7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 1/27
Sources of error in Software Estimation for MedicalDevice Development Projects
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 2/27
“That’s the wrong answer… ”
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 3/27
According to the 1994 CHAOS
report the average cost over-run for software projects is
189%
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 4/27
Builder estimated cost as part of scope definition
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 5/27
The Need for earlier estimatesy Projects are a function in 4 variables
y Scope
y Resources
y Schedule
y Quality
y If Scope, Resources, and Schedule expectations arenot realistic
y Quality becomes the inevitable loser!
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 6/27
Estimation is seen as part of
Schedule Development
Project TimeProject Scope ManagementManagement
•Define Activities
•Collect Requirements •Sequence Activities•
Define Scope•
Estimate Activity Resources•Create WBS •Estimate Activity Durations
•Develop Schedule
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 7/27
The Dilemma of Scope
Definitiony Outputs from Define Scope Process
y Product scope description
y Product acceptancecriteria y Projectdeliverablesy Project exclusionsy Project
constraintsy Project constraints usually includes scheduleand resources
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 8/27
The dilemmay Defining scope without estimating the impact
of restraints leads to failure
y But we don’t do estimation until after the scopeis defined
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 9/27
Mr Honcho,the VP says “We need a scope statement but don’t havemuch time to coordinate.
•Mr Earnest, you make a list of everything you can think of that you’d
like it to do.
•Mr Eager, you decide how long you want to wait for it. • We’ll paste
your inputs into the scope statement, approve it and send it to the
developers next week.
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 10/27
The Challenge !yWe need a data driven
estimation tool that can
be employed prior tomaking decisions of scope and constraints
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 11/27
Otherw ise we’ re stuc k w ithIndustry standard definition of
“Estimate” y [The common definition of
estimate is] "the most optimistic prediction that has anon-zero probability of coming true." … Accepting this
definition leads irrevocably toward a method called
what's-the-earliest- date-by-which-you-can't-prove-you-
won't-be-finished estimating
Tom DeMarco—
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 12/27
“How long will it take you to do this in six months?”
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 13/27
Why do w e fail to estim ate ?
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 14/27
The Cone of Uncertainty
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 15/27
Estimate
Targ et Schedu le
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 16/27
Estimate, Target or Plany Estimate -- “a prediction of how long a project
will take or how much it will cost.” *
yTarget - “i s a statement o f a desirable bu sinessobjective.”*
y *Steve McConnell, Software Estimation
y Plan -- an expedient methodology for accomplishinga required effort (possibly from an estimate) within theconstraints imposed by a target. Example - a schedule.
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 17/27
Definiti on of an “Estim ate”
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 18/27
The Solutiony Expert Estimation during Scope Definition
y “Expert judgment, guided by historical information, can
prov ide du ration es tima te in f orma tion or recommen dedmaximum activity durations from prior similar projects.”
y PMBOK Guide, 4th Edition, pp 149.
y Expert Estimation can be applied to earlier phases of the project
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 19/27
Method for Expert Estimationy Get as much definition of expected scope
and requirements on paper as possibleCWBS w ithh det ailibl yreate aas mucas
possey It helps to have a standard template with deliverables of
your development process already populatedy Distributeto Subject Matter Experts y Collect 3 point Estimates
for each tasky See PMBOK Guide 4, pp 150)
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 20/27
Method for Expert Estimationy Collect estimates and compile as appropriate
y Calculate Expected Values according to the PERT
f ormu lay Expected Value = (BestCase + 4*LikelyCase +
WorstCase)/6 y Calculate Estimated StandardDeviationy EstStdDev = (WorstCase - BestCase)/6
yPresent Estimates in terms of y Expected Effort
y Uncertainty bound
y(Expected + 1 StdDev) = 84% confidence
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 21/27
Example - Subway SandwichTask Best Likely Worst Expected Estimated
StdDev
Wait in Line 0 sec 45 sec 180 sec 60 sec 30 sec
Build Bread/Meat 20 sec 40 sec 120 sec 50 sec 17 secSubassembly
Add Cheese Accessory 5 sec 10 sec 20 sec 11 sec 3 sec
Compile Veggie 10 sec 25 sec 90 sec 33 sec 13 secOptions
P rocess mone t ary 20 sec 100 sec 200 sec 103 sec 30 secexchange
Complete Drink 30 sec 48 sec 90 sec 52 sec 10 secdelivery
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 22/27
Example - Monte Carlo Analysis
Certainty 1.2Time (sec) Certainty
1
220 0.02 0.8
0.6
264 016 04
0.2
309 0.5 0
0 100 200 300 400 500
354 0.84
84% confidence Project will
complete within 5 min 54 sec398 0.98
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 23/27
Example - Analysis conclusionsy The sum of Best Case estimates (85 sec) -
probability of completion on time would bey ~ 1i n
400,000y The sum of Likely Case estimates (268 sec) -
probability of completion on time would be
y ~ 1 in 6
y Best estimate is 354 seconds with 84% confidence
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 24/27
References and Recommended
Readingy Steve McConnell, Software Estimation: Demystifying
the Black Art. Redmond WA: Microsoft Press, 2006.
yRo n R ammage et. a l ,E xpert So f tware Dev elopmentEstimation with Uncertainty Correction, SEDM IEEE Proceedings, June 2010 (See additional slides section)
y Tom DeMarco, Controlling Software Projects: Management, Measurement & Estimation. EnglewoodCliffs NJ: Yourdon Press, 1982.
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 25/27
?
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 26/27
For notes and Q&A
7/31/2019 Ron Rammage Earlyestimation
http://slidepdf.com/reader/full/ron-rammage-earlyestimation 27/27
E xpert Sof tware Dev elopmentEstimation with Uncertainty
CorrectionRon Rammage, Hairong Lei, Michael Claus, David Baer. SoftwareEngineering and Data Mining Conference, Chengdu China, June 23-25, 2010Proceedings published by IEEE, Conf #16902
Abstract- Creation of an effective metrics and estimation program is an importantbut daunting step for the maturing software development organization. This
paper outlines a roadmap for implementing a process that establishes a programthat will reap a large portion of the benefits early in the process with a minimumof implementation effort and cost. This process includes a mechanism to improvesoftware estimation accuracy as historical data becomes available for moresophisticated methods. Furthermore, we present a practical proposal for softwareestimation in industry based on software task size, complexity, and uncertainty.