Post on 16-Jul-2015
transcript
Task 1
Lease Management Case
1
Metrics for Software Managers
Fall 2014
Presented by: Team Touchstone
Dibyendu Roy, Felix Amoruwa, Jennifer Li, Pallavi Mathane, Susana Lau, Tushar Dadlani
AgendaProject Background
Approach - Goal-Question-Metric Diagram
Key Metrics/Reports
Team Decisions & Insights
Reflection: Lessons Learned
A Real Story
Q&A
2
3
Project BackgroundLease management portal
30 Developers + 20 Domain Experts
3 Years
Over 1000 stories
18 months plan-driven + XP
Tarak
Issue 1: Missing Deadline
4
Issue 2: Changing Requirements
5
Issue 3: Integration Failures
6
Assumptions
Stories are not of equal size and same priority
Requirements can come in any time
Team can accurately estimate hours/story
Nature of the project can’t be changed
7
Goal- Question - Metric
8
Velocity Defect Density
Key Metrics
9
Existing Metrics
http://aea365.org/blog/2011/10/page/2/
Story point Variance Variance of deadline over time Percentage of accepted story points by customer Attrition rate Unit test & integration test success rate
Suggested Metrics
Velocity Reports
10
Burndown & Burnup Charts
11
Defects & Tests Reports
12
Dashboard
13
http://howto.commetrics.com/articles/who-benchmarks-against-you/
Team Decisions & Insights1. How many goals to consider?
2. How to include different stakeholders?
3. How to present GQM in a meaningful way?
4. Important to provide actionable items for stakeholders based on reports
14
Task: What Worked
15
Suitable Hypothesis
Well Defined Goals
Questions
Metrics
Well Structured Reports
Actionable Items
End to end workflow
Task: What To Improve
16
Supplementary reports
Deep dive into existing tools for similar projects
Better understanding of what is absolutely necessary
Teamwork Reflection: What Worked
17http://raedevelopment.com/wp-content/uploads/2012/09/team-hands1.jpg
http://shirtoid.com/wp-content/uploads/2010/08/brainstorm.jpg
http://www.learning3pointzero.com/wp-content/uploads/2011/03/listeningBowler.jp
http://pdci-network.org/images/stories/consensus.jpg
Teamwork Reflection: What To Improve
18
Strategy
A Real Story - Sentinel
19
“10 years of ‘Waterfall’ failure and $800m of waste”
Background
2001 Virtual Case File (VCF) - FBI’s IT Modernization Project
2005 730,000 lines of code never worked properly
Abandoned after spending $170 million
2006 Award of a $305 million contract to Lockheed Martin
to develop Sentinel
20
However…Aug 2010 project was only half done …
… and $100 million over budget
Sep 2010 new Agile methodology development strategy
July 2012 successfully deployed ~$500 million
21
What Worked - Agile
• Organized work into 670 ‘user stories’
• To be developed over 21 sprints – each 2 weeks long
• Assign story points based on difficulty
• Demos every other Friday with a host of stakeholders
• Only stories passed tests claimed completed
22
Questions
23