Post on 07-Aug-2015
transcript
4/27/2015
jksdksd jh jhfkjhfsd 1
METRICS PROGRAM
IMPLEMENTATION:
PITFALLS AND SUCCESSES
By Kris Kosyk
HOW MUCH DO WE RELY ON DATA TODAY IN
PERSONAL LIFE AND BUSINESS?
� Productivity/Efficiency?
� Quality?
� Predictability?
4/27/2015
jksdksd jh jhfkjhfsd 2
• Measure (Data Point) – Quantitative indication of
the extent, amount, dimension, capacity or size of
some attribute of a product or process
• Measurement – The act of determining a measure
• Metric – A quantitative measure of a degree to
which system, component, or process possesses a
given attribute
• Indicator (KPI) – A metric or combination of metrics
that provide insight into the software process,
project or product.
DEFINITIONS
WHY DO MEASURE?
OPERATIONAL
METRICS
SDLC
METRICS
PROJECT GOALS
PROJECT
IMPLEMENTATION
4/27/2015
jksdksd jh jhfkjhfsd 3
WHY NOTMEASURE?
ANALYZE
RESEARCH OCEAN
OFMETRICS
SELECT
METRICS
BASELINE
NORMALIZE
START
COLLECTING
METRICS
WHY NOTMEASURE?
Data Points?
Who?
How many? Technology?
Format?
Process?Training?
Usage?
ANALYZE
RESEARCH OCEAN
OFMETRICS
SELECT
METRICS
BASELINE
NORMALIZE
START
COLLECTING
METRICS
4/27/2015
jksdksd jh jhfkjhfsd 4
ANALYZE
RESEARCH OCEAN
OFMETRICS
SELECT
METRICS
BASELINE
NORMALIZE
START
COLLECTING
METRICS
WHY NOTMEASURE?
Data Points?
Who?
How many? Technology?
Format?
Process?Training?
Usage?
Adoption?
Support and Maintain?
4/27/2015
jksdksd jh jhfkjhfsd 5
SOFTSERVE METRICS PROGRAM CASE STUDY
200+ PROJECTS
I AM VERY
UNIQUE!
60+ CLIENTS
3000+
ENGINEERS
IN 3
COUNTRIESGLOBALOUTSOURCING COMPANY
WORKING ON PROJECTS FROM
START-UPS TO ENTERPRISE
LESSONS LEARNT FROM
IMPLEMENTING COMPANY-WIDE
METRICS PROGRAM IN 9 MONTHS
WITH NO INVESTMENT BUDGET
4/27/2015
jksdksd jh jhfkjhfsd 6
MAIN LESSON LEARNT:
DO NOT OVERCOMPLICATE!
LESSON #1: DON’T BE DISCOURAGED BY
PREVIOUS MISTAKES
“It still works in theory!”
4/27/2015
jksdksd jh jhfkjhfsd 7
I AM VERY
UNIQUE!
What is our PERFORMANCE?
Do we deliver high QUALITY service?
Can we PREDICT our releases?
Can we COMPARE our projects/teams?
LESSON #2: START WITH YOUR GOALS AND
METRICS WILL FOLLOW
LESSON #2: START WITH YOUR GOALS AND
METRICS WILL FOLLOW
4/27/2015
jksdksd jh jhfkjhfsd 8
LESSON #2: START WITH YOUR GOALS AND
METRICS WILL FOLLOW
Structure your metrics in logical
way that works for you
LESSON #2: START WITH YOUR GOALS AND
METRICS WILL FOLLOW
Have this information available to
everyone at any time
Provide layers of information
4/27/2015
jksdksd jh jhfkjhfsd 9
LESSON #2: START WITH YOUR GOALS AND
METRICS WILL FOLLOW
Revisit list if necessary
LESSON #3: WHEN EXPLAININGMETRICS START
WITH DATA POINTS
4/27/2015
jksdksd jh jhfkjhfsd 10
LESSON #4 DEFINE TECHNOLOGY TO COLLECT
AND ANALYZE METRICS EARLY. TRY TO WORK WITH
WHAT YOU HAVE
DATA POINTS METRICSCALCULATION REPORT/DASHBOARD<flexible> <automated> <clear and beautiful>
LESSON #5: USE METRICS FOR UNDERSTANDING,
NEVER FOR PUNISHMENT
4/27/2015
jksdksd jh jhfkjhfsd 11
LESSON #5: USE METRICS FOR UNDERSTANDING,
NEVER FOR PUNISHMENT
LESSON #5: USE METRICS FOR UNDERSTANDING,
NEVER FOR PUNISHMENT
4/27/2015
jksdksd jh jhfkjhfsd 12
LESSON #6: FOCUS A LOT ON ADOPTION
LESSON #6: FOCUS A LOT ON ADOPTION
� Ensure INFORMATION
availability on metrics
� Pay attention to USABILITY AND
ACCESSIBILITY of your technology that is used by users
� Have TRAININGS for all stakeholders (project team, management, executive management) on how to use metrics for their decision making. Prepare for many trainings and mentorship in the beginning
4/27/2015
jksdksd jh jhfkjhfsd 13
LESSON #7: INTRODUCE GOVERNANCE AROUND
THE METRICS PROGRAM
Plan for dedicated person/team to support the program
� Continue trainings, mentorship and advisory
� Maintain metrics list
� Ensure data is valid
� Maintain report/dashboard
� Look for improvements
And Don’t Forget That…
4/27/2015
jksdksd jh jhfkjhfsd 14
TRANSFORMATION IS AN ERA, NOT ANEVENT!
ROLL-OUT IN AGILE FASHION, CONTINUOUSLY IMPROVE!
4/27/2015
jksdksd jh jhfkjhfsd 15
Thank you!
Kris Kosyk
kkosyk@softserveinc.com