Software Technology Transfer

Pekka Forseliuswww.sttf.fi

Practical aspects of data collection in industry

Why is measurement so difficult to institutionalise?

FiSMA cases and lessons learned

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

”Measurement”?

Software and system measurement is closely related to, and essential part of

”Measurement programs”, ”Data collection” and ”Benchmarking”. There may be measurement without any other connections or any public indications like those three above, but such is very difficult to survey.

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

Is measurement important?

• Both SPICE and CMMI standards demand evidence from measurement at higher maturity and capability levels.

• Common sense tells us that we need measurement and data collection if we want to set realistic business goals and quantify improvement.

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

Finland and software measurement

• Finland is (in many ways) one of the top countries in the Measurement World.

• Activity in software project data collection is also an indicator of maturity level.

Where does the ISBSG data come? (2005)

per capita Finland and Australia are the most efficient so far

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

ISBSG data collection histogram

• Getting better year by year

• 2350 projects by the end of 2003

• 4000+ projects by today (2006)

• Data collection looks popular and important!

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

Experience® data collection histogram• 750+ projects • The best

organisations at CMMI/SPICE level 4, several on level 3.

• SPI and project estimation training and consulting services are well established, benchmarking services available.

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

”Success” of measurement programs

Of 610 measurement programs in place in

1998, only 140 survived the two-year mark as reported in data collected by Howard Rubin. Moreover, Dr. Rubin's data points since 1988 show a consistent 78% or higher failure rate for measurement programs. [Dekkers and McQuaid, IEEE IT Pro, 2002]

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

Introduction to FiSMA measurement methods and data collection tools

• Experience® Pro 3.1• Functional Size Measurement

and Project Delivery Rate (FSM & PDR, FP & h/FP)

• 21 productivity factors for development and 22 productivity factors for maintenance (ND21 & MT22)

• Context variables (5-30) and other metrics details

• Data quality criteria 2005 (max 100 points)

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

FiSMA measurement principle

Same metrics, same methods and same tools throughout the development life-cycle and maintenance.

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

Sample of FiSMA cases – data collection 1990-2005

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

Company-99 story (template)• Market position and

competition• Ownership and visible goals• Measurement training, metrics

specialist recruitment and R&D activity

• Method and tool adoption approach

• Recognition of success, rewarding and career opportunities

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

Why do so many measurement programs fail? Critical success factors of SPI:

Source: P.Willman

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

CSF’s of FiSMA sample companiesCompany External

pressure Leadership and vision

Capable people

Actionable first steps

Rewards Current “ranking”

03 - + + + - 6 04 - - + + ? 4 06 + - ? + - 5 08 - - + + - 8 11 - + + - ? 3 12 - + + - - 7 14 + + + + + 1 16 + ? + - ? 2

3/8 4/8 7/8 5/8 1/8

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

”SPI trinity”

Improving measurement and estimation processes

Measurement process owner?

Top management connection?

Memberships in SMA-network?

Support and training?

etc...

Functional size measurement

Effort measurement rules

Classification rules

Situation analysis method

etc...

Experience Pro

MS Office tools

KnowledgePlan

ISBSG tools

etc...

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

People skills

• Situational leadership• Nonverbal language• NLP• Cultural aspects• Management by walking

around• One minute management• Statuses• etc ...

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

Software Process Improvement Map

Software Technology Transfer

Pekka Forseliuswww.sttf.fi

Finland is known as a technologically advanced and exceptionally competitive country, where the software and systems development is well managed.

Conclusions

... but many Finnish companies have still lot to learn:

-Realistic goals: what do they want to reach?

-Correct timing: when to start measurement program?

-Best practices and methods: what should they measure?

Let’s keep learning from each other!

Thank you!