Who’s who…

Priscilla Boiardi

Edith Kroese

Tomas De Groote

www.impactnetwerk.be

Warm-up

What is the one thing you would really like to learn about impact measurement in this workshop?-> THINK 1’ – TALK 2’ – TELL 3’

What would be the purpose to start with impact measurement in your organisation/business/context?-> THINK 1’ – TALK 2’ – TELL 3’

Reasons for impact measurement

58%MANAGEMENT

PURPOSES

25%FUNDRAISING

TOOL

20%MARKETING

TOOL

(SELUSI research in 2010, executed in Spain, Hungary, Romania, Sweden & the UK.)

Ingredients for impact measurement

Mission: action, benificiaries & target outcome

Stakeholders: affecting/being affected by the action

Logic model: chronological steps in creating impact

Theory of change: the assumptions behind the steps

Defined purpose of evaluation

Scope: focus on what to measure

Data/indicators

5 elements of a logic model (or ‘impact value chain’)

Input Activities Output Outcome Impact

Theory of change

https://www.youtube.com/watch?v=dpb4AGT684U

‘Does it work?’

Input Activities Output Outcome ImpactMission

challenges

Societal

Mission

challenges

Societal

Theory of change

Logic model

Efficiency-implementation:Performance measurement

Effectiveness: outcome/impact

measurement

What happens in the program?What resulted? What to attribute?

Side effect(s)?

(Based on Karen Maas: P+ Magazine – 2014)

A framework for decisions…

WHAT do we want to find out?

WHY do we want to find that out?

WHEN do we need the information?

HOW can we get the information we need?

WHO is the information for and from whom can we collect?

Fin

etu

nin

gfr

om

star

t

What to do with a jungle of methods?

(Example)

(Karen Maas: Corporate Social Performance, From output measurement to impact measurement – 2008)

How can we get the information?

Step 1 - Set Objectives

Step 2 – Analyse Stakeholders

Step 3 – Measure Results

Step 4 – Verify & Value Impact

Step 5 – Monitor & Report

Impact Measurement as a:

• General framework (process approach)

• Learning Process

• Management Tool

The Impact Measurement Process –

5 steps of Impact Measurement

The five-step impact measurement process

• Both funder and social organisation• More specific = better preparation• Many methods & tools available• Use to select investment• Speak the same language• Advocate IM• Allocate resources

• Identification & engagement• Co-operation crucial• Learning process• Engage upfront + regular revision• Consider timing

• Both funder and social organisation• Outcomes: importance, usefulness, feasibility• Indicators: used to monitor progress (in line with ToC)• Impact: consider drop off, displacement, deadweight,

attribution• Clarify responsibilities upfront• Portfolio measurement (?)

• “Reality check”:• Verify outcomes are

achieved• Choose the impacts with

the highest social value• Qualitative & quantitative

methods• All stakeholders

• Monitor = tracking progress + collect data

• Integrate into management process• Costs and requirements to be

negotiated upfront and included in plan

• Reporting = Transform data in formats relevant for key stakeholders

• Feedback loop• Numerous tools and resources

available

Qualitative – quantitative data?

Indicators for impact measurement

(Antonella Passani (Red.) : Impact Assessment for Social Innovation - 2014)

DOING

THINGS

CSR

Sustainability

ESG

opportunities Mission = impact 1st

Social enterprises / Foundations

DOING THE RIGHT

THINGS

DOING THINGS

RIGHT

Finance

Contributions to cleaner air in

Amsterdam and improved taxi

service

1% less cars in Europe

Tries to createconditions for most

optimal form of participation.

http://www.social-enterprise.nl/impact-first/

1 Define goal and scoping

2Develop Theory of Change

3. Data collection5 Reporting & communication

4Sense making & conclusions

A framework for decisions…

Research:

1. Social impact

2. Economic impact

3. Environmental impact

Measured:

Questionnaire to active renters and owners

In depth interviews

Literature study

Available data of SnappCar

Impact of the peer to peer car-sharing

1. Economic impact

Earnings of 1,1 million for owners

60% is more positive about sharing and exchanging

2. Environmental impact

17% postponed to buy an own carOne part of renters drives more km but total reduction of 320 Ton Co2-eq

Findings

3. Social impact

Improved social network40% mentions contact is important, 20% meets outside of rental interaction

Helping others1/3 is more willing to help others

Social cohesionengagement as indicator for cohesion

More findings

1. How do you make sure costs are within proportion and possibilities

2. It is my impact! Right?

3. Can impact always be translated into Euro’s?

4. How do you use impact? How to manage for impact?

5. The bigger they are, the harder the fall…

Dilemma’s on the way

Experiences

1. 70% of the effort was in the first two steps

2. Where it get’s difficult is where the learning takes place.

4. Measuring impact lead to sharpening the proposition.

5. Communication got less important