EEA Grants Norway Grants

Juliet Martinez

Results and Evaluation team

What are results?

1.Context

2.What do we mean by results?

3. Examples

4. Monitoring

5. Reports available in DORIS

Overview

• What do we have now?… a lot of inputs

• 2015 starting to see resultsQuantitative + Qualitative

• 2 key objectives

• Need to disseminate results: project level, country level, sector level

Context

Many levels: project, programme, country, sector, overall

Quantitative - Number of NGOs supported

Qualitative - Change in attitudes towards discrimination

Evaluation report findings - NGO programmes are key source of support in BS

What are results?

Main reports to analyse progress and results

What is the Results Framework?

‘Create the story’ of progress towards results

and follow it through each level of analysis

These Reports, together with Evaluation findings,

show progress towards results

Annual

Programme

Reports

provide

qualitative

information

Report 44 Aggregated results

Report 15Individual programme summaries

Report 41

Project information

Report 35

Bilateral engagement report

Aggregated results = achievements at the level of

the grants overall

Programme level results are aggregated across programmes,

across countries, generally by PA.

Examples:

• Over 40,000 beneficiaries reporting improved access to basic and

welfare services (GR, HU, LT, RO, SK)

• Over 500 NGOs working on the promotion of democratic values and

human rights (BG, EE, HU, LT, LV, MT, PL, PT, SK)

• Over 200 bilateral partnerships formed on cultural heritage projects (CZ,

EE, LT, MT, PL, PT, RO, SK ,SI)

• 23 Environmental technologies developed (BG, EE, HU, LV, LT, RO, SK)

• 13,000+ trained legal professionals and staff (BG, CZ, LV, LT, MT, PL, RO)

Key Achievements 2014: High level

What’s the difference? The output indicator will be a number. The outcome indicator is showing a change; ie a trend/a percentage/a change in attitudes or behaviours.

PA Domestic and Gender based violence

• A number of programmes in BG, CZ, EE, PL, SK are supporting awareness raising campaigns on GBV.

• Output indicator = Number of awareness raising campaigns on GBV.

• An outcome indicator is needed to measure the effect of these awareness raising campaigns = Levels of awareness on GBV (in the target group)

Eg: Programme Area

Country level results – Bulgarian justice sector

• A number of programmes in BG are focussed on training -of judges, of magistrates, of legal staff, of prisoners and probation staff

• Other supported activities include improved access to justice for marginalised groups, including legal aid centres and a hotline.

• In addition, support is given for people to follow alternatives to prison. And some prison conditions are being improved.

• (These are all outputs). The overall outcome is that the capacity of the justice sector in Bulgaria is being strengthened.

Eg: Country + Sector

Bilateral results in the Research and ScholarshipsSector

• Across the entire sector over 400 mobile students and over 300

mobile research staff, supported by the grants (CZ, EE, ES, LV, LT,

PL, RO, SK, SI)

• Over 700 researchers working on joint projects including over 400 in

Romania

• There are over 300 BS and DS research institutions co-operating

within the sector, including over 150 from Poland

• Some Joint publications

Other sources of information on Bilateral results:

- Bilateral indicators in Report 44

- Report 35 in DORIS shows ‘intensity’ of bilateral cooperation:

- Relevant sections and Attachments to the Strategic Report

Eg: Bilateral

• Collecting data in a timely and effective manner (the ‘right’ data)

• NFPs/POs need to report fully on outputs, and on outcomes.

• Baselines – should be zero for all outputs, should not be zero for all outcomes……

• Targets – better to analyse the reasons why target not met than to change the targets to fit the achievements!

Monitoring

Summary

- We have results to communicate!

- Try to ‘tell the story’ of results

- Use Doris Reports (and give us feedback!)

- Evaluations: NGO, Cultural heritage, study on Roma inclusion, Bilateral, etc.

- Ask POs to Quality Assure data in DORIS

For comments or queries:

Juliet Martinez jma@efta.int