ESF Innovation, Transnationality & MainstreamingEvaluation workshop

Birmingham, 28 Sep 2010

Getting value from transnationality

Toby JohnsonAEIDL, Brussels

toby.johnson@poptel.org

11

Value of transnationalityCommission support

22

Learning for Change13 networks among ESF managing authorities:

inclusive entrepreneurship, social economy, youth, migrants & ethnic minorities, ex-offenders, age, asylum seekers

empowerment & inclusion, partnership, transnationality, administrative capacity-building, results-based management, gender mainstreaming

Common methodologies7 chapters: planning, consolidating, online networking,

peer reviews, evidence, mainstreaming, evaluation

Value of transnationalityFlanders: 3 goals for transnationality

33

To stimulate and support innovations through exchange of research, technical and practical techniques and experience

To validate and disseminate knowledge and experience, as a result of which we can avoid duplication of investments

to increase the capacity of the participating administrations and organisations

Value of transnationalityFlanders: 4 types of transnational co-operation

44

1. ESF authorities: exchange of experience, practice and ideas concerning the preparation, implementation, monitoring and evaluation of all elements of the Lisbon process in general and those of the ESF in particular.

2. Organisations or geographical partnerships: cross-border matters concerning the development of the labour market, but can also relate to broader matters of cooperation.

3. Thematic networking concerning specific topics or problems. Several stakeholders or groups with a specific interest can cooperate on several topical themes.

4. Projects: cooperation such as the one organised under EQUAL in the period 2000-2006.

+ individuals?

Benefits for ESF trainees

55

enhanced vocational skills language and communication skills understanding training & employment

situations in other countries re-evaluation of their own situation

and maybe higher motivation higher ambitions contacts to get work

Benefits for project staff

66

improved methods new language, communication & problem-

solving skills raised self-confidence a mirror: raised awareness of strengths &

weaknesses of their national systems & own institution

re-evaluation of their own situation

Benefits for project promoters- operational benefits

77

learning new ideas expert opinions on one’s own products extending & improving existing courses,

materials & methods pooling expertise to jointly create new

products finding new business partners acquiring new skills enhancing capacities through joint research

Benefits for project promoters- strategic benefits

88

build contacts access to European networks & markets stay at the cutting edge benchmarking: contrast approaches in

different countries better understanding of policy

developments status & reputation as open-minded

innovators spin-off: ideas for future projects

Benefits for managing authorities

99

underpins reform in employment & social policy

cost-effectiveness:transfer is cheaper than reinventionimpact is maximised (ICDL used in 148 countries)

speeds up social innovation

Value of transnational co-operation among EQUAL projects

1010

better understanding of legal & institutional contexts

better dissemination of innovative results ability to transfer social innovations develop true European mindset establish formal & informal networks

Ruth Santos, An investment in Europe’s present and future: the added value of transnational co-operation at project level under EQUAL. Ecotec, 2005

Extracting added value from transnationality

1111Learning Networks Seminar, 28-29 June 2010, BrusselsLearning Networks Seminar, 28-29 June 2010, Brussels

be clear with potential partnersdefine what you want to get out of itdefine what you are able to put into it

link it to a change you wish to bring aboutthis defines what you need to learn

Evidence-based policyIs it scientific?

1212

public policy informed by rigorously established objective evidence

issues:complex & changing environmental conditions are

irreproducible control groups are difficult to compareethics (guinea pigs)policy cycle too short

What is “evidence”?Definition & usage

1313

“that which can be seen” (Latin) a physical trace of an event (law) a fact that enables you to tell whether or not

an assertion is true (science) something that tells you whether or not a

policy is working, or is likely to work if scaled up and mainstreamed (policy)

Collecting evidenceTypes of indicators

1414

input or activity indicatorscosts

output indicatorsdirect effects

result or output indicatorsconsequent changes in behaviour

impact indicatorswider socio-economic effects (usually too early to say)

Collecting evidenceRelationship among levels of indicators

1515

Collecting evidenceCollection methods

1616

hard evidence = statisticslabour market & social statistics on Eurostatpress articlesprevious policy & evaluationsnumber of trainees, hours etc.immediate results

soft evidence = opinion surveysstructured interview / call centre / focus groupcard exercise / exit questionnaire / vox populionline questionnaireomnibus survey

Presenting statistical evidenceWhat is entrepreneurs’ experience of the business support services? (COPIE)

1717

Presenting case evidenceScientific data collection

analytical case studies:enforce comparabilityshow up weaknessesmany sectionscan be compiled into a databasemay be suitable for Wikipedia (neutral, notable,

referenced & encyclopaedic in style)

use for working data

1818Learning Networks Seminar, 28-29 June 2010, BrusselsLearning Networks Seminar, 28-29 June 2010, Brussels

Presenting case evidenceA good story

1919Learning Networks Seminar, 28-29 June 2010, BrusselsLearning Networks Seminar, 28-29 June 2010, Brussels

Presenting case evidence Journalistic case studies – content

catchy title context & problem main actors & key messages describe the interesting parts of the activity how key principles were applied (e.g. in

EQUAL: empowerment, innovation, partnership, transnationality & mainstreaming)

use for final publication

2020Learning Networks Seminar, 28-29 June 2010, BrusselsLearning Networks Seminar, 28-29 June 2010, Brussels

Presenting case evidence Journalistic case studies – format

not too long make it easy to select & skip:

headlinestandfirstcrossheadskeywords

photos & diagrams

2121Learning Networks Seminar, 28-29 June 2010, BrusselsLearning Networks Seminar, 28-29 June 2010, Brussels

Presenting argumentsPolicy brief

2222Learning Networks Seminar, 28-29 June 2010, BrusselsLearning Networks Seminar, 28-29 June 2010, Brussels

Presenting argumentsPolicy brief contents

title problem relevance – to policy and to people the solutions that have been tested

what made the differencewhat underlying principles are provenhard facts & figures

lessons learned policy recommendation

2323Learning Networks Seminar, 28-29 June 2010, BrusselsLearning Networks Seminar, 28-29 June 2010, Brussels

Elevator pitch – 6 steps to proving the value of transnationality

1. define what value you wish to obtain

2. design the project to deliver that value

3. define at the outset what change you wish to bring about

4. work out what evidence will demonstrate that change

5. collect the data (before & after)

6. present it effectively

Learning Networks Seminar, 28-29 June 2010, BrusselsLearning Networks Seminar, 28-29 June 2010, Brussels 2424