8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 1/19

Evaluations for Evidence basedEnvironmental Programs and Policies

-from a European (and Finnish) perspective

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 2/19

Evidence based policy – Background

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 3/19

Evidence-based policy in Europe

Based on Hansen & Rieper 2006

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 4/19

Evidence-based policy in Europe

Based on Hansen & Rieper 2006

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 5/19

Evidence-based policy in Europe

Based on Hansen & Rieper 2006

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 6/19

Po lic ie s based o n sy stema ticrevie w & a “h ie rarchy ofknowledge”

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 7/19

Key phases of systematic reviewand some comments

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 8/19

Evidence for environmental programsand policies

“Recently Pullin et al. (2004) and Sutherland et al. (2004), among others, have demanded that conservation efforts should be based onmore solid evidence than previously . In the UK, these studies claim, theconsequences of conservation efforts are rarely documented,systematic reviews of previous experiences are seldom made and research data are scantly utilised when new management plans aredrafted.”

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 9/19

Evidence in law, according to Wikipedia and some interviews

"The law of evidence governs the use of testimony (e.g. oral or written statements, such as an affidavit) and exhibits (e.g.

physical objects) or other documentary material which isadmissible (i.e., allowed to be considered by the trier of fact, suchas jury) in a judicial or administrative proceeding (e.g. a court of law)."

“Beyond reasonable doubt”“preponderance of the evidence” All the evidence is judged together, i.e. many different sourcesthat would not be enough proof alone may jointly be considered enough – triangulation in evaluation.Narrative synthesis, very different from Cochrane Collaboration.

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 10/19

What do I mean by evaluation?

" careful retrospectiveassessment of the merit,

worth and value of administration, output and outcome of government interventions , which isintended to play a role infuture, practical actionsituations ."

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 11/19

What are the practical situations were theevidence is intended to play a role?

“Intended use by intended users”.

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 12/19

Example: the evaluation of the FinnishEnvironmental Protection Act

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 13/19

Who produce the evaluation affects it role asevidence (who is a credible witness).The small country dilemma: National or international evaluationteam?

(How many air emission experts are there in Finland?)

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 14/19

Evaluations of legal acts in Europeduring the era of the Lisbon agenda

“make Europe, by 2010, the most competitive and the most dynamic knowledge-based economy in the world”.“Releasing our creativity from the restraints of red-tape is thebest way to push forward our ambitious goals for the economy,for the society and the quality of life of our citizens. If we canimprove the regulatory environment both at EU and national level, we will take a giant step towards unlocking Europe’shidden potential.” “If it can’t be Lisbonized then it should be terminated”

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 15/19

Timing of evidence by evaluation iscrucial

Ex post evaluation

Ex anteevaluation

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 16/19

“Intended use by intended users” as a guidingprinciple for evidence is not unproblematic

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 17/19

Evidence by evaluation depends onmany case specific aspects

" careful retrospectiveassessment of the merit,worth and value of administration, output and outcome of government interventions , which isintended to play a role infuture, practical action

situations ."

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 18/19

Take home message

8/14/2019 Per Mickwitz

http://slidepdf.com/reader/full/per-mickwitz 19/19

Some European sources aboutevidence based policy

The Institutionalization of Synthesized Evaluative Knowledge: Adoption, Methods and UseEvidence-based Policy: A Realist Perspective

What Works? Evidence-based policy and practice in public service