+ All Categories
Home > Documents > Evaluation in health promotion : principles and perspectives / edited by

Evaluation in health promotion : principles and perspectives / edited by

Date post: 30-Dec-2016
Category:
Upload: doanbao
View: 216 times
Download: 0 times
Share this document with a friend
561
Ev Ev alua alua t t ion ion in healt in healt h h pr pr omotion omotion Pr inciples and inciples and perspectiv es es Ev Ev Ev Ev Ev Ev aluation in health pr aluation in health pr aluation in health pr aluation in health pr aluation in health pr aluation in health pr omotion omotion omotion omotion omotion omotion WHO Regional Publications European Series, No. 92
Transcript
  • EvEvaluaaluattionionin healtin healthhprpromotionomotionPrinciples andinciples andperspectiveses

    EvEv EvEvEvEvaluation in health praluation in health praluation in health praluation in health praluation in health praluation

    inhealth

    promotion

    omotion

    omotion

    omotion

    omotion

    omotion

    WHO Regional PublicationsEuropean Series, No. 92

  • Evaluation in health promotionPrinciples and perspectives

  • !"#$

    %#&'#()*

    +# )#,-# .#/ 0#12#3 4# 5# # 6#768 #69:#8;6:#:#6 :#/6< :#=6 :#/

    /9' ()5(>+-0(+ %'8? @0(>*//' >-45A))00

    8/B9

  • Evaluation in health promotionPrinciples and perspectives

    Edited by:Irving Rootman, Michael Goodstadt,Brian Hyndman, David V. McQueen,

    Louise Potvin, Jane Springettand Erio Ziglio

    WHO Regional Publications, European Series, No. 92

    HealthCanada

    SantCanada

  • /9'()5(>+-0(+//'>-45A))00

    C ????DBE?6?

    #@E6 ???6/?F56GA)+>>H636BB

    ?I6?B6

    #

    ?DFB?)?1A#@

    #

    C?A

    I?B?/?D?66?6A??#C??3B#

    C????JD??#I6?A#

    CBI???D#

    3

  • AcknowledgementsC3BDB?6B???

    #/ 3 6? 37@#KA

    6B?6?1/?@@1G#

    AbbreviationsOrganizations9/ 9/61G ?61/'/ 'B3?/1 1K@ K@D?1'/ D?/D@ @61G'/ '/61G

    Specific studies and technical and other terms .7 ?A@C @C?' B

    88C ?3: @L AF?@ 7 @ G/ GB3/F8@C 8 KC 8 3KC@C '7 D'M@/ 'I@/

  • 6?

    66D?

    ;@L EAF?

  • Foreword

    !

    "

    #$%

    &

    '$

    ##

    (#(

    $)

    #

    *

    &

    +(

    *,&

    &

    &&

    #

    +

    -

    &$

    &

    *

    &

    %

    &

  • "

    "

    &&

    $

    &(

    & ( $ &

    )

    $

    #

    8D ?

  • I

    WHO European Working Group onHealth Promotion Evaluation

    @/6??616?6@61/@

    @/6?@6'?6?6@61/@

    8'3

    ?6@661G

    9K

    6 61?

    661/@

    876?61?C6

    7I6' 6?868B6 K

    896?61?C6 .!

    7B/@6966B6

    86@661G

    836'?696

  • I

    8;@?76'?6?6@61/@

    C8??68?/@??636K

    7N61N8N68N6

    6?61?C6 +!

    C/6?'@6?6@61/@

    /

    /36?/6 ???663

    +*#9B+(()+((56B/A7? @ ? / ? %@/ *# / I B 6+((4B7 A?.?633?6A6 B6 ?A6 # KB??6

    D6

  • I

    371A?G61/#/B3?F37+((-#B3

    6

    B

    #

    /&"-&&@?37A6@?B ?6 @F@ ?B?861?G8/1?G61/#K6

    A6B3BD#A???6?A?A6?3?66#

    # $ - / ? 9 K66@? ? @?? 1 ?9#K3J A?A3A 6 ? ? ? 6 D ?6 ? 6 ?6B

    E??6A?3B?#3?6#A I I 6 B

    D#BD?A#F?A6 ? ? ?#

    /&-$6##6@?61/6

    DA#KB??A?/1?8A

    6

    366???#??A1/#@@ ?6 A

  • I

    6?#

    0-&A?

    BA/?61??69361/#/A?

    BB?A? #?#

    +(%1?86#/K

    B?ENNA#9?6B38J??:A#??BJ#

    #%1 ?? ? / 1 ? L36 1G# / ? +(5.6

    ? L3#? 1?L3/C?81A6 A

    #/ 3 6 #/?I?/A?/?@#

    &%?? 1 ? C6 %

    * @ ? 1J ? 8J#?/?161/%##6+(2(*8161G%9#@#6+(2-*#?I )0 / @ K6C6&- 1J?@/6'B

  • I

    ??/36?

    A7C?#?GKK:AA?K6??>+*#

    0 @? 1?G861/6B3#9?F8?+((56B?37?1?G#

    $BA16?61?C66/8 16B#/81?

  • I

    C6 ? F ? ? ? @ K6 ?C?6#BA? 6 #6?? 6 @ K 9 K F6 'B C6 ' K 6 C3K?#K+((4+(((68B?@#

    0 ?

    B 1 ?61G6#/ ?? F 7B#

    +*0231/B/9

    +(5>6?31?@#/BI?B9

    6 / # +(5568 E3 3 3BAB F ? # +((-6 1?//?63A#GBJ???AF36?A#

    $0,69#@#6)>>>6@6761/#1?6/#

    06??)>>>6A?@6761/6B/K

    B'?A#6?AA#

    BAIBB???A#+(5),+((>6GA????#

  • I

    # ? @ ?966+((5#9?6?A?9#B31 ? 9 J ? 66AA3#

    )+(??6L1/?861/#???

    A? ?A666A?A?#

    30)??/16G61/#/ ?1?G8?1?G8/#/ABB36?G#BI D6# ?A66A666:@/#

    4&/?/D6?61/#/ ? L / ? D 8# / # 8 D I I A ? 6 :@/6F6#

    #,?K?B?37?1?GA61/#8DA?6#

    *(/&5/9 /@?7'?A61/#9?6??@@

  • II

    ????/

    @'?#9? F6B?? 1 9 1?61G%+(5-,+(()*66@??9/#@53+>>.>6F4A# / ? @6 9D66 K6 '6 'B =6 / 1G6 B

    1 /# 3 &

    %@@6861?86)>>>*#

    ! )@?37@ ??/???//1?G61/#/A?? ? GK#/

    6 B3 B #/A

    B?6 ? # / F?6A#/A??A6A6 6 #

    3& ! ? I ? @61G#9?6B ?AC?#

    !(???/861?86#/

  • II

    8 ? K ? / E#??#

    *3,##?A ? / 61 ? C6 6

    9#/#?93

    8#/#A?/1?'BL36#@??/ ?@? 8?/1?C# A?;?? 11J ? # ? I A6EA?A?6?# EA?A??6BA#?E???B 8C66F6? 6 E ? ? ? &?%BBB##E6(>+*#

    !$3@?? A@?/?'1?96#B36B76B8 ?GA

    K#/ /?? # ? # /? F?F6??AB363A6#

    &3&@?6K?'61?8A6 # / @B ? 8 ?# ? ???#

    0$2!3&68###6##6 @?A?8G1861/#/??

    BJ/?'?

    6 ? ?/A@?/@8/@?1/?/#@? ? 37

  • II

    1 ?G6 J B3???3??#A

    636?66A6E#

    6(3$????/1?C6A#9?F1+((>6?6??/16BB?A???JA#6?6?

    #

    +3?37A? ? 1 ?G61 /# A8BA7/?//1#A66A ? # A ? #B3DBAA?A#

    137? ? A??//@/C1 ?D67#8 :? ? L1# ?8@ /% ? ? ???*6F# PB3?B??A#

    +&@?37@F@?A86 @ 1?G61/#/D##A?1?G1A?'3#

  • II

    G?#A 6 B? A3

    #/DA?A?A#A????#??D6?#

    +,??A

  • II

    ??# ?6 ?A ?B

    ?#

    3?BF?+((>#IA?#6 ? 6 1 ? C ? J91#BF 3? ?6I3??FF#8 I I 666?I ?A#8B?A??6 6 J?8?#IIA?76BAF6@/AF??B3BBDB3 #8A?##

    '$ ? ?B B 371?G61/#/ I 6B

    A #8

    ? A

    BI??#/I?A6B6?#

    3&F?F3 ?# IA?B?A#II??6BB?#B?F6@/AF??B3BABDB3#

  • II

    868###6/6???A 1?

    661/#AA????6??

    #

    '9 @?/ ?? ?#9? F6B3 ?+)

    6'@#B3B+(5+#

  • II

    Contents@3B ######################################## @ ############################################# * 37#### I############################################## I

    Part 1. Introduction and framework3,"0

    ###################### -+# @?B3?,"0

    12

    3/. 4

    Part 2. Perspectives,3 ################################# .+)# 9

    ?,3.453* .0

    -# ,671831% 2-

    .# ,/. 5-

    0# C?

    BEE,.2 +>4

    2# ?EA?A?,60 +)-

    4# ?,+2 +.(5# BE

    ?B3,0 +4+(# B3?

    D(3 +50

    Part 3. Settings,12

    )>(+>#

    ,330 )+-++# ?

    ,.9*%%7*/.,50

    /9&/#3*

    053+13,.0

    3)5/4 ).+

  • II

    +)# ?,..9 )4+

    +-# B3,36/. )50

    +.#

    ?,3+/.%5 ->(

    Part 4. Policies and systems,6718/. --4+0#

    I,%0: -.++2# ?

    3,;1 -20+4# ?B

    I,0)"0

    0&) -54

    +5# ?,+/*&3)2%0+&+3 .>0

    +(# /?,1)5;%3,3# ,..##################################### .2-

    )+# A,7&*2+.65 .40

    ))# ??,=.43.3 .(-

    Part 5. Synthesis and conclusion)-#

    ,1.2

    9467183"0

    /. 0+4

  • Part 1Introduction and framework

  • Introduction to the bookIrving Rootman

    WHO European Working Group on Health Promotion Evaluation !"" ""!#"""!$"" %

    &" ""!$

    $'() * +* ( ,*+*- ./0"*0!,01+0!-.2!" ' " *" . /3

    "!3$4"$" " ' #5!6778"'9

    "!!!!$

    #%9

  • :

    ; "&&3

    ; !$&!

    Process%$ '" !*+*"0"* "#*(5"#677?!$*(+677@0 " "$

    #$!'0 "'"!!$!!'

    Guiding principles!'"$ $/!"',"-9

    ; ,$"-3

    ; !,-3; ,!""-3

  • 8

    ; , $-3

    ; &,!&!%-3; ,

    -3; !,!1 !$

    ""!""$!"1-

    "'0""!"$9 !$" ! " "!!/"!$"$$ " ! ""$>!" 9

    $ $

    Limitations and strengths 0""$"%!>"! " "!!*6$!

    $'""!/!"$3#"' *(0'$"$",*6-

    >!""!

  • A

    '

    !"

    ! > " 'B !$ C"

    ! D *E

    Structure !!"!"

    !$$ " " " !$$ '

    References6

    !"#$*"$

    "6778,-

    E %&'()*'%+,&-) .( /

    0 10 ,0 *10 2/ 3450

    66#*""6778 78/

    8

    (

    /9

    :

    &-02+09(

    042/663#'""677@,$-

    : &/(+

    %&')%+,&-)#

    *""677@,.F#*(F#G/=8=6=-

    8 /(#

  • ?

    1A framework for

    health promotion evaluationIrving Rootman, Michael Goodstadt,

    Louise Potvin and Jane Springett

    3"$ "

    What is health promotion? " !B!"! 9"3!3

    Recent origins 0"!0"67?:*"4H"18

    :!!!!#&!$!"/./"!""#67@A"#*(

    *("

    0$9

  • @

    6 &!3E B "

    3

    3:

    !!3

    8

    "!!!

    'I"""$9

    A !"$"$"3

    ? $B"&3

    @ $!!3

    7 "36=

    9 " C"

    &D

    ,'I234I)5$-

    >!" " ! !"!"&!""!64

    "50" !$9

    6 3E

    3 $

    "3: "

    !38 !!"

    "!3

  • 7

    A 3053?

    !

    / ,6 8-"

    ,E1A?- "%!$

  • 6=

    $!,->!"!$ % > " $!"&

    Table 1.1. Definitions of health promotion

    +"%$" 6E ! $66%$"

    Source and date Definition (emphasis added)

    Lalonde, 1974 (3) A strategy aimed at informing, influencing and assisting both individuals and organizations so that they will accept more responsibility and be more active in matters affecting mental and physical health

    US Department of Health, Education, and Welfare, 1979 (19)

    A combination of health education and related organizational, political and economic programs designed to support changes in behavior and in the environment that will improve health

    Green, 1980 (20) Any combination of health education and related organizational, politi-cal and economic interventions designed to facilitate behavioral and environmental changes that will improve health

    Green & Iverson, 1982 (21)

    Any combination of health education and related organizational, eco-nomic, and environmental supports for behavior conducive to health

    Perry & Jessor, 1985 (22) The implementation of efforts to foster improved health and well-being in all four domains of health [physical, social, psychological and personal]

    Nutbeam, 1985 (23) The process of enabling people to increase control over the determinants of health and thereby improve their health

    WHO, 1984 (24), 1986 (4) and Epp, 1986 (25)

    The process of enabling people to increase control over, and to improve, their health

    Goodstadt et al., 1987 (26)

    The maintenance and enhancement of existing levels of health through the implementation of effective programs, services, and policies

    Kar, 1989 (27) The advancement of wellbeing and the avoidance of health risks by achieving optimal levels of the behavioral, societal, environmental and biomedical determinants of health

    ODonnell, 1989 (28) The science and art of helping people choose their lifestyles to move toward a state of optimal health

    Labont & Little, 1992 (29)

    Any activity or program designed to improve social and environmental living conditions such that peoples experience of well-being is increased

  • 66

    Table 1.2. Definitions of health promotion deconstructed

    Source and date Activities(programmes, policies, etc.)

    Processes (underlying mechanisms)

    Objectives (instrumental outcomes)

    Goals(ultimate outcomes)

    Winslow, 1920 (2) Organized community effort for the edu-cation of the individual in personal health, and the development of the social machinery

    ... to ensure everyone a standard of living

    ... the maintenance or improvement of health

    Sigerist, 1946 (1) ... by providing a decent standard of living, good labor conditions, education, physical culture, means of rest and rec-reation

    Health is promoted

    Lalonde, 1974 (3) ... informing, influencing and assisting both individuals and organizations

    ... so that they [individuals and organizations] will accept more responsibility and be more active in matters affect-ing mental and physical health

    US Department of Health, Education, and Welfare, 1979 (19)

    A combination of health education and related organizational, political and eco-nomic programs

    designed to support changes in behavior and in the environment

    that will improve health

    Green, 1980 (20) Any combination of health education and related organizational, political and economic interventions

    ... designed to facilitate behavioral and environmental changes

    ... that will improve health

    Green & Iverson, 1982 (21) Any combination of health education and related organizational, political and economic supports

    for behavior conducive to health

  • 6E

    Perry & Jessor, 1985 (22) The implementation of efforts ... to foster improved health and well-being in all four domains of health [physical, social, psychological and per-sonal]

    Nutbeam, 1985 (23) The process of enabling peo-ple to increase control

    over the determinants of health

    ... and thereby improve their health

    WHO, 1984 (24), 1986 (4)Epp, 1986 (25)

    The process of enabling peo-ple to increase control over [their health]

    and thereby to improve their health

    Goodstadt et al., 1987 (26) through the implementation of effective programs, services, and poli-cies

    The maintenance and enhancement of existing levels of health

    Kar, 1989 (27) and the avoidance of health risks by achieving opti-mal levels of the behavioral, societal, environmental, and biomedical determinants of health

    The advancement of wellbe-ing

    ODonnell, 1989 (28) The science and art of helping people choose their lifestyles

    ... to move toward a state of optimal health

    Green & Kreuter, 1991 (7) The combination of educational and environmental supports for actions and conditions of living

    ... conducive to health

    Source and date Activities(programmes, policies, etc.)

    Processes (underlying mechanisms)

    Objectives (instrumental outcomes)

    Goals(ultimate outcomes)

  • 6

    0" ,-" %" 3 " !

    ! /!""%"! $""4""$

    !!> "!""

  • 6:

    !!"

    !" $

    0$ $&!%

    '""""$$! # " !!"!"

    ,-!"!$"""%$

    Practice

  • 68

    #"!!$

    "!$> "*" 9$

    $13$"3! " 3! % 3 !3$3!3!

    #"!

    $ 0 !! B!,$

    ""!-! # " !

    "!"!!&!$

    #!"" "!$%"#!"!!! "!"$0"

    "!"$"

    Conclusion$"!#!

  • 6A

    Meaning and practice of evaluation in health promotion:=!"!

    0'I2BC% !D 3 " "!&%&!JJ J > JJ !

    Fundamental issues and challenges ! " / !3# "!%$% " ) 0 ) 80)78(

    #!

    !!4!$!B 5 $ 63"!"%"$!"

    /!!"!"""!% ;" !0"10" $C$D"CDC!D43CD5%

    6"$$%;"&!$;$$

    >!" (

    $($)$/!

  • 6?

    $ . / ' $67A=" $ " % !! $

    !!#"!!B !!"'IHB$3(! " !/ 5" $ 9 "" " 0"9

    6 !!$ ! ,%&!-3

    E ! ,-3

    B!,!$-3

    : !%3

    8 !$,-

    !

    Social programming ( ! ! ($

    %"""% 6

    $

    !"! !> " ; "

  • 6@

    #"$!"$

    ;&!&"

    !& 0!

    !$ ( 1 B*

    C !D!!$

    " " ! # " ! ! "&"$!!&

    4!"'IHB$

    3$ ! B "!

    & ! ! $

    "

    >!"

    !*0!$ $! " " !#"'I2B(*+F(*+3 ""$"

    (*+,"!

    -(*+,!""$-

    Valuing ! # ! !"!

  • 67

    6!>"/" $ $"!$" 0 " " 5

    ($"%&!$!+ ! "%!5"$!$

    0"! " &! # "

    ! ! !

    "&9"$! ! / & ! ""$&!"&

    "! " 0 "!

    ! /!""!0"

    Knowledge construction 2!!""305 F&$ !! 6!!$ 3; #"*B ! ! $ !!3+

  • E=

    ! *" !($"!

    '303!"!

    $"

    $!!3&&!

    #",!-"

    !!"

    #!%!!$!" !"!!!$)!3""!

    0 "!!! !%$!"$

    " $!!&$!!" !!

    0"CD3"$!&"

    !$!$ 3%

    33!!

    0"

    *35&$$

    3!*

    "%&$

    0"%!

  • E6

    % "B* 35 ! C$&

    !$!D

    *

    ! ""$"""!3"&"""$"!"!35

    *35%%$!!!

    &C%

    FD

    !!C!!!F!D !$,"$"!!-C!! ! !

  • EE

    "$"

    $" ! ! !

    " " B0$5;" &

    > "$ ! ! $

    5&&/!"

    $

    5

    )! 5 !!"!#$!!!!!"""&!%$ " ! !3!"$

    ! &" !$ ! "

    !0)!5""C$

    !!$D

    "!" ,* 66-! !""$&

    Knowledge use#! $ $

    !%"$!500505>!9 !

    !3&"$! &$ 3 ! $

  • E

    3!$33$

    #"I>; * $!"$ > " !!$;I>;$ 0 !!%"!!!

    !5#"$"&!!

    ("""$CD;(!!"> "!"!!

    0,"-#"!" 55/5$!$

    Evaluation practice>!"&""""&"

    0/5"!I>B ;!"

    /5!$ ! ! $ # "

  • E:

    , " " -!&""&9

    0 ! $

    *6" "$!9C!D"$

    !$

  • E8

    0!$!

    $$

    !$ & # & " "&!

    " $!%"*%%!

    J/ !$"$&!$ " & ! "

    $

    4!$"!"

    #" > " "" J ! ! $""*$!"!"!"" $"$" (>

    $"%!

    J' " !

    *" J / 9 " " 0!!.

    !

  • EA

    9 ! %" ! 3 !3! 3$3!"3

    0"$0"$ ! 53!!$

    !B3 " !/$

    "$!$$

    .!"

    !

    Conclusions 0"!"!$!"!

    "$" ! + & " " B $"!"!$! ! !!!

    "!

    & >" !

    !

    " ! $!"!"&

  • E?

    55

    !" !

    !"!$0 "

  • E@

    A framework for the evaluation of health promotion initiatives /6;

    !6$!(3"" "!!39

    6 "$!3

    E "

    !3

    !9"

    !!3

    : """3

    8 "

    3

    A !9"

    )""!$ ! B " %""0"" $"

  • E7

    "

    /!$""! "

    / "0!$$$"!$

    / 0!$

    "/6;9

    0K&! !&%"%"$!%$"

    >!""$!!!

    Step 1. Describing the programme 0

    "$0!

    "$""""%

    + ! $!"#!"! $/6;9

    $ # " !&

    $,-($

  • =

    (3

    9!!$"$""!49$"!!""$

    Step 2. Identifying the issues and questions6 9

    "9""%$"

    "

    "$"$ !

    0 " """&!

    L ! 0!&!"0!!!!>" $ %>!"" !"

    #"!!&1$&$!!

    #!$B"!!

    Step 3. Designing the data-collection process

    $& ! B

  • 6

    #!!" !$!1"$"!

    !!"$$ # % 4"$& # ! $!!!!

    0!& $9

    6 %E : 8 &

    4$!56 % ! $

    > # " "

    &"&!""!"&&643

    /"%$"F" ! ,"-0

    "$ B%"

  • E

    "!%!!3!!!B,-/!$""

    &>"%J# "

    "8=M!!/"J"9 $"$!"!$!!6816@!9!&%"!F$"#" !

    Step 4. Collecting the data

    *! $ !/!")!$"!!

    Step 5. Analysing and interpreting the data# ! " !&/!"! / !#"!

    Step 6. Making recommendations/!"/6;$

    9C"!!$D(!!$"!" $$"

  • Step 7. Dissemination""

  • :

    @ 40*+/4&0,E-9E@,67@=-

    E6 '

  • 8

    E7 H0)

  • A

    :A H#

  • ?

    (.

    #"+*"./+$/"677="18E

    A8 *

  • @

    @ (0

  • Part 2Perspectives

  • IntroductionLouise Potvin

    !

    "#

    "$%

    &%$'

    (

    !)

    !

    *(#

    !+

    !)

    &,-

    .&))

    !

    !

  • %

    /

    *

    !0" *

    &

    #

    #

    ))

    ) + ! *#)

    1#*))/+))

    234

    "#) 5.* 3

    3

    & ) ) ! .

    )

    6

    )'!

  • 7

    .)18'

    )*9- 8:;

    *96 8:; . )#

    )

    &

  • D

    2Beyond process and outcomeevaluation: a comprehensive

    approach for evaluating healthpromotion programmes

    Louise Potvin, Slim Haddad and Katherine L. Frohlich

    ' 0

    &

    "# 3 3!&

    #!

    )9

    ;?

    (1@8))(B B

    &)

    + /##)

  • 2

    )&?+)

    Programmes?+#* )

    +

    /

    '#

    *

    (9 , . ( & ! ; A + !" #' + # 9E;

    &

    FG=

    #/ 0

    Programmes as living systems!+

  • Source: adapted from Contandriopoulos et al. (19)

    ?$9;&

    +=

    !(0

    ! 0 0

    Programme components8

    (%

    Target of change Programme components

    Relevance? ObjectivesInitial conditions

    Coherence?

    Resources

    Achievements?

    Results?Resulting conditions Activities/Services

    Responsiveness?

    Environmental conditions

    Programme

    Fig. 2.1. programme components and evaluation questions

  • 4

    !*#

    &*. 33!I*! =

    + !!#3 " ( )*)!$.""6"I$.?""6#

    !

    "!

    !+

    Programme evolution$!(%%

    !*

    * )

    ,

    !

    =*

    !H)(%%#!

    "

  • DE

    #

    Fig. 2.2. Programme phases and evaluation questions

    Source: adapted from unpublished course material developed by S. Haddad and L. Albert, University of Montreal, 1997.

    ( **#

    B*

    !*0

    $)+ #=++)

    Evaluation questions!**8*

    Programme

    Programmeenvironmentinteractions

    Focus of evaluation

    Effo

    rt

    Programme

    Developmentphase

    Phasingout

    End

    Achievements?

    Results?

    Responsiveness?

    Relevance?

    Coherence?

    Implementationphase

    TimeProgramme

  • D

    +

    *"* )

    /+)-

    !)

    J ' 0*I5

    J =05

    =)3

    J '0*5J '05

    J =05

    ! ) 0(%%)#

    0

    =

    )! ) # K6$$*9K6$$;$

    /#%

    Analysing programme coherence ( % %% ! # *=

    ? #&0#"

    =

    )

    3 &

  • D%

    Box 2.1. The Kahnawake School Diabetes Prevention Project!K6$$*9K6$$;,&*

    K6$$

    !$.""6"I$.?""6?'$)+

    ?

    !

    K6$$923%;!)!K6$$

    &

    K6$$

    )K,K6$$!0K6$$

    +

    ! !

    J

    K6$$

    H

    J K6$$H

    J

  • D7

    ' + ) H # 9;#

    6 K6$$

    #

    !#(K6$$

    # * )

    K6$$

    Analysing programme achievements )

    ! ) )

    I 9) ; 9;-+ 0 )

    0 $ $ )

    )

    ! !))#

    &

    ! $' ' $ #!

    $!$!0 !) !'9 !';

  • D

    !! K6$$

    )

    !K6$$

    6K6$$0 *"& )K6$$!

    K6$$ ))K6$$"

    K6$$!

    Analysing programme relevance-

    ! * #!!*

    ! **#"

    (

    B* !##

    !K6$$

    '

    &)

  • DD

    $"

    "*

    Analysing programme responsiveness.)

    !# 6 ) +

    !

    9#+;HH

    =

    9#;

    # # 0!# ?#.

    9;!! ) ' ,-##!

    !# !

    #

    K6$$

    )

    #

  • D2

    HK6$$# #

    K6$$

    Analysing programme results(#.#,

    B #

    ! !

    !

    7E

    , # +#!"

    !

    (#9; !

    !*

    0 ! ! &)/K6$$ *

    +&

  • D

    & B) ) &

    &

    )=$!

    )

    " ! #

    #+

    Conclusion= + +8H*#K *!

    A#

    !

    References , 6?B 861@/AB!?B.'

    %/.@,61&'(8.44%

    % 1.""B8=@8"=&(,)

    '$ ,4>2

    7 BA!/" , 6 "! 8 " *('(>73>4944E;

  • D4

    ,&!!8", .K,/"! 8.

    *+(737%>9442;

    % !?K?8 6 ! 12%>%3%4>9442;

    7 1.""B8=@K."A!".,,

    &'

    %,C,44

    K&K/A'&&%&$ 3&

    '

    !=/44>3 8",?&1B"N8,-(8--/--'OL$$

    (44

    4 ?B! B6.&?$?A8? $"! 880L

    LL %&8!,7-

  • 2E

    8

    -&95844%37%

    %E ,&BK8".,44E) ) 12%;

    %D '"&."., 6%=N+=(N/44E327

    %2 8&$":,!%84;

    %> '"B'!/('!?44E%4 .&C"B,!%='>'

    &/ /4

  • 2

    7 ,1. = "! 8 , $''$>

    ;D43>794>4;

    7D 8"("/C." . "! 8 012+'7%3794> , A8 : "! 8$B K 3

    2+ED3E>944>;

    74 $?!C&B8"! 88#

    0L

    L>%4E37

  • 27

    3What counts as evidence:

    issues and debatesDavid V. McQueen and Laurie M. Anderson1

    %

    +

    ( (;

    / )

    3&,%

    The rise of the evidence discussion!

    & &,44>#(=' ,F))G

    &

    , )?

    )*

    ?

    !

    (

    ,',,K,$6AH6BA H .R!A+1!#

    1

  • 2

    *!)*

    !#

    & ! * ' # 0

    Defining evidence"

    #+=

    ++

    &

    B&'# &

    5

    &

    N* "

    #!

    &F2?3&*EES

    "##&)#&

    )"#

    &

  • 2D

    60?

    )

    =0$++#

    H = )

    '

    !(

    H ###

    The problem of defining health promotion=4E

    6='?

    !

    #"

    !

    !

    "#+

    ###&

    &

    .

    =3#

    3& !

    !

  • 22

    Health promotion and the discussion on evidence=

    !

    (

    ( # !

    )

    )

    #$# # )

    )"H'

    ))#

    *

    ?

    '$#)!9E;'#* #&1@K$FG#94;&

    &

    &

    !!

    5&)+=

  • 2'+&

    2='$'"N$.%73%2N44>

    !?B"K/+F*G9%;3944

  • >E

    =&B8?=" / +B':A$4%7

    % ?8", BN

    0 5(223>942;

    7 ?8", BN(

    1'2(2D32% $ $$ &? B?A,@"C B6 A$' &*+

    9%;>3D944>;

    4 , 6?B 861=#5

    '

    97;%> ?8", BN1

    2(4D3%E94>>;%4 8?"'8" /= ( A

    $4427E (&K"6=@'="6".. "6)(

    A$4>2

  • >

    7 &8C"., B= 6

    &

    '=;?#?#A$4>D

    7% "C&6"B"/ "6 ."."?A."1.?A$"53)1'2%43%D944;

    77 ' .!N=

    5*'

    ((2%732%4944>

  • >7

    4Participatory approaches to

    evaluation in health promotionJane Springett

    &

    #'

    $

    ! &!#

    #?

    !

    &

    ?

    !

    Nature and origins of participatory evaluation Roots !

    84E"#&

    =

  • >

    #!"

    &

    #

    /+$("!/@!#++ *

    &42E4

  • >D

    *

    % !

    #*!

    7 = +

    !*!

    D 6

    2 !9#;!*#H

    !4 !

    E!

    &

    ( ?+ A B9( ?;)

    % #7 )D 2 # 4 E

    % 7

    & +&

    **+

  • >2

    + $

    $+

    !

    &

    *'))!

    *

    $

    PQ3 03

    A+!

    +!=+

    0

    ". ))##

    $! (

    J H

    J

    H

    J )))

  • >E # )"

    &

    !

    &A

    #

    &

    !

    PQ " *

    Relationship between action research, participatory research and participatory evaluation!

    H

    !

    ) # *"?

  • >>

    (#

    +

    F# G $

    &

    !#*$10

    =

    H+ >(( "# 8 ?

    #$*

    ++

    =

    "

    # H!, $

    C!FG

    Philosophical and epistemological basis of participatory evaluation =

    #

  • >4

    $&)!

    87G

    K9(;(!+

    9;9;!

    $

    H (*0!

    $

    I,

    Table 4.1. Characteristics of positivism and hermeneutics

    Source: adapted from Dahlbom & Mathiassen (4).

    Positivism Hermeneutics

    Objective observation Critical subjectivity

    Explanation and prediction Understanding and finding meaning

    Search for general knowledge and standardization

    View of every situation as unique

    View of social organization as combinations of similar thingsSurface view

    Stress on richness, variety and depth

    Hypothesis testing through formal definition of ideas and measurement

    Dialectical cycle to gain knowledge

    Mechanistic, with a focus on an object that has no voice and is submissive

    Dialogue and subjective participation (understanding is not real unless it is mutual)

    Aim: the power to control the collection of facts

    Aim: enlightenment, edification, enrichment, personal growth

    Emphasis on quantity Emphasis on quality

  • 4E

    !

    & =*

    "# & #

    B#

    &!!

    "!# $ H## * !!

    * *# +

    * ! #*

    Fig. 4.1. Action research and the learning cycle

    Concreteexperience

    (doing)

    Activeexperimentation

    (deciding onfuture action)

    Abstractconceptualization

    (thinking/learning)

    Reflectiveobservation(thinking)

  • 4

    !%;

    Table 4.2. Differences between the natural and social sciences in approach to and methods of programme evaluation

    !

    *

    * (

    Participatory evaluation in health promotion!&

    H!

    +

    Question Natural sciences Social sciences

    Who performs evaluation? External experts Community, project staff facilitator

    What is examined? Predetermined indicators of success, principally cost and health outcomes/gains

    Indicators of success identified by participants, which may include health outcomes and gains

    How? Focus on objectivity, distancing evaluators from other participants; uniform, complex procedures; delayed, limited distribution of results

    Self-evaluation, simple methods adapted to local culture; open, immediate sharing of results through local involvement in evalu-ation processes

    When? Usually at programme completion; sometimes also mid-term

    Merging of monitoring and evalu-ation; hence frequent small-scale evaluation

    Why? To ensure accountability, usually summative, to determine whether funding continues

    To empower local people to initiate, take and control corrective action

  • 4%

    *?*3+ 3 *!?

    !

    ( ,)$=

    # * !

    $

    )( *

    B + *.!

    !$

    !)&

    &

    "

    !$ ##

    $&!$

    (#

    ( #

    (!F=

  • 47

    PQ

    G

    &A

    $ $ B ,# !( $ ? 4>% (0

    $+$!))

    &

    $ &

    B'4>>((' ,6',"# "

    B

    #

    !

    6 1AK

    *9*;6#

    ! !'B$* ) !.@)! /:B !9;

    !

    #

    (#

    AK/@/!

  • 4

    H

    1

    &

    $

    ! + )+9;#)

    * ) )!+#H*!!! #

    @8 !" =

    !#!

    ! *'" # ! %EE

    ! )!27>AK' B'AK'( '!

    !

    #

    !

    %EH"$?

  • 4D

    , * +!0

    6

    *

    N

    "!

    #*

    8AK" !#@"

    Guidelines for engaging in participatory evaluation in health promotion=

    9!77%4>3%44;" )

    , ) )

    "$ # B

    !&

    &=

    &

    1 F * *

  • 42

    G

    # &

    !*

    )&)=#!

    #*

    * 9( / 44D;! )

    =

    #"

    9!7;? # ) / # &

    # !!H)

    "

    0

    !

    !

  • 4

    %2 6"C"8?$,"B! &! B"?,,&!!""0+(

    &6$?"64>4

    %

  • E%

    7% , 1".&?BN&

    F

    =>>3494>3>%

  • E

    9?$;

    >7 ?!?B1@$.&B1"!!N!>97;7D372%944 '?11 .!."! 8.#.(9;D43D 1 . B! N! #K%$$C&

  • ED

    ( 403!?$447

    >2 =""$ $P$Q%!6N@

    8"A@0@=&=;2'P'Q C1447

    >4 ," B.@,&!'.&.(9;94>>;

    4E ' , 30'2

    2%322944;

    4 .&' .6?B8=)%6+BK@8:+=5!?44

    4% / A,(.'#

    %

    8"(3.'6,A,44%9.',B%;

    47 "C".&!! C3'+97;D232D944D;

    4 = B1@/A..&, " 5( 9%; 2944;

    4D / A,(@??K"6' !*B

    97;>347944%;

    42 ' .8""! 8&

    0%

    29;

  • E

    )H

    ! H !#$#))&!

    Contemporary health promotion 6801;3")4>E

    FG#/ ) H $80='?.?"?'$ !!='?

    F

    G!

    (

    #* # + ?

    H#*#

    #!

    ? !

    (

    !

  • E4

    #(

    #

    " ) ) !

    &

    #&

    ! #

    0#)!! ) )

    Incommensurability"

    !(# H

    !

    ) ) "

    #$

    !

    &

    #8!#)#

    !K

    &

    )

    )#

  • E

    0 !

    "!

    $0

    #!

    !

    ))!#

    #

    +#&!#

    *+!#)!

    * K*.

    *H*K!#

    )

    ! ! * !

    ! #(#

    +

  • 8 #

    *

    & *.

    *& / *+!

    II / I

    0#

    #()#?

    *5 ,

    *=

    5?

    ) ) ?

    !)

    #? # # ( )** )

    &

    )0!

  • %

    Compatibility

    #

    "

    FG.@.))

    H+#9)#&)

    #*.@.

    ;!

    ,

    H#"$1#* ".6

    !? (

    "

    "!

    ) ) @(#9);

    *6+$!

    *

    ))

    *, !#

    )+

  • 7

    )9FG;))

    )') ))

    #()

    0+1 )

    ) ?))#& 4>244D))# #)

    (

    5() ) " )

    )$) #+)

    ) ) )

    +))

    1)

    #

    ) ) 5 )++()(

    !?)#!)"

    )

  • !#, "" + $ !

    ) 5=

    )""5(

    # "

    )&

    !

    '5&

    !

    ))H

    ) ) !

    !

    Complementarity&

    #(", # ( 9,#

    ;,

    #)

    .@.)) H

  • D

    #

    ) + &))

    !

    !#

    !

    #( )

    ".)## #

    !H

    #

    # ))!#

    ))!

    (#)

    ) ) #, )

    0 0 *' ) H *

    Seeking transformation=

    9);9);5(*#

  • 2

    #!

    ! #H!

    !$!9;( # /+ $( !! & ? !

    &

    #

    0

    Conclusion: challenges ahead' )

    ) ) !

    B#

    )

    !)0

    #))

    #/

    / )

    .+

  • 944D;% ,K&B8 :N/!

    0E43%2 6"!! 8$#

    %.@. ( /55

    '+&;(N/44D73

  • %

    3?.44D

    B:$4>7

    >

  • %7

    6Evaluation of quality-of-life

    initiatives in health promotionDennis Raphael

    Overview! ) ='?

    !

    #)

    )

    ,

    ),

    ))# ) &)4D%A

    . .@.!))

    !#

    .='?

    )'))!

    )

    ))&)

  • %

    )!!!

    ='?

    /8VB$' .. &/ &.6.'$A!!

    *#

    Nature of and intellectual underpinnings of quality of life )) !0"60

    #!#()$#

    #-FPQ0GA )

    )#=

    + ) ! ?'$& .

    )#& B

    ,

    5(&

    0,

  • %D

    '

    5()9;& !

    Paradigms of inquiry and quality of life!# ) =

    !

    J

    "H

    J

    H

    J )#

    8 @ 10: 5( $ 10. ' !

    + 9 ! #*!)

    The nature of knowledge and the knowable6

    )) 9 D; ) F

    )G"

    )

    )

    "

    =H5= 9);9;5

    ?

    "

  • %2

    #.

    #=1"H()

    B+)#

    ) ! =

    !)+" # +

    )

    ! )

    8 *#

    A"+

    !"

    (!

    +

    ?

    ')5

    ,

  • %

    !

    ?

    !

    H(##3

    3)

    &) .)- 8:

    ! +

    !- 8:K@/!*='?

    !) )

    ,6 8:

    &

    (++F!#='?=/

    6 *8:96 8:;&0+

    G

    !

    !B*"##

    )#A6 8:- 8:) ) 6 8:- 8:

    H+

    .)

    /$

    %

    '

    +

    #

    /$,6@B

  • %4

    ! )

    ' #

    ()

    #$

    Social indicators approaches ( 3 '') 3)=,!

    !#!

    #)#

    Rationale642EB ""!

    #

    )

    $

    W

    *

    *&

    * FG )FG!

    "9

    ;

  • 7E

    &

    9;0! *

    #&

    *9##;*9# ;

    ##

    # &

    ( #

    ) .

    Some recently identified indicators!#HHH! "3

    #9 ; 9

    ; 9 0; 9 0 0;9# ; 9 # ; 0 & (25(

    Using social indicators to document the health effects of economic inequality/

    AK !))(#

  • 7

    8@!"

    0 = +/) )

    Healthy Cities and Healthy Communities approaches B''

    &*

    9;&= #

    3(&;

    (( $

    )(@6

    =# )

    Other areas relevant to health and health promotion= ) 1@K0

    Developmental disabilities"

    )

    !+)(

    ) /6 +)

    9; ?#) 9 ; 9 ; 9;

  • 7%

    The social diagnosis approach&1@K0 )

    !

    )!0)#1@K / )

    !

    !)

    #

    =)

    !) ='?!

    Quality-of-life issues: levels and focus of inquiry and measurement!

    H)

    ,)#) 5!

    5

    !)

    & !

    )

    ,)+

    **

  • 77

    ) +

    ='?

    ,

    ) ,)=

    =)

    # 0 ) *) 0!'')!)!

    ! ) AK)

    Quality-of-life models consistent with WHO approaches to health promotion&)#

    Lindstrms model8V)B

    !

    8V

    ) F!)!

    ='?G8V0

    8V

    )F#

  • 7

    G , #

    J HJ #H

    J #HJ

    !

    )8V#=

    8V B 0 #

    )) 8V ' +

    B8V

    !2+8V0

    Table 6.1. Lindstrms model for the quality of life of children in Nordic countries

    Source: Lindstrm (66).

    Spheres Dimensions ExamplesGlobal 1. Macro environment Physical environment

    2. Culture3. Human rights

    Responsiveness to the United Nations Convention on the Rights of the Child

    4. Welfare policies Welfare distributionExternal 1. Work Parental education and satisfaction

    with employment 2. Income Income distribution3. Housing Quality of and satisfaction with housing

    Interpersonal 1. Family structure and function Satisfaction with family, lack of negative events

    2. Intimate friends3. Extended social networks

    Support from friends, neighbours and society

    Personal 1. Physical Growth, activity2. Mental Self-esteem and mood3. Spiritual Meaning of life

  • 7D

    8V#+B#'

    H ')

    0)'#)

    ='?8V

    (B&

    B$'1>6+= !

    Key issues8V0 )

    !** ! &

    # " !0(

    Centre for Health Promotion approach!='?

    '$A!&='?

    &+))!

    #!3#

    !$!,

    #+

    -

    *!**

    /

  • 72

    H 0 0#"

    9!2%;

    Table 6.2. The Centre for Health Promotions domains of quality of life

    &

    !! ;!! !" &

    Key issues! ) H

    !*!#&

    0

    H #! &

    )

    The community quality-of-life project: understanding communities through a health promotion approach!)*

    0

    Domains Subdomains Contents

    Being Physical Physical health, mobility, nutrition, exercise, fitness and appearance

    Psychological Independence, autonomy, self-acceptance and freedom from stress

    Spiritual Personal values and standards and spiritual beliefs

    Belonging Physical Physical aspects of the immediate environment

    Social Relationships with family, friends and acquaintances

    Community Availability of societal resources and services

    Becoming Practical Home, school and work activities

    Leisure Indoor and outdoor activities, recreational resources

    Growth Learning things, improving skills and relationships, adapting to life

  • 7D

    DE =?8( $ %(K0

    B$$4>7D377

    D A6"$ .!,"B!?('" 8!'"6A !&?B B6="8( ."/;=6A1$?424

    D% '"86?B"@8 B6K4D34% %

    + ; 9D2;D2

    2D . $' "86"! 8 )

    %

    2 +('

    %D3%9442;

  • 2

    22 8&B6!.X, / - 0@

    @7E37E2944%;

    26+=?#?#A$44

    2> . $' "8 6 ! *'

    2329442;

    24 ."B=&K.@/.?=B&/' $ ) %.. H( +& '

    !?442

  • 8&88&"/8 B!?B,"! 88 %

    2 97;DDD3D>9447;

    >D 1.:!!"BN"! 8)5!B#)94;47>34D944D;

    >2 K"K&, K&&"! 8)(097;%D37944D;

    >> 1

    ?$' 442

    >4 ,-A &1 8 / ;( +=7 ;& 5(

    3!$447

    4E ,-A &180&+(3

    (!C44D

    4 ,? !!&N$"! 8- 8:- 8:)5

  • 4

    7Economic evaluationof health promotion

    Christine Godfrey

    Introduction.)*

    )

    "

    9;9;!

    )

    !))(#9#;5 )

    (&

    0)6)!

    !

    ( #

    !*

  • DE

    & )

    )

    !) & B

    &

    #!)))1+(#+,+# , ) =)"))

    ! +&

    #)") !

    Types and uses of economic evaluation !))

    3 )(!

    !9;9;

  • D

    $ (

    +

    +,

    ?33

    B 9 %%; (# "&

    3 )=

    Types of partial economic evaluation?

    3 3

    ,

    & !9;!)*

    3#

    %2

    9);!

    6)

    !* #

  • D%

    *()

    ")*&)

    !

    #

    Full economic evaluations!

    J +J 3J 3J 3

    H

    !)

    ,#

    ?'$,#)

    6 8:- 8:92;&

    )! !*

    !

    !!

  • D7

    Table 7.1. Different types of full economic evaluation

    Source: adapted from Drummond et al. (1).

    ) ( # )

    &

    )

    &)!9);&+3!

    )

    Costeffectiveness analysis3! ) 9 ;9

    ;? + !)

    Type of study Treatment of alternatives

    Measurement/Valuation of costs in alternatives

    Identification of consequences

    Measurement/Valuation of consequences

    Cost-minimizationanalysis

    Monetary terms Identical in all relevant respects

    None

    Costeffectiveness analysis

    Monetary terms Single effect of interest, common to both alternatives, but achieved to different degrees

    Natural units (life years gained, numbers stopping smoking, etc.)

    Costutility analysis Monetary terms Single or multiple effects, not necessarily common to both alternatives

    Healthy years or (more often) QALYs

    Costbenefit analysis Monetary terms Single or multiple effects, not necessarily common to both alternatives

    Monetary terms

  • D

    #

    8

    ! (!

    3K"'&C

    '&CA Y

    / #

    3

    &

    (# )& = 3 *

    Costutility analysis3)=

    - 8:$6 8:9- 8:;+92;?

    !

    &

    )

    ! =#

    5 )#- 8:(#)

  • DD

    E9;9;)EDE4E)EDE- 8:9E#9E43ED;;

    !#

    = )@'##' #)

    )( )

    (@('@K#

    - 8:(@(

    - 8:!

    0!- '@K + '&C /'&C '&C- 8:

    Costbenefit analysis&3!

    !

    6@

    3

    1@!#9!

  • D2

    BH#7

    Table 7.2. An example of costbenefit analysis: legislation for bicycle helmets in Israel

    Source: adapted from Ginsberg & Silverberg (17).

    !3)1@!#!#

    ? ! (# AK

    6!!

    "!

    )!##

    Steps in undertaking an economic evaluation # 6#@'#

    #

    !$3 !

    Benefits and costs Values (US $)

    Benefits

    Value of lives saved 8 939 979

    Reduced health care costs 17 412 622

    Reduced long-term care costs 25 263 243

    Reduced need for special education 1 527 131

    Productivity gain from reduced disabilities 7 545 779

    60 688 754

    Costs

    Health education programme and helmets (20 143 984)

    Total social benefits 40 544 770

  • D

    + ! )&!)5*,

    )

    #*# A # !*"*%E7E*6

    *=#

    Concluding remarks!

    3/ ! "

    &

    "

    8 "

    ,

    $

    !

    ? )

  • 24

    References 6.A,,?B6,"! 8)

    %?#?#A$449442;

    K 'BN!3'&C 5 1 2 + 9%;4;

    (&"88 ,@(. BK$3 * 0 *1)1%

  • 6 8C&,/ (& '86!4>>

    4 ?'"B6@'"B6".?BN

    ?#?#,$4>>

    %E !?88":K&;8

    '" 44%

    % =&88& , " E27%237%494>D;

    %% 1. ' ,N@C A$"8NC

    5434D94>;

    %7 6.A,,?B6 , "! 8 3 509;773E9447;

    % K&B6 $ "! 8 C AK)E23%>2

    !&'$4>>

    ='?!

    ? !

    % 7 # D 2 4 )E

    !*

  • >

    ?# !

    Programme development8

    ) ! (>!AK#

    *) ! ) #

    H

    % H7 * #H

    +0H

    D H2 H

    #

    Dilemmas, contradictions and ethical considerations&

    )

    ()! ) ( # 9 ;

    !#, #

  • >%

    Fig. 8.1. The starting point for quality in health promotion planning

    Take account of the natureof the issues, level ofintervention required andtime limits

    Take account of existingknowledge, attitudes,behaviour, environmentalfactors and organizationalsystems

    Have due regard ofapproximate costs, time limitsand social, economic andenvironmental constraints

    Determine immediate targetgroups, significant mediatorsand support systems

    Determine skills deficit andtraining required

    Modify programme ifnecessary

    Clarify the health promotionissue or problem

    Agree the target groups

    Formulate precise programmeobjectives: usually educational,behavioural, environmental ororganizational

    Quantify desired outcomewithin given period of time(target setting)

    Rewiew possiblemethodological approaches

    Agree intervention approach

    Determine precise resourcesrequired

    Acquire funding and otherresources

    Allocate tasks

    Pilot-test progamme whereunproven methods are proposed

    Execute programme

    Evaluate programme

    Consultstake-holders

  • >7

    $

    +)!

    ) . */

    )!!

    In conclusion-

    #+ ! ) ='?.?"-

    &*)-

    &

    #)! 0 )

    References $"88".C "! 86 )

    AK

    97;%D3%%9444

    2 ? ' $ 9; 394>2;

  • >

    > =""U."1&?B 8'" 8!' A!'?.&!:4' & 5( , 1 44

    4 )

    2)5(

    ;=E=4KAK44

  • >D

    9Investigating policy

    networks for health:theory and method in a larger

    organizational perspectiveEvelyne de Leeuw 2

    Introduction$ "

    !

    ,

    +

    16

    )

    +

    '+ ) N @!

    )

    B

    !

    $+ .

    % & , 6 ' $A,B)+

    2

  • >2

    &0

    Policy studies$#9;$

    9);))* $

    (

    )

    '+

    ,

    $

    (#106/

    ='?'*

    +"'

    +!

    #

    !

    #

    "H

    ) *!)#*#.F*G"#B**#

  • >4

    K!!

    K"$

    #$

    ! H ! 1"*'!'H#'

    K0!

    ' $H &K0

    H 9 ;!

    %K0#'

    Policy networks$ )9; !#

    $33*

    !?&

    ,)

  • 4E

    K@ "

    ! #

    # ! ) / "!

    ++ # 9 ;H

    9FG;!FGF+G #

    ,+ =

    +

    Ownership of public problems10#1##'

    ? 5!!?

    9

    ; +!H

  • 4

    1##H+&

    (1#

    9+;

    !

    +0

    +0(

    !

    ?H?#

    "6

    10#

    !!!)#1

    +

    #H#1B

    $!*7$

    # K & !

    Constructing a theoretical mosaic$

    HK"

    !

  • 4%

    !

    J =

    9;5

    J '

    #

    9;5

    J =

    )9;5

    J '#*9;5

    J ,

    5

    !

    /()

    !#

    Policy research methodology and policy development& 91" FG; !&

    # ,

    &H1"! 1" ) #

    /"

    FG $#

    6 $

    ,

  • 47

    =@"

    ))

    H)9

    ;#! 9;

    9);$

    )*&+

    (+)

    # !)

    $ )#

    (

    ?

    + # ?

    1"+1"

    H% +H7 H *H

  • 4

    D * H

    2 H

    H4 HE H H%

    "

    ! K0!1#/

    &K

    0H

    A

    !)#

    Case 1. A quasi-experimental policy research design !*

    8 B 8 B ) !)*!$'8H,9%E EEE;C,"*

    ,97E EEE;&447$'

    & ,, / B ' ( / 44

  • 4D

    '

    #09;&&

    #'8

    !

    ()

    + #!

    !1"

    Commentary "

    . 9

    ;9

    ;1"*! 0

    1"

    # )

    H

    % + 9)&?4EEE;H

    7 H 9

    ;H

    D #)

    )

    *9

    ;

  • 42

    A,('$'! #

    )

    &

    Everyday research challenges&

    !")

    10

    #

    6

    1#

    H1 !

    8@K"

    &6

    =

    9;0

    B

    9

    ;9;9;

    6

    9 ; )

  • 4

    Case 2. Healthy Cities second-phase policy evaluation: theory and units of investigation!='?'*4>2

    ?0$*9;!* 44> 97EEE'='644

  • 44

    I I

    H

    % +H

    7 ***

    H

    *=

    Commentary0)

    !+0' #? ' ! !33 (

    '*)#+!

    ! ( # *

    0!

    The analytical process

    )&)9#);!9); ) !

  • %EE

    !! # #

    ) 9 ";

    B H# ()

    &

    ))

    &9;

    # 0 9E

  • %E

    B!

    Case 3. Policy research a planned endeavour& 4>2 1 B $ ! ! 1

    $0= A, & & )@"0 (4 9 ; 9 ;

    9 ;!

    Fig. 9.1. Study of the national debate on health policy in the Netherlands, 1980s

    Semi-structuredinterviews

    Research questions

    Mediaanalysis

    Chronology of the developmentof the policy

    Response

    95 hits

    Analysis andfinal report

    Documentanalysis

    KAPanalysis

    Kwaliananalysis

    Report Report

    Delphi

    Triangulation

  • %E%

    D2+! ! 2ES ) &K!

    * & * ! 4DS, !

    9;! 0 # 6

    + !C

    Commentary(!

    )! !/

    =5=

    5&

    +

    !&

    &

    (

    !0 / +

    +#$+

  • %E7

    0)! +

    Conclusion!

    !

    0

    .

    ! + #

    $

    ! )

    & )

    References ,8".?:K."! 8

    5(9;7D37>;% 8 , B?:"! 8 +

    9;%273%

  • %E

    > 1?A, B , %

    @@( ( 3 (

    :4K

    P!Q,A,44>4 1?A, B,@$.&B1"!!N(*['0

    5

    '

    9;737%%9442

    D ,&8&? B> ;

    & ( ( + ( ' $442

    2 !?A.? /BF(32& ='? . ? " 44 9;

    /" A"44D43%

    %E 1?A, B,$9;%/B

  • %ED

    + 44< 9 ='?I'$.I'"$I&'$I/.I44

    %> K"B&$@'B"&6".C$+#%,/@,+..(

    ;=>(/=44%D3D4

    %4 1A(&"86N/++&=(+A$4>

    7E 6"8""A="@$?8, B8'6#097;77377>944D;

    7 //", "/;

    (:0&(3(

    :;M,='? .'A,44 @=

    =@+@

    @=

    P& 5 )

    Q,='? . ' A , 4429= ' ?+ . ',B7;96;

    7 ,&8"= !@6"8""A=".

    [0E2(9;2D4

  • %E2

    74;

    % =:88&" @ ="88(

    97; DD32%944%;

    7 ,+0@NDOOP'8'\!HHQ,116T*T844

    @# ;

    ,

    "

    3"

    $

    :

    "

    Characteristics of community programmes:

    # 7

    * &

    . 0

  • 15

    .

    * 0"

    &

    ""@ :

    %

    3# A %

    #'('(&

    BC

    $ .$ 7DA

    0

    : # ###3# #%

    :% % 8

    *

  • 16

    $EE7%

    2

    =

    ##

    Key issues in evaluating community health promotion programmes! F.

    1 "

    - 4 5

    Issue 1. Identifying the evaluation questionsG 0"""

    Agreements/DisagreementsG" %2"

    *

    " &

    *3 2

    , "

  • 1!$H J@ I $= &

    *3 ,0. %&'*#.--E--4'1?5(

    1 =>I,AIHHKI$=3.2

    !!,!%&'/.1-?-E1--'14(

    1- 3$H=I);H$I$=,!!,. 3* $* *&.5--E5-?'1?&&IH2 E : %&'/.156E15?'15(

    15 !I==IHA !% &'$#.1E15'1?(

    16 232:==$;G@D3!$K:&G2& .

    +',($#.6E-'1?6(

    1,1

  • -5

    A>8:&!$3I$= :.3

    J,01)$ # $! ,$ *$ *

    2$;O$:151E1- &)A)=&GI .

    %$#$.6E'1(

    4 7HII;=@I$=I%)&'.HO = 3 #

    $.8;) !)&166E??

    -5 2:I=2$HA 28 8 "

    .8;) !)&115E1-

  • -6

    -6 J$3)8&GH3.

    2

    !!,+'*$$.

  • -&1E14.*/*17'-(.1E4-'14(

    66 H>8:;G8I

    #

    #+'*$#.6??E

  • -

    8I$2GD3$*)HGJ@!,

    . ).5E1?'1?

  • 4

    4 G);;IH$I$=H# .#"%+'9*#.6E14'1?1(

    5 2>HH$OG2G. 2

    !!,%&'*#.56E5

  • 41

    11Evaluating community initiatives

    for health and developmentStephen B. Fawcett, Adrienne Paine-Andrews,

    Vincent T. Francisco, Jerry Schultz, Kimber P. Richter,Jannette Berkley-Patton, Jacqueline L. Fisher,

    Rhonda K. Lewis, Christine M. Lopez, Stergios Russos,Ella L. Williams, Kari J. Harris and Paul Evensen 3

    Introduction # *

    !:K9$:G& 0 =

    #!

    3 ,

    E

    EE

    3.B C:

    - @7!,3G>AA!*'4

  • 4

    # #:

    2!39!3 ,HI3IGI9,H)3IIG ,

    $ 3 ! ',$3!( 3

    !$

    "

    " !:G$$@!) !&

    !$

    3

    :

    $

    # "

    &

    '4115($ P

    ,

    &

    "

  • 4-

    "

    I

    * & 0

    #

    *

    $

    @

    @7!,3G >A

    >&"

    *

    Challenges to community evaluationG 1

    1

    A"'36(

    -

    4

  • 44

    5

    !:K9$:G&

    6 I

  • 45

    Fig. 11.1. The community initiative as a catalyst for change

    Source: adapted from Fawcett et al. (26).

    3

    A #$ %

    &

    $ &

    * "

    !

    3

    Communityadaptation,

    institutionalizationand capacity

    Communityimplementation,

    action andchange

    More distaloutcomes

    Dissemination

    Collaborativeplanning

  • 46

    0 =

    #

    3

    * ,

    0

    Principles, assumptions and values of community evaluation&.

    1 3#

    - #4 3

    5 8

    6 I "

  • 4&

    3G, 7

    $

    ## "# H7

    #%G

    $ #

  • ?6

    %$:G&>&

    : # @

    :# 9 &'1(

    *"$ > &

    )

    2#5=#2#1 , "

    .

    H

    @!).

    /

    / 9#

    /

    /

  • ?& # 7 D; #

    .0

    =

    $ "" & %:

    Costbenefit and costeffectiveness & *A#D&

    E :E E

    ,%

  • $

    ' (

    " 0" ;E ;.B "R%E '

    (

    "0C

    &E 0 = E '31(3E

    IE

    && & A '&A(

    A ; $ "5-Q 1Q : . -1Q= -1Q

  • 1

    Issues in the development of effective evaluation

    *

    Workplace and organizational issues& 3 # H"

    : #2

    $ :I@

    ""

    H '(

    2 ' (@ 0

  • :

    $

    @

    %@

    G% " G

    0 @

    %2 3

    *""

    2 "

    :

    $

    :%

    , *"

    " $

  • -

    @ # # ).

    / .

    /

    %

    %

    / /

    2

    $

    #2#';!&';!&(>A(

    & 0 2 )#;!&

    @ & 0 0

    *0

    .

    #

    # 2

    ##3

    Methodological issuesG

    K

  • 4

    #

    H

    # " *

    ).

    / / /

    /

    / / / /

    $ % & '

    " B#C B0%" 0C

    @ " 2

    "

    &'#(

    &

    "##

  • 5

    :

    3BR% # 0#C

    &

    " @ " % & # 0P

    #

    " """

    $

    *

    $

    @" % "

    *

    Action research approaches to evaluation$ '34($ 0

    #

    & :

  • 6

    #:# " )

    ! 0 # 2

    2

    2

    I7

    )

    #0&:> "".

    /

    /

    /

    '

    ( :

    $I #

    #%"

  • A@** 7%6':.

    /

    / #

    >A*

    @

    $ # "

    1-1

    " : "

    , """ 3 ; & >&

    $

  • ? Table 13.1. Participatory evaluation of a health promotion programme: main actions, associated actions and comments

    Main actions Associated actions Comments

    Step 1. Clarify the aims and objectives of the proposed programme.

    Get the participants on board.Set up an evaluation group.Determine what the real health problem is.Establish baseline information.

    The importance of spending time on this groundwork cannot be over-emphasized. Involvement of the right people will ensure commitment to the use of the information generated and a good response to any questionnaires. The evaluation group (at least three people) should reflect the range of interests. Proper clarification makes the evalu-ation straightforward.

    Step 2. Design the framework for evalu-ation and what ques-tions to ask.

    Decide the purpose of the evaluation and who will use the informa-tion.Decide what questions are useful to ask in relation to achieving aims and objectives. Decide from whom to collect information.Decide whether process as well as outcome information is needed.

    Take this action before deciding what measures to use. If the objec-tives have been stated clearly, this should be relatively easy. Be clear about the aims of the evaluation; this affects what questions are asked. The main aim is to see whether the activities in the pro-gramme resulted in achieving the stated objectives. Try to look at process as well as outcome.

    Step 3. Design the framework for evalu-ation and decide how to measure change.

    Decide what to measure and which methods to use.Decide on sample size and target population.Decide when to collect the information.

    Good measurement depends on being clear about the issues. Meth-ods should be appropriate to the questions and need not be numeri-cal. Be realistic and honest about limitations of time and money.

    Step 4. Collect the data. Make sure data collection is unobtrusive and does not add to partici-pants workload or, if it does, they can see the value of doing it.Make sure participants are still on board.Keep participants informed by regular feedback.Remember that data are not information.

    There will be problems of confidentiality and bias. Bias is most com-mon in self-reported behaviour. Problems are smaller if all stakehold-ers have been involved. Participation is a key.

  • Source: Workplace Task Force report. London, Department of Health, 1993.

    Step 5. Evaluate the results to determine the effectiveness of the pro-gramme.

    Interpret data in association with the evaluation group, comparing what actually happened with what was expected. Remember that numbers are only indicators of what the world is like.

    Data are not information until they have been interpreted. This is best done as a collaborative process, so the participants understand how the results were obtained. Remember the value of so-called soft information, and that some health changes take time to be revealed.

    Step 6. Make recom-mendations.

    Clarify what is useful.Cover practical changes for immediate implementation.Include the costs and benefits of not implementing as well as imple-menting the recommendations. Challenge existing beliefs. Look for longer-term changes that may not yet be visible.

    If the participants have been involved in the process, they will already be committed to acting on the findings and be receptive to results

    Main actions Associated actions Comments

  • -

    :

    #%

    *

    #

    2H Q

    1Q

    Principles for the evaluation of health promotion in the workplace8 #

    Starting the formative evaluation process with health needs assessment*

    !.

    : 0$

  • -1

    H

    *! ""'( ' ( : 9 $

    :

    Participation and feedback$ *

    ,

    #&

    7 : :@

    *=33%0 , $

    Clarity about the purpose of evaluationI ,

    =

    :

    )

    : "

    %

    *

  • -

    2

    I

    Producing useful information

    " .

    G

    *'( $"

    $

    @I .61:#

    Attention to ethical issues

    >

    " :

    ' ( $

    &% >

  • --

    Evaluation practice as a process in the workplace$ ##

    #2"

    >

    : :

    :

    : @ "

    I

    8 " "

    #

    Recommendations for improving evaluation practice in the workplace

    Integration of evaluation with other workplace activity2E'

    (E

    #

  • -4

    "

    7 #

    Choice of methodologyI "02

    " H" ,

    %

    '

    (G

    %"#

    Bridging multiple sites$##0 I "

    Relevant evaluation indicators :

    . :"0 ##% I

    ' ( #

    '(: "

    Crossing interfaces8 & 0

  • -5

    Conclusion:

    " @ #

    @

    References1 ,I==I:IHAH$E

    !%&')'5(.-?E-??'16(

    7)INI=IHN I$=$ G>%= = ! , , %&''5(.-4E-4'16(

    - =I@:&3IG>&%&' ) *'&4(.E16'1??(

    4 GI22IH!A7$41#/3@!)H)

    I15'I!,&;4(

    5 8IHIH$H

    +'*.111E114'11(

    6 3)),IH3=D@:==:$2&&IG,#17#;$;O@14

  • -6

    1 GIJ)OG2D&)>!IH;GJ$ + ' * . 11E1-'1-(

    11 @:=&);27I$=$

    %&''6(.4E4-5'16(

    1 &,H:;7IJDG>7G:===@.*&.??E?'15(

    1- G>7G:== = 0- $'' *$ $$$$4 #* =!I$16

    14 G>7G:===D&,H:;7IJI.*&.--S@)H!@I$=! :E$&'*$*).HJ3I$=@. #%&')'6(.4-?E44?'11(

    8IHIH$H=

    %&'/'(.111E115'1(

    - ,$);2P( !=&1?4 )$A=IO$ I $=A7 $ @$

    17G=!I$145 7)=:I8;!D;I=&);$$

    !*5'1(.E11?'1(

  • -&

    21

  • -1?

    : )" $

    "

    ""

    3 "

    !3 $"

    $ #

    Indicators!

    3F$!3

    H;::

    "

    &% !37 ) I3 :

  • -1

    ,: :

    0 :" @

    A 0& 02!3 0 0

    3 !3

    "!30

    ! 3

    $I ##

    Audiences)!3 ! 3

  • -

    $

    7

    $

    H

    " !3

    Conclusion&!3 @

    $!3*

    @!3!3$

    !3

    #

    @

    : !3

    Evaluation at city level!3:@

  • -1

    0!3

    An example of Healthy Cities evaluation: Liverpool=>A 4I0

    =% =33H%

    # .

    Policy formulation'(7%6'

    16 &

    =

  • -

    : : " $ 0

    J1516

    , 8 J 15

    = $ 5-

    :

    0 0

    "

    %:

    = : :.'( &

    .:

  • --

    Policy implementationB C :

    $ :

    #J, !!3>%

    * I

    $!3> :1

  • -4

    5 0

    6

  • -5

    0%##

    % 0%, 0

    0 0%$ 0#

    :%.

    / G!30

    / 0%

    /

    ; 111:

    ,0"

    "$ ,

    00%

    70 2J1

    ,

  • -6

    " 0$0 G0 0: %0 G % $

    0%0

    0* "

    0

    0 00* #0 K *

    0 # "

    3 ,0

    Conclusion ! 3 @

    @=

  • -& %

    @"

    ;

    Guideline and recommendations$!3

    !3

    !3!3

    '( 70

    0" "$

  • -?

    0

    ,0

    I!3 " )

    *!3 H

    ' (" !3$ !3: " 0 @ 0!3 *

    !3

    "

    P

    : * !3@

    " !3

  • -

    ,

    &

    G

    !3 " &

    0 #@!3#

    References1 !$;3)3A.

    .A2DGJ,$4$*=H14

    =$8);TH!.*5'(.5-E6?'14(

    - !$>7!);7D!>;IH3-$/$=JA14

    4 2$I&&I;2-$/ * H $4 *$2@!)3 3H!3>215'@!)#3 3H!32&;(

    5 @$==IH&I:; ; , . %&').1,13I;I$=IG3$*#/$ $15

  • --

    3>H:3I = D 23P>II; G 6 AC ,$ &4 $$ ' #$$ I H> ! 831

    1 ,)=$;G8A!3,:..-2*! . F.-1E4'1-(

    1- 7)>2$;& 2 $ ';; *! ,$ ** 0*$*D*:#*

    LM2>21?14 7)>2$;&2D&,H:;7IJ*0.R!3%

    F)'4(.-11E-'1H)&$GIGA*C#;,$&4&/$ 4 1'#$$ 2&11

    16 =II&HD&2:!7%$* =HA,18=:3&I3)H2$;$7I2I;HI&I$H3!>;:$;GGI,$H2I;)*I;K:H);2I;:;;IH3::I&G:HI3)H$I% '/* ##%',$!=!2&)

    1??

    1 J$3)8& J 9*# ' 4 $$ * ! =H16

    GI 7H)) = 3 3.

    >.16E'1(

    - 3)S A D2$:H $ * 9 *#.1!==6$$'#;O,>,1

  • --1

    6 $A:;&); G 3* / $$4 / $$ ' $$*$!=314

  • --

    46 2:=:) ;(# # / ) 3

    , !$1?6

    4

  • ---

    64 HI$&);,"!.G#;AD=O&*/7'5 $)&14-4E--

    65 H:&H3:

    ".G# ;A D = O& */7 ' 5 $)&14

    66 3);&:G:;I2(/4!2 214

    6G!&&';:(1

  • --4

    ? 7)>2$;&2D&,H:;7IJ*0.R!3%F)'4(.-11E-'115'),(

    ? > !==!316?- &I3HI$HO)*&$I*)H!I$=!6'!=

    !2&)

    1?4 !$==:G$O2C4*$' #/

    -''*!&

    !&

    ,

    1?5 $O=)HJ(#$$+(/6> )

    =!3=1 !HH>=>1G&);83 .(*$.1H9:3,9!&3644(

    I;G$2J";*$*$#;! L!3EM$>$1?'G(

  • Part 4Policies and systems

  • IntroductionDavid V. McQueen and Jane Springett

    ! "" "" "# $ % & "

    "

    ' (" ) ' % # "

    *" " +" "

    , * " !%&" -.

    "".

    " /""""0

    12 3 " ) 45 " " " *

  • 6

    *" ,'((

    -)778 * "

    #)49: " !. + " " "

    #)4,

    "")"2

    * )4;6 ( +" "# *

    "

    "8

    +

    " .#)46

    8

    #)4;< *# $ " " ++

    %

    8 "2"

    "

    (

    "3, #

    " "

  • &

    Making a strategy for healthy public policies work DE

    "# ="8 " "

    "! ' 8

    " " !*,'((

    -

    Defining impact ! F

    " G " /)770F "

    G 2

    "

    ( ( " (

    (")

    ,

  • &&

    " . "

    Measuring impact *

    ("" /)&0# "

    Options for responding to the evaluation issues: example " # ,'( *

    ,+/8++30

    **

    Policy environment,+(* 3 " "

    =

    H

    " "

    ""$

    H ." $

  • &5

    H $

    H

    3

    -8DE3"

    D"E

    " ,+ " """ 8* - " " # ""* .. "=

    H ""

    $

    H "$

    H

    Logic of intervention for healthy public policy #4;;&> )*,'( /)770 *" 7@@@" " /C3(0 #* """ " =

    " "

    !"" #4;;5*" # 8 4;;9 ) '

  • &9

    %",+*

    F* " "" ,* * "

    8* "

    "

    =

    H ="H =H "=

    " "

    ) " # " ""

    !,+,'((

    -

    *,,'(**$"* * ,'( *

    ) "">3#"*

    !*>3"* ",'(*">3)"

  • &

    Evaluating healthy public policies at the local level#*,'(* ,++%: ?(

    *

    Health promotion issues!8454/40,'(* ,+ =

    Fig. 15.1. Key elements of an implementation structure for healthy public policies at the local level

    + 8

    .:

    #+%:*" 2

    Principles

    Levels Outcomes

    3 6

    2 5

    4 7

    Creating healthCommunity engagement

    Building alliancesSecuring investments

    1

    Local policiesLocal politics

    Local policy arenas

    Health promotion agen-das and issue networksHealthy public policies

    Investments forhealth promotion

    Cooperative planning

    Outcomesdefined by the

    cooperative planninggroup and by theplanning method

    Health lifestyles ofthe local populationSocial, economic,

    physical environments

    Active lifestyles andcommunity participation

    Social networksHealth-enhancing

    infrastructures

  • &6

    +" , *"

    /0" #+%:*"/0" 8

    "

    + .(* " " F

    Implementation process!"8454/70 #+%:* = / 0 """#

    Policy-making level ! """ "

    !"8454/0 : ,B" B,"

    B,B

  • &;

    , "F * 8 "

    Population level( *"

    / 8 454 &0 + # ,"B,

    / 0B

    +%:*" 2 /8454&0

    Health promotion outcomes! / 0*" /845450(" / 0"/ 0! " "

    "" ( " / 0"/ " 0 /0

    Evaluation design *" 8454 # /84570

  • 5@

    "

    Fig. 15.2. Design for an evaluation of healthy public policies at the local level

    # ( "2"/.0"( # " "

    / 0 # " 8* " F / " 0

    "

    Evaluation processImplementationprocess

    Cooperative planning Internal evaluation External evaluation

    Selecting theplanning group members

    BrainstormingDefining guidelinesand concrete goalsSetting priorities

    Defining measures

    Inplementing measures

    Assessing evaluability

    Evaluatingmeasures/outcomes

    Evaluatingoutcomes of

    group dynamics

    Evaluatingexternal outcomes

    Evaluating group dynamics

    Feedback to the planning group

    Analysis of key elements,structures and actors on the policy-making and

    population levels

  • 54

    /84570!" ) " " " "# " 8

    Use of quantitative data8":

    #+%:* ) +" I #"

    ""*,'(*"

    ! *

    * " ! " "I"" 8 "$ " / " "0"

    "" "./0!" ">3

    Evaluating healthy public policies outside the local level "",'(*

    ,+"

  • 57

    *,+ "

    Implementation process# " .!,+"8%++)" ,'(*". F /8 450 "

    + /J0 "

    Fig. 15.3. Current policy implementation structure

    !845" "K "" #

    Cabinet

    Ministries

    Regional administration

    Communities

    State level

    Regional level

    Local levelIssues

  • 5

    ,'(*"

    "*/845&0

    ! "" " !

    >3

    #*!3

    Fig. 15.4. Desired implementation structure for healthy public policies

    (

    /"

    0 " *+ 22 "

    " " >3

    Cabinet

    Ministries

    Regional administration

    Communities

    State level

    Regional level

    Local level

    Audit Group

    Umbrella Group

    Cooperative planning group

  • 5&

    8 !3

    +) * "

    C ".""#" ,,'(*> ))'% ",'(**"* "

    "

    Evaluation design* " "*">3

    Phase 1. Caseconsultancy approach>3"

    K " #

    #"> 3 " *,'(

    !"8455 *>3,'(* ,'(""

    " 8*>3" *

    "

    , * "

    ! " ""

  • 55

    !D E

    2

    >3" " "#"" " 2 "

    # "-" "

    "

    Phase 2. Measuring the impact of alliance building- C""""# * *

    Fig. 15.5. Intersectoral evaluation and learning process: caseconsultancy approach

    Outcomes Problem solution (direct

    result on case and indirect results on other projects)Use of knowledge/expertise The most powerful learningFacilitation of joint workEncouragement ofintegrated strategy

    Genericproblems

    Umbrella Groupprojects (andspecific issues)

    Evaluation processto bring expertise(action learning)

    Experience andexpertise

    Projectcase

    Local experienceand expertise

    WHO expertise,case work andnetworks

  • 59

    ! >3,'(*) ""=

    H

    $

    H $

    H "*

    " * "*

    : ,'(*) " *%,F?8>3 *8" *>3"/ 0. 3"

    " "8 *

    *$/ 0

    + >32"# /84574550"

    (>3 ! " "

    ">3 :

  • 5

    """8,'(""*,'(*")">3#

    Use of quantitative data,*),'(*.

    8 D E >3"*,+8DE3

    (. "">38>3" "4 * " *

    +" !" * . " >3 "

    "

    Audit of health impact of state public policies >3 ""8++!

    /845&0% ,'(*

    !"

    " /)60,'((

    - "='+ -,'(

  • 56

    % %",+

    !"""8

    C3( 2 >3 # * +

    Conclusion: towards a framework for evaluating healthy public policy(,'(*

    ,+ !""8D" E$"D "E ( C "

    ,'(*,+""! * ! >3

    , + "" #"

    ". ! # " " "

  • 5;

    . .

    8 " " ! " " 8

    "= !

    8 # "

    + ' " ""8 "B

    #

    """

    ) (

    " " C "

    "% "

    8"% DE

    D" E# "

  • 9@

    ": D

    E.% *"$"

    ! "

    References4 L-C!!"

    #=49749/4;;507 3(>:!C+:M+%#C3-N8*=O')2

    B$/&0=4477/4;;0

    ?-G#C?+MA#3?#(-' = %$ /40=&@/4;;90

    & :#?#(C&' !'!("%K 4;64

    5 ,'#-'-!K:) ** * " !( )'%> 4;;9

    9 (" ) ' % $ /&0= /4;690

    )'-C')" !%(+4;;@6 K-!C

    $/40=4;79/4;;90; :)I>--CKG

    $=77/4;;904@ ,-#++)'C=

    +=)N%,- !'!" . /% C"P !#4;;595;7

    44 L-C!$"0!." !:(G7@@@

    47 ?#CKF?(:)-)"1'-")

    %'4;96

    4 ,#?K!G+

  • 94

    45 '-)?('+!-1/! (+= 4;;9

    75 :)I>--CKG3Q%'F" G+=1!M?;!

  • 97

    & 3--C?,-!?%#!"*"%?!CK) -!?'"

    B + !$=7;;@;/4;;0

    & ,-#++)'MF>)>G!?!+:N=23' -=@74/4;6@0

    &6 )!%?!CC-!?)!*1-'" :4;5

    &; ,-#++)')

    /0+=F: # ' ))> %4;6;&447

  • 9

    5@ 8!C)#+)(G-!?! $ ! = &@&49/4;;0

    54 3((K:!C:% B! * !( '=&/4;;60

    57 '!,-%-!?:= " $ " = 7;&7/4;;0

    5 :)?-(P ''. *(' !((! " !%,F?84;;6

    55 >!'%'*!%,F?84;;

    59 +#:C-#>''%2 '"'9!)N,M+4;;5

    5 + *# CC,C&!(""%3!-")

    %'4;;&

    5; '-#K-C'-#:-!N%-=

  • 95

    16Evaluation of health promotion

    policies: tracking a moving targetNancy Milio

    Introduction!"=" "

    :=

    8 " B

    ! " $ 5@@4;6@4;;@65 "&" 2 "

    - "".

    8 "

    B. "

    F

    """

    """"

    . " "

    "

  • 99

    Policy evaluation% "" "* ="

    ""# #

    2

    Some basic questionsProcess! .

    H '"BH , BH ,""BH ,"

    BH ," B

    " /" " 0 "

    EffectsI=/

    0 / 0I

    =

    / 0

    /0/08 = +

  • 9

    =

    A framework for health promotion policy-makingEvaluation: concept, problem and purpose! " " !""# "

    " "

    "- !

    *

    Overview of the frameworkPublic policy: purpose and environment% """ # !$ # "

    (/0 / 0

    /0

    # ""

    ". "

    ""

  • 96 Fig. 16.1. Health organizations and policy-making Policy environment Policy impacts

    EconomyDemographicsEpidemiologyTechnologymedia mixIdeologiesPolitical processes

    Policyprocesses

    Publicpolicies

    Policytools

    Goods and services: jobs, housing, food, education, environment

    Organizations: public private (profit and non-profit)

    Self-starting initiatives

    Organizationalchanges:fiscaladministrativeprogrammaticinformational

    Impacts: on other organizationson other environments

    Outcomes for: clients total popu- lation

    Publicpolicy

    responses

    Healthorganizations

    policyaction

    Coalition building:lobbyinglitigationnegotiationopinion shaping

    Policy-makers

    Stakeholdergroups

    Communicationand interpretive

    media

    Publics

  • 9;

    !8494 2 0!

    ""

    .$#

    " - "

    Actors% """ *"

    /84970

    Fig. 16.2. Media and policy-making processes

    (

    Interest groups: legislative committees bureaucratic units parties caucuses lobbies of industry, labour, professions, voluntary organizations

    Media: news coverage and foci editorials opinion poll reports political advertisements Publics:

    consumers audiences taxpayers voters political contributors potential interest-group members

    Public policy-making

  • @

    , " % " " / 0" /84940

    .

    ! ( ( /84970

    "

    2%

    :

    Types of policies8 /R 0 / 0"494

    Table 16.1. Strategies for disease prevention and health promotion

    /0/0"/"" 0!

    Intervention strategy Focus

    Individual-directed, information-mediated change Homes and communities Organization settings

    Organization-directed change Policy bodies: legislatural bodies independent regulatory agencies government administration Specific organizations: government bodies other organizations

  • 4

    / 0 /0 / 0

    A case in point: tobacco-control legislation" " "

    >+4;6@ +"""""K

    .

    "

    Environmental context: why there and then? ."B, " B

    ,"B >+ "

    "" ""

    8 " ""

    * "! "+

  • 7

    $

    "

    Policy frame and setting: how and where was the policy issue defined and legitimized?'"

    "

    + .

    H '"" = B

    H , " / 0B

    H ,= 2B

    H '" B

    : +

    2

    The forum%

    ," B'""B

    ,

    B "" "

    !" B8"

    " +

    "

    Design, instruments and financing: what were the policy goals, tools and resources?#2 3 * / 0

  • 2,* "$" "

    Policy instruments / 0 $$ (/ 0"

    #* %"

    :""

    . +.""

    -

    "

    $

    "" .

    H ,"BH , "BH ,

    "BH ,"B

    +""=

    "R""""" "R

    Organizations: who were the players?Interests!" /0 "+2

  • &

    2"

    $

    , /"0"

    :

    "$"G$$

    =

    Bottom-line judgments * + - /"

    0 "

    +".!)+

    Identifying stakeholders:* )""

    Organization indicators!*.

    =2" *#=2

  • 5

    !2

    R

    The question of values!2 "

    ("2 " F. 2"

    H ,"BH ,"BH , B

    Interorganizational relations: how were players interlinked?" " " "

    Joint efforts! " "

    ) " ?

    ""

    ".*

    K

    ( "

    " "

    ""

    Issues to explore ""

  • 9

    "* *

    Organizations strategies: what action did players take?Types of strategic action

    >+ ?

    .

    Bargaining " " -

    . "" /)

    770

    !"

    .

    2

    "

    2

    #"$G

    +2""""3"2 F" ".

    F .=

  • Information in policy-making: what types of information were used and how? - " # .

    /0/"

    0"" ( "

    Designing policy8 " "+

    =

    "

    ( 2

    * 8 " *

    Enacting policyF =2%* "*

  • 6

    " )K(: #" R

    Effects on policy-making" ""

    2 2"#"

    %"" " C" # "

    22

    Useful queriesI"

    H K BH ,/ 0"

    """BH K

    BH ,""

    B

    Implementation: did policy become reality?. ="B!

    ": P

  • ;

    #"#."

    .

    H ,

    "B

    H '""B

    )"

    /0

    Policy evaluation issuesThe environment of policy evaluation%

    3" (

    #

    "

    Units of analysisIndividual indicators' " %

    """ "

    . ""+ " " ""

  • 6@

    " 22 22

    : " "

    "2"

    8 " / 0 /0" 2 + "' "D

    E*#

    Organization indicators, "

    * "

    +

    ( "=

    H * $H "

    $H /

    0$

  • 64

    H /"0$H /

    $ $0

    =

    H H H H H H

    )

    /84940

    Dissemination and use of evaluations( "" " " ! =" "

    8 / 0

    / 0+ "" $

    "

    # "

    "

    C" + .

    "

  • 67

    - =

    !

    " "

    Conclusions, "

    "

    C""

    -

    *+" "

    """"""""

    ! # " ." "" ! " =

    *

    References4 :#?#( C ! " =

    3 7! * !( =56/4;90

    7 :#C

  • 6

    & ?#C-C3-N-!?%" 37!* =7;64@/4;;40

    5 %-CA:!-!?"= 37!*!(/0=65697/4;6;0

    9 3?!CA %4;;

    44 F-,-3MK-?-(C%=!*""'"#?K4;6

    47 F-CN!:#C/&0=!+7;;!+@9/4;;50

    4 :#?#(C,!"**!.'"FN'> %4;;@

    4& :#?#( C0' * -. !' * '" "!'!(")'!%4;;9

    45 :#?#(C>+=" )4/&0=49/4;;90

    49 )!:%F-??'++**"SKT)'+%'> C)4;;@

    4 ?!>:!CC-M %4;;;57

    4; )!%%-?!8MN!:#-+(C. '**(*%!+)> % 4;;9

    7@ N!)(F+(C % - !? % B! *""-=6646/4;;0

  • 6&

    74 ()'-8(KM)(FF%&"!7!/40=594/4;;0

    77 %4;;

    75 3((K:!C-!?!. = . " :37!*/0=7@677@/4;;0

    79 3((K:!C-!?K

    $!6!"/70=4946/4;;0

    7

  • 65

    6 ?>-%C#C3(88#)-+ '*-**

    @',K)>+)4;;5

  • 6

    17Evaluation of countrywidehealth promotion policies:

    the Canadian experienceReg Warren, Irving Rootman and Rick Wilson

    Introduction " % ** * ,'(" /)#CK#0 >+ )(::# )>+ "*

    ,

    " "

    "

    Canadas health promotion programme#4;6)"

    " # "%

  • 66

    "')

    " " ! """"4;6;

    #" $ R $

    /0$ */ *0$ # ." ) U4@" "'%K

    C

    ! " .

    4;6; =

    H "$H "*

    '%K

    2$H 5@ /

    0@4@@ ')*$

    H

    3 *" . * *

    +"

    Evaluating Canadas health promotion programme: challenges and barriersThe administrative context4;6; "

  • 6;

    #

    # )/ 0$ !" " !

    " >* 8 "."

    ) % ' ! "3 !!D"" E

    The political context: roles and responsibilities, and shifting priorities()"

    ) * )." " .

    * / 0"

    #

    " 3 8 ".

    8" ""F

    K*"" "

  • ;@

    !."

    .# " B #

    The socioeconomic context!"" " " )") / 0+ " " "

    !" )" *

    Evolution of health promotion8/4;60 /4;6;0 + *

    (")'%,'(F4;6; "

    Differing resources and capacities

    " ", " /0). "" ".

    K

    #

  • ;4

    ) C3(

    . #

    C * + " /*0 :

    Coordination and integration#" "* " !

    .$ !" ".

    #" 8

    " -

    . ""

    "

    $ ""

    Lack of control conditions8" . - "

    "-

    2 *

    ,

  • ;7

    ""/"02"

    TimelinessF 4;6; "

    Seeking convergence from multiple sources( " "$ $ $ $

    */0$ - .*

    "" " "

    K

    . "

    >

    " *

    )

    . = / 0*"/ 0

    "

  • ;

    #

    * "

    .

    The Canadian experience: lessons learned( )2 " 8 =

    H "

    *$

    H "" $

    H *

    "$

    H $

    H

    $

    H "

    #=

    H

    $

    H

    $

    H

    $

    H $

    H *

    : "

    / .0

  • ;&

    /40:

    "

    Applying the lessons learned " (" .# " #" !. "

    " " :

    $ $ $ $*" $ +"

    ,

    "

    "=

    4 7

  • ;5

    &

    5 9 6 ;

    A user-driven approach" ( # /

    0 !" / ) &0 * -"""

    "

    ""

    "**""

    =

    H " / " 0$

    H " $H "

    # ""

    " "

    Agreement on basic operating principles! =

    H . $

  • ;9

    H . " $

    H $

    H $

    H /

    0$

    H $

    H *

    Partnerships:"

    =

    H " $

    H " $

    H "$H "$H $H $H

    "


Recommended