EvEvaluaaluattionionin healtin healthhprpromotionomotionPrinciples andinciples andperspectiveses
EvEv EvEvEvEvaluation in health praluation in health praluation in health praluation in health praluation in health praluation
inhealth
promotion
omotion
omotion
omotion
omotion
omotion
WHO Regional PublicationsEuropean Series, No. 92
Evaluation in health promotionPrinciples and perspectives
!"#$
%#&'#()*
+# )#,-# .#/ 0#12#3 4# 5# # 6#768 #69:#8;6:#:#6 :#/6< :#=6 :#/
/9' ()5(>+-0(+ %'8? @0(>*//' >-45A))00
8/B9
Evaluation in health promotionPrinciples and perspectives
Edited by:Irving Rootman, Michael Goodstadt,Brian Hyndman, David V. McQueen,
Louise Potvin, Jane Springettand Erio Ziglio
WHO Regional Publications, European Series, No. 92
HealthCanada
SantCanada
/9'()5(>+-0(+//'>-45A))00
C ????DBE?6?
#@E6 ???6/?F56GA)+>>H636BB
?I6?B6
#
?DFB?)?1A#@
#
C?A
I?B?/?D?66?6A??#C??3B#
C????JD??#I6?A#
CBI???D#
3
AcknowledgementsC3BDB?6B???
#/ 3 6? 37@#KA
6B?6?1/?@@1G#
AbbreviationsOrganizations9/ 9/61G ?61/'/ 'B3?/1 1K@ K@D?1'/ D?/D@ @61G'/ '/61G
Specific studies and technical and other terms .7 ?A@C @C?' B
88C ?3: @L AF?@ 7 @ G/ GB3/F8@C 8 KC 8 3KC@C '7 D'M@/ 'I@/
6?
66D?
;@L EAF?
Foreword
!
"
#$%
&
'$
##
(#(
$)
#
*
&
+(
*,&
&
&&
#
+
-
&$
&
*
&
%
&
"
"
&&
$
&(
& ( $ &
)
$
#
8D ?
I
WHO European Working Group onHealth Promotion Evaluation
@/6??616?6@61/@
@/6?@6'?6?6@61/@
8'3
?6@661G
9K
6 61?
661/@
876?61?C6
7I6' 6?868B6 K
896?61?C6 .!
7B/@6966B6
86@661G
836'?696
I
8;@?76'?6?6@61/@
C8??68?/@??636K
7N61N8N68N6
6?61?C6 +!
C/6?'@6?6@61/@
/
/36?/6 ???663
+*#9B+(()+((56B/A7? @ ? / ? %@/ *# / I B 6+((4B7 A?.?633?6A6 B6 ?A6 # KB??6
D6
I
371A?G61/#/B3?F37+((-#B3
6
B
#
/&"-&&@?37A6@?B ?6 @F@ ?B?861?G8/1?G61/#K6
A6B3BD#A???6?A?A6?3?66#
# $ - / ? 9 K66@? ? @?? 1 ?9#K3J A?A3A 6 ? ? ? 6 D ?6 ? 6 ?6B
E??6A?3B?#3?6#A I I 6 B
D#BD?A#F?A6 ? ? ?#
/&-$6##6@?61/6
DA#KB??A?/1?8A
6
366???#??A1/#@@ ?6 A
I
6?#
0-&A?
BA/?61??69361/#/A?
BB?A? #?#
+(%1?86#/K
B?ENNA#9?6B38J??:A#??BJ#
#%1 ?? ? / 1 ? L36 1G# / ? +(5.6
? L3#? 1?L3/C?81A6 A
#/ 3 6 #/?I?/A?/?@#
&%?? 1 ? C6 %
* @ ? 1J ? 8J#?/?161/%##6+(2(*8161G%9#@#6+(2-*#?I )0 / @ K6C6&- 1J?@/6'B
I
??/36?
A7C?#?GKK:AA?K6??>+*#
0 @? 1?G861/6B3#9?F8?+((56B?37?1?G#
$BA16?61?C66/8 16B#/81?
I
C6 ? F ? ? ? @ K6 ?C?6#BA? 6 #6?? 6 @ K 9 K F6 'B C6 ' K 6 C3K?#K+((4+(((68B?@#
0 ?
B 1 ?61G6#/ ?? F 7B#
+*0231/B/9
+(5>6?31?@#/BI?B9
6 / # +(5568 E3 3 3BAB F ? # +((-6 1?//?63A#GBJ???AF36?A#
$0,69#@#6)>>>6@6761/#1?6/#
06??)>>>6A?@6761/6B/K
B'?A#6?AA#
BAIBB???A#+(5),+((>6GA????#
I
# ? @ ?966+((5#9?6?A?9#B31 ? 9 J ? 66AA3#
)+(??6L1/?861/#???
A? ?A666A?A?#
30)??/16G61/#/ ?1?G8?1?G8/#/ABB36?G#BI D6# ?A66A666:@/#
4&/?/D6?61/#/ ? L / ? D 8# / # 8 D I I A ? 6 :@/6F6#
#,?K?B?37?1?GA61/#8DA?6#
*(/&5/9 /@?7'?A61/#9?6??@@
II
????/
@'?#9? F6B?? 1 9 1?61G%+(5-,+(()*66@??9/#@53+>>.>6F4A# / ? @6 9D66 K6 '6 'B =6 / 1G6 B
1 /# 3 &
%@@6861?86)>>>*#
! )@?37@ ??/???//1?G61/#/A?? ? GK#/
6 B3 B #/A
B?6 ? # / F?6A#/A??A6A6 6 #
3& ! ? I ? @61G#9?6B ?AC?#
!(???/861?86#/
II
8 ? K ? / E#??#
*3,##?A ? / 61 ? C6 6
9#/#?93
8#/#A?/1?'BL36#@??/ ?@? 8?/1?C# A?;?? 11J ? # ? I A6EA?A?6?# EA?A??6BA#?E???B 8C66F6? 6 E ? ? ? &?%BBB##E6(>+*#
!$3@?? A@?/?'1?96#B36B76B8 ?GA
K#/ /?? # ? # /? F?F6??AB363A6#
&3&@?6K?'61?8A6 # / @B ? 8 ?# ? ???#
0$2!3&68###6##6 @?A?8G1861/#/??
BJ/?'?
6 ? ?/A@?/@8/@?1/?/#@? ? 37
II
1 ?G6 J B3???3??#A
636?66A6E#
6(3$????/1?C6A#9?F1+((>6?6??/16BB?A???JA#6?6?
#
+3?37A? ? 1 ?G61 /# A8BA7/?//1#A66A ? # A ? #B3DBAA?A#
137? ? A??//@/C1 ?D67#8 :? ? L1# ?8@ /% ? ? ???*6F# PB3?B??A#
+&@?37@F@?A86 @ 1?G61/#/D##A?1?G1A?'3#
II
G?#A 6 B? A3
#/DA?A?A#A????#??D6?#
+,??A
II
??# ?6 ?A ?B
?#
3?BF?+((>#IA?#6 ? 6 1 ? C ? J91#BF 3? ?6I3??FF#8 I I 666?I ?A#8B?A??6 6 J?8?#IIA?76BAF6@/AF??B3BBDB3 #8A?##
'$ ? ?B B 371?G61/#/ I 6B
A #8
? A
BI??#/I?A6B6?#
3&F?F3 ?# IA?B?A#II??6BB?#B?F6@/AF??B3BABDB3#
II
868###6/6???A 1?
661/#AA????6??
#
'9 @?/ ?? ?#9? F6B3 ?+)
6'@#B3B+(5+#
II
Contents@3B ######################################## @ ############################################# * 37#### I############################################## I
Part 1. Introduction and framework3,"0
###################### -+# @?B3?,"0
12
3/. 4
Part 2. Perspectives,3 ################################# .+)# 9
?,3.453* .0
-# ,671831% 2-
.# ,/. 5-
0# C?
BEE,.2 +>4
2# ?EA?A?,60 +)-
4# ?,+2 +.(5# BE
?B3,0 +4+(# B3?
D(3 +50
Part 3. Settings,12
)>(+>#
,330 )+-++# ?
,.9*%%7*/.,50
/9&/#3*
053+13,.0
3)5/4 ).+
II
+)# ?,..9 )4+
+-# B3,36/. )50
+.#
?,3+/.%5 ->(
Part 4. Policies and systems,6718/. --4+0#
I,%0: -.++2# ?
3,;1 -20+4# ?B
I,0)"0
0&) -54
+5# ?,+/*&3)2%0+&+3 .>0
+(# /?,1)5;%3,3# ,..##################################### .2-
)+# A,7&*2+.65 .40
))# ??,=.43.3 .(-
Part 5. Synthesis and conclusion)-#
,1.2
9467183"0
/. 0+4
Part 1Introduction and framework
Introduction to the bookIrving Rootman
WHO European Working Group on Health Promotion Evaluation !"" ""!#"""!$"" %
&" ""!$
$'() * +* ( ,*+*- ./0"*0!,01+0!-.2!" ' " *" . /3
"!3$4"$" " ' #5!6778"'9
"!!!!$
#%9
:
; "&&3
; !$&!
Process%$ '" !*+*"0"* "#*(5"#677?!$*(+677@0 " "$
#$!'0 "'"!!$!!'
Guiding principles!'"$ $/!"',"-9
; ,$"-3
; !,-3; ,!""-3
8
; , $-3
; &,!&!%-3; ,
-3; !,!1 !$
""!""$!"1-
"'0""!"$9 !$" ! " "!!/"!$"$$ " ! ""$>!" 9
$ $
Limitations and strengths 0""$"%!>"! " "!!*6$!
$'""!/!"$3#"' *(0'$"$",*6-
>!""!
A
'
!"
! > " 'B !$ C"
! D *E
Structure !!"!"
!$$ " " " !$$ '
References6
!"#$*"$
"6778,-
E %&'()*'%+,&-) .( /
0 10 ,0 *10 2/ 3450
66#*""6778 78/
8
(
/9
:
&-02+09(
042/663#'""677@,$-
: &/(+
%&')%+,&-)#
*""677@,.F#*(F#G/=8=6=-
8 /(#
?
1A framework for
health promotion evaluationIrving Rootman, Michael Goodstadt,
Louise Potvin and Jane Springett
3"$ "
What is health promotion? " !B!"! 9"3!3
Recent origins 0"!0"67?:*"4H"18
:!!!!#&!$!"/./"!""#67@A"#*(
*("
0$9
@
6 &!3E B "
3
3:
!!3
8
"!!!
'I"""$9
A !"$"$"3
? $B"&3
@ $!!3
7 "36=
9 " C"
&D
,'I234I)5$-
>!" " ! !"!"&!""!64
"50" !$9
6 3E
3 $
"3: "
!38 !!"
"!3
7
A 3053?
!
/ ,6 8-"
,E1A?- "%!$
6=
$!,->!"!$ % > " $!"&
Table 1.1. Definitions of health promotion
+"%$" 6E ! $66%$"
Source and date Definition (emphasis added)
Lalonde, 1974 (3) A strategy aimed at informing, influencing and assisting both individuals and organizations so that they will accept more responsibility and be more active in matters affecting mental and physical health
US Department of Health, Education, and Welfare, 1979 (19)
A combination of health education and related organizational, political and economic programs designed to support changes in behavior and in the environment that will improve health
Green, 1980 (20) Any combination of health education and related organizational, politi-cal and economic interventions designed to facilitate behavioral and environmental changes that will improve health
Green & Iverson, 1982 (21)
Any combination of health education and related organizational, eco-nomic, and environmental supports for behavior conducive to health
Perry & Jessor, 1985 (22) The implementation of efforts to foster improved health and well-being in all four domains of health [physical, social, psychological and personal]
Nutbeam, 1985 (23) The process of enabling people to increase control over the determinants of health and thereby improve their health
WHO, 1984 (24), 1986 (4) and Epp, 1986 (25)
The process of enabling people to increase control over, and to improve, their health
Goodstadt et al., 1987 (26)
The maintenance and enhancement of existing levels of health through the implementation of effective programs, services, and policies
Kar, 1989 (27) The advancement of wellbeing and the avoidance of health risks by achieving optimal levels of the behavioral, societal, environmental and biomedical determinants of health
ODonnell, 1989 (28) The science and art of helping people choose their lifestyles to move toward a state of optimal health
Labont & Little, 1992 (29)
Any activity or program designed to improve social and environmental living conditions such that peoples experience of well-being is increased
66
Table 1.2. Definitions of health promotion deconstructed
Source and date Activities(programmes, policies, etc.)
Processes (underlying mechanisms)
Objectives (instrumental outcomes)
Goals(ultimate outcomes)
Winslow, 1920 (2) Organized community effort for the edu-cation of the individual in personal health, and the development of the social machinery
... to ensure everyone a standard of living
... the maintenance or improvement of health
Sigerist, 1946 (1) ... by providing a decent standard of living, good labor conditions, education, physical culture, means of rest and rec-reation
Health is promoted
Lalonde, 1974 (3) ... informing, influencing and assisting both individuals and organizations
... so that they [individuals and organizations] will accept more responsibility and be more active in matters affect-ing mental and physical health
US Department of Health, Education, and Welfare, 1979 (19)
A combination of health education and related organizational, political and eco-nomic programs
designed to support changes in behavior and in the environment
that will improve health
Green, 1980 (20) Any combination of health education and related organizational, political and economic interventions
... designed to facilitate behavioral and environmental changes
... that will improve health
Green & Iverson, 1982 (21) Any combination of health education and related organizational, political and economic supports
for behavior conducive to health
6E
Perry & Jessor, 1985 (22) The implementation of efforts ... to foster improved health and well-being in all four domains of health [physical, social, psychological and per-sonal]
Nutbeam, 1985 (23) The process of enabling peo-ple to increase control
over the determinants of health
... and thereby improve their health
WHO, 1984 (24), 1986 (4)Epp, 1986 (25)
The process of enabling peo-ple to increase control over [their health]
and thereby to improve their health
Goodstadt et al., 1987 (26) through the implementation of effective programs, services, and poli-cies
The maintenance and enhancement of existing levels of health
Kar, 1989 (27) and the avoidance of health risks by achieving opti-mal levels of the behavioral, societal, environmental, and biomedical determinants of health
The advancement of wellbe-ing
ODonnell, 1989 (28) The science and art of helping people choose their lifestyles
... to move toward a state of optimal health
Green & Kreuter, 1991 (7) The combination of educational and environmental supports for actions and conditions of living
... conducive to health
Source and date Activities(programmes, policies, etc.)
Processes (underlying mechanisms)
Objectives (instrumental outcomes)
Goals(ultimate outcomes)
6
0" ,-" %" 3 " !
! /!""%"! $""4""$
!!> "!""
6:
!!"
!" $
0$ $&!%
'""""$$! # " !!"!"
,-!"!$"""%$
Practice
68
#"!!$
"!$> "*" 9$
$13$"3! " 3! % 3 !3$3!3!
#"!
$ 0 !! B!,$
""!-! # " !
"!"!!&!$
#!"" "!$%"#!"!!! "!"$0"
"!"$"
Conclusion$"!#!
6A
Meaning and practice of evaluation in health promotion:=!"!
0'I2BC% !D 3 " "!&%&!JJ J > JJ !
Fundamental issues and challenges ! " / !3# "!%$% " ) 0 ) 80)78(
#!
!!4!$!B 5 $ 63"!"%"$!"
/!!"!"""!% ;" !0"10" $C$D"CDC!D43CD5%
6"$$%;"&!$;$$
>!" (
$($)$/!
6?
$ . / ' $67A=" $ " % !! $
!!#"!!B !!"'IHB$3(! " !/ 5" $ 9 "" " 0"9
6 !!$ ! ,%&!-3
E ! ,-3
B!,!$-3
: !%3
8 !$,-
!
Social programming ( ! ! ($
%"""% 6
$
!"! !> " ; "
6@
#"$!"$
;&!&"
!& 0!
!$ ( 1 B*
C !D!!$
" " ! # " ! ! "&"$!!&
4!"'IHB$
3$ ! B "!
& ! ! $
"
>!"
!*0!$ $! " " !#"'I2B(*+F(*+3 ""$"
(*+,"!
-(*+,!""$-
Valuing ! # ! !"!
67
6!>"/" $ $"!$" 0 " " 5
($"%&!$!+ ! "%!5"$!$
0"! " &! # "
! ! !
"&9"$! ! / & ! ""$&!"&
"! " 0 "!
! /!""!0"
Knowledge construction 2!!""305 F&$ !! 6!!$ 3; #"*B ! ! $ !!3+
E=
! *" !($"!
'303!"!
$"
$!!3&&!
#",!-"
!!"
#!%!!$!" !"!!!$)!3""!
0 "!!! !%$!"$
" $!!&$!!" !!
0"CD3"$!&"
!$!$ 3%
33!!
0"
*35&$$
3!*
"%&$
0"%!
E6
% "B* 35 ! C$&
!$!D
*
! ""$"""!3"&"""$"!"!35
*35%%$!!!
&C%
FD
!!C!!!F!D !$,"$"!!-C!! ! !
EE
"$"
$" ! ! !
" " B0$5;" &
> "$ ! ! $
5&&/!"
$
5
)! 5 !!"!#$!!!!!"""&!%$ " ! !3!"$
! &" !$ ! "
!0)!5""C$
!!$D
"!" ,* 66-! !""$&
Knowledge use#! $ $
!%"$!500505>!9 !
!3&"$! &$ 3 ! $
E
3!$33$
#"I>; * $!"$ > " !!$;I>;$ 0 !!%"!!!
!5#"$"&!!
("""$CD;(!!"> "!"!!
0,"-#"!" 55/5$!$
Evaluation practice>!"&""""&"
0/5"!I>B ;!"
/5!$ ! ! $ # "
E:
, " " -!&""&9
0 ! $
*6" "$!9C!D"$
!$
E8
0!$!
$$
!$ & # & " "&!
" $!%"*%%!
J/ !$"$&!$ " & ! "
$
4!$"!"
#" > " "" J ! ! $""*$!"!"!"" $"$" (>
$"%!
J' " !
*" J / 9 " " 0!!.
!
EA
9 ! %" ! 3 !3! 3$3!"3
0"$0"$ ! 53!!$
!B3 " !/$
"$!$$
.!"
!
Conclusions 0"!"!$!"!
"$" ! + & " " B $"!"!$! ! !!!
"!
& >" !
!
" ! $!"!"&
E?
55
!" !
!"!$0 "
E@
A framework for the evaluation of health promotion initiatives /6;
!6$!(3"" "!!39
6 "$!3
E "
!3
!9"
!!3
: """3
8 "
3
A !9"
)""!$ ! B " %""0"" $"
E7
"
/!$""! "
/ "0!$$$"!$
/ 0!$
"/6;9
0K&! !&%"%"$!%$"
>!""$!!!
Step 1. Describing the programme 0
"$0!
"$""""%
+ ! $!"#!"! $/6;9
$ # " !&
$,-($
=
(3
9!!$"$""!49$"!!""$
Step 2. Identifying the issues and questions6 9
"9""%$"
"
"$"$ !
0 " """&!
L ! 0!&!"0!!!!>" $ %>!"" !"
#"!!&1$&$!!
#!$B"!!
Step 3. Designing the data-collection process
$& ! B
6
#!!" !$!1"$"!
!!"$$ # % 4"$& # ! $!!!!
0!& $9
6 %E : 8 &
4$!56 % ! $
> # " "
&"&!""!"&&643
/"%$"F" ! ,"-0
"$ B%"
E
"!%!!3!!!B,-/!$""
&>"%J# "
"8=M!!/"J"9 $"$!"!$!!6816@!9!&%"!F$"#" !
Step 4. Collecting the data
*! $ !/!")!$"!!
Step 5. Analysing and interpreting the data# ! " !&/!"! / !#"!
Step 6. Making recommendations/!"/6;$
9C"!!$D(!!$"!" $$"
Step 7. Dissemination""
:
@ 40*+/4&0,E-9E@,67@=-
E6 '
8
E7 H0)
A
:A H#
?
(.
#"+*"./+$/"677="18E
A8 *
@
@ (0
Part 2Perspectives
IntroductionLouise Potvin
!
"#
"$%
&%$'
(
!)
!
*(#
!+
!)
&,-
.&))
!
!
%
/
*
!0" *
&
#
#
))
) + ! *#)
1#*))/+))
234
"#) 5.* 3
3
& ) ) ! .
)
6
)'!
7
.)18'
)*9- 8:;
*96 8:; . )#
)
&
D
2Beyond process and outcomeevaluation: a comprehensive
approach for evaluating healthpromotion programmes
Louise Potvin, Slim Haddad and Katherine L. Frohlich
' 0
&
"# 3 3!&
#!
)9
;?
(1@8))(B B
&)
+ /##)
2
)&?+)
Programmes?+#* )
+
/
'#
*
(9 , . ( & ! ; A + !" #' + # 9E;
&
FG=
#/ 0
Programmes as living systems!+
Source: adapted from Contandriopoulos et al. (19)
?$9;&
+=
!(0
! 0 0
Programme components8
(%
Target of change Programme components
Relevance? ObjectivesInitial conditions
Coherence?
Resources
Achievements?
Results?Resulting conditions Activities/Services
Responsiveness?
Environmental conditions
Programme
Fig. 2.1. programme components and evaluation questions
4
!*#
&*. 33!I*! =
+ !!#3 " ( )*)!$.""6"I$.?""6#
!
"!
!+
Programme evolution$!(%%
!*
* )
,
!
=*
!H)(%%#!
"
DE
#
Fig. 2.2. Programme phases and evaluation questions
Source: adapted from unpublished course material developed by S. Haddad and L. Albert, University of Montreal, 1997.
( **#
B*
!*0
$)+ #=++)
Evaluation questions!**8*
Programme
Programmeenvironmentinteractions
Focus of evaluation
Effo
rt
Programme
Developmentphase
Phasingout
End
Achievements?
Results?
Responsiveness?
Relevance?
Coherence?
Implementationphase
TimeProgramme
D
+
*"* )
/+)-
!)
J ' 0*I5
J =05
=)3
J '0*5J '05
J =05
! ) 0(%%)#
0
=
)! ) # K6$$*9K6$$;$
/#%
Analysing programme coherence ( % %% ! # *=
? #&0#"
=
)
3 &
D%
Box 2.1. The Kahnawake School Diabetes Prevention Project!K6$$*9K6$$;,&*
K6$$
!$.""6"I$.?""6?'$)+
?
!
K6$$923%;!)!K6$$
&
K6$$
)K,K6$$!0K6$$
+
! !
J
K6$$
H
J K6$$H
J
D7
' + ) H # 9;#
6 K6$$
#
!#(K6$$
# * )
K6$$
Analysing programme achievements )
! ) )
I 9) ; 9;-+ 0 )
0 $ $ )
)
! !))#
&
! $' ' $ #!
$!$!0 !) !'9 !';
D
!! K6$$
)
!K6$$
6K6$$0 *"& )K6$$!
K6$$ ))K6$$"
K6$$!
Analysing programme relevance-
! * #!!*
! **#"
(
B* !##
!K6$$
'
&)
DD
$"
"*
Analysing programme responsiveness.)
!# 6 ) +
!
9#+;HH
=
9#;
# # 0!# ?#.
9;!! ) ' ,-##!
!# !
#
K6$$
)
#
D2
HK6$$# #
K6$$
Analysing programme results(#.#,
B #
! !
!
7E
, # +#!"
!
(#9; !
!*
0 ! ! &)/K6$$ *
+&
D
& B) ) &
&
)=$!
)
" ! #
#+
Conclusion= + +8H*#K *!
A#
!
References , 6?B 861@/AB!?B.'
%/.@,61&'(8.44%
% 1.""B8=@8"=&(,)
'$ ,4>2
7 BA!/" , 6 "! 8 " *('(>73>4944E;
D4
,&!!8", .K,/"! 8.
*+(737%>9442;
% !?K?8 6 ! 12%>%3%4>9442;
7 1.""B8=@K."A!".,,
&'
%,C,44
K&K/A'&&%&$ 3&
'
!=/44>3 8",?&1B"N8,-(8--/--'OL$$
(44
4 ?B! B6.&?$?A8? $"! 880L
LL %&8!,7-
2E
8
-&95844%37%
%E ,&BK8".,44E) ) 12%;
%D '"&."., 6%=N+=(N/44E327
%2 8&$":,!%84;
%> '"B'!/('!?44E%4 .&C"B,!%='>'
&/ /4
2
7 ,1. = "! 8 , $''$>
;D43>794>4;
7D 8"("/C." . "! 8 012+'7%3794> , A8 : "! 8$B K 3
2+ED3E>944>;
74 $?!C&B8"! 88#
0L
L>%4E37
27
3What counts as evidence:
issues and debatesDavid V. McQueen and Laurie M. Anderson1
%
+
( (;
/ )
3&,%
The rise of the evidence discussion!
& &,44>#(=' ,F))G
&
, )?
)*
?
!
(
,',,K,$6AH6BA H .R!A+1!#
1
2
*!)*
!#
& ! * ' # 0
Defining evidence"
#+=
++
&
B&'# &
5
&
N* "
#!
&F2?3&*EES
"##&)#&
)"#
&
2D
60?
)
=0$++#
H = )
'
!(
H ###
The problem of defining health promotion=4E
6='?
!
#"
!
!
"#+
###&
&
.
=3#
3& !
!
22
Health promotion and the discussion on evidence=
!
(
( # !
)
)
#$# # )
)"H'
))#
*
?
'$#)!9E;'#* #&1@K$FG#94;&
&
&
!!
5&)+=
2'+&
2='$'"N$.%73%2N44>
!?B"K/+F*G9%;3944
>E
=&B8?=" / +B':A$4%7
% ?8", BN
0 5(223>942;
7 ?8", BN(
1'2(2D32% $ $$ &? B?A,@"C B6 A$' &*+
9%;>3D944>;
4 , 6?B 861=#5
'
97;%> ?8", BN1
2(4D3%E94>>;%4 8?"'8" /= ( A
$4427E (&K"6=@'="6".. "6)(
A$4>2
>
7 &8C"., B= 6
&
'=;?#?#A$4>D
7% "C&6"B"/ "6 ."."?A."1.?A$"53)1'2%43%D944;
77 ' .!N=
5*'
((2%732%4944>
>7
4Participatory approaches to
evaluation in health promotionJane Springett
&
#'
$
! &!#
#?
!
&
?
!
Nature and origins of participatory evaluation Roots !
84E"#&
=
>
#!"
&
#
/+$("!/@!#++ *
&42E4
>D
*
% !
#*!
7 = +
!*!
D 6
2 !9#;!*#H
!4 !
E!
&
( ?+ A B9( ?;)
% #7 )D 2 # 4 E
% 7
& +&
**+
>2
+ $
$+
!
&
*'))!
*
$
PQ3 03
A+!
+!=+
0
". ))##
$! (
J H
J
H
J )))
>E # )"
&
!
&A
#
&
!
PQ " *
Relationship between action research, participatory research and participatory evaluation!
H
!
) # *"?
>>
(#
+
F# G $
&
!#*$10
=
H+ >(( "# 8 ?
#$*
++
=
"
# H!, $
C!FG
Philosophical and epistemological basis of participatory evaluation =
#
>4
$&)!
87G
K9(;(!+
9;9;!
$
H (*0!
$
I,
Table 4.1. Characteristics of positivism and hermeneutics
Source: adapted from Dahlbom & Mathiassen (4).
Positivism Hermeneutics
Objective observation Critical subjectivity
Explanation and prediction Understanding and finding meaning
Search for general knowledge and standardization
View of every situation as unique
View of social organization as combinations of similar thingsSurface view
Stress on richness, variety and depth
Hypothesis testing through formal definition of ideas and measurement
Dialectical cycle to gain knowledge
Mechanistic, with a focus on an object that has no voice and is submissive
Dialogue and subjective participation (understanding is not real unless it is mutual)
Aim: the power to control the collection of facts
Aim: enlightenment, edification, enrichment, personal growth
Emphasis on quantity Emphasis on quality
4E
!
& =*
"# & #
B#
&!!
"!# $ H## * !!
* *# +
* ! #*
Fig. 4.1. Action research and the learning cycle
Concreteexperience
(doing)
Activeexperimentation
(deciding onfuture action)
Abstractconceptualization
(thinking/learning)
Reflectiveobservation(thinking)
4
!%;
Table 4.2. Differences between the natural and social sciences in approach to and methods of programme evaluation
!
*
* (
Participatory evaluation in health promotion!&
H!
+
Question Natural sciences Social sciences
Who performs evaluation? External experts Community, project staff facilitator
What is examined? Predetermined indicators of success, principally cost and health outcomes/gains
Indicators of success identified by participants, which may include health outcomes and gains
How? Focus on objectivity, distancing evaluators from other participants; uniform, complex procedures; delayed, limited distribution of results
Self-evaluation, simple methods adapted to local culture; open, immediate sharing of results through local involvement in evalu-ation processes
When? Usually at programme completion; sometimes also mid-term
Merging of monitoring and evalu-ation; hence frequent small-scale evaluation
Why? To ensure accountability, usually summative, to determine whether funding continues
To empower local people to initiate, take and control corrective action
4%
*?*3+ 3 *!?
!
( ,)$=
# * !
$
)( *
B + *.!
!$
!)&
&
"
!$ ##
$&!$
(#
( #
(!F=
47
PQ
G
&A
$ $ B ,# !( $ ? 4>% (0
$+$!))
&
$ &
B'4>>((' ,6',"# "
B
#
!
6 1AK
*9*;6#
! !'B$* ) !.@)! /:B !9;
!
#
(#
AK/@/!
4
H
1
&
$
! + )+9;#)
* ) )!+#H*!!! #
@8 !" =
!#!
! *'" # ! %EE
! )!27>AK' B'AK'( '!
!
#
!
%EH"$?
4D
, * +!0
6
*
N
"!
#*
8AK" !#@"
Guidelines for engaging in participatory evaluation in health promotion=
9!77%4>3%44;" )
, ) )
"$ # B
!&
&=
&
1 F * *
42
G
# &
!*
)&)=#!
#*
* 9( / 44D;! )
=
#"
9!7;? # ) / # &
# !!H)
"
0
!
!
4
%2 6"C"8?$,"B! &! B"?,,&!!""0+(
&6$?"64>4
%
E%
7% , 1".&?BN&
F
=>>3494>3>%
E
9?$;
>7 ?!?B1@$.&B1"!!N!>97;7D372%944 '?11 .!."! 8.#.(9;D43D 1 . B! N! #K%$$C&
ED
( 403!?$447
>2 =""$ $P$Q%!6N@
8"A@0@=&=;2'P'Q C1447
>4 ," B.@,&!'.&.(9;94>>;
4E ' , 30'2
2%322944;
4 .&' .6?B8=)%6+BK@8:+=5!?44
4% / A,(.'#
%
8"(3.'6,A,44%9.',B%;
47 "C".&!! C3'+97;D232D944D;
4 = B1@/A..&, " 5( 9%; 2944;
4D / A,(@??K"6' !*B
97;>347944%;
42 ' .8""! 8&
0%
29;
E
)H
! H !#$#))&!
Contemporary health promotion 6801;3")4>E
FG#/ ) H $80='?.?"?'$ !!='?
F
G!
(
#* # + ?
H#*#
#!
? !
(
!
E4
#(
#
" ) ) !
&
#&
! #
0#)!! ) )
Incommensurability"
!(# H
!
) ) "
#$
!
&
#8!#)#
!K
&
)
)#
E
0 !
"!
$0
#!
!
))!#
#
+#&!#
*+!#)!
* K*.
*H*K!#
)
! ! * !
! #(#
+
8 #
*
& *.
*& / *+!
II / I
0#
#()#?
*5 ,
*=
5?
) ) ?
!)
#? # # ( )** )
&
)0!
%
Compatibility
#
"
FG.@.))
H+#9)#&)
#*.@.
;!
,
H#"$1#* ".6
!? (
"
"!
) ) @(#9);
*6+$!
*
))
*, !#
)+
7
)9FG;))
)') ))
#()
0+1 )
) ?))#& 4>244D))# #)
(
5() ) " )
)$) #+)
) ) )
+))
1)
#
) ) 5 )++()(
!?)#!)"
)
!#, "" + $ !
) 5=
)""5(
# "
)&
!
'5&
!
))H
) ) !
!
Complementarity&
#(", # ( 9,#
;,
#)
.@.)) H
D
#
) + &))
!
!#
!
#( )
".)## #
!H
#
# ))!#
))!
(#)
) ) #, )
0 0 *' ) H *
Seeking transformation=
9);9);5(*#
2
#!
! #H!
!$!9;( # /+ $( !! & ? !
&
#
0
Conclusion: challenges ahead' )
) ) !
B#
)
!)0
#))
#/
/ )
.+
944D;% ,K&B8 :N/!
0E43%2 6"!! 8$#
%.@. ( /55
'+&;(N/44D73
%
3?.44D
B:$4>7
>
%7
6Evaluation of quality-of-life
initiatives in health promotionDennis Raphael
Overview! ) ='?
!
#)
)
,
),
))# ) &)4D%A
. .@.!))
!#
.='?
)'))!
)
))&)
%
)!!!
='?
/8VB$' .. &/ &.6.'$A!!
*#
Nature of and intellectual underpinnings of quality of life )) !0"60
#!#()$#
#-FPQ0GA )
)#=
+ ) ! ?'$& .
)#& B
,
5(&
0,
%D
'
5()9;& !
Paradigms of inquiry and quality of life!# ) =
!
J
"H
J
H
J )#
8 @ 10: 5( $ 10. ' !
+ 9 ! #*!)
The nature of knowledge and the knowable6
)) 9 D; ) F
)G"
)
)
"
=H5= 9);9;5
?
"
%2
#.
#=1"H()
B+)#
) ! =
!)+" # +
)
! )
8 *#
A"+
!"
(!
+
?
')5
,
%
!
?
!
H(##3
3)
&) .)- 8:
! +
!- 8:K@/!*='?
!) )
,6 8:
&
(++F!#='?=/
6 *8:96 8:;&0+
G
!
!B*"##
)#A6 8:- 8:) ) 6 8:- 8:
H+
.)
/$
%
'
+
#
/$,6@B
%4
! )
' #
()
#$
Social indicators approaches ( 3 '') 3)=,!
!#!
#)#
Rationale642EB ""!
#
)
$
W
*
*&
* FG )FG!
"9
;
7E
&
9;0! *
#&
*9##;*9# ;
##
# &
( #
) .
Some recently identified indicators!#HHH! "3
#9 ; 9
; 9 0; 9 0 0;9# ; 9 # ; 0 & (25(
Using social indicators to document the health effects of economic inequality/
AK !))(#
7
8@!"
0 = +/) )
Healthy Cities and Healthy Communities approaches B''
&*
9;&= #
3(&;
(( $
)(@6
=# )
Other areas relevant to health and health promotion= ) 1@K0
Developmental disabilities"
)
!+)(
) /6 +)
9; ?#) 9 ; 9 ; 9;
7%
The social diagnosis approach&1@K0 )
!
)!0)#1@K / )
!
!)
#
=)
!) ='?!
Quality-of-life issues: levels and focus of inquiry and measurement!
H)
,)#) 5!
5
!)
& !
)
,)+
**
77
) +
='?
,
) ,)=
=)
# 0 ) *) 0!'')!)!
! ) AK)
Quality-of-life models consistent with WHO approaches to health promotion&)#
Lindstrms model8V)B
!
8V
) F!)!
='?G8V0
8V
)F#
7
G , #
J HJ #H
J #HJ
!
)8V#=
8V B 0 #
)) 8V ' +
B8V
!2+8V0
Table 6.1. Lindstrms model for the quality of life of children in Nordic countries
Source: Lindstrm (66).
Spheres Dimensions ExamplesGlobal 1. Macro environment Physical environment
2. Culture3. Human rights
Responsiveness to the United Nations Convention on the Rights of the Child
4. Welfare policies Welfare distributionExternal 1. Work Parental education and satisfaction
with employment 2. Income Income distribution3. Housing Quality of and satisfaction with housing
Interpersonal 1. Family structure and function Satisfaction with family, lack of negative events
2. Intimate friends3. Extended social networks
Support from friends, neighbours and society
Personal 1. Physical Growth, activity2. Mental Self-esteem and mood3. Spiritual Meaning of life
7D
8V#+B#'
H ')
0)'#)
='?8V
(B&
B$'1>6+= !
Key issues8V0 )
!** ! &
# " !0(
Centre for Health Promotion approach!='?
'$A!&='?
&+))!
#!3#
!$!,
#+
-
*!**
/
72
H 0 0#"
9!2%;
Table 6.2. The Centre for Health Promotions domains of quality of life
&
!! ;!! !" &
Key issues! ) H
!*!#&
0
H #! &
)
The community quality-of-life project: understanding communities through a health promotion approach!)*
0
Domains Subdomains Contents
Being Physical Physical health, mobility, nutrition, exercise, fitness and appearance
Psychological Independence, autonomy, self-acceptance and freedom from stress
Spiritual Personal values and standards and spiritual beliefs
Belonging Physical Physical aspects of the immediate environment
Social Relationships with family, friends and acquaintances
Community Availability of societal resources and services
Becoming Practical Home, school and work activities
Leisure Indoor and outdoor activities, recreational resources
Growth Learning things, improving skills and relationships, adapting to life
7D
DE =?8( $ %(K0
B$$4>7D377
D A6"$ .!,"B!?('" 8!'"6A !&?B B6="8( ."/;=6A1$?424
D% '"86?B"@8 B6K4D34% %
+ ; 9D2;D2
2D . $' "86"! 8 )
%
2 +('
%D3%9442;
2
22 8&B6!.X, / - 0@
@7E37E2944%;
26+=?#?#A$44
2> . $' "8 6 ! *'
2329442;
24 ."B=&K.@/.?=B&/' $ ) %.. H( +& '
!?442
8&88&"/8 B!?B,"! 88 %
2 97;DDD3D>9447;
>D 1.:!!"BN"! 8)5!B#)94;47>34D944D;
>2 K"K&, K&&"! 8)(097;%D37944D;
>> 1
?$' 442
>4 ,-A &1 8 / ;( +=7 ;& 5(
3!$447
4E ,-A &180&+(3
(!C44D
4 ,? !!&N$"! 8- 8:- 8:)5
4
7Economic evaluationof health promotion
Christine Godfrey
Introduction.)*
)
"
9;9;!
)
!))(#9#;5 )
(&
0)6)!
!
( #
!*
DE
& )
)
!) & B
&
#!)))1+(#+,+# , ) =)"))
! +&
#)") !
Types and uses of economic evaluation !))
3 )(!
!9;9;
D
$ (
+
+,
?33
B 9 %%; (# "&
3 )=
Types of partial economic evaluation?
3 3
,
& !9;!)*
3#
%2
9);!
6)
!* #
D%
*()
")*&)
!
#
Full economic evaluations!
J +J 3J 3J 3
H
!)
,#
?'$,#)
6 8:- 8:92;&
)! !*
!
!!
D7
Table 7.1. Different types of full economic evaluation
Source: adapted from Drummond et al. (1).
) ( # )
&
)
&)!9);&+3!
)
Costeffectiveness analysis3! ) 9 ;9
;? + !)
Type of study Treatment of alternatives
Measurement/Valuation of costs in alternatives
Identification of consequences
Measurement/Valuation of consequences
Cost-minimizationanalysis
Monetary terms Identical in all relevant respects
None
Costeffectiveness analysis
Monetary terms Single effect of interest, common to both alternatives, but achieved to different degrees
Natural units (life years gained, numbers stopping smoking, etc.)
Costutility analysis Monetary terms Single or multiple effects, not necessarily common to both alternatives
Healthy years or (more often) QALYs
Costbenefit analysis Monetary terms Single or multiple effects, not necessarily common to both alternatives
Monetary terms
D
#
8
! (!
3K"'&C
'&CA Y
/ #
3
&
(# )& = 3 *
Costutility analysis3)=
- 8:$6 8:9- 8:;+92;?
!
&
)
! =#
5 )#- 8:(#)
DD
E9;9;)EDE4E)EDE- 8:9E#9E43ED;;
!#
= )@'##' #)
)( )
(@('@K#
- 8:(@(
- 8:!
0!- '@K + '&C /'&C '&C- 8:
Costbenefit analysis&3!
!
6@
3
1@!#9!
D2
BH#7
Table 7.2. An example of costbenefit analysis: legislation for bicycle helmets in Israel
Source: adapted from Ginsberg & Silverberg (17).
!3)1@!#!#
? ! (# AK
6!!
"!
)!##
Steps in undertaking an economic evaluation # 6#@'#
#
!$3 !
Benefits and costs Values (US $)
Benefits
Value of lives saved 8 939 979
Reduced health care costs 17 412 622
Reduced long-term care costs 25 263 243
Reduced need for special education 1 527 131
Productivity gain from reduced disabilities 7 545 779
60 688 754
Costs
Health education programme and helmets (20 143 984)
Total social benefits 40 544 770
D
+ ! )&!)5*,
)
#*# A # !*"*%E7E*6
*=#
Concluding remarks!
3/ ! "
&
"
8 "
,
$
!
? )
24
References 6.A,,?B6,"! 8)
%?#?#A$449442;
K 'BN!3'&C 5 1 2 + 9%;4;
(&"88 ,@(. BK$3 * 0 *1)1%
6 8C&,/ (& '86!4>>
4 ?'"B6@'"B6".?BN
?#?#,$4>>
%E !?88":K&;8
'" 44%
% =&88& , " E27%237%494>D;
%% 1. ' ,N@C A$"8NC
5434D94>;
%7 6.A,,?B6 , "! 8 3 509;773E9447;
% K&B6 $ "! 8 C AK)E23%>2
!&'$4>>
='?!
? !
% 7 # D 2 4 )E
!*
>
?# !
Programme development8
) ! (>!AK#
*) ! ) #
H
% H7 * #H
+0H
D H2 H
#
Dilemmas, contradictions and ethical considerations&
)
()! ) ( # 9 ;
!#, #
>%
Fig. 8.1. The starting point for quality in health promotion planning
Take account of the natureof the issues, level ofintervention required andtime limits
Take account of existingknowledge, attitudes,behaviour, environmentalfactors and organizationalsystems
Have due regard ofapproximate costs, time limitsand social, economic andenvironmental constraints
Determine immediate targetgroups, significant mediatorsand support systems
Determine skills deficit andtraining required
Modify programme ifnecessary
Clarify the health promotionissue or problem
Agree the target groups
Formulate precise programmeobjectives: usually educational,behavioural, environmental ororganizational
Quantify desired outcomewithin given period of time(target setting)
Rewiew possiblemethodological approaches
Agree intervention approach
Determine precise resourcesrequired
Acquire funding and otherresources
Allocate tasks
Pilot-test progamme whereunproven methods are proposed
Execute programme
Evaluate programme
Consultstake-holders
>7
$
+)!
) . */
)!!
In conclusion-
#+ ! ) ='?.?"-
&*)-
&
#)! 0 )
References $"88".C "! 86 )
AK
97;%D3%%9444
2 ? ' $ 9; 394>2;
>
> =""U."1&?B 8'" 8!' A!'?.&!:4' & 5( , 1 44
4 )
2)5(
;=E=4KAK44
>D
9Investigating policy
networks for health:theory and method in a larger
organizational perspectiveEvelyne de Leeuw 2
Introduction$ "
!
,
+
16
)
+
'+ ) N @!
)
B
!
$+ .
% & , 6 ' $A,B)+
2
>2
&0
Policy studies$#9;$
9);))* $
(
)
'+
,
$
(#106/
='?'*
+"'
+!
#
!
#
"H
) *!)#*#.F*G"#B**#
>4
K!!
K"$
#$
! H ! 1"*'!'H#'
K0!
' $H &K0
H 9 ;!
%K0#'
Policy networks$ )9; !#
$33*
!?&
,)
4E
K@ "
! #
# ! ) / "!
++ # 9 ;H
9FG;!FGF+G #
,+ =
+
Ownership of public problems10#1##'
? 5!!?
9
; +!H
4
1##H+&
(1#
9+;
!
+0
+0(
!
?H?#
"6
10#
!!!)#1
+
#H#1B
$!*7$
# K & !
Constructing a theoretical mosaic$
HK"
!
4%
!
J =
9;5
J '
#
9;5
J =
)9;5
J '#*9;5
J ,
5
!
/()
!#
Policy research methodology and policy development& 91" FG; !&
# ,
&H1"! 1" ) #
/"
FG $#
6 $
,
47
=@"
))
H)9
;#! 9;
9);$
)*&+
(+)
# !)
$ )#
(
?
+ # ?
1"+1"
H% +H7 H *H
4
D * H
2 H
H4 HE H H%
"
! K0!1#/
&K
0H
A
!)#
Case 1. A quasi-experimental policy research design !*
8 B 8 B ) !)*!$'8H,9%E EEE;C,"*
,97E EEE;&447$'
& ,, / B ' ( / 44
4D
'
#09;&&
#'8
!
()
+ #!
!1"
Commentary "
. 9
;9
;1"*! 0
1"
# )
H
% + 9)&?4EEE;H
7 H 9
;H
D #)
)
*9
;
42
A,('$'! #
)
&
Everyday research challenges&
!")
10
#
6
1#
H1 !
8@K"
&6
=
9;0
B
9
;9;9;
6
9 ; )
4
Case 2. Healthy Cities second-phase policy evaluation: theory and units of investigation!='?'*4>2
?0$*9;!* 44> 97EEE'='644
44
I I
H
% +H
7 ***
H
*=
Commentary0)
!+0' #? ' ! !33 (
'*)#+!
! ( # *
0!
The analytical process
)&)9#);!9); ) !
%EE
!! # #
) 9 ";
B H# ()
&
))
&9;
# 0 9E
%E
B!
Case 3. Policy research a planned endeavour& 4>2 1 B $ ! ! 1
$0= A, & & )@"0 (4 9 ; 9 ;
9 ;!
Fig. 9.1. Study of the national debate on health policy in the Netherlands, 1980s
Semi-structuredinterviews
Research questions
Mediaanalysis
Chronology of the developmentof the policy
Response
95 hits
Analysis andfinal report
Documentanalysis
KAPanalysis
Kwaliananalysis
Report Report
Delphi
Triangulation
%E%
D2+! ! 2ES ) &K!
* & * ! 4DS, !
9;! 0 # 6
+ !C
Commentary(!
)! !/
=5=
5&
+
!&
&
(
!0 / +
+#$+
%E7
0)! +
Conclusion!
!
0
.
! + #
$
! )
& )
References ,8".?:K."! 8
5(9;7D37>;% 8 , B?:"! 8 +
9;%273%
%E
> 1?A, B , %
@@( ( 3 (
:4K
P!Q,A,44>4 1?A, B,@$.&B1"!!N(*['0
5
'
9;737%%9442
D ,&8&? B> ;
& ( ( + ( ' $442
2 !?A.? /BF(32& ='? . ? " 44 9;
/" A"44D43%
%E 1?A, B,$9;%/B
%ED
+ 44< 9 ='?I'$.I'"$I&'$I/.I44
%> K"B&$@'B"&6".C$+#%,/@,+..(
;=>(/=44%D3D4
%4 1A(&"86N/++&=(+A$4>
7E 6"8""A="@$?8, B8'6#097;77377>944D;
7 //", "/;
(:0&(3(
:;M,='? .'A,44 @=
=@+@
@=
P& 5 )
Q,='? . ' A , 4429= ' ?+ . ',B7;96;
7 ,&8"= !@6"8""A=".
[0E2(9;2D4
%E2
74;
% =:88&" @ ="88(
97; DD32%944%;
7 ,+0@NDOOP'8'\!HHQ,116T*T844
@# ;
,
"
3"
$
:
"
Characteristics of community programmes:
# 7
* &
. 0
15
.
* 0"
&
""@ :
%
3# A %
#'('(&
BC
$ .$ 7DA
0
: # ###3# #%
:% % 8
*
16
$EE7%
2
=
##
Key issues in evaluating community health promotion programmes! F.
1 "
- 4 5
Issue 1. Identifying the evaluation questionsG 0"""
Agreements/DisagreementsG" %2"
*
" &
*3 2
, "
1!$H J@ I $= &
*3 ,0. %&'*#.--E--4'1?5(
1 =>I,AIHHKI$=3.2
!!,!%&'/.1-?-E1--'14(
1- 3$H=I);H$I$=,!!,. 3* $* *&.5--E5-?'1?&&IH2 E : %&'/.156E15?'15(
15 !I==IHA !% &'$#.1E15'1?(
16 232:==$;G@D3!$K:&G2& .
+',($#.6E-'1?6(
1,1
-5
A>8:&!$3I$= :.3
J,01)$ # $! ,$ *$ *
2$;O$:151E1- &)A)=&GI .
%$#$.6E'1(
4 7HII;=@I$=I%)&'.HO = 3 #
$.8;) !)&166E??
-5 2:I=2$HA 28 8 "
.8;) !)&115E1-
-6
-6 J$3)8&GH3.
2
!!,+'*$$.
-&1E14.*/*17'-(.1E4-'14(
66 H>8:;G8I
#
#+'*$#.6??E
-
8I$2GD3$*)HGJ@!,
. ).5E1?'1?
4
4 G);;IH$I$=H# .#"%+'9*#.6E14'1?1(
5 2>HH$OG2G. 2
!!,%&'*#.56E5
41
11Evaluating community initiatives
for health and developmentStephen B. Fawcett, Adrienne Paine-Andrews,
Vincent T. Francisco, Jerry Schultz, Kimber P. Richter,Jannette Berkley-Patton, Jacqueline L. Fisher,
Rhonda K. Lewis, Christine M. Lopez, Stergios Russos,Ella L. Williams, Kari J. Harris and Paul Evensen 3
Introduction # *
!:K9$:G& 0 =
#!
3 ,
E
EE
3.B C:
- @7!,3G>AA!*'4
4
# #:
2!39!3 ,HI3IGI9,H)3IIG ,
$ 3 ! ',$3!( 3
!$
"
" !:G$$@!) !&
!$
3
:
$
# "
&
'4115($ P
,
&
"
4-
"
I
* & 0
#
*
$
@
@7!,3G >A
>&"
*
Challenges to community evaluationG 1
1
A"'36(
-
4
44
5
!:K9$:G&
6 I
45
Fig. 11.1. The community initiative as a catalyst for change
Source: adapted from Fawcett et al. (26).
3
A #$ %
&
$ &
* "
!
3
Communityadaptation,
institutionalizationand capacity
Communityimplementation,
action andchange
More distaloutcomes
Dissemination
Collaborativeplanning
46
0 =
#
3
* ,
0
Principles, assumptions and values of community evaluation&.
1 3#
- #4 3
5 8
6 I "
4&
3G, 7
$
## "# H7
#%G
$ #
?6
%$:G&>&
: # @
:# 9 &'1(
*"$ > &
)
2#5=#2#1 , "
.
H
@!).
/
/ 9#
/
/
?& # 7 D; #
.0
=
$ "" & %:
Costbenefit and costeffectiveness & *A#D&
E :E E
,%
$
' (
" 0" ;E ;.B "R%E '
(
"0C
&E 0 = E '31(3E
IE
&& & A '&A(
A ; $ "5-Q 1Q : . -1Q= -1Q
1
Issues in the development of effective evaluation
*
Workplace and organizational issues& 3 # H"
: #2
$ :I@
""
H '(
2 ' (@ 0
:
$
@
%@
G% " G
0 @
%2 3
*""
2 "
:
$
:%
, *"
" $
-
@ # # ).
/ .
/
%
%
/ /
2
$
#2#';!&';!&(>A(
& 0 2 )#;!&
@ & 0 0
*0
.
#
# 2
##3
Methodological issuesG
K
4
#
H
# " *
).
/ / /
/
/ / / /
$ % & '
" B#C B0%" 0C
@ " 2
"
&'#(
&
"##
5
:
3BR% # 0#C
&
" @ " % & # 0P
#
" """
$
*
$
@" % "
*
Action research approaches to evaluation$ '34($ 0
#
& :
6
#:# " )
! 0 # 2
2
2
I7
)
#0&:> "".
/
/
/
'
( :
$I #
#%"
A@** 7%6':.
/
/ #
>A*
@
$ # "
1-1
" : "
, """ 3 ; & >&
$
? Table 13.1. Participatory evaluation of a health promotion programme: main actions, associated actions and comments
Main actions Associated actions Comments
Step 1. Clarify the aims and objectives of the proposed programme.
Get the participants on board.Set up an evaluation group.Determine what the real health problem is.Establish baseline information.
The importance of spending time on this groundwork cannot be over-emphasized. Involvement of the right people will ensure commitment to the use of the information generated and a good response to any questionnaires. The evaluation group (at least three people) should reflect the range of interests. Proper clarification makes the evalu-ation straightforward.
Step 2. Design the framework for evalu-ation and what ques-tions to ask.
Decide the purpose of the evaluation and who will use the informa-tion.Decide what questions are useful to ask in relation to achieving aims and objectives. Decide from whom to collect information.Decide whether process as well as outcome information is needed.
Take this action before deciding what measures to use. If the objec-tives have been stated clearly, this should be relatively easy. Be clear about the aims of the evaluation; this affects what questions are asked. The main aim is to see whether the activities in the pro-gramme resulted in achieving the stated objectives. Try to look at process as well as outcome.
Step 3. Design the framework for evalu-ation and decide how to measure change.
Decide what to measure and which methods to use.Decide on sample size and target population.Decide when to collect the information.
Good measurement depends on being clear about the issues. Meth-ods should be appropriate to the questions and need not be numeri-cal. Be realistic and honest about limitations of time and money.
Step 4. Collect the data. Make sure data collection is unobtrusive and does not add to partici-pants workload or, if it does, they can see the value of doing it.Make sure participants are still on board.Keep participants informed by regular feedback.Remember that data are not information.
There will be problems of confidentiality and bias. Bias is most com-mon in self-reported behaviour. Problems are smaller if all stakehold-ers have been involved. Participation is a key.
Source: Workplace Task Force report. London, Department of Health, 1993.
Step 5. Evaluate the results to determine the effectiveness of the pro-gramme.
Interpret data in association with the evaluation group, comparing what actually happened with what was expected. Remember that numbers are only indicators of what the world is like.
Data are not information until they have been interpreted. This is best done as a collaborative process, so the participants understand how the results were obtained. Remember the value of so-called soft information, and that some health changes take time to be revealed.
Step 6. Make recom-mendations.
Clarify what is useful.Cover practical changes for immediate implementation.Include the costs and benefits of not implementing as well as imple-menting the recommendations. Challenge existing beliefs. Look for longer-term changes that may not yet be visible.
If the participants have been involved in the process, they will already be committed to acting on the findings and be receptive to results
Main actions Associated actions Comments
-
:
#%
*
#
2H Q
1Q
Principles for the evaluation of health promotion in the workplace8 #
Starting the formative evaluation process with health needs assessment*
!.
: 0$
-1
H
*! ""'( ' ( : 9 $
:
Participation and feedback$ *
,
#&
7 : :@
*=33%0 , $
Clarity about the purpose of evaluationI ,
=
:
)
: "
%
*
-
2
I
Producing useful information
" .
G
*'( $"
$
@I .61:#
Attention to ethical issues
>
" :
' ( $
&% >
--
Evaluation practice as a process in the workplace$ ##
#2"
>
: :
:
: @ "
I
8 " "
#
Recommendations for improving evaluation practice in the workplace
Integration of evaluation with other workplace activity2E'
(E
#
-4
"
7 #
Choice of methodologyI "02
" H" ,
%
'
(G
%"#
Bridging multiple sites$##0 I "
Relevant evaluation indicators :
. :"0 ##% I
' ( #
'(: "
Crossing interfaces8 & 0
-5
Conclusion:
" @ #
@
References1 ,I==I:IHAH$E
!%&')'5(.-?E-??'16(
7)INI=IHN I$=$ G>%= = ! , , %&''5(.-4E-4'16(
- =I@:&3IG>&%&' ) *'&4(.E16'1??(
4 GI22IH!A7$41#/3@!)H)
I15'I!,&;4(
5 8IHIH$H
+'*.111E114'11(
6 3)),IH3=D@:==:$2&&IG,#17#;$;O@14
-6
1 GIJ)OG2D&)>!IH;GJ$ + ' * . 11E1-'1-(
11 @:=&);27I$=$
%&''6(.4E4-5'16(
1 &,H:;7IJDG>7G:===@.*&.??E?'15(
1- G>7G:== = 0- $'' *$ $$$$4 #* =!I$16
14 G>7G:===D&,H:;7IJI.*&.--S@)H!@I$=! :E$&'*$*).HJ3I$=@. #%&')'6(.4-?E44?'11(
8IHIH$H=
%&'/'(.111E115'1(
- ,$);2P( !=&1?4 )$A=IO$ I $=A7 $ @$
17G=!I$145 7)=:I8;!D;I=&);$$
!*5'1(.E11?'1(
-&
21
-1?
: )" $
"
""
3 "
!3 $"
$ #
Indicators!
3F$!3
H;::
"
&% !37 ) I3 :
-1
,: :
0 :" @
A 0& 02!3 0 0
3 !3
"!30
! 3
$I ##
Audiences)!3 ! 3
-
$
7
$
H
" !3
Conclusion&!3 @
$!3*
@!3!3$
!3
#
@
: !3
Evaluation at city level!3:@
-1
0!3
An example of Healthy Cities evaluation: Liverpool=>A 4I0
=% =33H%
# .
Policy formulation'(7%6'
16 &
=
-
: : " $ 0
J1516
, 8 J 15
= $ 5-
:
0 0
"
%:
= : :.'( &
.:
--
Policy implementationB C :
$ :
#J, !!3>%
* I
$!3> :1
-4
5 0
6
-5
0%##
% 0%, 0
0 0%$ 0#
:%.
/ G!30
/ 0%
/
; 111:
,0"
"$ ,
00%
70 2J1
,
-6
" 0$0 G0 0: %0 G % $
0%0
0* "
0
0 00* #0 K *
0 # "
3 ,0
Conclusion ! 3 @
@=
-& %
@"
;
Guideline and recommendations$!3
!3
!3!3
'( 70
0" "$
-?
0
,0
I!3 " )
*!3 H
' (" !3$ !3: " 0 @ 0!3 *
!3
"
P
: * !3@
" !3
-
,
&
G
!3 " &
0 #@!3#
References1 !$;3)3A.
.A2DGJ,$4$*=H14
=$8);TH!.*5'(.5-E6?'14(
- !$>7!);7D!>;IH3-$/$=JA14
4 2$I&&I;2-$/ * H $4 *$2@!)3 3H!3>215'@!)#3 3H!32&;(
5 @$==IH&I:; ; , . %&').1,13I;I$=IG3$*#/$ $15
--
3>H:3I = D 23P>II; G 6 AC ,$ &4 $$ ' #$$ I H> ! 831
1 ,)=$;G8A!3,:..-2*! . F.-1E4'1-(
1- 7)>2$;& 2 $ ';; *! ,$ ** 0*$*D*:#*
LM2>21?14 7)>2$;&2D&,H:;7IJ*0.R!3%
F)'4(.-11E-'1H)&$GIGA*C#;,$&4&/$ 4 1'#$$ 2&11
16 =II&HD&2:!7%$* =HA,18=:3&I3)H2$;$7I2I;HI&I$H3!>;:$;GGI,$H2I;)*I;K:H);2I;:;;IH3::I&G:HI3)H$I% '/* ##%',$!=!2&)
1??
1 J$3)8& J 9*# ' 4 $$ * ! =H16
GI 7H)) = 3 3.
>.16E'1(
- 3)S A D2$:H $ * 9 *#.1!==6$$'#;O,>,1
--1
6 $A:;&); G 3* / $$4 / $$ ' $$*$!=314
--
46 2:=:) ;(# # / ) 3
, !$1?6
4
---
64 HI$&);,"!.G#;AD=O&*/7'5 $)&14-4E--
65 H:&H3:
".G# ;A D = O& */7 ' 5 $)&14
66 3);&:G:;I2(/4!2 214
6G!&&';:(1
--4
? 7)>2$;&2D&,H:;7IJ*0.R!3%F)'4(.-11E-'115'),(
? > !==!316?- &I3HI$HO)*&$I*)H!I$=!6'!=
!2&)
1?4 !$==:G$O2C4*$' #/
-''*!&
!&
,
1?5 $O=)HJ(#$$+(/6> )
=!3=1 !HH>=>1G&);83 .(*$.1H9:3,9!&3644(
I;G$2J";*$*$#;! L!3EM$>$1?'G(
Part 4Policies and systems
IntroductionDavid V. McQueen and Jane Springett
! "" "" "# $ % & "
"
' (" ) ' % # "
*" " +" "
, * " !%&" -.
"".
" /""""0
12 3 " ) 45 " " " *
6
*" ,'((
-)778 * "
#)49: " !. + " " "
#)4,
"")"2
* )4;6 ( +" "# *
"
"8
+
" .#)46
8
#)4;< *# $ " " ++
%
8 "2"
"
(
"3, #
" "
&
Making a strategy for healthy public policies work DE
"# ="8 " "
"! ' 8
" " !*,'((
-
Defining impact ! F
" G " /)770F "
G 2
"
( ( " (
(")
,
&&
" . "
Measuring impact *
("" /)&0# "
Options for responding to the evaluation issues: example " # ,'( *
,+/8++30
**
Policy environment,+(* 3 " "
=
H
" "
""$
H ." $
&5
H $
H
3
-8DE3"
D"E
" ,+ " """ 8* - " " # ""* .. "=
H ""
$
H "$
H
Logic of intervention for healthy public policy #4;;&> )*,'( /)770 *" 7@@@" " /C3(0 #* """ " =
" "
!"" #4;;5*" # 8 4;;9 ) '
&9
%",+*
F* " "" ,* * "
8* "
"
=
H ="H =H "=
" "
) " # " ""
!,+,'((
-
*,,'(**$"* * ,'( *
) "">3#"*
!*>3"* ",'(*">3)"
&
Evaluating healthy public policies at the local level#*,'(* ,++%: ?(
*
Health promotion issues!8454/40,'(* ,+ =
Fig. 15.1. Key elements of an implementation structure for healthy public policies at the local level
+ 8
.:
#+%:*" 2
Principles
Levels Outcomes
3 6
2 5
4 7
Creating healthCommunity engagement
Building alliancesSecuring investments
1
Local policiesLocal politics
Local policy arenas
Health promotion agen-das and issue networksHealthy public policies
Investments forhealth promotion
Cooperative planning
Outcomesdefined by the
cooperative planninggroup and by theplanning method
Health lifestyles ofthe local populationSocial, economic,
physical environments
Active lifestyles andcommunity participation
Social networksHealth-enhancing
infrastructures
&6
+" , *"
/0" #+%:*"/0" 8
"
+ .(* " " F
Implementation process!"8454/70 #+%:* = / 0 """#
Policy-making level ! """ "
!"8454/0 : ,B" B,"
B,B
&;
, "F * 8 "
Population level( *"
/ 8 454 &0 + # ,"B,
/ 0B
+%:*" 2 /8454&0
Health promotion outcomes! / 0*" /845450(" / 0"/ 0! " "
"" ( " / 0"/ " 0 /0
Evaluation design *" 8454 # /84570
5@
"
Fig. 15.2. Design for an evaluation of healthy public policies at the local level
# ( "2"/.0"( # " "
/ 0 # " 8* " F / " 0
"
Evaluation processImplementationprocess
Cooperative planning Internal evaluation External evaluation
Selecting theplanning group members
BrainstormingDefining guidelinesand concrete goalsSetting priorities
Defining measures
Inplementing measures
Assessing evaluability
Evaluatingmeasures/outcomes
Evaluatingoutcomes of
group dynamics
Evaluatingexternal outcomes
Evaluating group dynamics
Feedback to the planning group
Analysis of key elements,structures and actors on the policy-making and
population levels
54
/84570!" ) " " " "# " 8
Use of quantitative data8":
#+%:* ) +" I #"
""*,'(*"
! *
* " ! " "I"" 8 "$ " / " "0"
"" "./0!" ">3
Evaluating healthy public policies outside the local level "",'(*
,+"
57
*,+ "
Implementation process# " .!,+"8%++)" ,'(*". F /8 450 "
+ /J0 "
Fig. 15.3. Current policy implementation structure
!845" "K "" #
Cabinet
Ministries
Regional administration
Communities
State level
Regional level
Local levelIssues
5
,'(*"
"*/845&0
! "" " !
>3
#*!3
Fig. 15.4. Desired implementation structure for healthy public policies
(
/"
0 " *+ 22 "
" " >3
Cabinet
Ministries
Regional administration
Communities
State level
Regional level
Local level
Audit Group
Umbrella Group
Cooperative planning group
5&
8 !3
+) * "
C ".""#" ,,'(*> ))'% ",'(**"* "
"
Evaluation design* " "*">3
Phase 1. Caseconsultancy approach>3"
K " #
#"> 3 " *,'(
!"8455 *>3,'(* ,'(""
" 8*>3" *
"
, * "
! " ""
55
!D E
2
>3" " "#"" " 2 "
# "-" "
"
Phase 2. Measuring the impact of alliance building- C""""# * *
Fig. 15.5. Intersectoral evaluation and learning process: caseconsultancy approach
Outcomes Problem solution (direct
result on case and indirect results on other projects)Use of knowledge/expertise The most powerful learningFacilitation of joint workEncouragement ofintegrated strategy
Genericproblems
Umbrella Groupprojects (andspecific issues)
Evaluation processto bring expertise(action learning)
Experience andexpertise
Projectcase
Local experienceand expertise
WHO expertise,case work andnetworks
59
! >3,'(*) ""=
H
$
H $
H "*
" * "*
: ,'(*) " *%,F?8>3 *8" *>3"/ 0. 3"
" "8 *
*$/ 0
+ >32"# /84574550"
(>3 ! " "
">3 :
5
"""8,'(""*,'(*")">3#
Use of quantitative data,*),'(*.
8 D E >3"*,+8DE3
(. "">38>3" "4 * " *
+" !" * . " >3 "
"
Audit of health impact of state public policies >3 ""8++!
/845&0% ,'(*
!"
" /)60,'((
- "='+ -,'(
56
% %",+
!"""8
C3( 2 >3 # * +
Conclusion: towards a framework for evaluating healthy public policy(,'(*
,+ !""8D" E$"D "E ( C "
,'(*,+""! * ! >3
, + "" #"
". ! # " " "
5;
. .
8 " " ! " " 8
"= !
8 # "
+ ' " ""8 "B
#
"""
) (
" " C "
"% "
8"% DE
D" E# "
9@
": D
E.% *"$"
! "
References4 L-C!!"
#=49749/4;;507 3(>:!C+:M+%#C3-N8*=O')2
B$/&0=4477/4;;0
?-G#C?+MA#3?#(-' = %$ /40=&@/4;;90
& :#?#(C&' !'!("%K 4;64
5 ,'#-'-!K:) ** * " !( )'%> 4;;9
9 (" ) ' % $ /&0= /4;690
)'-C')" !%(+4;;@6 K-!C
$/40=4;79/4;;90; :)I>--CKG
$=77/4;;904@ ,-#++)'C=
+=)N%,- !'!" . /% C"P !#4;;595;7
44 L-C!$"0!." !:(G7@@@
47 ?#CKF?(:)-)"1'-")
%'4;96
4 ,#?K!G+
94
45 '-)?('+!-1/! (+= 4;;9
75 :)I>--CKG3Q%'F" G+=1!M?;!
97
& 3--C?,-!?%#!"*"%?!CK) -!?'"
B + !$=7;;@;/4;;0
& ,-#++)'MF>)>G!?!+:N=23' -=@74/4;6@0
&6 )!%?!CC-!?)!*1-'" :4;5
&; ,-#++)')
/0+=F: # ' ))> %4;6;&447
9
5@ 8!C)#+)(G-!?! $ ! = &@&49/4;;0
54 3((K:!C:% B! * !( '=&/4;;60
57 '!,-%-!?:= " $ " = 7;&7/4;;0
5 :)?-(P ''. *(' !((! " !%,F?84;;6
55 >!'%'*!%,F?84;;
59 +#:C-#>''%2 '"'9!)N,M+4;;5
5 + *# CC,C&!(""%3!-")
%'4;;&
5; '-#K-C'-#:-!N%-=
95
16Evaluation of health promotion
policies: tracking a moving targetNancy Milio
Introduction!"=" "
:=
8 " B
! " $ 5@@4;6@4;;@65 "&" 2 "
- "".
8 "
B. "
F
"""
""""
. " "
"
99
Policy evaluation% "" "* ="
""# #
2
Some basic questionsProcess! .
H '"BH , BH ,""BH ,"
BH ," B
" /" " 0 "
EffectsI=/
0 / 0I
=
/ 0
/0/08 = +
9
=
A framework for health promotion policy-makingEvaluation: concept, problem and purpose! " " !""# "
" "
"- !
*
Overview of the frameworkPublic policy: purpose and environment% """ # !$ # "
(/0 / 0
/0
# ""
". "
""
96 Fig. 16.1. Health organizations and policy-making Policy environment Policy impacts
EconomyDemographicsEpidemiologyTechnologymedia mixIdeologiesPolitical processes
Policyprocesses
Publicpolicies
Policytools
Goods and services: jobs, housing, food, education, environment
Organizations: public private (profit and non-profit)
Self-starting initiatives
Organizationalchanges:fiscaladministrativeprogrammaticinformational
Impacts: on other organizationson other environments
Outcomes for: clients total popu- lation
Publicpolicy
responses
Healthorganizations
policyaction
Coalition building:lobbyinglitigationnegotiationopinion shaping
Policy-makers
Stakeholdergroups
Communicationand interpretive
media
Publics
9;
!8494 2 0!
""
.$#
" - "
Actors% """ *"
/84970
Fig. 16.2. Media and policy-making processes
(
Interest groups: legislative committees bureaucratic units parties caucuses lobbies of industry, labour, professions, voluntary organizations
Media: news coverage and foci editorials opinion poll reports political advertisements Publics:
consumers audiences taxpayers voters political contributors potential interest-group members
Public policy-making
@
, " % " " / 0" /84940
.
! ( ( /84970
"
2%
:
Types of policies8 /R 0 / 0"494
Table 16.1. Strategies for disease prevention and health promotion
/0/0"/"" 0!
Intervention strategy Focus
Individual-directed, information-mediated change Homes and communities Organization settings
Organization-directed change Policy bodies: legislatural bodies independent regulatory agencies government administration Specific organizations: government bodies other organizations
4
/ 0 /0 / 0
A case in point: tobacco-control legislation" " "
>+4;6@ +"""""K
.
"
Environmental context: why there and then? ."B, " B
,"B >+ "
"" ""
8 " ""
* "! "+
7
$
"
Policy frame and setting: how and where was the policy issue defined and legitimized?'"
"
+ .
H '"" = B
H , " / 0B
H ,= 2B
H '" B
: +
2
The forum%
," B'""B
,
B "" "
!" B8"
" +
"
Design, instruments and financing: what were the policy goals, tools and resources?#2 3 * / 0
2,* "$" "
Policy instruments / 0 $$ (/ 0"
#* %"
:""
. +.""
-
"
$
"" .
H ,"BH , "BH ,
"BH ,"B
+""=
"R""""" "R
Organizations: who were the players?Interests!" /0 "+2
&
2"
$
, /"0"
:
"$"G$$
=
Bottom-line judgments * + - /"
0 "
+".!)+
Identifying stakeholders:* )""
Organization indicators!*.
=2" *#=2
5
!2
R
The question of values!2 "
("2 " F. 2"
H ,"BH ,"BH , B
Interorganizational relations: how were players interlinked?" " " "
Joint efforts! " "
) " ?
""
".*
K
( "
" "
""
Issues to explore ""
9
"* *
Organizations strategies: what action did players take?Types of strategic action
>+ ?
.
Bargaining " " -
. "" /)
770
!"
.
2
"
2
#"$G
+2""""3"2 F" ".
F .=
Information in policy-making: what types of information were used and how? - " # .
/0/"
0"" ( "
Designing policy8 " "+
=
"
( 2
* 8 " *
Enacting policyF =2%* "*
6
" )K(: #" R
Effects on policy-making" ""
2 2"#"
%"" " C" # "
22
Useful queriesI"
H K BH ,/ 0"
"""BH K
BH ,""
B
Implementation: did policy become reality?. ="B!
": P
;
#"#."
.
H ,
"B
H '""B
)"
/0
Policy evaluation issuesThe environment of policy evaluation%
3" (
#
"
Units of analysisIndividual indicators' " %
""" "
. ""+ " " ""
6@
" 22 22
: " "
"2"
8 " / 0 /0" 2 + "' "D
E*#
Organization indicators, "
* "
+
( "=
H * $H "
$H /
0$
64
H /"0$H /
$ $0
=
H H H H H H
)
/84940
Dissemination and use of evaluations( "" " " ! =" "
8 / 0
/ 0+ "" $
"
# "
"
C" + .
"
67
- =
!
" "
Conclusions, "
"
C""
-
*+" "
""""""""
! # " ." "" ! " =
*
References4 :#?#( C ! " =
3 7! * !( =56/4;90
7 :#C
6
& ?#C-C3-N-!?%" 37!* =7;64@/4;;40
5 %-CA:!-!?"= 37!*!(/0=65697/4;6;0
9 3?!CA %4;;
44 F-,-3MK-?-(C%=!*""'"#?K4;6
47 F-CN!:#C/&0=!+7;;!+@9/4;;50
4 :#?#(C,!"**!.'"FN'> %4;;@
4& :#?#( C0' * -. !' * '" "!'!(")'!%4;;9
45 :#?#(C>+=" )4/&0=49/4;;90
49 )!:%F-??'++**"SKT)'+%'> C)4;;@
4 ?!>:!CC-M %4;;;57
4; )!%%-?!8MN!:#-+(C. '**(*%!+)> % 4;;9
7@ N!)(F+(C % - !? % B! *""-=6646/4;;0
6&
74 ()'-8(KM)(FF%&"!7!/40=594/4;;0
77 %4;;
75 3((K:!C-!?!. = . " :37!*/0=7@677@/4;;0
79 3((K:!C-!?K
$!6!"/70=4946/4;;0
7
65
6 ?>-%C#C3(88#)-+ '*-**
@',K)>+)4;;5
6
17Evaluation of countrywidehealth promotion policies:
the Canadian experienceReg Warren, Irving Rootman and Rick Wilson
Introduction " % ** * ,'(" /)#CK#0 >+ )(::# )>+ "*
,
" "
"
Canadas health promotion programme#4;6)"
" # "%
66
"')
" " ! """"4;6;
#" $ R $
/0$ */ *0$ # ." ) U4@" "'%K
C
! " .
4;6; =
H "$H "*
'%K
2$H 5@ /
0@4@@ ')*$
H
3 *" . * *
+"
Evaluating Canadas health promotion programme: challenges and barriersThe administrative context4;6; "
6;
#
# )/ 0$ !" " !
" >* 8 "."
) % ' ! "3 !!D"" E
The political context: roles and responsibilities, and shifting priorities()"
) * )." " .
* / 0"
#
" 3 8 ".
8" ""F
K*"" "
;@
!."
.# " B #
The socioeconomic context!"" " " )") / 0+ " " "
!" )" *
Evolution of health promotion8/4;60 /4;6;0 + *
(")'%,'(F4;6; "
Differing resources and capacities
" ", " /0). "" ".
K
#
;4
) C3(
. #
C * + " /*0 :
Coordination and integration#" "* " !
.$ !" ".
#" 8
" -
. ""
"
$ ""
Lack of control conditions8" . - "
"-
2 *
,
;7
""/"02"
TimelinessF 4;6; "
Seeking convergence from multiple sources( " "$ $ $ $
*/0$ - .*
"" " "
K
. "
>
" *
)
. = / 0*"/ 0
"
;
#
* "
.
The Canadian experience: lessons learned( )2 " 8 =
H "
*$
H "" $
H *
"$
H $
H
$
H "
#=
H
$
H
$
H
$
H $
H *
: "
/ .0
;&
/40:
"
Applying the lessons learned " (" .# " #" !. "
" " :
$ $ $ $*" $ +"
,
"
"=
4 7
;5
&
5 9 6 ;
A user-driven approach" ( # /
0 !" / ) &0 * -"""
"
""
"**""
=
H " / " 0$
H " $H "
# ""
" "
Agreement on basic operating principles! =
H . $
;9
H . " $
H $
H $
H /
0$
H $
H *
Partnerships:"
=
H " $
H " $
H "$H "$H $H $H
"