!
STAAR
Grade 3-8 Standards Now We Know Who Passed!
www.lead4ward.com !
!
The Buzz What!are!folks!buzzing!about?!!!
What’s!confusing!or!needs!clarification?!!!!!!!!!!!!!
!!
Using Performance Categories for Intervention and Review
!Performance!Category! Description! Raw!score!%! Planning!%! Intervention!
Level!I!Unsatisfactory!Academic!Performance!
Inadequately!Prepared!
EOC!<35K65%!Gr.!3K8!!<39K66%! <!55%!
LongKterm,!sustained,!sequential!intervention!
Level!II!!Satisfactory!Academic!Performance!!
Sufficiently!Prepared!
Phase!I!EOC!≥!35K65%!Gr.!3K8!≥!!39K
66%!
≥!55%!
ShortKterm,!targeted!intervention!Final!
EOC!≥!50K73%!!
≥!≈62%!
Gr!3K8!!≥!63K84%! ≥!≈75%!
Level!III!Advanced!Academic!Performance!
Well!Prepared!
EOC!≥!63K92%!Gr!3K8!!≥!82K93%!
!
≥!≈85%!!
Review!and!maintenance!
!!
page 1
Scale
Raw
%age
Scale
Raw
%age
Scale
Raw
%age
Scale
Raw
%age
Scale
Raw
%age
English�I�R
eading
5618
1327
48%
1875
3054
%19
5034
61%
2000
3664
%23
0446
82%
English�II�Re
ading
5618
0624
43%
1875
2748
%19
5031
55%
2000
3359
%23
2845
80%
English�III�Reading
5618
0819
34%
1875
2138
%19
5025
45%
2000
2850
%21
3535
63%
English�I�W
riting
6217
9837
60%
1875
4065
%19
5043
69%
2000
4573
%24
7657
92%
English�II�Writing
6218
0736
58%
1875
3861
%19
5041
66%
2000
4369
%24
0855
89%
English�III�W
riting
6218
0829
47%
1875
3353
%19
5037
60%
2000
4065
%21
5547
76%
Algeb
ra�I
5433
7117
31%
3500
2037
%37
5027
50%
4000
3463
%43
3342
78%
Geo
metry
5233
6215
29%
3500
1835
%37
5024
46%
4000
3160
%43
9740
77%
Algeb
ra�II
5033
5016
32%
3500
1938
%37
5024
48%
4000
3060
%40
8032
64%
Biology
5433
6717
31%
3500
2037
%37
5027
50%
4000
3361
%45
7645
83%
Chem
istry
5233
4818
35%
3500
2140
%37
5026
50%
4000
3262
%46
0743
83%
Physics
5033
4616
32%
3500
1938
%37
5024
48%
4000
3060
%44
9939
78%
World�Geo
graphy
6833
8327
40%
3500
3146
%37
5039
57%
4000
4769
%44
0457
84%
World�History
6833
2628
41%
3500
3146
%37
5037
54%
4000
4262
%46
3454
79%
U.S.�H
istory
6833
7225
37%
3500
2841
%37
5036
53%
4000
4465
%44
4055
81%
*�Level�III�is�fin
al�fo
r�all�EO
Cs�other�th
an�Eng
lish�III�Reading
,�Eng
lish�III�W
riting�an
d�Algebra�II
Math
Minim
um�Score
Science Soc.�StudiesEnglish
STA
AR
EO
C R
aw S
core
Con
vers
ion
sSp
rin
g 2
012
Pap
er A
dm
inis
trat
ion
s
Phase�2
Fina
l
Level�II�Ͳ�Satisfactory
Phase�In*
Level�III�Ͳ�A
dvan
ced
Phase�1
Phase�1
Subject
Item
s
©�lead4w
ard,�LLC�201
2http://lead4
ward.com/resou
rces/
page 2
Scale
Raw
%age
Scale
Raw
%age
Scale
Raw
%age
Scale
Raw
%age
Grade�3
4013
3120
50%
1400
2563
%14
6830
75%
1555
3485
%
Grade�4
4414
2223
52%
1486
2864
%15
5033
75%
1633
3886
%
Grade�5
4614
5825
54%
1520
3065
%15
8235
76%
1667
4087
%
Grade�6
4815
0427
56%
1567
3267
%16
2937
77%
1718
4288
%
Grade�7
5015
5627
54%
1615
3366
%16
7438
76%
1753
4386
%
Grade�8
5215
7527
52%
1637
3465
%17
0039
75%
1783
4587
%
Grade�3
4613
9226
57%
1460
3270
%15
2937
80%
1615
4189
%
Grade�4
4814
7128
58%
1535
3471
%15
9938
79%
1677
4390
%
Grade�5
5014
8926
52%
1558
3366
%16
2739
78%
1710
4488
%
Grade�6
5215
0921
40%
1584
2956
%16
5837
71%
1762
4485
%
Grade�7
5415
5123
43%
1615
3056
%16
7836
67%
1798
4685
%
Grade�8
5615
8322
39%
1641
2952
%17
0035
63%
1863
4988
%
Grade�5
4435
0029
66%
3750
3477
%40
0037
84%
4402
4193
%
Grade�8
5435
0029
54%
3750
3463
%40
0039
72%
4406
4685
%
SS
Grade�8
5235
0025
48%
3750
3262
%40
0038
73%
4268
4383
%
Grade�4
4435
0023
52%
3750
2659
%40
0030
68%
4612
3682
%
Grade�7
7235
0039
54%
3750
4461
%40
0050
69%
4602
6083
%
Math ScienceReading WritingST
AA
R G
rad
es 3
-8 R
aw S
core
Con
vers
ion
sSp
rin
g 2
012
Pap
er A
dm
inis
trat
ion
s (E
ng
lish
)
Phase�2
Fina
l
Level�II�Ͳ�Satisfactory
Phase�1
Subject
Items
Level�III�Ͳ�A
dvan
ced
©�lead4w
ard,�LLC�201
2http://le
ad4w
ard.com/resou
rces/
page 3
©"lead4ward,"LLC"2012 http://lead4ward.com/resources/
Phase&I Final
%&Satisfactory %&Satisfactory
Grade"3 73% 35% 738%
Grade"4 72% 39% 733%
Grade"5 75% 39% 736%
Grade"6 69% 32% 737%
Grade"7 74% 38% 736%
Grade"8 80% 43% 737%
Grade"3 66% 34% 732%
Grade"4 63% 27% 736%
Grade"5 74% 33% 741%
Grade"6 75% 33% 742%
Grade"7 76% 36% 740%
Grade"8 78% 36% 742%
Grade"5 84% 45% 739%
Grade"8 62% 29% 733%
SS Grade"8 40% 11% 729%
Grade"4 62% 24% 738%
Grade"7 65% 30% 735%
Year Phase Follow"a"Class2012 Phase"I use"0"for"kindergarten2013 Phase"I2014 Phase"II2015 Phase"II2016 Final
Writing
Subject/Grade Difference
STAAR Grades How Far From FinalSpring 2012 Paper Administrations (English)
Math
Science
Read
ing
page 4
Grad
e&Level
Conten
t&&Area
Top&%&Correct
54%
Top&%&Correct
58%
Top&%&Correct
70%
Top&%&Correct
79%
Top&%&Correct
92%
Stud
ents
Raw&Score
Stud
ents
Raw&Score
Stud
ents
Raw&Score
Stud
ents
Raw&Score
Stud
ents&
Raw&Score
Antone
lla54
%Jerónimo
61%
Andrew
70%
Jada
79%
Mariana
92%
Isabella
54%
Valeria
58%
Benjam
ín70
%Em
iliano
79%
Michael
92%
Imani
54%
Ryan
58%
Maria<Jo
sé70
%An
dre
79%
Jazm
ine
91%
Daniel
52%
Lucia
58%
Jacob
69%
Emily
79%
Ashley
89%
Soph
ia52
%Joshua
58%
Darryl
69%
Alyssa
78%
Ebon
y88
%Trevon
49%
DeShaw
58%
Dem
etriu
s69
%Maurice
78%
Elizabeth
88%
Deja
49%
Gabrie
l58
%Jim
ena
69%
Ethan
78%
Nicolás
88%
Olivia
49%
Ava
58%
William
68%
Shanice
78%
Matías
87%
Hannah
48%
Aaliyah
57%
Tomas
68%
Joaquín
78%
Terrell
87%
Sebastián
48%
Sara
57%
Martin
a68
%Catalina
76%
Malik
87%
Luciana
42%
David
57%
Alexande
r64
%Samue
l74
%Va
lentina
83%
Precious
41%
Dom
inique
56%
Marqu
is63
%Em
ma
74%
Christoph
er83
%Mía
41%
Camila
56%
Agustín
63%
Anthon
y74
%Diego
82%
Madison
40%
Tyrone
56%
Tyler
63%
Abigail
73%
Mateo
82%
Martín
39%
Daniela
55%
Sam
62%
Samantha
73%
DeA
ndre
82%
Darius
38%
Tierra
55%
Trey
62%
Sarah
73%
Santiago
82%
Asia
38%
Lucas
55%
Conn
or61
%Nicho
las
72%
Grace
82%
Gabrie
la36
%Em
ma
55%
Ash
61%
Daniel
72%
Mario
82%
Reginald
26%
Emmanue
l55
%Jonathan
61%
Samantha
72%
Nia
81%
Jose
24%
David
55%
Jake
61%
Alejandro
71%
Willie
81%
Performan
ce&
Thesho
ldPa
ss&
Rate
Notes
>55
%79
%>
62%
57%
>75
%30
%>
85%
10%
2012
78%
2012
Res
ults
Quintile&1
Quintile&2
Quintile&3
Quintile&4
Quintile&5
An
alyz
ing
ST
AA
R D
ata
Gra
des
3-8
yours
yours
&Low
est&P
erform
ing&to&Highe
st&Perform
ing&
page 5
STA
AR
: Ana
lyzi
ng S
tud
ent P
erfo
rman
ce
Qui
ntile
s an
d C
omm
on S
ense
Quintile(1(
Quintile(2(
Quintile(3(
Quintile(4(
Quintile(5(
Top(%(Correct(
((To
p(%(Correct(
((To
p(%(Correct(
((To
p(%(Correct(
((To
p(%(Correct(
((Stud
ents(
Raw(Score(
Stud
ents(
Raw(Score(
• Students(
Raw(Score(
Stud
ents(
Raw(Score(
Stud
ents((
Raw(Score(
• Discuss(the(students(learning(
needs((perception)(
• Look(for(concept(gaps(
• Top(perform
ing(student(<50%(
correct(could(m
ean(longitudinal(
or(systemic(concept(issues(
• Complete(SE(analysis(for(this(
group(of(students(
• Notice(patterns(in(readiness(and(
process(standards(
• Are(those(aligned(to(concepts(in(
the(current(year(instruction?(
• Review(the(progress(of(and(the(
success(of(interventions(for(these(
students(from(the(previous(school(
year(
• Plan(accelerated(instruction(
(
• Discuss(the(students(learning(
needs((perception)(
• Are(students(in(quintile(m
ore(like(
students(in(quintile(1(or(3?(
• Plan(accelerated(instruction(or(
targeted(intervention(
(
(
((
• Discuss(the(students(learning(
needs((perception)(
• Top(perform
ing(student(<60%(
correct(and(the(students(are(m
ore(
like(the(students(in(lower(
quintiles(could(m
ean(systemic(
content/concept(issues.((
• Consider(instruction:(opportunities(
for(transfer(of(learning,(rigor,(or(
concept(development(
• Consider(multiPgrade(level(issues(
• Most(student(perform
ance(
around/above(60%(P(specific(
student,(teacher,(or(concept(
issues.(
• Plan(accelerated(instruction(or(
targeted(intervention(
(
• (Discuss(the(students(learning(
needs((perception)(
• Are(students(in(quintile(m
ore(like(
students(in(quintile(3(or(5?(
• Plan(targeted(intervention(
(
(
((
• Discuss(the(students(learning(
needs((perception)(
• Highest(perform
ing(students(
• Did(all(students(in(this(quintile(get(
over(80%(of(the(items(correct?(
90%(((
• If(m
ost(students(score(below(80%(
significant(instructional(issues(
could(exist–(likely(across(grade(
levels(
• Complete(SE(analysis(for(this(
group(of(students(
• Notice(patterns(in(readiness(
standards(to(identify(overarching(
curriculum(hot(spots(
(
((
Analyze(the(gap(betw
een(the(perform
ance(of(the(students(in(quintile(1(and(quintile(5.((
• Is(the(gap(small?(
• The(m
ore(sim
ilar(the(perform
ance(of(the(group(
• Perform
ance(in(both(quintile(1(and(quintile(5(is(similar(but(low(=(systemic(issues((likely(longitudinal)(
• Perform
ance(in(both(quintile(1(and(quintile(5(is(similar(but(high(=(celebration(and(specific(student,(teacher,(or(concept(issues(
• (Is(the(gap(wide?(
• The(m
ore(diverse(the(perform
ance(of(the(group(
• May(describe(systemic(content/concept(issues(
(
Analyze(the(distribution(of(scores(by(teacher(
• Teachers(highlight(students(in(their(classes(last(year(
• Original(class(composition(establishes(the(baseline(
• Sim
ilar(composition(of(classes(–(analysis(yields(which(teachers(m
ay(need(support(
• Ability(based(distribution(of(classes(–(analysis(should(included(previous(perform
ance(–(did(students(m
ake(progress?(
(
Major(concept(and(process(gaps(
( ( ( ( (
page 6
Det
erm
inin
g In
terv
enti
on F
ocus
Are
as
! !Quintile!1!
Quintile!2!
Quintile!3!
Quintile!4!
Quintile!5!
Level!III!
Advanced
!Ac
adem
ic!Perform
ance!
(Well!Prepa
red)!
!
!!
!!
!
Level!II!
Satisfactory!
Acad
emic!Perform
ance!
(Sufficiently!Prepa
red)!
!
!!
!!
!
Level!I!
Unsatisfactory!
Acad
emic!Perform
ance!
(Inad
equa
tely!
Prep
ared
)!
!!
!!
!
page 7
!!!!Design of STAAR !!Standard!Type! Description! Role!in!Intervention!
Readiness!Standards!
Essential!for!success!in!the!current!grade!or!course!
Important!for!preparedness!for!the!next!grade!or!course!
Support!college!and!career!readiness! Necessitate!in=depth!instruction! Address!broad!and!deep!ideas!
Assess!cognitive!complexity! Plan!for!multiple!novel!items! Focus!on!high!volume!reporting!
categories! Anticipate!based!on!prior!year!data! Integrate!into!instruction! Remediate!based!on!lag!performance!!!
Supporting!Standards!
Introduced!in!the!current!grade!or!course,!but!emphasized!in!a!subsequent!year!
Reinforced!in!the!current!grade!or!course,!but!may!be!emphasized!in!a!previous!year!
Prepare!students!for!the!next!grade!or!course!but!not!a!central!role!
Address!narrowly!defined!ideas
Scaffold!for!intervention! Assess!prerequisite!skills!or!context!! Align!to!focus!readiness!standards! Use!STAAR!Alternate!TEKS!Framework!
Process!!Standards!
Tools!to!Know:!Represent!the!strategies!and!structures!a!student!uses!to!access!learning!
Ways!to!Show:!Represent!the!way!a!student!demonstrates!understanding/communicates!knowledge
Activate!memory! Support!engagement! Establish!access!! Maintain!performance!orientation! Create!novelty! Focus!or!highly!tested! Ensure!process!strategies!
!
!
page 8
TEKS%Scaffolding:%Math%Grade%4
©2013%lead4ward
4.4
#4.4.D
# Student+Expectation Type 2013+STAAR 2012+STAAR4.4.B represent%multiplication%and%division%situations%in%picture,%word,%and%
number%formS
4.4.C recall%and%apply%multiplication%facts%through%12%×%12 S
3.4.A learn%and%apply%multiplication%facts%through%12%by%12%using%[concrete]%models%[and%objects]
S
3.4.B solve%and%record%multiplication%problems%(up%to%two%digits%times%one%digit) R
2.4.A model,%create,%and%describe%multiplication%situations%in%which%equivalent%sets%of%concrete%objects%are%joined
S
Number,+operation,+and+quantitative+reasoning.+The+student+multiplies+and+divides+to+solve+meaningful+problems+involving+whole+numbers.+The+student+is+expected+to
Readiness+Standarduse%multiplication%to%solve%problems%(no%more%than%two%digits%times%two%digits%without%technology)
Scaffolded+Skills
page 9
Tools to Know | Ways to Show (highly tested process standards)
Process My Strategies
Mat
h
Math%in%everyday%situations%(analyze(information)%3.14A%|%4.14A%|%5.14A%|%6.11A%|%7.13A%|%8.14A%
%
Use%problem?solving%models%3.14B%?%3.14C%|%4.14B%?%4.14C%|%5.14B%?%5.14C%|%6.11B%?%6.11C%|%7.13B%?%7.13C%|%8.14B%?%8.14C%
%
Communicate%mathematical%ideas%(graphical,(numerical,(physical,(or(algebraic(models)%6.12A%|%7.14A%|%8.15A%
%
Scie
nce%
Analyze/interpret%information%?%make%inferences%5.2D%|%8.2E%|%B.2G,%B.2H%|%C.2H%|%P.2J,%P.3F%
%
Use%scientific%tools%and%instruments%5.4A%|%C.2G%
%
Use%models%to%represent%natural%world%8.3B%
%
Soci
al S
tud
ies%
Sequencing,%categorizing,%cause/effect,%inference%8.29B%|%WH.29F%|%USH.29B%
%
Create%and%interpret%visuals%and%organize%information%8.29C%|%WG.21C%|%WH.15A,%WH.15B,%WH30.C|%USH.29H%
%
Primary%and%secondary%sources%%8.29A%|%WG.21A%
%
Rea
din
g%
Use%context%to%determine%or%clarify%the%meaning%of%words%3.4%B%|%4.2B%|%5.2B%|%6.2B%|%7.2B%|%8.2B%%
%
Make%inferences/use%textual%evidence%%Gr.%3?8:%Fig.19D%%|%Eng.%I,%II,%III%Fig.%19B%
%
Summarize,%paraphrase,%and%synthesize%texts%Gr.%3?8:%Fig.19E%
%
Wri
ting
%
Revision%%
Writing%to%prompt/maintaining%focus%%
Clear%thesis%%
%
page 10
©"lead4ward,"LLC"2012"
Instructional Adjustments Fine Tuning for Interventions
"Adjustment Connection to STAAR Intentional Intervention
1. Talk"with"students"" "
2. Ask"questions"that"we"ourselves"can"answer"
" "
3. Check"for"understanding"(during"teaching/use"common"assessments"wisely)"
" "
4. Learn"from"students"mistakes"
" "
5. Provide"time"for"students"to"think"
" "
6. Pace"appropriately"" "
7. Provide"opportunities"for"transfer"
" "
""
Learning from Mistakes – Key to Intervention
Procedural Errors Students"cannot"complete"content"specific"procedures"accurately."
Application Errors Students"cannot"apply"learning"to"a"
specific"task"or"stop"too"early"in"problem"solving.
Conceptual Errors Students"have"misunderstanding"about"the"underlying"concepts"behind"the"
learning.
Reading • Doesn’t"read"captions"• Substitutes"words"
• Stops"reading"passage,"reads"questions"and"looks"for"answer"
• Reads"each"genre"as"fiction"
• Looks"for"details"v."inferring""• Confuses"tone"and"mood/theme"and"topic"
Writing • Writes"to"the"image"v."prompt"• Editing"errors"that"interfere"with"meaning"
• Inadequately"revises"• Ends"before"essay"is"complete"
• Writes"to"wrong"purpose/confuses"purpose"
• Confuses"revision"and"editing"
Math • Puts"decimal"point"in"the"wrong"place"
• Makes"addition"error"
• Stops"too"early"in"the"problem"solving"
• Doesn’t"know"how"to"start"
• Doesn’t"understand"why"division"of"proper"fraction"yields"a"larger"quantity"
Science • Misreads"meniscus"• Uses"wrong"unit"of"measure"
• Limits"data"interpretation"to"single"conclusion"
• Does"not"complete"the"water"cycle"
• Cannot"convert"between"data"displays"
• Confuses"plant"and"animal"cells"
Social Studies
• Cannot"read"a"primary"source"• Forgets"the"name"of"an"event"
• Misinterprets"population"data"• Cannot"link"events"to"their"context"
• Cannot"link"events"to"a"concept"• Does"not"infer"meaning"from"a"primary"source"
page 11
STAAR Intervention Mind your Ps and Qs !!
Problem Starting
Planning
Persistence
Questions
!!!!
page 12
Usi
ng L
ocal
Ass
essm
ent D
ata
to In
form
Inte
rven
tion
Yes$=
$similar$to$samples$used$in$instruction$|$assessmen
t$of$teaching$
No$=$requ
ires$stude
nt$to
$app
ly$learning$|$assessm
ent$o
f$learning$
$Nam
e$Quintile$
%$
Correct$
Yes$Items$
No$Ite
ms$
Items$
#$Co
rrect$
%$Correct$
Items$
Correct$
%$Correct$
$$
$1$$2$$7$$8$$9$$12$13$$15$$16$
$$
3$$4$$5$$6$$10$11$14$$17$18
$$
$
$$
$1$$2$$7$$8$$9$$12$13$$15$$16$
$$
3$$4$$5$$6$$10$11$14$$17$18
$$
$
$$
$1$$2$$7$$8$$9$$12$13$$15$$16$
$$
3$$4$$5$$6$$10$11$14$$17$18
$$
$
$$
$1$$2$$7$$8$$9$$12$13$$15$$16$
$$
3$$4$$5$$6$$10$11$14$$17$18
$$
$
$$
$1$$2$$7$$8$$9$$12$13$$15$$16$
$$
3$$4$$5$$6$$10$11$14$$17$18
$$
$
$$
$1$$2$$7$$8$$9$$12$13$$15$$16$
$$
3$$4$$5$$6$$10$11$14$$17$18
$$
$
$$
$1$$2$$7$$8$$9$$12$13$$15$$16$
$$
3$$4$$5$$6$$10$11$14$$17$18
$$
$
$$
$1$$2$$7$$8$$9$$12$13$$15$$16$
$$
3$$4$$5$$6$$10$11$14$$17$18
$$
$
$$
$1$$2$$7$$8$$9$$12$13$$15$$16$
$$
3$$4$$5$$6$$10$11$14$$17$18
$$
$
$$
$1$$2$$7$$8$$9$$12$13$$15$$16$
$$
3$$4$$5$$6$$10$11$14$$17$18
$$
$
$Ra
w$
%$
9$10
0$8$
89$
7$78
$6$
67$
5$56
$4$
45$
3$34
$2$
23$
1$12
$0$
0$
$
page 13
Intervention After the Assessment ��
Procedural�Errors�
�
Application�Errors�
�
Conceptual�Errors�
�
Implications�for�intervention�
�
����������
page 14
Analyzing Student Performance Local Assessment
Can the student apply the learning?
Performance on items that require student to apply learning | assessment of learning
Yes No
Did
the
stud
ent g
et it
the
way
I ta
ught
it?
Perf
orm
ance
on
item
s si
mila
r to
sam
ple
s us
ed in
inst
ruct
ion
| as
sess
men
t of t
each
ing
Yes
No
page 15
STAAR Log !
Student! !Teacher! !Grade! !Class! !
!!
3 ! My!plan!
!
! !
! ! !
2!! My!plan!
!
! ! !
1!
! My!plan!
!!tool!to!know!|!way!to!show! my!strategy!!!
!
!!
!
!!
!
!!
!
!
I know!
to grow!
to go !
page 16
© lead4ward, LLC 2012
STAAR Relevant Review Subject-by-Subject
Subject( Instructional Hot Spots/Adjustments Cool Ideas ! !
Science(
• Investigation!or!demonstration!
• Academic!language!of!investigation!
• Off!level!SEs!• Reporting!of!data!in!multiple!forms!
• Expository!writing!• Models!
!
!
! !
Social Studies(
• Timeline!or!sequencing/chronology!support!
• Memorization!of!facts!in!context!
• Memorization!of!facts!by!concept!
• Primary!source!strategies!
• Expository!writing!• Understanding!relationships!
!
! !
Math(
• Transfer!and!application!• Overreliance!on!samples!–!item!practicing!
• Problem!Starting!
• Selecting!a!problem!solving!model!!
• Tricks!and!misconceptions!
!
! !
Reading(
• Academic!vocabulary!of!genre!
• Persistence!in!extended!reading!• Planning!for!genre!• Opportunities!for!inferential!thinking!• Shared!Reading!• Textual!evidence!v.!find!the!answer!
!
! !
Writing(
• Writing!to!the!prompt!
• Revision!focused!on!effectiveness!• Editing!focused!on!correctness!• Matching!organizational!structure/form!for!purpose!
• Clear!thesis!or!central!idea!• Concise!and!precise!writing!
!
!
page 17