1
Performance System
Deputy Superintendent Ronn Nozoe 8/19/2013
Hawaii’s New School Accountability & Improvement System
Strive HI Information on HawaiiPublicSchools.org
2
• Background • Strive HI Performance System Basics • SY 2013-‐14 Results • School Improvement ImplementaGon • Q&A
Today’s Webinar
3
• Clear, high expectaGons for students, staff, & schools
• A commitment to using best tools available to measures student, staff, & school progress & provide acGonable data to stakeholders
• A commitment to provide customized support to students, staff, & schools to ensure they succeed in meeGng those goals
4
Hawaii’s Strategic Plan sets vision & direction
4
A clear vision for success grounded in college & career readiness that establishes a culture of reflec8on & improvement at every level of the system:
• 5/20 -‐ USED approved Hawaii’s proposal
• SY 2013-‐14 -‐ ImplementaGon begins
5
USED Approved HI proposal for Strive HI Performance System
Lack of Alignment Opportunity
to Align Approval &
ImplementaGon
• Federal NCLB accountability system was outdated, ineffecGve, & out of sync with Hawaii’s Strategic Plan
• USED provided states opportunity to design new system to replace components of NCLB
• Hawaii seized opportunity & with stakeholder input, designed new system to align with Strategic Plan
6
Strive HI Performance System replaces components of NCLB
No Child LeD Behind (2002-‐12) Strive HI Performance System (2013 -‐ ) Federal government designed system based on outdated approach to school
reform
Designed by?
Hawaii stakeholders designed system to align to BOE/DOE State Strategic Plan
Proficiency in reading & math Focus? Readiness for college & careers
Adequate Yearly Progress (AYP) measured school performance based mostly on 1 test, the Hawaii State Assessment (HSA) reading & math
scores in grades 3-‐10
Metrics? Strive HI performance Index measures school performance & progress, using mulGple measures
All schools are held accountable for meeGng one naGonal, aspiraGonal
target (regardless of current challenges)
Targets? Each school held accountable for meeGng ambiGous & a`ainable goals that are customized
to each school complex (based on current performance)
Schools held accountable for performance of student subgroups that do not fully reflect Hawaii’s student
populaGon
Students included?
All schools held accountable for performance of all of Hawaii’s students & student subgroups that
reflect state’s student populaGon
Required federally-‐designed, one-‐size-‐fits-‐all interven8ons
System of supports?
Customized rewards, support & intervenGons proven successful in Hawaii’s schools and based on
5 Strive HI Steps
• Background • Strive HI Performance System Basics • SY 2013-‐14 Results • School Improvement ImplementaGon • Q&A
Today’s Webinar
7
8
Strive HI Goals & Annual Targets aspiring to Strive HI with ambi4ous & a7ainable goals
82
72
64
34
See actual Complex goals at HawaiiPublicSchools.org
9
Strive HI Performance Index mul4ple measures to understand & school performance & progress
Schools receive a total score out of 400 points
Current Year Gap Rate (gap rate between high needs & non-high
needs students) (0-50 pts)
Two Year Gap Reduction Rate (gap
rate between high needs & non-high needs students) (0-50 pts)
10
Student Growth
• Uses the Hawaii Growth Model. • Student Growth Percen8le (SGP) = a student’s growth compared to their academic peers (other students with similar prior test scores).
• Index uses a school’s Median SGP. • A school’s Median SPG IS NOT a representaGon of the school’s increased proficiency rate from last year.
• Points assigned: using scoring rubric: Reading Math
Median SGP Points Median SGP Points > 58 50 >62 50
55 -‐ 58 35 56 – 62 35 50 -‐ 54 25 50 – 55 25 45 -‐ 49 15 43 – 49 15 < 44 0 <42 0
11
Chronic Absenteeism
• Defini4on: ProporGon of students in a school who were absent 15 or more days. • This IS NOT a school’s average daily a`endance.
• Points assigned: using scoring rubric:
% of students chronically absent Points < 11% 100
12 -‐ 15% 60 16 -‐ 19% 30 20 -‐ 24% 15 > 24% 0
12
ACT
8th Grade ACT EXPLORE: • Scored on a scale of 1 to 25. • Index uses a school’s Median
8th Grade ACT score • Points assigned: using scoring
rubric:
11th Grade ACT Test: • Scored on a scale of 1 to 36. • Index uses percentage of
students scoring 19 or above.
• UH research: 19 predicts college success for Hawaii students.
• Points assigned: by mulGplying percentage by 45.
Median 8th Grade Explore score
Points
> 15.0 100 14.5 -‐ 15.0 65 13.5 -‐ 14.0 35 < 13.0 0
13
Gradua8on & College-‐Going Rates
Gradua8on Rate: • Defini4on: Percentage of students who graduated on Gme in four years with regular diploma.
• Points assigned: by mulGplying graduaGon rate by 50
College-‐Going Rate: • Defini4on: Percentage of students who graduated from high school & enrolled in college within 16 months.
• Points assigned: by mulGplying college-‐going rate by 5
14
Current Year Gap Rate
Current Year GAP : (Non-‐High Needs Students proficiency) –
(High Needs Students proficiency)
Current Year Gap Rate (gap rate between high needs & non-high
needs students) (0-50 pts)
Two Year Gap Reduction Rate (gap
rate between high needs & non-high needs students) (0-50 pts)
80%
50%
20%
Non-High Needs students
High Needs Students
30%
SCHOOL B
Non-High Needs students
High Needs Students
30%
SCHOOL A
Current Year GAP RATE: (Non-‐High Needs Students proficiency) –
(High Needs Students proficiency)
(Non-‐High Needs Students proficiency)
SCHOOL A = 30 pp SCHOOL B = 30 pp
SCHOOL A = 38% SCHOOL B = 60%
The Index uses GAP RATE to differenGate between schools with equal GAPS but different PROFICIENCY RATES.
Proficiency rate
15
Current Year Gap Rate
Current Year Gap Rate (gap rate between high needs & non-high
needs students) (0-50 pts)
Two Year Gap Reduction Rate (gap
rate between high needs & non-high needs students) (0-50 pts)
90%
50%
30% 30%
Non-High Needs students
High Needs Students
20%
2010 2011 2012
2010 Gap Rate: 38% 2012 Gap Rate: 33% 2 YEAR GAP REDUCTION RATE = 2010 Gap Rate – 2012 Gap Rate
2010 Gap Rate
2 Year Gap Reduction Rate = 37 percent
70%
10%
Proficiency rate
SCHOOL B
16
Strive HI Performance Index mul4ple measures to understand & school performance & progress
Schools receive a total score out of 400 points
Current Year Gap Rate (gap rate between high needs & non-high
needs students) (0-50 pts)
Two Year Gap Reduction Rate (gap
rate between high needs & non-high needs students) (0-50 pts)
There are some schools that have missing data, or data that was not used, due to a range of reasons. In these cases, schools’ indexes were calculated according to specific business rules designed to NOT penalize the school for missing or unused data. See your School Performance Report & the SAO office for more informaGon.
17
Strive HI Performance Index Weights Weigh4ng indicators appropriately based on K-‐12 spectrum
18
Based on Index, schools are placed on a Step.
Strive HI Steps targe4ng proven rewards & supports to schools
• Background • Strive HI Performance System Basics
• SY 2013-‐14 Results • School Improvement ImplementaGon • Q&A
Today’s Webinar
19
20
Key Findings
• Our new Strive HI Performance System allows us to do a much be`er job of measuring & understanding school performance so that we can tailor rewards, supports, & intervenGons.
• As a state we set a higher bar for our students: college & career readiness. The big picture on student outcomes shows that we have work to do, but we are on track to graduate more students ready for college & careers.
• We have made significant progress on one of our most important prioriGes: closing achievement gaps between student groups.
• We are parGcularly proud of the results in the Zones of School InnovaGon.
21
Statewide Snapshot – Student Performance
Unacceptable gaps remain, but our schools have made significant process closing gaps in the last two years
Small gains in proficiency. We expect conGnued focus on 6 Priority Strategies will
lead to conGnued improvements.
On track to graduate more students college & career
ready.
By providing ACT exams to all students for free, we’ve removed a barrier to college
entrance.
# SCHOOLS LEVEL TITLE I STATUS ZONES CHARTER
RECOGNITION 14 Schools 13 elementary 1 middle
9 Title I Schools 5 Non-‐Title I Schools
0 “Zones” Schools 1 Charter Schools
CONTINUOUS IMPROVEMENT 228 schools
137 elementary 42 middle
49 high school
182 Title I Schools 46 Non-‐Title I
schools
15 “Zones” Schools
17 Charter Schools
FOCUS 29 schools 15 elementary
5 middle 9 high school
23 Title I Schools 6 Non-‐Title I Schools
2 “Zones” Schools 6 Charter Schools
PRIORITY 14 Schools 3 elementary 2 middle
9 high school
12 Title I Schools 2 Non-‐Title I Schools
1 Zone 8 charter schools
SUPT’S ZONE n/a n/a n/a n/a n/a
22
Statewide Snapshot: School Classifica8ons
Based on Index, schools are placed on a Step.
School Distribu8on
Schools are ranked according to their weighted Points total & the business rules for the Classifica8ons. In some cases, a trigger or excep8on will direct schools into a different category than their pure Index ranking: • SIG status • Low grad rate, or high grad rate gap • Low performance, or high performance gaps
23
24
School Distribu8on In general, schools are distributed as you would expect: the higher the Index Score, the higher the classificaGon.
There are outliers: triggered into a category for a specific reason, based on their data.
25
School Distribu8on SCHOOL CLASSIFICATION TRIGGER
Waianae Elementary Priority SIG Status Kauai High Focus Large graduaGon gap
Pearl City High Focus Large Achievement gap
Lahainaluna High Focus Large Achievement gap
School Distribu8on “Recogni8on” requires mee8ng one of the “posi8ve” triggers for 1 of 2 categories: 1: High Performance Schools: • Meet or exceed targets for all subgroups • Grad rates in top 10% • Gap rate must be less than 30% 2. High Progress Schools: • Increases 15% of all students proficiency over three years • Increases in grad rates (top 10% of schools with increase of 10% over three years) • Gap reducGon of 10% or greater over 3 years
High Index schools that didn’t meet Recogni8on Criteria
Hahaione Elementary Kihei Elementary
Kanoelani Elementary MomilaniElementary
Pearl Harbor Kai Elementary
26
• Background • Strive HI Performance System Basics • SY 2013-‐14 Results • School Improvement Implementa8on • Q&A
Today’s Webinar
27
28
Federally Required Turnaround Principles Align with Strategic Plan Goals
Principle Goal Providing strong leadership Goal 2: Staff
Success
Ensuring teachers are effecGve &able to provide improve instrucGon
Redesign the school day, week, or year Goals 1 & 2:
Student & Staff Success
Strengthen the school’s instrucGonal program
Using data to inform conGnuous improvement
Goal 1: Student Success
Establish a school environment that improves safety & discipline
Engage families & communiGes
29
Recogni8on Schools
• Top 5 percent of schools • High-‐performing schools & high-‐growth schools • Receive recogniGon, rewards, & access to administraGve flexibility. Expected Ac8ons: • Financial Awards:
• Strive HI Award ⎯ up to $95,000 • School swill receive Awards NoGficaGon memo detailing process • Receive funds in Sept; expenditure in SY 2013-‐14
• Administra4ve Relief & Flexibility: • RecogniGon schools leaders invited to workgroup to advise on
addiGonal areas of administraGve relief & flexibility
30
Con8nuous Improvement Schools
• 75 – 85% schools • Generally on a posiGve trajectory & do not need intensified support from their Complex Area or state office. Expected Ac8ons: • Con4nued implementa4on of 6 Priority Strategies • 2014-‐15 AcFin – address student subgroup
performance challenges idenGfied through the Strive HI Index data & school report cards.
31
Focus Schools
• Low performance on Strive HI Index or automaGc trigger • Increased CAS & Deputy role Expected Ac8ons: • CASs may receive an addi4onal Complex Area EO to coordinate targeted improvement efforts.
• Comprehensive needs assessment (CNA) to diagnose root causes for underperformance, using tools provided by the Office of the Deputy Superintendent. (Guidance & requirements provided by 9/1/13)
• SY13-‐14 Focus Schools Fiscal Requirement Form: Based on results & CNA, develop 1 year plan to be implemented & funded in the second semester of SY2013-‐14.
• Access to “array of services” • Development of SY14-‐15 AcFin: Focus Schools will also begin work on their SY14-‐15 AcFin which must address CNA findings include full implementaGon of at least one of the seven turnaround principles.
32
Priority Schools
• Lowest performance on Strive HI Index or automaGc trigger • Increased CAS & Deputy role Expected Ac8ons: • CASs may receive an addi4onal Complex Area EO to coordinate targeted improvement efforts.
• CAS chooses school improvement model: Victoria Bernhardt or School Synergy • Comprehensive needs assessment (CNA) to diagnose root causes for underperformance, using tools provided by the Office of the Deputy Superintendent. (Guidance & requirements provided by 9/1/13)
• Access to “array of services” • SY13-‐14 Priority Schools Fiscal Requirement Form: Based on results & CNA, develop 3 year plan with some acGviGes to be implemented & funded in the second semester of SY2013-‐14.
• Development of SY14-‐15 AcFin: Priority Schools will also begin work on their SY14-‐15 AcFin which must include full implementaGon of all of the seven turnaround principles.
• Background • Strive HI Performance System Basics • SY 2013-‐14 Results • School Improvement ImplementaGon
• Q&A
Today’s Webinar
33
Resources
SCHOOL REPORTS Ø Student Group Performance
Report (SY12-‐13) (statewide summary and by school: Provide detailed informaGon about how each school’s student groups’ performance meeGng math, reading, science, and retenGon or graduaGon rate targets.
Ø Strive HI: School Performance
Report: Demonstrates how each school’s results were converted into the 400 point Strive HI Index, and then into a classificaGon. This report can be found on each school’s individual school site. (Use the “Find Schools” tool.) This School Performance Report Overview walks through how to understand the report.
34
STATEWIDE DATA Ø Statewide Snapshot (SY12-‐13): Summary of statewide
student performance on the Strive HI Performance Index metrics of proficiency (in math, reading, and science), student growth over (in reading and math), readiness (chronic absenteeism, ACT scores, graduaGon rates, and college going rates) and achievement gap.
Ø School Classifica8on List (SY12-‐13): Lists how schools
have been classified in one of the 5 Strive HI Performance Steps.
Ø Strive HI Performance System: School
Distribu8on: This interacGve site allows users to explore schools’ performance relaGve to other schools.
KEY RESOURCES • Strive HI Performance System: Summary • Strive HI Performance System: FAQs • Fact Sheet: Strive HI vs NCLB • August 19, 2013: Webinar Recording & PPT