TETN Session #18319 | November 14, 2013 | 1:00-3:00 p.m.

Texas Education Agency | Office of Assessment and Accountability Division of Performance ReportingShannon Housson, Director

State Accountability Update

Final Accountability Ratings

3

Final 2012-13 Accountability Ratings

Final accountability ratings were released on November 7, 2013, based on outcomes of 2013 appeals.

TEA received 85 appeals in 2013 compared to 202 in 2011.

Four of the 19 school district appeals (21 percent) and eleven of the 66 campus appeals (17 percent) were granted.

In addition to the rating changes due to granted appeals, the final ratings for two charter campuses and one charter district were revised due to data integrity issues.

Performance Reports

5

2012-13 Texas Academic Performance Reports (TAPR)

The 2012-13 TAPR will be released on the confidential Texas Education Agency Secure Environment (TEASE) website on November 21, 2013. District and campus TAPR will be posted to the TEA public website on December 5.

Email notifications will be sent to district superintendents and ESC directors.

The TEASE release provides the information that districts need to fulfill publishing and notification requirements for the TAPR.

The TAPR Guidelines will provide details about district responsibilities

6

2012-13 Texas Academic Performance Reports (TAPR)

Publishing

MUST publish: Performance and profile sections of district and campus TAPR reports

MAY publish: Glossary (English Glossary will be available on November 21. Spanish translation will be available in January 2014.)

MUST ADD and publish: o Campus performance objectives;o Report of violent or criminal incidents; and o Information from THECB about performance of students in

postsecondary institutions

7

2012-13 Texas Academic Performance Reports (TAPR)

District Responsibilities – Hearing for Public Discussion

Must be held within 90 calendar days after the November 21, 2013, TEASE release. District winter break days do not count towards the 90 days.

TAPR must be disseminated within 2 weeks after the hearing.

8

Reporting Changes in TAPR

Statutory requirements for indicators included in performance reports relatively unchanged from AEIS reports.

Significant differences from previous AEIS reports include:

o STAAR Proficiency and STAAR Progress Measures Resultso Inclusion of two new postsecondary indicatorso Replacement of financial profile section with direct link to 2011-12

Financial Actual Report for respective district or campus.

9

2012-13 School Report Card

In the 2011-12 school year, the reporting requirements for the School Report Card were suspended during the transition from TAKS to STAAR since no state ratings were assigned in 2012.

A newly-designed School Report Card for the 2012-13 school year will be released in January 2014.

10

Public Education Grant (PEG)

A statutorily-mandated program of school choice (TEC Ch. 29, Subchapter G,§29.201-§29.205) was not affected by changes made by the Texas Legislature in HB 3 in 2009.

Partially aligned with accountability ratings, but not fully aligned with the state system.

Statute requires districts to notify parents of the 2014-15 list by February 1, 2014.

11

Public Education Grant (PEG) Criteria

Released by End of

Applies to School Year

Identifying Criteria for a School to be Placed on Public Education Grant (PEG) List

2013 2014-2015

TAKS/STAAR passing rate ≤ 50% in two of the three preceding years (2011: TAKS: Grades 3-11, 2012: STAAR at TAKS Equivalency for grades 3-8, and TAKS at grade 10, 2013: STAAR (Index 1)

OR Rated Academically Unacceptable or Improvement Required in 2011 or 2013.

2014 2015-2016

STAAR passing rate ≤ 50% in two of the three preceding years (2012: STAAR at TAKS Equivalency for grades 3-8, and TAKS at grade 10, 2013: STAAR (Index 1), 2014: STAAR (Index 1)

OR Rated Improvement Required in 2013 or 2014.

2015 2016-2017

STAAR passing rate ≤ 50% in two of the three preceding years (STAAR (Index 1): 2013, 2014, 2015)

OR Rated or Improvement Required in 2013, 2014, or 2015.

2014 Accountability Development

13

2013 Accountability Ratings and Designations

Accountability Rating (Districts and Campuses)

Distinction Designations(Campuses Only)

Met Standard

Top 25%: Student Progress and/or

Academic Achievement: Reading/ELA and/or

Academic Achievement: Mathematics

Met Alternative Standard(assigned to charter operators and

alternative education campuses (AECs) evaluated under alternative

education provisions)

N/A

Improvement Required N/A

14

2014 Accountability Ratings and Designations

Accountability Rating (Districts and Campuses)

Distinction Designations(Districts and Campuses)

Met Standard

Postsecondary Readiness

Distinction Designations(Campuses Only)

Top 25%: Student Progress and/or

Top 25%: Closing Achievement Gaps and/or

Academic Achievement: Reading/ELA and/or

Academic Achievement: Mathematicsand/or

Academic Achievement: Scienceand/or

Academic Achievement: Social StudiesMet Alternative Standard

(assigned to charter operators and alternative education campuses (AECs) evaluated under alternative

education provisions)

N/A

Improvement Required N/A

2013 Performance Index Targets15

2013 Index Targets for Non-AEA Campuses and Districts

To receive a Met Standard rating, non-AEA campuses and districts had to meet the following accountability targets on all indexes for which they had performance data in 2013.

Performance Index Campuses Districts

Index 1: Student Achievement 50 50

Index 2: Student Progress

High Schools: 17

21Middle Schools: 29

Elementary Schools: 30

Index 3: Closing Performance Gaps 55 55

Index 4: Postsecondary Readiness 75 75

16

2014 Performance Index Targets

2014 Index Targets for Non-AEA Campuses and Districts

The 2014 Index targets will be finalized in spring 2014 by the commissioner based on recommendations from accountability advisory groups that will convene in early winter 2013.

Performance Index Campuses Districts

Index 1: Student Achievement TBD TBD

Index 2: Student Progress

High Schools: TBD

TBDMiddle Schools: TBD

Elem. Schools: TBD

Index 3: Closing Performance Gaps TBD TBD

Index 4: Postsecondary Readiness TBD TBD

2013 Index 1: Student Achievement

17

Index 1 Student Achievement provides an overview of student performance based on satisfactory student achievement across all subjects for all students.

Subjects: Combined over Reading, Mathematics, Writing, Science, and Social Studies.Student Groups: All Students onlyPerformance Standards: Phase-in 1 Level II (Satisfactory)

18

2014 Index 1: Student Achievement

Index 1 Student Achievement provides an overview of student performance based on satisfactory student achievement across all subjects for all students.

Subjects: Combined over Reading, Mathematics, Writing, Science, and Social Studies.

Student Groups: All Students only

Performance Standards: Phase-in 1 Level II (Satisfactory)

STAAR EOC Assessments: Algebra I, Biology, English I, English II, U.S. History

19

Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners.

By Subject Area: Reading, Mathematics, and Writing for available grades.

Credit based on weighted performance:

o One point credit given for each percentage of students at the Met growth expectations level.

o Two point credit given for each percentage of students at the Exceeded growth expectations level.

2013 Index 2: Student Progress

20

2014 Index 2: Student Progress

Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners.

By Subject Area: Reading, Mathematics, and Writing for available grades.

Credit based on weighted performance:

One point credit given for each percentage of students at the Met growth expectations level.

Two point credit given for each percentage of students at the Exceeded growth expectations level.

Additional Progress Measures Included in 2014: STAAR-M, STAAR-Alt, and the new ELL Progress Measure.

21

2014 Index 2: Student Progress

Enhancements to STAAR Progress Measure for 2013-14 posted on Student Assessment website on October 1 under STAAR General Resources heading at following link:

http://www.tea.state.tx.us/student.assessment/staar/

Additional STAAR Progress Measure results that will be included in 2014 accountability include: o Students tested on STAAR Mo Students tested on STAAR-Alto Students who do not test in consecutive grades/courses from

year to year in a single content areao Students who move from English to Spanish and Spanish to

English in mathematics only.o Students who take an EOC test in Summer 2013 or Fall 2013 for

the first time.

22

2014 Index 2: Student Progress

New ELL Progress Measures results will be reported in spring 2014 and included in 2014 accountability results.

The latest information on the ELL Progress Measure was posted on Student Assessment website on October 22 under STAAR General Resources heading at following link:

http://www.tea.state.tx.us/student.assessment/staar/

Accountability advisory groups will make recommendations on the appropriate inclusion of the ELL Progress Measure results in the respective performance indexes.

23

Credit based on STAAR performance:o Phase-in 1 Level II satisfactory performance

One point for each percent of students at the phase-in 1 Level II satisfactory performance standard.

2013 Index 3: Closing Performance Gaps

Index 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two lowest performing race/ethnicity student groups.

24

2014 Index 3: Closing Performance Gaps

By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies.

Student Groupso Socioeconomic: Economically Disadvantagedo Lowest Performing Race/Ethnicity: The two lowest performing race/

ethnicity student groups on the campus or district, based on 2013 assessment results reported on 2013 Index 1: Student Achievement Data Table released on August 8, 2013

25

2014 Index 3: Closing Performance Gaps

Index 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two lowest performing race/ethnicity student groups.

Credit based on STAAR weighted performance:

o Phase-in 1 Level II satisfactory performance One point for each percent of students at the phase-in 1 Level II satisfactory performance standard.

o Level III advanced performance Two points for each percent of students at the Level III advanced performance standard.

2013 Index 4: Postsecondary Readiness

26

Index 4: Postsecondary Readiness emphasizes the importance for students

to receive a high school diploma that provides them with the foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and middle schools in preparing students for high school.

Graduation Score: Combined performance across the graduation and dropout rates for:oGrade 9-12 Four-Year Graduation Rate for All Students and all student groups OR

oGrade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index.

RHSP/DAP Graduates for All Students and race/ethnicity student groups

27

2014 Index 4: Postsecondary Readiness

Index 4: Postsecondary Readiness emphasizes the importance for students to receive a high school diploma that provides them with the foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and middle schools in preparing students for high school.

Graduation Score is the combined performance across the graduation and dropout rates for:

o Grade 9-12 Four-Year Graduation Rate for All Students and all student groups OR

o Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index.

RHSP/DAP Graduates for All Students and race/ethnicity student groups

STAAR Score: STAAR Percent Met Final Level II on One or More Tests for All Students and race/ethnicity student groups

28

2014 Index 4: Postsecondary Readiness

Additional Indicators Required by House Bill 5 (83rd Texas Legislature, 2013)

Texas Success Initiative (TSI) college readiness benchmarks

Number of students who earn postsecondary credit required for the foundation high school program, an associate’s degree, or an industry certification.

Accountability advisory groups will develop recommendations on how and when these indicators will be evaluated in 2014 and beyond.

Distinction Designations

30

2013 Distinction Designations

Campus Top Twenty-Five Percent Distinction Designations

o Top 25% Student Progress. Based on performance on Index 2: Student Progress. Campuses in the top quartile of their campus comparison group in performance on Index 2 earn this distinction designation.

Academic Achievement Distinction Designations o Reading/ELA o Mathematics

31

2014 Distinction Designations

Campus Top Twenty-Five Percent Distinction Designations

o Top 25% Student Progress. Based on performance on Index 2: Student Progress. Campuses in the top quartile of their campus comparison group in performance on Index 2 earn this distinction designation.

o Top 25% Closing Achievement Gaps. Based on performance on Index 3: Closing Performance Gaps. Campuses in the top quartile of their campus comparison group in performance on Index 3 earn this distinction designation.

Academic Achievement Distinction Designations o Reading/ELA o Mathematicso Scienceo Social Studies

32

2014 Distinction Designations

New Academic Achievement Distinction Designations (AADD) Indicators in Reading/ELA and Mathematics Grade 10 (PSAT and PLAN) and Grade 11 (PSAT) Participation.

PSAT Grade 10 and Grade 11 Performance Indicators: ELA and Mathematics.

PLAN Grade 10 Performance Indicators: English and Mathematics.

33

2014 Distinction Designations

New Districts and Campus Postsecondary Readiness Distinction Designations

House Bill (HB) 5 (83rd Texas Legislature, 2013) expanded distinction designations

to both districts and campuses for outstanding performance in attainment of postsecondary readiness. Criteria for this distinction must include indicators based on percentages of students who:

o Achieve college-readiness standards on STAAR; o Earn nationally or internationally recognized business or industry

certification;o Complete a coherent sequence of CTE courses;o Complete dual credit courses or a postsecondary course for local credit;o Achieve college readiness standards on SAT, ACT, PSAT, or ACT-PLAN; ando Earn college credit based on performance on AP/IB examinations.

Legislative Updates

35

2014 Accountability Development Topics Related to House Bill 5

Expands the postsecondary readiness indicators evaluated for state accountability to include Texas Success Initiative (TSI) college readiness benchmarks and the number of students who earn postsecondary credit required for the foundation high school program, an associate’s degree, or an industry certification.

Expands distinction designations to districts and campuses for outstanding performance in attainment of postsecondary readiness.

Beginning in the 2016-17 school year, requires TEA to assign ratings of A, B, C, D, or F to districts, and ratings of exemplary, recognized, acceptable, or unacceptable to campuses.

36

HB 5 – Community and Student Engagement (TEC Section 39.0545)

Beginning with the 2013-14 school year, districts will be required to evaluate community and student engagement compliance for the district

and each of their campuses and assign a rating. The ratings are required to be reported to TEA by August 8, 2014.

Statute requires that districts assign a performance rating of exemplary, recognized, acceptable, or unacceptable based on locally-determined criteria. These performance ratings must be based on criteria developed by a local committee. Statute does not permit the Agency to determine the criteria that can be used for these evaluations.

TEA is developing a proposal to collect the locally-determined ratings in PEIMS Submission 3 for the 2013-14 school year. TEA is also required to report these ratings publicly by October 1, 2014.

37

Senate Bill (SB) 1538

New requirements that require the evaluation of dropout recovery schools that are defined as:

o serves students in grades 9-12; o has enrollment of which at least 50 percent of the students are

17 years of age or older as of September 1 of the school year; ando meets the eligibility requirements for and is registered under

alternative education accountability procedures adopted by the commissioner.

Further modifications to the applicable indexes will be reviewed with the accountability advisory groups in fall 2013 to ensure all SB 1538 requirements are met.

State and Federal System Safeguards

39

2013 State Accountability System Safeguards

Systems safeguards are designed to evaluate the disaggregated performance results of the state accountability system to ensure that poor performance in one area or one student group is not masked in the performance index.

Performance rates for system safeguards are calculated from the assessment results used to calculate performance rates in Index 1.

Targets for the disaggregated results are:o STAAR performance target corresponds to Index 1 (50%);o STAAR participation target required by federal accountability (95%);o Federal graduation rate targets and improvement calculations for

4-year rate (78%) and 5-year rate (83%); ando Federal limit on use of alternate assessments (1% and 2%).

40

2013 State Accountability System Safeguards

Participation Rates differ from prior federal accountability participation rate criteria:

o For end of course (EOC) tests , the best test for each course within a subject is selected first then counted in participation;

o Multiple EOC tests within a subject are included multiple times;o Test score code “O” are considered non-participants; and

o Students tested and scored on TELPAS are credited as participants for Reading only.

Performance rates for system safeguards are calculated from the assessment results used to calculate performance rates in Index 1.

2014 targets for the state accountability system safeguard disaggregated results will be finalized in spring 2014.

41

2013 Federal Accountability System Safeguards

November 1, 2013, Correspondence from the Agency explaining the approved USDE Flexibility Waiver was posted at:

http://www.tea.state.tx.us/index4.aspx?id=25769808031

Federal AYP results are no longer evaluated.

Detailed information on the 2013 System Safeguard information used for the identification of Focus and Priority Schools will be available soon from the Division of Program Monitoring and Interventions.

As detailed in the currently approved waiver:o Performance rates for system safeguards are calculated from the

assessment results used to calculate performance rates in Index 1.

42

2013 Federal Accountability System Safeguards

Also detailed in the currently approved waiver:o Performance, Participation, and Graduation Rates are evaluated for:

o Only seven student groups All, African American, Hispanic, and White, Economically Disadvantaged, Special Education and ELL students;

o Reading and Mathematics subjects only.

Targets or Annual Measureable Achievement Objectives (AMOs) approved by the USDE for the disaggregated federal system safeguards results are:

o STAAR performance target approved (75%);o STAAR participation target required by federal accountability (95%);o Federal graduation rate targets and improvement calculations for

4-year rate (78%) and 5-year rate (83%); ando Federal limit on use of alternate assessments (1% and 2%).

43

2014 Accountability Development Topics Related to House Bill 5 and Federal Requirements USDE federal accountability policy requires states to assess students

in mathematics at the high school level.

HB 5 reduces end-of-course mathematics assessments to Algebra I, which may also be administered to middle school students. About 80,000 students take Algebra I in middle school. Currently, these students take no other mathematics assessment in high school.

The Commissioner submitted a request to USDE on November 6, 2013, to amend the approved Flexibility Waiver. If approved, test results of students taking Algebra I at the middle school level will be attributed to the middle school.

44

Advisory Committees

December 2013 to early spring 2014 – Accountability advisory groups convene to develop recommendations to Commissioner for accountability ratings criteria and labels for 2014 and beyond and performance index targets for 2014, 2015, and 2016 accountability ratings.

Spring 2014 – Commissioner announces accountability ratings criteria for 2014 and beyond and final 2014 targets, preliminary 2015 targets, and preview 2016 targets.

45

Calendar

November 7, 2013 Final accountability ratings released based on outcomes of 2013 appeals.

November 21, 20132013 Texas Academic Performance Reports (TAPR) released on TEASE

(formerly known as Academic Excellence Indicator System)

Early December 2013 2013 Texas Academic Performance Reports released on TEA website

Mid December 2013 Public Education Grant (PEG) list posted on public website

January 2014

Expanded TAPR Results posted on TEASE and public website

2013 School Report Cards posted on public website

2013 Federal Report Cards for Texas Public Schools posted on public website

(formerly known as NCLB Report Cards)

Resources

2013 Accountability Manualhttp://ritter.tea.state.tx.us/perfreport/account/2013/index.html

Frequently Asked Questions (FAQs)http://ritter.tea.state.tx.us/perfreport/account/2013/faq.html

STAAR Progress Measure Documentshttp://www.tea.state.tx.us/student.assessment/staar/

Performance Reporting Home Pagehttp://www.tea.state.tx.us/perfreport

Performance Report Telephone Number(512) 463-9704

46