Fall ELL Assessment Update

transcript

Fall ELL Assessment UpdateSeptember 09, 2013TETN Event #20783Student Assessment DivisionTexas Education Agency

Disclaimer These slides have been prepared by the

Student Assessment Division of the Texas Education Agency

If any slide is changed for local use, please remove the TEA footer at the bottom of the slide

TEA Fall ELL Assessment Update - DRAFT 2

Topics What’s New STAAR Spanish Highlights STAAR L TELPAS Key Steps to Take this Fall ELL Progress Measure

What’s New

What’s New at TEA? Assessments for students served by special

education and assessments for ELLs are now the responsibility of the Assessments for Special Populations Unit in the Student Assessment Division.

STAAR L Practice Sets Practice sets consist of approximately 25 items

for each STAAR L assessment To be posted in early 2014 Will be available in online format similar to

TELPAS so that students may experience the items as they will be presented in the operational administration.

STAAR L and SSI Beginning 2013–2014, 5th and 8th grade

students assessed with STAAR L in mathematics will be held to same SSI requirements for both mathematics and reading, including retesting, as students taking the general STAAR assessments

Special English I EOC ProvisionsTAC §101.1007

For ELLs who ― have been enrolled in U.S. schools 3 school years or less (5 or

less if qualifying unschooled asylee/refugee) and have not yet attained TELPAS advanced high reading rating

When enrolled in English I/ESOL I course, eligible ELL shall not be required to retake assessment each time it is administered if student passes course but does not meet standard

Rule to be posted for public comment in October for 30 days

Note: Students are not exempt from testing while in the course Provisions do not apply to English II

TELPAS Standards Review Committees comprised of ELL focus group

members and educators convened in August to review standards for grades 2–12 TELPAS reading tests

Cut scores adjusted for each proficiency level of each grade cluster test

These standards will be implemented spring 2014

Data Collection Changes Beginning in the 2013–2014 school year, students

must be enrolled for 60 consecutive school days for that year to count in years in U.S. schools calculations. Please note that this is not to be calculated retroactively.

Unschooled Asylee Refugee Continue as it has in the past

Students with Interrupted Formal Education (SIFE) SIFE and Limited Prior Schooling groups from 2012–2013

have been collapsed This data will be collected through the student data

upload Specific information will be included in the 2014 DCCM

TELPAS Administration Manuals

Spring test administration manuals will be split — TELPAS Rater Manual TELPAS Reading Test Administrator Manual

This should decrease the number of additional manuals ordered by districts

Spanish STAAR Highlights

STAAR Spanish Available for students in grades 3–5

Grades 3–5 reading and math Grade 4 writing

Grade 5 science Same grades and subjects are tested as

English

Who Takes STAAR Spanish? Students for whom Spanish version of STAAR

test is the most appropriate measure of academic progress

LPAC determines if STAAR Spanish is an appropriate assessment for ELLs and non-ELLs

STAAR– Increased Expectations

Focus is on the most essential curriculum: readiness standards

Content and skills are addressed at a greater depth and cognitive complexity

Rigor evident on the test as a whole individual test questions more inferential questions performance standards

Test Development Process20 Steps

Key Steps in STAAR Item Development

Annual Activities: Testing contractor develops items TEA reviews items and ensures items meet

quality assurance Educators review the items for appropriateness

before they are field tested (language, grade level, TEKS, free from bias, etc.)

Items are field tested Data of items is reviewed Items with solid data are included in the Item

Bank Tests are constructed from the Item Bank

How is STAAR Spanish Developed?

Follow the same guidelines as English item development

Reading and Writing The items and/or passages are developed

separately to account for cultural and linguistics differences.

Mathematics and Science Items from English development are

translated or transadapted into Spanish.

Transadaptation Process for STAAR Spanish Math and Science

Test items for STAAR Spanish are selected from the English development

Goal is to build tests for regular STAAR and STAAR Spanish using the same items if appropriate

Item writing and review process for transadapted items ensure that items in Spanish are linguistically and culturally appropriate and that they meet grade-level expectations

Every year bilingual educators review selected items for STAAR Spanish tests

Spanish/English Alignment on STAAR Tests

STAAR Spanish and regular STAAR both – follow the same item development

guidelines use the same blueprints adhere to same guidelines to build tests

in terms of range of content tested and cognitive complexity

expect same student performance

SpanishTotal Students

in 2013(Satisfactory)

LII-2013

(Advanced)

LIII-2013(Unsatisfactory)LI

Grade 03 READ 36,841 68% 15% 32%

Grade 04 READ 24,323 57% 11% 43%

Grade 04 WRIT 25,436 59% 3% 41%

Grade 05 READ 10,785 70% 10% 30%

Grade 03 MATH 19,024 59% 8% 41%

Grade 04 MATH 9,426 51% 7% 49%

Grade 05 MATH 3,606 44% 5% 56%

Grade 05 SCIENCE 5,370 41% 2% 59%

2013 STAAR Spanish Student Performance

Grade Subject 2012 2013 % Change

3 Math 56% 59% 3%

Reading 65% 68% 3%

4 Math 53% 51% -2%

Reading 60% 57% -3%

Writing 64% 59% -5%

5 Math* 49% 44% -5%

Reading* 69% 70% 1%

Science 41% 41% 0%

* Primary Administrations

STAAR Spanish Student PerformanceSpring 2012 and 2013

Key Elements for Success in STAAR

Understand the level of performance the TEKS require

Teach students the academic vocabulary Teach both readiness and supporting content

and skills Emphasize critical/inferential thinking, problem

solving, and application rather than isolated or memorized content and skills

Reinforce connections between different content areas (e.g., math and science, math and reading)

EXAMPLES OF TRANSADAPTED ITEMS

Grade 3 Math

Grade 3 Math – Spanish

Grade 5 Science

Grade 5 Science – Spanish

Grade 5 Math

Grade 5 Math – Spanish

Additional Information 2013 STAAR tests were released in August Grade 4 Writing Scoring Guides are

available on the Student Assessment website

Timeline for new mathematics curriculum

Timeline for New Mathematics TEKSSTAAR Grades 3–8

New TEKS adopted in April 2012 Convene advisory groups in 2013 New STAAR items are being developed to

address new TEKS in 2014 Implement new TEKS in 2014–2015 school

year New STAAR items are field-tested in 2014–

2015 school year New STAAR items are assessed in 2015–

2016 school year

STAAR L TEA Fall ELL Assessment Update - DRAFT 33

2013 STAAR L Administrations Online interface provided certain linguistic

accommodations for qualifying students: Clarification in English at the word or phrase level for

pre-determined words Words read aloud at the word-by-word level

35,000 students across the state were administered STAAR L across all administration in 2013

STAAR L Online Student Tutorial

Available early spring 2014 Minor updates to grades 3–8; Updates to EOC

version to address assessment changes from HB 5

Should be used to familiarize students with clarification and read aloud accommodations and standard TestNav tools

Test administration directions for operational STAAR L assessments will assume some familiarity with online interface

STAAR L Paper Administrations Paper test booklets (and ECGs as applicable)

will be approved by TEA in rare circumstances Accommodations that are not available in

TestNav Unavoidable technological problems that make

online testing impossible Other special situations (e.g., homebound

students, JJAEPs, etc.) Similar to TELPAS paper request process Detailed information about STAAR L paper

request process will be posted on Coordinator Manual Resources page at http://www.tea.state.tx.us/student.assessment/manuals/dccm

STAAR L Paper Administrations Student who was approved for a paper

administration in the spring but is retesting in December will not automatically receive paper materials

DTC should forward prior approval to TEA at ELL.tests@tea.state.tx.us so paper materials can be ordered from Pearson

ELLs with Parental Denials TAC §101.1005 (f)

Reminder: These students are not eligible for special ELL assessment, accommodation, or accountability provisions No testing in Spanish No linguistic accommodations during testing No English I EOC special provisions No unschooled asylee/refugee provisions

ELLs with parental denials may, however, use bilingual, ESL, or other allowable dictionaries as part of dictionary policy for STAAR reading and writing tests in grade 6 and up; under this policy, use of dictionaries not considered linguistic accommodation

TELPASTEA Fall ELL Assessment Update - DRAFT 39

TELPAS Administration

Assessment window for spring: March 17–April 9

Data verification window: April 10–11

TELPAS Spring DatesDate ActivityJan 9 Assembling and Verifying Grades 2–12 Writing Collections

course availableJan 24 End date for district coordinator training—all TELPAS

components Jan 27 Online basic training courses for new K–1 and 2–12 raters

availableJan 27 Supplemental support provider recorded Web-based training

availableFeb 7 End date for campus coordinator training—holistically assessed

componentsFeb 17 Calibration window opens for new and returning raters—first 2

setsFeb 17 End date for training raters on administration procedures

Feb 17 Earliest eligibility date for TELPAS writing samplesFeb 26 3rd and final calibration set available; supplemental training

beginsMar 17-Apr 9

TELPAS assessment windowTEA Fall ELL Assessment Update - DRAFT 41

Holistic Rating Training Resources2013–2014 training resources:

PowerPoint presentations (updated) Making the ELPS-TELPAS Connection: K–12 Overview Introductory Training on the PLDs (separate modules for

K–1 and 2–12) Grades 2–12 Writing Collection Overview Holistic Rating Training Requirements

Educator Guide to TELPAS

These resources will be available on the TELPAS Resources webpage at www.tea.state.tx.us/student.assessment/ell/telpas/

TELPAS Calibration – Spring 2012 and 2013

Grades K–1

Grade 2

Grades 3–5

Grades 6–8

Grades 9–12

2012 Total Successful Calibration

29205100%

15464100%

36054100%

1716099%

1498898%

2013 Total Successful Calibration

29689100%

15336100%

3641599%

1746099%

1545498%

2012 Successful after Set 1

2659991%

1386390%

3014283%

1323377%

996465%

2590187%

1146675%

2343264%

1365977%

1215477%

TELPAS Calibration – Spring 2012 and 2013

Grades K–

Grade 2

Grades 3–5

Grades 6–8

Grades 9–12

23658%

13369%

494814%

343320%

380425%

323411%

320321%

1012628%

242414%

270217%

12208%

28578%

13778%

2012 Unsuccessful

after Set 38

0%130%

2013 Unsuccessful

after Set 3470%

TELPAS Course Completions– Spring 2013

Course Completions

Assembling and Verifying Writing Collections

Grades K–1 Online Basic Training Course 17961Grades 2–12 Online Basic Training Course 22741

TELPAS Release There will be a full release of TELPAS

forms for all grade bands in 2014. These are to be released in an online

format to allow them to be seen in the TestNav environment, just as the students see the operational test.

Key Steps to Take This Fall

1. Conduct ELPS and TELPAS professional development sessions

Teachers are required to implement the ELPS and content area TEKS in instruction

District and campus administrators need working knowledge of ELPS and TELPAS

TELPAS familiarization training is good for future raters good way to reinforce use of PLDs all year

2. Help support teacher use of TELPAS results and ELPS PLDs to monitor and maximize learning of English

Beginning of year: Review ELLs’ past TELPAS results to see if

making steady progress in learning English

TELPAS confidential campus student rosters include 2 years of test scores how long student has been in U.S. schools

3. Help support LPAC use of TELPAS results and ELPS PLDs to monitor and maximize learning of English

LPAC meetings during school year: Use previous spring’s TELPAS results and

current year’s teacher input to gauge progress in English proficiency review and adjust linguistic

accommodations used in instruction plan for instructional interventions, if

necessary plan for linguistic accommodations

during state assessment TEA Fall ELL Assessment Update - DRAFT 50

Remember When implemented effectively in instruction,

linguistic accommodations accelerate learning of academic content and

English reduce length of time and degree to which

substantial linguistic accommodations needed

The ELPS, as measured by TELPAS, support

better learning of the TEKS, as measured by STAAR

ELL Progress MeasureTEA Fall ELL Assessment Update - DRAFT 52

What Will the TEXAS ELL Progress Measure Look Like?

ELL Progress Measure will: take into account the amount of time

needed to acquire English affects time needed to fully learn and demonstrate grade-level academic skills in English

be applied to all content areas Brochure with more information to be

posted this fall on the ELL Assessments webpage at http://www.tea.state.tx.us.student.assessment/ell

ELL Progress Measure Conceptual Model

TEA Fall ELL Assessment Update - DRAFT54

Satisfactory

Initial Years in Schools

Initial TELPAS Composite Proficiency

1Beginning and Extenuating

Circumstances5-Year Plan

1 Beginning 4-Year Plan1 Intermediate 3-Year Plan1 Advanced 2-Year Plan1 Advanced High 1-Year Plan

2Intermediate or Below

and Extenuating Circumstances

5-Year Plan

2 Intermediate or Below 4-Year Plan2 Advanced 3-Year Plan2 Advanced High 2-Year Plan

3Advanced or Below and

Extenuating Circumstances

5-Year Plan

3 Advanced or Below 4-Year Plan3 Advanced High 3-Year Plan

4Advanced High or Below

and Extenuating Circumstances

5-Year Plan

4 Any TELPAS Score 4-Year Plan

TEA Fall ELL Assessment Update - DRAFT

ELL Progress Measure Plan Expectation

5-Yr Plan

1st Year (E1)

2nd Year (E1)

3rd Year (E2)

4th Year (E3)

5th Year (LII)

4-Yr Plan

1st Year (E1)

2nd Year (E2)

3rd Year (E3)

4th Year (LII)

3-Yr Plan

1st Year (E2)

2nd Year (E3)

3rd Year (LII)

2-Yr Plan1st Year (E3)

2nd Year (LII)

1-Yr Plan 1st Year (LII)

TEA Fall ELL Assessment Update - DRAFT56

How Will the ELL Progress Measure be Used?

ELL Progress Measure will be incorporated into the 2014 state accountability reports Used to calculate accountability for

both Index 1 & 2 For detailed information regarding the

accountability system: http://ritter.tea.state.tx.us/perfreport/account/2013/20130328coe/pi_technical_5-23-13.pdf

Upcoming ELL Assessment Training

Annual ESC LPAC Assessment Training TETN October 8, 20139:00 a.m. – 12:00 p.m.Event #20784Open to ESCs only

Would you like to Participate in an Educator Committee?

Educators are invited to review items before they are field tested for:

STAAR (all programs) and TELPAS

Please go to the following link to nominateyourself or other educators: http://educator.force.com/TX

Actual Educators’ Comments

“This was a great learning experience”“I would love to participate again”“Fue una experiencia muy bonita y educativa”“The meeting was informative and made me feel like I made a difference”“Awesome experience!”“!Aprendí mucho!”“Excellent process and very beneficial!”“I really felt that I contributed with my opinions”

Contact Information

Go to www.tea.state.tx.us/student.assessment and click on ELL Assessments

Call the TEA Student Assessment Division at (512) 463-9536

Email us at ELL.tests@tea.state.tx.us

Fall ELL Assessment Update

Documents