7EA ® Texas Education Agency
STAAR Interim Assessments Texas Assessment Conference
November 4, 2019
Texas Education Agency
Agenda
STAAR Interim Assessments Overview
Updates to the 2019–2020 School Year
2018–2019 Data
Stakeholder Feedback
Resources
Objective: Attendees will understand the purpose of STAARinterim assessments to inform student progress monitoring.
2
7EA ® Texas Education Agency
STAAR Interim Assessments Overview
3
Texas Education Agency
What are STAAR Interim Assessments?
The STAAR interim assessment is a free, optional online tool for school districts and open-enrollment charter schools that provides actionable data to help educators monitor progress and predict student performance on the State of Texas Assessments of Academic Readiness (STAAR®).
Interim assessments include test questions developed with Texas teachers and STAAR summative test questions from previous years.
Interim test questions have been field tested and are fully aligned to the Texas Essential Knowledge and Skills (TEKS).
4
Texas Education Agency
The STAAR Interim Assessment…
IS…. a way to monitor academic improvement, especially for students who
are consistently performing below grade-level. a tool to inform interventions for students or groups of students based
on predictions of STAAR performance. a benchmarking instrument at the campus or district level.
IS NOT…. an item bank intended for building classroom quizzes and assignments. a source of test questions for tutoring or small-group instruction. a classroom formative assessment tool designed to provide performance
data on specific student expectations
5
Texas Education Agency
#it ....... ....
Pulse Check
True/False: interim assessments are a tool designed to provide performance data on specific student expectations.
6
Texas Education Agency
Assessment Types: What’s the difference?
Classroom formative assessments measure student performance on specific student expectations to inform a teacher's instructional choices, immediate adjustments to unit plans, and changes to lessons. (Examples: class quizzes, exit tickets)
Interim assessments measure a student's understanding of a broader span ofstudent expectations to monitor progress, predict summative performance, and identify students for intervention. (Examples: benchmarks, STAAR interim assessments)
Summative assessments measure student mastery of a broader span of student expectations at the end of an instructional unit to determine the effectiveness of the program. (Examples: student portfolios, STAAR summative assessment)
7
7EA ® Texas Education Agency
Updates to the 2019–2020 School Year
8
Texas Education Agency
Updates for 2019–2020 (1/2)
New STAAR interim assessments will be available for science and social studies (in English and Spanish where applicable).
Unlike the TEKS for reading language arts (RLA) and math that tend to include similar skills over the grades but build in complexity, the science and social studies TEKS tend to contain discrete skills, facts, and concepts. Therefore, the Texas Education Agency (TEA) is planning to only offer one testing opportunity and recommend that it is administered after the majority of TEKS have been covered
9
Texas Education Agency
Updates for 2019–2020 (2/2)
Interim assessments for math and RLA will continue to be available, but there will only be one testing opportunity for grades 3 - 8 reading. This is because the RLA TEKS have been revised and only overlapping standards will be assessed in grades 3 - 8 at this time.
For the Spanish interim assessments, content and language supports in Spanish will now be available.
Refreshable braille is now offered for reading, English I, English II, grade 8 social studies, and U.S. History.
10
Texas Education Agency
Opportunity and Registration Dates for 2019-2020
First testing window (Opportunity 1)
Second testing window (Opportunity 2)
Registration opens: Assessment window: August 12, 2019 August 15, 2019 -
March 31, 2020
Registration opens: Assessment window: November 15, 2019 November 22, 2019 -
March 31, 2020
11
Texas Education Agency
Opportunity Availability by Subject
Two testing opportunities (available during Opportunities 1 and 2) • grades 3 - 8 mathematics • Spanish grades 3 - 5 mathematics • Algebra I • English I • English II
One testing opportunity (available during Opportunity 2 only) • grades 3 - 8 reading • Spanish grades 3 - 5 reading • grade 5 science (new) • Spanish grade 5 science (new) • grade 8 science (new) • grade 8 social studies (new) • Biology (new) • U.S. History (new)
12
Texas Education Agency
#it ....... ....
Pulse Check
Why are 3-8 RLA tests only offered for one testing opportunity this year?
Which opportunity are they offered in: opportunity 1 or opportunity 2?
13
7EA ® Texas Education Agency
2018–2019 Data
14
Texas Education Agency
••• ---
During the 2018–2019 school year…
~1.7M interim assessments were completed.
~600 districts participated in interim assessments.
868k unique testers submitted an interim assessment.
Average testing time was 1 hour 37 minutes total.
15
TEA® Education Agency Texas
l
■
Tota l Test Sub missions
0
10,000
20,000
30,000
40,000
45,852
.... . --- --'•• ........
: . i • .
• • . . . . . · ··: • • •
. .
•
• . . . • • ----:· e ·
• •
Chihuahua
'. )
•
· . . , ... , ... _, ;''··· -• ... \:•' '•··--• .. ,·~ .. ,_: }
)·
Coahuila de Zaragoza
• •
. •
Oklahoma
····•·."· .. '
'---.. • . \,>,,,-•-, -~,-- ~--· -~ ·:_ > ·---i __ "•
. •
. . -..· .. •· •.. . . . . . . ·; • ·-~ .•. .:; \i i . . .
• • • • • . -·~ ... . • .. . .~-: .. . ..
: ...... ·.• ·, : ~- "'-_ ... : ·- . . . •e:•;.·. .. • • . •; . • .• ~ ·.. . . . . . .. i • • • •• • •
.. Tex:..s
.....
··•.
• •
• . , •
• • .- c •
Interims have tripled in participation
0.4M
1.7M
0.0M
0.2M
0.4M
0.6M
0.8M
1.0M
1.2M
1.4M
1.6M
1.8M
Uni
que
Test
Subm
issi
ons
During the pilot year, interims were
only available by application
As interims became available to all districts, participation increased by 1.3M
Last year, interims became available to all
districts
2017-2018 (Pilot) 2018-2019
Actual
16
Texas Education Agency
New ~eXJCO
- - ------------------------------- -YSL ETA ISD ECTOR COUNTY ISD
Chihu~hua
-·,.,•-.. ,: ;·--·
Coahuila de Zaragoza
Nuevo Leon
·--
Texas
~-·-----------
Oklahoma
,-,,
,_ ••• '-: ,·'(~- .,_ ,,·c, •• _,:. -- •• - • ..__ • .--. ·• .... . ,. __ , ...
CARROLLTON-F.!111 BRANCH ISD
AUST IN ISD •
• __ / BROWNSVILLE 15D
Interims serve districts across Texas
Top 10 Districts Total
SPRING ISD 76,710 YSLETA ISD 66,441 ECTOR COUNTY ISD 55,493 PFLUGERVILLE ISD 52,631 BROWNSVILLE ISD 44,914 TOMBALL ISD 38,176 CARROLLTON-FARMERS BRANCH ISD 36,250 LUBBOCK ISD 35,847 MESQUITE ISD 35,239 GRAPEVINE-COLLEYVILLE ISD 28,086
17
Texas Education Agency
• ••• ---
2019–2020: Where are we at today?
252 districts statewide have registered for over 1 million interim assessments.
119 districts statewide have completed 80,961 interim assessments.
*Reflects data pulled on 11/05/2019
18
Texas Education Agency
#it ....... ....
Pulse Check
What percent of districts participated in STAAR interim assessments in 2018-2019?
About how long does it take to complete an entire interim assessment?
What happens if a student doesn’t finish in this amount of time?
19
Texas Education Agency
Stakeholder Feedback
20
Texas Education Agency
• •
• •
Positive feedback from stakeholders
“
Stakeholders believe interims help students practice for the online STAAR…
The students were able to practice using theonline system.
It is helpful for students that will take the STAAROnline test.
I think the format will help prepare them for theonline assessment.
I liked having this opportunity for students andfor them to experience an online testing format.
I think the tool is useful for students who will test online with embedded support. It gives them extended exposure to the testing platform.
…and provide useful data to better support students
“ It will help me to target specific students and identify trends.
For years, we have needed a system that canprovide real-time feedback that is aligned to statestandards and the STAAR exam. This systemprovides that. Thank you!
Teachers will DEFINITELY be able to use this for help in preparing students for the spring assessments
It provides a starting block upon which we canmonitor and support personal achievements. “ “
21
Texas Education Agency
I I -------------------------------------r---------------------r----
89% of DTCs and 63% of teachers believe interim assessments will improve summative outcomes
Respondents that agree with the statement: The interim assessment tool will improve outcomes on state
assessments
Total
Other district/campus staff
Classroom teacher/test administrator
Campus Testing Coordinator
District Testing Coordinator
TEA solution: Roles and Permissions as well as new Group-Rostering capabilities in TOMS have been updated to allow districts more flexibility in assigning teacher roles.
Lower teacher responses may be due to lack of access to data • “If teachers don't have access to results,
there is no way this will improve work of the students.”
• “I was not given access to the results and have not been able to use any data.”
0% 20% 40% 60% 80% 100%
22
Texas Education Agency
What can you do?
Follow the Best Practices Make sure teachers read the FAQ. Understand the purpose of interim
assessments in comparison to formatives. Strategically schedule the tests (November
and February). Confirm that students and systems are
ready for testing. Teachers should understand how to analyze
their students’ results and have access to do so. (Demo of teacher access to Online Reporting Suite.)
23
Texas Education Agency
Read the FAQ
The frequently asked questions document details the overview, purpose, and specifications of interim assessments.
24
Texas Education Agency
#it ....... ....
Pulse Check
How are the STAAR interim assessments administered?
Who do I need to call at TEA to get permission to participate?
Are the STAAR interim assessments a part of my school’s accountab ility?
25
Texas Education Agency
Strategically schedule the tests
Because STAAR summative predictability is based on the number of school instructional days, STAAR interims are more accurate when Opportunity 1 tests are administered in November and Opportunity 2 tests are administered in February.
*Schools and teachers should consider their local scope and sequence as well as when to test off-grade.
26
Texas Education Agency
Confirm that students and systems are ready for testing
Are students prepared for interims? Have district IT personnel updated the STAAR Online Testing Platform systems
and ensured that the bandwidth will support students testing? Are test tickets printed? Is school closed down or are students working on interims over time? Have you spoken with parents so that the data you share with them is more
meaningful? Are your students comfortable with the PNPs and Content and Language
Supports? Are your students comfortable with a computer at all?!
Secure Browser for SOTP 27
7EA ® Texas Education Agency
Resources
28
Texas Education Agency
Search TEA Texas Educat ion Agency
A- Z Index Contact Employment
m oOO CJ' About TEA Academics Finance & 6rants Reports& Data Student Testing &
Accountability
Home I Student Testing and Accountability I IH!ing I State of Texas Assessments of Academic
Readiness (STAAR)
State-Developed ST AAR Interim Assessments student Assessment Home I Assessment A-Z Directory I Contact Student Assessment
Overview of STAAR Interim Assessments Tne Texas Education Agency (TEA) tlas created optional online interim assessments ttlat align
to the Texas Essential Knowledge and Skills (TEKS). Test questions for the STMR Interim
Assessments are developed with Texas teachers and include some former STA.AR items. These
assessments will be available at no cost to districts and charter schools, and they are not tied to
accountability
Resources • STAAR Interim Assessments Frequently Asked Questions (PDF posted 08/14/19)
• Best Practices: How to Successfully Implement STAAR Interim Assessments (PDF posted
08/14/19) • Interim Assessments User Manual (posted 08/13/19)
• Assessment Blueprints: Grades 3-8 Mathematics, English I and English II , Algebra I
• (additional blueprints will be available before the second testing window)
Training Opportunities Training opportunities through webinars are available for the 2019-2020 Interim Assessments.
Materials and recordings will be available on the Texas Assessment website
El Sign Up for Updates TEA Correspondence
I'll') ~ Texas Educ.ators Texas Schools
Contact Information
For additional information, contact
Student Assessment Division
1701 North Congress Avenue
Room 3-122A
Austin, Texas 78701
(512) 463-9536
Q What are che STAAR ,men m ass.essmencs.1
The STAA.R interim asse5sments ii,.. offered iilS ii free optiol"WII online tool for sct\O districts and open-enrulmE>flt ch.irmr schoots. The tool pru..-ides Ktionable data to help educators monioor progress and Delp predict student p«fo ma nee on the St.ilte ofTe:w;asAssessments of Academic Re~(t,i_f!~S~_(SJAAR~L
ii1toolto1niormnterv@OllCOSforstudents based onpredlction5 of STAM performance
TEA, . f II , ... a .... ,~. Best Practices: How to Success u y
Implement STAAR Interim Assessments
Resources
More information about interims can be found on the STAAR Interim Assessments website…
…including Frequently Asked Questions (FAQ) and Best Practices
29
Texas Education Agency
Interim Assessments User Manual
Supplement to the STAAR Assessment Mana,gement System User's Guide
2019-2020 ADM INISTRATIONS
Revised 7/ 29/ 2019
St udent Assess ment Divisio n l exas Education Agency 1701 N. Congress Avenue Aust in, TX 78701-1494
l exas Assessment Suppo rt Center 855-333-7770 [email protected] rg [email protected]
Resources
Detailed instructions on registeringstudents, preparing and administering interim tests, and viewing and analyzing results areavailable through the Interim Assessments User Manual. Pro Tip: Section 8 Making Sense of
Interim Assessments is useful to teachers to orient users to data analysis. Data comes in three forms: District-Level Campus-Level Student-Level
30
Texas Education Agency
D,i str ict Overview Report~
.,........ --
1644
- ________ __:;,:......---r CIiek Students Tested to view a .,_ list of al l campuses with data.
+--- --- --- ----, Hover over status bar to display students tested and registered . ........... "'.~ Cl1ek Find to search for other organization or student reports.
Results are segmented into top and bottom quarters and middle half based on the scale Score Range at the bottom of the page. Cl/eking a segment displays schools Included in the range and the Mean Score for each.
- ---------------------+-Campus resu"s are shown from
·=
• ----~
lowest to highest mean score. Scroll over the bars to Identify campuses. Click a bar to view the campus report.
-------c1,c1<. a Probabilities pie icon to view a detailed pop-up repolt .
Campuses are listed from /OWeSt to highest Mean Score. Number of students who completed testing is a/s,o shown.
- - ---------------------------+-CIiek a campus link to view the campus reporl.
-- - ----- ----- -.:::;:;;:=-- ------- - ---- ~1 Cl/ck the Info Icon to view 4 ---=====::::;~ additional information about the
TEA
• Composite Image from multiple views. CIiek the PDF Icon to download a PDF file of the displayed report.
data displayed.
Resources
District-Level Data In the District Overview
report, districts can view the mean score for their district and results by campus as two reports: one report displaying graphs and the other displaying an alphabetical list of campuses.
31
Texas Education Agency
Potential Strategies
District-Level Data Review the campuses at the top and bottom quarter. Are there similarities among the campuses? Differences? Are there bright spots at certain campuses that should be further investigated to
determine best practices that could be shared with other campuses?
NOTE: As you are answering these questions pay close attention to the number of students taking the test at each campus. Comparisons may not be as strong with small student counts.
32
Texas Education Agency
I'
17
......................
-- -
:.!J~ ;;-..--r Click S· udents Tested to, view the Cam us s tucl m
.._--------- Performanc r:eport. Hove-r over status bar to -------T display stuclents ested nd reg s.tered. ---t- Click nd to search for oth r organJza km or tuden ,rep®.
~ -----t-Resurts are segmented into op nd bo tom quarters and middle,
ha , based cm the Scafe Scote Range shown st he botlorn o he page. Clicking a segment displays a !isl of students and mean- scores. Student resulls -r,e displayed from lowest to bi hest me n score. Scroll over lo view student scores_ Clic o vie v a• st nt report.
Student reslllls indude Soo,e.
:~------=---~~:2~-t~~~~~~~-~-~-~-~~:::Ll Probabilities, and performence by categorr for he, selected segment.
CJk a· s udenr lin ,to Ill ew -ndi ·dual s uden re.suit • --------------...::.........::.:.. ____ _::...__,_....,...._ ____ ___:: ~:::L Click e Info iaJn to ll>iew
addi oo,a,J information a.bout the da ,a displayed.
· Composite ima e fr,orn m I i,ple v·ews. Cftck the PDF Icon to download a PDF 1i · of t e displayed report.
Campus-Level Data In the District Overview
report, districts can view the mean score for their district and results by campus as two reports: one report displaying graphs and the other displaying an alphabetical list of campuses.
Resources
33
Texas Education Agency
Potential Strategies
Campus-Level Data Review the results within the campus. Look at the bottom quarter of the score range within the pie chart. Focus on similarities and/or differences between the students. Identifying results by levels (top quarter, bottom quarter, and middle half) allows
you to quickly identify students who are struggling with the content and studentswho are excelling with the content. This will allow you to develop strategies at each of the different levels.
Look at students that have a greater than 75% probability of obtaining Approaches. How are they doing at the reporting category level? Are there students who are performing well (have a high raw score) in a particular
reporting category? Are there students who have a scale score in the bottom quarter of the score range
and have a reporting category flagged as a strength? What is different or unique for these students in comparison to the other students
in the bottom quarter of the score range?
34
Texas Education Agency
Plubol . . &HI
" .
1650
1,--..~ 1
111~8 · 101:!1'UCorn!d
lllil'FIJ' 1' - "' Q ..... r I po ~ •I .... . -
l1• .., Q,,
s.,. ✓ Q,
n; i;,,,.,. )( Q,
11 S.1 F 1111 °""" ✓ Q,
C....,,..,.2:Aipltlrll t1p1:lt1~cana
a .. ltu b.1 ... 5,j. yl' q
S:t ... I I r• Q,
~, .., Q,
u ~lE .., Q,
Resources
Student-Level Data The reported interim assessment results areintended to answer these questions: What is the scale score that a student
would most likely achieve if he or shewould have taken the STAAR summative assessments at this time?
How likely is it that the student is going toachieve Approaches, Meets, and Masters grade level performance on thecorresponding STAAR summativeassessments in the coming spring 2020 primary administration?
Is the student relatively stronger or weaker in one reporting category?
How did the student do on each item?
35
Texas Education Agency
Potential Strategies
Student-Level Data Review the item-level data for students who took the same test form. Analyze the incorrect answers given to identify student misconceptions about a
concept. Group students who have similar misconceptions together to teach a lesson that
addresses those misconceptions. Go to the released forms or the formative item bank to find additional items covering
that same student expectation and/or concept and give them a few items as an exit ticket after the lesson.
36
Texas Education Agency
o,
--•
-•t-a-1M-•
•t-aNIM~•
TEii
.w o...... c.--11 o _,, olJllhcj ...... o-.,... ..
- ---•- ·-· 0...-,-•--....•c.--... ----~ l\"lWJIJ'l·171a•'J -----
~- --- =I _....,.
~ - ~-1- Across Years displays performance year-to-year.
Click the radio buttons to switch to a different subject or between district and campus mean and median.
Click selections under Score History to toggle their display. Click and drag the timeline bar (or use the scroll wheel) to adjust report date span.
Scroll over data points to display details (date, time, test type, and score).
Student scores are plotted in the Score graph. Adjusting report date span also changes the X-axis display accordingly to show years, months, days, or times between tests. Tests taken are listed below the Score graph, including summary information tor each test and links to the detailed student report for each test.
..+----:-:--.:r---i-r Score Range displays the student score on the test score range. Cilek an info icon to view test score range.
* Composite Image from multiple views. A PDF report with the data on this page is available for
download.
Off-grade tests are indicated by a pink bubble in the Score graph above and listed here with a pink Off grade test bubble. Scroll-over to view the student's enrolled grade.
Potential Strategies
Across Years view shows student test performance for a single subject across school years. View student scale score results
between opportunities to show improvement. Note where the student may have
taken a below-grade test. Note how the student performed
when that student re-attempted thetest. Follow the student's progression of
primary scores across years. Use the School Year tab to see and
focus on grade and subject results forjust one year at a time.
37
Texas Education Agency
*~ ~;~:ang Sutte Interim Longitudinal Bad to STAAR k~essment Management &,stem Logout
Interim Reports Slate TEA - Texas Education Agency District ETS UAT District #1 New Campus ETS UAT District 1 EL 5
ETS UAT District 1 EL 5 Report 2019-20 INT 3-8 Spring (SC, ss and Op2 MA. RE) Spanish
Viewing: Grade 5 Mathematics All Forms • 1· -Select Roster_ .. ...... ; j .................................. .~! .. O.g.m_9.9I~.P.0.!~~
Report Categories
Mean Score students by Roster(s)
1414 12 07~92 r-~-------~
Campus's Student Scores ; k•f H 1704
1604
1504
"' 1404 Q)
0 ()
rn 1304
1204
1104
1004
904
Campus
District
Students in Each Level ;
11
Mean Score Comparison
1414
1390
Potential Strategies
Use the “All Forms” tab available to view if a student who took a multi-stage adaptable test was routed to Easy, Medium, or Hard.
38
TEA® Education Agency Texas
--
j
. --·------
-
n-
·- .... ,
•-~-· _.,
• • • •
• • •
Potential Strategies
The School Year view shows student test performance for a single subjectduring the current school year.
Teachers can use multiple views in student-teacher conferences and conferences with parents.
39
Texas Education Agency
#it ....... ....
Pulse Check
Which assessment type measures performance of specific standards: classroom formatives or interims?
Which assessment type predicts summative performance: classroom formatives or interims?
40
7EA ® Texas Education Agency
You make an impact! THANK YOU!
Contact me at (512) 463-9536 [email protected]