Post on 05-Jul-2020
transcript
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Assessment Updates
January 12th, 2016
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
2
Computer‐Based Testing Updates
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Computer‐Based Testing The following Spring 2016 assessments are computer‐based:• Grades 8–10/Retake FSA ELA Writing• Grades 4–10 FSA ELA Reading
• Grade 4 Reading on computer for the first time
• Grades 5–8 FSA Mathematics• FSA EOC Assessments (Algebra 1, Geometry, Algebra 2)
• NGSSS EOC Assessments (Algebra 1 Retake, Biology 1, Civics, U.S. History)
• FCAT 2.0 Reading Retake3
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Computer‐Based TestingNew Student Interface shell for 2015–16• Universally accessible
• De‐emphasize navigation components by using lighter colors
• Item tools menu • All tools now consolidated in a single location under a menu button in the top right corner of the item.
4
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Computer‐Based TestingItem Response Recovery• For FSA ELA Writing, students may restore previously‐saved versions of their writing responses (during the same sitting)
• Responses save every two minutes• Tool is also available on open response items for ELA Reading and Mathematics assessments
5
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Computer‐Based Testing
FSA Session Transitions• Beginning with the Winter FSA EOCs, the process for moving from Session 1 to Session 2 includes the following changes:
• Students no longer have the option to click “Next” on the Session Review screen.
• Students will select “End Session” (to pause their tests) and test administrators will take no further action (other than to stop the session).
6
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Computer‐Based TestingListening Items• Grades 4–10 ELA Reading• Listening items may appear in either or both sessions of the ELA Reading tests
• Schools must provide headphones/earbuds, or students may use their own
• Headphones/earbuds should be plugged in and system settings checked (e.g., volume not muted) PRIOR to launching the secure browser
• American Sign Language (ASL) Videos will be available for eligible students taking CBT or PBT accommodated ELA Reading tests
• PBT accommodated students will have access to listening items (audio) on a computer through a secure site
7
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Computer‐Based Testing
• FDOE’s IT team is involved in overseeing all technology‐related processes and changes for AIR and Pearson.
• All system changes and improvements proposed by the contractor must be reviewed and approved by FDOE IT staff.
• FDOE will closely monitor testing to ensure that all systems work as expected, and to troubleshoot any issues that arise.
8
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
• FSA ELA Test Item Specifications—Slight revisions made to format and other minor details
• ELA Test Design Summary and Blueprint—Remove Grade 11; update Writing administration time to 120 minutes; update Technology‐Enhanced Item Descriptions for 2015–16; update language regarding the weighting of the ELA writing component; provide additional language regarding cognitive complexity
Additional Fall/Winter Updates
9
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
• Now available on the FSA Portal• Grade 4—Opinion; Grade 5—Informative; Grade 6—Informative; Grade 7—Argumentation; Grade 8—Informative; Grade 9—Argumentation; Grade 10—Informative
• Examples of student responses that represent various score‐point combinations
• Not intended to provide a full spectrum of examples• Do not necessarily represent highest or lowest examples of score points
• Passage sets are permissioned pieces and will be available via a hyperlink. (Printing is available via the URL.)
FSA ELA Writing Scoring Samplers
10
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
New FSA CBT Practice Tests• Now available on the FSA Portal • FSA practice tests available for each grade; replaces the Training Tests
• Online FSA Reading practice tests divided into two sessions to allow Test Administrators practice with logging students in and out of sessions
• SESSION LENGTH AND CONTENT ARE NOT REPRESENTATIVE OF THE OPERATIONAL ASSESSMENTS!
• CBT students required to participate in a practice test prior to testing
11
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
More FSA ELA Writing Practice Tests • Grade 4—Informative • Grade 5—Opinion• Grade 6—Informative• Grade 7—Argumentation • Grade 8—Informative• Grade 9—Argumentation• Grade 10—Informative
12
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Accommodations • For students with IEP or 504 plan that specifies this accommodation, Text‐to‐Speech (TTS) functionality will be available for all computer‐based FSA ELA Reading and Writing components.
• Passages/text sets are not read to students.• Items and options are read to students.• Prompt wording is read to students.
• American Sign Language (ASL) videos provided for listening items on the CBT and PBT ELA Reading tests (SPRING 2016)
• Students with PBT accommodations have access to the listening items via a secure interface.
13
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
FSA ELA Writing Condition Codes• Totally blank – no valid ELA score because student did not attempt to take the Writing portion of the ELA assessment
• If “0” reported = attempt to respond, but response earned condition code resulting in zero points out of 10 points possible
• Entire response written in a language other than English = 0
• Totally illegible, incomprehensible, insufficient, or copied from the sources with no original writing = 0
• Totally off topic = conventions domain is still scored, resulting in 0, 1, or 2 points
14
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
FSA Writing Reminders to Students•Read prompt first! •Read the passage set carefully, taking notes• Think about the purpose, audience, and task.
•Reread the prompt.•Plan the response.•Draft a response, read your draft, then revise and edit as needed.
15
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Handheld Calculators• FDOE provided an approved list of calculator models for the 2015–16 FSA assessments
• The list can be found in the following document on the FSA Portal: Calculator and Reference Sheet Policies for Florida Standards Assessments (FSA) Mathematics Assessments (shown on next slide as well)
• FDOE will review/approve additional models for the list once annually; however, districts may provide calculators if mathematics specialists in the district determine that they meet the published specifications (provided on later slides)
• Handheld calculators are OPTIONAL
16
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Updated Calculator PolicyThe following handheld scientific calculators are FDOE‐approved calculators for the 2015–16 school year.
• Texas Instruments TI‐30Xa• Casio fx‐260 solar• Casio fx‐82 solar• Sharp EL‐510R• Sharp EL‐510RN
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Updated Calculator Policy
• Schools may use calculators that are not on the approved list if district mathematics specialists determine they meet the required specifications.
• Students are not allowed to share calculators. Not every test item in the calculator section will require the use of a calculator.
• See the calculator and reference sheet policy on the portal.
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Handheld Calculators• Calculators are allowed for certain grades and subjects, and for only certain FSA sessions:
• Grades 7 and 8 Mathematics – SESSIONS 2 and 3 ONLY• FSA EOCs – SESSION 2 ONLY• NGSSS EOCs (Algebra 1 Retake, Biology 1) – 4‐function handheld
• Tests for students who have access to a calculator during non‐calculator sessions OR who have access to a calculator with prohibited functionalities must be invalidated
19
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Handheld Calculators
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Handheld Calculators – Prohibited Functionality
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
FSA Calculator SummaryAssessment Calculator Permitted
Grades 3 and 4 Mathematics
PBT‐ None
Grades 5 and 6 Mathematics
CBT ‐ None
Grades 7 and 8 Algebra 1Algebra 2Geometry
Computer based scientific calculator or hand‐heldscientific calculator
PBT: Paper Based Test CBT: Computer Based Test
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Practice Using the Online Calculator
The online scientific calculator for grades 7 and 8, and FSA EOCs can be found at:
http://fsassessments.org/resources/
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Sign up
Updated !
Click here for….
Accessing Resources in the FSA Portal
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Resources include: Equation editor item tutorial; FSA Mathematics policies and materials; FSA scientific calculator
Accessing Resources in the FSA Portal
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
26
Vince Verges
Assistant Deputy Commissioner, Accountability, Research, and Measurement
Vince.verges@fldoe.org
Questions About These Assessment Topics?
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Florida Standards Alternate Assessment
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Florida Standards Alternate Assessment
• IEP determines if:• The student has a significant cognitive disability• Even with appropriate and allowable instructional accommodations, assistive technology, or accessible instructional materials, the student requires modifications to grade level general state content standards
• The student requires direct instruction in academic areas of English language arts, mathematics, social studies, and science based on access points in order to acquire, generalize, and transfer skills across settings
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
2016 FSAA
• FSAA‐Performance Task• 99% of students meeting the criteria for needing instruction in Access Courses and being assessed on alternate achievement standards will participate in the performance task assessment
• FSAA‐Datafolio Trial Administration• designed to provide a second option for assessing students with the most significant cognitive disabilities for whom no formal mode of communication has been established.
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Blueprints and Alignment
Study Summer 2014
Items Developed Winter‐
Summer 2015
Item Review CommitteeJune 2015
andJuly 2015
Construct Test Forms and ProductionSummer‐Fall
2015
Administer TestSpring 2016
Performance Task: Milestone Timeline
• New assessment blueprints developed for Mathematics, ELA, and HS Biology
• New blueprints for ELA and Mathematics are aligned to the Florida Standards Access Points
• New blueprint for Biology based on NGSSS• Alignment study determined which items currently in bank are aligned to new blueprints
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Content Areas & Grades Assessed
• Civics EOC, US History EOC, and Algebra 2 portfolio introduced in 16‐17 • Operational field test for Writing in 2015‐16
Grade Level ELA Mathematics Science EOC
Algebra 1EOC
GeometryEOC
Biology
3 X X
4 X X
5 X X X
6 X X
7 X X
8 X X X
9 X
10 X
HS X X X
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Performance Task Overview• Accessibility for all students:
• Universal Design concepts• Tactile/Braille materials – contracted and non‐contracted• Gradual transition to Unified English Braille• Tactile materials for non‐braille readers• American Sign Language videos in 16‐17
• Administration Modes• Paper administration in 2016 • Transition to optional online computer based administration 2017
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Performance Task Design Overview
2016 Operational Field Test Design
• Goals of 2016 Operational Field Test• Test the item tiers and complexity assumptions• Establish the psychometric scale for future assessment
• Administration procedures will change• Each content will be separated into 2 or 3 sessions• Each session will follow different administration procedures
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
FSAA‐Datafolio Trial Administration
• FSAA—Datafolio Trial Administration• 120 participating teachers• 160 participating students
• Participating teachers will provide feedback throughout the process on:
• Training Materials, Samples and the Resource Guide (RG)
• Blueprints & Activity Choices• Participation Guidelines• Levels of Assistance• Scoring
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Important Dates ‐ Resources
ResourcesAccommodated Materials Ordering Window• Tactile Graphic Materials• Uncontracted Braille/Tactile Graphic Materials• Contracted Braille/Tactile Graphic Materials• One-Sided Response Booklet Ordering
September 21 – November 2, 2015
Train the Trainer Resources available on the Measured Progress FTP Site
November 2, 1015 – April 3, 2015Website (URL): https://transfer.measuredprogress.org
Administration manuals (TAMs) arrive in districts
November 18-19, 2015
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Important Dates ‐ Resources
ResourcesAdministration Training Modules and Support Documents posted to the FSAA Training Website
December 1, 2015
FSAA Online System’s Assessment Registration December 2 – 30, 2015
Print-based Practice Materials arrive in districts December 3 & 4, 2015Practice materials/tutorial available in the FSAA Online System
Mid- to late December 2015
Distribution of Object Exchange List and List ofCards and/or Strips and Teacher-Gathered Materials
No later than January 15, 2016
FSAA Online System training for AACs\Teachers January 20, 2016\February 1, 2016
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
FSAA Important Dates – Elementary and Middle
Elementary and Middle School (Grades 3-8)
Materials in Districts February 19 – 24, 2016
Student Testing Window February 29 – April 15, 2016
Student Responses Entered into Online System
No later than 11:59 PM EST on April 15, 2016
Return of Test Materials to PiedraData Services
No later than May 13, 2016
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
FSAA Important Dates – High School
High School ELA (Grades 9 & 10) , Algebra 1, Geometry, and Biology 1
Materials in Districts March 15 – 17, 2016 or March 21 – 23, 2016
Student Testing Window Upon receipt of materials through April 29, 2016
Student Responses Entered into Online System
No later than 11:59 PM EST on April 29, 2016
Return of Test Materials to Piedra Data Services
No later than May 13, 2016
Student Reports in districts Week of June 6, 2015
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Standard Setting and Reporting
• Standard setting will be conducted after the 2015‐16 administration.
• Reports will be in schools the week of June 6• Until standard setting is conducted and cut scores determined, student reports will include student raw score and percentile ranking per content area
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
FSAA Contact Information
Angela Nathaniel
angela.nathaniel@fldoe.org
(850)245‐0972
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Assessing Communication and Comprehension in English State‐to‐State for English Language Learners 2.0
(ACCESS for ELLs 2.0)
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
ACCESS for ELLs 2.0 Assessments• Based on the WIDA English Language Development Standards and are used to measure students’ progress in learning English.
Three components:
• Kindergarten ACCESS for ELLs, paper‐based assessment for Kindergarten
• ACCESS for ELLs 2.0 Paper, paper‐based assessment for Grades 1–12
• Alternate ACCESS for ELLs, paper‐based assessment for students in Grades 1–12 who have significant cognitive disabilities
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Important ResourcesFlorida’s WIDA webpage: https://www.wida.us/membership/states/Florida.aspx
• Florida‐specific information regarding the administration of the ACCESS for ELLs 2.0.
WIDA Secure Portal: www.wida.us/login.aspx• Online training modules and certification to district and school personnel for the ACCESS for ELLs 2.0.
WIDA Assessment Management System (WIDA AMS): www.wida‐ams.us• Administrative portal is to order test materials, edit student demographic information and accommodations, and download the Spring 2016 ACCESS for ELLs 2.0 Score Reports.
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Students to be TestedAll students enrolled in the district (grades K‐12) and classified ELL, with a code of “LY” on the 1st day of the test administration window, must be administered the ACCESS for ELLs 2.0.
Students with disabilities participate in the statewide assessment program by taking one of the following:
• ACCESS for ELLs 2.0 without accommodations,
• ACCESS for ELLs 2.0 with accommodations, or
• Alternate ACCESS for ELLs
Important: All determinations regarding participation and accommodations in the statewide assessment program must be documented in the student’s IEP or Section 504 Plan, and the student’s ELL Plan.
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
2015 – 2016 ACCESS for ELLs 2.0 ScheduleEvent Date
Delivery of 2016 Administration Materials January 15, 2016
2016 ACCESS for ELLs 2.0 Test Administration Window February 8, 2016 – March 25, 2016
Return of Materials February 9, 2016 – April 1, 2016
Pre‐Reporting Data Validation Window April 20, 2016 – April 26, 2016
Delivery of 2016 ACCESS for ELLs 2.0 Score Reports May 20, 2016
Post‐Reporting Data Validation Window May 23, 2016 – June 3, 2016
Final Data Available to State June 13, 2016
Bridge Study (conducted by Center for Applied Linguistics) June 14, 2016 – September 30, 2016
Standard Setting October 2016
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Test Overview• Kindergarten ACCESS for ELLs is an individually administered, adaptive assessment designed to take an average of 45 minutes per student.
• The Test Administrator scores all sections, including the Writing test, on site.
• ACCESS for ELLs 2.0 Paper is available in three tiered forms within a grade‐level cluster. Tier refers to the form of the test administered that roughly correspondences to a student’s position along the second language continuum: Tier A (Beginning); Tier B (Intermediate); or Tier C (Advanced).
• Grade‐Level Clusters: 1, 2, 3, 4–5, 6–8, 9–12• The Speaking section is individually administered and scored by the Test Administrator.
• The Listening, Reading, and Writing sections can be group‐administered.
• Alternate ACCESS for ELLs is an individually administered, semi‐adaptive assessment.
• Grade‐Level Clusters: 1–2, 3–5, 6–8, 9–12• The Test Administrator scores all sections.
.
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Training and Certification Requirements for Test Administrators via WIDA Secure PortalWIDA requires that all Test Administrators score 80% or higher on the appropriate quiz to become a certified Test Administrator. For some educators, one or more quizzes are required.
• Kindergarten ACCESS for ELLs: Kindergarten Training Module and take the Kindergarten quiz
• ACCESS for ELLs 2.0 Paper: Speaking Assessment Scoring Module and take the appropriate quiz
• There are five Speaking Assessment Scoring Modules that cover the grade‐level clusters (Grade 1, 2–3, 4–5, 6–8, 9–12), which takes approximately 90 minutes to complete all modules. These modules provide sample student responses for Test Administrators to practice scoring.
• The Speaking Quiz is provided in two grade‐level clusters (Grades 1–5 or 6–12).• Note: If a Test Administrator is not administering the Speaking section, the Speaking
quiz is not required.
• Alternate ACCESS for ELLs: Alternate ACCESS for ELLs Training Module and take the Alternate ACCESS for ELLs quiz
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
2016 ACCESS for ELLs 2.0 Regional Training Sessions
Location Assessment(s) Date
Tallahassee Kindergarten ACCESS for ELLsACCESS for ELLs 2.0 Paper December 14, 2015
Gainesville Kindergarten ACCESS for ELLsACCESS for ELLs 2.0 Paper December 15, 2015
Kissimmee Kindergarten ACCESS for ELLsACCESS for ELLs 2.0 Paper December 17, 2015
Kissimmee Alternate ACCESS for ELLs December 18, 2015
Boca Raton Kindergarten ACCESS for ELLsACCESS for ELLs 2.0 Paper January 11, 2016
Boca Raton Alternate ACCESS for ELLs January 12, 2016
Online TrainingKindergarten ACCESS for ELLs ACCESS for ELLs 2.0 PaperAlternate ACCESS for ELLs
October 5, 2015 – March 25, 2016
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
2016 ACCESS for ELLs 2.0 Score Reports• Individual Student Report (ISR): Scores are reported as Proficiency Levels and as Scale Scores of four individual language domains and combined domains.
• Note: For Alternate ACCESS for ELLs, the ISR is referred to as the Parent/Guardian Report.
• Student Roster Report: Lists individual scale scores along with their corresponding ELP levels for each grade according to grade‐level clusters.
• Teacher Report: Provided for Alternate ACCESS for ELLs.
• School Frequency Report: Shows the distribution of ELLs according to their language proficiency levels for each language domain and combination of domains in a stated grade of a specified school.
• District Frequency Report: Shows the distribution of ELLs according to their language proficiency levels for each language domain and combination of domains in a stated grade of a specified district.
Important: Districts are scheduled to receive one hardcopy of each score report on May 20, 2016, but additional reports can be printed via WIDA AMS.
www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.
Contact Information
Florida Department of Education Office of AssessmentSabrina Read, WIDA Florida ACCESS Test Trainer
• Telephone Number: 850‐245‐0843• Email: Sabrina.Read@fldoe.org