State Science AssessmentWERA Conference, December 2015

Agenda

State testing for the next few years Development of the next generation of science

assessments

Science Assessment Staff• Dawn Cope—Science Assessment Lead

• dawn.cope@k12.wa.us

• Kara Todd—Science Assessment Specialist• kara.todd@k12.wa.us

• Cinda Parton—Director of Assessment Development• cinda.parton@k12.wa.us

• Jessica Cole—Administrative Assistant• jessica.cole@k12.wa.us

General Science email account:

science@k12.wa.us

Stay informed and get involved

Sign up for GovDelivery messages Go to the Subscribe page for GovDelivery. Enter your

email address. On the Subscriptions page, select Content Areas > Science, then select the grade band(s) for which you would like to receive information.

Email from “OSPI GovDelivery” or just “OSPI” (waopsi@public.govdelivery.com)

Check calendar posted at: http://www.k12.wa.us/Science/ProfDevelopment.aspx

State testing for the next few years…

Assessment requirements: Federal and state law require that our state’s science

standards must be assessed: Once in elementary school (we give Measurements of

Student Progress in 5th grade) Once in middle school (we give MSP in 8th grade) Once in high school (we give Biology End-of-Course exam)

We will continue to give these assessments through spring 2017 at least Items are written to the 2009 science standards Scored and equated the same way as we have since 2011

(MSP) and 2012 (Bio EOC)

Scores—percent passing

  5th MSP 8th MSPBio EOC-

10th

2011 55.6 61.6 —

2012 66.2 66.3 61.3

2013 66.6 64.8 71.5

2014 66.8 67.2 77.7

2015 63.4 60.7 72.5

Measurements of Student Progress Online testing encouraged Same engine as the Smarter Balanced ELA and Math

assessments Paper/pencil testing still available Resources available:

Teacher Resource page: http://www.k12.wa.us/Science/EducatorResources.aspx

Updates documents—practice questions Scoring Training videos—how some short-answer questions are scored

Online Training test: Interactive Practice using features of the test engine http://wa.portal.airast.org/training-tests/

Biology EOC Graduation Requirement Legislative intent regarding high school science

assessment 2013 Engrossed House Bill 1450 2015 Senate Bill 6145

Classes of 2017 and beyond must pass the state science exam to graduateBiology EOC until a comprehensive NGSS-based test is

administered (Spring 2018)Transition period where either the Biology EOC or the

high school NGSS assessment could be used for graduation purposes, much like math’s transition to Smarter Balanced assessments

Biology EOC

Paper/pencil Resources available:

Teacher Resource page: http://www.k12.wa.us/Science/EducatorResources.aspx

Updates documents—practice questions Scoring Training videos—how some short-answer

questions are scored

Who Takes the Biology EOC? Winter (January/February) 2016

Students (class of 2017+) who took EOC previously and did not meet standard

Students (class of 2017+) completing a biology course mid-year

Spring 2016 Any student (class of 2017+) enrolled in a high school

level biology course All 10th graders who have not yet met standard

Meets the high school science testing requirement of NCLB

Next Generation of Science AssessmentDevelopment and Implementation

New Learning Standards = New Assessment Next Generation Science Standards (NGSS) adopted

as our state science learning standards in October of 2013

Official name:

Washington State 2013 K-12 Science Learning Standards

Current assessment timeline—At the earliest…Fall 2015: begin development of

assessmentSpring 2016: limited pilot testSpring 2017: full pilot testSpring 2018: operational test for entire

state

Major assessment shifts…

All the tested grade levels (5, 8, and high school) will be tested onlineMore item types available online

Science and Engineering Practices (SEPs) embedded throughout

Comprehensive for high school:all of the domains—PS, LS, ESS, ETS—will be tested

Grade 5 test to assess 3rd, 4th, and 5th grade standards

Steps to building a new assessment: Develop item specifications from standards (began

winter 2015)

Determine the test map/blueprint (begin summer 2016)

Develop test items (began fall 2015)

Develop Achievement Level Descriptors (ALDs) from standards (begin summer 2016)

Administer an operational test (spring 2018)

Set achievement levels (Standard Setting) (summer 2018)

Test Item Development Cluster Development*—October 2015, March 2016

Content Review*—December 2015, July 2016

Bias/Sensitivity Review—December 2015, July 2016

Pilot Testing—Spring 2016, Spring 2017

Pilot Range Finding*—Summer 2016, Summer 2017

Content Review with Data*—Fall 2016, Fall 2017

*Educator Committees

Item Specifications Provide guidance for writing items that match the standards. Provide information about allowable item types, vocabulary, etc.

Contributing documents: A Framework for K-12 Science Education NRC Report: Developing Assessments for the NGSS Washington State 2013 K-12 Science Learning Standards (NGSS) Evidence Statements (from Achieve) Assessment Framework (from SAIC) Item Specifications Guidelines (from SAIC)

Washington Item Specifications Will be revised through stages of the assessment development

cycle First published by fall 2017, updated annually

Science Assessment Item Collaborative SAIC—January 2015 Led by CCSSO, Achieve, and WestEd Membership includes 14 states and the Virgin

Islands Arkansas California Connecticut Delaware Hawaii Illinois Kentucky Maryland

Massachusetts Michigan Nevada Oregon Washington West Virginia Virgin Islands

SAIC Products Assessment Framework

Provides a range of options and accompanying rationales for the development of the NGSS-aligned items for summative assessments

Item Specification Guidelines Companion document to the Assessment Framework Focuses on how the content of the NGSS will be assessed, by

articulating the NGSS-to-Item cluster correlations

Prototype Items Initial example for measuring three-dimensional science learning Can support states in guiding their test vendors with the design

and development of NGSS-aligned assessments’ Can promote dialogue about a large-scale assessment for

measuring the NGSS

SAIC Products available from CCSSO CCSSO Website

• Science Assessment Item Collaborative Assessment Framework

• Science Assessment Item Collaborative Item Specifications Guidelines

• Science Assessment Item Collaborative Grade 5 Item Cluster Prototype

Center on Standards and Assessment Implementation• http://www.csai-online.org/spotlight/science-asse

ssment-item-collaborative

Grade 5 Item Cluster Prototype

NGSS Science Standard

Bundled Performance Expectations

Item Cluster Overview

Evidence Statements

• Development led by Achieve Inc.

• Completed for all grade levels and grade bands

• Expand the initial PE structure to include specific, observable components of student performance 

• Intended to be used by educators and assessors to determine a student’s level of mastery for a given PE

• http://www.nextgenscience.org/resources

Evidence Statement

Questions?