Introducing the New Iowa Assessments

transcript

The Iowa AssessmentsDates Locations Purposes

Introduction MayJune

AEAs Overview of changes in content, ordering, delivery, reporting

Content Overviews

August September

Webinars Details on content coverage, instructional linkages

Interpretation Overviews

October November

AEAsWebinars

Details on new reports, interpretations and use

Professional Development

Scheduled as needed

SchoolsDistricts

Strategies for using Iowa Assessment data to inform and change instruction

2011 by Iowa Testing Programs

Details

• All slides posted to Iowa Testing Programs website: https://www.education.uiowa.edu/itp/

• Q&A is underway and will be posted by early June

• Catherine-welch@uiowa.edu

Overview of New Iowa Assessments

New Iowa Assessments

• Forms E and F• All new items • All items written and reviewed by Iowa

educators• All items field tested on Iowa students• All items align to the Iowa Core and the

Common Core State Standards

Major Changes from Current Forms

• All Levels– Order of tests within the booklet; adjusted number of items– Use of color, page layouts– New configuration of composite scores

• Levels 5/6 to 8– Sources of Information has been eliminated

• Levels 9 to 14– Maps and Diagrams and Reference Materials have been eliminated*

– Mathematics (two separately timed parts) has replaced Math Concepts and Estimation and Math Problem Solving and Data Interpretation

• Levels 15 to 17/18– Spelling and Sources of Information* have been eliminated

*where appropriate content has been moved to Science or Social Studies

Implications for AYP/NCLB Testing (Levels 9 to 14)

Forms A and B• Reading Comprehension (25

+ 30 mins)• Science (30 mins)• Mathematics Concepts and

Estimation (25 + 5 mins)• Mathematics Problem

Solving and Data Interpretation (30 mins)

Forms E and F• Reading, Part 1 (30 mins)• Reading, Part 2 (30 mins)• Science (35 mins)• Mathematics, Part 1 (30

mins)• Mathematics, Part 2 (30

Implications for AYP/NCLB Testing (Levels 15 – 17/18)

Forms A and B• Reading (40 mins)• Science (40 mins)• Mathematics (40 mins)

Forms E and F• Reading (40 mins)• Science (40 mins)• Mathematics (40 mins)

Level 10 Example Score Composite Scores

Reading

Written Expression

Conventions of Writing

Vocabulary

ELA Total

Mathematics

Computation

Mathematics Total

Core Composite

Science

Social Studies

Complete Composite

Level 15 Example Score Composite Scores

Reading

Written Expression

Vocabulary

ELA Total

Mathematics

Computation

Mathematics Total

Core Composite

Science

Social Studies

Complete Composite

Level Content Essential Competencies

Conceptual Understanding

Extended Reasoning

9 Explicit Meaning

Implicit Meaning

Author’s Craft

Key Ideas

Vocabulary

10 Explicit Meaning

Implicit Meaning

Author’s Craft

Key Ideas

Vocabulary

Reading Specifications

Extended Reasoning

9 Appropriate Expression

Planning and Organization

Sentence Structure

Usage and Grammar

10 Appropriate Expression

Planning and Organization

Sentence Structure

Usage and Grammar

Written Expression Specifications

Extended Reasoning

9 Algebraic Patterns and Connections

Data, Probability and Statistics

Geometry

Measurement

Number Sense and Operations

10 Algebraic Patterns and Connections

Data, Probability and Statistics

Geometry

Measurement

Numbers Sense and Operations

Mathematics Specifications

Extended Reasoning

12 Earth Science

Life Science

Physical Science

13 Earth Science

Life Science

Physical Science

14 Earth Science

Life Science

Physical Science

Science Specifications

Extended Reasoning

9 Civics/Government

Economics

Geography

History

10 Civics/Government

Economics

Geography

History

11 Civics/Government

Economics

Geography

History

Social Studies Specifications

Level Test Essential Competencies

Extended Reasoning

All Spelling

All Capitalization

All Punctuation

All Vocabulary

All Computation

Skills Tests

Test Design and Development

Iowa Assessments – Forms E/F

• Standards-based instructional decisions

• Individual progress and growth for individuals

• Reporting group progress and growth

• Providing relative comparisons

• Providing empirical evidence that supports comparisons with NAEP, state results and international benchmarking measures

• Providing information that measures a continuum of achievement and tracks student progress from kindergarten to grade 12.

• Measuring achievement in core academic areas important for success in college including reading, language arts, mathematics and science.

Test Development Sources of Evidence

• Common Core State Standards• Leading state standards• International standards• Assessment data• Curriculum surveys• NAEP frameworks and specifications• Scholarly research in curriculum and assessment• Feedback from educators, researchers, professional organizations,

parents, students

Introduction to Reports

Reports to Support Uses of The Iowa Assessments

• Standards-based Interpretations• Accountability• Growth• College Readiness• Relative Comparisons

Standards-Based Interpretations

• Determine which standards have been mastered by the student, classroom or school

• Determine which standards need additional focus

• Compare progress among students

Accountability

Measure Growth

• Determine expected growthfor all students

• Set goals for a student basedon any starting place

• Measure student growth using vertically articulatedstandards

College Readiness

• Predict college readiness indicators• Help students plan the appropriate

coursework• Identify students

that are not “on track”

Relative Comparisons

• Determine student strengths with respect to the school, district, stateand nation

• Use relative comparisonsto evaluate programs, set expectations and determine interventions

Reports – Standard Service

• List of student scores• Summary reports• Student labels• Profile Narrative Report• Mathematics Performance Summary• Reading Performance Summary• Student data on CD

Reports – Optional

• Group Diagnostic Report• Group Item Response Record• Group Item Analysis• Individual/Group Performance Profile• Individual/Group Longitudinal Report• Individual/Group Common Core Standards

Domain Report• Group Narrative Summary

Scoring and Reporting

• Standard Service• List of Student Scores• Summary Reports

Implications for AYP Reporting

New Iowa AssessmentsImplications for Determination of Proficiency

• Background– Due to historical trend data available prior to

NCLB, the state’s workbook application requested continued flexibility of administration dates (fall, midyear or spring)

– The National Percentile Rank (NPR) metric allowed for a fixed cutscore while allowing for flexibility in administration dates

New Iowa AssessmentsImplications for Determination of Proficiency

• Assumptions for new forms– Schools will continue to administer their Iowa

Assessments to meet their scheduling requirements and to retain their historical trend data (fall, midyear or spring)

– New forms will be linked to previous forms and the equivalent of the 41st NPR from the 2000 norms will be identified on the Form E scale

– The expectations for proficiency remain the same from Forms A/B to Forms E/F

– Interpretation information will be made available to schools to transition to new forms

41 NPR = 259 Standard Score =21 Raw Score

Standard Score Scale

Current Proficiency Ranges –High School Reading Example

Testing Period Score Not Proficient Proficient

Fall Raw Score 1-20 21-44

Standard Score 165-258 259-369

NPR 1-40 41-99

Midyear Raw Score 1-21 22-44

NPR 1-40 41-99

Spring Raw Score 1-22 23-44

NPR 1-40 41-99

Proposed Link to Proficiency Ranges –High School Reading Example

Testing Period

Score Proficiency -- Current

Proficiency – New

Fall Raw Score 21-44 New assessments will be linked to

current assessments

Standard Score 259-369

NPR 41-99

Midyear Raw Score 22-44 Standard score scale will be

established using linking

relationship

Standard Score 262-369

NPR 41-99

Spring Raw Score 23-44 SS metric will be used for reporting

AYP Standard Score 263-374

NPR 41-992011 by Iowa Testing Programs

Reading Example

Summary

• Proficiency cutscores be reported in Standard Score metric

• Proficiency cutscores be available in August• Cutscores will be provided for:– Grades 3-12– Mathematics, Reading, Science– Fall, Midyear, Spring

Test Administration and Delivery

•Registering/Ordering Materials•Receiving Materials•Administering Assessments•Returning Materials•Scoring and Reporting

Registering and Ordering Materials

• Continue to use Online Tools to register and order materials

• Continue to use current process for Student Demographic Files (“barcodes”)

Online ToolsClosed from June 8 through August 15 for updates

Receiving Testing Materials

• Test Booklets, Directions for Administration and Answer Documents– Pearson will continue to pack and ship

• Interpretive materials– Available as pdfs at Online Tools

Administration Configurations for Iowa Assessments

Year Form Paper/Pencil Online Constructed Response(optional)

2011-2012 E Pilot Pilot

2012-2013 F Pilot

2013-2014 E

2014-2015 F

Accommodations

• Determined by IEP or 504 Plan• Should be consistent with state policy as

defined in the annual Department of Education letter on NCLB requirements

Calculator Use

• Calculators may be used on the Mathematics test (Parts 1 and 2)– Use of calculators should be guided by district

alignment of assessment with instruction– No separate calculator norms

• Calculators may not be used on the Computation test

Test Security• Assurance statement for school

administrators from the Iowa Department of Education

• Applies to test preparation and test administration practices

• Maintaining test security is a requirement for NCLB compliance and Title I funds

Returning Testing Materials

• Test Booklets and Answer Documents– Return materials to Pearson– Answer Documents must have barcodes to be

processed

• Order for Scoring Services (OSS)– Complete in ITP Online Tools

Scoring and Reporting

• CD-ROM – Shipped from Riverside to address provided on OSS– New record layout

• Printed Reports– Shipped from Pearson to address provided on OSS