ReadiStep Roll-out Workshop

TX

Part 1: Description of the assessment

1. Description of ReadiStep assessment

2. Background on the development of the ReadiStep

assessment

3. Score reporting

Part 2: Administration

1. How to prepare for administration

2. Testing administration procedures

3. What to do after administration

Agenda

Part 1.1

Description of the ReadiStep assessment

What is ReadiStep?

Middle school assessment measuring

reading, writing, and math skills

Content based on theCollege Board Standards

for College Success™

Provides early feedbackon students’ academic

progress

Helps students identify and improve the skills

they need to be ready for high school and college

Benefits of ReadiStep

• Gives insight into students’ academic progress• Helps students create a roadmap for successEarly Feedback

• Identify students for more challenging courses

• Help students make smarter choicesCourse Selection

• Identify areas where students excel

• Identify skills that require further development Skills Identification

•Helps create a college-going culture•Students realize that college is within their reach

College Readiness

ReadiStep is user-friendly and familiar

• Critical Reading

• Writing Skills

• MathematicsThree Sections

• Four options

• Rights-only scoring: students attempt all questions

Multiple Choice

• Paper booklet

• Scannable registration form/answer sheetPaper and Pencil

ReadiStep is comprised of three tests

• Sentence completion items: 30%

• Passage-based items: 70%Critical Reading

• Improving Sentences items: 56%

• Identifying Sentence Errors items: 33%

• Improving Paragraphs: 11%Writing Skills

• Number and Operations items: 35%

• Algebra items: 25%

• Geometry and measurement items: 25%

• Data, statistics, probability: 15%

Mathematics

Items on the Critical Reading test

Items on the Writing Skills test

Items on the Mathematic s test

C

Scoring is the same for each of the tests

• Correct answer = 1 point

• Wrong answer or omitted question = 0 pointsRaw Scores

• Scores on a 2 to 8 scale for Critical Reading, Writing Skills and Mathematics

• Increment between score points is 0.2Scale Scores

• Rights-only scoring does not penalize students for incorrect answers

• Students attempt all questions

Rights-only Scoring

Part 1.2

Background on Readistep’s Development

Features of the ReadiStep assessment

• Mathematics and Statistics College Board Standards for College Success™

• English Language Arts College Board Standards for College Success™

Standards-Based

• Representative normative samples by gender, race/ethnicity, region, community type and socioeconomic status

Nationally Representative

Sample

• ReadiStep has strong reliability and validity

• Appropriate inferences from test results can be made with confidence

Strong Technical Properties

• Employs objective scoring

• Efficient survey of a student’s acquisition of specific reading, writing and mathematical skills

Straightforward Scoring and

Results

ReadiStep field trial participation

ReadiStep has a high degree of reliability

• Degree to which a test is consistent and stable.

• Important measure of the quality of the assessment

Definition of reliability

• High reliability is necessary in order to have a high level of confidence in scores

Why reliability is important

• ReadiStep reliability estimates of .84-.89 indicate a high level of consistency

ReadiStep reliability

Validity of the ReadiStep assessment

• Whether a test measures what it is supposed to measure

Definition of validity

• Is the content of the test appropriate?

• Test specifications for the ReadiStep assessment based on College Board Standards for College SuccessTM

• Incorporation of three test development committees

• Can growth be demonstrated?

• Demonstration of developmental changes or growth based on the ReadiStep assessment test scores

How do you demonstrate

validity?

Part 1.3

Score reporting

ReadiStep provides multiple feedback measures

• Skills students possess

• Skills they need to develop

• Advice on how to improve critical reading, writing, and mathematics skills

Skills Insight™

• National: relative to 8th grade students nationally

• Local: based on performance within a district

Percentiles & Ranges

• 2.0 – 8.0 range in 0.2 incrementsScaled Scores

• Predicted range on the PSAT/NMSQT® (provided on educator reports)

Forward-looking Measures

Student Report

Classroom Score Summary Report

Classroom Item Analysis Report - Analysis

Classroom Item Analysis Report – Item Statistics

School Summary Report

District Summary Report

ReadiStep can be useful for different audiences

• Inform instruction and classroom content

• Review test books and skills with students

• Address student weaknesses

Teachers

• Look at school/district performance relative to the nation

• Suggest curricular areas of focus

• Inform decision making aimed at increasing college readiness

Principals and Superintendents

• Ensure that state curriculum, through its standards, is reinforcing areas of improvement for greater college readiness

State-level Policy Makers

ReadiStep can inform course selection in high school

Recommended High School Core

Curriculum

English: 4 years

Mathematics: 4 years

Natural Science: 4 years

Social Science: 4 years

College and Career Exploration with MyRoad™

ReadiStep participants receive access to MyRoad, an

online tool that lets them:

Take a short, fun quiz to understand their personality types

Learn about careers and college majors that fit their personality types

Start exploring colleges by location, college major, cost and much more

Track what they need to do in high school to prepare for college

Free CollegeEd Lesson: “What Can College Do for You?”

Students learn:

How to begin researching careers.

That flexibility and life-long learning are key because many people change careers during their lives.

Their place in a global economy.

The direct connection between higher education and careers.

Take a short, fun quiz to understand their personality types

Part 2.1

Preparing for Administration

Steps for administering the assessment

Order testing materials

Decide on administration dates

Select testing supervisors

Assign/prepare classrooms for administration

Plan for the collection of materials

ReadiStep is designed for flexible administration

• Fall 2011: October 11 – November 11

• Spring 2012: February 21 – March 23

Offered Twice a Year

• Can be administered at any time during a six -week administration window

Administration Window

• Administered in classroom (40 minute test sections)

• Teacher proctored

• Can be given all at once (recommended) or over the course of three class periods

In-School Administration

• Option to have labels pre-printed with students’ information for answer sheetsBulk Registration

Testing windows and ordering cut-off dates

Oct. 11–

Oct. 21Sept. 2 Sept. 9 Oct. 25 Nov. 29

Oct. 24–

Nov. 11Sept. 16 Sept. 23 Nov. 15 Dec. 16

Oct. 11–

Oct. 31Sept. 2 Sept. 9 Nov. 2 Dec. 16

Quick and simple administration

Section Timing # of Items

Critical Reading 40 Minutes 45 Items

Writing Skills 40 Minutes 50 Items

Mathematics40 Minutes

(20 calculator,

20 non-calculator)

36 Items

(18 calculator,

18 non-calculator)

Total 120 Minutes 131 Items

Responsibility of test supervisors for the ReadiStep™ assessment is focused on two major areas:

Ordering and securing test materials

Administering assessment and returning test materials

Administration of the ReadiStep assessment

Ordering and registration process

Nearly all districts and schools have been pre-

certified to order the ReadiStep assessment

You can order the assessment by submitting an

online order form at readistep.collegeboard.org

For assistance with your order, please call

ReadiStep Customer Service at 877-79-READI or

877-797-3234 (domestic) and 212-520-8570

(international toll call).

Student registration process options

We recommend the bulk registration option to make

the process more efficient.

You will receive instructions for submitting your student

file for bulk registration as part of your order confirmation.

Students can register on test day by completing a

ReadiStep answer sheet.

Handling test materials

• Test materials should be opened and checked within24 hours of receipt

• Open the cartons and take out the materials – check that you have received all materials listed on your Shipping Notice

Receivingmaterials

• Check the serial numbers on the test books against those on the School Packing List

Checkingmaterials

• Return all test materials to the cartons, reseal the cartons and sign your name across the top of each carton

Packaging materials

• Store the cartons in a secure area to which only you and other authorized persons have access

Storingmaterials

1. Test Books

2. Pre-ID labels (if your school participated in the bulk registration/pre-ID process)

3. Answer Folders

4. School Packing List

5. FedEx Prepaid Return Label(s) for returning Answer Folders to Pearson

6. Return Shipping Instructions

7. Supervisor’s Report Form

8. Supervisor’s Irregularity Report Form

9. Administration Survey

Materials in your shipment

Selecting testing assistants

One testing assistant is needed in each testing roomin which you will not administer the test yourself.

Testing assistants may be teachers or membersof the administrative, secretarial or clerical staff.

All of your testing assistants must be reliable andcapable of doing detailed work.

Setting up the testing environment

• All students must face the same direction

• All chairs must be placed directly behind those in the preceding row

Classroomarrangement

• There should be unimpeded access to every student for effective monitoring

• Test materials should be distributed to each student individually by staff

Test monitoring

• For the math calculator section, students who have large or raised displays should be seated separately from other test-takers

Calculator use

• Students should not face each other at opposite ends of a table

• Ensure that only test books, answer sheets, pencils and erasers are on students’ desks

Security precautions

Review of testing procedures

• Seat students to ensure they work independently. You should be able to monitor all students from any location in the room

• Students should not leave testing room without your permission

Admission to the testing room

• Hand a test book to each student, one at a time, along each row

• Have students write their name on the test book cover

• Distribute an answer sheet to each student

Distribution of test materials

• Allow 20 minutes for students to complete registration information if your school did not choose the registration option

• Adhere to the 40-minute timing for each test section.

Timing of the assessment

Prohibited items during test taking

Telephones or cell phones

MP3 players

Beepers/pagers

Watch alarms (including those with flashing lights or alarm sounds)

Personal digital/electronic recording or photographic devices

Dictionaries (including electronic)

Books or pamphlets

Papers of any kind

Part 2.2

Testing Accommodations

Testing accommodations can be requested

Special test materials are available for accommodations:

ReadiStep™ Test Booklet (Braille Format)

ReadiStep™ Test Booklet (Large-Type Format)

Reader’s Script for the ReadiStep™ Assessment

Reader’s Script for the ReadiStep™ Assessment (Audio

Format)

Students can be given extended time if requested

Requirements for extended testing time

Extended testing time can be given to a

student if that is the typical accommodation

provided on similar assessments

Length of extended testing time

The length of extended testing time

provided should also be consistent with the

typical accommodation provided to that

student on similar assessments

Part 2.3

After Administration

Collecting materials properly

• Collect answer sheets from each student individually. Do not have them passed to you.

• Make sure students do not put their answer sheets inside the test books.

• Count answer sheets and verify that you have an answer sheet for each student.

Collecting and counting answer

sheets

• After accounting for the answer sheets, collect the test books from students individually in the same order in which you distributed them.

• Count the used test books and verify that you have a test book for each student.

Collecting and counting test books

• When all of the test materials have been accounted for, place them where they will not be accessible to the students after testing.

• Make certain that all test materials are in your possession and that they secure.

Protecting test materials after the

test

Returning materials to the scoring center

Make sure all test materials are secure.

Return all used answer folders and ancillary materials (Supervisor’s Irregularity Report, Supervisor’s Report Form (Header), and Administration Survey) no later than two days after the administration using the prepaid UPS label(s)

provided.

Arrange for package pickup with UPS.

For More Information

Contact us

Phone: 877-79READI (877-797-3234)

8:30 a.m to 8 p.m. ET, Monday – Friday

Fax: 212-713-8143

Email: readistep@collegeboard.org

The College Board

Attn: ReadiStep Program

PO Box 8670

Reston, VA 20195

Visit us online at

readistep.collegeboard.org