MAP SAL Training

August 6, 2015

WHAT WILL BE COVERED

• Test Preparation• MAP Assessment• Policies & Procedures• Accommodations• Scores• Reports• SPF• SAL, Proctor, & STR Responsibilities• Technology Requirements• Resources

2

MAP PREPARATION

Prior to any MAP testing, the following must occur:• SAL must train all instructors and proctors on policies, procedures,

ethics and technology Staff Training Sign-in Sheet due prior to the start of any MAP

testing.

• All testing devices need a lockdown browser installed and readiness check completed STR Device Readiness Verification Form due 8/24/15.

Forms can be found online at http://dpsare.com/map-2/

Completed forms can be emailed to MacKenzie Lane @ mackenzie_lane@dpsk12.org

3

MAP PREPARATION

Notes about rosters:• All Pathways schools or any other schools on the district MAP license

will be rostered by ARE• Only students who are rostered in IC will appear on your MAP roster• Students who need to be tested immediately and are not on the

roster can be manually entered into MAP at the school level– ALL profile information is required when manually entering in a

new student– Profiles that are incomplete will not show on any MAP reports

(profile is missing a grade, gender, ethnicity, DPS ID, etc.)– Please be as accurate as possible when manually entering

student profile information to avoid duplicates and reporting errors

4

MAP PREPARATION

Notes about rosters Cont.:• Rosters do not account for students who leave during the test

window (graduate, move)• To remove students from your roster, email

mackenzie_lane@dpsk12.org with the DPS ID number of those students– Note: students must be end dated in IC before they will be

removed• Rosters will be updated weekly on Monday morning (August-

September) & bi-monthly thereafter. New rosters will be loaded at the start of each test window.

• If your school requires additional roster updates due to term changes (quarters, hexters), email mackenzie_lane@dpsk12.org for assistance.

• Instructor profiles are loaded with each roster: instructors should watch for an email from NWEA to set up an account.

• Additional user accounts can be using the Login Request Form found here: http://dpsare.com/map-2/ under MAP Resources

5

6

MAP Assessment

WHAT IS MAP (MEASURES OF ACADEMIC PROGRESS)

NWEA computerized MAP tests provide teachers, students, and parents with an accurate assessment of a student’s ability, accurately measuring what a child knows and needs to learn.

When administered at regular intervals over time, it is possible to find out whether an individual student, or an entire grade level, is making satisfactory progress in these basic skills areas. Teachers can use this assessment information for instructional planning for an individual student or an entire class.

7

WHAT IS MAP (MEASURES OF ACADEMIC PROGRESS)

• 3 assessments: mathematics, reading and language

• Aligned to the Common Core State Standards

• Computer adaptive; 39-52 questions per subject area

• Data driven

• Administered 3 times each year

8

WHY WE USE MAP

• Instruction:– inform in-the-moment instructional practices– track student growth – provide insight into college and career readiness– provide valid growth data

• Accountability:– measure of school performance on the Alternative SPF

WHO TAKES MAP

• ALL students primarily enrolled in grades 6-12 at a Pathways school during the testing window are required to take all MAP tests (mathematics, reading, and language)

• Any student who is secondarily enrolled at a Pathways school in a course/related course that is assessed by MAP

2015-2016 ASSESSMENT WINDOWS

• FALL: 8/03/15-11/20/15

• WINTER: 11/30/15-2/19/16

• SPRING: 2/29/16-6/3/16

*Schools are allowed to create their own testing schedules as long as all of the tests are administered within the window. Be sure to allow enough time for any make-up tests and re-tests.

12

Policies & Procedures

2015-2016 MAP POLICIES

• ALL students in grades 6-12 who are primarily enrolled at the school during the testing window must take all MAP tests. This includes students who might be duly enrolled at a community college.

• Any student who is secondarily enrolled at the school in a course/related course assessed by MAP must take the MAP assessment for that course.

• Students should only test 1 time in each subject per window (unless they have an invalid test score)

• Students should only test in 1 subject per day.

• Allow 65 minutes per testing session (50 minutes for administration and 15 minutes for preparation between groups).

• Tests are NOT timed. All students should be given adequate time to complete their assessments. Tests may be stopped with an option to resume at another time.

2015-2016 MAP POLICIES

• Students who are absent must be rescheduled during the testing window.

• A student who receives an invalid test score will be required to re-

test during the window.

• Schools will be responsible for pulling testing reports to identify students who have an invalid test and must re-test.

• Schools will also be responsible to pulling testing reports to identify students who have not yet tested.

• ARE will conduct weekly analysis of scores and will contact schools with any questions or concerns.

MAP ETHICS

• Understand the procedures needed to administer the assessment.

• Avoid any conditions in the preparation and administration that might invalidate the results.

• Ensure that any eligible student is not excluded from taking the assessment.

• Ensure that all students who need an accommodation are afforded one according to policies and procedures.

• Protect the rights to privacy of all examinees.

• Avoid actions or conditions that would permit or encourage an individual to receive scores that misrepresent their actual levels of achievement.

TESTING IRREGULARITIES

• A testing irregularity is any action or event that occurs before, during or after administration that may compromise the validity of the test.

• The SAL must immediately report any concern about breaches in test security or noncompliance with test administration procedures to ARE.

• Please instruct test administrators to contact the SAL to report all testing irregularities.

A Testing Irregularity includes…• Large scale power or bandwidth failure during testing• Technology Interruptions that are not resolved within 15 minutes.• Failing to provide a student with a documented accommodation • Providing a student with an accommodation that is not documented

and therefore is not appropriate• Student uses a cell phone or other prohibited handheld electronic

device (e.g., smartphone, iPad®) while testing • Taking a photo of a test item

TESTING IRREGULARITY ONLINE FORM – COMING SOON

• Submit an irregularity form within 48 hours of the incident.• Go to www.dpsare.com and click on the quick link at the bottom of

the page for Assessment Application. Log in and select “Irregularities”.

• Enter all relevant information into each field, the students involved, upload additional documents if available (ie.statement from the Test Administrator).

18

Accommodations

MAP ACCOMMODATIONS: STANDARD

Presentation Accommodations:• Simplify or clarify directions; for example, clarifying the location of

the Next button

• Use visual magnification devices or software (for example, MAP is compatible with ZoomText Magnifier 9.1 or MAGic 11)

• Use auditory amplification devices, noise buffers, or software

• Use masks to block a portion of the screen; for example, the student may use a sticky note, index card, or a blank sheet of paper to move down the screen as he or she is reading

• Read or reread aloud the test directions

• Read or reread aloud the test questions for math or language usage tests only

MAP ACCOMMODATIONS: STANDARD

Response Accommodations:• Scribes, educational assistants, and other people supporting a

student during testing must be neutral in responding to the student during test administration. Assistance in test administration must not lead a student to the correct answer. The student’s response must accurately represent the student’s own choice.

– Assign a scribe to record responses– Dictate responses to a scribe– Point to responses for a scribe– Respond in native language

MAP ACCOMMODATIONS: STANDARD

Setting Accommodations:• Test an individual student in a separate setting

• Test a small group of students in a separate setting

• Minimize distractions; for example, use a study carrel

MAP ACCOMMODATIONS: STANDARD

Timing / Schedule Accommodations:• Administer test over multiple sessions in a day

• Administer test over a number of days (limited to 2 days)

• Allow flexible schedule

• Extend time for testing (all MAP assessments are designed to be untimed for all students)

• Administer at time of day most beneficial to student

• Offer breaks

MAP ACCOMMODATIONS: STANDARD

Materials or Devices Accommodations:• Provide scratch paper

• Provide a comparable calculator when a student is unable to access the on-screen calculator given in a question

MAP ACCOMMODATIONS: STANDARD

Miscellaneous Accommodations:• Provide a drink during testing

• Provide a snack during testing

MAP ACCOMMODATIONS: NON-STANDARD

Accommodations that have the potential to bias the student’s test score are considered non-standard, and they require special consideration. Examples include:• Native language translation

• Reading aloud the answer options

• Reading or translating any portion of the reading test

• Pronouncing symbols for math

• Defining words within the test question

• Using a calculator for questions that do not have an on-screen calculator

• Any other accommodations not listed above

MAP ACCOMMODATIONS: NON-STANDARD

• Non-standard accommodations must be listed on the student IEP/504 plan

• Accommodation must be used regularly in the classroom and in place no less than 90 days prior to testing

27

Scores

MAP SCORES: RIT

• MAP tests report the student’s Rasch unIT (RIT) score upon completion

• Shows current student level in that subject

• Equal-interval score; scores can be added together to calculate accurate class or school averages

• RIT scores range from about 100 to 300

• RIT scores show growth from year to year

MAP: SEM

• Standard Error of Measurement (SEM) is an estimate of the achievement of a test score.

• If a single student were to take the same test repeatedly (with no new learning taking place and no memory of question effects), their test scores would likely fall within a given range each time. The SEM represents the probability that the actual score for the student lies within this range.

• The smaller the SEM, the more precise the achievement estimate is.

MAP NORMS

NEW 2015 NORMS!• 2015 RIT scale norms allow educators to compare achievement status and

growth between test occasions to a students’ performance in the same grade at a comparable stage of the school year.

• RIT scale score norms are especially useful in four key areas:– individualizing instruction– setting achievement goals for students or entire school– understanding achievement patterns– evaluating student performance

• Slight differences from the 2011 norms have been observed– true change in the performance of the student– school demographics have changed– larger and more representative sample make 2015 norms more

accurate– varied nature of CCSS adoption, implementation, and testing appear to

have resulted in lower test scores• 12th grade not included

*Handout

MAP NORMS

MAP SCORES: READING

Ranges may

change

based on new

norms

MAP SCORES: MATHEMATICS

Ranges may

change

based on new

norms

MAP SCORES: LANGUAGE

Ranges may

change

based on new

norms

TEST INVALIDATIONS

Student Invalidations:• copies or receives verbal help from another student• answers randomly without reading questions• refuses to take or continue the test• seems unable to comprehend directions or questions, exhibits

disabling anxiety, or becomes ill during the test

Score Invalidations:• RIT score does not fall between 100 and 350• Test duration is too short: score attained in under 6 minutes• Standard Error of Measurement (SEM) is outside the acceptable

limits: SEM is less than 1.5 or above 5.5. If the RIT score is above 240, the SEM above 5.5 is acceptable

• Test is terminated without the option to resume

TEST INVALIDATIONS

• Records with invalid scores are retained in the database, but are not included in any class, school, or district reporting.

• Records with invalid scores are included on test reports (Class Report), but will appear in gray font without a numeric score.

• A student who receives an invalid score must re-test within the window. Schools are responsible for identifying these students on testing reports.

TEST INVALIDATIONS

• If a student takes the same test twice and one is invalid and the other valid, the student’s name will appear twice on the reports. The invalid score will appear in gray font.

• If a student takes the same test twice and both are valid, both scores will appear on the reports. The score that will be used for data purposes will be the score with the lowest SEM and will be in black font. The score that will NOT be used will be in gray font.

38

MAP Reports

MAP REPORTS

Report changes based on new norms:• New term comparisons available

– Winter to winter– Winter to spring

• Percentiles adjusted for amount of instruction• Option to pull data using 2011 or 2015 norms – USE 2015 NORMS

in 2015-16• Enhanced reporting

– Achievement Status and Growth– Class Breakdown by Projected Proficiency*– Student Progress– Student Goal Setting Worksheet– Projected Proficiency Summary* (district-level)– Student Growth Summary (district-level)*Scheduled to be released later this fall

NOTE: Projected growth, observed growth, and met projected growth shown on MAP reports is NOT an indication of SPF growth targets or measures!

MAP REPORTS

MAP Reports Summary

Highlights = report changes based on new norms

*Handout

MAP REPORTS

41

New growth data

New comparative data

New visual growth comparisons

Now available as a spreadsheet!

MAP REPORTS

School level growth report

New visual growth comparisons

43

SPF

MAP SPF

• MAP is a measure of student progress over time (growth) on the Alternative SPF.

• Students with at least two valid scores in the same school in the same year with at least 40 consecutive instructional days between the earliest and latest tests are included.

• Minimum requirement of 16 eligible growth measures to be included in calculations.

• Growth is measured separately for mathematics, reading, and language.

• Three years of data are used in SPF calculations.

MAP SPF

• MAP growth expectations are based on the RIT scale score.

• It is determined if a student met or exceeded growth expectations by comparing RIT Scale scores.

• The RIT scale score from the earliest test is referenced against a growth expectations table to determine what the expected RIT scale score should be for the latest test based on the number of weeks between tests.

NOTE: Projected growth, observed growth, and met projected growth shown on MAP reports is NOT an indication of SPF growth targets or measures!

MAP SPF: EXAMPLES

• Students

  Target RIT Growth Targets

Pre-test RIT grade

8-15 wks

16-23 wks

24-31 wks

32+ wks

MathematicsK-7th (<226) 2 3 4 58 (226-230) 2 2 3 49 (231-233) 1 2 2 410 (234-237) 1 1 2 211 (238-239) 1 1 2 2

12 (239+) 1 1 1 1Reading

K-7th (<218) 1 1 2 38 (218-220) 1 1 2 39 (221-222) 1 1 2 310 (223-226) 1 1 2 3

11 (227) 1 1 2 212 (227+) 1 1 2 2

Language ArtsK-7th (<218) 1 1 2 38 (218-220) 1 1 2 3

9 (221) 1 1 2 310 (222-223) 1 1 2 311 (224-225) 1 1 2 2

12 (225+) 1 1 2 2

Example 1: Student A scores a 200 on his first/pre-test math test. He stays at Vista Academy for 20 weeks. His expected growth target would be 3 RITs for a final score of at least 203. His score remains the same at 200. Thus, he did not meet his growth target and would be counted negatively.Example 2: Student B scores a 219 on his first/pre-test reading test. He stays at Emily Griffith for 30 weeks. His expected growth target would be 2 RITs for a final score of at least 221. He scores 222. Thus, he meets his growth target and would be counted positively.

MAP SPF GROWTH TARGETS

Grade Level Test Measure Lower RIT Range Upper RIT Range

8 Weeks 16 Weeks 24 Weeks 32 Weeks

07 Language Usage 0 217 1 1 2 3

07 Mathematics 0 225 2 3 4 5

07 Reading 0 217 1 2 2 3

08 Language Usage 218 220 1 1 2 3

08 Mathematics 226 230 2 2 3 4

08 Reading 218 220 1 2 2 3

09 Language Usage 221 221 1 1 2 3

09 Mathematics 231 233 1 2 2 4

09 Reading 221 222 1 1 2 2

10 Language Usage 222 223 1 1 2 3

10 Mathematics 234 237 1 1 2 2

10 Reading 223 226 1 1 2 2

11 Language Usage 224 225 1 1 2 2

11 Mathematics 238 239 1 1 2 2

11 Reading 227 227 1 1 2 2

12 Language Usage 226 262 1 1 2 2

12 Mathematics 240 286 1 1 1 1

12 Reading 228 266 1 1 1 1

Targ

ets may

change

Based on new

norms

MAP SPF CONTACTS

Questions about MAP on the SPF?

The ARE Accountability Team:Maegan Daigler, Accountability ManagerB Sanders, Senior Research Analyst

Email: spf@dpsk12.org

49

SAL, Proctor &STR Responsibilities

SAL RESPONSIBILITIES

Two weeks prior to testing:

Create a master schedule for testing sessions, proctors, equipment, and locations

Deliver proctor/teacher training prior to the start of any MAP testing. Completed training sign-in sheet must be returned to mackenzie_lane@dpsk12.org prior to the start of any MAP testing.

Coordinate with your STR to ensure device readiness Ensure all proctors have access to MARC (MAP admin site) Plan for any standard accommodations

SAL RESPONSIBILITIES

One week prior to testing:

Confirm list of students for testing Plan ahead for students with special needs Provide teachers with a copy of master testing schedule Verify that all computers are available for testing and are in working

order Create test sessions in MARC

SAL RESPONSIBILITIES

Day of testing:

Verify that all computers are set to the correct date and time Remove/cover any posters or board information that would aid

students Provide scratch paper and pencils for the mathematics tests Place a Do Not Disturb sign on the door Ask teachers to remind students to bring a book to read or class

work to complete when they are finished with their test

PROCTOR RESPONSIBILITIES

Day of testing:

Launch the MAP browser on student testing devices Log in to MARC on the proctor device Write the Test Session Name and Password on the board Make a note of absent students Read student directions aloud to students prior to starting the test Provide a comparable test environment for all students – ensure

that exactly the same information is given to all students Confirm students to test using the MARC dashboard Observe and monitor students during testing. If necessary, advise

students to slow down or to continue to make progress

PROCTOR RESPONSIBILITIES CONT.

Monitor test session – students should not visit or have access to cell phones, reference books, websites, or other instructional material during testing

Clarify directions if needed Record student scores if desired – either print or write down scores

as students finish Students may read a book when finished with their assessment Students may be dismissed when 90% of the class has completed

testing - determined site by site and by the master testing schedule Collect all scratch paper and dispose of it

STR RESPONSIBILITIES

One month prior to testing:

Download and distribute the MAP lockdown browser to all testing computers

Complete a readiness check on each device by starting its lockdown browser

Prep any Chromebook or iPads for testing (lockdown browser is not required)

STR RESPONSIBILITIES

One week prior to testing:

Verify that there are enough testing devices Verify that all devices are in working order Complete the STR Device Readiness Verification From by 8/24/15

and return to MacKenzie Lane @ mackenzie_lane@dpsk12.org

57

Technology Requirements

TECHNOLOGY REQUIREMENTS

TECHNOLOGY REQUIREMENTS

LOCKDOWN BROWSER

To ensure MAP test security, students use a lockdown browser or similar technology. Lockdown browsers help secure testing by restricting access to resources other than the MAP test. Testing without the lockdown browser installed is a testing irregularity.

LOCKDOWN BROWSER

Desktop Computers:• For Windows computers, you use the PC

Version lockdown browser, available from the home page when you log into the MAP system. It includes an installation program. **NEW version available** The new version ensures continued compatibility with modern school networks and future MAP updates.

• The Mac version of the lockdown browser does not involve an installation. Instead, you simply download the file to the Mac desktop of each computer before test-taking.

• Requires a MAP user account.

LOCKDOWN BROWSER

Chromebook:• There is no lockdown browser for the Chromebook. This requires a

workaround to secure testing. More information is available here: http://dpsare.com/map-2/ under MAP Resources.

LOCKDOWN BROWSER – READINESS CHECK

• Once all devices have the lockdown browser installed, each device needs a readiness check.

• The readiness check will tell you if the lockdown browser installation was successful or if any components failed.

• Readiness checks must be completed prior to any MAP testing.

• Readiness check information can be found in the System and Technology Guide here: http://dpsare.com/map-2/ under MAP Resources.

64

Resources

RESOURCES: MAP SITE

RESOURCES: MAP SITE

New reports tutorial

RESOURCES: ARE SITE

NEW ARE Website: www.dpsare.com

RESOURCES: ARE SITE