+ All Categories
Home > Documents > Smarter Balanced District Test Coordinator...

Smarter Balanced District Test Coordinator...

Date post: 07-Feb-2018
Category:
Upload: vutuyen
View: 218 times
Download: 1 times
Share this document with a friend
43
1 . Smarter Balanced District Test Coordinator Workshop 1 January 27-30 2015 AOE - Michael Hock – Director of Educational Assessment - Frank Gerdeman – Assistant Director, Secondary and Adult Education - Linda Moreno – Assessment Coordinator for Special Populations - Peter Drescher – Educational Technology Coordinator AIR - Jen Chou – Program Manager - Liz Mortimer – Project Coordinator - Colin Horner – Systems Support Assistant Presenters 2
Transcript
Page 1: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

1

.

Smarter Balanced District Test Coordinator Workshop

1

January 27-30 2015

• AOE

- Michael Hock – Director of Educational Assessment

- Frank Gerdeman – Assistant Director, Secondary and Adult Education

- Linda Moreno – Assessment Coordinator for Special Populations

- Peter Drescher – Educational Technology Coordinator

• AIR

- Jen Chou – Program Manager

- Liz Mortimer – Project Coordinator

- Colin Horner – Systems Support Assistant

Presenters

2

Page 2: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

2

Overview of Smarter Balanced Assessments

Special Populations

Test Readiness

Presentation Overview

3

What is Smarter Balanced?

A. A buttery spread that helps lower your cholesterol?

B. A new testing company?

C. A state-governed project based at a research university?

Page 3: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

3

5

Common Core State Standards

specify K-12

expectations for college and

career readiness

Common Core State Standards

specify K-12

expectations for college and

career readiness

All students leave

high school college

and career ready

All students leave

high school college

and career ready

Teachers and schools have

information and tools they need to improve teaching

and learning

Interim assessments Flexible, open, used for

actionable feedback

Summative assessments Benchmarked to CCSS;

Combine Computer Adaptive and Performance

Tasks

Teacher resources for formative assessment

practicesto improve instruction

What’s so “balanced” about Smarter Balanced?

All students enrolled in grades 3–8 and 11 are required to participate in the Smarter Balanced summative mathematics test except:

Students with the most significant cognitive disabilities who meet the state’s criteria for a mathematics alternate assessment based on alternate achievement standards (approximately one percent or less of the student population).

Students with state approved exemption.

All students enrolled in grades 3–8 and 11 are required to participate in the Smarter Balanced summative English language arts/literacy (ELA) test except:

Students with the most significant cognitive disabilities who meet the state’s criteria for the English language arts/literacy alternate assessment based on alternate achievement standards (approximately one percent or less of the student population).

English Language Learners (ELLs) who enrolled within the 12 months prior to the beginning of testing in a U.S. school have a one-time exemption. These students may instead participate in their state’s English language proficiency assessment consistent with state and federal policy.

Students with state approved exemption.

Student Participation for Smarter Balanced Math/ELA Assessments

6

Page 4: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

4

Testing Windows

7

Vermont Testing WindowsPractice/Training Test January 27, 2015

Interim Assessment(ICA and IAB)

mid February 2015

Summative (Grade 3-8) March 17, 2015

Summative (HS) March 17, 2015

Smarter Balanced Summative Assessments Estimated Testing Times

8

Page 5: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

5

ELA Timing and Sequencing

9

Mathematics Timing and Sequencing

10

Page 6: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

6

Suggested order of administration for each content area:

Note: The ELA PT has two parts: • Part 1 – Research

• Part 2 – Full Write

Scheduling Test Sessions

11

CATCATClassroom Activity

Classroom Activity

PerformanceTask

PerformanceTask

Recommended to be administered no more than 3 days before the PT

Approximately 30 minutes

Designed to “level the playing field” to ensure that all students understand the context of the task

Administered in a classroom setting

Topics and scripted classroom activities available for download in Test Information Distribution Engine (TIDE).

Classroom Activity

12

Page 7: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

7

Smarter Balanced Practice and Training Tests

13

The training test should be taken by all students and within three weeks of when testing begins.

Response Types

14

Page 8: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

8

All universal tools

All designated supports, including:• Color contrast• Masking• Streamlining• Text-to-speech items • Translated test directions: Spanish • Translations (glossary): Spanish, Arabic, Cantonese, Filipino, Korean, Mandarin, Punjabi, Russian,

Ukrainian, Vietnamese• English Glossary • Stacked Translation: Spanish

All accommodations, including:• American Sign Language for all math items and ELA listening stimuli and items • Braille• Text-to-speech for reading passages in grades 6–high school • Closed Captioning

Embedded Universal Tools, Designated Supports, and Accommodations

15

Test Security Chart

16

Page 9: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

9

Appeal Types

17

Appeal Type Description

Reset a Test • Removes the test, and scores associated with the test, from the system• Enables student to start a new test• Requested due to accommodations not being set properly

Reopen a Test • Allows for a test that has already been submitted or has expired to be re-opened

Grace Period Extension • Extends the grace period if a test session is unexpectedly interrupted• Gives access to all previous answers

Restore a Test That Has Been Reset

• Return a test from the Reset status to its prior status• Only allowed on tests that have been reset• A test can be restored if it was reset in error

Invalidate a Test • Eliminates the test• Student loses that test and does not receive a score• Requested due to test security incidences

Available middle of February• Interim Assessment Blocks (IAB)

• Interim Comprehensive Assessments (ICA)

Requires upload of school users to TIDE

Requires setting of designated supports and accommodations for students in TIDE

Educators must be trained

Students should be provided opportunity to take Practice/Training Tests

Interim Assessments

18

Page 10: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

10

AIR Systems Overview

Copyright © 2014 American Institutes for Research. All rights reserved.

• Portal

• Secure Browser

• Test Information Distribution Engine (TIDE)

• Test Delivery System (TDS)

• Online Reporting System (ORS)

Overview

20

Page 11: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

11

Portal – http://vt.portal.airast.org

21

User Pages

22

Page 12: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

12

2323

Resources

Important Dates

Practice and Training Tests

Modules:

- What is a CAT?

- Performance Task

- Accessibility and Accommodations

- Embedded Universal Tools

- Student Interface

- TA interface

- Technology Overview

Systems Requirements for Online Testing

Resources Available Now

24

Page 13: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

13

Resources Coming Soon

25

• Test Administrator and Test Coordinator Manual

• User Guides

– Test Information Distribution Engine (TIDE)

– Test Administration

– Online Reporting System (ORS)

– Teacher Hand Scoring System (THSS)

• Modules

– Test Administration Overview

– Test Information Distribution Engine (TIDE)

– Teacher Hand Scoring System (THSS)

What is the Secure Browser?

26

The secure browser is designed to ensure test security by prohibiting students from accessing any other programs or websites during testing.

Page 14: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

14

Download the latest secure browser from the portal. The field test secure browser will not work.

Before taking a test, all applications must be closed.

An iOS 8 compatible version can now be found in the Apple store.

Secure Browser Information

27

Secure Browser Download

28

Page 15: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

15

Accessing AIR Systems

29

Activating TIDE Account

30

Page 16: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

16

TIDE Navigation

31

TIDE Overview

32

Page 17: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

17

User Roles

33

Task DA DC SC TE TA

Viewing and Editing Student Settings

Add/Edit Student Demographics

Adding Rosters

Adding User Accounts

Create Appeals

Downloading and Installing Voice Packs

Roles and Usernames

34

Page 18: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

18

Manage Users

35

Add Users

36

Page 19: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

19

Student Information

37

Add Students

38

Page 20: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

20

Retrieve Students

39

Uploading Student Settings and Accommodations

40

Page 21: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

21

Testing Tickets

41

Appeals

42

Page 22: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

22

Types of Appeals

43

Appeal Type Description

Reset a Test • Removes the test, and scores associated with the test, from the system• Enables student to start a new test• Requested due to accommodations not being set properly

Reopen a Test • Allows for a test that has already been submitted or has expired to be re-opened

Grace Period Extension • Extends the grace period if a test session is unexpectedly interrupted• Gives access to all previous answers

Restore a Test That Has Been Reset

• Return a test from the Reset status to its prior status• Only allowed on tests that have been reset• A test can be restored if it was reset in error

Invalidate a Test • Eliminates the test• Student loses that test and does not receive a score• Requested due to test security incidences

Creating Appeals

44

Page 23: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

23

Creating Appeals

45

Viewing Appeals

46

Page 24: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

24

Voice Pack

47

Test Delivery System Overview

48

Two interfaces:• Student

• Test Administrator

Two sites• Operational

– Interim

– Summative

• Practice/Training Test

Page 25: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

25

Student Interface

49

Student Test Selection

50

Page 26: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

26

Student Interface

51

End of Segment

52

Page 27: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

27

End of Test

53

Test Administrator Interface

54

Page 28: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

28

TA Interface: Overview

55

TA Interface

56

Page 29: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

29

Student Entry

57

Save and Edit Details

58

Page 30: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

30

Monitoring Student Progress

59

Pausing and Stopping Sessions

60

Page 31: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

31

This online course includes the following: Contains step-by-steps instructions for Test Administrators

Supplements other training resources (user guides, test coordinator manual, etc.)

Contains interactive portion

Contains quiz questions

Multiple viewing opportunities

Certificate of completion

ALL TAs and TEACHERS MUST TAKE THIS COURSE BEFORE PROCTORING A TEST!

Online TA Certification Course

61

ORS Interface: Welcome Page

62

Page 32: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

32

Which students have not yet tested?

Which students have started but not yet completed their test?

Which students need to finish tests that are going to expire soon?

Which students have paused tests?

Test Management Center: Plan and Manage Testing

63

Special Populations

Copyright © 2014 American Institutes for Research. All rights reserved.

Page 33: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

33

Available to  ALL Students

Available with IEP or 504 Plan

A Conceptual Model for SBAC Accessibility

A Conceptual Model for SBAC Accessibility

Page 34: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

34

A Conceptual Model for SBAC Accessibility

(Math),

A Conceptual Model for SBAC Accessibility

EmbeddedAmerican Sign Language, Braille, Closed Captioning, Text to Speech(Reading)

Non-EmbeddedAbacus, Alternate Response Options, Calculator, Multiplication Table, Print on Demand, Read Aloud, Scribe, Speech--to -Text

Page 35: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

35

69

Planning for Students with Special Assessment Needs: The Individual Student Assessment Accessibility Profile (ISAAP)

http://www.smarterbalanced.org/parents‐students/support‐for‐under‐represented‐students/

ISAAP is a tool designed to help school teams match student accessibility needs with the tools embedded in the SBAC Test Interface. ISAAP, as well as other tools and documents for students with special assessment needs, can be accessed using this link: 

Student Last Name SSID (consistent with TIDE) Grade

Student First Name Teacher of Record School (ID or Name)

Universal Tools – Embedded (Default setting for universal tools is selected; de-select any tool as needed)

*Use of this support will likely alsorequire separate setting or extra time.

Student Need(s)Select all that apply

Identification of Student NeedRecommendation: IEP or 504 must be selected

to populate recommended Accommodations

Designated Supports Educator(s) Recommendation

(To view guidance on recommended use of the Designated Support/Accommodation, hover over selected cell)

Page 36: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

36

Page 37: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

37

Uploading Accommodations and Settings

73

Test Readiness

Copyright © 2014 American Institutes for Research. All rights reserved.

Page 38: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

38

Network Connection:• A stable, high-speed (wired or wireless) network and

internet connection are required for the test.

• The response time for each test depends on your network’s bandwidth, number of students simultaneously testing, size of test content, proxy server (if used), and other factors.

Network Requirements

75

Network Configuration:• Session timeouts on proxy servers and other devices should be

set to values greater than the average scheduled testing time. For example, if test sessions are scheduled for 60 minutes, consider session timeouts of 65–70 minutes.

• Web proxy servers must be configured to NOT cache data received from servers.

• For any device that performs traffic shaping, packet prioritization, or quality of service, the IP addresses to be used for testing should be given a high priority to ensure the best performance.

Network Requirements

76

Page 39: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

39

Performance Factors:• Bandwidth

• Number of students simultaneously testing

• Wireless networking configuration

• Secure browser

Network Requirements

77

Bandwidth:• At least 20Kbps bandwidth per student being tested

• Affected by both Local Area Network (LAN) traffic and internet traffic from the router

• LAN should always be analyzed to determine potential traffic bottlenecks

Network Performance

78

Page 40: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

40

Number of students simultaneously testing:• Network performance may slow when large numbers of

students are testing at one time.

• Perform network analyses at different times to ensure adequate capacity.

• Multiply the number of students being tested by 20Kbps to get an estimate of bandwidth needed, and compare that estimate with a network speed test.

Network Diagnostics

79

Network Diagnostics Tool

80

Page 41: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

41

Smarter Balanced Modules

Training Modules

81

What is a CAT? Technology OverviewPerformance Task Test Administration OverviewAccessibility and Accommodations Online Reporting System Embedded Universal Tools Teacher Hand Scoring System Student Interface TIDETA interface

Test Administrator Manual

Test Coordinator Manual

Technology Coordinator Brochure

District/Test Administrator Brochure

TIDE Brochure

TDS Brochure

ORS Brochure

Manuals/Brochures

82

Page 42: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

42

The following webinars will take place in February:

Technology Requirements for Online Testing

How to Start/Monitor Online Testing and Test Settings

How to Use the Online Reporting System

Upcoming Webinars

83

Practice and Training Tests

84

Page 43: Smarter Balanced District Test Coordinator Workshopvt.portal.airast.org/core/fileparse.php/1691/urlt/Vermont-Training... · Balanced summative mathematics test except: ... (glossary):

43

Event Date(s)

TIDE Go-Live early February 2015

Practice and Training Tests Release Date January 27, 2015

Smarter Balanced Interim Assessment Test Window (ICA and IAB)

mid February 2015–June 12, 2015

Smarter Balanced Math/ELA Summative Assessment Test Window (Grades 3 – 8, HS)

March 17, 2015–June 12, 2015

Key Dates

85

Further Information

• Vermont Smarter Balanced Assessment Portal • http://vt.portal.airast.org/

Vermont Smarter Balanced Help Desk• American Institutes for Research

• 1-844-218-1184

[email protected]

Thank You!


Recommended