90
English Language Arts – Mathematics – Science – Social Studies PARCC/Colorado Measures of Academic Success (CMAS) Spring Administration Training for SACs
English Language Arts – Mathematics – Science – Social Studies
PARCC/Colorado Measures of Academic Success (CMAS)
Spring Administration Training for SACs
Overview
Timeline and Test Structure Training requirements Scheduling Before Testing Accessibility Features and Accommodations During Testing Administering Tests Make-Up Testing Receiving Materials After Testing Resources
2
Colorado Measures of Academic Success (CMAS)
3
PARCC English Language Arts and Mathematics:
Purple
Science and Social Studies:
Green Student Testing Ticket Student Authorization Ticket Student Registration Import/Export (SRI/SRE)
Student Data Upload (SDU/RSDU)
Unit (Sections within Unit) Section PearsonAccessnext PearsonAccess Classic Scratch Paper No Scratch Paper (District
decision) Personal Needs Profile (PNP) for Accommodations
No PNP: Assign through SDU or User Interface
Spanish Text-to-Speech Available (Math Only)
Spanish Audio and Spanish Source Book
Training and TA’s
Test Administrators
5
• Test administrators must be employed by the district. o Substitutes may be used, as long as they are trained and sign the
security agreement for the assessment.
• Test Administrators must sign a security agreement for each test that they administer (PARCC and Science and Social Studies).
• Must be trained in a face to face training by School Assessment Coordinator o Test Administrators that were trained this fall will need to be
retrained.
• New policies and procedures • Review of security
Everyone involved in PARCC and CMAS administration must be trained each year. This includes DACs, SACs, Test Administrators, technology personnel and any other school or district staff involved in administration. SACs are responsible for ensuring that all individuals involved in test administration at their building receive training and sign a security agreement
6
District Training
• Must include: o Test Security o Standardized Test Environment o Test Administration procedures o Basic Error Resolution o Test Session Management (if school chooses to
have TA’s do this) • How to RESUME students
o Test Administrator Role vs. Teacher Role o Opportunity to ask questions
Test Administrator Training
7
TA training • A power point will be provided for you to add in
school specific information • Must be face to face
Timeline, Structure and Scheduling
9
Timeline
Spring 2015 Tentative Critical Dates
11
Description
PARCC English Language Arts and
Mathematics PBA EOY
Science and Social Studies
Set up teacher test proctor accounts Open now Open now Open now
Online test session set-up begins Open now Open now February 16
Materials scheduled to arrive in districts* February 23 April 13 March 30
Proctor caching test content begins (prior to testing)
February 23 April 13 March 30
Paper based returns* 03/16-3/18 5/4-5/6 NA
*Paper based returns apply on to elementary schools where entire grade is giving paper.
Administration Overview
PARCC English Language Arts and Mathematics (two windows) Performance Based Assessment (PBA) End-of-Year Assessment (EOY)
CMAS Science and Social Studies Elementary and Middle School (one window)
12
Content Area Grades
English Language Arts 3-11
Mathematics 3-8, three high school assessments • Integrated/Math I, Integrated/Math II,
Integrated/Math III
Content Area Grades
Science 5 and 8
Social Studies 4 and 7
Spring 2015 Assessment Calendar
13
Assessment Grades Assessment Windows-CBT
Paper Based
Window* PARCC
Performance-Based Assessment
(PBA)
3-8, High School 3/02/15 to 4/03/15 3/02/15 to
3/13/15
CMAS and CoAlt: Science and
Social Studies
4 and 7 (Social Studies)
5 and 8 (Science) 4/13/15 to 5/01/15 NA
PARCC End-of-Year Assessment
(EOY) 3-8, High School 4/20/15 to 5/15/15
4/20/15 to 5/1/15
*Elementary only: Paper based window only applies when entire grade level is taking the paper based assessments. Paper based assessments have a two week window.
District Assessment calendar online
Structure
PARCC PBA Test Administration Flowchart
16 Note: This diagram illustrates grades 6-8.
PARCC EOY Test Administration Flowchart
Note: This diagram illustrates grade 7 and high school. 17
Grades 8-11 math test assignments
Science and Social Studies Administration Flowchart
Science and Social Studies (One Window)
Section 3 (Unit)
Section 2 (Unit)
Section 1 (Unit)
Scheduling/Timing
PARCC Unit testing time
6-8 and 9-12
Science and Social Studies Section Testing Times
Science and Social Studies
Subject Unit/Section For Scheduling/Testing
Purposes
Unit/Section Testing Time
Science and Social Studies
Section 1 80 minutes
Section 2 80 minutes
Section 3 80 minutes
23
CMAS: Structure and Timing
CMAS: Science and Social Studies Section Administration Time for Elementary and Middle School Time for Set Up and Transition
(Estimated)
Required Testing Time for All
Students
Additional Testing Time
(20 minutes) 55 minutes 15 minutes
• If all students have completed the test section, the Test Administrator may read the script to end that particular test section.
New
• Start up TestNav 8.0 • Log in • Test transfer (proctor cache…) • Give directions • Review sample items
Time for Set up and Transition Includes….
• Select Timing Option (1, 2, 3, or 4) o If Option 1 or 2 is selected, indicate where students should go when
finished
o In PARCC they are called A, B, C
Section Timing: School Level Decisions
Timing Options
Timing Options
PARCC TAM timing
• Turn over your timing page or write down somewhere on the power point notes: oAt least 3 important things just covered
Guidelines for Administration Time
31
Task Time to be Allotted
for an Administration
Preparing for testing (includes reading instructions to students and answering questions)
20 minutes (recommended)
Distributing test materials 5 minutes (recommended)
PARCC English language Arts and Mathematics Unit testing time 60-90 minutes*
Science and Social Studies Section testing time 80 minutes
Completing end-of-unit activities, including closing units, collecting test materials, and administering a student survey (after EOY)
5–10 minutes (recommended)
*For PARCC, depending on unit and subject—refer to Unit Guidelines and Schedule table in the Test Coordinator Manual for each Unit Time.
Guidelines for Administration Time Guidelines for Administration Time • Schedule the entire amount of Unit/Section Testing
Time. • Once the Unit/Section Testing Time has elapsed, the
Unit/Section must end. • If all students have completed the Unit/Section, the
Unit/Section may be ended (no minimum testing time). A student may be allowed an extended time accommodation only if listed in his or her IEP, 504 Plan, or EL Plan. • PARCC: time-and-a-half is not included in Unit
testing time. • Science and Social Studies: time-and-a-half is
included in the Section testing time
32
NEW
NEW! Guidelines for Breaks (p 10 TCM)
33
Breaks
• Between Units/Sections, scheduled breaks may occur.
• During a Unit/Section, short “stand-and-stretch” breaks
may be permitted at the discretion of the Test Administrator. • Not to exceed 3 minutes • Add 3 minutes on to total unit testing time
Example EOY (ELA/L Administration): 8:00 a.m. – 10:00 a.m. Unit 1 10:00 a.m. – 10:15 a.m. Scheduled Break 10:15 a.m. – 12:15 p.m. Unit 2
Scheduling • Test Units/Sections can only be administered to
students in consecutive order. o Only PARCC Make-ups may be administered out
of order. • Paper testing: A school must administer the same
Unit to all paper-based students within the same day (e.g., Unit I on Tuesday).
• Computer testing: To the extent possible, all students within the school should be assessed at the same time. If not possible, all students should be assessed within the shortest timeframe practicable.
34
Scheduling Considerations
• Schedule first group/first day with more of a time cushion than other groups if you can.
• Schedule smallest group first. • Determine whether one content area will be
completed before beginning the next, or if testing will alternate between the two content areas (make-ups excluded).
• Determine whether students will take an entire session in one day or take one Section/Unit per day (make-ups excluded).
• One TA or two per room?
35
PARCC Scheduling • If the time and directions are the same,
different grades can be administered in the same room. o ELA and Math cannot be administered in the same room
because the directions are different o PBA of Algebra I and II can be tested together but the EOY
cannot because of Unit time differences o Ensure that all calculator/non-calculator sections are the
same
• Students from different grade levels taking the same assessment (Algebra I for grades 8-10) can be combined in a testing environment.
• Recommended to only test students on up to 2 units per day
36
Schedules created/sent • Send completed school schedule to Kim
Terry by Feb. 10th • Be sure to include:
oDate oGrade level and Unit o Start time o Location of tests (for support staff to find
you)
Turn and Talk • Share your 3 important things
o Any to add?
• What other information do you need to know more about or consider when creating your schools testing schedules for:
• PBA • SS and Science • EOY
The Test Environment
39
• Student-to-Test Administrator ratio must not exceed 30 to 1 o Test Administrator must be able to actively monitor the space
within the testing environment.
• Consider room configuration o Make special considerations for large testing environments or
environments with complicated configurations.
• Test Administrators must: o Actively proctor. o Remain attentive and in the room during the entire testing section. o Circulate throughout the room during the test.
• Should be able to see students working, not student work
Student-to-Test Administrator Ratio
40
The testing environment must: • Be adequately lit, quiet, free of distractions, and
heated or cooled. • Provide an adequate writing surface (paper-
based). • Be free of electronic devices and music. • “Do Not Disturb/Only Authorized Personnel Allowed”
sign must be placed on the door during test sessions.
The Test Environment
41
• No food or drinks are allowed on desks or near test materials.
• The testing environment must be free of any content related posters or aids that suggest possible answers to students: o Word walls o Steps for solving math equations o Any content related materials o Any resource that defines, explains, or illustrates terminology or concepts
o Graphic organizers o 100s charts
o Definitions o Math manipulatives
The Test Environment
42
• Generally, posters that do not include content specific definitions, content related processes or solutions may remain on the wall.
• Timing Box (optional box around; other information required)
Unit Name: Math Unit 1 Unit Testing Time: 75 Min Starting Time: 9:00 Stopping time: 10:15
The Test Environment
43
• Students should not be able to see each other’s work from a normal testing position.
• Consider the following seating configurations to maintain test security: o Seat students in every other seat (useful in a computer lab setup) o Arrange monitors back-to-back o Seat students back-to-back o Seat students in a semicircle (useful for schools using laptops) o Seat students in widely spaced rows or in every other row
(appropriate for a classroom setup)
• Dividing screens or other privacy materials may be used if students cannot be placed far enough away from each other.
Room Configuration
44
PARCC • ELA PBA all students must have headphones for all
Units. o Exception this year for grade 8 – no headphones
Text-to-Speech • To be in a testing room with other students,
headphones must be worn. • Students may be tested separately, if they are not
able to wear headphones.
Headphones
45
• Only students, Test Administrators/Examiners, and authorized school, district, state personnel, or state-sanctioned test monitors may be in testing areas during administration.
• Media are not allowed to have access to the tests
before, during, or after test administration, or take pictures or video of testing materials or testing students.
• Parents are not allowed in the testing room with their child.
Unauthorized Visitors and the Media
46
During Testing
Test Administration
47
Tasks to Complete During Testing: SAC/STC On the Day of Testing (CBT):
Distribute test materials. Scratch paper/pencils Authorization/Testing tickets Seal Codes
Ensure Test Administrators have a computer or tablet available, if they are resp. for online management
Start test sessions/units (can also be done in advance) Monitor test activity.
Resume tests as needed Be available to Test Administrators and Proctors. Investigate security breaches and testing irregularities. Respond to all technology related issues. Collect materials from Test Administrators after each test
unit/section.
48
• Test Administrator’s Manual (TAM) o BEFORE TESTING: Fill in and select options for after the test
session. o Practice in advance! o Read script exactly as written (may clarify after read
exactly). o Exit Instructions.
• Student Testing/Authorization Tickets o Hand out and collect in the test environment. o Have a master list of students including accommodations. o Student Testing/Authorization Tickets are secure!
• Seal Code o Write on board or poster. o Take down after testing starts.
Test Administration Materials
49
• School Decisions: o Will students be able to leave when they have finished
testing? (no minimum time) o Will students sit quietly? o Read (cannot use any electronic reading devices)? o May students be released to location outside testing area? o What to do when all students are completed with
Unit/Section?
• Considerations: o To where will students be released? o To whom will students be released?
School Decisions:
After Students Finish Unit/Section
50
Active Administration Active Administrators:
• Provide feedback • Clarify test questions • Answer content related
questions • Interfere with the students’
demonstration of skills • Interact with students in any
way that would impact student responses
• Engage in other tasks during test sessions
• Read sources, items, or student responses
• Help with TestNav navigation
Administrators May Not: • Ensure students have all
necessary materials for each section
• Ensure a standardized testing environment
• Follow all scripts exactly as written
• Move throughout the room during testing
• Read directions to students when asked
• Use proximity to keep students on task
• Use “continue working” script
51
Prepare the test environment and situate students Start session in PearsonAccess/PearsonAccessnext
Follow directions and read script in the Test Administrator’s Manual
Hand out Student Testing/Authorization Tickets and scratch paper Assist students in logging on to TestNav 8 Complete directions to students and start Unit/Section Actively administer each test Unit/Section Collect Student Testing/Authorization Tickets and scratch paper End test Unit/Section Close test session in PearsonAccess after last Unit/third Section
only At this point, the status of all tests for all students in the test
session must be “Completed” or “Marked Complete”* *For Science and Social Studies, SACs must mark a student’s test complete
Administration Steps for Computer Testing
52
• School site log in • Start up TestNav 8 • Log in • Test transfer (from proctor cache)
o First item may take time to load • Read directions • Review sample items (Section 1)
Schedule Time for Setup and Transition - Computer Testing
53
54
Science and Social Studies Seal Codes
• Only three seal codes will be used for each assessment
• Cross off the last six seal codes to avoid confusion
PARCC ELA and Math Seal codes
Authorization/Testing tickets
During Testing: Security Breaches
Monitoring and Reporting Security Breaches and Testing Irregularities
1. All instances of security breaches and testing irregularities must be reported to the School Test Coordinator (STC), and subsequently, the DAC, immediately.
2. DAC will contact the state immediately upon receiving the call.
3. Testing Irregularity or Security Breach – PARCC: STC (SAC) will complete the Form to Report a Testing
Irregularity or Security Breach within two school days of the incident and send it to DAC.
– Science and Social Studies: SAC will complete the Test Incident Report and sent it DAC
57
During Testing: Contaminated & Damaged Materials PBT - Contaminated or damaged test materials must be replaced. Place Student ID label on replacement document or complete data grid. Record security barcode number of the damaged and new documents. Submit the Form to Report Contaminated Damaged, or Missing
Materials through PearsonAccessnext. If possible, transcribe responses from contaminated test material into
the replacement. If not, contact DAC Destroy contaminated material according to local biohazards protocols. Compile a list of contaminated/damaged Test Booklets, maintain the list
for 3 years, and notify DAC
58
Create a Plan and Train Staff for Safety Threats and Severe Weather Test Administrators and Proctors must:
1. Note the time of the disruption. 2. Secure test materials as specified in your School Security Plan. 3. Prepare students for the continuation of the Unit/Section and
resume students’ tests. 4. Document the situation in writing. 5. If the disruption will cause the Unit/Section to be carried over
into the next day, notify CDE.
During Testing: Safety Threats and Severe Weather
59
Make-Up Testing
60
Make-Up Testing
Make-Up Testing
• Students who are absent, become ill, or who can no longer test because of classroom, school, or technical interruptions during original units, may utilize make-up testing. • They may not return to questions previously viewed.
• Test security and administration protocols apply. • School Test Coordinators will establish the make-up testing
schedules for their schools. • PARCC ELA/Math Units may be taken out of order for make-
up testing only. • PearsonAccessnext functionality
• Science and Social Studies Sections may not be taken out of order.
Priority: minimize risk of prior exposure to test content that could result in an invalidation. 61
• Multiple screens may be managed in PearsonAccessnext at the same time.
Managing Test Sessions in PearsonAccessnext
62
Test Security
63
• Protection of student information and data. • Protecting the validity of the state assessments. • Proprietary information.
Test Security Protocols
64
• Successful Security Plan requirements: o All personnel have appropriate training. o All involved personnel understand security protocols. o All involved personnel have signed security agreements.
• Think about anyone who may be in the testing environment! o Test environments are secured against unauthorized
personnel. o Establish a documented chain of custody. o Materials are kept in a central, secure location with limited
access.
Security Plan
65
• Student Testing/Authorization Tickets
• Seal codes • Paper-based Test Booklets • Social Studies source books • Oral scripts • Used scratch paper • Any student work/responses • Mathematics Reference
Sheets prior to and after given to students
Test Materials Security Secure Non-Secure
• Test Administrator Manual (TAM)
• Procedures Manual • Test Coordinator
Manual (TCM) • Unused (not handed
out) scratch paper
66
• All secure test materials must be secured while in the Test Administrator’s possession.
• No duplication of secure CMAS materials is permissible (exception: Oral Scripts translated into languages other than Spanish).
• No cell phones or other communication, reproduction or recording devices are allowed during test sessions unless required for accessibility. o Manage devices!
Maintaining Security of the Assessments
67
• Document before, during, and after testing. o Any movement of secure materials must be documented.
• Deliver materials to schools no more than 1 week in advance.
• Complete the chain-of-custody form/school security checklist.
• Deliver paper based forms and materials (oral scripts) to Test Administrators only on the day of testing.
• Distribute only the content area being assessed. • Return materials to a designated secure location.
o Not stored in classrooms • Return materials to Pearson after testing is completed.
Chain of Custody
68
Receiving Test Materials
• Initial materials will be received 2 weeks prior to your district start date.
• Materials are packaged by school and shipped to the district.
• PARCC Quantities, which include 5% overage per school, are derived from the information provided in the Student Registration Import. • There is no overage for Science and Social Studies.
69
Contents of Initial Shipment
• Test Coordinator Kit o Resealable plastic bag (holds all materials) o Paper Bands o Pearson Scorable and Nonscorable Labels (different colors) o UPS Ground return labels for Scorable and Nonscorable materials o Pre-printed/pre-gridded Used Test Booklet/Return School Header o Student ID Labels and Roster o Return Instructions Sheet o Shipping Carrier Return Instructions
• Packing List and Chain-of-Custody Form • Test Coordinator Manuals • Test Administrator Manuals • Test Booklets • Math Reference Sheets, Rulers, and Protractors, if applicable • Large Print kits • Human Reader/Oral Script kits
70
Chain-of-Custody Forms PARCC
Districts may use these forms or create their own to track all secure materials. • District Chain-of-Custody Form for Initial Shipment of Materials Form
indicates: ‒ A full list of materials within the district ‒ Form and security numbers
• School Chain-of-Custody Form indicates: ‒ Security numbers for each secure test material ‒ Student and Test Administrator assignment ‒ Date and time for checked-out and checked-in of materials
• Computer-based Chain-of Custody Form ‒ Materials Moved from Locked Central Storage Area to Classroom ‒ Materials Moved from Classroom to Locked Central Storage Area ‒ Materials Securely Destroyed by Shredding
71
Documenting and Storing Test Materials
Upon Receipt of Test Materials, Test Coordinators should:
Remove the Packing List, Chain-of-Custody Form, and Test Coordinator Kit from Box 1. Use the Chain-of-Custody Form to document all test manuals and test materials
received. Inventory materials immediately to verify that there is an adequate number for
administration. NOTE: Count through the shrink wrap only. Do not open shrink-wrapped packages until two school days before testing, and do not distribute materials before the first day of testing.
Order additional material by contacting DAC, if necessary. Keep all test materials in a centrally locked storage area, with limited access, until
distributing them to the Test Administrators. Remind Test Administrators that all test materials must be distributed only on test
administration day and must be returned to secure storage immediately after testing.
72
Documenting and Storing Test Materials
Keep all boxes in which the test materials were delivered and use them to return Scorable and Nonscorable materials after testing is completed.
Report the following occurrences immediately to DAC using the Form to Report Contaminated, Damaged, or Missing Materials (see the Test Coordinator Manual): ‒ Non-receipt of any packages listed on the School Packing List. ‒ Discovery of a damaged test material. ‒ Discovery of missing or duplicate sequence numbers on any Test Booklets.
73
After Testing
74
Tasks to Complete After Each Unit/Section of Testing
Computer Based Testing – After Testing The day of testing:
• Collect materials (Testing/Authorization Tickets, scratch paper, seal codes, etc.).
• Ensure students have logged out of TestNav. • Return materials to STC/SAC using chain-of-custody form.
Paper Based Testing – After Testing The day of testing:
• Collect materials (Test Booklets, scratch paper, etc). • Ensure names are on Test Booklets. • Return materials to STC using chain-of-custody form.
75
Final Day: Tasks to Complete After Testing
Computer Based Testing – Final Day After Testing The final day of testing:
• Collect materials (Testing/Authorization Tickets, scratch paper, seal codes, etc.).
• Ensure Student Tests have been submitted/completed. • Ensure Test Sessions have been stopped. • Purge the cached test content. • Securely destroy materials listed on page 56 of TCM.
• School or District
Paper Based Testing – Final Day After Testing The day of testing:
• Collect materials (test booklets, scratch paper, etc). • Ensure labels are affixed or data grids are complete. • Securely destroy materials listed on page 56 of TCM.
76
Students who were absent or not tested (did not access any part of the test): • Paper Based Testing: Return test materials with non-
scorable o Mark not tested reason in PearsonAccessnext
• Computer Based Testing: DO NOT mark test complete o Mark not tested reason in PearsonAccessnext
• Specific directions about this process will be forthcoming.
PARCC: Non-Tested Students
77
• Keep Test Coordinator Manual and Test Administrators Manuals between PBA and EOY.
• Manuals are only sent to districts with PBA materials.
Manuals Reminder
78
Tasks to Complete After Testing
After Testing (continued) One week after the final Unit/Section:
• Organize and return test materials. ‒ Identify transcribed and damaged test materials as “Do Not
Score.” • Destroy/shred scratch paper and used Mathematics
Reference Sheets. • Must return used scratch paper for Science & Social Studies in
secure return envelopes. • Keep records for three years.
Within the final week of testing: • Enter any post test data such as accommodations or test
invalidations when DAC sends instructions
79
Support
80
PARCC and CMAS Support
http://avocet.pearson.com • An online,
alphabetical, topic-based index for assessment manuals and materials.
• Easy search capabilities.
• Frequently updated and updated on demand.
• News feed with the latest broadcast emails.
• Most popular topics are listed at the top.
• View pages, print results, and download full PDFs.
81
Science and Social Studies
Resources – Support Page
82
PARCC Resources
• PARCC Accessibility Policy Manual & Implementation Guidance o PARCC Accessibility Features and Accommodations Manual o Overview website page, including implementation appendices A-K o Translation Policy Memo o All located at http://www.parcconline.org/parcc-accessibility-
features-and-accommodations-manual www.parccconline.org • Training Modules
o Located at https://parcc.tms.pearson.com • Test Coordinator & Test Administrator Manuals for
Paper-based and Computer-based Testing o Found at https://PARCC.pearson.com on the Support page
• PARCC Test Tutorials and Sample Items o Located under Sample Sets and Tutorials of
http://PARCC.pearson.com 83
Contact PARCC Support for assistance with:
Pearson Support
Accessing resources
Setting up proctor caching
Submitting additional orders
Inquiring about shipments
Navigating PearsonAccessnext
Navigating the Training Center
Managing Student Registration Data
Setting up test units
Managing user IDs and passwords
PARCC Online Support and Resources:
http://PARCC.Pearson.com/Support
Call Toll Free: 1-888-493-9888
Email: [email protected]
(5:00 am – 7:00 pm CT, Mon.–Fri.)
CMAS Science and Social Studies:
Call Toll Free: 1-888-687-4759
Email: [email protected]
84
State or District Support
Testing schedule
Testing accommodations
Unusual circumstances on test days
Violations of test security
School emergencies that affect testing
Questions about general testing policies
Questions about state communications
Kimberly Terry [email protected] 303-340-0861 ext. 28335
Contact DAC for assistance with:
85
Additional Assessments
86
• A paper/pencil Spanish Language Arts test is being developed for grades 3 and 4.
• The Lectura/Escritura eligibility criteria will apply. • Updated decision making flowchart is on the website -
http://www.cde.state.co.us/assessment/spanishliteracyassessmentqualification
• Pending US Department of Education approval, this will be a census
field test Spring 2015 with the first operational administration in Spring 2016.
• Testing windows • Performance-Based Window March 16, 2015 - April 3, 2015 • End-of-Year Window April 27, 2015 - May 22, 2015
Spanish Language Arts Assessment
87
• Ordering information will be sent via DAC email once the process has been finalized.
• Currently recruiting educators for item review Feb. 3-5, 2015 https://www.surveymonkey.com/s/SpanishLanguageArts.
• Please contact Heather Villalobos-Pavia with any questions • 303-866-6118, [email protected]
Spanish Language Arts Assessment
88
• Colorado Alternate English Language Arts and Mathematics Assessments for Students with significant cognitive disabilities
• Grades 3-11
• Window: April 13th – May 15th
• Recorded trainings are available on the Assessment Unit website: http://www.cde.state.co.us/assessment/trainings
CoAlt: Dynamic Learning Maps (DLM)
89
Thank you
90
