School Test Coordinator TrainingSeptember 3, 2015

SCPCSD District Office Training Room

Today’s Agendao Introductionso The School Test Coordinator’s roleo Resources for the STCo Overview of all State Testso Test Securityo Lunch 12:00-1:00o Materials and Ordering—Precodeo English Language Learnerso Students with Disabilities o Accountability

Introductions

Please tell us:oYour nameoYour schooloWhat else you do besides testing

School Test Coordinators are:

o Organized—plans and implements effectively

o Responsible—Successfully completes tasks ON TIME

o Detail-Oriented—Assures Accuracy of every aspect and document related to testing

o Dedicated– go “above and beyond”

STC Responsibilitieso Coordinates the administration of all

statewide assessments, including preparation before and follow up after testing.

o Implements all policies/procedures for the assessments as directed by Test Coordinator and Test Administration Manuals, and SCPCSD Directives.

o Assures the security of all secure testing materials.

o Adheres to all state policies regarding test security.

STC Responsibilities (continued)

o Assures that students with Disabilities, Students with ELL Accommodations Plans and Students with 504 Plans receive appropriate testing accommodations.

o Assures that appropriate testing environments are maintained.

o Trains building level staff in test security administration. (Test Administrators & Monitors).

Resourceso Emails from the District Test Coordinator will

alert you of upcoming deadlines.

o Emails from Test Contractors (i.e., ACT)

o Test Contractor web pages and portals:o eDirect (for SCPASS and End of Course Tests)o ACT WorkKeys : South Carolina web page for

ACT WorkKeys (also for the ACT and ACT Aspire)

The Bookshelf on Sharepoint

Our Charter District site for sharing documents and resources !! The Bookshelfhttps://sccharter-public.sharepoint.com (GO To ASSESSMENTS)o Will include information such as:

o The District Assessment Calendaro STC Handbooko PowerPoint Trainingso Links to eDirect, SCDE websites, and contractor websiteso Contact information for Customer Support

Testing Calendar

*Many dates are TBD.

o The Assessment Calendar will be on SharePoint.

o Caution: Test Manuals for some tests will list the State Testing Window. Districts are often required to select a shorter window of dates within the state window.

Updates for 2015-16

o 32 Schoolso More online availability

o Still unknown!o gr. 3-8 ELA and math

test, o gr. 11 college and career

readiness assessmento ELL assessment

State Assessments

*Scheduled Tests

4K Readiness

oMy IGDIS (Individual Growth and Development Indicators)

oAn early literacy measure

o Individual Administration required first 45 days and last 45 days

5K Readiness

o Developmental Reading Assessment 2

o Provides a measure of independent reading level and comprehension

o Individual Administration required first 45 days and last 45 days

CogAT/IAo Name: Cognitive Abilities Test & Iowa Assessment o Grades: 2nd o Subject Areas: Aptitude (verbal, quantitative, and

nonverbal), reading, and matho Test Dates: October 21– November 11 o Format: Paper-and-pencil

 Who is tested?The norm-referenced tests (aptitude and achievement) for gifted and talented screening are administered in the fall of each year to students in grade 2. The information from the administration of the norm-referenced tests is entered into the GIFT software program, which identifies students who qualify for the program. Based on the results from the norm-referenced tests, a secondary screening using a performance assessment may be required for possible candidates.

Performance Tasks Assessment

o Name: SC Performance Tasks Assessmento Grades: Typically 2nd, but may include otherso Subject Areas: Verbal and nonverbalo Test Dates: February 16– March 3o Format: Paper-and-pencil with preteaching and

manipulatives Who is tested?Students who partially qualify as Gifted and Talented in either Dimension A or Dimension B, but not both, based on CogAT/ITBS scores, may be given the Performance Tasks Assessment. This assessment provides a second opportunity to become identified as Gifted and Talented.

EOCEPo Name: End-of-Course Examination Programo Grades: 7-12o Subject Areas: Algebra 1, English 1, US History and the

Constitution, and Biology 1o Test Dates: January, May, Julyo Format: Paper-and-pencil or Online

 Who is tested?All students who are enrolled in courses in which the academic standards corresponding to the EOCEP tests are taught must take the appropriate tests. The examinations count 20 percent of the students’ final grade in each course.

Alternate AssessmentsSouth Carolina Alternate Assessment (SC-ALT) and National Center and State Collaborative (NCSC)

o NCSC – ELA and Math-ages 8-13 and 16o SC-ALT – Science and Social Studies, ages 9-13; Biology, age 16o Test Dates: March 1-29, 2016o Format: Paper-and-pencil

 Who is tested?Alternate assessment is for students with significant cognitive disabilities who are unable to participate in the general assessment program even with accommodations. Students must meet the participation guidelines for alternate assessment.

State TestsWith undetermined dates

Procurement activities not finalized

EOCEP-Geometry, English 2

oName: End-of-Course Examination Program

oGrades: 7-12o Subject Areas:  Geometry, English

2 If required for federal accountability.Test contractor names and administration dates to be announced.

SCPASSo Name: SC Palmetto Assessment of State Standardso Grades: 4-8o Subject Areas: Science and Social studieso Test Dates: May o Format: Paper-and-pencil or online

 Who is tested?o Students in grades 4-8 take both science and social

studies. o Dates to be announced when the Summative

Assessment ELA and math dates are announced.

ELA and Math Summative Assessments, Grades 3-8

Test names and administration dates will be announced as soon as procurement activities are finalized.

College and Career Readiness Assessment

o All students in grade 11 and students in their third year of high school must be administered a College and Career Readiness Assessment and WorkKeys.

o The College and Career Readiness Assessment is still TO BE DETERMINED. Test name and administration dates to be announced.

English Language Proficiency

o To Be Announced as soon as the procurement activities are finalized.

o Test Dates: typically mid February – mid March

Who is tested?All students in grades K-12 who are determined to have limited English proficiency - based upon the completion of a Home Language Survey and the initial assessment of their English proficiency. This includes those students whose parents have waived direct ESOL services.

Participation is expected to be 100%, verified by the SCDE Title III office.  

WorkKeyso What Is WorkKeys? A job skills

assessment published by ACT.

o Three 45 minute assessments: reading for information, applied math, and locating information.

Dates: Negotiations with ACT are in progress.

Non-State TestsNAEP

Formative AssessmentsPSAT AP

NAEP-National Assessment of Education Progress

o Grades: 4, 8, and 12o Subject Areas: 12 subject areas Test Dates: January –

Marcho Format: Paper-and-pencil; pilot testing of tablets in

2015, technology based assessments begin in 2017.Who is tested?NAEP statisticians carefully select a sample of students to represent the entire student population. Main NAEP is administered to students in grades four, eight, and twelve; however, samples for long-term trend are based on age (9, 13, and 17) rather than grade. Test scores and questionnaire responses are always kept confidential. Results are never reported for individual students or schools.  For the 2015-16 school year, NAEP assessment will focus on the Arts. NO DISTRICT PARTICIPANTS.

Formative Assessments

The following assessments have been approved by the State Board of Education:

oBlending Assessment with Instruction Program (BAIP-Math)

o STAR Reading and STAR Mathematics

oMeasures of Academic Progress (MAP)

o Istationo I-Ready – Paid for by the SCPCSD

in 2015-16!

Funding for Formative Assessments

Funding ProcessEach year, schools complete a survey to indicate the number of students tested and submit an invoice showing funds spent. The state collects this information from all districts and allocates funds based on the number of students tested statewide.

Reimbursement varies each year and is not expected to be 100%.

PSAT/NMSQTo The PSAT can be administered by Schools with a

Level II code from the College Board.

o Schools without a Level II code should refer students to other schools

o The SCDE Office of Assessment will pay the College Board for all TENTH grade students who take the in grade 10 in 2015-16.

o Test Date: October 14, 2015

APo Name: Advanced Placemento Grades: Typically 11 & 12o Subject Areas: 31 subjects including Calculus, Biology,

& English Lito Test Dates: Mayo Format: Paper-and-pencil

 Who is tested?The state will pay for students enrolled in approved Advanced Placement courses to take the exam (students may pay a small administrative fee). Any student may take any exam for $89.

Schools must apply to the College Board for a level II code in order to administer AP exams. Students may make arrangements with their local high school.

Questions?

Test Security

Dr. Kathryn Rhodes, SCDE

Test Securityo DTCs, STCs and all personnel involved in

paper/pencil and online testing must be familiar with SC test security legiislation and State Board Regulations.o Pages 11-14 in Handbooko Pages 13-14: Read X. A-U

Any suspected violation must be reported to the DTC

Test Security Agreement Forms

o All STCs, TAs, and Monitors must sign after receiving training

o Scan and Return to district office and keep copies.

o In 2015-16 you will be asked to return these prior to the test dates.

Storage Policies

o Secure materials must be kept in secure, locked storage when not in use.

o If possible—no outside or inside windows.

o No copy or fax machine or frequently accessed materials in the room.

Security of Materials

o Do not leave secure materials unattended at any time. If a TA must leave the room before testing begins, materials should be placed in a locked drawer, cabinet, etc. or materials should be taken with the TA.

Security Checklistso Schools and districts are required to

use security checklists to track distribution and return of all secure paper/pencil test materials

o STCs, TAs, and monitors are responsible for ensuring that all test materials and student responses for online tests are handled in accordance with security procedures outlined in the TAM.

ProctoringState Board Regulation 43-100, X, C: “Failing to proctor the test to ensure that examinees are engaged in appropriate test-taking activities” is considered a security violation.

o Preparation- The TAs should make certain they

have read the test manual and are well-prepared.

o TAs should not deviate from the directions for

conducting the test.

Proctoring ( continued)o TAs should be alert and move throughout the

room during testing in order to:o observe any apparent cheating, talking, or copying,o Observe any cellphone use or use of electronic deviceo Check that students are following directions for marking

responses or entering into the online testing system.

o Monitors may not be left in charge of a classroom in which students are testing or in which test materials are not in secure storage.

Testing Violations-2014These are actual violations that occurred in our district in 2013-14:o A test Administrator was using a cell phone during a small group

administration of a high school test.o A student did not receive a test in a small group even though small

group administration was included in his IEP.o A student was not allowed to type responses although his IEP specified

that he should be allowed to do so.o A student received an oral administration accommodation of the SC

PASS test but the student did not have an IEP or 504 plan .o A student was allowed to type responses even though typing responses

was not an accommodation for that student.o Student was allowed to use a calculator (not in IEP).o A teacher administered the entire CogAt test on one day even though

the Test Administration Manual specified that specific subtests be given on specific days..

o A test booklet and answer document were not returned on time.

Testing Violations (2015)

o A TA administered the ACT with Timing Accommodations when the students should have had the standard administration.

o A LEP student was supposed to have oral administration of the Algebra EOC and did not receive it.

o The ACT was administered to a small group of Students with Disabilities using the WorkKeys manual.

o The TA left a monitor with students taking the SCPASS makeup test while he went to another room to read directions to another group of students taking makeups.

o CogAt/IA tests were returned to the contractor several days late.

ConsequencesStudent:o Invalidation of test scores

Teacher:o Report to SLED for information or investigationo Suspended/Revoked Certificate

School:o Letter of Caution from the District Officeo Probationo Revocation

Remember that failing to report a violation is also a violation!

Security for Online Testing

o Test tickets are secure; use testing roster, in lieu of security checklist, to account for tickets.

o Online test may not be viewed by anyone prior to the test session.

o TAs are expected to ensure that visible online tests are not left unattended.

o Use of traditional desktop and laptop computers is recommended for online testing.

o If Chromebooks or iPads are allowed schools will be responsible for ensuring test security on these devices and will be accountable for any atypical impact on students test scores.

Test Security –case 1

Mr. Edwards, a teacher at Springfield Middle School, is very thorough. His students are taking the SCPASS test online this year, and Mr. Edwards wants to make sure that his students get as many points as possible on the test.

During testing, as each student finishes, Mr. Edwards asks them to go to the Review/End Test screen. If he sees a blank response, he instructs the student to return to the item and answer it.

Case 1 ExplanationThis is a test security violation. TAs should not examine an online test or a paper answer document to make sure all of the questions were answered.While moving around the classroom, it is permissible for TAs to check that students are following the directions for marking their responses on the computer screen or in the answer document. It is not permissible to stop and read test items or check students’ responses on the computer screen or in their answer documents. The TA may make general announcements to the class such as reminding students to check their answers before exiting the test or to do a good job of erasing on the paper answer documents.

Test Security-Case 2 All classrooms at High-Tec Middle

School have computers. Ms. Twitter, a frequent user of her computer, e-mailed her colleagues after testing to ask if they noticed the question in the social studies test about the Museum of Ancient History.

Case 2 Explanation Ms. Twitter is guilty of several test security

violations. TAs and other personnel are not permitted to read test items before, during, or after testing. Based on her e-mail message, it appears that Ms. Twitter read a question in one of her student’s test booklets. She should not have done this unless she was conducting an oral or signed administration using a secure script. In addition, TAs are not permitted to disclose or discuss the contents of any test with students, teachers, or other personnel. Here again, Ms. Twitter committed a test security violation by e-mailing her colleagues with a reference to secure test content.

Test Security-Case 3

In order to save time, Mr. Fatica decided to have his students practice the Online Tools Training (OTT) for the End of Course test immediately before the actual test administration

To be efficient, he handed out the Student Test Tickets as soon as the students were seated. The class then began to work on the OTT as a group, openly discussing the practice items. Four students mistakenly used their test tickets to login to their actual tests during the OTT session. By the end of the OTT session, they had nearly completed the entire test

Case 3 Explanation This is a test security violation for several

reasons. As indicated in Appendix B of the SCPASS TAM, the OTT should be used prior to the online testing window, not immediately prior to an actual test session. The TA failed to follow directions as specified in the test manual, but the TA also violated S.C. Code Annotated Section 59-1-445 (2004) by giving examinees access to the test questions prior to testing.

Test Security-Case 4Mrs. Hansel, the Special Education Coordinator, developed a plan for ordering customized materials and arranging for SCPASS testing accommodations. In December, she asked all teachers at Stonehouse Middle School to provide her with a list of the testing accommodations specified in each student’s IEP and/or 504 Plan. Teachers sent this information to Mrs. Hansel.

After testing was completed, however, it was discovered that one of Mr. Gredler’s students had not received an accommodation for science as specified in his IEP. A review of the situation revealed that Mr. Gredler had provided Mrs. Hansel with the student’s IEP accommodations for social studies, but not for science.

Case 4 Explanation

Not providing accommodations as appropriate for students with IEPs or 504 Plans is a test security violation. Because the student in Mr. Gredler’s class did not receive the accommodation specified in his IEP, an IEP team meeting must be convened as specified in the SCPASS TAM to determine whether or not the science test administration should be considered valid.

Avoiding Common Security Mistakes

o Develop an effective system for ensuring that students receive the correct accommodations.

o Provide a comprehensive training for Test Administrators and monitors.

o Emphasize that test manuals must be read in their entirety. It is not sufficient simply to attend training.

o Encourage Test Administrators and monitors to contact you immediately if there is a questionable situation. Make sure you are available by phone. Testing is not the time for Test Administrators to make independent decisions.

Avoiding Common Mistakes with Materials

o Use security checklists provided by test contractors.o Test Administrators sign out tests and sign them back in.

o Know exactly how many documents each TA is responsible for.

o COUNT, COUNT, COUNT every time documents change hands.

o Identify which student used which document.o Conduct a final inventory, then sign the security checklist.o Double-check all labeling.o Separate scorable from non-scorable.o Keep a count of scorable documents.o Follow diagrams in the TAM for packaging order.o Complete Header Sheets if required.o Return materials by the stated deadline.

Security Questions

PLEASE ASK…o If a student was not given the proper

accommodation, but this error was discovered and the student is given a different form of the test, does this still constitute a security violation?

LUNCH

12:00-12:45

Preparation for Testing

o District Test Coordinator emails to you and emails sent to you from contractors will provide guidance regarding deadlines and next steps.

Know your deadlines!

o 1. Precoding in PowerSchoolo 2. Contractor websites/portals

Precodeo The Precode Process – Sends student

information in school databases to testing contractors for the purpose of pre-assigning answer documents and test booklets via barcoded documents and labels.

o (Provides the same data for online testing)

o Eliminates manual coding, which saves time and labor and prevents errors.

Importance of State ID

o Test contractors require state ID values to be unique and have a value for each student. Students with no state IDs and students with duplicate state IDs will not be precoded.

Precodeo Communicate with your PowerSchool

Administrator about:o Sorting materialso Customized materialso Paper vs. online administration

o Data Collections – whole school responsibility. Work closely with PowerSchool Administrator, Special Education Coordinator, and Title III Coordinator to ensure that accurate data is uploaded by Test Contractors.

Precodeo Precode Data Collections:

o Kindergarten Readiness—August 24, 2015o CogAT/Iowa Assessment – August 28, 2015o Fall EOC: October o Spring Print Phase: Januaryo Spring Update Phase: March

o Communicate with your PowerSchool administrator!!

o Communicate with your Special Ed coordinator!!o Pay attention to Precode vs. other ordering

instructions to ensure that accurate data is uploaded by Test Contractors.

Online Participation

o Available Online:

o EOCEPo SCPASSo CogAt/IA (if your

school previously signed up)

o Gr.3-8 assessment and Gr. 11 summative assessment

o NOT Available Online:

o SC Performance Tasks

o Gr. 4 and 5 Readiness

o WorkKeys (no lockdown browser)

EOC Participation

o Make sure that Student is enrolled in a section with the proper course codeo 4111 Algebra 1o 3142 Math Tech 2o 4117 Intermediate Algo 4114 Common Core Alg 1o 3011 English 1o 3024 Common Core Eng 1o 3221 Biology 1o 3227 Applied Biology 2o 3320 US Historyo 3372 AP US Historyo 336D IB History of the

Americaso 3322 Dual Enroll. American

Hist.

o Will the student test online or on paper?

Sort Fieldso As of October 2014, the Sort ID fields affect ONLY

SCPASS o Use one of four options:1. An Alphanumeric entry up to 9 characters to sort by

teacher, test administrator, or other grouping.2. AWG to sort alphabetically within grade3. If Sort ID is blank, materials will be sorted by Home

Room. 4. If Sort ID & Home Room are blank, materials will be

sorted AWG.

PrecodeOral/Signed Administration

o Teacher-level materials (Script and/or CD-Rom)o Must be ordered via eDirect for SCPASS &

EOCEP

o Student-level materials (Test booklet)o Must be coded in PS for SCPASSo Must be coded in PS for online EOCEP

For paper/pencil Oral Administrations, MAKE SURE the student booklet is the correct form to match the script.

eDirecteDirect is the website for the test contractor Data Recognition Corporation (DRC). DRC provides the SC PASS Assessments (social studies and science) and EOCEP Assessments for our state.Each STC is provided with an account on eDirect (https://sc.drcedirect.com). Contact the DTC for assistance logging in or using eDirect. This account is used to:

o Order test materialso View and download documents such as the TAMo Access online software downloads and training tools for

online assessmentso View reports after testing is completed

ACT Testing: SCo ACT Testing: South Carolina o www.act.org/aap/southcarolina/act/

htmlo Contains Checklist of dates,

Manuals and Supplements, Training, Score Reporting, and Customer Services contact information.

o Each STC is provided with an account.

English Language Learners with ELL Plans

Vamshi Rudrapati, Director of Federal Programs

English Language Learners

o A limited English Proficient (LEP) –a student who has a primary language other than English and is not proficient in listening, speaking, reading, writing, or comprehension in the English speaking classroom as determined by a language assessment instrument.

Precode for LEP students

o In PowerSchool, the appropriate code for each student is based on the ACCESS or ELDA test score.

o For new students, coding in PowerSchool is based upon performance on the assessment used for initial placement.

No alternate language formats

o Assessments are NOT available in languages other than English.

o Test Administrators may not translate any part of the tests except the test directions.

ESOL/LEP students and PowerSchool Codes

o PowerSchool codes 1-7 can receive accommodations.

o PowerSchool codes 8 and 9 do not receive accommodations.

Accommodations -LEP

o Accommodations should be used only as appropriate for individual students and should not be applied to all LEP students indiscriminately.

Accommodation Plan-ESOL/LEP

o Generally, the same accommodations that are available to Students with Disabilities are available to LEP students.

o Accommodations should be recorded on the student’s accommodations form and kept with the student’s ESOL folder.

ELL Exit Criteria

• An ELL student CANNOT be exited from the ELL Program until the student meets the state exit criteria on the State English Language Proficiency Assessment.

Special Education and Assessment

Beckie Davis, Director of Special Education Services

It’s the Law!

o Students with disabilities must be included in state and district assessments.

o Assessments must provide for accommodations for students with disabilities.

State Board Regulation XO

o XO. Not providing accommodations (to include customized forms and modifications) as appropriate for students with IEPs or 504 Plans. This includes providing more accommodations (customizations, modifications) than appropriate.

Validity of Assessments

o Not providing accommodations or providing additional accommodations jeopardizes the validity of the inferences made on the basis of test data.

Students with Disabilities

o All of the following accommodations must correlate:o Stated in IEP or 504 o Received during regular instructiono Received during testingo Coded on answer documento Coded in PowerSchool

o Standard vs. non-standard (team decision)o Only route to accommodations is IEP or 504o Exception: temporary conditionso Violation requires review by IEP or 504 team

Extracted from PowerSchool

Oral administration Signed administration Custom Materials (loose leaf,

large print

Ordered from Contractor

Oral administration scripts and Braille oral administration script for paper testing

(for TEACHER USE: SCPASS and End of Course.) Test booklets for paper testing (EOC)

Accommodations that do not require special materials:

o Setting accommodations: preferential seating, separate location, small group, and individual administration

o Timing Accommodations:-frequent breakso Scheduling accommodations:-several

sessions per day, time of day, administering the test over several days.

o Presentation Accommodations: reading test aloud to himself, TA signing directions, TA highlighting key words, etc.

When in doubt, ask!

o If accommodations are on the IEP and NOT listed in the Test Administration Manual…..

o Contact Beckie and/or Jean

AccountabilityCourtney Mills, Director of Academic

Programs

Accountability95% participation requirement is based on:o First day of testing (FDT) datao Students not tested (SNT) data

o Medically unable to attend school or receive instructiono Homebound and physically or mentally unable to testo Expulsiono Withdrawalo Death of the student or a family member**All students not tested must have a reason entered in PowerSchool, even if the reason does not qualify for an exclusion. For example, parent or student refusal to test.

o Every subgroup of at least 30 students

Who “Counts”?

Test Participation Test Performanceo If a student is enrolled on

the first day of testing, he or she MUST take the test

o The goal is 95% participation overall and in every subgroup (gender, ethnicity, SES, etc.)

o Applies to the new assessments in ELA & Math

o New Assessments (ELA/Math): Students’ scores only count if they are enrolled continuously from the 45th day through the first day of testing

o EOC (Bio & USH): Every score counts

First Day of Testing

o Data will be extracted on or about the first day of each test

o Student enrollment must be up-to-date

o Accountability implications

Students Not Tested Reporting

If a student misses any portion of PASS, NCSC, SC-Alt or the new accountability exams that he or she was supposed to take, you must complete the SNT fields on the Precode page.

Students Not Tested Reporting

o If a student withdraws MORE THAN one week prior to testing, he must be properly withdrawn in PowerSchool before the first day of testing.

o If a student withdraws LESS THAN one week prior to testing, and you properly withdraw him in PowerSchool before the first day of testing, there is nothing else you need to do.

o If a student withdraws LESS THAN one week prior to testing, and you do NOT withdraw him in PowerSchool before the first day of testing, then you must complete the SNT fields for that student.

Standards & Assessment

ELA/Matho 2015-16: Teach and assess SC College-and

Career-Ready Standards

Scienceo 2015-16: Phase-in of 2014 standards continueso 2015-16: Assess 2005 standardso 2016-17: New standards will be assessed

Social Studieso 2015-16: Teach & assess 2011 standards

Students with Disabilities

True Gradeo Make sure the True Grade Field is BLANK for all students!

Effect on Accountabilityo Students are expected to test based on their true

grade.o There are consequences for incorrectly coding

this field, including reduced participation rates or incorrect performance rates if students take the incorrect grade-level assessment, or reduced graduation rates if a high school student’s 9GR conflicts with the true grade.

Students with Disabilities

o Students are classified by the Instructional Setting field in PowerSchooloWill include more studentsoSome schools may now have a large enough subgroup to count.

Contact us with Questions

Jean EppsCoordinator of Assessmento jepps@sccharter.orgo 803-734-0117o Test administrationo Test security/violationso Precode

Courtney MillsCoordinator of Academic Programso cmills@sccharter.orgo 803-734-0525o Accountability Questionso First day of Testingo Students Not Tested