Slide 1

Slide 2 QualityCore New DAC/BAC Test Administration Training August 16, 2013 Scot Calvert ACT, Inc. Jennifer Stafford Policy Advisor Kentucky Department of Education Jennifer.stafford@education.ky.gov Slide 3 Agenda Whats New Testing Windows and Sessions Responsibilities and Deadlines Accommodations Materials Group Headers Answer Documents Return Shipping Prohibited/Acceptable Materials Online Testing Resources 1 Slide 4 Glossary of Terms CBT-Computer Based Testing P&P- Paper and Pencil Vantage- ACT QualityCores online system VanGuard 2 Slide 5 Whats New Removal of graduates from Vantage (2012 and 2013) KDE/ACT upload/update of student accounts Inactivate duplicate student accounts Bulk Student Roster Upload Function Preparation for year three State Course Codes Online Stress Test 3 Slide 6 Removal of Graduates from Vantage New Policy: Graduates will be removed from the Vantage system by ACT in December following graduation dates. Allows school staff time to print Individual Student Reports. ACT and KDE will work together to determine when this effort will be complete. Please review the DAC Monday e-mails for additional information about this effort. 4 Slide 7 Create and Upload Students KDE will extract from Infinite Campus (IC) students enrolled in IC at the high school level within each district. Be sure student records are updated in IC by September 6 ACT will create student accounts at the appropriate school. Student grade levels will reflect current status in IC. Accounts for students enrolled after this effort will need to be created or moved by the school. Note: Middle school students taking courses for high school credit will not be included. 5 Slide 8 Duplicate Student Accounts KDE and ACT are working collaboratively to purge the system of duplicate accounts. The target is to have this work done this fall. After this effort, school staff should review school lists to verify quality of work. Please review DAC Monday e- mails for additional information. 6 Slide 9 Bulk Student Roster Upload New function available to add multiple student records to roster(s) via upload. Detailed instructions will be posted to ACTs QualityCore website prior to the start of October testing. The instructions document will also be sent via the DAC Monday e-mail. Ad Hoc currently in Infinite Campus for each course EOC Bulk Roster Registration Algebra II EOC Bulk Roster Registration Biology EOC Bulk Roster Registration English II EOC Bulk Roster Registration U. S. History 7 Slide 10 Preparation for Year Three Creation of new teacher accounts Inactivate teacher accounts no longer in the school Upload student demographics per the layout in Vantage Addition of new ninth graders 8 Slide 11 KDE State Course Codes English II Biology 230110-English 2 230162-Pre-IB English 2 302601-Life Science/Biology 1 302602-Biology II 302611-Biochemistry 302613-Microbiology 302614-Ecology 302623-IB Environmental Systems 302643-Pre-IB Biology 302644-IB Biology 2 302645-IB Biology 3 302646-AP Biology 302680-AgriBiology 302685-Agriscience 302698-Intro Biology with Earth/Space Science 303010-Astrobiology 303091-Integrated Science I 303092-Integrated Science II 303093-Integrated Science III 302603 - Honors Biology (newly added) 302618 - Medical Science (newly added) 9 270311-Algebra 2 450809-U.S. History Survey 450812-United States History, Reconstruction to the Present 450814- AP American History Algebra II U.S. History Slide 12 Online Stress Test The purpose of this assessment is to provide Kentucky educators assurance the online system will work with a large number of students in the system at once. ACT must prove the system has been fixed; if it cannot, the state will likely look for a different testing vendor for the 2014-15 school year. *See August 19, DAC Monday E-mail for more details. 10 Slide 13 When students are tested 11 Example 1Example 2Example 3 Student passes semester 1 Student passes trimester 1 Student passes semester 2 Student fails semester 2 Student fails trimester 2 Student takes examStudent retakes semester 2 Student takes trimester 3 Student takes examStudent retakes trimester 2 Student takes exam Slide 14 12 Two Sessions Two separate EOC sessions Multiple Choice 1 (Paper or Computer) Multiple Choice 2 (Paper or Computer) School staff may choose to utilize both paper and CBT at the same site. Users must complete both sections using the same mode (paper or CBT) Sessions are 45 minutes each Paper sessions are timed by the test administrator. Computer sessions are timed automatically by the computer. Slide 15 Testing Sessions Paper Testing: ALL students must be tested at the same time, in the same content area. Computer Testing: Multiple testing sessions can be utilized in a single day. The first computer based test must begin at the same time as the paper based test. Note: A 10-15 minute break is allowed between test sessions. 13 Slide 16 14 Testing Windows (Includes Paper and Computer Testing) Six EOC test windows per year August 1-September 13 October 1-November 15 December 2-January 17 February 3-March 14 April 1-June 13 June 16-July 15 Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions. Within the 10-day window, schools choose one day per content area. Note: MC1 and MC2 must be given in order on the same day. May schedule multiple content tests on same day. Slide 17 15 Non-Traditional Windows (Includes Paper and Computer Testing) Six EOC test windows per year August 1-September 13 October 1-November 15 December 2-January 17 February 3-March 14 April 1-June 13 June 16-July 15 Within each window, schools choose one day per student(s) to complete sessions. Note: MC1 and MC2 must be given in order on the same day. May schedule multiple content tests on same day. Slide 18 Traditional vs. Non-Traditional? High Schools with only Traditional Courses: Use Schools 10-day window Alternative Schools with only Non-Traditional Courses: Use States broader window Schools with both Traditional and Non-Traditional Courses: Use both schools 10-day and States broad window 16 Slide 19 Access to Online System Username and Password Needed https://qc.vantage.com/qualitycore/do/log DACs grant access to others in the district 17 Slide 20 Steps for Ordering Confirm Unit Usage (DACs/Designee) Create/Upload Users & Teachers (DACs/Designee) Create/Upload Students (KDE/ACT, Local) Create Class Test Rosters (Local) Finalize Class Rosters (Local) Note: Valuable Resources are located at: http://www.act.org/stateservices/kentucky/before.ht ml http://www.act.org/qualitycore/qcresources.html 18 Slide 21 Responsibilities District or School Administrator: Conduct Administration Code and Inclusions Training Confirm Unit Usage per school Determine Paper or Computer Testing Estimate Number of Students Testing ACT will print the Confirmed Unit Usage per school. DAC/BAC should order additional tests to ensure enough materials are received. Determine Testing Dates Create/Upload Students (New enrollees) 19 Slide 22 Create and Upload Students KDE will extract from Infinite Campus (IC) students enrolled in IC at the high school level within each district. ACT will create student accounts at the appropriate school. Student grade levels will reflect current status in IC. Accounts for students enrolled after this date will need to be created by the school. Note: Middle school students taking courses for high school credit will not be included. 20 Slide 23 Responsibilities School Administrator: Create Class Roster Name: Options 1. Name by school, course, teacher, and period i.e. CCHS, Algebra II, C. Greer, period 5 2. Name by school, course, per teacher i.e. CCHS, Algebra II, C. Greer 3. Name by school, course i.e. CCHS, Algebra II Note: Separate class roster for extended time for computer based (specific timing). 21 Slide 24 Responsibilities School Administrator or Teacher: Finalize Class Rosters Verify all students to be tested are on roster No roster in SDRR at this time Print or save electronic copy to use as a reference for accountability in SDRR at the end of school year. Create seating chart 22 Slide 25 Test Form Changes 23 Before Form Change All end 2012-03-31 After Form Change All end 2012-07-31 During Form Change Ends 2012-03-31 Ends 2012-07-31 Slide 26 Target Dates Deadlines for August 1 September 13 Begin Testing the Week of:August 1August 5August 12August 19August 26September 2September 9 Confirm Unit UsageJune 6June 10June 17June 24July 1July 8July 15 Create/Upload Users & TeachersShould be Complete Create/Upload StudentsJune 20June 24July 1July 8July 15July 22July 29 Create Class Test RostersJune 27July 1July 8July 15July 22July 29August 5 *Finalize Class Rosters July 4July 8July 15July 22July 29August 5August 12 24 *Finalize Class Rosters must be completed four (4) weeks and one day prior to testing. Other dates are targets for workload management. Slide 27 Target Dates Deadlines for October 1 November 15 End-of-Course Testing Begin Testing the Week of: October 1October 7October 14October 21October 28November 4November 11 Confirm Unit Usage August 6August 12August 19August 26September 2September 9September 16 Create/Upload Users & Teachers Should be Complete Create/Upload Students August 20August 26 September 2September 9September 16September 23September 30 Create Class Test Rosters August 27 September 2 September 9September 16 September 23 September 30October 7 *Finalize Class Rosters September 2 September 8 September 15September 22 September 29October 6October 13 25 *Finalize Class Rosters must be completed four (4) weeks and one day prior to testing. Other dates are targets for workload management. Slide 28 Target Dates Deadlines for December 2 January 17 End-of-Course Testing Begin Testing the Week of: December 2December 9December 16 December 23December 30January 6January 13 Confirm Unit Usage October 7October 14October 21NANovember 4November 11November 18 Create/Upload Users & Teachers Should be Complete Create/Upload Students October 21October 28November 4NANovember 18 November 25December 2 Create Class Test Rosters October 28November 4November 11NANovember 25December 2December 9 *Finalize Class Rosters November 3 November 10November 17NADecember 1December 8December 15 26 *Finalize Class Rosters must be completed four (4) weeks and one day prior to testing. Other dates are targets for workload management. Slide 29 Accommodations 2009 Inclusion of Special Populations Must have a current IEP, 504 or PSP with accommodations listed Accommodations should not be introduced just for the assessment Must be student initiated Accommodations must not impact content validity 27 Slide 30 Accommodated Testing Paper OnlyPaper and Computer R = Reader A = Audio B = Braille LP = Large Print Scribe Extended Time Paraphrasing Manipulatives Prompting/Cueing Behavior Modification Interpreter (sign language) Dictionaries/Thesauri 28 Slide 31 Ordering Accommodated Test Materials Navigate to http://www.act.org/stateservices/kentuckyhttp://www.act.org/stateservices/kentucky Select the Resources tab (top right side of screen) Select Test Accommodations (left side of screen) Download and complete the KDE Accommodated Testing Materials Order Form. Once the order form is completed, email it to QualityCoreCustomerService@act.org QualityCoreCustomerService@act.org Note: This process is for accommodated materials, not test booklets. Paper units must be allocated to the school and students must be on finalized roster for order to be complete. 29 Slide 32 Ordering Accommodated Test Materials Order Deadline This includes ordering of reader scripts. E-mail Form to QualityCore Customer Services (QualityCoreCustomerSercice@act.org) Form available at: http://www.act.org/stateservices/kentucky/accommodations.html http://www.act.org/stateservices/kentucky/accommodations.html 30 Begin Testing the Week of: October 1October 7October 14October 21October 28 November 4 November 11 Accommodations Order September 3September 9September 16September 23 September 30October 7October 14 Begin Testing the Week of:December 2December 9December 16 December 23 December 30January 6January 13 Accommodations OrderNovember 4November 11November 18 NADecember 2December 9December 16 Begin Testing the Week of:August 1-September 15 Accommodations OrderShould be complete Slide 33 Exemption Types Medical Exemption choice requires more detailed information, including Date of Diagnosis and Hospitalization. More detailed descriptions are needed for approval. Extraordinary Circumstance (Other Exemption) choice has open field to enter information. For both types of exemptions, see the associated Medical Exemption and Extraordinary Circumstance forms on the KDE website. Procedure Change: SDRR will be open for exemption applications in Fall and remain open throughout the school year. 31 Slide 34 Exemption Information Student identifying information Name SSID Grade Gender DOB School Name Test Type Exemption Type Explanation of Medical or Extraordinary issue Relevant dates 32 1.Keep paper form on-file in the district. 2.Enter information electronically into SDRR. An Exemption Request is NOT automatically approved. Slide 35 Receiving/Storing Materials Shipment going to DACs will be identified with course name, school and BACs name, as well as course name for easy distribution Check shipment contents Testing Boxes Test Booklets with answer document. Reference Sheets- Alg 2 only Test Supervisors Manual, Room Supervisors Manual School Header Group Header- One per roster plus a small overage Box 1 Contains Packing List 33 Store SECURELY LOCKED storage Discrepancies Call (866)764-7228 Slide 36 Seating Chart 34 Slide 37 Group Headers One per roster created online Group headers will be pre-printed with School name, Test Roster name, Course code, and Test Assignment Roster ID. Example: If Ms. Jones has 3 Algebra II rosters in Vantage, there will be 3 separate Group Headers. 35 Slide 38 36 B: Test Roster Name A: School Name C: Course D: Vantage Test Assignment Roster ID Slide 39 Combined MC Test Booklets No longer separate multiple choice test booklets. Change effective spring of 2013. Student answer document with embedded student information is located inside the test booklet. Cover of test booklet contains embedded roster and student information. Booklets are packed by roster for easy distribution on test day. 37 Slide 40 Answer Document without embedded student info. Student On Roster: If student is on the roster, click on the name to locate QualityCore ID. Complete boxes A thru D on answer document. Student Not On Roster: Add student to roster from User Student List. Complete boxes A thru D on answer document. **Students name must be gridded on answer document exactly as shown on roster. **If units not available, contact DAC to have more units allocated to your school. 38 Slide 41 Bubble student information 39 Slide 42 Return Shipping: Group Headers 40 Group Header 1 Roster 1 Roster 2 Group Header 2 Slide 43 Return Shipping Packing Envelopes Used Answer Documents Testing Irregularity Report Instructions can be found in the Test Supervisors Manual Boxes Used and unused tests booklets in the boxes stamped with their course names Instructions can be found in the Test Supervisors Manual 41 KDE and ACT recommend return shipping from the school. Slide 44 Irregularities A disturbance or distraction occurs that could affect one or more students scores. A student becomes ill and discontinues testing. A student questions or challenges a test item. A student uses unauthorized testing aids. Complete a Testing Irregularity Report (Test Supervisors and Room Supervisors Manuals) 42 Slide 45 Prohibited Materials ComputerPencil/Paper Notes Foreign language or English dictionary Scratch paper Notes Foreign language or English dictionary 43 Slide 46 Acceptable Materials ComputerPencil/Paper Scratch Paper-Please collect and destroy securely. Calculators Reference Sheets (Algebra II) Scratch work is to be done in the test booklet. Calculators Reference Sheets (Algebra II) 44 Slide 47 Practice Online Testing Coordinate with District Technology Coordinators to verify workstations are ready for online testing CBT Launch Demo PPT QC CBT QuickStart LaunchTest Teachers/Students may use the Launch Demo to practice the system. 45 Slide 48 Locating Launch PPT and Test 46 www.act.org/stateservices/kentucky Slide 49 47 Slide 50 Resources/Manuals 48 Slide 51 Retrieve Codes from System Test Control Code Vanguard Exit Code 49 Slide 52 Online Testing Student will choose their correct birthdate from the dropdown menu and accept the Users Agreement. The student has the option of completing a tutorial before beginning the test. 50 Slide 53 Student Login Page 51 Slide 54 Accept User Agreement 52 Slide 55 Complete Login 53 Slide 56 Choose Correct Test 54 Slide 57 Directions 55 Slide 58 Directions (continued) 56 Slide 59 Test Display 57 Time Remaining Tools Slide 60 Student Prompt After Answering 58 Slide 61 Skipping a Question 59 Slide 62 Bookmark a Question 60 Slide 63 Student Review Page 61 Slide 64 62 Slide 65 63 Take a Break or End the Test Break Slide 66 64 Test Control Code Slide 67 Test Security The Kentucky Department of Education (KDE) along with the testing contractor will be doing analysis of student responses and data to determine if possible inappropriate practices have occurred. All instances of impropriety should be reported Student Testing staff 65 Slide 68 Resources Kentucky QualityCore Website www.act.org/stateservices/kentucky www.act.org/stateservices/kentucky Kentucky Department of Education http://education.ky.gov/AA/distsupp/Pages/EO C.aspx http://education.ky.gov/AA/distsupp/Pages/EO C.aspx 66 Slide 69 Contact Information ACTKDE ACT Customer Services: E-mail: QualityCoreCustomerService@ act.org QualityCoreCustomerService@ act.org Phone: 866.764.7228 Assessment Support and Research: E-mail: dacinfo@education.ky.gov dacinfo@education.ky.gov Phone: 502.564.4394 Jennifer Stafford E-mail: Jennifer.stafford@education.k y.gov Jennifer.stafford@education.k y.gov 67