1

Test Security and Integrity of the Testing Program

Mark BillingsleyTSNAP Vice-President

Austin ISD

2

Why test security?ValidityReliability

3

Security Requirements in Response to Office of

Inspector General Report

Records retention – minimum of 5 yearsSeating charts – locally maintainedHonor Statement – 9 - ExitTEA on-site monitors

14-point Security Plan

4

5

Test Security In Detail Seating charts required by TEA – locally

maintained Reporting local investigatory and disciplinary

actions – (see AISD forms) Document retention – minimum of 5 years On-site monitoring

6

Test Security Student Seating Charts

Used to link test administrator to student and student to student

Should include in and out times for test administrator(s)

Must reflect movement of students

To be turned in at check-in (AISD)

Must use district form provided (AISD)

7

Test SecurityBefore test administration Emphasize importance of training Train as many staff as possible Principals are required to attend the campus training (AISD) Distribute test administrator manuals BEFORE training Follow procedures for oaths Account for all test materials Ensure proper storage of materials When applicable, set aside Form #1 booklets for oral administration and dyslexia

bundling Verify demographic information Verify testing requirements for special education students, given changes to

assessments this year Be available for questions

8

Test Security

During test administration Ensure each student receives the correct assessment and

testing materials Practice good inventory control at all levels Emphasize and verify active monitoring Ensure all testing personnel understand that they may NOT:

provide assistance view the tests without authorization discuss confidential student information check for strategies

9

Test Security

After test administration No unauthorized viewing or scoring student

responses No discussion of confidential student information No erasing stray marks or darkening response ovals Account for all test materials

10

Test SecurityPitfalls to Avoid

Assigning untrained staff to administer and/or monitor tests Failing to inventory test materials Having insufficient test booklets and/or test administrator manuals Not accounting for all test booklets and answer documents each day Assigning a student the incorrect assessment Failure to give appropriate accommodation(s) Improper (or nonexistent) monitoring Failure to remind students to record their responses and/or failure to

verify that students have bubbled their answers Leaving secure materials unattended

11

Test Security Testing Irregularities

Violations Resulting in a Referral Viewing a test before, during, or after an assessment Hand-scoring student tests Discussing secure test content or student responses Copying secure materials Any Action that Directly or Indirectly Assists Students with Responses

Clarifying or translating writing prompt or test items Gesturing, pointing, or demonstrating correct responses Changing student responses Providing answers to test questions

REMINDER: However well intentioned, these actions are never allowable orappropriate. Also, these incidents must be reported to TEA immediately.

12

Test Security Reminder Monitoring

Before a student leaves the room, the test administrator must inspect the completed answer document to be sure that the student has bubbled in answers as instructed

If the student has not done so, the test administrator must instruct the student to bubble in the answers

Test administrators should look to verify that answers are marked; they cannot look or comment on individual answers

Concerning grade 3, test administrators may quickly look through the scorable test booklets after the students are finished to ensure that all items have been answered, but they may not look at answers to individual items

13

Oath Procedures

The process for initialing and signing oaths in 2007-08 was a two-part process:

1. Initialing and signing after training and before handling secure materials

2. Signing after completion of each test administration for test administrators and at the end of the testing year for campus coordinators and principals

TAKS Campus Coordinator will submit signed oaths at the conclusion of training and will sign them again at the end of the testing season. (AISD)Oath process subject will be revised in 2008-09.

14

Common Testing Irregularities

Individualized Education Program (IEP) Errors

Accommodation errorsWrong assessment

15

Common Testing Irregularities

Procedural/Monitoring Errors

Improper distribution & handling of test materialsUse of untrained test administrators or monitorsImproper/incomplete transcribingUse of cell phones during testing

16

Common Testing Irregularities

Administering test on wrong dayAdministering assessments outside testing window

REMINDER: If caught in time and reported to TEA, these can generally be easily fixed.

Calendar Errors

17

Common Testing Irregularities

Misplaced or lost answer documentsMisplaced or lost test bookletsLate return of secure materials

REMINDER: Additional information about return of secure materials can be found in the Secure Materials Supplement.

Missing/Late Return of Secure Materials

18

Common Testing Irregularities

Failure to administer test orally to eligible studentsAdministering test orally to ineligible studentsForm 1 not usedWorking/scoring/discussing test items

NOTE: Be sure to refer to the Accommodations Manual for details.

Oral Administration Errors

19

Viewing a test before, during, or after an assessment

Hand scoring student tests

Discussing secure test content or student responses

Copying secure materials

REMINDER: These incidents must be reported to TEA immediately.

Potential Referral to Educator Certification

and Standards

20

Reporting Irregularities

1. Don’t panic2. Gather complete information3. DON’T ASSUME - contact TEA if you have any

questions about how to handle the problem4. Report the incident if an irregularity occurred

Gather all facts Collect documentation Submit documentation

21

Reporting IrregularitiesNotify the Security Task Force immediately if you become aware of one of the following types of irregularities:

Teacher/test administrator intervention or assistance

Unauthorized viewing, scoring, discussing, or duplication of secure material

22

Reporting IrregularitiesCollecting Documentation

All irregularities require the following documentation to be submitted:

Incident report (preferably via the Online Incident Reporting Process)Statement(s) from individuals involved

NOTE: Do not use the Student Assessment Incident Report Form to submit statements from individuals involved.

23

Reporting Irregularities

Submission of InformationIncident reports may be submitted to TEA online using the following guidelines:1. Access the Online Incident Reporting Process

located on the TEA Student Assessment Division website at:

2. Review the procedures for reporting an irregularity online and then click the link entitled “Click here to submit an online incident report.”

http://www.tea.state.tx.us/student.assessment/admin/incidents/online/

24

Reporting IrregularitiesSubmission of Information (cont.)

3. Select your district and campus from the pull-down menus and complete the required information on the form.

4. Attach electronic supporting documentation and complete the submission process.NOTE: If you do not choose to use the online system’s attachment

feature, all supporting documentation must be submitted by fax to 512-463-9302, or by e-mail to testsecurity@tea.state.tx.us within 10 working days of the incident. Be sure to include the incident identification number provided upon completion of the online submission with each set of documentation.

25

Reporting Irregularities

Submission of InformationIf you encounter difficulties using the online submission process, you can download an electronic copy of the incident report form.1. Download the incident report form from:

2. Complete the form, save it, and e-mail it as an attachment to testsecurity@tea.state.tx.us . Electronic supporting documentation can be attached to the same e-mail as the incident report, or it can be faxed to 512-463-9302.

http://www.tea.state.tx.us/student.assessment/admin/incidents/Student_Assessment_Incident_Report_Form.doc

26

27

28