VCAA Assessment Online

Progress Tests Preview

Fran O’MaraProject ManagerOnline Testing

Agenda What is On Demand Testing?

Types of Tests Available

Uses and Benefits of On Demand Testing

Progress Tests

Linear Test Reports (Progress Tests)

Computer Adaptive Tests

Interpretation of On Demand Test Outcomes

Software Upgrades

Future Directions

Contacts

What is On Demand Testing?

The VCAA Assessment Online System delivers online tests from a central repository to student PCs via the Internet and a school’s local network.

Teachers may use the resource when, where and

how they choose.

It is optional, time-saving and able to be administered to a single student and/or a whole class.

Type of Tests Available

Computer Adaptive Tests

EnglishMathematics

(30 or 60 question tests)

Linear Tests

EnglishMathematics

Progress Tests (30 question tests)

andStandard Linear Tests (15 to 25 question tests) 60 Question

Test

Roadmap for Year 7 4L

3H 4M

3M 4L 4H

3L 3H 4M 5L

3M 4L 4H 5M

3L 3H 4M 5L 5H

3M 4L 4H 5M 6L

3L 3H 4M 5L 5H 6M

3M 4L 4H 5M 6L 6H

3L 3H 4M 5L 5H 6M 6EL

3M 4L 4H 5M 6L 6H 6EM

3L 3H 4M 5L 5H 6M 6EL 6EH

25

25

30

30

30

25

25

20

20

15

15

10

10

5

5

= 95 items in 30 question

roadmap 30 Question

Test

= 290 items in 60 question

roadmap

Uses of On Demand Testing

LIT Program pre-testing and post-testing students (168 schools, 500 teachers)

Teaching and Learning Coaches Initiative (382 Schools, 1500 teachers - Mathematics and Science)

NMR Zones Improvement Project (55 schools)

Assisting in forward planning of teaching programs

Corroborating teacher judgments

Online trials of new items/tests

Benefits of On Demand Testing

Identifying strengths or weaknesses of individual student’s learning outcomes (Linear/Progress Tests)

Testing the general range a student can perform in (Adaptive Test)

Reporting on performance and student progress tracking

Progress Tests

All questions and tests are created by the VCAA P-10 Unit, and are referenced to the Victorian Essential Learning Standards (VELS).

Progress tests have been designed to

provide an estimated VELS Progression Point outcome for students.

Progress tests’ results are limited to a given VELS range eg 2.0 to 2.5

To confirm results for students who achieve close to zero or perfect scores on these tests it is recommended that an additional test at a higher or lower level be administered.

Progress Tests

Mathematics: Number (six tests) English: Reading (six tests)

• VELS 2.0 to 2.5• VELS 2.5 to 3.0• VELS 3.0 to 3.5• VELS 3.5 to 4.0• VELS 4.0 to 4.5• VELS 4.5 to 5.0

Progress Tests

Linear Test Reports (Progress Tests)

Student Raw Score by Question Standard Level Report

Class Raw Score by Question Standard Level Report

Student Percentage Correct by Question Standard Level Report

Student Percentage Correct by Key Area Report

Student Skills Report Class Skills Report

Computer Adaptive Tests

All questions correspond to a curriculum outcome

Selected from a large pool of Mathematics and English questions downloaded to the school

Test adapts to each student’s ability 30 question single dimension CAT

60 question general CAT across a domain Tests take about 15 - 30 minutes Variable timing for questions that timeout

(i.e. 60, 90, 120 secs etc)

Computer Adaptive Tests

Students cannot return to previous questions

Students will get more challenging questions as they answer

Paper & pencil/pen are allowedNo calculators allowed during the test

Computer Adaptive Tests

Sample Answer Roadmap (Individual Student)

4M

3H 4M 5L

3H3L 4M 5L 5H

3M

3M

4L

4L

4L

5M

5M

4H

4H

4H

Adaptive Test Report

Interpretation of On Demand Test Outcomes

VELS Translation Table Progress Test Student Data Adaptive Test Report Comparing Progress Test and

Adaptive Test Standard Scores

VELS Translation Table (Excerpt)

Progress Test Sample Data

Adaptive Test Report

Progress Tests Vs Adaptive Tests

Software Upgrades

The On Demand system is packaged with Virtual Machine (VM) Ware.

The On Demand VM Ware package is distributed on CASES 21 to Government schools.

Upgrades to the School Server are important. Upgrades include new features and system maintenance.

Future Directions

Review of the VCAA Assessment Online system On Demand usage survey Program rebuild

Adaptive Test expansion Extend to Years 9 and 10

(English and Mathematics) Top up Years 2 to 8 to 200%

VCAA ASSESSMENT ONLINE

CONTACTS WEB

• http://www.aimonline.vic.edu.au/

Helpdesk• Freecall Number 1800 827 721

Email• vcaa.ondemand.support@edumail.vic.gov.a

u