Assessment for Learning

ASSESSMENT FOR LEARNINGIntroducing the OARS/INSPECT and SCANOARS tools for developing common Formative Assessments

December 8, 2008 Updated October 4th, 2010

TODAY’S TASKSOutline a context for Formative

AssessmentTouch briefly on a the history of OARSLearn how to Login to OARS SystemLearn how to Build A Quiz using INSPECTLearn how to download and Install

SCANOARS softwareDemonstrate how to Scan an INSPECT

QuizProvide an introduction to OARS ReportsProvide contacts to call for help

2

CONTEXT FOR FORMATIVE ASSESSMENT

3

CYCLE OF

TEACHING

Planning of Instruction

Assessment

Instructional StrategiesReflection

Analysis

Planning of Instruction

4

ASSESSMENT AND LEARNING

Teaching, learning and assessment are all interrelated

Using assessment can help promote a learning communityDeeper understanding of standards and what

they “look like”Discussions about assessments (developing,

results, etc) can help define/refine teachingShared understanding of the outcome and

discussions about the best approaches for obtaining proficiency

5

6

PlanningWhat will I do (differently) to ensure that every student learns this std. (strategies, resources, etc.)Goal: Create a plan to re-address this std. including progress monitoringResources: Curriculum TE, Professional Sharing

Implementation

Implement planned instructional strategies before re-assessing to determine proficiency

Assessment:Did they get it now?

Goal: Administer common “assessment” (district or teacher created – e.g., AFS/INSPECT teacher created quiz, student work). Analyze at pre-determined time with grade level

AnalysisHow successful was our teaching? What did our students get/not get?

Goal: Identify at least one common standard of focus for re-teaching/pre-teachingResources: Assmt. results, CST Blueprints, Curriculum Map

ReflectionWhat/How did I teach?

What were student misperceptions? Why?

Goal: Determine why students may not have learned standards to proficiencyResources: Response Analysis Tools (if Applicable), Curriculum TEs

Cycle of Teachin

g

A BRIEF HISTORY OF OARS7

OARS ONLINE ASSESSMENT REPORTING

SYSTEM History

Originally set up to be used for Reading First schools (SCOE) Created by previous classroom teacher Has grown in use and capability Speaks to need for more frequent monitoring and increased

capability of assessment use Purpose of adding OARS

Access to INSPECT item bank Access to reporting features Some tests for purchase can be scanned in the OARS.

SCOE, Theme Skills, INSPECT, etc. 8

MANY ASSESSMENTS TO LOOK AT

Interim assessments SCOE Theme Skills INSPECT Etc.

9

LOGIN TO OARS

10

LOGIN TO OARSQUICK START GUIDE

• Navigate to http://www.oarsaccess.net/• Select Fresno USD in the “Select your District” window• Log in. Initial log ins are…

– Username: firstname.lastname, using the Sharepoint format– 1st Password: birth month and last 2 digits of birth year…

September 1963 would be ‘0963’– Usernames and passwords also handed out today– This is NOT AiS!!!! The username and password for OARS is different

than in AiS– Problems with passwords?

Call your school’s OARS Liaison or Bon Vang in REA at 457-3895• Three “Download Resources” may be helpful for you: “OARS in a

Nutshell,” “OARS Users Manual,” and “ScanOARS Download” (when you are ready for scanning) 11

http://www.oarsaccess.net/

LOGIN TO OARS – STEP BY STEP1. Go to www.oarsaccess.net, 2. Choose Fresno USD and Click GO to login

12

http://www.oarsaccess.net/

LOGIN TO OARS – STEP BY STEPALLOWING POPUPS

13

Some users may have to allow popups in order for OARS to work properly. The following slides only apply if you see either or both of the messages seen here.

CLICK OK or Close as needed to clear the

error messages

If you see don’t see either or both of the messages above,

SKIP to slide 16 of this guide.

LOGIN TO OARS – STEP BY STEPALLOWING POPUPS

14

CLICK Tools Pop-up Blocker Always Allow Pop-ups from This

Site…

Notes: • The screen will blink and refresh itself when you do

this. • You will probably only need to do this once per

computer.

LOGIN TO OARS – STEP BY STEP

Log in. Initial log ins are…• Username: firstname.lastname, using the Sharepoint format• 1st Password: birth month and last 2 digits of birth year…May1963 would be

‘0563’• Usernames and passwords also handed out today• This is NOT AiS!!!! The username and password for OARS is different than in

AiS• Problems with passwords?

Call your school’s OARS Liaison or Bon Vang in REA at 457-3895

1. Type in Username2. Enter Password3. CLICK Log In 15

LOGIN TO OARS – STEP BY STEPEXTRA STEP – FIRST LOGIN ONLY

16Read the Terms and Conditions, then CLICK

I am an Authorized User – and – I Accept All Terms and Conditions Above

LOGIN TO OARS – STEP BY STEPFIRST TIME LOGIN AND PASSWORD CHANGES

17

Complete the Password, Confirm Password, Security

Question, and Response

CLICK Update My Account

Note: To change your password in the future, you may access this screen by clicking on the MY ACCOUNT tab found on the OARS main page.

LOGIN TO OARS – STEP BY STEPFIRST TIME LOGIN AND PASSWORD CHANGES

18

Note: Having changed your password, you will receive a confirmation message. The click here is a little hard to see so it’s highlighted here.

CLICK here

LOGIN TO OARS

Once you have logged in, Three “Download Resources” may be helpful for you: 1) OARS in a Nutshell,2) OARS Users Manual3) ScanOARS Download (when you are ready for scanning)

19

You will find the Log Out in the upper right-hand corner. (Not

pictured).

BUILD A QUIZ USING INSPECT

20

BUILD A QUIZ USING INSPECT QUICK START GUIDE

• To Build a Quiz ….– Select the “ASSESSMENTS” tab at the top of the main menu– Select the “Create a new test” button– NEW: An Automatic Build Feature was reactivated Nov, 2008!– Complete the “Test Information” boxes– Select the Course, Strand and Standard Information – Select items for the quiz by choosing the “ADD” button for each

item you select. You can see the directions and the distractor rationales for an item by clicking the boxes below each item.• Note: for ELA items, there is an option to look at other items that use the

same reading passage. If you are trying to create a “one passage” quiz, you might select this to identify other items associated with the passage.

– An Inspect quiz should be short… 5-6 items only21

– Review the draft of your quiz– Save the quiz… after you click on save, you can

still edit/delete, until you …..– … Print and Lock (when you do this, a print copy will

appear in a new window). – You can also choose to share the quiz, or keep it just

for your class– Print the quiz, and you have several print options

available for how you’d like the quiz to look… • Bubbles or letters for the answer choices• Answers highlighted or not• Answer key accompanying• Print a copy with distracter rationales

BUILD A QUIZ USING INSPECT QUICK START GUIDE - CONTINUED

22

• To Print Answer Sheets ….– Teachers with multiple grade levels, or teaching multiple

classes (secondary) will need to select a “section” of their classes for which to print answer sheets. Click on the “Sections” tab on the blue strip at the top of the screen, then • Click on the program menu, and select “Inspect Item Bank”• Click on your name• If you are selecting a subset of all your students to take the test,

select them here, otherwise the whole student list will be uploaded

– From the “Assessments” tab, select “Print” answer sheets and follow the directions there.

• Have students take the quiz!!23

BUILD A QUIZ USING INSPECT QUICK START GUIDE - CONTINUED

STEP 1: Click on ASSESSMENTS tab

BUILD A QUIZ USING INSPECT STEP-BY-STEP

24

25


The “Assessments “ Main Screen

STEP 2: Click on INSPECT Item Bank here

The “Assessments “ Main Screen

STEP 3: Click on Create New here


26


27

STEP 4: Select a Subject

STEP 5: Type a Description THIS IS REQUIRED

STEP 6: CLICK on Choose Individual

Items

Entering Details is Optional, but consider how you will remember what you were thinking months

from now and whether or not the quiz will be shared with others!

ALTERNATE STEP 6: Once you have entered the subject and dscription, the Automatic Build feature is

another way to build a test!

If you are sharing quizzes, consider what your descriptions will mean to other users. Also, what will they mean to you in 10

months?


STEP 7: Select the CourseSTEP 8: Select the Strand

STEP 9: Select the Standard

After a short delay the items are displayed in this area of the screen. You will have to scroll down to see them all!

28


STEP 10: Scroll Down to select items to Add to your assessment (The

screen blinks with each item individually selected).

ALTERNATE STEP 10: Place a Checkmark by clicking in the box of the upper left-hand corner of each item you want. Then scroll all the way down to the bottom of the list and CLICK

Add Checked Items. This is faster, because the screen only refreshes (blinks) once!

29

STEP 2: Click on Create New Test here

BUIL

D A

QU

IZ U

SIN

G

INSP

ECT

ALTE

RNAT

IVES

WH

EN

SELE

CTIN

G IT

EMS

Some items (esp. ELA and History) are based on a

reading passage. This link can be used to find those

other items

The correct answer is highlighted.

You can click on the +Show links to see Instructions

and/or Distractor Rationales30


31

STEP 11: Click on View Test to see what you have

created!

Quarantine This Itemis something to avoid

(See Slide 34 for more info.)

Need to go back?Follow the “breadcrumb”

trail

BUILD

A QU

IZ USIN

G IN

SPECT STEP-BY-STEP

32

STEP 12a (Optional): To change the order of items, you can use

the1. Move To drop-down OR 2. The Arrow UP or Down

The standard associated with each item appears in the lower right corner.

STEP 12b (Optional): You can also choose to Remove

the item.

BUILD

A QU

IZ USIN

G IN

SPECT STEP-BY-STEP

STEP 12d (Optional): Or you

can simply choose to Remove All Items

STEP 12c (Optional): You can also choose the

checkboxes for each item and scroll to the bottom of the

screen to Remove Checked Items

33

STEP 13: Once the test is the way you want, scroll

all the way back to the top and CLICK on Save Test.


34

STEP 14: Print and Lock your quiz hereYou may still review and edit a

quiz UNTIL you “Print and Lock” it!

Once it’s locked, you have to start the process over!

STEP 15: Click OK


35

Once you are ready to print your answer

booklet, you will have several printing options.

BUILD

A QU

IZ USIN

G IN

SPECT STEP-BY-STEP

36

BUILD

A QU

IZ USIN

G IN

SPECT STEP-BY-STEP

STEP 16: Click on File then Print to

produce the document

37

Opening the print feature actually opens a new window

or tab (depending on your version of Internet Explorer)

You will need to close the window or tab to return to

the OARS.

You will have some choices for printing. You can print forms for all students in one class, one blank form, or for multiple classes. For this example we will print forms for all students in one class.

STEP 17: Click on Print to produce the Answer Sheets


38

STEP 18a (Optional): Click on Multiple Forms to have

INSPECT automatically create 2-4 versions of your test

STEP 21: (SECONDARY ONLY) Select your class(es) here

STEP 20: Select Inspect Item Bank

39

STEP 19: Click on Sections to produce the Answer Sheets


40

You will be given the choice of opening all of the

documents for immediate printing, or saving the

documents for printing later.


41

Answer documents will be created for each student in your class. These documents have basic information already inserted (including Student ID and Test Code). This allows you to scan the document and upload into OARS.


BUILD A QUIZ USING INSPECTADDITIONAL INFORMATION

– Do not quarantine an item– It might lock others out from using it– Or, for some users, the only one locked out is that user

– Some items are quarantined at the system level for inclusion on a District-wide test (CAHSEE Diagnostic tests)

– Some questions have an extra version created (e.g., with just a small change to an answer choice). The “View Alternate Item” button allows you to see all versions of an item, and pick the one you want to use.

– You can now “delete” a quiz using Inspect test managementTechnically the quiz is still there, but if you use the delete option, you will never have to see it again!This can help keep your page of active quizzes well-organized.

42

43

STEP (a): If you have district level access, Click on

“Schools”

STEP (b): Click on the school you would like to view.

USING ONLINE ASSESSMENTHOW TO REACH THE ONLINE ASSESSMENT TUTORIAL

44

Click on the name of the teacher and section (if applicable) that you would like to view.

Until you do this you will not be able to see the link to ONLINE ASSESSMENT


45


STEP 2: Having selected a group of students, you will

notice that the ONLINE ASSESSMENT Tab now appears.

46


STEP 3: Click on “Using the Online Assessment Module”

DOWNLOAD AND INSTALL SCANOARS SOFTWARE

47

DOWNLOAD & INSTALL SCANOARSThis may not be necessary at your school site. To find

out whether or not you need to download and install the ScanOARS software, please contact the OARS-INSPECT liaison for your school.

The following represent the two most common situations in terms of setup for scanning using ScanOARS

Using a dedicated computer Your school has set up a computer that stays connected to the scanner all the time Chances are you don’t need to download the software

Using a docking station Your school has set up a docking station or USB connection to the scanner Each teacher can connect their own laptop if the station is available Chances are you WILL need to download the software to your laptop

Note: You need a PC – this is not recommended for MACs

48

DOWNLOAD AND INSTALL SCANOARS

Once you have logged in,

CLICK on ScanOARS Download and Documentation

Follow the directions provided. Call Eric Wenrick x73876 if you need help.

49

ENTERING STUDENT DATA INTO THE ONLINE

ASSESSMENT REPORTING SYSTEM

50

ENTERING DATAAssessment information can be entered different ways Scanning Using ScanOARS

Some implementing now Requires a certain level of technical expertise Requires a PC connected to an approved scanner The District has purchased a scanner for every elementary school and

two for each secondary school May be the most efficient way for sites to get data into the OARS Can get data back within minutes with a variety of reports

Hand Entry Using INSPECT Scores only; does not allow for response analysis OR Entering Individual Responses (allows for response analysis)

Administering the Assessment Online Requires all students to take the test at a computer Reduces use of paper/printer resources

51

Once you have given the assessment using the test booklet and answer sheet, you are now ready to scan your answer documents.

52

ENTERING DATA - SCANOARS

STEP 1: Start ScanOARS and

select Fresno USD

STEP 2: CLICKOK

53


STEP 3: Make sure Default proxy is

selected then CLICK OK

STEP 4: Your username and

password are the same ones that you used to login to OARS. Once

you have typed these in, CLICK OK

54


STEP 5: Put your answer documents on your

scanner and click SCANBrother DCP8060:

Face Up – Top Side First

STEP 6: Once your documents are scanned, the Send Data to Server button will turn black.

CLICK on Send Data to Server to send your data to OARS.

STEP 7: Exit ScanOARS

TIP:You may want to take a

highlighter or copy pencil and mark forms you have already

scanned. The machine will not do this for you.

APPROVING THE SCANNED DATA

55

Although you can wait and approve data later, we

recommend doing this as part of the scanning process.

Please go to the next slide for more information regarding

how to “Approve” your data.

APPROVING THE SCANNED DATA QUICK START GUIDE

56

o If you chose to scan and upload your data, the next time you log in to OARS, you will see a screen asking you to review and approve the new data.

o Once reviewed and approved, you will have access to your assessment data using the OARS reports.


57

If scanned data is ready to be approved, the Review Data area will show you what still needs to be

approved.

STEP 1: Click on Tools.

If no scanned data is ready to be approved, the

Review Scanned Data area will have a message letting you

know.


58

STEP 2: • To see results for one student CLICK on Show

Responses.• To see results for all students CLICK on Expand All.

STEP 4: When you have completed your review, CLICK on Approve Data.

STEP 3: (Optional) CLICK on a response to change it.

Make your changes and CLICK Save or CLICK Cancel if you made a mistake.


59

Once the data has been approved successfully, you will receive a confirmation message.

You are now ready to view results using the various reports. Please go to slide #62.

60

ENTERING DATA – INSPECT HAND ENTRY

Select INSPECT Item Bank. Then select the section by clicking on the teacher name next to that

section.

SECONDARY TEACHERS:You will need to select a section

first.

61STEP 1: Click on Enter Scores

SECONDARY TEACHERS:You will see the section you have

selected here.



62

STEP 2: Make sure INSPECT Item Bank is

selected

STEP 4: Select the assessment you

want to enter scores for

STEP 5: Select the method of entering the

dataSTEP 6: Click GO

IF you want response analysis select Enter Actual Responses

STEP 3: Select appropriate options


63

This is the screen you get if you selectEnter Actual Responses

You will need to enter the letter choice of each response if you choose this method of entry

STEP 8: Scroll to the bottom of the page

and Click Once on the Click ONCE to Save

Button

STEP 7: Complete the data entry process


64

This is the screen you get if you selectEnter Actual Responses

You will need to enter the letter choice of each response if you choose this method of entry

STEP 8: Scroll to the bottom of the page

and Click Once on the Click ONCE to Save

Button

STEP 7: Complete the data entry process

ENTERING DATA – INSPECT ONLINE ASSESSMENT (PREVIEW)

65

The OARS will allow you to produce an assessment and allow students to take the assessment online Every student will need to take the assessment on a

computer Teachers can control things like…

The test window Which assessment(s) are available online Student Passwords A specific computer a student can use for taking the assessment

(or can select ANY computer) Reduces paper processing

ENTERING DATA – INSPECT ONLINE ASSESSMENT (PREVIEW)

66

BRIEF INTRODUCTION TO OARS REPORTS

67

INTRO TO OARS REPORTS

For Teachers Benchmark Report for Interim Assessments (SCOE,

Theme Skills) How many students were at Intensive, Strategic, Benchmark and

Challenge Item Analysis

For scanned assessments only Drill Down

Starts at Grade Level/Theme, drills down to teacher, to student, to standard, can create intervention groups by standard

INSPECT Questions (can build a test or use questions during lessons to check for understanding)

Ability to create and monitor Intervention Groups68

INTRO TO OARS REPORTS For Administrators

STAR Data (Scale Score, Clusters, Disaggregated, etc.) Benchmark Report for Interim Assessments

(SCOE, Theme Skills) By grade level Ability to compare classrooms Ability to track progress of cohorts of students Ability to disaggregate in many ways

By Theme By skill (Reading Comp., Vocabulary, Spelling, Grammar) Summary results Classroom Results Demographic subgroups

69

WHO TO CALL FOR MORE HELPPerson Can Help With Phone

School OARS Liaison

TEACHERS: Your liaison should be your first call for help. Liaisons will call REA or Tech Service Staff as needed for additional support.

Help Desk or MCS

Call the Help Desk or your assigned Microcomputer Specialists (MCS) • Hardware problems with your scanner• Connecting to the Internet

457-2600

Bon Vang, REA • Resetting Passwords• Creating User Accounts 457-3958

70

PREVIEW OF UPCOMING GUIDES

71

Check back on http://rea.fresnounified.org/Assessment.cfm

Upcoming presentations may include… USING OARS-INSPECT ONLINE

ASSESSMENTUSING OARS REPORTING FEATURES CREATING YOUR OWN MULTIPLE-

CHOICE ITEMS USING THE INSPECT ITEM EDITOR

http://rea.fresnounified.org/Assessment.cfm

http://rea.fresnounified.org/Assessment.cfm

Date post:	24-Feb-2016
Category:	Documents
Upload:	betty
View:	45 times
Download:	0 times

Assessment for Learning

Documents