Strategies for Utilizing Assessment Results to Improve

Instruction

Strategies for Utilizing Assessment Results to Improve

Instruction

Rae Lees, NOCTI ConsultantNACTEI Conference

Philadelphia, PennsylvaniaMay 2011

Session Overview

Overview of NOCTI

Selecting an Assessment

Putting the Data to Work

Q&A

Overview of NOCTI

Over 40 years serving the CTE community

Non-profit organization

Owned and operated by the 50 states

Works with both secondary and post-secondary populations

The Whitener Group (a NOCTI subsidiary) provides services to industry

Our Customer Breakdown

Our Product Breakdown

Over 80 Job Ready tests offered

30 Pathway tests in 10 clusters available

Over 90 private industry employment and/or advancement tests delivered

20 teacher-level assessments

Study guides for all Job Ready and Pathway assessments

Countdown Kits offered for 40 titles

Successful Schools-Successful Programs Guide

Supplemental ProductsAssessments

NOCTI Products

Selecting an Assessment

Determine purpose of assessment

Determine audience

Determine results desired

Research available options

Selecting an Assessment

Selecting an Assessment

Learn how NOCTI assessments can be used to meet Perkins requirements for technical assessments!

Job Ready Assessments

Assess technical skills at the occupation level (e.g., Accounting, Carpentry, Pre-Engineering)

Measure aspects of occupational competence such as factual and theoretical knowledge

Target secondary and post-secondary program completers

NOCTI Job Ready Assessment Blueprint

Number of Questions: 222 Areas Covered:

AccountingAccounting

NOCTI Job Ready Assessment Blueprint

Number of Questions: 222 Areas Covered:

AccountingAccounting

NOCTI Job Ready Assessment Blueprint

Number of Questions: 222 Areas Covered:

AccountingAccounting

NOCTI Pathway Assessment Blueprint

Banking & Related Banking & Related ServicesServices

Number of Questions: 104 Areas Covered:

Other NOCTI Services

Customized Standards Development Customized Assessment Development Professional Development Workshops Certification Delivery Systems Local and State Program Management

Assessment Results

NOCTI’s Standard Score Reporting Package: Individual Score Reports

Group Score Reports

Comparative Data

Other Reports Available: Task-Link Reports

Integrated Academic Reports

NOCTI Standard Score Reports

Individual Score Individual Score Reports Reports

•Provided for each test taker•Scores by duty and total•Pre-/post-test comparisons•Comparative data

Individual Score Individual Score Reports Reports

•Provided for each test taker•Scores by duty and total•Pre-/post-test comparisons•Comparative data

NOCTI Standard Score Reports

Group Score ReportGroup Score Report

•Provided for the testing group•Duty and total scores for each participant

Group Score ReportGroup Score Report

•Provided for the testing group•Duty and total scores for each participant

NOCTI Standard Score Reports

Analysis of Scores Analysis of Scores ReportReport

•Provided for the testing group•Comparative data•Criterion-referenced cut score•Other statistical information

Analysis of Scores Analysis of Scores ReportReport

•Provided for the testing group•Comparative data•Criterion-referenced cut score•Other statistical information

NOCTI Additional Reports:Task-Link Report

Task-Link ReportTask-Link Report

•Includes:• Number of items

presented for each task

• Average correct by group

• Number correct for each test taker

Task-Link ReportTask-Link Report

•Includes:• Number of items

presented for each task

• Average correct by group

• Number correct for each test taker

NOCTI Additional Reports:Integrated Academics Report

Putting the Data to Work

What is CTEDDI?

Training that is highly interactive A process, not a one-time event Uses data that teachers and schools

own Builds on the success of an ever-

increasing community of practice Ongoing state-supported mentorship,

local coaches and online help

CTEDDI Instructional Improvement Cycle

Benefits of CTEDDI

Educators:Educators: Data-driven instructional improvement Improved ability to meet accountability goals A positive educational impact

CTE Community:CTE Community: Practical application of Perkins data Logic-based policy tool Demonstrate ROI

EveryoneEveryone Increased student achievement Enhanced preparation for college and careers Gains in workforce competence/productivity

Ways to Participate

Statewide Statewide ImplementationImplementation

• State DOE support• Use of Sharing

Center• Ongoing mentorship• Access to evolving

resources• Access to a national

network• Statewide common

workshops on data• Use of real data

Jump-StartJump-Start

• Local support• Access to existing

resources (for the Jump-Start days only)

• 2-day workshop on CTEDDI process

• Use of mock data

Introductory PDIntroductory PD

• Access to existing resources (for the day only)

• 1-day (or less) workshop

• Use of a portion of exercise data

Questions?

www.nocti.org

1.800.334.6283