NCDPI Observer Calibration Tool

Introduction & Demo

Welcome

• Observation Calibration Training (OCT)

• Approximately 20 participants

• Alleghany County Schools and Newton-Conover City Schools

• You are the first to review!

Why are you here?

• N.C. recognizes that the accurate and reliable evaluation of teachers is more important then ever – High stakes decisions– Teachers need and want coaching

• Clear message from principals, human resources and superintendents-

“We need more training on the NCEES”.

3

4

55

Agenda

• Introductions and overview of platform• Observation Engine overview and live

demo• BloomBoard overview and live demo• Login and debrief information• Q & A

6

7

BloomBoard & Observation Engine

• BloomBoard & Empirical Education are partnering to provide access to a marketplace of calibration and training services for school administrators across the state

• The easy-to-use platform will combine BloomBoard’s Professional Development resources with Empirical’s state-of-the-art observer training and calibration tool, Observation Engine - and will promote continuous NCEES improvements.

8

What is Observation Engine?

• An online tool that uses classroom videos to ensure accurate and reliable classroom observations

• Videos from the MET library have been master-scored on the NCEES teacher evaluation rubric to create learning opportunities for teacher evaluators in North Carolina.

9

Observation Engine will provide NC evaluators:

1. Observer Calibration Events & ReportingProvides rating practice and helps increase rater agreement to target scores using Scoring Studies

2. Supplemental Learning ExercisesProvides targeted, self-paced online exercises focused on specific NCEES elements using Lessons

10

1. Calibrate through Scoring Studies• Improves rater

agreement to target scores

• Builds consensus among evaluation staff and helps establish a mutual understanding of the best ratings

• Facilitates group learning through discussion of areas of disagreement

3b Knows Content for Specialty

3d Makes Instruction Relevant

4g Communicates Effectively

4a Knows How Learning Takes

Place

4d Integrates TechnologyVideo 1: Distribution of Ratings by NCEES Element

*

*

*

*

*

* = Target Score

11

Calibration Reports – sample figures

12

Calibration Reports – sample figures cont’d

13

2. Rating practice through Lessons

• Self-paced practice exercises

• Watch and rate short video clips, focusing on one NCEES indicator at a time

• Receive immediate on-screen feedback

14

Live Demo

BloomBoard

• Easy access to a marketplace of supplemental professional growth opportunities, resources, and services tailored to each educator’s unique needs.– Thousands of articles, videos/video clips, and links

to web based resources at your fingertips. – Further support the work you’re doing through

Observation Engine’s scoring studies and calibration events

15

BloomBoard - Live Demo

16

Thank you!

• Logins– Check your email for instructions on how to

login to your own demo accounts

• Debrief dates/times:– Thursday 7/10 – 1 p.m. EST– Friday 7/11 – 11 a.m. EST

• Optional Individual Feedback Calls• Q & A

17