DELIBERATE PRACTICE

The Marzano Causal Teacher Evaluation Model

Teacher Evaluation Metrics

• Focus: Instructional Practice

2

Student Growth

Instructional Practice

Instructional Practice is where classroom observations and

feedback are provided to teachers throughout the

year.

Review: Last Summer’s Scoring and Weighting Workshop - FLDOE Recommendation

• Year 1

3

• Year 2

Status Score 60%

Deliberate Practice

Score 40%

Status Score 100%

Instructional Practice 50%

Instructional Practice 50%

Why do we need Deliberate Practice?

4

What if?

• What if every teacher engaged in a self assessment of their classroom practice?

• What if the Individual Professional Development Plan was aligned to the teacher evaluation system to help teachers measurably improve the Instructional Practice score?

5

The Deliberate Practice Plan may be used as an option for districts in place of their current IPDP if:

• Districts follow the FLDOE-approved model as presented

• At least one of the Deliberate Practice growth targets is developed with consideration of appropriate student growth data

6

What is Deliberate Practice?

7

Deliberate Practice

Deliberate practice is a way for teachers to grow their expertise through a series of planned activities, reflection, and collaboration. Involved in the series is a protocol: • setting personal goals, • focused practice, • focused feedback, • observing and discussing teaching, and • monitoring your progress

8

Making the Connections

Deliberate Practice

Teacher Behavior

Student Achievement

9

Domain 1

Domains 2-4

11

Marzano Teacher Evaluation Model

When these strategies are used, here is the typical effect on raising student achievement (percentile gain corrected):

Building Vocabulary 20% Effort and Recognition 14% Graphic Organizers 13% Homework 15% Identifying Similarities and Differences 20%

Interactive Games 20% Nonlinguistic Representations 17%

Note Taking 17% Practice 14% Setting Goals/Objectives 25% Student Discussion/Chunking 17% Summarizing 19% Tracking Student Progress and Using Scoring Scales

34%

Deliberate Practice Involves:

13

Focused Practice

Focused Feedback

Remember the Goal

An expectation that all teachers can increase their expertise from year to year which produces gains in student achievement from year to year

with a powerful cumulative effect

14

Fundamentals of Deliberate Practice

Deliberate Practice begins with empowering teachers!

• Teachers should take the lead in identifying their personal growth goals, and collaborate with their principals on their goals.

− Principal must approve the IPDP

• Deliberate Practice should be structured, resourced and monitored by the principal.

15

16

Teacher Growth Must Occur in Three Major Areas:

Major Areas: 1. Scaffolding of Unit Content (around Unit

Learning Goals) into Daily Lessons that support student learning

2. Implementation and Use of Instructional Strategies

3. Deliberate Practice of Strategies

Steps for Developing a Deliberate Practice Plan

1. Self Assessment

2. Identify Focus Strategies

3. Create Measurable Goals

4. Actions in the Classroom

5. Reflection

6. Tracking Progress and Celebrating Success

17

Linking Performance Scales to Teacher Reflection and Deliberate Practice

Autonomous Phase

Shaping Phase

Cognitive Phase

18

Rating Scale for Domain Elements (State Model Teacher Evaluation Scale)

4 3 2 1 0

Formative Ratings Used for Each Domain Element

Innovating

Applying

Developing

Beginning

Not Using

19

Cognitive Phase

Shaping Phase

Autonomous Phase

Linking Performance Scales to Teacher Reflection and Deliberate Practice

Highly Effective Effective Needs

Improvement/Developing

Unsatisfactory

Formative Ratings Used for Each Domain Element

20

Cognitive Phase

Shaping Phase

Autonomous Phase

21

22

Self-Assessment Example

23

24

Identify Focus Strategies Example

25

26

Write Measurable Goals Example

27

28

Action Steps Example

29

30

Reflection Example

31

32

Tracking Progress Example

Appendix Tools

• Recommendations for Developing Goals and Resources

• Goal #1 – Progress Check-In and Reflection Log • Goal #2 – Progress Check-In and Reflection Log • Goal #3 – Progress Check-In and Reflection Log • Video Self-Observation Guide (Optional) • Peer Observation Guide (Optional) • Instructional Rounds Guide (Optional) • Glossary of Terms

33

Recapping the Benefits of Deliberate Practice

• Empowers teachers to take responsibility for their own professional growth and development

• Generates sources of evidences for other domains (planning/preparing, reflection/professionalism, etc.)

• As teachers increase their effectiveness with target

strategies, it tends to lift their overall teaching

34

DELIBERATE PRACTICE Scoring and Calculation

Review: Last Summer’s Scoring and Weighting Workshop – FLDOE Recommendation • Year 1

36

• Year 2

Status Score 60%

Deliberate Practice

Score 40%

Status Score 100%

Instructional Practice 50%

Instructional Practice 50%

5 Steps to Calculate the Deliberate Practice Score

District or teacher identifies target strategies following district policies Step 1

Obtain at least 2 data points for each target strategy Step 2 For each element, determine the number of growth levels from the first data point to the last data point Step 3 Use the average growth level and the final data points against the scale to obtain the Deliberate Practice Score for each target element Step 4 Average the Deliberate Practice Scores for each target element for the final element score. Step 5

38

Teacher identifies the following targets: • Domain1

• #1 Providing clear learning goals and scales (rubrics) • #2 Tracking student progress • #3 Celebrating success

Example Step 1 District or teacher identifies target element(s) following district policies

39

Example Step 2 Obtain at least 2 data points for each element

October Data Point 1

March Data Point 2

Domain 1: #1 Providing clear learning goals and scales (rubrics)

0 3

Domain 1: #2 Tracking student progress 2 3

Domain 1: #3 Celebrating success 1 3

Note: Scores are based on the Marzano scale: Innovating (4), Applying (3), Developing (2), Beginning (1) and Not Using (0)

40

Example Step 3 For each element, determine the number of growth levels from the first data point to the last data point using the Marzano Scale

Note: Scores are based on the Marzano scale: Innovating (4), Applying (3), Developing (2), Beginning (1) and Not Using (0)

October Data Point

1

March Data Point

2

Growth Levels

Domain 1: #1 Providing clear learning goals and scales (rubrics)

0 3 3

Domain 1: #2 Tracking student progress 2 3 1

Domain 1: #3 Celebrating success 1 3 2

41

Example Step 4 Use the scale to obtain the Deliberate Practice Score for each target element

Highly Effective (4)

Effective (3)

Needs Improvement or Developing

(2)

Unsatisfactory (1)

Grows 3 levels Grows 2 levels Grows 1 level Achieves no growth

Or grows to Level 4

Or grows to Level 3

Or grows to Level 2 Or scores at Level 1 Note: The district may decide which rule takes precedence

42

Example Step 5 Average the growth levels across target elements

Levels Grown

Final Level Deliberate Practice Score

Domain 1: #1 Providing clear learning goals and scales (rubrics)

3 3 4*

Domain 1: #2 Tracking student progress 1 3 3

Domain 1: #3 Celebrating success 2 3 3

Final Deliberate Practice Score: 3.33

* This score may be vary depending on the precedence of the scoring rules. This scenario uses the highest scoring rule.

Deliberate Practice Score

Highly Effective Effective Needs Improvement Or Developing Unsatisfactory

3.5 - 4 2.5 - 3.4 1.5 - 2.4 1 - 1.4

Issue: How to Handle No Growth

Two Options:

• Score as “Unsatisfactory” – 1 Point

• Score as “Unsatisfactory,” but allow for one target element with no growth to be “forgiven” if multiple elements were targeted

45

No Growth Sample Scenarios Deliberate Practice Score

Start Finish No Growth = Unsatisfactory Forgive One Element 3, 3, 3 3, 3, 3 1 (Unsatisfactory) 1 (Unsatisfactory) 3, 3, 3 3, 3, 4 2 (Needs Improvement) 2.5 (Effective) 3, 3, 3 3, 4, 4 3 (Effective) 4 (Highly Effective) 2, 2, 2 2, 2, 2 1 (Unsatisfactory) 1 (Unsatisfactory) 2, 2, 2 2, 2, 3 1.6 (Needs Improvement) 2 (Needs Improvement) 2, 2, 2 2, 3, 3 2.3 (Needs Improvement) 3 (Effective) 2, 2, 2 2, 3, 4 2.7 (Effective) 3.5 (Highly Effective) 3, 3 3, 3 1 (Unsatisfactory) 1 (Unsatisfactory) 3, 3 3, 4 2.5 (Effective) 4 (Highly Effective) 2, 2 2, 2 1 (Unsatisfactory) 1 (Unsatisfactory) 2, 2 2, 3 2 (Needs Improvement) 3 (Effective) 2, 2 2, 4 2.5 (Effective) 4 (Highly Effective) 3 3 1 (Unsatisfactory) 1 (Unsatisfactory) 2 2 1 (Unsatisfactory) 1 (Unsatisfactory)

Highly Effective

Effective

Needs Improvement

Unsatisfactory

46

Additive: Status Score + Addition of Deliberate Practice = Final Instructional Practice Score

Two Methods for Calculating Instructional Practice When Including Deliberate Practice

Inclusive: Status Score + Deliberate Practice = Final Instructional Practice Score

Status Score

Deliberate Practice

Status Score

Deliberate Practice

Final Instructional Practice Score Final Instructional Practice Score

Additive Method Considerations: • Deliberate Practice is added to

the Instructional Practice Score • Performance in Deliberate

Practice only adds to the Instructional Practice score; it is not punitive

• Top scores are possible without growth in Deliberate Practice

• High reward for high growth • More teachers will rank higher

on the performance scale

47

Status Score

Deliberate Practice

Final Instructional Practice Score

Inclusive Method Considerations: • Deliberate Practice is a percentage of

the Instructional Practice Score • Performance in Deliberate Practice

can be punitive if the teacher shows no growth.

• Top scores are not possible without growth in Deliberate Practice

• Reward for high growth and high status score

• More teachers will rank lower on the performance scale

48

Status Score

Deliberate Practice

Final Instructional Practice Score

Sample Scenarios

Typical Teacher Deliberate Practice 2.5 Status Score 3.1 Additive Score: 3.60 (Highly Effective) Inclusive Score (40%, 60%): 2.86 (Effective) Difference: .74 points

The Additive method puts the teacher in the Highly Effective range rather than the middle of the Effective range.

FLDOE Recommendation

50

2012/13 2013/14

Additive Inclusive

2012/13 2013/14

2014/15

Pilot Additive Inclusive

OR

Next Steps

• Implementing the Monitoring Plan

• Monitoring for results and making adjustments

• Identifying and sharing best practices

• Celebrating successes

51

Professional Development

• Deliberate Practice for Administrators • Deliberate Practice for Teachers • Deeper Connections • Planning and Creating Units of Instruction