Michigan Department of Education

Office of Education Improvement and Innovation

One Voice – One PlanMichigan Continuous School

Improvement (MI-CSI)

2

Continuous School Improvement Process

3

To what extent does this represent your experience with School Improvement?

4

Guided Conversations

WHY: Why is it important to strategically implement, monitor, and evaluate the School Improvement Plan?

HOW: How will we communicate the plan to all stakeholders so that they clearly understand and own their roles in implementation?How do we build ownership of the strategy and the plan?How will we ensure implementation with fidelity?How is the implementation of your plan monitored and evaluated?How is the impact of your plan monitored and evaluated?

WHAT: What will your school look like when this plan is implemented with fidelity?What is the expected impact on student achievement?

DO

5

Do: Plan Requirements

ESEA and PA 25 require annual evaluation of the following:

•Implementation of the plan•Student achievement results by subgroup using data from state assessments and other indicators•Modifications to plan as needed

ISDs/RESAs are required by PA25 to provide technical assistance to schools and districts to develop annual evaluations.

6

Plan

Develop School Improvement PlanDOImplement Plan

Monitor PlanEvaluate Plan

7

Reflection

What have you done to monitor the implementation

and impact of your building/district plans?

8

Implementation is a Process!

MonitorMonitor Implementation Evaluate Implementation

MonitorMonitor Impact Evaluate Impact

Adult Focused

Student Focused

9

Leadership and Learning Center 2010

10

MONITOR ADULT IMPLEMENTATION AND IMPACT ON STUDENT ACHIEVEMENT

(Formative)

IS IT WORKING?

ARE STRATEGIES AND ACTIVITIES BEING IMPLEMENTED AS INTENDED WITH

FIDELITY?

ARE WE COLLECTING & USING STUDENT AND

ADULT DATA TO MODIFY & ADJUST

ONGOING IMPLEMENTATION?

IS WHAT WE ARE DOING WORKING?

ARE WE SHOWING EVIDENCE OF STUDENT

GROWTH?

WHAT INTERIM ADJUSTMENTS ARE

SUGGESTED BY IMPLEMENTATION

DATA? HOW MIGHT THESE ADJUSTMENTS

AFFECT THE INTEGRITY OF THE RESULTS?

Implementation: Adult Focused Impact: Student Focused

MONITOR EVALUATE EVALUATEMONITOR

11

ActivitiesConnection to SPR

40/90, Interim SA/SAGetting Ready to

ImplementImplement Monitoring Fidelity of

Implementation and Impact

How will we address the targeted areas in your Process Data (SPP)?

What areas in your process data have been identified as challenge areas during your comprehensive needs assessment process?

How will we ensure readiness for implementation?

How will we ensure that staff and administrators have the knowledge and skills to implement?

POSSIBLE ACTIVITIESProfessional development around strategy Purchase materials Planning for implementation – Identify schedule for strategy use, personnel, mechanism for monitoring, rollout, etc.Communication vehicles

How will we ensure successful opportunity for and implementation of the strategy?

POSSIBLE ACTIVITIESCommunication – to whom? How?Ongoing coaching?Observations?Instructional technology utilized? *Activities to support at-risk students (For Title One students)*•Parent Involvement *

*Required Components

How will we ensure the strategy is implemented with fidelity?

How will we monitor the impact on student achievement?

POSSIBLE ACTIVITIESWalkthroughsPLC/CASL meetingsDocumentation of effective implementationDocumentation of impactDemonstration classrooms, videos, self assessmentsGathering achievement data

12

MonitoringMonitoring Implementation and Impact

Are you meeting on a regular basis to monitor implementation of your plan?

What does the data say when you monitored implementation?

•What evidence have you collected to determine if adults are implementing with fidelity?•What evidence have you collected to determine the impact of implementation?

What adjustments are suggested by implementation and impact data? How might these adjustments affect the integrity of results?

How will you communicate progress with stakeholders?

13

14

15

16

17

18

Checking for Understanding

What are your questions about monitoringmonitoring

implementation and impact?

19

Reflection

What might you do to enhance the monitoring of the

implementation and impact of your building/district plans?

20

Plan

Develop School Improvement PlanDOImplement Plan

Monitor PlanEvaluate Plan

21

Reflection

What have you done to evaluate the implementation and impact of your building/

district plans?

22

Implementation is a Process!

Monitor Implementation Evaluate Implementation

Monitor Impact Evaluate Impact

Adult Focused

Student Focused

23

MONITOR ADULT IMPLEMENTATION AND IMPACT ON STUDENT ACHIEVEMENT

(Formative)

IS IT WORKING?

EVALUATE ADULT IMPLEMENTATION AND

IMPACT ON STUDENT ACHIEVEMENT

(Summative)

DID IT WORK?

ARE STRATEGIES AND ACTIVITIES BEING IMPLEMENTED AS INTENDED WITH

FIDELITY?

ARE WE COLLECTING & USING STUDENT AND

ADULT DATA TO MODIFY & ADJUST

ONGOING IMPLEMENTATION?

WAS THE PROGRAM IMPLEMENTED AS

INTENDED?

DID WE IMPLEMENTTHE PLAN/STRATEGIES

CORRECTLY & CONSISTENTLY?

DID WE GIVE IT ENOUGH TIME? RESOURCES?

IS WHAT WE ARE DOING WORKING?

ARE WE SHOWING EVIDENCE OF STUDENT

GROWTH?

WHAT INTERIM ADJUSTMENTS ARE

SUGGESTED BY IMPLEMENTATION

DATA?

HOW MIGHT THESE ADJUSTMENTS AFFECT THE INTEGRITY OF THE

RESULTS?

Implementation: Adult Focused Impact: Student Focused

MONITOR EVALUATE EVALUATEMONITOR

DID OUR STRATEGIES RESULT IN INCREASED

STUDENT ACHIEVEMENT?

WHAT UNINTENDED CONSEQUENCES (GOOD

AND BAD) HAVE OCCURRED?

SHOULD THE STRATEGY/ACTIVITY BE

CONTINUED? DISCONTINUED?

MODIFIED?

24

IMPLEMENTATION

What evidence do you have that the strategy was or was not implemented with fidelity?

What evidence do you have that implementation adhered to strategies, timelines, and responsibilities?

IMPACT

What impact has the strategy had on student achievement and what is the evidence?

What impact has the strategy had on subgroups and what is the evidence?

Evaluating Implementation and Impact

25

Evaluate Plan - Conclusion

Given your evidence, what adjustments are needed to your School Improvement Plan, if any?

•What do we continue to do?•What do we stop doing?•What do we need to “tweak”?

26

Evaluate Plan - Digging Deeper

• To what extent was this the right strategy/activity to address your need?

• What is needed to maintain momentum and accelerate achievement gains?

• Are the benefits of the strategy/activity sufficient to justify the resources it requires?

• How might these results inform the School Improvement Plan?

27

Evaluate Plan

The process is cyclical, and evaluation data should inform the next cycle of planning.

The ultimate goal is to have improvement strategies take hold and become so internalized that they become part of the school culture.

28

Checking for Understanding

What are your questions about evaluatingevaluating implementation and

impact?

29

Reflection

What might you do to enhance the evaluation of the implementation and

impact of your building/district plans?

30

• It is also critical that the School Improvement Team structure opportunities to celebrate successes, no matter how small.

• Celebrating successes reinforces valued performance and reminds the school community that however challenging, school improvement results in improved academic performance.

One Voice – One Plan

31

One Voice – One Plan

However noble, sophisticated, orenlightened proposals for changechange andimprovementimprovement might be, they come tonothing if teachers don’t adopt themin their own classrooms and if theydon’t translate them into effectiveeffectiveclassroom practicesclassroom practices..

32

Guided Conversations

WHY: Why is it important to strategically implement, monitor, and evaluate the School Improvement Plan?

HOW: How will we communicate the plan to all stakeholders so that they clearly understand and own their roles in implementation?

How do we build ownership of the strategy and the plan?How will we ensure implementation with fidelity?How is the implementation of your plan monitored and evaluated?How is the impact of your plan monitored and evaluated?

WHAT: What will your school look like when this plan is implemented with fidelity?

What is the expected impact on student achievement?

DO

33

Questions/Comments?Please contact:

Renie Araoz (Araozr@michigan.gov) Diane Fleming (FlemingD6@michigan.gov) Diane Joslin-Gould (Joslin-Gouldd@michigan.gov)

Or visit the MDE - School Improvement website

34

Renie Araoz – MDE/AdvancED MichiganDeb Asano - Marquette-Alger RESALisa Bannon - Wexford-Missaukee ISDBen Boerkoel - Kent ISDElizabeth Brophy - Calhoun ISDDeb Dunbar - Bay-Arenac ISDScott Felkey - Oakland SchoolsDiane Fleming - MDELinda Forward - MDELisa Guzzardo Asaro - Macomb ISD

These training materials and resources were developed by the Michigan Continuous School Improvement Team. We deeply appreciate their time and support.

Carrie Haubenstricker - Tuscola ISDFiona Hinds - AdvancED MichiganDiane Joslin-Gould - MDEScott Koziol - Michigan Center Public Schools Kathleen Miller - Shiawassee RESDCarolyn Rakotz - Wayne RESADodie Raycraft - St Joseph County ISDKaren Ruple – MDEJennifer Sell-Sabsook - Charlevoix-Emmet ISDKathy Sergeant - AdvancED Michigan