GODDARD AND SLAVENSKirkpatric vs. Success Case Study

ENVIRONMENT:

TREADING LIGHTLY ON THE EARTH

From The Learning Space: http://openlearn.open.ac.uk/course/view.php?id=4112

Course Evaluated:

KIRKPATRICK

Phase 1: Reaction

Student user feedback survey

1. How user friendly did you find this web-based lesson?

very easy easy doable confusing impossible2. After completing the lesson, how often did you make choices to

reduce your footprint?

always often occasionally seldom never3. After completing this lesson, how often do you find

yourself sharing your new knowledge with others?

consistently often occasionally rarely never

4. Would you endorse this lesson for others that wish to improve their footprint on Earth?

definitely probably possibly doubtful never

Phase II: Assessing use of the knowledge

Assessing behavior changes one month later

1. Explain two areas in your everyday life you have made changes to reduce your footprint.

2. What was your cost vs benefit analysis from your changes you made?

3. How has the changes you have made affected your family positively or negatively?

4. How have you educated others with your new knowledge to improve their footprints left?

5. Devise a plan for your life for the next 6 months to further reduce your carbon footprint.

Phase III: Performance

Student environmental plan: Personal 6 month footprint study

1. Student will implement 6 month plan from phase II.

2. Student will keep a daily log/journal of changes made in all phases of student’s life. ie. work, home, leisure, etc.

3. Student will keep a log of footprint reduction due to changes.

4. Student will keep a cost analysis of all changes made in their

plan.5. Student will create tutorial to teach others how to reduce

other’s footprint based on the changes the student has made in their life.

Phase IV: Results

Results of student study

1. From your study, how much of a reduction of your carbon footprint

did you document?

2. From your study, what was the financial cost of your changes made in your life? Do you feel it was worth the financial cost?

3. What areas of your life did you find you were able to make the

most changes?

4. Was your tutorial able to sway others to make changes in their

lives? How?5. Overall, how effective was your plan in reducing your

footprint and will you be able to continue your plan in the future?

SUCCESS CASE METHOD

STEP 1: IDENTIFY PARTICIPANTS THAT WERE THE MOST AND LEAST SUCCESSFUL

STEP 1A: ONE MONTH AFTER THE COMPLETION OF THE COURSE, SEND ALL OF THE PARTICIPANTS A SURVEY.

 

Q1: SINCE COMPLETING THE COURSE, TO WHAT EXTENT HAVE YOU MADE CONSCIOUS DECISIONS TO TAKE ACTIONS TO REDUCE YOUR CARBON FOOTPRINT?CONSTANTLY FREQUENTLY SOMETIMES RARELY NEVER

Q2: SINCE COMPLETING THE COURSE, I HAVE BEEN ABLE TO RECOGNIZE ACTIONS THAT ARE MORE EFFECTIVE IN REDUCING MY CARBON FOOTPRINT THAN OTHERS AND HAVE CONCENTRATED ON MAKING CHANGES THAT WILL HAVE A GREATER IMPACT.

CONSTANTLY FREQUENTLY SOMETIMES RARELY NEVER Q3: SINCE COMPLETING THE COURSE, TO WHAT EXTENT HAVE YOU EDUCATED OTHER MEMBERS IN YOUR HOUSEHOLD ABOUT WAYS TO REDUCE THEIR CARBON FOOTPRINTS?

CONSTANTLY FREQUENTLY SOMETIMES RARELY NEVER NA

STRONGLY AGREE AGREE INDIFFERENT DISAGREE STRONGLY DISAGREE

Q4: AFTER COMPLETING THE COURSE, TO WHAT EXTENT DO YOU AGREE WITH THE FOLLOWING STATEMENT: “RECOGNIZING MY CARBON FOOTPRINT AND TAKING STEPS TO REDUCE THIS FOOTPRINT IS IMPORTANT.”

STEP 1B: COLLECT THE SURVEY RESULTS AND IDENTIFY THE PARTICIPANTS THAT WERE THE MOST AND LEAST SUCCESSFUL.

 

MOST

LEAST

STEP 1C: CONDUCT PHONE INTERVIEWS WITH THE SUCCESSFUL PARTICIPANTS TO DETERMINE WHY THEY WERE SUCCESSFUL.

 

Questions to ask listed on next page.

QUESTIONS TO ASK SUCCESSFUL PARTICIPANTS

Q1. Did you have an opinion about greenhouse gas emissions prior to taking this course?

If yes, did the course change this opinion?

If yes, how and what content was most responsible for the change?

Q2. Several technical actions were identified in the course as ways to reduce your carbon footprint. Exactly which of these actions have you taken? When did you take this action? How?

For example, if improving home insulation is identified, then ask what type of insulation was used, what parts of the house, etc.

Q3. Several behavioral actions were identified in the course as ways to reduce your carbon footprint. Exactly which of these actions have you taken? How? How often?

For example, if participant answers “lowering the room temperature” ask how many degrees and how many days.

Q4. What were the financial costs?

Q5. The financial benefits?

Q6. Were there any factors other than the training course that enabled you to take these actions?

STEP 1D: CONDUCT PHONE INTERVIEWS WITH THE UNSUCCESSFUL PARTICIPANTS TO DETERMINE WHY THEY WERE SUCCESSFUL.

 

Questions to ask listed on next page.

QUESTIONS TO ASK UNSUCCESSFUL PARTICIPANTS

Q1. Did you have an opinion about greenhouse gas emissions prior to taking this course?

If yes, did the course change this opinion?

If yes, how and what content was most responsible for the change?

Q2. Several technical actions were identified in the course as ways to reduce your carbon footprint. What go in the way of taking these actions? (ie, resources, perception of value)

Q3. Several behavioral actions were identified in the course as ways to reduce your carbon footprint. What go in the way of taking these actions? (ie, resources, perception of value)

STEP 2: COMPILE THE RESULTS

STEP 2A: IDENTIFY THE MOST DESCRIPTIVE EXAMPLES OF SUCCESS AND PRESENT THEM IN A STORY FORMAT.

 

STEP 2B: IDENTIFY THE MOST DESCRIPTIVE EXAMPLES OF NON-SUCCESS AND PRESENT THEM IN A STORY FORMAT.

 

STEP 2C: COMPARE THE SUCCESS STORIES TO THE NON-SUCCESS STORIES TO IDENTIFY POTENTIAL CAUSES OF SUCCESS VS. NON-SUCCESS.

 

And that completes the Success Case Method.

Success Non-Success

Phase 1Feeback based on student’s reaction of course and presentation – done immediately after course

Phase 2 Feedback – Check change in behavior one month later based on knowledge learned

Phase 3 – Evaluate Performance: knowledge used in relevant experience

Phase 4 – Results: analyze experience for successful use of knowledge

Phase 1 feedback – conducted one month after training to determine level of success

Phase 2 feedback – interview most successful/least successful to determine what factors contributed to success or lack of success

Phase 3 – Relate the results in a story format to identify contributing factors of success/non-success

Kirkpatrick Success Case Method