Date post: | 25-Dec-2015 |
Category: |
Documents |
Upload: | chloe-garrett |
View: | 214 times |
Download: | 0 times |
Dr. Jeff M. AllenDepartment of Technology and Cognition
Assessment of Assessment of CoursesCourses
An Open Forum through the University Forum on Teaching,
Learning and AssessmentSponsored by the Office of the Vice-President of Academic Affairs
Can be Downloaded at:www.coe.unt.edu/Allen/download.htm
Dr. Jeff M. AllenDepartment of Technology and Cognition
Session ObjectivesSession Objectives
Discuss General Classroom Assessment.
Discuss Outcome Oriented Evaluation.
Facilitate an Open Discussion about Assessment.
Dr. Jeff M. AllenDepartment of Technology and Cognition
Needs AssessmentNeeds Assessment
What do you know about assessment or evaluation?
What are your expectations of this session?
Dr. Jeff M. AllenDepartment of Technology and Cognition
What is the Difference What is the Difference betweenbetween
Education & Education & Training?Training?
Dr. Jeff M. AllenDepartment of Technology and Cognition
Consider your reaction if Consider your reaction if your child came home and your child came home and told you:told you:We attended sex education today!
or We attended sex training today!
Dr. Jeff M. AllenDepartment of Technology and Cognition
Evaluation MythEvaluation Myth
I can’t Measure the I can’t Measure the ResultsResults of my of my
Program.Program.
Dr. Jeff M. AllenDepartment of Technology and Cognition
Using different “Levels” of Evaluation:
Comfort (Environment)
Consider . . .Consider . . .
Dr. Jeff M. AllenDepartment of Technology and Cognition
Using different “Levels” of Evaluation:
Comfort (Environment)
Formative (Progress)
Consider . . .Consider . . .
Dr. Jeff M. AllenDepartment of Technology and Cognition
Using different “Levels” of Evaluation:
Comfort (Environment)
Formative (Progress)
Summative (Learning Outcomes)
Consider . . .Consider . . .
Dr. Jeff M. AllenDepartment of Technology and Cognition
Using different “Levels” of Evaluation:
Comfort (Environment)
Formative (Progress)
Summative (Learning Outcomes)
Transfer (Application of Learning)
Consider . . .Consider . . .
Dr. Jeff M. AllenDepartment of Technology and Cognition
Contextual Learning Why do I have to learn this? Where am I going to use it? How does this
relate to where I’m going in life?
Consider . . .Consider . . .
Dr. Jeff M. AllenDepartment of Technology and Cognition
Evaluation MythsEvaluation Myths
I Don’t Need To I Don’t Need To Justify My Justify My Existence, I Have a Existence, I Have a Proven Proven Track RecordTrack Record
Dr. Jeff M. AllenDepartment of Technology and Cognition
Evaluation MythEvaluation Myth
My My Doesn’t Doesn’t Require Evaluation,Require Evaluation,
So Why ShouldSo Why Should
I Do It?I Do It?
Dr. Jeff M. AllenDepartment of Technology and Cognition
What if is no longer in that position?
What about tough economic times?
Budget Cuts? What if someone doesn’t have
the same amount of faith?
Consider . . .Consider . . .
Dr. Jeff M. AllenDepartment of Technology and Cognition
Why Evaluate?Why Evaluate?
Dr. Jeff M. AllenDepartment of Technology and Cognition
Goals of AssessmentGoals of Assessment(Classroom)(Classroom) Basis for Planning & Directing Determine if Training /
Education makes a Difference Assess Progress &
Achievement Continuous ImprovementContinuous Improvement
Dr. Jeff M. AllenDepartment of Technology and Cognition
Goals of AssessmentGoals of Assessment(Programs)(Programs) Basis for Planning & Directing Assess Progress &
Achievement Evaluate Curriculum /
Programs / Staff / Facilities Certify / Rate / Accredit
(for example: SACS & THECB) Monitor Expenditures of $$$
Dr. Jeff M. AllenDepartment of Technology and Cognition
Goals of AssessmentGoals of Assessment(Programs)(Programs) Justify Existence Accountability Pressure from Other
Organizations Marketing Continuous ImprovementContinuous Improvement
Dr. Jeff M. AllenDepartment of Technology and Cognition
Please Remember . . Please Remember . . .. Not everything is
quantifiable. Consider evaluation
EARLY. Some benefits cannot be
measured immediately.
Dr. Jeff M. AllenDepartment of Technology and Cognition
A Complete A Complete Results Results
Oriented ModelOriented ModelSource:
Phillip, J. (1991). Handbook of Training Evaluation and Measurement Methods (2nd Ed.). Houston, TX: Gulf.
Latest Edition:
Phillips, J. (1997) – 3rd Ed. ISBN #0-88415387-8
1. Conduct a Needs Analysis 2. Develop Tentative Objectives
3. Establish Baseline Data4. Select Evaluation Methods/Designs5. Finalize Program Objectives7. Estimate Program Cost/Benefits8. Prepare and Present Proposal9. Design Evaluation Instruments10. Determine & Develop Content11. Design or Select Training and Development Methods12. Test Program and Make Revisions
BEFORE
13. Implement and Conduct Program
14. Evaluate/Collect Data at Proper Stages
15. Analyze and Interpret Data
DURING
16. Make Adjustments
17. Calculate Return-on-Investment
18. Communicate Results
AFTER
Results-Oriented ModelResults-Oriented Model
1. Conduct a Needs Analysis 2. Develop Tentative Objectives
3. Establish Baseline Data4. Select Evaluation Methods/Designs5. Finalize Program Objectives7. Estimate Program Cost/Benefits8. Prepare and Present Proposal9. Design Evaluation Instruments10. Determine & Develop Content11. Design or Select Training and Development Methods12. Test Program and Make Revisions
BEFORE
13. Implement and Conduct Program
14. Evaluate/Collect Data at Proper Stages
15. Analyze and Interpret Data
16. Make Adjustments
17. Calculate Return-on-Investment
18. Communicate Results
DURING
AFTER
Results-Oriented ModelResults-Oriented Model
13. Implement and Conduct Program
14. Evaluate/Collect Data at Proper Stages
15. Analyze and Interpret Data (Improvement Notes)
DURING
1. Conduct a Needs Analysis 2. Develop Tentative Objectives
3. Establish Baseline Data4. Select Evaluation Methods/Designs5. Finalize Program Objectives7. Estimate Program Cost/Benefits8. Prepare and Present Proposal9. Design Evaluation Instruments10. Determine & Develop Content11. Design or Select Training and Development Methods12. Test Program and Make Revisions
BEFORE
Results-Oriented ModelResults-Oriented Model
16. Make Adjustments
17. Calculate Return-on-Investment
18. Communicate Results
13. Implement and Conduct Program
14. Evaluate/Collect Data at Proper Stages
15. Analyze and Interpret Data (Improvement Notes)
1. Conduct a Needs Analysis 2. Develop Tentative Objectives
3. Establish Baseline Data4. Select Evaluation Methods/Designs5. Finalize Program Objectives7. Estimate Program Cost/Benefits8. Prepare and Present Proposal9. Design Evaluation Instruments10. Determine & Develop Content11. Design or Select Training and Development Methods12. Test Program and Make Revisions
BEFORE DURING
AFTER
Results-Oriented ModelResults-Oriented Model
1. Conduct a Needs Analysis 2. Develop Tentative Objectives
3. Establish Baseline Data4. Select Evaluation Methods/Designs5. Finalize Program Objectives7. Estimate Program Cost/Benefits8. Prepare and Present Proposal9. Design Evaluation Instruments10. Determine & Develop Content11. Design or Select Training and Development Methods12. Test Program and Make Revisions
BEFORE
13. Implement and Conduct Program
14. Evaluate/Collect Data at Proper Stages
15. Analyze and Interpret Data (Improvement Notes)
DURING
16. Make Adjustments
17. Calculate Return-on-Investment
18. Communicate Results
AFTER
Results-Oriented ModelResults-Oriented Model
Continuous
Improvem
ent
Dr. Jeff M. AllenDepartment of Technology and Cognition
Limitations of Limitations of Evaluation & Evaluation & AssessmentAssessment Evaluation/Assessment
(generally) Does Not Solve Problems,
It Serves to Identify Them.
Improvement is Next!Improvement is Next!
Dr. Jeff M. Allen
University of North TexasUniversity of North Texas
Department of Technologyand Cognition
P.O. Box 311337Denton, Texas 76203-1337
Email: [email protected]: (940)565-4918
To Download Presentation: http://www.coe.unt.edu/Allen/download.htm
(Available until February 2000)