DID THEY DO BETTER?
MECHANISMS TO DEMONSTRATE IMPACT OF YOUR PROJECT OR PROGRAM:
Michael Lesiecki | Luka PartnersEmma Perk | EvaluATE
WHO ARE WE?
EMMA MIKE
WHAT IS DRIVING THIS?
WHERE’S THE IMPACT?
?
WE ASK OURSELVES
WE ASK OURSELVES
WE ASK OURSELVES
THEME OF TODAY
THEME OF TODAY
THEME OF TODAY
YOUR ACTIVITIES
PERFORMANCE TASK
ASSESSMENT
a situation that has been carefully designed to elicit meaningful differences in behavior of a certain kind.
PERFORMANCE TASK
EXAMPLE:STEM PERFORMANCE TASK
Example: STEM Performance Task
Goal: devise a solution to a problem or need using a wearable sensor
Example: STEM Performance Task
Performance Task: establish a data communication link between the sensor and a smart phone
Goal: devise a solution to a problem or need using a wearable sensor
HOW DO WE MEASURE
PERFORMANCE?
Hamburger Rubric
Analytic Rubric
Holistic Rubric
Single-Point Rubric
EXAMPLE:PROGRAMMABLE LOGIC CONTROLLERS
Example: Programmable Logic Controllers
Competencies: A combination of software coding (IT) skills and physical skills like wiring
Performance Task: Write a PLC program for machine automation
Task: Write a PLC program for machine automation
ConcernsAreas that need work
CriteriaStandards of this performance
AdvancedEvidence of exceeding
standards
TheMachineCycleisbrokendownintomodularpiecesofcode
ConcernsAreas that need work
CriteriaStandards of this performance
AdvancedEvidence of exceeding
standards
TheMachineCycleisbrokendownintomodularpiecesofcode
Automa:csequencestepsaredefined
Task: Write a PLC program for machine automation
ConcernsAreas that need work
CriteriaStandards of this performance
AdvancedEvidence of exceeding
standards
TheMachineCycleisbrokendownintomodularpiecesofcode
Automa:csequencestepsaredefined
Codingisdonevialadderlogic
Task: Write a PLC program for machine automation
ConcernsAreas that need work
CriteriaStandards of this performance
AdvancedEvidence of exceeding
standards
TheMachineCycleisbrokendownintomodularpiecesofcode
Automa:csequencesstepsaredefined
Par$cularlywelldocumentedstepsequence
Makebe7eruseoffunc$onalblocks
Codingisdonevialadderlogic
0-79 points 80-95 points 96-100 points
Task: Write a PLC program for machine automation
Example: Wiring Diagram, I/O Map, Motor Start
Competencies: A combination of software coding (IT) skills and physical skills like wiring
Performance Task: demonstrate the manual start of a 24 volt motor that is to be controlled by a PLC
Task: Demonstrate the manual start of a 24 volt motor that is to be controlled by a PLC
ConcernsAreas that need work
CriteriaStandards of this performance
AdvancedEvidence of exceeding
standards
Wiring diagram indicates the correct I/O connections
The diagram is consistent with the control system flow chart
Task: Demonstrate the manual start of a 24 volt motor that is to be controlled by a PLC
ConcernsAreas that need work
CriteriaStandards of this performance
AdvancedEvidence of exceeding
standards
wire the I/O modules correctly
successfully interpret the I/O map
wire the start push button and motor to the correct modules at the correct terminals
If the motor does not start when the start button is pushed, the student has not demonstrated all of the competencies needed to accomplish the task.
Example: Suite of Performance Tasks
ConcernsAreas that need work
CriteriaStandards of this performance
AdvancedEvidence of exceeding
standards
The student will construct a wiring diagram indicating the correct I/O connectionsThe student will perform the correct wire I/O connectionsdemonstrate the manual start of a 24 volt motor that is to be controlled by a PLC with an I/O map and program provided by the instructor
0-79 points 80-95 points 96-100 points
_______Total Points
Example: Suite of Performance Tasks
ConcernsAreas that need work
CriteriaStandards of this performance
AdvancedEvidence of exceeding
standards
Add notes for concerns here…
The student will construct a wiring diagram indicating the correct I/O connectionsThe student will perform the correct wire I/O connectionsdemonstrate the manual start of a 24 volt motor that is to be controlled by a PLC with an I/O map and program provided by the instructor
Add notes for advanced score here…
0-79 points 80-95 points 96-100 points
_______Total Points92
• Even under ideal conditions a single performance task can suffer from random errors or practice (test re-test effects)
• A suite of performance tasks aggregated can minimize these limitations
Performance Task: Limitations
Performance Tasks: Other Examples
Create Series and Parallel Circuits
Operate a Vacuum Leak Detector Simulator
Gown for a cleanroom
Performance Task: Conceptual Understanding
Explaining the concept to another audience
Demonstrate the concept of a limiting reagent through color changes
Use a laser to demonstrate the concept of polarization
Does this work beyond the
CLASSROOM?
YES
National Conference Impact: HI-TEC
Snapshot of HI-TEC Survey Results
100%agreed there were adequate networking opportunities
97%ofexpecta:onsweremetandtheywouldrecommendHI-TEC
96%willbeabletousethecontent/materialspresented
100%explorednewtechnologyareasoutsidetheirareaofexper:se
Snapshot of HI-TEC Survey Results
100%agreed there were adequate networking opportunities
97%ofexpecta:onsweremetandtheywouldrecommendHI-TEC
96%willbeabletousethecontent/materialspresented
100%explorednewtechnologyareasoutsidetheirareaofexper:se?
Performance Task: HI-TEC
Goal: empower industry participants to act on a better understanding of challenges encountered by educators.
Performance Task: -Changingrecruitmentstrategies,-JoiningcurriculumcommiHees-Invi:ngeducatorstojointheirworkforcecommiHees
How should we measure
PERFORMANCE?
Performance Task: HI-TEC
Holis'crubric:Performancetask:CreateMoreEfficientRecruitmentStrategiesScore Descrip'on4 Jobeventsheldoncampusincollabora:onwithspecificprograms;job
announcementssay“ProgramGradatesPreferred;Metricsshowfewerapplicantsareneededtobescreenedtofindthequalifiedcandidate
3 Increasedcollabora:onattheprogramleveltoiden:fyhowprogramgraduatescanbeHerevidencetheirSkills,KnowledgeandAbili:esinjobinterviews;programcompletersguaranteedajobinterview
2 Increasedcollabora:onattheprogramleveltoiden:fyhowprogramgraduatescanbeHerevidencetheirSkills,KnowledgeandAbili:esontheirresumes
1 JobannouncementsaresenttoCommunityCollegePlacementoffice
• Student success with competency based instruction can be assessed through performance tasks
• Performance tasks are helped by rubrics that describe student performance
• Completion of these tasks provide evidence for what a student knows and can do
• The performance task approach can be extended to assess impact of conferences and workshops
Performance Task: Summary
We challenge you to go and create your
own performance task and rubric!
Keep in touch:Michael Lesiecki: [email protected]
Emma Perk: [email protected]
What to do next?