Outcome Based Measurement
Mark AndersenDirector of Learning and
Economic AdvancementChicago Public Library
Agenda
• Who we are• The problem– Why we focus on outcomes
• The Solution: The Logic Model• Example• Wrap up and conclusion
Who are we?
Chicago Public Library
Our mission
We welcome and support all people in
their enjoyment of reading and
lifelong learning. Working together,
we strive to provide equal access to
information, ideas and knowledge
through books, programs and other
resources. We believe in the freedom
to read, to learn, to discover.
systemwide map
2014 Statistics
Branches: 80Active cardholders: 1,117,772Visitors: 9,968,256WiFi sessions: 3,046,636Items circulated: 10,022,785Public computer sessions: 2.8 million Public-access computers: approx 2,800Website visits: 13,807,482
The Problem
1.We have a finite number of resources.
why are we focused on outcomes?
1.We have a finite number of resources.
2.We have specific goals we are trying to achieve with a specific program or service.
why are we focused on outcomes?
1.We have a finite number of resources.
2.We have specific goals we are trying to achieve with a specific program or service.
3.We need to make sure we’re putting our time & talent to its best use.
why are we focused on outcomes?
52,165
1. What did they do?
2. What did they learn?
3. Are they better off?
what we don’t know
3,782
1. What did they do?
2. What did they learn?
3. Are they better off?
what we can begin to understand
The Solution
Outcome Based Measurement
Step 1: Define results to be measured
Step 2: Identify data required and sources
Step 3: Review existing assessment methods
Step 4: Define additional methods and measures
Step 5: Implement and evaluate
GOAL:
INPUTS → OUTPUTS → OUTCOMES INDICATORS (KPIs)
Logic Model
goal
what you hope to achieve with the new program or
service.
input
resources devoted to a program or service
Examples: librarians Computers classroom supplies
outputs
something that happens as a result of an activity or
process. Examples:
# of participants # of classes taught # of items
created
outcomes
what happens to the participant as a result of participating in
the activity or process.
outcomes
Examples: a new skill is developed new knowledge is learned change in attitude modification of behavior
KPI(Key Performance Indicator)
a sign that shows that what you want to accomplish did or did not happen.
KPI
Example: Objective: user has gained a
digital literacy skill Indicator: patron uses
software to create a design which they then print on the 3D printer.
If …. ThenInput
Output
Outcomes
KPIs
Outcome is achieved (Y/N)
GOAL: Foster and inspire creativity while building 21st century digital learning skills.
INPUTS → OUTPUTS → OUTCOMES INDICATORS (KPIs)
maker lab
GOAL: Foster and inspire creativity while building 21st century digital learning skills.
INPUTS → OUTPUTS → OUTCOMES INDICATORS (KPIs)
patron graphic file
a new digital literacy skill is developed
Printed object of a personalized or original design
patron graphic file
creativity is unleashed
Personalized and / or original graphic file
maker lab
Thank You