Outcome Based Measurement

Mark AndersenDirector of Learning and

Economic AdvancementChicago Public Library

Agenda

• Who we are• The problem– Why we focus on outcomes

• The Solution: The Logic Model• Example• Wrap up and conclusion

Who are we?

Chicago Public Library

Our mission

We welcome and support all people in

their enjoyment of reading and

lifelong learning. Working together,

we strive to provide equal access to

information, ideas and knowledge

through books, programs and other

resources. We believe in the freedom

to read, to learn, to discover.

systemwide map

2014 Statistics

Branches: 80Active cardholders: 1,117,772Visitors: 9,968,256WiFi sessions: 3,046,636Items circulated: 10,022,785Public computer sessions: 2.8 million Public-access computers: approx 2,800Website visits: 13,807,482

The Problem

1.We have a finite number of resources.

why are we focused on outcomes?

1.We have a finite number of resources.

2.We have specific goals we are trying to achieve with a specific program or service.

why are we focused on outcomes?

1.We have a finite number of resources.

2.We have specific goals we are trying to achieve with a specific program or service.

3.We need to make sure we’re putting our time & talent to its best use.

why are we focused on outcomes?

52,165

1. What did they do?

2. What did they learn?

3. Are they better off?

what we don’t know

3,782

1. What did they do?

2. What did they learn?

3. Are they better off?

what we can begin to understand

The Solution

Outcome Based Measurement

Step 1: Define results to be measured

Step 2: Identify data required and sources

Step 3: Review existing assessment methods

Step 4: Define additional methods and measures

Step 5: Implement and evaluate

GOAL:

INPUTS → OUTPUTS → OUTCOMES INDICATORS (KPIs)

Logic Model

goal

what you hope to achieve with the new program or

service.

input

resources devoted to a program or service

Examples: librarians Computers classroom supplies

outputs

something that happens as a result of an activity or

process. Examples:

# of participants # of classes taught # of items

created

outcomes

what happens to the participant as a result of participating in

the activity or process.

outcomes

Examples: a new skill is developed new knowledge is learned change in attitude modification of behavior

KPI(Key Performance Indicator)

a sign that shows that what you want to accomplish did or did not happen.

KPI

Example: Objective: user has gained a

digital literacy skill Indicator: patron uses

software to create a design which they then print on the 3D printer.

If …. ThenInput

Output

Outcomes

KPIs

Outcome is achieved (Y/N)

GOAL: Foster and inspire creativity while building 21st century digital learning skills.

INPUTS → OUTPUTS → OUTCOMES INDICATORS (KPIs)

maker lab

GOAL: Foster and inspire creativity while building 21st century digital learning skills.

INPUTS → OUTPUTS → OUTCOMES INDICATORS (KPIs)

patron graphic file

a new digital literacy skill is developed

Printed object of a personalized or original design

patron graphic file

creativity is unleashed

Personalized and / or original graphic file

maker lab

Thank You