Outputs, Outcomes, and Logic Models

Community Training Institute 2013

Ashley Brundage, Senior Director of Community Impact Grants

United Way of Metropolitan Dallas

Topics and Objectives

Why Use Outcomes?• Learn value of outcome measurement

Logic Models• Clearly explain how to construct the logic model

Outputs• Clearly explain outputs

Outcomes• Provide an in-depth discussion on developing

outcomes

2

Why Use Outcomes?

3

4

The importance of Evaluation and Outcome based programing

The measurement

of Results

Analysis & Learning

Action & Improvement

Accountability

Benefits of Outcome Measurement

• Increased accountability to donors and the community

• Enhance marketing and fundraising messages

• An improved image and greater visibility in the community

• Greater success in retaining, maintaining and/or increasing dollars

5

“The American public has extended you the right to avoid taxation in exchange for your commitment to create real social value. You owe it to the public to make a real effort to track your performance and report to them on how you are doing in your work.”

from Enterprising Nonprofits

Questions that Outcomes Answer

• Did the program achieve is intended goals/impact/etc.?

• How does the program contribute to the agency’s strategic goals?

• Is this program worth the cost?

• Did the program reach the target population?

• How can implementation be improved?

• Is this program still relevant or viable?

• Is what was promised being achieved?

• Is the program working?

• What is the program accomplishing?

• How does this program compare to others?

• Did we reasonably accomplish what we committed to do?

• How have participants changed as a result of our program?

6

Logic Models

Logic Models: Purpose

What is a Logic Model?• If Then• Visual representation of the program’s intent

Why are Logic Models necessary?• Help to assess the program’s effectiveness.• Illustrate the client’s progress through the

program• Developing a realistic picture of what the

program can expect to accomplish• Helps tell your story and the difference you’re

making

8

Logic Models: Resources & Activities

9

Resources• Identify all inputs that

make the activities possible.

• List all the “what” and “who” that is necessary to delivering the activities.

• People, materials, meeting space, etc.

Activities• What will participants be

doing?• Prioritize, what activities

will help to achieve the outcomes?

Resources & Activities Example

Resources• Staff

• Curriculum

• Funding

• Awareness handouts

• Conference room

• Projector

Activities• Child abuse

awareness presentations

• Distribution of awareness handouts

10

ACTIVITY BREAK

11

Activity Break: Resources and Activities

Think about a program at your agency to evaluate.

• Needs to have a clear target population.

• Needs to have a clear method of providing services.

• Focus on one for the purposes of this training today.

Fill in the Resources and Activities of your program.

Work in pairs to help each other.

What did you find difficult about this part? Easy?

12

Outputs

13

Logic Model Component: Outputs

Primary Activities

Outputs

What do clients do?

What is produced?

14

Outputs Example

Outputs:

• Educators will teach 200 people about the signs of child abuse.

• Educators will give 10 hour long presentations.

• Outreach staff will distribute 1,000 child abuse awareness handouts.

15

Activity Break: Develop Outputs

With your partner,

Discuss your program’s activities

Develop your outputs

Fill in the output column of your logic model

Share with the group one output from each of your programs

What did you find difficult about this part? Easy?

16

Outcomes

18

What is outcomes based planning and evaluation?

“Not how many worms the bird feeds its young, but how well the fledgling flies”

United Way of America, 2002

Logic Model Component: Outcomes

• What is an Outcome?

• Outcomes are the benefits/client change for participants during or after their involvement with a program.

• Outcomes may relate to a change in knowledge, skills, attitudes, values, behavior, condition, or status.

• Satisfaction is not an outcome.

Example:

Educators increase the audience’s awareness about signs of child abuse.

19

Indicators

• What is an Indicator?

• Indicators are specific observable, measurable characteristics or changes that represent achievement of the overall impact.

• Specific statistics calculated to summarize the program’s level of achievement.

Example:

Percent of target audience that remembers key points of lecture.

20

Building an Outcome

21

What your clients do

How you want your clients to change

Indicator of Change

Outcome Statement

Outputs Outcome Indicator

Building an Outcome

22

Attend presen-tations

Increased Awarenes

s

Increased Pre/Post

Test scores

Audience will have increased

awareness of child abuse as

measured by an increased score from their pre to post test taken before and after the presentation.Outputs Outcome Indicator

Activity Break: Outcome Statements

• Look at your activities and outputs you have for your program so far.

• What outcomes do you want to see?

• What indicators will determine those outcomes?

• Develop at least one Outcome Statement for your program and share with the group.

23

Outcomes: SMART

S• Specific

M• Measurable

A• Action-Oriented

R• Realistic

T• Timed

24

Outcomes: The SMART Format

X% (number) of clients will improve by X% or achieve X

in a specific time frame.

25

Outcomes: Example

80% (160) of 200 clients will increase their post test score by 20% above their pre test score after attending one child abuse

awareness presentation.

26

Activity Break: Outputs vs Outcomes

Check under seat

Read out loud

Is yours an Output

or an Outcome?

27

Activity Break: SMART Outcomes

28

• Using the Outcomes statement developed earlier

• Add SMART Criteria

• Fill in the Outcomes column on Logic Model

• Report to Group Examples

Logic Model Components: Impact

Impacts are organizational, community, and/or system level changes expected to result from program activities, which might include improved conditions, increased capacity, and/or changes in the policy arena.

Ex: Improved health and well being in North Texas.

29

Activity Break:

Add your impact statement to your logic model.

Share examples with the group.

30

Logic Models: Tips

31

“I think you should be more explicit here in Step Two.”

A common problem is that activities and strategies often do not lead to the desired outcomes.

Check your ‘if-then’ statements and ensure that they make sense and lead to the outcomes you want to achieve.

A logic model makes the connections EXPLICIT.

Activity Break: Logic Model Exercise

• Individually circle what you think needs adjustment

• Share with the group what you identified as problem areas and why

Using the logic model example provided

32

Questions?

Thank You!