LOGIC MODEL: A Program Performance Framework

New Educator OrientationSept. 30, 2010

Oklahoma State UniversityStillwater, OK

New Educator Thought for the Day

“People don’t care how much you know until they know how much you care.”

» Unknown

This will serve you well as you begin your career in Extension

OCES Program Planning

• OCES works within broad program guidelines.– Long Range Plan of Work

• Rolling Plan of Work – Typically 3 years or more, but is flexible

– Short term Planning to Accomplish Longer Term Goals

• Annual Implementation Timeline– This is your roadmap

Just What Is A LOGIC Model?

• The program logic model is defined as:– A picture of how our organization does its

work—the theory and assumptions underlying the program. A program logic model links outcomes (both short- & long-term) with program activities/processes and the theoretical assumptions/principles of the program.

What is a Logic Model?

• A simplified picture of a program, initiative or intervention in response to a given situation.

• Shows the logical relationships among the resources that are invested, the activities that take place and the benefits or changes that result.

– Some call this ‘program theory’

• Logic modeling is really a way of thinking!

• A bridge between where you are and

where you want to be with your programs.

LOGIC

• If you don’t know where you’re going, how are you gonna’ know when you get there?– Yogi Berra

Brief History

• Logic Models Aren’t New– Date back to the 1970s

• Suchman (1967), Weiss (1973, Bennett (1976), others• Used Many Places:

– Private Sector• TQM

– Public Sector• Govt. Performance Results Act 1993

– Set Standards for Measuring Performance– Non-Profit Sector

• United Way – International Donor Agencies– Evaluators

Goals for Today

• Learn about LOGIC Models– A basic introduction to the logic model as an

action-oriented tool for program planning and evaluation

• Practical Applications of LOGIC Models in your programs

WHY LOGIC MODELS?• Shows difference

between what we do and impact we are having

• Provides a common vocabulary

• Focus on quality and continuous improvement

What is a Logic Model?

• A systematic and visual way (road map) to present and share your understanding of the relationships among:– Resources you have to operate your program– The activities you plan to do– The changes or results you hope to achieve

– It’s a map of how you think your program will work from start to finish.

Logic Model

Common Vocabulary

SITUATION

OUTCOMESINPUTS OUTPUTS

Government reports, OCES reports, Grant applications

HEADACHE

Feel betterGet pills Take pills

Everyday Logic Model

Logical progression, common sense

HUNGER

Feel betterFind Food Eat Food

Everyday Logic Model

Logical progression, common sense

Logic Model

• OCES Logic Models will be somewhat more complicated, but remembering the simple examples should keep them from becoming overwhelming or intimidating.

An Extension Example: Healthy Eating for Oklahoma Youth

Extension invests time and resources

A variety of educational activities are provided to youth who participate (outputs)

These owners gain knowledge and change practices resulting in improved nutrition and better long-term health. (outcomes)

Another Example

• Situation: Cattle Stocking Rates are generally considered too great for the carrying capacity of the land, resulting in weed encroachment and poor cattle performance.

• Outputs: A series of educational programs regarding determining and implementing appropriate stocking rates is developed, marketed, promoted, delivered, and evaluated.

• Outcome: Stocking rates are reduced to the carrying capacity of the land, resulting in better cattle performance and increased potential for profit.

INPUTS

FacultyStaff

MoneyTime

VolunteersPartners

EquipmentTechnology

OUTPUTS What we do Who we reach

ACTIVITIES Workshops Counseling(Consulting??) On-farm research Facilitation Product development Curriculum design Trainings Field days Conferences Media

PARTICIPATION Participants Clients Customers Users

LOGIC MODEL: Program Performance

INPUTS OUTPUTS OUTCOMES

Program investments

Activities Participation Short Medium

What we invest

What we do

Who we reach

What results

Long-term

IF : THEN• The IF:THEN relationship provides for

the development of the LOGIC MODEL.

• The Logic MODEL is important to OCES because our current( 07-11) federal Plan of Work is designed around it.

• So…Logic tells us the Logic Model is important at the local level.

Logical Linkages: Series of If-Then Relationships

IF THEN IF THEN IF THEN IF THEN

INPUTS OUTPUT OUTCOMES

OCESinvests time

&money

Resourceinventorycan be

developed

Clientswill knowwhat is

available

Clientswill access

services

Clientswill have

needs met

IF : THEN• “IF: the purpose of youth groups is to

develop leadership and citizenship skills (Wylie, 1990), and

• IF: we know that skills developed in one’s youth carry into adulthood (Ladewig & Thomas, 1987),

• THEN: youth leadership organizations should be able to document how their alumni are impacting the communities in which they reside…” (Pennington & Edwards, 2004)

LOGIC MODEL: Program Performance Framework

INPUTS OUTPUTSActivities Participation

What we invest

StaffVolunteersTimeMoneyMaterialsEquipmentTechnologyPartners

What we do

WorkshopsMeetingsCounselingFacilitationAssessmentsProduct dev.Media workRecruitmentTraining

Who we reach

ParticipantsCustomersCitizens

Reactions

ENVIRONMENTInfluential factors

SITUATION

What the short term results are

Learning

AwarenessKnowledgeAttitudesSkillsOpinionsAspirationsMotivations

Action

BehaviorPracticeDecisionsPoliciesSocial action

What the ultimate impact(s) is

Conditions

Social Economic Civic Environmental

OUTCOMES-IMPACTShort Medium Long-term

What the medium term results are

Environment–Influential Factors

• Extension program does not exist in a vacuum (other educational sources)

• Context of the program (other sources of behavior changes)– politics, family circumstances, cultural milieu,

demographics, economics, values, biophysical environment, policies, services

• What affects the program over which you have little control?

Do the Outcomes First

• I definitely advocate doing the outcomes first! I find that people come up with much more effective activities when they do. Use the motto, “ plan backward, implement forward.”

– Beverly Anderson Parsons, WKKF Cluster Evaluator

OUTCOMESINPUTS OUTPUTS

Activities Participation Short Medium Long

term

Programmatic investments

i

Implement and Evaluate

PLANNING

Outcomes• Are they Important?• Are they Reasonable?• Are they Realistic?• Are there Negative Consequences?

S.M.A.R.T.• Specific• Measurable• Attainable• Realistic• Timed

Staff

Money

Partners

Develop parent ed curriculum

Deliver 6 interactivesessions

Targeted

parents

attend

Parents increase knowledge of child dev

Parents learn new ways to discipline

Parents use improved parenting skills

Reduced rates of child abuse & neglect

INPUTS OUTPUTS OUTCOMES

INDICATORS???

Research

Progressive Outcome Relationships

SHORT MEDIUM LONG-TERM

Seniors increaseknowledge of food contamination risks

Practice safe cooling of food; food preparation guidelines

Lowered incidence of food borne illness

Participants increaseknowledge and skills infinancial management

Establish financial goals,use spending plan

Reduced debt andincreased savings

Community increasesunderstanding ofchildcare needs

Residents and employersdiscuss options andimplement a plan

Child care needs are met

Empty inner city parkinglot converted tocommunity garden

Youth and adults learngardening skills, nutrition,food preparation and mgt.

Money saved, nutritionimproved, residents enjoygreater sense ofcommunity

Logic model with Indicators for Outputs

and Outcomes

Program implemented

Targeted farmers

Farmers learnFarmers practice new techniques

Farm profitability increases

Number of workshops held

Number and percent of farmers attending

Number and percent who learned content

Number and percent who adopted practices

Number and percent show improved farm profits; amount of increase

OutputsOutcomes

Where Does Evaluation Fit?

Decrease in rates - agency records

Actual use - follow-up phone interview

Increase in knowledge/skill- post session survey

# parents attending/sessionwhich parents% of parents

Quality of curriculum# of sessions delivered

Staff

Money

Partners

Design parent ed curriculum

Provide 6 training sessions

Targeted

parents

attend

Parents increase knowledge of child dev

Parents learn new ways to discipline

Parents use improved parenting skills

Reduced rates of child abuse & neglect

INPUTS OUTPUTS OUTCOMES

EVALUATION: What do you want to know? How will you know it?

Last Slide

• View evaluation as learning - integrate into the way we work

• Build evaluation in upfront• Ask ‘tough questions’• Make measurement meaningful• Be accountable for highest professional

standards

Summary

• Think of the Logic Model as Your “Roadmap”– Provides a graphic description of a program

(process, event, community initiative)– Shows the relationship of program inputs and

outputs to expected results (outcomes)– Makes explicit the underlying theory of a

program

Summary

• Made up of six components:– Situation– Inputs– Outputs– Outcomes– Assumptions– External Factors

Logic Model Websites

• http://www.uwex.edu/ces/lmcourse/

• http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf

• http://www.uidaho.edu/extension/LogicModel.pdf

• Or goto google.com, search for “logic model program evaluation”

• Be aggressive in your programming– Establish needs early on

• Recognize things change• Extension must be flexible

– Be a risk taker

– Utilize volunteers

New Educator Thought for the Day

• “People don’t care how much you know until they know how much you care.”

» Unknown

• This will serve you well as you begin your career in Extension

New Educator Thought for the Day

• “People don’t care how much you know until they know how much you care.”

» Unknown

• This will serve you well as you begin your career in Extension

New Educator Thought for the Day

• “People don’t care how much you know until they know how much you care.”

» Unknown

• This will serve you well as you begin your career in Extension

Last Slide, Really!!

• Questions?