Beyond Data

Why does evaluation seen so foreign to most?

Feeing frustrated?Have you ever gotten frustrated with

the evaluation process?Have you ever wondered how to take

the data you have collected and tell the success stories of your programs?

Have you ever found you had wonderful programs but could not communicate your successes to others?

Why is Evaluation so Important?

It can: define who the program serves how the program functions determine if it is working as

intended tel us what needs to change determine if it is it worth the

investment market your wonderfulness make a case for your funding

Myths and Facts Evaluation comes at

the end Using the same

form for each teaching group is a good practice

Someone else should evaluate your program

Just the Facts Evaluation starts at the

beginning We are often guilty of

planning by starting in the middle

Determine what you want to happen (objectives)

Evaluate only large efforts not short sessions (satisfaction vs. impact)

Evaluate a series of efforts toward the WHOLE

Into the Beyond… It’s not that foreign Remember a few things Maximize your outreach cyfernet.org/ncsu_fcs/

beyonddata/

What do you want to change?

Knowledge & AttitudesSkillsMotivationBehaviorsPolicies

Evaluation tips

Include evaluation in initial program design

Don’t do it alone; create evaluation teams Include stakeholders in all phases Go beyond satisfaction data Combine quantitative and qualitative data Don’t let your data go into a black hole

unused

Example Sample Program

Objectives:

Teen parents will express that they feel more social/emotional support and resource support by being part of a parent support network.

Teen parents will interact appropriately with their toddlers 80% of the time when observed.

Community partners will work together to organize a resources center to be completed by June 2009.

Evaluation methods Case studies Interviews Observation check

sheets (pre and post) Standardized

instruments (pre and post comparisons)

Phone surveys Demographic tracking Public hearing,

forums

Telling your story Executive

summaries, abstracts

Annual reports Brochures, exhibits Fact sheets News releases Posters Graphics, slides

Drawing conclusions into a report

Give background Outline objectives of the

program Tell what was done Summarize into

paragraphs Tell the numbers

(percentages and frequencies at least)

Use powerful quotes Edit, spell check, design

a professional cover or “look”

Example

Coded head counts

Self-report follow-up after learning

Coded learning sessions by topic

Report “Look”

Report “Look” too

More helpProgram planning websiteBeyonddata website

-http://cyfernet.org/ncsu_fcs/beyonddata/

www.cyfernet.org - click on EVALUATION

Planning a Program Evaluation - learningstore.uwex.edu/pdf/G3658-1.PDF