Performance Performance Measurement: Defining Measurement: Defining

ResultsResultsTutorial #1 for AmeriCorps*VISTATutorial #1 for AmeriCorps*VISTA

This tutorial will cover:This tutorial will cover:

1.1. Uses of Performance MeasurementUses of Performance Measurement

2.2. Performance Measurement Performance Measurement RequirementsRequirements

3.3. Introduction to the Project PlanIntroduction to the Project Plan

4.4. Performance Measurement Six StepsPerformance Measurement Six Steps

5.5. What are Results? Output,What are Results? Output,Intermediate Outcome, End OutcomeIntermediate Outcome, End Outcome

6.6. Results ExamplesResults Examples

7.7. Additional ResourcesAdditional Resources

Uses of Performance MeasurementUses of Performance Measurement

Internal program assessment and improvement

Fundraising

Communicating with stakeholders

Project monitoring and technical assistance

Corporation reports and publications

Performance Measurement Performance Measurement RequirementsRequirements

Performance Measurement Performance Measurement RequirementsRequirements One project plan containing one or more One project plan containing one or more

goalsgoals

Performance Measurement Performance Measurement RequirementsRequirements One project plan containing one or more One project plan containing one or more

goalsgoals Identify activities and results for each goalIdentify activities and results for each goal

Performance Measurement Performance Measurement RequirementsRequirements One project plan containing one or more One project plan containing one or more

goalsgoals Identify activities and results for each goalIdentify activities and results for each goal Results are written as outputs, Results are written as outputs,

intermediate outcomes, or end outcomesintermediate outcomes, or end outcomes

Performance Measurement Performance Measurement RequirementsRequirements One project plan containing one or more One project plan containing one or more

goalsgoals Identify activities and results for each goalIdentify activities and results for each goal Results are written as outputs, Results are written as outputs,

intermediate outcomes, or end outcomesintermediate outcomes, or end outcomes Label 3-5 of these results as “performance Label 3-5 of these results as “performance

measures”measures”

Performance Measurement Performance Measurement RequirementsRequirements One project plan containing one or more One project plan containing one or more

goalsgoals Identify activities and results for each goalIdentify activities and results for each goal Results are written as outputs, Results are written as outputs,

intermediate outcomes, or end outcomesintermediate outcomes, or end outcomes Label 3-5 of these results as “performance Label 3-5 of these results as “performance

measures”measures”-One Output

Performance Measurement Performance Measurement RequirementsRequirements One project plan containing one or more One project plan containing one or more

goalsgoals Identify activities and results for each goalIdentify activities and results for each goal Results are written as outputs, Results are written as outputs,

intermediate outcomes, or end outcomesintermediate outcomes, or end outcomes Label 3-5 of these results as “performance Label 3-5 of these results as “performance

measures”measures”-One Output

-One Intermediate Outcome

Performance Measurement Performance Measurement RequirementsRequirements One project plan containing one or more One project plan containing one or more

goalsgoals Identify activities and results for each goalIdentify activities and results for each goal Results are written as outputs, Results are written as outputs,

intermediate outcomes, or end outcomesintermediate outcomes, or end outcomes Label 3-5 of these results as “performance Label 3-5 of these results as “performance

measures”measures”-One Output

-One Intermediate Outcome

-One End Outcome

Performance Measurement Performance Measurement RequirementsRequirements One project plan containing one or more One project plan containing one or more

goalsgoals Identify activities and results for each goalIdentify activities and results for each goal Results are written as outputs, intermediate Results are written as outputs, intermediate

outcomes, or end outcomesoutcomes, or end outcomes Label 3-5 of these results as “performance Label 3-5 of these results as “performance

measures”measures”– One OutputOne Output– One Intermediate OutcomeOne Intermediate Outcome– One End OutcomeOne End Outcome

Identify indicators, targets, and instruments Identify indicators, targets, and instruments for each performance measurefor each performance measure

AmeriCorps*VISTA Project PlanAmeriCorps*VISTA Project Plan

Column AGoals, Activities, and Results

Column BDate(s)

Column CProject Reporting

GOAL 1    

Activities    

Results Outputs Intermediate Outcomes End Outcomes

   

GOAL 2    

 Activities    

 Results Outputs Intermediate Outcomes End Outcomes

   

GOAL 3 Etc.

AmeriCorps*VISTA Project PlanAmeriCorps*VISTA Project Plan

Column AGoals, Activities, and Results

Column BDate(s)

Column CProject Reporting

GOAL 1    

Activities    

Results Outputs Intermediate Outcomes End Outcomes

   

GOAL 2    

 Activities    

 Results Outputs Intermediate Outcomes End Outcomes

   

GOAL 3 Etc.

AmeriCorps*VISTA Project PlanAmeriCorps*VISTA Project Plan

Column AGoals, Activities, and Results

Column BDate(s)

Column CProject Reporting

GOAL 1    

Activities    

Results Outputs Intermediate Outcomes End Outcomes

   

GOAL 2    

 Activities    

 Results Outputs Intermediate Outcomes End Outcomes

   

GOAL 3 Etc.

AmeriCorps*VISTA Project PlanAmeriCorps*VISTA Project Plan

Column AGoals, Activities, and Results

Column BDate(s)

Column CProject Reporting

GOAL 1    

Activities    

Results Outputs Intermediate Outcomes End Outcomes

   

GOAL 2    

 Activities    

 Results Outputs Intermediate Outcomes End Outcomes

   

GOAL 3 Etc.

Performance measurementPerformance measurementis a six-step process foris a six-step process for

regularly measuringregularly measuringyour program results.your program results.

Performance Measurement Six Steps

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

Performance Measurement Six Steps

The logic model describes The logic model describes your AmeriCorps*VISTA your AmeriCorps*VISTA

project.project.Use it to identify your Use it to identify your

project activities and what project activities and what you will measure to gauge you will measure to gauge the success of your project. the success of your project.

1. Develop Logic Model

& Project Plan

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

Identifying your data Identifying your data sources and data sources and data

collectors.collectors.Determine a timeline Determine a timeline for data collection, for data collection,

analysis, and analysis, and reporting reporting

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments

Adapt existing Adapt existing instruments or instruments or

develop your own; develop your own; pilot test to make sure pilot test to make sure

instruments collect instruments collect valid, appropriate valid, appropriate

informationinformation

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments4. Collect

Data

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments4. Collect

Data

Go out and collect Go out and collect your data (e.g., fill your data (e.g., fill

out attendance out attendance sheets, administer sheets, administer surveys, conduct surveys, conduct

interviews)interviews)

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments4. Collect

Data

5. AnalyzeData

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments4. Collect

Data

5. AnalyzeData

Aggregate and Aggregate and analyze data; analyze data;

generate generate summary info summary info

(totals, averages, (totals, averages, etc)etc)

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments4. Collect

Data

5. AnalyzeData

6. ReportResults

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments4. Collect

Data

5. AnalyzeData

6. ReportResults

Write progress Write progress report; include report; include

your performance your performance measurement measurement

resultsresults

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments4. Collect

Data

5. AnalyzeData

6. ReportResults

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments4. Collect

Data

5. AnalyzeData

6. ReportResults

ContinuousProgram

Improvement

Performance Measurement Six Steps

1. Develop Logic Model

& Project Plan

2. DevelopPM Plan

3. Developand Test

Instruments4. Collect

Data

5. AnalyzeData

6. ReportResults

ContinuousProgram

Improvement

What Are Results?What Are Results?

What Are Results?What Are Results?Outputs and outcomes your AmeriCorps*VISTA project hopes to achieve by engaging in service activities

What Are Results?What Are Results?

Outputs: Services delivered and products completed by VISTA members

Outputs and outcomes your AmeriCorps*VISTA project hopes to achieve by engaging in service activities

What Are Results?What Are Results?

Outputs: Services delivered and products completed by VISTA members

Outcomes: Changes or benefits that occur as a result of services delivered

Outputs and outcomes your AmeriCorps*VISTA project hopes to achieve by engaging in service activities

What Are Results?What Are Results?

Outputs: Services delivered and products completed by VISTA members

Outcomes: Changes or benefits that occur as a result of services delivered• Intermediate Outcomes: Changes that are

short of the “final” result you hope to achieveeach year

Outputs and outcomes your AmeriCorps*VISTA project hopes to achieve by engaging in service activities

What Are Results?What Are Results?

Outputs: Services delivered and products completed by VISTA members

Outcomes: Changes or benefits that occur as a result of services delivered• Intermediate Outcomes: Changes that are

short of the “final” result you hope to achieveeach year

• End Outcomes: The most significantchanges that your AmeriCorps*VISTAproject hopes to achieve each year

Outputs and outcomes your AmeriCorps*VISTA project hopes to achieve by engaging in service activities

Scenario for Example ResultsScenario for Example Results

Community-based organization (CBO)Community-based organization (CBO)has existing mentoring program, buthas existing mentoring program, butfaces challenges in recruiting and faces challenges in recruiting and retaining volunteer mentors.retaining volunteer mentors.

CBO unable to deliver high-quality service CBO unable to deliver high-quality service to youth.to youth.

VISTA members will serve with CBO to VISTA members will serve with CBO to develop system to recruit, train and develop system to recruit, train and support volunteer mentoring program.support volunteer mentoring program.

Position descriptions for volunteer mentors Written procedures for screening volunteer

mentors Tracking database Training curriculum for new volunteer mentors Written procedures to provide ongoing support to

volunteer mentors Agency staff complete training in new systems

and procedures

Outputs answer the question, “How much service did we do?” They do NOT answer the question, “What changed as a result of the service?”

OutputsOutputs

Trained agency personnel demonstrate

understanding of how to use new system

and procedures (new knowledge and skills).

Agency personnel use new systems and

procedures to recruit, train, and support

volunteer mentors (changes in behavior).

Intermediate outcomes are important milestones on the way to achieving end outcomes. Achieving intermediate outcomes can lead to attaining end outcomes.

Intermediate OutcomesIntermediate Outcomes

More youth are served by volunteer mentors under the new system than were served under the previous system (increased organizational capacity).

More youth experience a close and stable relationship with a caring adult, because a greater proportion of volunteer mentors complete their service commitments (improved quality of service).

End outcomes are changes that reflect the overarching goals of your AmeriCorps*VISTA project.

End OutcomesEnd Outcomes

Additional Resources:

Contact your CNCS State OfficeContact Project STAR

• www.projectstar.org• 1-800-548-3656• star@aiweb.com