Evaluating SPP/APR Improvement Activities
Presented by Jeanna Mullins, Mid-South Regional Resource Center, RRCP
Document developed by members of the Systems and Improvement Planning Priority Team (NECTAC and RRCP)
Resource Document Highlights
Content Types of SPP/APR Improvement Activities Selection and Review of Activities Steps for Evaluation of Activities Evaluation Scenarios
Poll Question
Have you reviewed the Evaluating SPP/APR Improvement Activities document?
Types of Improvement Activities
Improve data collection and reporting Improve systems administration and
monitoring Build systems and infrastructures of
technical assistance and support Provide technical assistance/
training/professional development
Types of Improvement Activities
Clarify/examine/develop policies and procedures
Program Development Collaboration/coordination Evaluation Increase/adjust FTE
Selection and Review of Improvement Activities
Root cause analysis? Links between root cause, data, and
proposed outcomes? Evidence-based practices? Address more than one indicator? Identification of collaborative partners?
Selection and Review of Improvement Activities
Detailed action plan (tasks, person(s) responsible, resources needed, timelines) for each activity?
Short-term and long-term outcomes? Data sources, collection, analyses, and
reporting?
Poll Question
Do you have an evaluation plan for one or more of your SPP/APR improvement activities?
Steps for Evaluating Improvement Activities
Goal/Purpose
Questions
Process/Impact
Data Collection Methods
Steps for Evaluating Improvement Activities
Timelines
Data Analysis Methods
Use and Reporting of Results
Person(s) Responsible
Sample Improvement Activity
Collaborate across State Part C and Section 619 agencies to clarify roles and responsibilities of local programs at the data collection point when the child exits Part C and enters Part B.
Collaboration Scenario Context Missing data on C3/B7 Local programs are unclear about
when data should be collected and reported
Written policies and procedures are unclear, (e.g. roles and responsibilities of Part C v. 619)
All local staff have not been trained
Goal/Purpose
GoalTo clarify roles and responsibilities of Part C and Section 619QuestionTo what extent did the collaboration result in clear descriptions of roles and responsibilities of Part C and 619 staff?
Impact and Methods
Impact: Outcome Evaluation
Data Collection Method: Focused discussion with small group
Timelines and Data Analysis
Timelines: Prior to the dissemination of revised policies and procedures and provision of training (Identify the specific timelines)Data Analysis: Baseline: Local programs report that roles and responsibilities are not clear.
Data Analysis Method
Notes/transcript from the reviewer discussion will be analyzed to determine whether or not roles and responsibilities for Part C and 619 are clear, and, if not, how they could be improved.
Data Use and Reporting
Feedback will help ensure written roles and responsibilities are clear. Will be incorporated into overall policies and procedures related to collecting and reporting outcomes data and into training.
Persons Responsible
Responsibilities: Part C and 619 staff will identify a set of local providers/program staff to participate in the review and discuss the reviewer feedback and implications for additional clarification needed regarding roles and responsibilities
Improvement Planning ResourcesRRCP SPP/APR Planning Calendarhttp://spp-apr-calendar.rrfcnetwork.org/explorer/view/id/650?2#category2
Evaluating SPP/APR Improvement ActivitiesNCRRC SPP/APR Improvement Activity Review FormState Systems Self-Assessment and Planning GuideUsing the SPP/APR as a Management Tool
Questions, Comments, Ideas
What are your thoughts?