Evaluation Results Ohios SAMHSA Garrett Lee Smith Grant School Climate Evaluation of Ohios Infrastructure for Statewide Mental Health Check Ups Receptivity Family motivation to give consent, complete referral Program Providers Youth and Families Activities consent, screening, referral Output Consents and screenings offered Counts Outcomes Consents granted; Referrals completed Responsivity Consent Climate Referral Climate Responsivity Continuous Quality Improvement Do-Study-Reflect-Plan Do-Study-Reflect-Plan Capability (Stakeholder perception of innovation adoption) Consents NOT Returned 3,79131%8,434 69% CountRow % Returned No CountRow % Returned Yes Consents Returned = 12,232 (48%) 25,662100% 3,791 15% 13,430 8,434 33% CountRow % CountRow % Returned No CountRow % Not Returned Returned Yes Consents Distributed* *October 1, June 30, % Count Row % Total Offered Consents 4 We need to improve consent rates by applying what we have learned in Year 1 & 2 *Barriers, Challenges and Strategies Newsletter What Works & What Doesnt *Barriers, Challenges and Strategies Newsletter 5 Strategies Proven to Work Sending consent form home with begin-year registration Sending consent from a classroom combined with prevention education Strategies that are Not Effective Mailing consents Incentives Education + Mental Health = Higher Consent Rates Of consents returned: TeenScreen YES = 63.4% SOS YES= 81.2% Project Totals* 1.Screenings Offered25,662 2.Consents Returned12,232 3.Screenings 7,658 4.Clinical Interviews 1,936 5.Referrals Made 1,238 * Oct 2006 June 2008 8 Program Outputs and Outcomes 1.Offer Screening 2.Obtain Parental Consent 3.Conduct Screenings 4.Conduct Clinical Interviews 5.Refer for Counseling 9 Consents by Program Type TeenScreen SOS Juvenile Justice Consents Offered85%13%2% Consents Distributed & Not Returned79%21%0% Consents Returned Yes63%81%99% Consents Returned No37%19%1% Screens by Program Type TeenScreenSOS Juvenile Justice TeenScreen Screened5,5772, Screened Positive29%9%48% Screened Negative71%91%52% The TeenScreen Tool is more sensitive and finds more positive youth. 11 Clinical Interview by Program Type TeenScreen SOS Juvenile Justice Screened Positive Interviews Completed1746*198*276 Youth Identified for Emergency Care2702 *More interviews completed than positive due to youth interviewed due to debriefing results 12 Clinical Interview Results TeenScreen and SOS programs completed 100% of clinical interviews of youth positive TeenScreen programs identified 27 youth that needed emergency care 13 Referrals by Program Type TeenScreen%SOS% Juvenile Justice% Total referred after clinical interview Completed Referrals55251%4131%14473% Crisis Referrals: 27 (2.3%) 18 Accepted by youth and parent 4 Accepted by parent not youth 1 Accepted by youth not parent 4 rejected by youth and parent Does Follow-up Aid Intervention? 1238 Referrals made, 990 received first follow-up call 680 First appointments made 576 First appointments kept (85%) 34 First appointments missed (5%) 68 Made Second appointments (9 missed the 2 nd appt.) Of 34 known missed first appointments, 5 Missed due to lack of interest 1 Missed due to provider not accepting insurance 3 Had transportation concerns 25 Did not report or reported other reasons Referrals Rejected: (62%) received follow-up call 4 made and kept an appointment 68 made no appointment 44 (38%) not called Referrals by type of site 18 System Motivation 19 Perception of Screening (Innovation Adoption) 20 Perception of Screening Questionnaire Stakeholders Perceptions of Compatibility Complexity Observability Stakeholder Perceptions 22 Referral Climate YouthParent 23 Referral Climate Items Provided choices and options Understood me Conveyed confidence Listened to me Encouraged questions Tried to understand how I see things before making suggestions Referral Climate Correlations ** ** ** ** ** ** **.354** Correlation Coefficient Sig. (2-tailed) N Correlation Coefficient Sig. (2-tailed) N Correlation Coefficient Sig. (2-tailed) N Correlation Coefficient Sig. (2-tailed) N Correlation Coefficient Sig. (2-tailed) N Mean - Youth RCQ Mean - Parent RCQ Relative advantage mean Complexity mean Observability mean Kendall's tau_b Mean - Youth RCQ Mean - Parent RCQ Relative advantage mean Complexity mean Observability mean Correlation is significant at the 0.01 level (2-tailed). **. 26 Referral Climate Findings Lowest Rated Youth Item The person who talked with me showed confidence that I can make changes if I want to 27 Referral Climate Questioner Findings Lowest Rated Adult Item The person who talked with me understands how I see things with respect to seeing a counselor