Starfish Pilot Program Updates Erie Community College
Starfish Initial Pilot Launch Goals:
Adoption
• To assist the faculty in clearly articulating problem behaviors that interfere with academic performance.
• To assist support staff with the tools and information necessary to meet the needs of flagged students.
Success Metrics
Assess the number of flags created.
Evaluate the types of flags raised.
Evaluate the flag resolution rate.(cleared)
Assess the number and types of notes created.
Offer individual and group training sessions for faculty and staff.
Progress survey response rate.
Data: Progress Survey Response Rate Fall 2015/Spring 2016
Progress Survey Response Rate
Week 3 Week 7
Fall 2015 42.41% 38.87%
Spring 2016 44.30%
Slide 3
Week 7 Progress Survey
You Can Make a Difference!
Data: Tracking Item Activity Fall 2015 to Spring 2016
Week Flags Raised Notes Entered Flags Cleared
Fall 2015 Spring
2016
Fall 2015 Spring 2016 Fall 2015 Spring
2016
Week 1 0 256 0 410 0 6
Week 2 1 94 2 101 0 121
Week 3 (Week 3 Progress Survey) 1352 635 1028 621 214 50
Week 4 (Week 3 Progress Survey) 762 710 1171 1088 366 141
Week 5 409 193 559 2148 422 252
Week 6 262 100 123 1618 227 197
Week 7 (Mid Term Progress Survey) 956 1396 140
Week 8 (Mid Term Progress Survey) 1057 2740 323
Week 9 (Mid Term Progress Survey) 907 2421 231
Week 10 245 253 170
Week 11 222 587 428
Week 12 211 131 379
Week 13 157 222 202
Week 14 255 69 194
Week 15 164 47 290
Week 16 109 27 336
Week 17 105 222 21
Slide 6
Data: Tracking Items Raised Fall 2015
Flag Title Number Raised
Online Participation Concern 3381
Attendance Concern 1202
In Danger of Failing Concern 652
Poor Performance 621
Missing Assignments 514
Kudos – Keep up the Good Work 380
Participation Concern 196
Course Materials Concern 167
Kudos – Showing Improvement in a Course 45
I Need Help 6
Academic Research Resources Concern 5
I Need Help in a Course 4
Behavioral Crisis Concern 1
TOTAL 7174
Slide 7
Data: Tracking Items Cleared Fall 2015
Flag Title Number Raised
Online Participation Concern 2790
Attendance Concern 527
In Danger of Failing Concern 187
Poor Performance 173
Missing Assignments 96
Participation 92
Course Materials Concern 66
Keep up the Good Work 9
Academic Research Resources Concern 4
Behavioral Crisis Concern 1
I Need Help 1
I Need Help in a Course 1
Total 3947
Slide 8
Data: Notes Statistics and Usage Fall 2015
Note Type Number Recorded
Manual Academic Flag Comment 6169
Email Comment 3201
Manual Comment – Kudos 670
Flag Comment 426
Close the Loop Comment 390
General Shared Note 96
Kudos Comment 19
Manual Social Flag Comment 14
Instructors to Students Note 10
Instructors to Chairs Note 3
Total 10,998
Slide 9
Starfish Summary Fall 2015 Training Sessions
Total Trainings Offered
Academic Leadership 2
Academic Support 2
Counseling Chairs 5
Department Heads/Chairs 2
Director EOP 1
EOP Counselor 2
EOP Mentor 2
General Advisor 2
Instructor 44
Librarian 2
Mentor/Instructor 1
Not in Starfish/No Role Assigned 7
SAC City Campus 1
Say Yes Mentor 2
Skills Center Technical Assistant 1
Student Services Leadership 2
Student Success Specialist 1
Student Support Center- City Campus 3
Student Support Center- North 7
Student Support Center- South 4
Technology Mentor- North 2
Technology Mentor- South 2
Veteran Support Services 4
Slide 10
Training Sessions
Starfish Initial Pilot Launch Goals
Satisfaction Faculty/staff satisfaction survey
Student outreach
Key Concepts- Fall 2015 Survey Results
Strengths
• Ability to catch student problems early.
• Alerting students of problems via Starfish.
• Communication across all offices.
• Faculty generally believe that the Starfish program will help with retention and student performance.
• Easy to use.
Weaknesses
The need for additional trainings.
Need for transparency into the workings of Starfish.
A greater need for cooperation between faculty and staff.
Concerns regarding the speed of response to flags .
Concerns that flags are not being addressed.
Student Outreach Initiatives
• Student Focus groups.
• Starfish Student Kick-off events.
• Incorporation of Starfish into START orientation sessions.
• Open House.
• SGA activities.
• Collaborative activities involving faculty, staff, and students.
• Raise Your Hand Feature.
Slide 13
Starfish Student Outreach: Potential Barriers to Adoption
• Not reading their ECC e-mail.
• Not having regular access to a computer.
• Lack of basic computer skills to navigate Starfish and access their dashboard.
Slide 14
Action Items Based Upon Fall 2015 Survey
• A comprehensive training guide for both faculty and staff.
• More opportunities for individual trainings.
• Photos to help facilitate early identification of students.
• The use of the success score to assist support staff members in triaging cases based upon elements of risk.
Slide 15
ETS Success Navigator
Slide 16
ACCELERATE
Student Name: Bobby Naimi
Student ID: 12-34567
Score Date: Aug 12, 2013
Bobby’s Background
• Major: Business • Race: African-American • Gender: Male • Parental Education: BA (Mother); HS Diploma (Father)
Academic Skills – Tools to succeed in the classroom
Skills • Sometimes uses organizational tools (e.g., checklist, planner) • Occasionally mismanages his schedule regarding assignments and exams
Next Steps Refer Bobby to the Tutoring Center to provide goal setting strategies and organizational tools. You can find additional ways of working with Bobby by clicking here.
Commitment – Active pursuit towards an academic goal
Skills • Strongly committed to attaining an associate degree • Consistently attends class • Moderate interest in engaging with resources on campus
Next Steps The Career Center can help Bobby align his degree goals with his career goals. You can find additional ways of working with Bobby by clicking here.
Social Support – Networks to support academic success
Skills • Willing to engage resources on and off campus • Parents have moderate support of his college attendance
Next Steps The Office of Student Life can connect Bobby with valuable student groups on campus. For helpful tools and tips about student connections, click here.
Self-Management – Managing the daily expectations
Skills • Usually calm during important tests and assignments • Occasionally gives up when frustrated with assignments
Next Steps Refer Bobby to the Wellness Center on campus to help him manage pressures and succeed. For effective ways of helping Bobby manage every day academic stress, click here.
MODERATE
ACADEMIC SUCCESS SCORE*
HIGH
RETENTION SUCCESS SCORE*
*Course Placement: Recommended academic placement action for student. * Academic Success Score: Weighted composite of student’s SuccessNavigator™ profile and other academic indicators of student preparedness, such as self or institution reported high school GPA, SAT/ACT, etc. * Retention Success Score: Projected likelihood that student will return for a second year at the institution.
Advisor Report
SKILL REPORT
STRONG
STRONG
MODERATE
MODERATE
COURSE PLACEMENT*
Student Success Score
Predictive Analytics Formula
Flags created by faculty and staff through
Starfish
Student Success Score
Interpreting the Student’s Success Score
Likelihood of Persisting:
Next Steps: Fall 2016
College-Wide Rollout
Next Steps: Fall 2016 College-Wide Roll-out
• All students included in Starfish.
• Nightly data uploads to more accurately reflect enrollment.
• Greater outreach to educate students about Starfish.
• Incorporation of additional student service support staff to triage and respond to flags.
• Availability of the Attendance Tool feature.
• The potential role of Department Chairs in Starfish.
Slide 22
Next Steps: Fall 2016 New Flags and Enhanced Services
• The incorporation of ETS SN into the predictive score.
• Financial aid probation flag- system flag for students who are placed upon financial aid probation their first semester.
• Financial Aid probation plan embedded into Starfish.
• Adding Kudos into the progress surveys.
• Immunization flag.
Slide 23
Additional Resources
• Additional resources are also available on SharePoint
• Questions? E-mail the Starfish team at [email protected]
Slide 24