Starfish Pilot Program Updates Erie Community College

Starfish Initial Pilot Launch Goals:

Adoption

• To assist the faculty in clearly articulating problem behaviors that interfere with academic performance.

• To assist support staff with the tools and information necessary to meet the needs of flagged students.

Success Metrics

Assess the number of flags created.

Evaluate the types of flags raised.

Evaluate the flag resolution rate.(cleared)

Assess the number and types of notes created.

Offer individual and group training sessions for faculty and staff.

Progress survey response rate.

Data: Progress Survey Response Rate Fall 2015/Spring 2016

Progress Survey Response Rate

Week 3 Week 7

Fall 2015 42.41% 38.87%

Spring 2016 44.30%

Slide 3

Week 7 Progress Survey

You Can Make a Difference!

Data: Tracking Item Activity Fall 2015 to Spring 2016

Week Flags Raised Notes Entered Flags Cleared

Fall 2015 Spring

2016

Fall 2015 Spring 2016 Fall 2015 Spring

2016

Week 1 0 256 0 410 0 6

Week 2 1 94 2 101 0 121

Week 3 (Week 3 Progress Survey) 1352 635 1028 621 214 50

Week 4 (Week 3 Progress Survey) 762 710 1171 1088 366 141

Week 5 409 193 559 2148 422 252

Week 6 262 100 123 1618 227 197

Week 7 (Mid Term Progress Survey) 956 1396 140

Week 8 (Mid Term Progress Survey) 1057 2740 323

Week 9 (Mid Term Progress Survey) 907 2421 231

Week 10 245 253 170

Week 11 222 587 428

Week 12 211 131 379

Week 13 157 222 202

Week 14 255 69 194

Week 15 164 47 290

Week 16 109 27 336

Week 17 105 222 21

Slide 6

Data: Tracking Items Raised Fall 2015

Flag Title Number Raised

Online Participation Concern 3381

Attendance Concern 1202

In Danger of Failing Concern 652

Poor Performance 621

Missing Assignments 514

Kudos – Keep up the Good Work 380

Participation Concern 196

Course Materials Concern 167

Kudos – Showing Improvement in a Course 45

I Need Help 6

Academic Research Resources Concern 5

I Need Help in a Course 4

Behavioral Crisis Concern 1

TOTAL 7174

Slide 7

Data: Tracking Items Cleared Fall 2015

Flag Title Number Raised

Online Participation Concern 2790

Attendance Concern 527

In Danger of Failing Concern 187

Poor Performance 173

Missing Assignments 96

Participation 92

Course Materials Concern 66

Keep up the Good Work 9

Academic Research Resources Concern 4

Behavioral Crisis Concern 1

I Need Help 1

I Need Help in a Course 1

Total 3947

Slide 8

Data: Notes Statistics and Usage Fall 2015

Note Type Number Recorded

Manual Academic Flag Comment 6169

Email Comment 3201

Manual Comment – Kudos 670

Flag Comment 426

Close the Loop Comment 390

General Shared Note 96

Kudos Comment 19

Manual Social Flag Comment 14

Instructors to Students Note 10

Instructors to Chairs Note 3

Total 10,998

Slide 9

Starfish Summary Fall 2015 Training Sessions

Total Trainings Offered

Academic Leadership 2

Academic Support 2

Counseling Chairs 5

Department Heads/Chairs 2

Director EOP 1

EOP Counselor 2

EOP Mentor 2

General Advisor 2

Instructor 44

Librarian 2

Mentor/Instructor 1

Not in Starfish/No Role Assigned 7

SAC City Campus 1

Say Yes Mentor 2

Skills Center Technical Assistant 1

Student Services Leadership 2

Student Success Specialist 1

Student Support Center- City Campus 3

Student Support Center- North 7

Student Support Center- South 4

Technology Mentor- North 2

Technology Mentor- South 2

Veteran Support Services 4

Slide 10

Training Sessions

Starfish Initial Pilot Launch Goals

Satisfaction Faculty/staff satisfaction survey

Student outreach

Key Concepts- Fall 2015 Survey Results

Strengths

• Ability to catch student problems early.

• Alerting students of problems via Starfish.

• Communication across all offices.

• Faculty generally believe that the Starfish program will help with retention and student performance.

• Easy to use.

Weaknesses

The need for additional trainings.

Need for transparency into the workings of Starfish.

A greater need for cooperation between faculty and staff.

Concerns regarding the speed of response to flags .

Concerns that flags are not being addressed.

Student Outreach Initiatives

• Student Focus groups.

• Starfish Student Kick-off events.

• Incorporation of Starfish into START orientation sessions.

• Open House.

• SGA activities.

• Collaborative activities involving faculty, staff, and students.

• Raise Your Hand Feature.

Slide 13

Starfish Student Outreach: Potential Barriers to Adoption

• Not reading their ECC e-mail.

• Not having regular access to a computer.

• Lack of basic computer skills to navigate Starfish and access their dashboard.

Slide 14

Action Items Based Upon Fall 2015 Survey

• A comprehensive training guide for both faculty and staff.

• More opportunities for individual trainings.

• Photos to help facilitate early identification of students.

• The use of the success score to assist support staff members in triaging cases based upon elements of risk.

Slide 15

ETS Success Navigator

Slide 16

ACCELERATE

Student Name: Bobby Naimi

Student ID: 12-34567

Score Date: Aug 12, 2013

Bobby’s Background

• Major: Business • Race: African-American • Gender: Male • Parental Education: BA (Mother); HS Diploma (Father)

Academic Skills – Tools to succeed in the classroom

Skills • Sometimes uses organizational tools (e.g., checklist, planner) • Occasionally mismanages his schedule regarding assignments and exams

Next Steps Refer Bobby to the Tutoring Center to provide goal setting strategies and organizational tools. You can find additional ways of working with Bobby by clicking here.

Commitment – Active pursuit towards an academic goal

Skills • Strongly committed to attaining an associate degree • Consistently attends class • Moderate interest in engaging with resources on campus

Next Steps The Career Center can help Bobby align his degree goals with his career goals. You can find additional ways of working with Bobby by clicking here.

Social Support – Networks to support academic success

Skills • Willing to engage resources on and off campus • Parents have moderate support of his college attendance

Next Steps The Office of Student Life can connect Bobby with valuable student groups on campus. For helpful tools and tips about student connections, click here.

Self-Management – Managing the daily expectations

Skills • Usually calm during important tests and assignments • Occasionally gives up when frustrated with assignments

Next Steps Refer Bobby to the Wellness Center on campus to help him manage pressures and succeed. For effective ways of helping Bobby manage every day academic stress, click here.

MODERATE

ACADEMIC SUCCESS SCORE*

HIGH

RETENTION SUCCESS SCORE*

*Course Placement: Recommended academic placement action for student. * Academic Success Score: Weighted composite of student’s SuccessNavigator™ profile and other academic indicators of student preparedness, such as self or institution reported high school GPA, SAT/ACT, etc. * Retention Success Score: Projected likelihood that student will return for a second year at the institution.

Advisor Report

SKILL REPORT

STRONG

STRONG

MODERATE

MODERATE

COURSE PLACEMENT*

Student Success Score

Predictive Analytics Formula

Flags created by faculty and staff through

Starfish

Student Success Score

Interpreting the Student’s Success Score

Likelihood of Persisting:

Next Steps: Fall 2016

College-Wide Rollout

Next Steps: Fall 2016 College-Wide Roll-out

• All students included in Starfish.

• Nightly data uploads to more accurately reflect enrollment.

• Greater outreach to educate students about Starfish.

• Incorporation of additional student service support staff to triage and respond to flags.

• Availability of the Attendance Tool feature.

• The potential role of Department Chairs in Starfish.

Slide 22

Next Steps: Fall 2016 New Flags and Enhanced Services

• The incorporation of ETS SN into the predictive score.

• Financial aid probation flag- system flag for students who are placed upon financial aid probation their first semester.

• Financial Aid probation plan embedded into Starfish.

• Adding Kudos into the progress surveys.

• Immunization flag.

Slide 23

Additional Resources

• Additional resources are also available on SharePoint

• Questions? E-mail the Starfish team at starfish@ecc.edu

Slide 24