65
1 Division Y College A Division Y Student Satisfaction KPI Analysis Date Prepared by: CCI Research Inc.
1
Division Y
College ADivision Y
Student Satisfaction KPI Analysis
Date
Prepared by: CCI Research Inc.
2
Division Y
Introduction
3
Division Y
Introduction
Analysis performed to summarize learning from the KPI Student Satisfaction Survey for College A, Division Y over the past 8 years Objectives:
Explain differences in results over timeDetermine the extent to which each element measured by the KPI Student Satisfaction Survey drives KPI and Capstone satisfactionIdentify main findings from KPI survey to direct decision-making
4
Division Y
Data sources and methods include:KPI Survey frequency resultsEnrolment dataCorrelation and multiple regression analysisGap analysis (Satisfaction - Importance)Analysis of facilities and services according to usage and satisfactionDemographic analysisOverview of Department results
Data is from past 8 years of KPI Student Satisfaction Survey
Methodology
5
Division Y
KPI Survey satisfaction results = “Very Satisfied” + “Satisfied,” unless otherwise notedBenchmark 1 includes: [criteria specified by College A]The standard KPI filters were used for analysis:
Students could not be in semester 1 of their programFor analysis of Capstones and KPI, the “KPI-eligible” filter was used; responses for any item were only counted if the student answered all 4 capstones, and therefore contributed to KPI results
All responses for which N/A was selected were not included in any analysis of satisfaction data
Data Considerations
6
Division Y
All results are rounded to the nearest whole numberThe correlation and regression analysis reported use collapsed results, i.e., “Very Satisfied” + “Satisfied,” etc.Statistically significant differences over time, based on confidence intervals at the 95% confidence level, are denoted within charts using arrowsPriorities for improvement were chosen based on the following considerations within schools:
Correlations with capstones over 8 yearsSatisfaction over 8 yearsDerived importance and rated importanceGap analysis (importance – satisfaction)Usage over time and current year
Data Considerations
7
Division Y
Overall Summary
8
Division Y
Summary – Priorities for KPI Improvement
Division YKPI
Facility Issues: library/resource centre, open access computer labs/resources, space for individual/group study, recreation/athletics
Service Issues: safety/security services, co-op/field placement, employment/placement/ career services
college support (coursework, person to rely on, financial information, non-academic
responsibilities)
Staff Concernfor Students
Overall College Experience
Comfort/cleanliness/accessibility
safety/security services, quality of classroom learning,
comfort/cleanliness/access
Learning Experiences:feedback, quality of classroom learning, quality of other learning, course materials
Knowledge and Skills:
develops your ability to solve problems using math techniques
= highest priorities
9
Division Y
KPI Trends
10
Division Y
2004 2005 2006 2007 2008 2009 2010 201170%
80%
90%
100%
84% 84%83%
81%82%
81%80%
78%
88% 88% 87%
91% 91%
88%
85%
81%
College A KPI Division Y KPI
Year
KP
I Sat
isfa
ctio
nCollege A overall shows declining KPI results since 2004, while Division Y experienced a decline over the past 3 yearsDivision Y currently has a KPI of 81%, down from high of 91% in 2007 and 2008; Division Y was higher than the overall College from 2007-2010 but is now similar
KPI Trends –College A and Division Y
11
Division Y
2004 2005 2006 2007 2008 2009 2010 201170%
80%
90%
100%
73% 73%74%
75%77% 77%
79% 79%
88% 88% 87%
91% 91%
88%
85%
81%
Benchmark 1 KPI Division Y KPI
Year
KP
I Sat
isfa
ctio
nDifferent pattern across Benchmark 1 and College A’s Division YBenchmark 1 KPI has increased while College A’s Division Y has declined, closing the gap so that results are now similar
KPI Trends – Benchmark 1
12
Division Y
Very Dissatisfied
0%5%10%15%20%25%30%
2004 2005 2006 2007 2008 2009 2010 2011
Dissatisfied
0%5%
10%15%
20%25%30%
2004 2005 2006 2007 2008 2009 2010 2011
Neither Satisfied nor Dissatisfied
0%5%
10%15%20%
25%30%
2004 2005 2006 2007 2008 2009 2010 2011
Satisfied
40%45%50%55%60%65%70%
2004 2005 2006 2007 2008 2009 2010 2011
Very Satisfied
20%25%30%35%40%45%50%
2004 2005 2006 2007 2008 2009 2010 2011
For Division Y, the Very Satisfied responses fluctuated, with a high in 2008 and subsequent decline, corresponding to the overall Division KPI patternNeither Satisfied nor Dissatisfied responses appear to be increasing somewhat over timeDissatisfied and Very Dissatisfied are not changing over time
KPI Response Scale Trends
13
Division Y
Results for Knowledge & Skills (Capstone 14) and Learning Experiences (Capstone 26) fluctuated, but did not experience a large decreaseResults for Facilities/Resources (Capstone 44) and Services (Capstone 45) are lower by 11% and 12%, respectively, over 8 years
Capstone Trends
70%
75%
80%
85%
90%
95%
100%
2004 2005 2006 2007 2008 2009 2010 2011
Year
Cap
ston
e S
atis
fact
ion
Knowledge & Skills(Capstone 14)Learning Experiences(Capstone 26)Facilities/Resources(Capstone 44)Services (Capstone 45)
14
Division Y
KPI and Enrolment Trends
15
Division Y
2004 2005 2006 2007 2008 2009 2010 2011500
700
900
1100
Division Y Enrolment
2004 2005 2006 2007 2008 2009 2010 201170%
80%
90%
100%
88% 88% 87%
91% 91%
88%85%
81%
Division Y KPI
Year
KP
I Sat
isfa
ctio
nEnrolment
For current programs for Division Y, there was a decrease in KPI satisfaction from 2008-2011, while enrolment increased in most years (total enrolment increase was about one-third over 8 years)
16
Division Y
2004/05 2005/06 2006/07 2007/08 2008/09 2009/10 2010/11
-10%
-5%
0%
5%
10%
15%Capstone 45: Services Division Y EnrolmentCapstone 44: Facilities/Resources
Enrolment has fluctuated for Division Y over time; positive changes in enrolment appear to be negatively related to changes in Facilities/Resources and Services
Enrolment
Year
-to-Y
ear %
Cha
nge
17
Division Y
2004/05 2005/06 2006/07 2007/08 2008/09 2009/10 2010/11
-10%
-5%
0%
5%
10%
15%Capstone 14: Knowledge and Skills Division Y EnrolmentCapstone 26: Learning Experiences
A less-pronounced pattern with Knowledge and Skills and Learning Experiences
Enrolment
Year
-to-Y
ear %
Cha
nge
18
Division Y
Division Y KPI
19
Division Y
KPI Top Drivers 2011
The following drivers of KPI for Division Y have been among the top 10 drivers for 6 of the past 8 years:
Q.43 ‘comfort/cleanliness/accessibility of college facilities’, andQ.3 ‘provides you with skills and abilities specific to your chosen career’
Of the top drivers for 2011, these 6 have shown the largest declines over time (>10% from highest satisfaction to current year)
Pearson's rQ.43 comfort/cleanliness/accessibility of college facilities .564Q.42 employment/placement/career services .505Q.20 quality of classroom learning .485Q.32 counselling/native counselling/advising services .483Q.35 recreation/athletics .468Q.39 safety and security services .465Q.29 peer tutoring services .451Q.3 provides you with skills and abilities specific to your chosen career .449Q.4 includes topics relevant to your future success .416Q.25 lab/shop facilities and equipment .414Q.30 special skills services .400
Top KPI Drivers for 2011
Survey Question
*
* Denotes aspects that were not used by/not available to >50% of students at this division
**
*
*
*
20
Division Y
.150
.200
.250
.300
.350
.400
.450
.500
.550
.600
45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95%
Item Satisfaction
Cor
rela
tion
with
KP
I
Knowledge & Skills Learning Experiences Facilities and Resources Services
Q.3
Q.4
Q.16 Q.15
Q.43
Q.42
Q.20Q.32Q.29
High Importance,Low Satisfaction
High Importance,High Satisfaction
Q.13
KPI Opportunities
The top drivers of KPI for Division Y for 2011 are Q.43 comfort/cleanliness/accessibility and Q.42 employment/placement services
Q.35Q.39
Q.9
Q.21
21
Division Y
.150
.200
.250
.300
.350
.400
.450
.500
.550
.600
45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95%
Item Satisfaction
Cor
rela
tion
with
KP
I
High Importance,Low Satisfaction
High Importance,High Satisfaction
Q.3 career-specific skills/abilitiesQ.15 teachers’ knowledge of subjects Q.4 topics relevant to future successQ.16 teachers up-to-date/current in field Q.9 develops your ability to work with othersQ.13 provides you with experience that will
be useful to your future life outside of work
Q.21 quality of lab/shop learning
Q.29 peer tutoring services (84% not used/avail.) Q.42 employment/placement/career services (69% not used/avail)Q.32 counselling/native counselling/advising services (78% not
used/avail.) Q.39 safety and security services (61% not used/avail.) Q.35 recreation/athletics (68% not used/avail.) Q.20 quality of classroom learning Q.43 comfort/cleanliness/accessibility of college facilities
Q.5 has teachers who help you to understand your chosen career
Q.17 teachers’ presentation of the subject material
Low Importance, High SatisfactionLow Importance, Low Satisfaction
Q.19 feedback about your progress Q.23 field placement, clinical experiences or co-op work terms Q.7 develops your speaking skills Q.34 bookstore
KPI Opportunities
Opportunities for improvement include comfort/cleanliness/access, quality of classroom learning, and several services (recreation/athletics, safety/security, counselling, employment, and peer tutoring)
22
Division Y
Student Engagement Items as Drivers
Analysis of the Student Engagement results indicates that some items were drivers of KPI, Capstone satisfaction, perceived concern of people at college for your success (Q.46), or overall college experience (Q.47); particularly Q.49The correlations highlighted in yellow below can be considered drivers:
College support to deal with coursework can be considered a driver of KPI, Capstones 44 & 45, and perceived concern of people at college for your success (Q.46), as well as overall college experience (Q.47)Most of the college support engagement questions above can be considered drivers of KPIHaving at least one person to rely on for useful information, student financial aid services information, and support for non-academic responsibilities are also related to perceived concern of people at college for your success (Q.46)
KPI Capstone 14
Capstone 26
Capstone 44
Capstone 45 Q.46 Q.47
Q.49 provides support to deal with your coursework 0.409 0.229 0.297 0.339 0.371 0.360 0.329Q.48 encourages you to spend time on your coursework 0.363 0.296 0.301 0.256 0.302 0.272 0.290Q.54 provides you with challenging courses 0.335 0.291 0.330 0.256 0.286 0.273 0.348Q.53 has at least one person you can rely on for useful information 0.328 0.313 0.275 0.232 0.228 0.394 0.298Q.51 provides information on social opportunities 0.318 0.229 0.200 0.284 0.294 0.294 0.288Q.52 provides information on student financial aid services 0.304 0.155 0.200 0.306 0.371 0.315 0.267Q.50 provides support to deal with your non-academic responsibilities 0.265 0.158 0.182 0.228 0.290 0.356 0.219
Student Engagement Question
23
Division Y
Student Engagement
Q.49 ‘provides support to deal with your coursework’ was a driver of KPI, Facilities/Resources and Services (Capstones 44 & 45), concern of people (Q.46), and overall college experience (Q.47)
College Support Questions
80%86%
76%71%
67%61%
40%
0%
20%
40%
60%
80%
100%
Q.53 reliableperson for useful
information
Q.48 encouragestime on
coursework
Q.54 challengingcourses
Q.49 courseworksupport
Q.51 informationon social
opportunities
Q.52 informationon student
financial aid
Q.50 support fornon-academic
responsibilities
Sat
isfa
ctio
n
24
Division Y
Knowledge & Skills
25
Division Y
Knowledge & Skills Trending
Large net decline in results over 8 years for Q.11 ‘develops your computer skills’ (by 14%) and Q.8 ‘develops your ability to solve problems using math techniques’ (by 17%) ; the largest differences are identified below
50%
55%
60%
65%
70%
75%
80%
85%
90%
95%
100%
2004 2005 2006 2007 2008 2009 2010 2011
Q.3Q.4Q.5Q.6Q.7Q.8Q.9Q.10Q.11Q.12Q.13
Q.8, math techniques declined by 17%
Q.11, computer skills declined by 14%
26
Division Y
Knowledge & Skills – Top Drivers Over Time
Q.3 has consistently been the top driver for Knowledge & Skills (Capstone 14) over the past 8 years; Q.4 and Q.13 also among the top drivers over time
2004 2005 2006 2007 2008 2009 2010 2011
Q.3 provides you with skills and abilities specific to your chosen career .622 .557 .555 .554 .493 .449 .591 .766
Q.4 includes topics relevant to your future success .396 .529 .328 .432 .470 .383 .433 .634
Q.13 provides you with experience that will be useful to your future life outside of work .355 .319 .399 .407 .348 .448 .329 .472
2004 2005 2006 2007 2008 2009 2010 2011
Q.3 provides you with skills and abilities specific to your chosen career 1 1 1 1 1 1 1 1
Q.4 includes topics relevant to your future success 2 2 3 2 2 4 3 2
Q.13 provides you with experience that will be useful to your future life outside of work 3 8 2 4 4 2 9 3
Survey Question
Ranking Order for Correlation with Capstone 14
Survey Question
Correlation with Capstone 14 (Pearson's r value)
27
Division Y
Pearson's r Strength of Correlation
Strength of contribution to
regression modelQ.3 provides you with skills and abilities specific to your chosen career .766Q.4 includes topics relevant to your future success .634Q.13 provides you with experience that will be useful to your future life outside of work .472Q.15 teachers' knowledge of their subjects .387Q.12 provides you with opportunities to further your education after graduation .369Q.21 quality of lab/shop learning .354Q.5 has teachers who help you to understand your chosen career .341Q.42 employment/placement/career services .336Q.8 develops your ability to solve problems using math techniques .325Q.9 develops your ability to work with others .312Q.20 quality of classroom learning .306Q.23 field placement, clinical experiences or co-op work terms .306Q.25 lab/shop facilities and equipment .304Q.10 develops your ability to solve problems .300Q.22 quality of other learning experiences .299Q.39 safety and security services .294Q.16 teachers are up-to-date/current in their fields .291Q.24 course materials .287Q.41 co-op/field placement services .286Q.18 helpfulness of teachers outside of class .275
Survey Question
Knowledge & Skills – Current Year Drivers
Q.3, Q.4, and Q.13 were the strongest drivers of Knowledge & Skills (Capstone 14) in 2011, both in terms of correlation and regression analysis
*
*
*
* Denotes aspects that were not used by/not available to >50% of students at this school
28
Division Y
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Q3 Q14 Q4 Q9 Q13 Q5 Q12 Q10 Q11 Q7 Q6 Q8
Satisfaction Importance
Knowledge & Skills Gaps
Drivers
Gap between importance and satisfaction for all questions; the three strongest drivers have relatively smaller gaps
29
Division Y
Q.3
Q.4
Q.5
Q.6 Q.7
Q.8 Q.9Q.10
Q.11
Q.12
Q.13
.100
.200
.300
.400
.500
.600
.700
.800
45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95%
Item Satisfaction
Cor
rela
tion
with
Cap
ston
e 14
High Importance,Low Satisfaction
High Importance,High Satisfaction
Knowledge and Skills Opportunities
Skills/abilities specific to career, includes topics relevant to future success, experience useful to future life outside work
Future career
Skills
Math techniques, writing skills, speaking skills, computer skills
30
Division Y
Learning Experiences
31
Division Y
Learning Experiences Trending
The largest net decline in results for Q.22 ‘quality of other learning experiences’ (by 15%) and Q.24 ‘course materials’ (by 16%) over 8 years, identified below
50%
55%
60%
65%
70%
75%
80%
85%
90%
95%
100%
2004 2005 2006 2007 2008 2009 2010 2011
Q.15Q.16Q.17Q.18Q.19Q.20Q.21Q.22Q.23Q.24Q.25
Q.22, quality of other learning experiences declined by 15%
Q.24, course materials declined by 16%
32
Division Y
Learning Experiences – Top Drivers Over Time
Q.20, Q.3, Q.4, and Q.17 among the top drivers over 8 years, although there was some fluctuation
2004 2005 2006 2007 2008 2009 2010 2011
Q.20 quality of classroom learning .500 .471 .394 .323 .319 .406 .442 .443
Q.3 provides you with skills and abilities specific to your chosen career .504 .357 .419 .257 .414 .372 .511 .531
Q.4 includes topics relevant to your future success .359 .375 .338 .329 .321 .424 .326 .483
Q.17 teachers' presentation of the subject material .379 .414 .372 .279 .305 .380 .409 .352
2004 2005 2006 2007 2008 2009 2010 2011
Q.20 quality of classroom learning 3 1 2 6 5 6 3 5
Q.3 provides you with skills and abilities specific to your chosen career 1 13 1 13 1 8 1 1
Q.4 includes topics relevant to your future success 9 10 7 4 4 4 15 2
Q.17 teachers' presentation of the subject material 7 6 4 11 8 7 8 11
Survey Question
Ranking Order for Correlation with Capstone 26
Survey Question
Correlation with Capstone 26 (Pearson's r value)
33
Division Y
Pearson's r Strength of Correlation
Strength of contribution to
regression modelQ.3 provides you with skills and abilities specific to your chosen career .531Q.4 includes topics relevant to your future success .483Q.16 teachers are up-to-date/current in their fields .478Q.21 quality of lab/shop learning .446Q.20 quality of classroom learning .443Q.15 teachers' knowledge of their subjects .442Q.42 employment/placement/career services .431Q.25 lab/shop facilities and equipment .393Q.18 helpfulness of teachers outside of class .362Q.32 counselling/native counselling/advising services .361Q.17 teachers' presentation of the subject material .352Q.22 quality of other learning experiences .351Q.39 safety and security services .346Q.8 develops your ability to solve problems using math techniques .324Q.24 course materials .320Q.41 co-op/field placement services .315Q.12 provides you with opportunities to further your education after graduation .311Q.5 has teachers who help you to understand your chosen career .306Q.19 feedback about your progress .302Q.9 develops your ability to work with others .301Q.38 cafeteria/food services .300Q.29 peer tutoring services .293Q.13 provides you with experience that will be useful to your future life outside of work .285Q.33 special needs/disability services .283Q.11 develops your computer skills .282Q.31 space for individual/group study .282Q.10 develops your ability to solve problems .279Q.7 develops your speaking skills .277
Survey Question
Learning Experiences – Current Year Drivers
Q.3, Q.21, and Q.20 emerge as the strongest drivers in 2011 considering both correlation and regression analysis
*
*
*
*
**
* Denotes aspects that were not used by/not available to >50% of students at this school
34
Division Y
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Q15 Q16 Q26 Q21 Q17 Q25 Q18 Q20 Q23 Q19 Q22 Q24
Satisfaction Importance
Top Drivers of Capstone 26
Learning Experiences Gaps
Gap between importance and satisfaction for all questions. Q.20 has a large gap and is a top driver
35
Division Y
Q.18
Q.19
Q.20
Q.22
Q.23
Q.24
Q.25Q.15
Q.16
Q.17
Q.21
.100
.200
.300
.400
.500
.600
.700
.800
45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95%
Item Satisfaction
Cor
rela
tion
with
Cap
ston
e 26
High Importance,Low Satisfaction
High Importance,High Satisfaction
Learning Experiences Opportunities
Quality of lab/shop learningCourse materials, quality of
other learning experiences, feedback
Quality of classroom learning
Teachers presentation
Teachers up-to-date/current
Teachers knowledgeable
Lab/shop facilities/equip., helpfulness of teachers
outside of class
36
Division Y
Facilities & Resources
37
Division Y
Facilities and Resources Trending
Net decline in results for all Facilities and Resources items over 8 years (by 5%-15%). The three largest declines were Q.27, ‘library/resource centre’, Q.35 ‘recreation/athletics’, and Q.34 ‘bookstore’, identified below
50%
55%
60%
65%
70%
75%
80%
85%
90%
2004 2005 2006 2007 2008 2009 2010 2011
Q.27Q.28Q.31Q.34Q.35Q.43
Q.27, library/resource centre declined by 15%
Q.34, bookstore declined by 11%
Q.35, recreation/athletics declined by 13%
38
Division Y
2004 2005 2006 2007 2008 2009 2010 2011
Q.43 comfort/cleanliness/accessibility of college facilities .361 .529 .481 .386 .567 .533 .572 .692
Q.35 recreation/athletics .282 .248 .395 .215 .270 .386 .496 .558
Q.28 open access computer labs/resources .334 .355 .218 .350 .322 .331 .251 .429
Q.42 employment/placement/career services .267 .360 .258 .273 .288 .256 .433 .437
Q.31 space for individual/group study .309 .272 .387 .298 .235 .316 .372 .391
Q.41 co-op/field placement services .168 .465 .395 .347 .302 .339 .339 .287
2004 2005 2006 2007 2008 2009 2010 2011
Q.43 comfort/cleanliness/accessibility of college facilities 1 1 1 1 1 1 1 1
Q.35 recreation/athletics 6 16 3 21 11 4 2 2
Q.28 open access computer labs/resources 3 7 23 3 3 8 14 9
Q.42 employment/placement/career services 10 6 13 9 7 19 3 7
Q.31 space for individual/group study 5 12 5 6 20 9 5 13
Q.41 co-op/field placement services 20 2 3 4 5 6 9 20
Survey Question
Ranking Order for Correlation with Capstone 44
Survey Question
Correlation with Capstone 44 (Pearson's r value)
Facilities and Resources – Top Drivers Over Time
Q.43 consistently the top driver for Facilities/Resources (Capstone 44) over 8 years; the remaining top drivers fluctuate year-to-year
*
*
*
*
* Denotes aspects that were not used by/not available to >50% of students at this division
*
*
39
Division Y
Pearson's r Strength of Correlation
Q.43 comfort/cleanliness/accessibility of college facilities .692Q.35 recreation/athletics .558Q.39 safety and security services .508Q.29 peer tutoring services .497Q.32 counselling/native counselling/advising services .468Q.37 health services .444Q.42 employment/placement/career services .437Q.40 financial aid services .434Q.28 open access computer labs/resources .429Q.30 special skills services .429Q.27 library/resource centre .421Q.33 special needs/disability services .416Q.31 space for individual/group study .391Q.8 develops your ability to solve problems using math techniques .372Q.20 quality of classroom learning .365Q.22 quality of other learning experiences .348Q.36 registration/records services .337Q.38 cafeteria/food services .319Q.25 lab/shop facilities and equipment .301
Survey Question
Facilities and Resources – Current Year Drivers
Q.43 was the top driver of Facilities/Resources (Capstone question 44) in 2011 followed by Q.35 and Q.39
* Denotes aspects that were not used by/not available to >50% of students at this division
**
**
**
**
*
40
Division Y
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Q44 Q43 Q35 Q28 Q34 Q27 Q31
Satisfaction Importance Usage
*Usage is not asked for Q44 (overall quality of facilities/services) or Q43 (comfort/cleanliness/accessibility) .
Top Drivers of Capstone 44
Facilities and Resources Gaps
Gap between importance and satisfaction for all questions, except Q.35, which is a top facilities/resources driver
41
Division Y
Q.27 Q.28Q.31
Q.34
Q.35
Q.43
.100
.200
.300
.400
.500
.600
.700
.800
45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95%
Item Satisfaction
Cor
rela
tion
with
Cap
ston
e 44
High Importance,Low Satisfaction
High Importance,High Satisfaction
Facilities and Resources Opportunities
Comfort/cleanliness/accessibility
Space for individual /group study
Open access computer labs/resources
Bookstore
Library/resource centre Recreation/athletics
42
Division Y
Q.27 Library/Resource Centre Usage
66%
62%
75% 76%
70%68%
63%
75%
60%
65%
70%
75%
80%
2004 2005 2006 2007 2008 2009 2010 2011
Q.35 Recreation/Athletics Usage
42%39%
32%
40% 40%
33%
27%
32%
25%
30%
35%
40%
45%
2004 2005 2006 2007 2008 2009 2010 2011
Q.28 Open Access Computer Labs/Resources Usage
97% 96% 96% 95% 95%92%
83%
87%
80%
85%
90%
95%
100%
2004 2005 2006 2007 2008 2009 2010 2011
Usage of Facilities/Resources Over Time
Fluctuation in usage over time for library/resource centre and recreation/athletics, while open access computer labs/resources has declined in usage since 2008
43
Division Y
Services
44
Division Y
Services Trending
Net declines for all Services items over 8 years (by 9% to 21%), with the exception of Q.30 (special skills) and Q.38 (cafeteria/food), which fluctuated over 8 years but did not have an overall net decrease; the largest differences are identified below
50%
55%
60%
65%
70%
75%
80%
85%
90%
2004 2005 2006 2007 2008 2009 2010 2011
Q.29Q.30Q.32Q.33Q.36Q.37Q.38Q.39Q.40Q.41Q.42
Q.41, co-op field placement declined by 18% (65% not used)
Q.29, peer tutoring declined by 21% (84% not used)
45
Division Y
2004 2005 2006 2007 2008 2009 2010 2011
Q.43 comfort/cleanliness/accessibility of college facilities .350 .417 .374 .318 .462 .416 .512 .612
Q.42 employment/placement/career services .506 .379 .472 .408 .348 .289 .414 .399
Q.32 counselling/native counselling/advising services .439 .369 .400 .256 .364 .236 .373 .413
Q.31 space for individual/group study .320 .271 .378 .329 .295 .271 .406 .427
Q.29 peer tutoring services .243 .368 .278 .381 .389 .423 .256 .394
Q.36 registration/records services .314 .337 .366 .312 .200 .296 .388 .433
Q.35 recreation/athletics .237 .281 .383 .245 .206 .427 .553 .453
Q.41 co-op/field placement services .286 .340 .455 .347 .343 .339 .320 .354
2004 2005 2006 2007 2008 2009 2010 2011
Q.43 comfort/cleanliness/accessibility of college facilities 5 1 7 8 1 3 2 1
Q.42 employment/placement/career services 1 2 1 1 5 15 8 12
Q.32 counselling/native counselling/advising services 2 3 3 19 4 21 11 10
Q.31 space for individual/group study 6 13 5 6 9 17 9 9
Q.29 peer tutoring services 23 4 17 2 2 2 23 13
Q.36 registration/records services 8 7 8 9 27 12 10 6
Q.35 recreation/athletics 26 11 4 20 24 1 1 5
Q.41 co-op/field placement services 12 6 2 4 6 8 15 15
Survey Question
Ranking Order for Correlation with Capstone 45
Survey Question
Correlation with Capstone 45 (Pearson's r value)
Services – Top Drivers Over Time
Q.43 and Q.42 most consistent among the top drivers for Services (Capstone 45) over 8 years; fluctuation in the remaining top drivers
* Denotes aspects that were not used by/not available to >50% of students at this division
*
**
**
*
**
**
46
Division Y
Pearson's r Strength of Correlation
Q.43 comfort/cleanliness/accessibility of college facilities .612Q.39 safety and security services .475Q.28 open access computer labs/resources .471Q.27 library/resource centre .463Q.35 recreation/athletics .453Q.36 registration/records services .433Q.30 special skills services .430Q.38 cafeteria/food services .430Q.31 space for individual/group study .427Q.32 counselling/native counselling/advising services .413Q.40 financial aid services .403Q.42 employment/placement/career services .399Q.29 peer tutoring services .394Q.37 health services .364Q.41 co-op/field placement services .354Q.22 quality of other learning experiences .352Q.20 quality of classroom learning .349Q.8 develops your ability to solve problems using math techniques .340Q.25 lab/shop facilities and equipment .336Q.34 bookstore .333
Survey Question
Services – Current Year Drivers
Q.43 was the top driver of Services (Capstone 45) in 2011
* Denotes aspects that were not used by/not available to >50% of students at this division
*
**
**
**
**
47
Division Y
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Q37 Q45 Q38 Q40 Q33 Q39 Q32 Q36 Q42 Q30 Q29 Q41
Satisfaction Importance Usage
*Note that usage is not asked for Q45, overall quality of services.
Services Gaps
Gap between importance and satisfaction for most services
Top Drivers of Capstone 45
48
Division Y
Q.29Q.30 Q.32
Q.33
Q.37
Q.38
Q.39
Q.40
Q.41
Q.36
Q.42
.100
.200
.300
.400
.500
.600
.700
.800
45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95%
Item Satisfaction
Cor
rela
tion
with
Cap
ston
e 45
High Importance,Low Satisfaction
High Importance,High Satisfaction
Services Opportunities
Safety/security, registration/records, counselling, employment /placement/career
Peer tutoring
Co-op/field placement
Health Services
Cafeteria/food
Financial Aid Services
Special Needs/Disability Services
Special skills
49
Division Y
Q.39 Safety and Security Services Usage
34%
29%31%
39%37% 37% 37%
39%
25%
30%
35%
40%
45%
2004 2005 2006 2007 2008 2009 2010 2011
Q.41 Co-op/Field Placement Services Usage
24%
20%22%
28%26%
32%34% 35%
15%
20%
25%
30%
35%
2004 2005 2006 2007 2008 2009 2010 2011
Q.38 Cafeteria/Food Services Usage
95%97% 99%
97% 97% 96%
91% 91%
80%
85%
90%
95%
100%
2004 2005 2006 2007 2008 2009 2010 2011
Usage of Services Over Time
Higher usage over time for co-op/field placement and safety and security services, while cafeteria/food services experienced lower usage over time
Note that satisfaction with co-op/field placement has declined substantially as usage has increased
50
Division Y
Staff Concern and Overall College Experience
51
Division Y
Staff Concern and Overall Experience Trending
Concern of people and overall college experience have both declined since 2009 in Division Y (by 12% and 8%, respectively)
60%
65%
70%
75%
80%
85%
90%
95%
100%
2004 2005 2006 2007 2008 2009 2010 2011
Year
Sat
isfa
ctio
n
Q.46 Concern of people Q.47 Overall college experience
52
Division Y
Drivers of Staff Concern
Q.46, Staff Concern, was often among the top 10 drivers of KPI over the past 8 years for Division YThe top drivers of Q.46, Staff Concern in the current year:
Q.32 ‘counselling/native counselling/advising services’ (.442) (75% not used/not available)Q.47 ‘your overall college experience’ (.377)Q.8 ‘develops your ability to solve problems using math techniques’ (.369)Q.18 ‘helpfulness of teachers outside of class’ (.366)Q.43 ‘comfort/cleanliness/accessibility of college facilities’ (.352)
53
Division Y
Drivers of Overall Experience
Q.47, Overall Experience, was the item most strongly related to KPI for Division Y for 3 of the past 8 yearsThe top drivers of Q.47, Overall Experience in the current year:
Q.46 ‘the concern of people at this college for your success’ (.377)Q.39 ‘safety and security services’ (.450) (60% not used/not available)Q.20 ‘quality of classroom learning’ (.420)Q.43 ‘comfort/cleanliness/accessibility of college facilities’ (.418)Q.3 ‘provides you with skills and abilities specific to your chosen career’ (.381)
54
Division Y
Demographics
55
Division Y
Demographics
Student gender has fluctuated over time, with a peak in female students in 2009
% Male Students
40% 41%37% 36%
34%
22%26%
30%
20%25%30%35%40%45%
2004 2005 2006 2007 2008 2009 2010 2011
% Fem ale Students
60% 59%63% 64%
66%
78%74%
70%
55%60%65%70%75%80%
2004 2005 2006 2007 2008 2009 2010 2011
Student age has also fluctuated over time, with the largest proportion of <21 year olds from 2008-2010
% <21
46%50% 50%
45%
54%51%
53%
44%
30%
35%
40%
45%
50%
55%
2004 2005 2006 2007 2008 2009 2010 2011
% 21-25
40% 38% 40%45%
35% 37%33%
41%
30%35%40%45%50%55%
2004 2005 2006 2007 2008 2009 2010 2011
56
Division Y
High School Diplom a
80%81%
79%81% 80%
75%
79%
73%
65%
70%
75%
80%
85%
2004 2005 2006 2007 2008 2009 2010 2011
Demographics
Current year is the lowest percent of students entering Division Y with only a high school diploma
Demographics do not appear to have a clear relationship to KPI results
57
Division Y
Department Results
58
Division YK
PI S
atis
fact
ion
KPI Trends by Department
KPI results for the two departments within Division Y follow a pattern similar to the overall Division
2004 2005 2006 2007 2008 2009 2010 201175%
80%
85%
90%
95%
100%
Division Y KPI
Department 1
Department 2
59
Division Y
-20%
-15%
-10%
-5%
0%
5%
10%
55% 60% 65% 70% 75% 80% 85% 90% 95% 100%
Knowledge & SKills(Capstone 14)Learning Experiences(Capstone 26)Facilities/Resources(Capstone 44)Services (Capstone 45)
Satisfaction with Capstone
Diff
eren
ce in
Cap
ston
e S
atis
fact
ion
from
201
1-20
04
Capstone Trends by Department
Among the 2 departments within Division Y, the largest decreases and lowest satisfaction occur with Facilities/Resources and Services (Capstones 44 and 45) for Department 2; smaller decreases with Knowledge & Skills (Capstone 14)
Department 2
Department 1
60
Division Y
Summary and Conclusions
61
Division Y
Summary of Findings
Analysis of 8 years of KPI data suggests that the KPI results for Division Y have decreased from 2008-2011. Specifically:
Very pronounced declines in student opinion of many Facilities/Resources and ServicesEnrolment for Division Y has grown by approximately one-third% since 2004
62
Division Y
Summary of Findings
The top driver over time for Capstones 44 and 45 (Facilities/ Resources and Services) is Q.43 ‘comfort/cleanliness/ accessibility of college facilities’On the basis of driver strength, usage, and satisfaction over time, other priorities include:
Q.27 ‘library/resource centre’ Q.28 ‘open access computer labs/resources’ Q.31 ‘space for individual/group study’Q.35 ‘recreation/athletics’ (not used/not available to 68% of students)Q.39 ‘safety and security services’ (not used by 60% of students)Q.41 ‘co-op/field placement services’ (not used by 65% of students)Q.42 ‘employment/placement/career services’ (not used by 69% of students)
63
Division Y
Summary of Findings
For Capstone 26, Learning Experiences, top drivers with high satisfaction are strengths:
Q.15 ‘teachers’ knowledge of their subjects’Q.16 ‘teachers are up-to-date/current in their fields’
For Capstone 26, priorities for improvement include: Q.19 ‘feedback about your progress’Q.20 ‘quality of classroom learning’Q.22 ‘quality of other learning experiences’Q.24 ‘course materials’
64
Division Y
Summary of Findings
For Capstone 14, Knowledge and Skills, top drivers with high satisfaction are strengths:
Q.3 ‘provides you with skills and abilities specific to your chosen career’ (also a top driver of Capstone 26)Q.4 ‘includes topics relevant to your future success’
For Capstone 14, priorities for improvement include: Q.8 ‘develops your ability to solve problems using math techniques’
65
Division Y
Summary of Findings
Department KPI results follow a pattern similar to the overall Division
Q.47 ‘your overall college experience’ and Q.46 ‘the concern of people at this college for your success’ are consistently strongly related to KPI over time
Some college support aspects (student engagement section) appear to be drivers of KPI:
Q.49 ‘provides support to deal with your coursework’Q.48 ‘encourages you to spend time on your coursework’Q.54 ‘provides you with challenging courses’Q.53 ‘has at least one person you can rely on for useful
information’Q.51 ‘provides information on social opportunities’Q.52 ‘provides information on student financial aid services’
