23
Key Performance Indicators Report Presented to Okanagan College Board of Governors June 28, 2011 Draft 2.7
Key Performance Indicators Report Presented to Okanagan College Board of Governors June 28, 2011 Draft 2.7
ii | Okanagan College KPI Report
Executive Summary
A draft set of 23 key performance indicators (KPIs) was approved by the Okanagan College Board of Governors in November 2008. The KPIs fall into three categories: student, employee, and organizational indicators. Almost half of these are student indicators. Three of these KPIs do not yet have data available and are not reported here. Two of these, KPI 5 and 16, now have data sources. The Community College Survey of Student Engagement (CCSSE) has been conducted in 2011 as an assessment tool for KPI 5. Data from this study will be available by fall 2011. The Sustainability Tracking Assessment and Rating System (STARS) has been employed to track KPI 16. The BC Colleges Consortium Employee Survey referenced in KPI 10 has been discontinued. While we have continued to study alternatives, no acceptable assessment tool has yet been found for KPI 10, employee engagement. No employee satisfaction survey was conducted in 2011. However, a task force was formed and an extensive review of the previous survey results was conducted. From this review, an action list was created and followed up with reports submitted back to the employee communities. A comprehensive review of the multiple data sources that inform our key performance indicator results this year reflects the continued pattern of overall institutional success. Areas with Best Results For the sixth year in a row, Okanagan College has produced over 100 per cent of its total student enrolment FTE targets. The college has consistently increased its Ministry of Advanced Education (AVED) utilization every year with the last three years’ utilization over 100 per cent. In 2010-11, Okanagan College produced 5,170 full-time equivalent students in programs funded by AVED, with a target of 4,757 ministry-funded seats, or a utilization rate of 109 per cent. Overall utilization is 105 per cent. Aboriginal FTE and headcount numbers have both steadily increased since 2006 (688 and 1,501, respectively). The results for students’ satisfaction with the quality of education, with their transfer experiences, and with their educational goal achievement all remain high and close to the provincial averages. Areas to Watch The percentage of students satisfied with facilities fell to 83 per cent from 90 per cent the year before, but back to historic levels. Sixty-nine per cent of Aboriginal college students indicated that they feel their culture is respected and valued, the same percentage as the year before. Fewer diploma, certificate, and apprentice students were employed in jobs related to their training in 2010 over 2009; these results were close to the provincial average. However, Aboriginal students reported more training-related employment; from 71 per cent in 2009 to 76 per cent in 2010 with a provincial average of 74 per cent. As well, baccalaureate graduates did better than the provincial average, with 88 per cent and a provincial average of 72 per cent. Areas to Focus on Okanagan College received almost 50 per cent of the students from our region who immediately transitioned to post secondary education in the academic year 2009-10, the largest market share for all post secondary students in the region. The Okanagan College Region has seen an 8 per cent increase in the immediate-entry transition rate of 43.5, up from 35.4 per cent in 2001/02. However, the Okanagan College Region eight-year transition rate is the lowest in the province.
iii | Okanagan College KPI Report
Contents Executive Summary .................................................................................................................... ii
Background ................................................................................................................................. 1
Glossary ...................................................................................................................................... 1
Student KPIs ............................................................................................................................... 2
KPI 4 Student satisfied with quality of education .................................................................. 2
KPIs 6 and 22 Students who would recommend Okanagan College ...................................... 4
KPI 3 Students satisfied with transfer experience .................................................................. 5
KPI 15 Student satisfaction with facilities .............................................................................. 5
KPI 21 Aboriginal students who feel their culture is respected and valued at Okanagan College .................................................................................................................................... 6
KPI 1 Students who achieve their educational goal (all) ........................................................ 7
KPI 18 Aboriginal students who achieve their educational goal ............................................ 8
KPI 2 Students employed in jobs related to their training (all) .............................................. 9
KPI 19 Aboriginal students employed in jobs related to their training ................................ 10
Employee KPIs ......................................................................................................................... 11
KPI 7 Employees who would recommend OC as an employer. ........................................... 11
KPI 8 Employees who feel they know how to do their job. ................................................. 11
KPI 9 Employees who feel they are achieving their goals. .................................................. 11
KPI 11 Employees who feel their region is valued. .............................................................. 11
KPI 16 Employee satisfaction with facilities. ....................................................................... 11
Organizational Effectiveness KPIs ........................................................................................... 12
KPI 12 Okanagan College FTE Utilization .......................................................................... 12
KPI 13 Space Utilization ...................................................................................................... 13
KPI 20 Aboriginal FTEs and Headcount .............................................................................. 14
KPI 23 Okanagan college students studying abroad ............................................................. 14
KPI 14 Students transitioning to Okanagan College ............................................................ 15
Appendix 1: Glossary ........................................................................................................... 17
Appendix 2: Additional Transition Information................................................................... 18
1 | Okanagan College KPI Report
Background
In May 2008, a committee was formed with a mandate to develop a set of KPIs for the college. In November 2008, a draft set of 23 KPIs was approved by the Board of Governors. With time and experience, this set is expected to be refined to approximately 10 KPIs in the future. These KPIs cover student success, employee satisfaction, and institutional effectiveness. Last year, three KPIs did not yet have subscribed data sources. KPI 5 Rank of College (Benchmark survey on student engagement) KPI 10 Rank of College (Benchmark survey on employee engagement) KPI 16 Sustainability (Benchmark survey on organizational sustainability) The Community College Survey of Student Engagement (CCSSE) has been conducted in 2011 as an assessment tool for KPI 5. Data from this study will be available by Fall 2011. The Sustainability Tracking Assessment and Rating System (STARS) has been employed to track KPI 16. Some study has been done; however, no acceptable assessment tool has yet been found for KPI 10, employee engagement, to replace the BC Colleges Consortium Employee Survey. For the other 20 measures, there are data available, some from internal sources, such as student and employee surveys, which provide internal baseline comparisons. Other data are from external sources, such as the provincial student outcomes surveys, and these data allow for benchmarking against provincial comparators. Since the establishment of institutional KPIs in 2008, we have two or more years of data for most of the indicators. Where available, data for previous years are included for informational purposes. A glossary is available in the appendix.
Glossary
Definitions DACSO Diploma, Associate Degree, Certificate Student Outcomes Survey, data
available November APPSO Apprentice Student Outcomes Survey, data available July
BGS Baccalaureate Graduate Outcomes Survey, data available March CDW Central Data Warehouse - data may change with updates, October data
available December SSS Student Satisfaction Survey, data available July ESS Employee Satisfaction Survey data available every two years
AASS Aboriginal Access and Satisfaction Survey data available January CCSSE Community College Survey of Student Engagement STARS Sustainability Tracking Assessment and Rating System
2 | Okanagan College KPI Report
Student KPIs
Almost half (10) of the indicators address student satisfaction and success. These indicators also include separate items for Aboriginal and international students. The following charts show the data over four years compared to the provincial average, where applicable. Note that response data from BGS and APPSO are too few for Aboriginal reporting.
KPI 4 Student satisfied with quality of education Source: BC Student Outcomes surveys Student satisfaction with the quality of their education has remained high, aligned with the provincial average, and stable over the last five years. Over 90 per cent of students from all three surveys, DACSO, APPSO, and BGS are satisfied with their education at Okanagan College.
95% 95% 95% 94% 94%94% 95% 95% 93% 95%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
2006 2007 2008 2009 2010
Students satisfied with quality of education (All)source: DACSO
Province OKN
3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
| Okanagan
98%
2007
Studen
93% 89%
2006
Stude
n College K
997%
7
ts Satisft
94% 95%
2007
ents sati
KPI Report
96% 98%
2008
fied withtheir ed
source
Provinc
94% 96%
2008
sfied wieducasource: A
Province
96%
20
h the oveucatione: BGS
e OKN
93%% 98
2009
ith overaationAPPSO
e OKN
96%
009
erall qua
95%% 95
2010
all qualit
95% 97
2010
ality of
93%5% 9
2011
ty of
7%
90%
1
4
KPIs 6 aSource: S The Studengagemavailable
0%
20%
40%
60%
80%
100%
| Okanagan
and 22 StudStudent Satis
dent Satisfactment, the CCSe in fall.
84%70
2007
Stude
n College K
dents who wsfaction Surv
tion Survey SSE, was run
90%0%
nts who
All Studen
KPI Report
would recomvey
was not runn. This ques
%79%
2008
o would source: SSS
nts Intern
mmend Okan
n in 2010. Insstion was ask
87% 79%
2009
recommS
ational Studen
nagan Colle
stead a surveked on CCSS
89%%
20
mend OC
nts
ege
ey to determSE and the re
90%
010
C
mine student esults will b
e
5
KPI 3 StSource: D
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
KPI 15 SSource: S
This yearadministe
0%
20%
40%
60%
80%
100%
| Okanagan
udents satisDiploma Ass
89% 8
2006
Stud
Student satStudent Satis
r the questioered at the sa
83%
2007
Stude
n College K
sfied with trsociate Degr
86%7%
dents sat
tisfaction wsfaction Surv
on is part of aame time as
90%
2008
ent satisf(learnin
source
KPI Report
ransfer expree and Cert
% 85%
2007
isfied wiso
P
with facilitivey, Commu
a different dthe CCSSE
86%
2009
faction wng enviroe: SSS, CCSSE in
erience tificate Stude
81% 81
2008
ith transfource: DACSO
Province OKN
es unity College
ata source; irather than
90%
2010
with faconment)n 2011
ent Outcome
87%%
2
fer exper
N
e Survey of S
it was asked with the Stu
% 83
0 20
cilities )
es Survey.
83%
2009
rience (A
Student Enga
as a supplemudent Satisfa
3%
11
83% 83%
2010
All)
agement.
mental questaction Survey
%
tion y.
6 | Okanagan College KPI Report
KPI 21 Aboriginal students who feel their culture is respected and valued at Okanagan College Source: Aboriginal Access to Student Services Survey The results from this survey remain largely unchanged over four years.
65% 67% 69% 69%
0%
10%
20%
30%
40%
50%
60%
70%
80%
2008 2009 2010 2011
Aboriginal students who feel their culture is respected and valued at OC
source: AASS
7 | Okanagan College KPI Report
The following KPIs indicate student success.
KPI 1 Students who achieve their educational goal (all) Source: Diploma Associate Degree and Certificate Student Outcomes Survey This indicator has followed the provincial level each year over the last five years.
88% 89% 89% 88% 85%83%90% 91% 86% 85%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
2006 2007 2008 2009 2010
Students who achieve their educational goal (All)source: DACSO
Province OKN
8 | Okanagan College KPI Report
KPI 18 Aboriginal students who achieve their educational goal Source: Diploma Associate Degree and Certificate Student Outcomes Survey This indicator has trended closer to the provincial average over the last three years. In the years previous, 2006 and 2007, Okanagan College’s results were much lower than the provincial average.
90% 89% 91% 91% 87%71%
80%90% 88% 87%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
2006 2007 2008 2009 2010
Students who achieve their educational goal (Aboriginal)
source: DACSO
Province OKN
9
KPI 2 StSources: The emp2007 to 2and bacc
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
0%10%20%30%40%50%60%70%80%90%
100%
| Okanagan
udents empBC Student
loyment out2009 for diplalaureate stu
68%57%
2006
Studen
95% 94%
2006
Stude
n College K
ployed in jobt Outcomes S
tcomes are loloma, certifiudents fared
71% 7
2007
ts employtr
95% 94%
2007
ents emt
KPI Report
bs related toSurveys
ower in 2010icate and appbetter.
70%76%
2
yed in jobraining (A
source: DACSO
Province
94% 91%
2008
ployed itheir trai
Source APP
Province
o their train
0 than they wprentice stud
74%
2008
bs relatedAll)O
OKN
95% 95%
2009
in jobs riningPSO
OKN
ning (all)
were in the edents; howev
87%71%
2009
d to their
94% 93%
2010
elated t
economic bover, Aborigin
67% 65%
2010
91% 88%
2011
o
oom years ofnal (see KPI
%
f 19)
10
Baccalauemployed
KPI 19 ASource: D
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
0%
20%
40%
60%
80%
100%
| Okanagan
ureate graduad in jobs rela
Aboriginal sDiploma Ass
72%
52%
2006
Students
80% 8
2007
Stude
n College K
ates are survated to their
students emsociate Degr
72% 75
2007
s employed
8180%
ents emt
KPI Report
veyed two yetraining than
mployed in joree and Cert
74%5%
200
d in jobs r(Aborigin
source: DAC
Province
% 89%
2008
ployed itheir trai
Source BG
Province
ears out. A gn the provin
obs related tificate Stude
73%79%
08
related to tnal) SO
OKN
79% 8
2009
in jobs riningGS
OKN
greater proponcial average
to their traient Outcome
% 71%
2009
their train
7286%
elated t
ortion of our e.
ining es survey
74% 76%
2010
ning
%88%
2010
o
grads are
11 | Okanagan College KPI Report
Employee KPIs
The next five KPIs seek to measure employee satisfaction. Each of these indicators’ data is from the internal Employee Satisfaction Survey. Note that two of the questions have two years of data while three questions were asked only in 2009. No employee satisfaction survey was conducted in 2010.
KPI 7 Employees who would recommend OC as an employer.
KPI 8 Employees who feel they know how to do their job.
KPI 9 Employees who feel they are achieving their goals.
KPI 11 Employees who feel their region is valued.
KPI 16 Employee satisfaction with facilities.
Note that KPI 10, Employee Engagement, does not have a suitable data source identified, since the dissolution of the provincial employee engagement survey consortium (survey conducted by Mercer) in 2007.
79% 82%96% 96%
0
68%
0
71%
0
65%
0%10%20%30%40%50%60%70%80%90%100%
2007 2009
Employee Satisfactionsource: ESS
KPI 7 Recommend OC KPI 8 Know how to do job
KPI 9 Achieving goals KPI 11 Region is valued
KPI 16 Satisfaction with facilities
12
Organi
The last f
KPI 12 OSource: O
4,160
4
20
| Okanagan
izational
five KPIs ill
Okanagan COkanagan C
0
4,020
5,209
5,827
2007
97%
112%
007
AV
n College K
Effective
lustrate organ
ollege FTE UCollege Centr
4,350
4,268
6,4
2008
Okana
AVED Target
99%
103%
2008
FTE VED FTE Utiliza
KPI Report
eness KP
nizational ef
Utilization ral Data Wa
4,60
488
6,693
agan Col
t OC AVED
102%105%
2009
Utilizatiation
PIs
ffectiveness.
arehouse
00
4,697 6,873
7,19
2009
llege FTE
D FTE Tota
105108
2010
ionTotal FTE Utiliz
.
4,801
5,019
78
201
E Utilizat
al Target O
5%
18%1
2011
zation
4,7
,527
8,095
10
tion
OC Total FTE
109%
105%
757
5,170 7,311
7,6
2011
44
13
KPI 13 SSource: A
0%
20%
40%
60%
80%
100%
| Okanagan
Space UtilizaAVED Space
65% 68% 70
Kelown
so
n College K
ation e Utilization
48%
0%75%
na
Source: AVED, R
20
KPI Report
Reports, 20
50%60% 60%
Vernon
pace UtiRevelstoke inc
006 2007
010 not yet a
49%
71%%
Penti
ilizationcluded in 2008
2008 200
available.
8071%
76%
icton
Salmon Arm
09
0%75%
56%
Salmon Arm
64%
14
KPI 20 ASource: P
KPI 23 OSource: F
0
2
4
6
8
10
12
14
16
0
200
400
600
800
1,000
1,200
1,400
1,600
| Okanagan
Aboriginal FProvincial C
Okanagan cFall Demogr
10
2006
892
324
2006
Abo
n College K
FTEs and HeCentral Data
college studraphics
7
2007
Number
617
4
2007
original Fsou
KPI Report
eadcount a Warehouse
dents study
14
2008
r of OC studsource: Fa
901
363
7 2
FTEs andurce: CDW Oct
Headcount
e, October 20
ying abroa
14
2009
dents studyll demographics
1,
461
2008
d Headco2010
t FTE
010
ad
2
ying abroad
,244
562
2009
ount
14
010
d
1,501
688
2010
12
2011
15 | Okanagan College KPI Report
KPI 14 Students transitioning to Okanagan College Source: Student Transitions Project (STP) KPI 14 indicates the percentage share of students who come to Okanagan College from two perspectives. Point (a) shows the percentage share of the grade 12 graduates who immediately transition to postsecondary and enrolled at either Okanagan College or UBC Okanagan (UBC O) during the academic year. That is, of those students that go on to postsecondary, how many come here or UBC O. Point (b) shows the percentage share of grade 12 graduates (entire class) who enrolled at either Okanagan College or UBC O during the academic year. That is, of the entire graduating class, how many come here or UBC O.
Market Share of Immediate Transitions from Okanagan College Region
Grade 12 Grad Class Year 2005/ 2006
2006/ 2007
2007/ 2008
2008/ 2009
Grade 12 Grad Class 4,058 3,903 4,010 4,004
Immediate-entry the following year to PSE 1,574 1,641 1,670 1,740
Immediate-entry Transition Rate to all PSE 39% 42% 42% 43%
Number of Grads to UBC Okanagan 451 467 463 512
% of Immediate Transition to UBC Okanagan (a) 28.7% 28.5% 27.7% 29.4%
% of Grade 12 Grad Class to UBC Okanagan (b) 11.1% 12.0% 11.5% 12.8%
Number of Grads to Okanagan College 753 815 796 827 % of Immediate Transition to Okanagan College (a) 47.8% 49.7% 47.7% 47.5% % of Grade 12 Grad Class to Okanagan College (b) 18.6% 20.9% 19.9% 20.7% Number of Grads to Other Institutions 370 359 411 401 % of Immediate Transition to Other Institutions 23.5% 21.9% 24.6% 23.0%
16
Note: KPIs 5, 1
| Okanagan
10, and 17 do
28.7%
47.8%
23.5%
2005/2006
% of Immediat
% of Immediat
n College K
o not have d
Grade 1
Marke
te Transition to U
te Transition to O
KPI Report
data available
28.5%
49.7%
21.9%
2006/2007
2 Grad Class Ye
et Share of IOkanag
source: STP
UBC Okanagan (
Other Institution
e.
ar ‐ Entry into P
Immediate Tgan College RFirst Annual T
a) % o
ns
27.7%
47.7%
24.6%
2007/2008
PSE the following
Transitions fRegionTransitions
f Immediate Tra
g Year
from
ansition to Okan
29.4%
47.5%
23.0%
2008/2009
agan College (a)
)
17 | Okanagan College KPI Report
Appendix 1: Glossary
Definitions
DACSO Diploma, Associate Degree, Certificate Student Outcomes Survey, data available November
APPSO Apprentice Student Outcomes Survey, data available July BGS Baccalaureate Graduate Outcomes Survey, data available March CDW Central Data Warehouse - data may change with updates, data
available December SSS Student Satisfaction Survey, data available July ESS Employee Satisfaction Survey data available every two years
AASS Aboriginal Access and Satisfaction Survey data available January CCSSE Community College Survey of Student Engagement STARS Sustainability Tracking Assessment and Rating System
18 | Okanagan College KPI Report
Appendix 2: Additional Transition Information
Not only is the immediate-transition rate for the Okanagan College Region improving, but the gap between this rate and the BC rate has decreased.
50.9% 51.2% 49.9% 50.2% 50.9% 51.7% 52.4% 53.6%
35.4% 36.6% 35.5% 35.9%38.8%
42.0% 41.6% 43.5%
‐15.5% ‐14.5% ‐14.4% ‐14.3% ‐12.1%‐9.7% ‐10.8% ‐10.1%
‐20.0%
‐10.0%
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
2002/2003 2003/2004 2004/2005 2005/2006 2006/2007 2007/2008 2008/2009 2009/2010
Okanagan College Region Transition Rates Compared to BC
BC Immed Trans OKN Immed Trans Difference
Linear (OKN Immed Trans) Linear (Difference )
OKN region transition rate is improving overall
OKN transition rate gap is becoming smaller
35.4%
36.4%
0%10%20%30%40%50%60%70%80%90%
100%
Regional Transition Rates to date of Grad Year 2001‐02Immediate Transition ‐ Immediate Transition Delayed ‐ 1 Year Delay
Delayed ‐ 2 Year Delay Delayed ‐ 3 or More Year Delay
No Transition Yet ‐ No Transition Yet
19
Howevertransition
F
Nor
Thom
Ne
Vancou
| Okanagan
r, the Okanagn over eight
Okanagan
Rockies
Fraser Valley
rthern Lights
mpson Rivers
Malaspina
w Caledonia
Camosun
North Island
Northwest
Province
Selkirk
Kwantlen
Capilano
Douglas
ver/Langara
8 Yea
n College K
gan College years) in the
ar TransiColle
KPI Report
Region has e province.
tion Ratege Regio
the lowest e
te of 200on (averSource: STP
eight year tra
01‐02 Grrage 76.2
ansition rate
63.6%
65.9
68
rad Class2%)
(cumulative
9%
8.2%
70.8%
73.5%
73.6%
74.3%
74.6%
75.4%
75.8%
76.2%
76.3%
78.7%
80.4
81.
8
s by
e
%
4%
1%
85.2%
20 | Okanagan College KPI Report
0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0% 70.0%
Northern Lights
Rockies
Fraser Valley
Okanagan
Thompson Rivers
Malaspina
Camosun
North Island
New Caledonia
Selkirk
Capilano
Grand Total
Northwest
Kwantlen
Douglas
Vancouver/Langara
Immediate Transition to PSE of Grade 12 Class 2008‐09
Aboriginal NonAboriginal All
