Post on 10-Jan-2022
transcript
MEDICINE COLLEGE
KPIs Guide
DEVELOPMENT & QUALITY UNIT
2
Table of Contents
Table of Contents 2
Speech of Dean of the college of medicine 3
Speech of Vice dean for Development and quality 4
College vision, Mission and Goals 5
Introduction 6
Table -1 Benchmark types 8
Diagram – 1 MECHANISM OF Performance indicators measurement 9
Table – 2 List of the KPIs utilized for the assessement of the strategic objectives,and
college mission, acheivement 10
Diagram –2 Distribution of KPIs in relation to the relevant Strategic objectives 11
KPIs Utilize to follow the quality assurance including NCAAA program KPIs 12
Table - 3.List of the KPIs Utilize to follow the quality assurance including NCAAA
program KPIs 13
Table - 4 Consistency of program key performance indicators and Najran university key
performance indicators 17
Table - 5 Consistency between program KPIs & vision 2030 18
Table – 6 Consistency of program KPIs with, NCAAA KPIs, and Afaaq KPIs 20
Table – 7 Program KPIs according to its type 21
Important links 22
3
Speech of Dean of the college of medicine
The rapid evolving of the medical education institutions all around
the globe, result in shifting target of these institutions from the concept of
quantity to concept of quality of their input in serving local, regional and
international community; by provide competent doctors, trustable
distinguished scientific researches ,and efficient community services to
support community health care and wellbeing.
In college of medicine We adopts quantitative and qualitative measurable
performance indicators in order to evaluate how far we achieve our
strategic objectives, inorder to determine to which extent we fulfill our
mission, so as to Identify deficiencies, and to develop operational plans for
continuous improvement. Moreover we choose benchmarks to compare our
performance with other national colleges, what help to assess the college
wellbeing and quality of the performance in relation to other national
colleges
Prof. DR. Mohamed Zayed Al Ayed
4
Speech of Vice dean for Development and quality
The Vice deanship of college of medicine for Development and quality,
through the unit of Development and quality seeks to spread the culture of
quality and Development, and to ensure that the standards of the National
Center for Academic Accreditation and Assessment (NCAAA) are met; to
ensure the quality of performance at the level of the medicine and surgery
program as an effort to contribute to achieving the vision, mission, and
strategic objectives of the college, and to achieve the leadership that the
college of medicine aspires to; in an integrated and solid manner.
The Development and quality unit also focuses on the process of continuous
Evaluation of all operations and activities within the college through which
it is possible to determine the level of its quality. This Evaluation includes
all aspects of administrative, academic and research activities and other
activities, that the college performs annually, which enables continuous
monitoring of the performance.
Evidence and information to support this Evaluation is needed, among these
evidences are performance indicators, in addition to the necessity for a
benchmark comparison with similar institutions and programs that have
good practices that can be used, or information and measurements that can
be compared with, to evaluate or performance.
In this manual, the focus will be on explaining the types of performance
indicators and how to define and calculate them, as well as the types of
benchmark comparisons.
Dr.Abd-Allah Mofarih Asiri
5
College vision, Mission and Goals
College vision
Excellence in medical education and contribution to scientific research to promote health services and
participate in community service.
College Mission
Preparation of qualified medical personnel capable of providing distinguished medical services,
contributing to scientific research and establishing multiple partnerships to serve the community and
raise the level of health awareness.
College Goals
Continuous Development of curricula and the means of medical education.
Preparation of morally and professionally medical cadres, well qualified, and capable of
continuous self-learning.
Development of the scientific research and cooperation with local, regional, and global
institutions in medical research environment.
Contributing to the health education and medical services provided to the community
Establishing an academic environment attract talented faculty members.
6
Introduction
Introduction
Definitions
Key Performance Indicators -KPIs:
It is the performance indicator that identifies evaluative criteria for scientific
assessment of an educational objective or student learning outcome
performance. A KPI must be measurable or written in a way that is designed
for assessment. When benchmarking and analysis are used with it, together,
they provide evidence for assessment to guide decision-making and
judgments.
Benchmark:
It is the performance level of achievement for a given KPI or performance
indicator. There are many kinds of benchmarks that align with KPIs;
therefore it is necessary to qualify benchmarks in order to understand their
relationship to a given KPI. Benchmarks may be internal or external.
Target Benchmark:
It is the anticipated performance level or desired outcome (goal or aim) for a
KPI.
Finding Benchmark:
7
Also known as actual benchmark; It is the actual outcome determined when the KPI
is measured or calculated. It represents the actual reality of the present situation.
Internal Benchmarks:
They are benchmarks based on information from inside the program or institution.
Internal benchmarks include target or finding benchmark data results from
previous years.
External Benchmarks
They are benchmarks from similar programs or institutions that are outside the
program or institution. For example, external benchmarks for "student to teacher
ration" could be Six students to 1 teacher from a different program within the
institution or another program outside the institution, or for institutions, it refers to
other institutions (national or international).
KPI Analysis:
It is a process in which a comparison and contrast of the benchmarks to determine
strengths and recommendations for improvement. This is sometimes called
"benchmarking." For example, KPI analysis could compare and contrast "student
to teacher ratio" target and actual benchmarks from both internal and external
data banks to determine strengths and recommendations for improvement.
New Target Benchmark:
It is the establishment of a new or desired target.
8
The program of medicine and surgery utilizes quantitative or qualitative
measurable performance indicators in order to evaluate the extent to which
strategic objectives have been achieved, and that indicate how far the program
achieved its mission, to Identify deficiencies, and to develop operational plans for
continuous improvement.
The program measures the key performance indicators with benchmarking
depending on appropriate tools, such as (Surveys, Statistical data, etc.) according to
the nature and objective of each indicator, as well as determining the following
levels for each indicator:
• Actual performance
• Targeted performance level
• Internal reference (Internal benchmark)
• External reference (External benchmark)
• New target performance level
The college selects internal and external benchmarking, to assess the program
wellbeing and performance in relation to
Table -1 Benchmark types
Internal
benchmark
External benchmark
KPI of the same program for
the previous year
KPIs of the Program of
medicine, Qassim
University
KPIs of the Program of
medicine at King Khalid
University.
9
Diagram – 1 MECHANISM OF Performance indicators
measurement
Planning and follow-up
The responsible
committee of the index
OPERATION
Committee & Index
Performance
Measurement
INPUT
Committee & Index
Performance
Measurement
Committee
Formation a committee
to study the results of
the measurement to
identify strengths and
weaknesses.
1. Receive responses from
target groups.
2. Perform the necessary
statistical analyses
using the Statistical
Software Package
(SPSS).).
3. Discuss results, make
comparisons and
report.
Annual reports
for monitoring
approved
performance
indicators.
1. Follow-up on
the implementation
of improvement
plans.
OUTPUT
Committee & Index
Performance
Measurement
1. Paper & Electronic forms
2. The approved timeline
for submitting forms
electronically.
3. Links to the surveys on
the college's website.
4. Advertising procedures
and communication with
target groups to access
links
Planning and follow-up
College Agency for
Development and Quality
01
Table – 2 List of the KPIs utilized for the assessment of the strategic
objectives, and college mission, achievement
College Mission
Statement
Content of
the
Mission
Consistent Objectives Key Performance Indicators
Preparation of
qualified medical
personnel capable of
providing
distinguished
medical services,
contributing to
scientific research
and establishing
multiple partnerships
to serve the
community and raise
the level of health
awareness.
Teaching
and
learning
Continuous Development of
curricula and the means of
medical education.
Percentage of courses adopted new medical
education means
Percentage of teaching staff participated
in training programs regarding teaching
and learning methods.
Preparation of morally and
professionally medical cadres,
well qualified and capable of
continuous self-learning.
Students’s performance in the
professional and/or national
examinations
Graduates' employability and enrolment
in postgraduate programs within one year
of graduation
Establishing an academic
environment attract talented
faculty members.
Number of honored teaching staff by the
college administration
The proportion of teaching staff leaving the
program
Scientific
researches
Development of scientific
research and cooperation with
local, regional, and global
institutions in the medical
research environment.
Percentage of publications of faculty
members
Rate of published research per faculty
member
Citations rate in refereed journals per
faculty member
Community
services
Contributing to the health
education and medical
services provided to the
community
Rate of community services activities
provided to the community per teaching staff
The proportion of the departments provided
at least five community services activities
The number of the medical services provided
to the community.
00
Diagram – 2 Distribution of KPIs in relation to the relevant Strategic
objectives
02
KPIs Utilize to follow the quality assurance including NCAAA
program KPIs
03
KPI code KPI operative KPI description Time of
measurement
Responsibility
KPI-P.01 Percentage of achieved
indicators of the program
operational plan
objectives.
Percentage of performance
indicators of the operational plan
objectives of the program that
achieved the targeted annual level
to the total number of indicators
targeted for these objectives in the
same year
Last four
weeks of the
academic
years
Mission and
Goals
Committee
KPI-
MED.01
The degree of awareness
of the beneficiaries with
the mission and
objectives
The mean of knowledge of faculty
members and undergraduate and
graduate students with the program
mission and objectives. Using a
five-point scale in an annual survey
Last four
weeks of the
academic
years
Mission and
Goals
Committee
KPI-P.02 Students' Evaluation of
quality of learning
experience in the program
The mean of the rating of final year
students for the quality of learning
experience in the program on a
five-point scale in an annual survey
Last four
weeks of the
academic
years
Teaching and
Learning
Committee.
KPI-
MED.02
Percentage of courses
evaluated by the students
during the year
Percentage of courses taught and
then evaluated by the students in
the concerned year to the total
number of delivered courses in the
same year.
In the last
week of the
academic year
Teaching and
Learning
Committee.
KPI-P.03 Students' Evaluation of
the quality of the courses
The mean of students' rating for the
quality of courses on a five-point
scale in an annual survey
In the last
week of the
academic year
Teaching and
Learning
Committee.
KPI-P.04 Completion rate The proportion of undergraduate
students who completed the
program in minimum Time in each
cohort
Beginning of
the second
semester of
the academic
year
Teaching and
Learning
Committee.
KPI-P.05 First-year students'
retention rate
Percentage of first-year
undergraduate students who
continue at the program the next
year to the total number of first-
year students in the same year
In the 1st four
weeks of the
next academic
year-
Teaching and
Learning
Committee.
KPI-P.06 Students' performance in
the professional and/or
national examinations
Percentage of students or graduates
who were successful in the
professional and / or national
According to
the result
disclosed by
Teaching and
Learning
Committee.
Table-3.List of the KPIs Utilize to follow the quality assurance including NCAAA
program KPIs
04
examinations, or their score
average and median (if any)
SMLE
KPI-P.07 Graduates' employability
and enrolment in
postgraduate programs
Percentage of graduates from the
program who within a year of
graduation were:
a. employed
b. enrolled in postgraduate
programs
during the first year of their
graduation to the total number of
graduates in the same year
First 4weeks
of the next
year
Teaching and
Learning
Committee.
KPI-P.08 The average number of
students in the class
The average number of students
per class (in each teaching
session/activity: lecture, small
group, tutorial, laboratory, or
clinical session)
First 4 weeks
of the
academic year
Teaching and
Learning
Committee.
KPI-P.09 Employers' Evaluation of
the program graduate's
proficiency
The mean of the rating of
employers for the proficiency of
the program graduates on a five-
point scale in an annual survey
Last four
weeks of the
academic year
Teaching and
Learning
Committee.
KPI-P.10 Students' satisfaction with
the offered services
The mean of students' satisfaction
with the various services offered
by the program (restaurants, sports
transportation, facilities, academic
advising, ...) on a five-point scale
in an annual survey
Last four
weeks of the
academic year
Students'
Committee.
KPI-
MED.03
Evaluation of students for
academic and
professional guidance
The mean of students' satisfaction
with the appropriate academic and
vocational guidance for the all
teaching period on a five-point
scale in an annual survey for final
year students
Last four
weeks of the
academic year
Students'
Committee.
KPI-P.11 The ratio of students to
teaching staff
The ratio of the total number of
students to the total number of full-
time and full-time equivalent
teaching staff in the program
First four
weeks of the
academic year
Teaching Staff
Committee
KPI-P.12 Percentage of teaching
staff distribution
Percentage of teaching staff
distribution based on:
a. Gender
b. Branches
c. Academic Ranking
First four
weeks of the
academic year
Teaching Staff
Committee
KPI-P.13 The proportion of
teaching staff leaving the
The proportion of teaching staff
leaving the program annually for
In the 1st four
weeks of the
Teaching Staff
Committee
05
program reasons other than age retirement
to the total number of teaching
staff.
next academic
year
KPI-P.14 Percentage of
publications of faculty
members
Percentage of full-time faculty
members who published at least
one research during the year to
total faculty members in the
program
Last four
weeks of the
academic year
Teaching Staff
Committee
KPI-P.15 Rate of published
research per faculty
member
The average number of refereed
and/or published research per each
faculty member during the year
(total number of refereed and/or
published research to the total
number of full-time or equivalent
faculty members during the year)
Last four
weeks of the
academic year
Teaching Staff
Committee
KPI-P.16
Citations rate in refereed
journals per faculty
member
The average number of citations in
refereed journals from published
research per faculty member in the
program (total number of citations
in refereed journals from published
research for full-time or equivalent
faculty members to
the total research published)
Last four
weeks of the
academic year
Teaching Staff
Committee
KPI-
MED.04
Number of researches or
reports submitted in
academic conferences
during the previous year
for all full-time faculty
members
The average number of researches
or reports submitted in academic
conferences during the previous
year per faculty member in the
program
Last four
weeks of the
academic year
Teaching Staff
Committee
KPI-
MED.05
Percentage of staff
members and full-time
co-workers involved in
community service
activities
Percentage of staff members and
full-time co-workers involved in
community service activities to
total faculty members in the
program
Last four
weeks of the
academic year
Teaching Staff
Committee
KPI-
MED.06
Percentage of faculty
members involved in
professional development
activities during the
previous year
Percentage of staff members
involved in professional
development activities during the
previous year to total faculty
members in the program
Last four
weeks of the
academic year
Teaching Staff
Committee
KPI-P-17 The satisfaction of
beneficiaries with the
learning resource
(Students, staff members)
The mean of beneficiaries'
(students') satisfaction with the
adequacy and diversity of learning
resources (references, journals,
Last four
weeks of the
academic year
Learning
Resources,
Facilities, and
Equipment
06
databases; etc.) on a five-point
scale in an annual survey.
Committee
KPI-
MED.07
The satisfaction of
beneficiaries with the
facilities and equipment.
(Students, Staff member)
The mean of beneficiaries' (Staff
members') satisfaction with the
adequacy and diversity of learning
resources. (References, journals,
databases… etc.) On a five-point
scale in an annual survey.
Last four
weeks of the
academic year
Learning
Resources,
Facilities, and
Equipment
Committee
07
Table - 4 Consistency of program key performance indicators and
Najran university key performance indicators
No KPI code KPI program of medicine and
surgery
KPI
code
KPI of Najran university
1 KPI-MED.1 The degree of awareness of the beneficiaries
with the mission and objectives (average
range of knowledge of faculty members and
undergraduate and graduate students in the
thesis using a five-year questionnaire)
NU1.4 Satisfaction of the beneficiaries of
the university's mission and
objectives
2 KPI-P-02 Students' Evaluation of quality of learning
experience in the program
NU1.8 Final year student satisfaction rate
for academic program (calendar)
3 KPI-P-06 Students' performance in the professional
and/or national examinations
NU8.2 Ranking of graduates in
measurement tests at the level of
the Kingdom (health colleges –
teachers.
4 KPI-P-09 Employers' Evaluation of the program
graduates' proficiency
NU8.1 Community and labor market
satisfaction ratio for graduate
performance skills
5 KPI-P-10 Students' satisfaction with the offered services NU6.6
Student satisfaction rate for
services and facilities provided by
the Deanship of Admissions and
Registration
6 KPI-MED.3 Evaluation of students for academic and
professional guidance
NU6.1
Student satisfaction rate for
counselling, social and
psychological services
7 KPI-P-12 Percentage of teaching staff distribution NU3.4 Percentage of Professor,
Associate Professor, Associate
Professor on both women's and
men's
8 KPI-MED.7 the satisfaction of beneficiaries with facilities
and equipment
NU4.1 Faculty satisfaction ratio for
facilities and equipment
9 KPI-MED.8 the satisfaction of beneficiaries with the health
services provided by the university hospital
NU6.4 Students’satisfaction rate for
health services
08
Table – 5 Consistency between program KPIs & vision 2030
KPI Code KPIs Vision 2030
objectives
KPI-P.02 Students' Evaluation of quality of learning
experience in the program
Strategic objective
(1&4&5)
KPI-P.04 Completion rate
KPI-P.05 First-year students retention rate
KPI-P.08 The average number of students in the class
KPI-P.10 Students' satisfaction with the offered services
KPI-MED.03 Evaluation of students for academic and
professional guidance
KPI-P.11 The ratio of students to teaching staff
KPI-P.01 Percentage of achieved indicators of the
program operational plan objectives.
KPI-MED.01 The degree of awareness of the beneficiaries
with the mission and objectives
KPI-MED.02 Percentage of courses students evaluated
during the year Strategic objective
(2) KPI-P.03 Students' Evaluation of the quality of the
courses
KPI-P.17 The satisfaction of beneficiaries with the
learning resource
KPI-MED.07 The satisfaction of beneficiaries with facilities
and equipment.
KPI-P.14 Percentage of publications of faculty members Strategic objective
(2&3) KPI-P.15 Rate of published research per faculty member
KPI-P.16 Citations rate in refereed journals per faculty
member
KPI-MED.04 The number of papers (researches) or reports
presented at academic conferences for all
faculty members
KPI-P.06 Students' performance in the professional
and/or national examinations Strategic objective
09
KPI-P.07 Graduates' employability and enrolment in
postgraduate programs within (4&5)
KPI-P.9 Employers' Evaluation of the program
graduate's proficiency
KPI-P.12 Percentage of teaching staff distribution Strategic objective
(4) KPI-P.13 The proportion of teaching staff leaving the
program
KPI-MED.06 Proportion (percentage) of faculty members
engaged in professional development activities
KPI-MED.05 Proportion (percentage) of faculty members
participating in community service activities Strategic objective
(1&5) KPI-MED.08 the satisfaction of beneficiaries with the health
services provided by the university hospital
21
Table – 6 Consistency of program KPIs with, NCAAA KPIs, and Afaaq
KPIs
No KPI code KPI program of medicine and surgery NCAAA
KPIs
Afaaq
KPIs
1 KPI-P-01 Percentage of achieved indicators of the program operational
plan objectives.
KPI-P-01
2 KPI-P-02 Students' Evaluation of quality of learning experience in the
program
KPI-P-02 A8.2
3 KPI-P-03 Students' Evaluation of the quality of the courses KPI-P-03 A8.2
4 KPI-P-04 Completion rate KPI-P-04 A3.1
5 KPI-P-05 First-year students retention rate KPI-P-05
6 KPI-P-06 Students' performance in the professional and/or national
examinations
KPI-P-06
7 KPI-P-07 Graduates' employability and enrolment in postgraduate
programs within
KPI-P-07 A2.3
8 KPI-P-08 The average number of students in the class KPI-P-08
9 KPI-P-09 Employers' Evaluation of the program graduate's proficiency KPI-P-09 A7.1
10 KPI-P-10 Students' satisfaction with the offered services KPI-P-10 A7.2
11 KPI-P-11 The ratio of students to teaching staff KPI-P-11 A4.2
12 KPI-P-12 Percentage of teaching staff distribution KPI-P-12 A5.1
13 KPI-P-13 The proportion of teaching staff leaving the program KPI-P-13 A5.3
14 KPI-P-14 Percentage of publications of faculty members KPI-P-14 A10.1
15 KPI-P-15 Rate of published research per faculty member KPI-P-15 A12.2
16 KPI-P-16 Citations rate in refereed journals per faculty member KPI-P-16 A12.4
17 KPI-MED.6 Proportion (percentage) of faculty members engaged in
professional development activities
A8.1
18 KPI-P-17 The satisfaction of beneficiaries with the learning resource KPI-P-17
20
Table – 7 Program KPIs according to its type
NO KPI code KPI program of medicine and surgery Type
1 KPI-P-01 Percentage of achieved indicators of the program operational plan
objectives.
Productivity
2 KPI-MED.01 The degree of awareness of the beneficiaries with the mission and
objectives
Quality
3 KPI-P-02 Students' Evaluation of quality of learning experience in the program Quality
4 KPI-MED.02 Percentage of courses evaluated by the students during the year Quality
5 KPI-P-03 Students' Evaluation of the quality of the courses Quality
6 KPI-P-04 Completion rate Productivity
7 KPI-P-05 First-year students retention rate Efficiency
8 KPI-P-06 Students or graduates who were successful in the professional and / or
national examinations
Efficiency
9 KPI-P-07 Graduates' employability and enrolment in postgraduate programs Productivity
10 KPI-P-08 The average number of students in the class Efficiency
11 KPI-P-09 Employers' Evaluation of the program graduate's proficiency Efficiency
12 KPI-P-10 Students' satisfaction with the offered services Quality
13 KPI-MED.03 Evaluation of students for academic and professional guidance Quality
14 KPI-P-11 The ratio of students to teaching staff Efficiency
15 KPI-P-12 Percentage of teaching staff distribution Efficiency
16 KPI-P-13 The proportion of teaching staff leaving the program Efficiency
17 KPI-P-14 Percentage of publications of faculty members Productivity
18 KPI-P-15 Rate of published research per faculty member Productivity
19 KPI-P-16 Citations rate in refereed journals per faculty member Effectiveness
20 KPI-MED.04 The number of papers (researches) or reports presented at academic
conferences for all faculty members
Productivity
21 KPI-MED.05 Proportion (percentage) of faculty members participating in community
service activities
Effectiveness
22 KPI-MED.06 Proportion (percentage) of faculty members engaged in professional
development activities
Effectiveness
23 KPI-P-17 The satisfaction of beneficiaries with the learning resource Efficiency
24 KPI-MED.7 The satisfaction of beneficiaries with facilities and equipment Safety
25 KPI-MED.08 The satisfaction of beneficiaries with the health services provided by
the university hospital
Efficiency
22
Important links
NCAAA KPIs for program accreditation:
Afaaq higher education strategy:
SAUDI ARABIA Vision 2030:
Prepared by:
DR. OSMAN TAGALSIR DR. SOHEIR SOLIMAN DR. ABD ELRAHEEM ALMHBOUB
Supervisor of Supervisor of Chairman of
Development and quality unit Development and quality unit The Performance Measurement
Boys' section Girls' section Committee