1

Punang AmaripujaMuhammadiyah University of Yogyakarta

p_amaripuja@yahoo.com

Higher Education Quality Assurance in Indonesia

Muh

amm

adiy

ah U

nive

rsity

of Y

ogya

karta

t

2

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

General Context

• Enormous population base (+/- 220 M)• Scattered through 16.000 islands

– Limited physical infrastructure in outer islands

– Low access to communication lines• Java centric

– Human capital– Knowledge base

3

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Education in General• Pre-Elementary: 1-2 years, optional• Elementary: 6 years (compulsary)• Junior High: 3 years (compulsary)• High School: 3 years

– General– Vocational

• Higher Education:– General (Universities, 4 yrs)– Vocational (Academies, Polytechnics, 2-3 yrs)

• Others:– Informal– Non Formal

4

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Current Issues in Education

• Ammended Constitution orders 20% of National Budget for Education (not including salaries, etc.), while current budget is only 11% outruled by Constitutional Court

• Certification of Teachers and Lecturers with up to 3x current salaries

• Some state universities converted to State Owned Education Corporations

5

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Some Facts on Education

Institutions Students Teachers

Kindergarten 47,937 1,985,749 254,531

Primary School 1,089 29,092,130 1,490,948

Junior Secondary

32,966 9,586,753 749,571

Senior Secondary

17,329 6,175,528 480,564

Higher Education

2,589 4,001,191 208,181

(Directorate General of Higher Education, 2005)

6

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaNUMBER OF TEACHERS

BASED ON EDUCATION IN 2007

GRADUATE OF

EMPLOYMENT STATUSTOTAL %

GOV’MT PRIVATE

HIGH SCHOOL 288,680 268,813 557,493 24.82%

Diploma 1 34,565 20,792 55,357 2.46%

Diploma 2 532,608 125,270 657,878 29.29%

Diploma 3 85,550 52,214 137,764 6.13%

Bachelor 459,360 368,937 828,297 36.88%

Masters 7,379 1,743 9,122 0.41%

Ph.D 13 28 41 0.002%

TOTAL 1,408,155 837,797 2,245,952 100.00%

7

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia9

S-3Sp

876 S-254 D-4

S-13D-32 D-21 D-1

Indonesian tertiary educations qualifications framework

8

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Number of HE Students

Description QuantityPopulation aged 19-24 24,901,100

Total HE Students 3,550,485

Public Univ Students 937,510

Private Univ Students 2,099,383

Departemental Univ 51,539

Islamic Univ 462,053

Gross Enrollment 14.26%

9

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaGovernment Support for Private Universities

• Competitive Research Grants• Competitive Departmental & University Level Grants• Competitive University Unit level Grants• The grants are competed between public and private universities• Some private university lecturers (and teachers) become

government officials• Both public and private univ lecturers are licensed and promoted

through the Ministry of Education• Certification of public and private university lecturers• Domestic Scholarships

10

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Ministry of Education Strategic Plan

VisionA Smart and Competitive Indonesia

MissionEstablish and education system that could

develop a smart and competitive Indonesia which is just, qualified, and relevant with

the needs of the local and global community Strategic Policy

• Equity and Extension of Access • Quality, Relevance, and

Competitiveness• Governance, Accountability, and Public

Image

11

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Targets of the DGHE

2005 -2010Capacity building and modernization

2010 - 2015Services Improvement

2015 - 2020Regional Competitiveness

2020 - 2025International Competitiveness

12

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaIndonesian Higher Education Vision Indonesian Higher Education Vision

2010 2010 On 1 April 2003 the DGHE has proclaimed On 1 April 2003 the DGHE has proclaimed HELTS HELTS

2003 - 20102003 - 2010 (the (the Higher Education Long Term Higher Education Long Term Strategy 2003 – 2010)Strategy 2003 – 2010)

Which incorporates the Indonesian Higher Which incorporates the Indonesian Higher Education Vision:Education Vision:

In order to contribute to the nation’s In order to contribute to the nation’s competitiveness, the national higher education competitiveness, the national higher education

has to be organizationally healthy, and the same has to be organizationally healthy, and the same requirement also applies to institutions. A requirement also applies to institutions. A

structural adjustment in the existing system is, structural adjustment in the existing system is, however, needed to meet this challenge. The however, needed to meet this challenge. The

structural adjustment aims, by the year of 2010, structural adjustment aims, by the year of 2010, of having a healthy higher education system, of having a healthy higher education system,

effectively coordinated and demonstrated by the effectively coordinated and demonstrated by the following features : following features :

• QualityQuality• Access and EquityAccess and Equity

• AutonomyAutonomy

13

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaStrategic IssuesStrategic Issues

in the in the HELTS 2003 - 2010HELTS 2003 - 2010

One of the One of the strategic issuesstrategic issues described in the described in the HELTS 2003 – 2010 HELTS 2003 – 2010 point E is point E is Quality Quality

Assurance Assurance as stated belowas stated below ::

In healthy organizations, continuous quality In healthy organizations, continuous quality improvement should become its primary improvement should become its primary

concern. Quality assurance should be concern. Quality assurance should be internally driven, institutionalized within each internally driven, institutionalized within each organization’s standard procedure, and could organization’s standard procedure, and could also involve external parties. However, since also involve external parties. However, since quality is also a concern of all stakeholders, quality is also a concern of all stakeholders,

quality improvement should aim at producing quality improvement should aim at producing quality outputs and outcomes as part of public quality outputs and outcomes as part of public

accountability.accountability.

14

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

The New ParadigmThe New Paradigm

Autonomy

Assurance/Evaluasi

AccreditationAccountability

Quality

The purpose of evaluation is not to prove but to improve.

(Stufflebeam et al., Educational Evaluation and Design Making, 1997)

15

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaThe Definition of

Higher Education Quality Assurance

Higher Education Quality Assurance is the process of defining and fulfillment of

Higher Education Quality Management Standards in a consistent and sustainable

manner in order to satisfy all its stakeholders (students, parents, industry,

government, lecturers, supporting staff, and other relevant parties)

16

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaMechanism for identifyingMechanism for identifying

HE Quality StandardsHE Quality Standards

StakeholderStakeholderNeedsNeeds

VisionVision

StandardsStandards

• Recruitment• Probation period• Permanent staff status• Work performance appraisal• Mutations, Promotions, Demotions• Work schedules• Overtime and paid leave• Compensations and Rewards• Social security and welfare• Development and trainings• Work health and safety• Discipline• Field work compensation• Work separations

This example assumes that all HE Institutions are Educational Legal Bodies

17

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

HE Quality Assurance Structure

Self Self EvaluationEvaluation Program EvaluationProgram Evaluation

(Self Evaluated)(Self Evaluated)

InternalInternalQuality AssuranceQuality Assurance

ExternalExternalQuality AssuranceQuality Assurance

Higher EducationHigher Education

EPSEPSBEDBED

IQAIQA

Accredi-Accredi-tationtation

18

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaSustainable Higher EducationSustainable Higher Education

Quality Assurance ActivitiesQuality Assurance Activities

ACTIVITYACTIVITY GOALGOAL STATUSSTATUS INSTITUTIONINSTITUTION

ACREDITATIONACREDITATION

SELF EVALUATEDSELF EVALUATEDPROGRAM EVALUATIONPROGRAM EVALUATION

(EPSBED)(EPSBED)

INTERNALINTERNALQUALITY ASSURANCEQUALITY ASSURANCE

External HE External HE Quality ControlQuality Control

and Audit and Audit

CompulsaryCompulsaryExtension ofExtension ofOperational PermitOperational Permit

InternalInternalimprovementimprovementof HE Qualityof HE Quality

FacultativeFacultative(optional)(optional)

HE National HE National Acreditation BoardAcreditation Board

BAN – PT BAN – PT and / or othersand / or others

Directorate GeneralDirectorate Generalof Higher Educationof Higher Education

Self InnitiatedSelf Innitiated HE InstitutionHE Institution

19

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaOverview ofHE Quality Assurance

8 Minimal Standard

(NED)

Other standards(above the National Education Standard)

Compul-sary

Internally Driven(HELTS)

1. Content 2. Process 3. Graduate Competence 4. Academic staff 5. Infrastructure 6. Operations 7. Financial 8. Academic Appraisal

1. Community services2. Information Systems3. Alliances & Cooperations4. Student affairs5. Academic atmosphere6. Financial resources7. Others (Inst. based)

HE Quality Assurance

A Smart and Competitive

Indonesia

T.Frame2015 2020 2025

20

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaStandards Improvement StrategyStandards Improvement Strategy

Hig

her

Educ

atio

n

2006 2007 2008 2009 2010 2015

Surpass NES, AUN Quality

Label,Acquire

AUN Standard

ASSISTANCE

ASSISTANCE

INDEPENDENCY

2020 2025

Acquire AUN Standard

100 best in Asia / World

AcquireInternasional

Standard100 best in Asia / World

REGIONAL INTERNASIONAL

INTERNAL QUALITY ASSURANCE

EXTERNAL QUALITY ASSURANCE / ACCREDITATION (HE-NAB)

LAW OBEDIENCY

100

NASIONAL

21

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaQuality Assurance ProcessQuality Assurance Process

a. The HE Institution defines its a. The HE Institution defines its visionvision and and missionmission

b. Every program defines its b. Every program defines its visionvision and and missionmission based on the institution’s vision and missionbased on the institution’s vision and mission

c. The program’s vision is broken down into a set c. The program’s vision is broken down into a set of quality standardsof quality standards

d. The HE Institution sets the organization and d. The HE Institution sets the organization and mechanism of quality assurancemechanism of quality assurance

e. The HE Institution implements quality e. The HE Institution implements quality assurance through quality control assurance through quality control managementmanagement

f. The HE Institution evaluates and revises its f. The HE Institution evaluates and revises its quality standard through ongoing quality standard through ongoing benchmarkingbenchmarking

22

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Self Evaluated Items (LRAISE)

Leadership

RelevanceEnvironmental sensitivityGraduate qualityIndustry acceptance

Academic AtmosphereLecturer – student, lecturer – lecturer,& student - student interactionsSOP Discipline

Internal Management & OrganizationDecision making processesBudget prioritiesInternal and external evaluations

SustainabilityAssure institutional existanceAssure quality levelResources

Efficiency and ProductivityLength of study, length of thesis, etc.Ability to produce good output

23

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Self Evaluation Report

SummaryI. Self Evaluation ProcessII. Background

a. Department & Program History b. Long Term Development Plans c. External Environment

III. Academis Program Evaluationa. Educationb. Researchc. Community Servicesd. Quality Assurance Programs

IV. Management of Resources a. Financial Managementb. Human Resources Management

c. Physical Facilities Management1. Infrastructure (Buildings)2. Laboratories3. Libraries

d. Data and Information Management

V. Departmental Performance Indicators a. Primary Performance Indicators b. Supporting Performance Indicators

VI. Identified ProblemsVII. Alternative SolutionsVIII. Appendix

24

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaNATIONAL ACCREDITATION SYSTEM (Current)

Ministry of Education

HE-National Accreditation Board

HE Institution A HE Institution B

P 1 P 3 P 4P 2 P W P X P Y P Z

ACCREDITATION

25

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaNATIONAL ACCREDITATION SYSTEM (Alternate)

Ministry of Education

HE-NAB

HE Institution A HE Institution B

ASSOCATION OF HEI

Program Accreditation

ACCREDITATION

P 1 P 3 P 4P 2 P W P X P Y P Z

26

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Goals of AccreditationProtect the communityAssist Quality Assurance of HE InstitutionsPublic Accountability of HEIStandardization of academic credit to allow student

mobilizationBasis for accreditation / licenseConsideration for grantsConsideration for employee recruitment International recognition of certificate / competence Input for meta-evaluation of HE quality

27

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Scope of Accreditation

• Quality Control : – System and mechanism to assess

comlpiance with performance indicators

• Quality Audit: – Appraisal of internal Quality Control

mechanisms• Quality Assessment:

– System efficiency and effectiveness

28

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaWho is responsible for HE Quality?

• HE Institutions• Association of HEI

(self regulation) • Directorate General of HE• HE National Accreditation

Board

29

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

Functions of the HE-NAB

• Prepare organization• Formulate technical policy• Setup appraisal criteria• Collect data• Operate appraisals• Determine accreditation• Publish accreditation certificates• Announce accreditation results• Give recommendation for supervision• Assist self evaluation of HE Institutions• Periodic reports to the Ministry of Education

Kepmendikbud 187/U/1998

30

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

TYPE OF INSTIT-UTIONS

LEVEL OF ACCREDITATION

ACCRE-DITED

D-3 STUDY PROGR

AMS

NUMBER OF D-3

STUDY PROGR

AMS

ACCREDITED D-3 FROM TOTAL

D-3 STUDY

PROGRAMS

A B C DState

Univer-sities

1210.6%

5851.4 %

3934.5 %

43.5 %

11316.2 %

46417.0 %

24.4 %

Private Univer-sities

438.9 %

20943.5 %

21845.3 %

112.3 %

48189.4

%2013

73.9 %23.9

%Institute

for Religiou

s Studies

00 %

00 %

00 %

00 %

00 %

441.6 % 0 %

ServiceInstitute

s0

0 %7

50.0 %

750.0 %

00 %

142.6 %

2047.5 % 6.9 %

TOTAL559.0 %

27445.1 %

26443.4 %

152.5%

608 2725 22.3 %

Accreditation results of Diploma (D-3) programs (25 Aug 2004)

31

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

TYPE OF INSTIT-UTIONS

LEVEL OF ACCREDITATION

ACCRE-DITED

S-1 STUDY

PROGRAMS

NUMBER OF S-1

STUDY PROGRA

MS

ACCREDITED S-1 FROM

TOTAL S-1 STUDY PROGRA

MSA B C DState

Univer-sities

30723.0

%

69752.1

%

31723.7

%

161.2 %

133725.7 %

180525.2 % 74.1 %

Private Univer-sities

266 8.0 %

1537

46.3 %

1364

41.1 %

1524.6 %

331963.3 %

424661.6 % 78.2 %

Institute for

Religious

Studies

469.3%

25050..6 %

15731.8

%

418.3 %

4948.4 %

80712.7 % 61.2 %

ServiceInstitute

s

38.3 %

1455.6

%

1033.3

%

02.8 %

270.6 %

370.6 % 73.3 %

TOTAL62212.0

%

2498

48.3 %

1848

35.7 %

2094.0 %

5177 6895 75.1 %

Accreditation results of S-1 programs (25 Aug 2004)

32

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

TYPE OF

INSTIT-UTIONS

LEVEL OF ACCREDITATION

ACCRE-DITED

S-2 STUDY PROGR

AMS

NUMBER OF S-2

STUDY PROGR

AMS

ACCREDITED S-2 FROM TOTAL

S-2 STUDY

PROGRAMSA B C D

State Universi

ties

1527.8 %

2648.1 %

1324.1 %

00 %

5457.4 %

37869 %

14.3 %

Private Univer-sities

37.5 %

1435.0 %

1845.0 %

512.5 %

40445.1

%13625 %

29.4 %

Institute for

Religious

Studies

00 %

00 %

00 %

00 %

00 %

377 % 0 %

ServiceInstitute

s0

0 %0

0 %0

0 %0

0 %0

0 % 0 0 %

TOTAL1819.1 %

4042.6 %

3133.0%

55.3 %

94 551 17.1 %

Accreditation results of S-2 programs (Jan 2003 - Aug 2004)

33

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaKOPERTIS (Coordinator of Private HE Institutions)

• There are 12 regional offices covering all provinces

• Their functions include:– Implement supporting policies towards private HE

institutions in its jurisdiction– Support implementation of the three HE services– Support resources to private HE institutions– Technical guidance and support to private HE

institutions

34

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaHE SystemProblems and Constraints

• Immature system• Wide variety in stage of

development of institutions and programs

• Wide variety of quality within programs in different institutions

• Wide variety of quality between programs within institutions

35

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaHE Quality AssuranceProblems and Constraints

• Lack synchronization between internal HEI system and data and external requirements (Self Evaluation, NAB, Competitive Grants)

• Limited awareness of HEI senior officials towards the impotance of accurate and complete data collection

• Limited data utilization in the decision making process

36

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaAccreditation Problems & Constraints

• Huge number of programs• Limited number of experts• Limited number of reviewers• Limited funding

37

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

siaPROBLEMS IN COMPILATION OF SELF EVAL, NAB, AND QA DATA

1. Data spread out over several units and levels2. Different data codification and stratification

in each unit and HEI3. Different content and format between Self

Eval, NAB, and HE-QA data4 Limited use of data in planning of HEI5 Underutilization of existing units for data

collection6 Underutilization of Self Evaluation data for

planning in HEI

38

High

er E

duca

tion

Qual

ity A

ssur

ance

in In

done

sia

References• Badan Akreditasi Nasional Perguruan Tinggi, DGHE of MOE,

Akreditasi Dalam Uu Sistem Pendidikan Nasional (Uu No. 20/2003)

• DGHE-MOE, Kebijakan Nasional Sistim Penjaminan Mutu Perguruan Tinggi (Spm-pt), “Sub Tema: Sinkronisasi Sistim Penjaminan Mutu Internal (Spm-pt), Epsbed Dan Penjaminan Mutu Eksternal (Akreditasi)

• Gunawan, J. Pedoman Penjaminan Mutu (Quality Assurance) Pendidikan Tinggi

• M. K. Tadjudin, Capacity Building In Quality Assurance And Accreditation In Higher Education In The Asia Pacific Region

• Rapat Kerja Wilayah Pimpinan Perguruan Tinggi Swasta (Pts) Rapat Kerja Wilayah Pimpinan Perguruan Tinggi Swasta (Pts) (2006), (2006), Kebijakan Nasional Spm-pt Untuk Sinkronisasi Sistem Penjaminan Mutu Internal (Spmpt), Penjaminan Mutu Eksternal (Akreditasi) Dan Perijinan (Epsbed)