Introduction
Methods
Results
Conclusions and Implications
2
In 2007, introduce the sunset periodIn 2007, introduce the sunset period
National Technical Qualifications(NTQ) of KoreaNational Technical Qualifications(NTQ) of Korea
☞ ☞ Legal basic of NTQs: the National Technical Qualification ActLegal basic of NTQs: the National Technical Qualification Act
InIn 1973, enacting and declaring legal basics for NTQs1973, enacting and declaring legal basics for NTQs
3
I. Introduction
In 2010, operating 512 NTQsIn 2010, operating 512 NTQs
☞ ☞ 481 NTQs in technical skills fields, 31 NTQs in service and clerical fields.481 NTQs in technical skills fields, 31 NTQs in service and clerical fields.
☞ ☞ 25 job areas, 114 sub job areas25 job areas, 114 sub job areas
Current Levels of NTQs Current Levels of NTQs in the technical skills fieldsin the technical skills fields
Levels in service and clerical fields consist 1~3 or 1~2Levels in service and clerical fields consist 1~3 or 1~2
Assessment criteria / sunset periodAssessment criteria / sunset period
4
I. Introduction
Assessment criteria Assessment criteria
☞ ☞ Each of the NTQs has the assessment criteria except certificate of professional engineerEach of the NTQs has the assessment criteria except certificate of professional engineer ※ ※ certificate of professional engineer has covered all range of techniccertificate of professional engineer has covered all range of technic
☞ ☞ regulated by a law in updating the assessment criteriaregulated by a law in updating the assessment criteria
☞ ☞ a minimal period to updatea minimal period to update
☞ ☞ Each of the sunset period was set up 2~5 yearEach of the sunset period was set up 2~5 year ※ ※ through gathering the opinions of the experts in ‘The assessment criteria development committee’through gathering the opinions of the experts in ‘The assessment criteria development committee’
sunset
period
(years)
levels
totalCraftsman
Industrial
engineer
Engineer
Master craftsm
an
2 - 1 1 - 2
3 10 5 5 2 22
4 18 18 16 6 58
5 152 86 90 20 348
total 180 110 112 28 430
Set up the sunset periodSet up the sunset period
Needs for StudyNeeds for Study
The assessment criteria is played key role in NTQThe assessment criteria is played key role in NTQ
Various efforts to updating the assessment criteriaVarious efforts to updating the assessment criteria
☞ ☞ It has been five years since the sunset period system was introducedIt has been five years since the sunset period system was introduced ☞ ☞ the development of the NCS and its employmentthe development of the NCS and its employment ☞ ☞ Technology has been changedTechnology has been changed
circumstantial changes about NTQcircumstantial changes about NTQ
Reviewing the status of using the assessment criteria/Reviewing the status of using the assessment criteria/Developing new update scheme for Assessment criteriaDeveloping new update scheme for Assessment criteria 5
I. Introduction
☞ ☞ The assessment criteria indicate the range of subject assessmentThe assessment criteria indicate the range of subject assessment ☞ ☞ regulation to develop assessment criteria for the enactmentregulation to develop assessment criteria for the enactment ☞ ☞ revision of the each qualification in accordance with the National Technical Qualifications Lawrevision of the each qualification in accordance with the National Technical Qualifications Law
☞ ☞ set up the sunset period set up the sunset period in each assessment criteria to improve field suitability of the criteriain each assessment criteria to improve field suitability of the criteria
☞ ☞ the job analysis the job analysis is carried out by field specialists in developing the assessment criteria, and since 2005 is carried out by field specialists in developing the assessment criteria, and since 2005
the employment of the employment of the NCS the NCS was expanded.was expanded.
MethodsMethods
II. Methods
6
Analysis Analysis
☞ ☞ literature reviewliterature review - precedent studies- precedent studies on the assessment criteria, on the assessment criteria, policy documentspolicy documents and and statistical resourcesstatistical resources
☞ ☞ interviewinterview - for figure out the actual condition- for figure out the actual condition - six staffs in HRD Korea(which was in charge of assessment), two specialists for developing the assessment criteria - six staffs in HRD Korea(which was in charge of assessment), two specialists for developing the assessment criteria and two exam writers.and two exam writers.
☞ ☞ surveysurvey - for find out the suitability of assessment criteria sunset period by types- for find out the suitability of assessment criteria sunset period by types - complete enumeration(The assessment criteria development committee member)- complete enumeration(The assessment criteria development committee member)
comprised of 52 groups in total with 10 members in each areacomprised of 52 groups in total with 10 members in each area
Development Development
☞ ☞ developing the draftdeveloping the draft - prepared through the examinations of precedent studies and related law and through the result of current status analysis - prepared through the examinations of precedent studies and related law and through the result of current status analysis
and investigation researchand investigation research ☞ ☞ examine the field suitability / applicabilityexamine the field suitability / applicability - - three staffs in HRD Korea, two specialists for developing the assessment criteria and two exam writers.three staffs in HRD Korea, two specialists for developing the assessment criteria and two exam writers.
Usage status of the Assessment criteriaUsage status of the Assessment criteria
III. Results
7
Using the job analysis, resources from the NCS
But, confusion of terms as the forms and names of item were different
ex) C.A use the terms likes key item, sub item and detailed sub item
J.A, NCS use the terms likes competency unit, competency unit element and key item respectively
Development of Assesment CriteriaDevelopment of Assesment CriteriaDevelopment of Assesment CriteriaDevelopment of Assesment Criteria
four or five times questions are made to be stocked in the item pool → the questions are
selected and verified from the item pool to perform an examination
Lack of the sufficient information about the level of difficult and field suitability for exam
writer
※ 73.7% of the exam writer is academic expert
Development of the exam questionsDevelopment of the exam questionsDevelopment of the exam questionsDevelopment of the exam questions
The evidence for selecting the sunset period is not enough
suitability of sunset period : too long(25.7%, especially, IT and materials areas), too
short(7.5%)
requirement to reset the sunset period
reflecting the speed of technical change
Updated status of the Assessment criteria (1)Updated status of the Assessment criteria (1)
III. Results
8
Suitability of sunset period Suitability of sunset period Suitability of sunset period Suitability of sunset period
Same sub job areas: use the same SME pool for updating job analysis and assessment
criteria
Updating at the same time, same areas: ① to prevent the duplication of the A.C
② to achieve the standardization of the terminology
But, 15 areas (13.2%) out of 114 areas had a different sunset period between the areas
The adjustment of the sunset period between A.C in the same sub job areas was
required
Different sunset period between the sub job areasDifferent sunset period between the sub job areasDifferent sunset period between the sub job areasDifferent sunset period between the sub job areas
Revision the A.C in 2008~2010: 195types
※ Due to the expiry of the sunset period: 79.0%
※ A frequent revision: 21.0%
Requirement to frequent revisions
※ the sunset period is a minimal period to update
Updated status of the Assessment criteria (2)Updated status of the Assessment criteria (2)
III. Results
9
Updating the A.CUpdating the A.CUpdating the A.CUpdating the A.C
deviation about the A.C revision deviation about the A.C revision deviation about the A.C revision deviation about the A.C revision
79.0%
21.0%Due to the expiry of the sunset period
A frequent revision
Direction of improvement and new update scheme for Direction of improvement and new update scheme for Assessment criteria(1)Assessment criteria(1)
III. Results
10
reorganization of qualification types for using the NCS
Revision the A.C using the assemble the NCS
※ Every field has its own standard in the future
A scheme to apply the NCS(In updating the A.C )A scheme to apply the NCS(In updating the A.C )A scheme to apply the NCS(In updating the A.C )A scheme to apply the NCS(In updating the A.C )
reset to reflect the speed of technical change, and the sunset period of the same type of
sub job areas
making revision plan (for revising Every year the same number (85~95 types) of the A.C)
Reset the sunset periodReset the sunset periodReset the sunset periodReset the sunset period
the rename of the name of items for use the NCS
※ ex) key item → competency unit
Providing more information(about detailed sub items) to exam writers
the level of difficulty, the level of importance and the level of frequency
Revision of the current A.C forms & name of itemsRevision of the current A.C forms & name of itemsRevision of the current A.C forms & name of itemsRevision of the current A.C forms & name of items
III. Results
11
AA frequentfrequent monitoring system to review the field applicabilitymonitoring system to review the field applicabilityAA frequentfrequent monitoring system to review the field applicabilitymonitoring system to review the field applicability
Revision the A.C
Revision the A.CRequiring change
More than 10%
Sunset period
Restart
The sunset period
Requiring change
less than 10%
통계 DBAssessment
CriteriaAssessment
Criteria
A frequent monitoring(when setting
exam questions)
Direction of improvement and new update scheme for Direction of improvement and new update scheme for Assessment criteria(2)Assessment criteria(2)
A frequent monitoring system to review the field applicability might be introduced
ConclusionsConclusions
IV. Conclusions & Implications
12
The A.C provide accurate information to users, and contain competency to be applicable to the fieldThe A.C provide accurate information to users, and contain competency to be applicable to the field
the A.C must be reviewed frequently and complemented reflecting newly developed technologythe A.C must be reviewed frequently and complemented reflecting newly developed technology
But, less frequent revisions, updates were made obligatory after the expiry of the sunset period.But, less frequent revisions, updates were made obligatory after the expiry of the sunset period.
Necessary to revise the form and items of A.C, reset the sunset period, adopt the frequent update system Necessary to revise the form and items of A.C, reset the sunset period, adopt the frequent update system
ImplicationsImplications
to install a frequent monitoring system working together with the sunset periodto install a frequent monitoring system working together with the sunset period
the NCS resources might be employed positively in the updatethe NCS resources might be employed positively in the update