8
Performance Evaluation of National R&D Program in Korea AEA Annual Conference Nov. 13, 2009
Performance Evaluation ofNational R&D Program in Korea
Performance Evaluation ofNational R&D Program in Korea
AEA Annual ConferenceNov. 13, 2009
1. Purpose of R&D Performance Evaluation
Analyzing a whole process such as 「 Planning-
Implementation-Result-Utilization 」 in line with
strategic goals and indicators of national R&D
program
To improve the outcome and induce efforts of researchers `
To enhance the efficiency and effectiveness of national R&D
investment 2
Purpose
Focus
Emphasis
1999 2005 2008 …
-Special Law for S&T Innovation (1997)
- S&T Framework Law- Law on Performance Evaluation and Performance Management of National R&D Program(2006)
- Law on Performance Evaluation and Performance Management of National R&D Program(2006) - National Finance Law (2008)
3
2. Historical Perspective in KOREA
※ NSTC : National Science & Technology Council / MOSF : Ministry of Strategy & Finance
MEST:Ministry of Education, Science and Technology/ MKE :Ministry of Knowledge Economy
NRF : National Research Foundation
3. Structure of S&T Administration System
President
NRF
MKE OthersMOSF MEST
KISTEP KIAT, KEIT Agencies
Main Bodies of R&D(Research Institutions under Research Council, Private Companies, Universities, etc.)
NSTC
4
4. R&D Management Process
Planning R&D Planning R&D ProgramProgram
R&D R&D Program Program MgtMgt
Program Program EvaluationEvaluation
Budget Budget AllocationAllocation
Application ofApplication ofresultsresults
<NSTC><NSTC>NationalNational
R&DR&DMgt.Mgt.
Research Analysis
MonitoringBudget
Outcome planning
NSTC
Planning & Coordinating
MOSF
Budget Allocation
Program Evaluation
MEST, MKE, etc
Planning R&D Program
R&D Program
Management
KISTEP
Supporting Whole
Process,
including NSTC’s Roles5
5. National R&D Program Evaluation System
Feasi-bility
Analysis
Specific -
Eval.(In-
depthEval.)
Follow upEval.
Self-Eval.
Meta-Eval.
Self-Eval.
Meta-Eval.
Self-Eval.
Meta-Eval.
Endyear
Evaluation-
depth
Start + 1year +3year +3year
Section Feasibility Analysis
Self -Eval./Meta -Eval. Specific(In-depth) Eval. Follow-up Eval.
Organization
MOSF MOSF(NSTC) MOSF(NSTC) MOSF(NSTC)
Actor KISTEP (Self-Eval.) each Ministry(Meta-Eval.) KISTEP
KISTEP (Self-eval.) Each Ministry(Meta-eval.) KISTEP
TargetNewly proposed
ProgramOn going Program
(triennial)
Programs for which the self- evaluation result
indicates the necessity of additional in-depth
evaluation
Terminated Program
Purpose Feasibility(technology, policy & economic)
Performance evaluation & performance management
Relevance of structure, Effectiveness, etc.
Impact assessment
Uses Making decision Coordinate budget allocation Recommendation to program ministries
Consult to another program planning
Report Each Ministry/MOSF
NSTC/OGPC NSTC NSTC
Ex-ante Ex-postMonitoring Monitoring
6
Session Agenda
1. Reformation of National R&D Program Evaluation System
Mr. Woo Chul Chai
1. Reformation of National R&D Program Evaluation System
Mr. Woo Chul Chai
2. In-depth Evaluation of R&D Program in Korea
Dr. Seung Jun Yoo
2. In-depth Evaluation of R&D Program in Korea
Dr. Seung Jun Yoo
3. Evaluation of National Science and Technology Innovation Capacity
Mr. Seung Ryong Lee
3. Evaluation of National Science and Technology Innovation Capacity
Mr. Seung Ryong Lee
4. The Effect of Institutional Evaluation System of GRIs on the Receptivity of Evaluation Result and the Performance of GRIs Dr. Soon Cheon Byeon
4. The Effect of Institutional Evaluation System of GRIs on the Receptivity of Evaluation Result and the Performance of GRIs Dr. Soon Cheon Byeon
Discussion Discussion
7
