Post on 23-Jan-2016
description
transcript
1Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
The Programme for Research in Third Level Institutions
(PRTLI):
An Irish Experience
2Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Presentation
Focus of presentationBrief description of PRTLIKey Guiding Principles for recent
PRTLI Impact AssessmentThe Impact Assessment ProcessClosing Remarks
3Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Evaluation
Ex-AnteMonitoringEx-PostEx-AnteMonitoringEx-PostMonitoring
Project level
Programme Level
Research System
4Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Objectives
5Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
To enable a strategic and planned approach by third-level institutions to the long-term development of their research capabilities...,
so as to enhance the quality and relevance of graduate output and skills…..
to encourage co-operation between researchers both within the institutions and between institutions….
6Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
PRTLIDISTINGUISHING
FEATURES(NDP funded)
PRTLIDISTINGUISHING
FEATURES(NDP funded)
COUNTERPART FUNDING
INSTITUTIONAL STRATEGY FOCUS
ALL DISCIPLINES
SCALE / RESOURCES; €605M
PROGRAMMES (€202m) INFRASTRUCTURE (€403m)
ENHANCED EDUCATION
EVALUATION
7Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Addressing National Sectoral Needs% Total Allocation/Euros funding to date
•Biosciences/Biomedical 48% 294m(INCL. Food and Health Science, & Neuroscience)
•Platform Technologies & Materials 14% 87m(INCL. Chemical & Physical sciences)
•Environment/Marine 11% 63m •ICT/Advanced Communications 10% 60m
•Social Science/Humanities 8% 46m
•Research Resources/Libraries 9% 54m
8Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
TO DATE…..
•Funding of >60 research programmes
•17 Research Centres & 1 national library completed 33 Centres/Institutes to be established 99, 000m2 new purpose-built research space
•Human capital - approx. 450 postdocs - approx. 1000 postgrad.
students
9Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Higher Education AuthorityAn tÚdarás um Ard-Oideachas
HEA
Monitoring and Evaluation
11Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
OUTCOMES - FOR
INSTITUTIONS
STRATEGIC PLANNING
INTER-INSTITUTIONAL CO-OPERATION
LEADERSHIPCHALLENGE
RESPONSE
PROCESSES
PRIORITISATION
SELECTION
SPILL-OVER
RESEARCHTEACHING
LEARNING
12Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
OUTCOMES - NATIONALLY
RESEARCH ACTIVITY
MULTI-DISCIPLINARY RESEARCH
RESEARCH CENTRES
QUANTUM
INCREASE
STRENGTHENED
NEW
HUMAN CAPITAL
13Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Independent International PRTLIImpact Assessment
•Additional to ‘routine’ monitoring
•Initiated October 2003
•Five years post programme launch
•Approx. 4 years since initiation of flow of funds
14Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Informing Principles for Selection of Steering Committee
Independence of Steering Committee International Experience Reputation
Composition of Steering Committee In broad terms, representation of disciplines Geographical balance Gender balance
15Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Steering Committee Composition
Prof. E. Banda Secretary General ESFFormer Secretary General for Universities and Research, Spain
Prof. R. Vihko President of the Academy of Finland
Prof. J. Morrill British & Irish History, Cambridge UK.Arts and Humanities Council
Prof. L. Resnick Prof. Of Psychology, Director ofthe Institute for Learning, Univ.of Pittsburgh, USA.
16Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
ProcessIndependence
No engagement in evaluation by HEA Executive or Authority
Appropriate Tools Diversity of tools Facilitation of engagement with all stakeholders Horizontal and vertical probing
Real and Meaningful Indicators Programme characteristics Stage of life cycle Stakeholder diversity….requirements ‘Collectable’ and cost effective
17Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Objectives of Assessment
Policy
Progress
Management
To address the broader policy issues including
role of PRTLI in funding of research core
capacity
To assess the progress of the programmes
funded to date
To ascertain whether the objectives of the PRTLI
scheme are being met
To Capture implications for future programmes
To Capture implications for wider society
To monitor the level of adherence to
documented plans
To assess the administration of the programme
by the HEA executive
Scope of Assessment
Commencement of the PRTLI scheme - to end December 2003
Snap shot at a point in time in a dynamic process …
The heterogeneity of programmes taken into account….
The Assessment to include many elements of final review of Cycle 1….
19Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Teaching & Learning
Visiting Experts
Specialists In T&L
Research
Visiting Experts
Researchers
Peer review
Institutional Strategy &
Management
Members of SC
Collaboration
Policy Review
Steering Committee Independent
Secretary/
Rapporteur
Support from Indecon International Economic Consultants
Support from CIRCA Europe Ltd
(Bibliometrics CWTS/Van Raan Leiden)
Bibliometrics
20Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Research &Teaching/LearningSix-Monthly Report Analysis
All reports for all programmes – by Research Consultants
Site Visits 19 sites/~30 programmes
3 international experts per site visit
Tours of facilites
Interviews: Centre/Programme Director; Heads of Department(s); Tenured academic staff ; post-doc researchers; post-grad students; undergraduate students
21Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Research
Bibliometrics CWTS (Leiden, Prof.
Van Raan) Comparison of Pre-
PRTLI and ‘during’ PRTLI
Random selection of 200 researchers from HEA database by CWTS
Global/broad discipline analysis
Peer Review Output of Centres /
Programmes as above Humanities, Social
Sciences Centres / Programmes
2-7 peers : range of papers
International context
22Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Research & Teaching/Learning Indicators
Research
Equipment, specialised facilities etc.
Scale of Research Activities /Output
Teaching & Learning (UG & PG)
Activity/processes
Content (Courses, format etc)
Collaboration
Joint Initiatives
23Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Strategy and Policy ReviewSteering Committee:
Meetings with Presidents/Directors of HEIs (Successful and un-successful PRTLI applicants) – on site visits
Meetings with a range of government departments/public bodies
Meetings with leading industry figures and representatives of industry
Submissions from a range of organisationsStrategy/management Indicators and
benchmarking with pre-initiation of PRTLI; international comparisons.
24Higher Education Authority
An tÚdarás um Ard-Oideachas
HEA
Conclusions
………….