The outcome of the 2010 TEN-TCalls for Proposals
Anna PanagopoulouTEN-T Executive AgencyHead of Unit –Technical & Financial Engineering, GIS & Monitoring
TEN-T Project Management Workshop, 15-16 February 2011
TEN-T Project Management Workshop15-16 February 2011
2
Outline
• Brief presentation of the 2010 Calls (FAB/ATM, RIS/MoS and Annual Call)
• Main steps of evaluation and selection process • Organisation of the 2010 external evaluation and key
figures• Guiding principles of the external evaluation and the
role of experts • Outcome of the 2010 evaluation/selection exercise• Conclusions
TEN-T Project Management Workshop15-16 February 2011
3
TEN-T Calls 2010
• Multi-Annual Call Functional Airspace Blocks/Air Traffic Management (FAB/ATM) – up to €20 million
• Multi-Annual Call River Information Services (RIS) – up to €10 millionMotorways of the Sea (MoS) – up to €85 million
TEN-T Project Management Workshop15-16 February 2011
4
TEN-T Calls 2010• Annual Call – up to €77 million
For the first time, the Annual Call targeted specific priorities: – Priority 1: Development of an integrated &
environmentally friendly transport system multimodal transport + decarbonisation of transport
– Priority 2: Acceleration/facilitation of TEN-T project implementation studies for all transport modes + works for mature projects notably in the rail and inland waterways sectors + projects supporting the Single European Sky policy
– Priority 3 : Support to Public-Private Partnerships (PPPs)
TEN-T Project Management Workshop15-16 February 2011
5
TEN-T EA was responsible for:• checking the eligibility of the proposals:
- arrived on time, were complete, signed by the applicant, approved by the Member State… - in compliance with EU legislation (environment…), applicants have the financial and technical capacity to carry out the project…
• conducting the external evaluation:- proposals were reviewed independently by at least three external experts- the external experts met in a "consensus meeting" to reach a consensus recommendation and score for each proposal - DG MOVE participated to the consensus meetings
Evaluation and Selection of Proposals Step 1 - External evaluation
TEN-T Project Management Workshop15-16 February 2011
6
DG MOVE was responsible for the:• Internal evaluation and final selection of proposals (with
the assistance of the TEN-T EA), based on the:- recommendations of the external evaluation- available budget, strategic objectives of the calls and the policy relevance of the proposals/EU relevance
• consultation of other EU services (DG Environment, DG REGIO…)
• consultation of:- Financial Assistance Committee (Member States)- European Parliament (one month right of scrutiny)
Evaluation and Selection of Proposals Step 2 - Internal evaluation/Selection
TEN-T Project Management Workshop15-16 February 2011
7
2010 external evaluation exercise “at a glance” (1)
• External evaluation took place between:– 17 and 21 May 2010 for FAB/ATM Call – 27 September and 8 October 2010 (2 weeks) for
MoS, RIS and 2010 Annual Calls• Out of the 126 proposals submitted 2 were not eligible
(no evidence of the submission date, proposal not approved by MS involved)
• Around 56 Agency staff members were directly involved in the external evaluation exercise, from secretaries to IT staff, project managers (as moderators) and evaluation managers
TEN-T Project Management Workshop15-16 February 2011
8
2010 external evaluation exercise “at a glance” (2)
• 37 experts, of which 33 experts from the EC Cordis database and 4 experts from EU Agencies/initiatives (European Maritime Safety Agency- EMSA, European Railway Agency-ERA, European Agency of Competitiveness and Innovation-EACI, European Private Public Partnership Expertise Centre-EPEC) worked individually and in panels of three experts to assess each of the 124 eligible proposals
• The process was examined by an independent observer, whose observations and recommendations are detailed in a report
TEN-T Project Management Workshop15-16 February 2011
9
External evaluation: the process• Individual assessment
Each proposal was assessed independently by at least three external experts
• Consensus meetingThe three experts met in a “consensus meeting" to agree on:→ comments and scores for each of the 4
criteria→ a general recommendation This agreement is reflected in a « consensus form »
TEN-T Project Management Workshop15-16 February 2011
10
External evaluation: 4 blocks of criteria
1. Relevance: contribution of the Action to the TEN-T policyand the objectives of the calls, and EU dimension
2. Maturity of the Action: is the Action ready to go?
3. Impact of the Action: anticipated socio-economic effectsand impact on the environment
4. Quality of the Action: completeness and clarity of theproposal, description of the planned activities, coherencebetween objectives, activities and planned resources,soundness of the project management process
For Annual Call Priority 1b, Priority 3 and MOS, further guidance wasprovided in the Call text on the interpretation of the award criteria
TEN-T Project Management Workshop15-16 February 2011
11
External evaluation: guiding principles
• Objectivity: each proposal shall be evaluated as it is written
• Accuracy: experts’ evaluation shall be made against the official award criteria, and nothing else
• Consistency: the same standards of evaluation shall be applied to all proposals
TEN-T Project Management Workshop15-16 February 2011
12
External evaluation: the role of experts• External experts are at the heart of the evaluation
of proposals under the TEN-T programme
Experts are responsible for the in-depth technical assessment of proposals submitted by the Member States Experts provide independent, impartial and objective recommendations Experts represent neither their employer, nor their country The opinion of external evaluators is the basis for the final selection made at Commission level
TEN-T Project Management Workshop15-16 February 2011
13
External evaluation: proposal scoring under each of the 4 criteria
Experts awarded a score for each of the 4 criteria on a six-point scale from 0 to 5:0 - Insufficient. The proposal fails to address the criterion under examination or cannot be judged due to missing or incomplete information1 - Poor. The criterion is addressed in an inadequate manner, or there are serious inherent weaknesses.2 - Fair. While the proposal broadly addresses the criterion, there are significant weaknesses.3 - Good. The proposal addresses the criterion well, although improvements could be made.4 - Very good. The proposal addresses the criterion very well, although certain improvements might still be possible.5 - Excellent. The proposal successfully addresses all relevant aspects of the criterion in question. Any shortcomings are minor.
Proposals scoring <3 points for one or more of the four criteria are not recommended for funding
TEN-T Project Management Workshop15-16 February 2011
14
Overview of the results of the external evaluation of the 2010 Calls
TEN-T Project Management Workshop15-16 February 2011
15
Internal evaluation An Internal Evaluation Panel composed of representatives of DGMOVE, TEN-T EA and DG ENV reviewed each proposal individuallyto:
– consider each proposal in view of the TEN-T objectives, priorities and restrictions, as defined in the TEN-Guidelines, the work programmes and the call texts
– cut any costs and/or activities that would be not eligible or not recommended for funding
– recommend a selection of proposals for funding
TEN-T Project Management Workshop15-16 February 2011
16
Inter-service consultation
The proposed selection of projects for funding was then reviewed and agreed by other DGs, in particular:
- DG ENV- DG BUDG- DG REGIO
TEN-T Project Management Workshop15-16 February 2011
17
Overview of the results of the 2010 MAP Calls evaluation/selection
TEN-T Project Management Workshop15-16 February 2011
18
Overview of the results of the 2010 MAP Calls evaluation/selection
TEN-T Project Management Workshop15-16 February 2011
19
Overview of the results of the 2010 Annual Call evaluation/selection
- Priority 1: Promoting the development of an integrated and environmentally friendly transport system – 13 projects selected, €32.1 million in funding
- Priority 2: Accelerating/facilitating the implementation of TEN-T projects (studies for all modes, works for mature projects, notably in the rail and inland waterways sectors), as well as projects supporting the Single European Sky policy - 18 projects selected, €41.1 million in funding
- Priority 3: Studies to support Public-Private Partnerships (PPPs) - 3 projects selected, €4.9 million in funding
TEN-T Project Management Workshop15-16 February 2011
20
Overview of the results of the 2010 Annual Call evaluation/selection
TEN-T Project Management Workshop15-16 February 2011
21
Overview of the results of the 2010 Annual Call evaluation/selection
TEN-T Project Management Workshop15-16 February 2011
22
Overview of the results of the 2010 Annual Call evaluation/selection
TEN-T Project Management Workshop15-16 February 2011
23
Overview of the results of the 2010 CallsOversubscription
TEN-T Project Management Workshop15-16 February 2011
24
Overview of the results of the 2010 CallsLeverage effect
TEN-T Project Management Workshop15-16 February 2011
25
Success of targeted 2010 Annual Call
• For the first time, the Annual Call contained three specific priorities, including priorities addressing the climate change challenge, acceleration and facilitation of the implementation of TEN-T projects and support to Public-Private partnerships
• One project was retained for funding addressing the decarbonisation of transport
• A dedicated workshop on PPPs organised prior to the submission of proposal - 3 out of 5 proposals were selected under the PPP priority-promote the participation of private sector to TEN-T funding
• Better use of limited EU funds by supporting mature projects and/or studies that accelerate the maturity of works and thus maximise the impact of the expected results in specific areas of TEN-T policy.
TEN-T Project Management Workshop15-16 February 2011
26
Success of targeted 2010 MoS Call
• For the 2010 MoS call focus was broadened to:– wider benefits projects – and pilot actions to bridge the gab between studies and full scale
implementation – facilitate to introduction of new concepts and technologies
• The successful establishment of the “MoS One Stop Help Desk”: further explain the rules and requirements for the MoS implementation
• Better communication with applicants-more proposals submitted in line with the MoS concept
• A high leverage effect is foreseen • TEN-T calls remain popular - oversubscription is high
TEN-T Project Management Workshop15-16 February 2011
27
Last steps for the 2010 Annual and RIS/MoS Calls
- Transmission of draft selection proposals to European Parliament which had the “right of scrutiny” until 20 January 2011
- Interim contact between TEN-T EA and MS on projects where environmental clarifications are awaited (ongoing)
- Assuming positive outcome to above steps, TEN-T EA will enter into negotiations on individual funding decisions with a view to finalising them as soon as possible in the spring (ongoing)
TEN-T Project Management Workshop15-16 February 2011
28
TENT-T Calls for Proposals 2010 Feedback form
- What? Web survey to obtain feedback on 2010 TEN-T Call for Proposals
- Why? To help us improve the process for future calls
- Who? All those who applied to a TEN-T Call in 2010
- When? end February to mid-March
- How? Applicants will receive an email with weblink to questionnaire
TEN-T Project Management Workshop15-16 February 2011
29
Thank you for your attention
[email protected]://tentea.ec.europa.eu