Draft KPI dashboard

European Skills, Competences, Qualifications and Occupations 7th Member States Working Group on ESCO

Draft KPI dashboard-June 2018 2

ESCO (2018) SEC 008 DRAFT

Document Date: 09/05/2018

Last update: 06/06/2018

Purpose of document

Key performance indicators (KPI) are an important instrument to measure the success

and quality of ESCO. The Commission presented a status update on the ESCO KPI

framework to the ESCO Maintenance Committee on its 25th meeting.

The purpose of this document is to present a format for dashboards in which the KPI

would be used for regular reporting to the committee and to the Member States

Working Group on ESCO. These dashboards will use and show the KPIs that the

Commission and the committee already discussed at previous meetings. At this stage,

the dashboards are only based on sample data. The members of the Maintenance

Committee members were invited to provide feedback on the format of the

dashboards during its 26th meeting, which took place in Brussels the 5 of June 2018.

Five dashboards

The ESCO team suggests to present group the KPI in dashboards along the following

five topics:

1. Acceptance of ESCO as a de facto standard

2. ESCO in EURES

3. Evolution of the ESCO qualifications pillar

4. Conceptual and terminological coverage

5. Level of granularity of ESCO

The five draft dashboards are shown below.

Next steps

In the implementation, the ESCO team would give priority to the KPIs that can be

measured first. Once in place, dashboards will be regularly updated.

Summer 2018 Cooperation with EURES team and Cedefop to identify the best datasets and ways of measuring KPIs

September 2018 MAI meeting Real data for dashboard #1 (Acceptance as de facto standard)

and possibly #3 (evolution of the qualifications)

November 2018 MAI meeting First version of dashboard #2 (ESCO in EURES) and #4 (conceptual and terminological coverage)

2019 First version of dashboard #5 (ESCO granularity)

Draft KPI dashboard-June 2018 3

1. ESCO acceptance as de facto standard

Downloads of ESCO API and datasets

Downloads by user type Download by purpose

List of known organisations or services using ESCO

EURES

Cedefop Big Data Analysis of Job

Vacancies

Skills Profile Tool for Third

Country Nationals

PES Ireland (JobsIreland)

PES Iceland (under development)

OPENSKIMR

Transparency in Art Levels and

Qualifications (TALQ)

E-Skills Match

ACROSS: “green your skills“

Textkernel

Docebo

Milch & Zucker (JobStairs)

Skilllab.io

Boost.rs

…

0

50

100

150

200

250

Jan

-18

Feb

-18

Mar

-18

Ap

r-1

8

May

-18

Jun

-18

Jul-

18

Au

g-1

8

Sep

-18

Oct

-18

No

v-18

Dec

-18

API

Datasets

34%

4%

8%17%

2%

21%

6%8%

Public employment service Private employment service

Job portal Education/training institution

Social Partner Application developer

Career adviser Other

23%

4%

15%

5%11%

28%

14%

Integration in applications Mapping

Statistical research Consultation

Curricula development Recruitment

Other

Draft KPI dashboard-June 2018 4

2. ESCO in EURES

Mapping to ESCO

Occupations Skills

Planning to map Started mapping Finished mapping

Planning to adopt Started implementation Implemented

Unknown Not part of EURES

% of EURES job vacancies annotated with ESCO

% of EURES user profiles and CVs annotated with ESCO

0%

10%

20%

30%

0%

10%

20%

30%

Draft KPI dashboard-June 2018 5

3. Evolution of the ESCO qualifications pillar

Qualifications in ESCO

Qualifications in ESCO National qualification database established, but not in ESCO National qualification database under development No national qualification database No information Not part of EQF

Number of qualifications in ESCO

% of qualifications linked to ESCO skills

0

1000

2000

3000

4000

5000

Jan

-18

Feb

-18

Mar

-18

Ap

r-1

8

May

-18

Jun

-18

Jul-

18

Au

g-1

8

Sep

-18

Oct

-18

No

v-1

8

Dec

-18

Linked3%

Not linked97%

Draft KPI dashboard-June 2018 6

4. Conceptual and terminological coverage of ESCO

Conceptual and terminological coverage per ESCO version

Terminological coverage by language

Terminological coverage by economic sector

Most frequently appearing candidate terms

Occupations

English teacher Demi-chef de rang

…

Skills

Augmented reality GDPR

…

0%

20%

40%

60%

80%

Occupations Skills

v1.0.0

v1.0.3

v1.0.5

0%

20%

40%

60%

80%

100%

61%

64%

65%

76%

76%

81%

84%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%

…

D Electricity, gas, steam and air conditioning supply

E Water supply, sewerage, waste management and…

G Wholesale and retail trade, repair of motor vehicles and…

C Manufacture

B Mining and Quarrying

F Construction

A Agriculture, Forestry, Fishing

Draft KPI dashboard-June 2018 7

5. Granularity of ESCO

Level of granularity per occupation

Occupations in ESCO with the highest/lowest granularity

Most granular

Aquaculture environmental analyst Aquaculture rearing technician Aquaculture hatchery technician Aquaculture recirculation manager

…

Least granular

Sales assistant Shop supervisor Shop assistant Specialised doctor …

0

100

200

300

400

500

600

-10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10

# of national classifications with more generic concepts (broader) - # of national classifications with more detailed concepts (narrower)

# concepts

Concepts in ESCO with high granularity Concepts in ESCO with low granularity