Guidelines to the Self-Assessment Tool and Key Performance ... · Pierre Bastien (Roland Berger)...

DIGITAL CITIES CHALLENGE

Guidelines to the

Self-Assessment Tool and Key Performance Indicators

DIGITAL Cities

2

Guidelines to the Self-Assessment Tool and

Key Performance Indicators

Prepared by:

Paresa Markianidou (Technopolis Group)

Kincsö Izsak (Technopolis Group)

Pierre Bastien (Roland Berger)

DIGITAL Cities

3

TABLE OF CONTENT

1 INTRODUCTION ................................................................................................... 4

1.1 Background of the Digital Cities Challenge initiative ....................................... 4

2 THE SAT CONCEPTUAL FRAMEWORK ............................................................. 5

2.1 Objectives ........................................................................................................ 5

2.2 Dimensions and structure ................................................................................ 5

2.3 Levels of digital maturity .................................................................................. 7

3 COMPLETING THE SAT ONLINE TOOL .............................................................. 7

3.1 Identify your list of key city stakeholders ......................................................... 7

3.2 Login to the online tool ..................................................................................... 8

3.3 Start the questionnaire ..................................................................................... 9

3.4 Click on one question and complete .............................................................. 10

3.5 Check whether you have answered all questions .......................................... 11

3.6 Check out inspiring city cases ....................................................................... 11

3.7 Create your Assessment Report .................................................................... 12

3.8 Compare yourself to other cities .................................................................... 13

4 KEY PERFORMANCE INDICATORS FRAMEWORK ......................................... 13

1.1 COLLECTING DATA FOR THE KPI FRAMEWORK ..................................... 14

Templates for SAT and KPI collection .................................................... 21

Questionnaire ......................................................................................... 26

Sample email to city stakeholders .......................................................... 29

ICT company definition .......................................................................... 30

DIGITAL Cities

4

1 INTRODUCTION This guide has been prepared in the framework of the ‘Digital Cities Challenge’ initiative of the European Commission and explains how to use and complete the Self-Assessment Tool (SAT) and how to collect data for the Key Performance Indicators (KPIs). The objective of the SAT is to determine the digital maturity of cities and to identify the starting points for discussion on how to (further) develop and improve the digital transformation strategies of European cities. It will take you around 30 minutes to reply to all the questions and further time can be dedicated to browse among the good practice cases and interpreting the automatic feedback provided at the end. The objective of the KPIs is to collect data that can diagnose the current status in terms of digital maturity and measure the progress made by model cities during and at the end of the ‘Digital Cities Challenge’ initiative. In order to fill in the KPIs, you will need to collect data from various public administration departments, from local telecom providers or transport companies. It will take 2-3 days of work from a dedicated colleague of yours. The emphasis of the SAT and the KPIs is first of all on the role of cities as enablers of industrial transformation through digital technologies and solutions in the economy and less in the context of Smart Cities and e-governance as such.

The SAT and KPIs will serve first of all as a basic input to the advisory services provided to 15 European cities selected through a call for expressions of interest and will be complemented with a detailed expert assessment. It is, however, also available to any other city who wishes to test its digital maturity through an online platform that provides an assessment framework, individualised reports and link to good practices to get inspiration from.

1.1 Background of the Digital Cities Challenge initiative The rise of cities enhances their prospect to serve as launch pads for digital transformation. Due to their high density, cities are put in a very good position to create innovative ecosystems made up of a wide array of different stakeholders from government, industry, finance, academia, communitarian organisations, social partners, etc. In this context arises the Digital Cities Challenge initiative with the main purpose to support build up local capacity in digital transformation, by offering policy advice, coaching, facilitation and support to 15 cities in Europe that wish to move forward on the digitisation scale. The support to be offered will speed up the digital transformation and the industrial modernisation of cities in order to take full advantage of the 4th industrial revolution. This initiative will enable cities to foster local innovation ecosystems for digital transformation and industrial modernisation by applying the recommendations set out in the "Blueprint for cities as launch pads for digital transformation". In addition, it will reinforce the pan-European networking of the model cities, facilitate their participation in on-going European initiatives in similar policy fields, strengthen stakeholder collaboration and stimulate investments, by exploring and developing potential cross-regional partnerships, designing common projects and attracting private investments for digital transformation of industrial value chains. Specifically, selected model demonstrator cities will receive support in the form of field advisory services to be provided by a group of high level experts and peer reviewers, and will offer the possibility for city representatives to participate in a series of capacity building and networking seminars.

DIGITAL Cities

5

2 THE SAT CONCEPTUAL FRAMEWORK

2.1 Objectives

The SAT aims at identifying the starting points for discussion on how to (further) develop, reshape and improve the digital transformation strategies, in line with the broader smart specialisation strategies of European cities. With the Self-Assessment Tool, cities will be able to:

• Determine their level of digital maturity and the existing conditions for digital transformation processes;

• Identify their advancement levels along 9 dimensions of digital development in the form of individualised reports;

• Allow to get the perceptions of all the key types of stakeholders in the city and look for gaps or shared vision;

• Compare themselves to the performance of other cities;

• Get inspiration from other city cases and good practices.

The SAT has three special features (see Figure 1): • The SAT is to be prepared with the involvement of all the key types of stakeholders

that play an important role in the digital ecosystem such as the public, business, research or the finance sector. Although the SAT can be also used if only the city administration fills it in, it provides most value if all the five stakeholder groups responds to it and it becomes a tool for identifying a common vision. This is why it is important to identify this list of local organisations and institutions well in advance.

• The SAT is highly interactive and visually appealing as it is designed with a graphical presentation and allows for feedback and comparison.

• The users get instant links to other city cases and links to good practices that can be used as a source of inspiration.

Figure 1: Three special features of the Self-Assessment Tool

2.2 Dimensions and structure

The SAT is composed of a set of 39 questions that are also linked to the key performance indicators on different abilities for digital transformations. The questions are structured around 8 key dimensions related to the prerequisites and the accelerators of digitalisation of industry in cities that will allow to assess the level of development in these specific aspects at the end of the SAT process.

DIGITAL Cities

6

Figure 2: Dimensions of the SAT and KPIs

Digital Infrastructure: the dimension contains the infrastructure needed to make digitalisation possible such as broadband coverage, mobile internet or ICT used in public services such as transport, energy and health. Open data: data is the new oil, but technology is required to enable the processing, this dimension therefore contains the technology allowing the access to data and the tools to process it, with sub-dimensions such as Big data and Open data platforms. Digital skillset: digitalisation is nowhere without skilled people, this dimension therefore contains the human assets and capabilities present in the participating model regions and cities, with sub-dimensions such as Entrepreneurs and business and Individuals. Digital competencies of firms: this dimension includes questions related to companies embracing Industry 4.0 concepts or offering specific digital trainings. Governance & Leadership: is related to the existence of digital strategies and agenda driven by a strong leadership and good coordination. Support services offered for digital entrepreneurs: this dimension includes the existing incentives provided by regional public authorities and agencies to foster digital industries and digitalisation. Finance: the dimension contains the capital available for investments into digital technology, infrastructure and businesses, with sub-dimensions such as Private investment and Public investment. Community: digitalisation is not a stand-alone element but requires an ecosystem, this dimension therefore contains the interactions between different actors in the participating model regions and cities, with sub-dimensions such as Communication and collaboration, Support structures and Leadership.

Prerequisites to create favourable framework conditions

Accelerators to enhance digitalisation of industry

Infrastructure

Accessto data

Digitalskillset

Community

Finance

Governance& leadership

Dimensions of digital

transformation

Companies' digitalcompetencies

Supportservices

(Digital) infrastructure is a basic requirement to enable digitalisation

Processing of data requires access to data through technology

Human assets and capabilities are prerequisites to enhance digital transformation

Interactions between different stakeholders of the ecosystem can enhance digitalisation

Funding is needed to support digital projects

Overall coordination and governance is needed to streamline the process

The ecosystem greatly benefits from a portfolio of support services facilitating

digital transformation

Companies need specific digital competencies to realise digital transformation

DIGITAL Cities

7

2.3 Levels of digital maturity

Each question has three potential pre-defined answers that indicate the key stages of digital development being:

1) digitally less advanced; 2) digitally transforming; and 3) digitally mature.

Within each of these three levels, we further differentiate among three grades in order to explore the more subtle stage of development. This results in 9 grades in total along the 3 main levels of digital development.

Figure 3: Assessing the level of digital maturity

3 COMPLETING THE SAT ONLINE TOOL

3.1 Identify your list of key city stakeholders

At the start of the self-assessment process, please draw up your list of the key city stakeholders and organisations that you think should answer the SAT and allow identifying a collective view of the city digital advancement level.

The key stakeholders that you should contact and share the SAT with are the following:

• Industry including both large companies, SMEs and business organisations such as chambers of commerce or cluster organisations;

• Utility companies such as telecommunication providers, energy providers, public transport providers etc.;

• Education and research such as university, high school or research institutions;

• Financial institutions such as banks or venture capital firms.

Today's digital maturity level of the city determined

by SAT & KPIs

Digitally less advanced

Digitally mature

Digitally transforming

⟳Level 1 Level 2 Level 3

1 2 3 4 5 6 7 8 9

DIGITAL Cities

8

You can identify several organisations for each group according to the feature of your city. If several organisations respond from one stakeholder group, their replies will be averaged at the end in the reporting process.

3.2 Login to the online tool

Please go to the website of the Digital Cities Challenge SAT and login to the Self-Assessment Online Tool that you can select from the menu tab on the left upper corner (see Figure 4). Please create your account by indicating your email address, select a username according to your preference and create a password. This password will be the one you will have to distribute to the other city stakeholders such as businesses, utility companies, banks, financial institutions, university and research institutions (as explained in 3.1). Please send the selected password to your list of stakeholders so that they use the same credentials when filling in the SAT!

In Appendix C, you also find a sample email that can be translated and sent to the list of selected organisations explaining them the purpose of the SAT.

Figure 4: Login to the SAT

DIGITAL Cities

9

3.3 Start the questionnaire

The questionnaire is embedded into a graphical visual depicting the map of a city, where the questions are to be found by clicking on the highlighted icons. Please see the map below.

Figure 5: SAT - starting the questionnaire

Each icon represents one dimension of the SAT such as digital infrastructure, open data or digital skillset (and it is also placed on the image of a corresponding building such as an energy tower or factory). As you will hover your mouse over the icons, a text box will also appear to indicate the title of the specific dimension.

- digital competencies of firms

- governance & leadership

- open data

- support services

- community

- finance

- digital infrastructure

- digital skillset

DIGITAL Cities

10

Please select one dimension according to your preference and start answering the questions. Under each icon, all the questions related to the specific dimension will be listed and you can choose with which question you wish to start.

When you have answered all questions, you will be able to download your individualised report.

Figure 6: Graphical presentation of the SAT

3.4 Click on one question and complete

When you clicked on one icon and selected one question according to your preference, you will be offered to choose from 3 potential answers. You will have to select which answer describes the best the situation in your city and you should also indicate to what extent this answer is applicable to your case (somewhat or highly). You can select only one out of the three answers as it should be self-evident.

Figure 7: Selection of the applicable answer

DIGITAL Cities

11

This sub-level grading system (indicating whether it is somewhat applicable – highly applicable) allows you to make a further difference whether your city is at a more or less developed stage of digital development. When you finished, please click on <Confirm>.

3.5 Check whether you have answered all questions

You will need to fill in all the questions, before you can create your report. You can follow up your progress by hovering your mouse of each icon and checking the percentage indicated with regard to the answers provided/questions completed. You can also follow up your progress by checking the list of questions. When a question is completed, it becomes green and is ticked.

Figure 8: The level of completeness of questions

3.6 Check out inspiring city cases

As you go along in filling in the SAT and responding to the questions, you can click on the icon: <Check out inspiring city cases> and browse among the good practices that have been collected and placed in the library related to each dimension of the SAT.

DIGITAL Cities

12

Figure 9: City cases of good practices

3.7 Create your Assessment Report

At the end of the SAT questionnaire, when all questions have been answered, you can create your assessment report.

The report will provide you the following feedback:

• It will indicate your level of digital maturity on a scale of 1-9 (divided into 3 levels and 3 grades within each).

• It will provide some general recommendations corresponding to your digital development level.

• You can view your results per dimension and sub-dimension and see in which (sub-) dimension your city performs better or worse. Spider and column diagrams will support the visualisation of data.

• You can check in which dimension and which questions there have been the largest gaps in the answers of the different city stakeholders.

• You can download the full list of answers per question and city stakeholder in an excel.

• You will be offered a list of inspiring city cases and good practices to check out.

DIGITAL Cities

13

Figure 10: Report: example of results per dimension

3.8 Compare yourself to other cities

At a later stage of the project, you will be able to compare yourself to other cities by selecting an average figure for more developed cities or less developed ones that also participated in the Digital Cities Challenge initiative.

4 KEY PERFORMANCE INDICATORS FRAMEWORK The indicators allow the monitoring of the targeted and actual impact of the actions and initiatives on the local economy, businesses and citizens, and enable the participating cities to assess the progress achieved in terms of digital transformations.

The KPIs will facilitate the activities of the policy makers and stakeholders of cities when identifying and addressing the bottlenecks and obstacles of the processes of digital transformation and industrial modernisation. They will also enable the right identification of the key success factors of the different initiatives and actions undertaken.

DIGITAL Cities

14

1.1 COLLECTING DATA FOR THE KPI FRAMEWORK The Key Performance Indicators have been structured along the same dimensions and sub-dimensions as the SAT. In this respect, the SAT and the KPI framework complements each other. The data will be collected by the city with the support of the Digital Cities Challenge advisory team.

Below, in Error! Reference source not found., you find the overview of the KPIs, the link to the dimension and sub-dimension of the SAT, the sources and an explanation on how to construct the indicator.

In Appendix A templates for Telco providers, Public transportation companies, Industry associations, Educational establishments and financial institutions have been provided to facilitate the data collection process.

Dimension Sub-dimension KPIs Source How to construct the indicators

Infrastructure Digital infrastructure

% of households with broadband internet at home [%]

Telco providers

Numerator: number of households with broadband internet at home. Data to be inquired to telco provider(s) operating in the city. Broadband connection used by the household includes DSL, wired fixed (cable, fiber, Ethernet, PLC), fixed wireless (satellite, WiFi, WiMax) and mobile wireless (3G/UMTS) (DESI definition). Denominator: Number of households. Data to be collected from Eurostat “Living conditions - functional urban areas [urb_llivcon]”. (See data collection template in Appendix A)

% of enterprises with broadband internet at home [%]

Telco providers

Numerator: number of enterprises with broadband internet. Data to be inquired to telco provider(s) operating in the city. Broadband connection used by the enterprise includes DSL, wired fixed (cable, fiber, Ethernet, PLC), fixed wireless (satellite, WiFi, WiMax) and mobile wireless (3G/UMTS) (DESI definition). Denominator: Number of enterprises. Data to be collected from national registers of companies database. (See data collection template in Appendix A)

% of households with internet at home [%]

Telco providers

Numerator: Number of households with internet. The data to be inquired to telco provider(s) operating in the city. Internet connection used by the household includes dial up, DSL, wired fixed (cable, fiber, Ethernet, PLC), fixed wireless (satellite, WiFi, WiMax) and mobile wireless (3G/UMTS). Denominator: Number of households. Data to be collected from Eurostat “Living conditions - functional urban areas [urb_llivcon]”. (See data collection template in Appendix A)

DIGITAL Cities

15


Average speed of internet [Mbps] Telco infrastructure providers

Data to be inquired to telco infrastructure providers. (See data collection template in Appendix A)

Average cost of broadband internet [EUR/Mbps]

Telco providers

Data to be inquired to telco providers. (See data collection template in Appendix A)

% of people using mobile internet to go online over the last 12 months [%]

Telco providers

Numerator: number of people using mobile internet to go online. Data to be inquired to telco providers. Denominator: Population (See data collection template in Appendix A)

% of city covered by 4G [%] Telco infrastructure providers

Numerator: Number of square meters covered by 4G or Number of households living in areas covered by advanced fourth generation mobile broadband (LTE protocol) (DESI definition) Denominator: Number of households. Data to be collected from Eurostat “Living conditions - functional urban areas [urb_llivcon]”. (See data collection template in Appendix A)

Average cost of mobile internet [EUR] Telco providers

EUR monthly charges in EUR by basket with VAT included. The baskets must be defined according to the EU study “Mobile Broadband Prices in Europe 2016”. Data to be inquired to telco providers to update/validate the data collected in 2016 for the aforementioned study. (See data collection template in Appendix A)

Number of unique devices connected to wireless internet freely available at public spaces in last 12 months [#]

Public administration

The public administration to inquire the data on unique devices connected during the last 12 months to the company(-ies) in charge. (See data collection template in Appendix A)

Non-digital infrastructure

Availability of integrated mobility platform to travel across transport modes [Y/N]


This is a yes or no indicator to be inquired to the relevant public administration representatives.

Availability of real-time transport monitoring system [Y/N]



% of public transportation tickets purchased online [%]in last 12 months

Public transportation companies

Numerator: # public transportation tickets purchased online in last 12 months Denominator: # public transportation tickets purchased in last 12 months Data to be inquired to public transportation companies operating in the city.

DIGITAL Cities

16

Dimension Sub-dimension KPIs Source How to construct the indicators Availability of one-stop shop for water, gas, electricity for address changes or new addresses? [Y/N]



Availability of coax or fibre network at main business parks [Y/N]


This is a yes or no indicator to be inquired by the relevant public administration representatives. The information should be provided by main business parks.

% of permits (e.g. housing construction, house extension) applied for online in last 12 months [%]


Numerator: # permits applied online Denominator: # permits The type of permits considered will need to be described.

% of Individuals who used the internet for interaction with public authorities (average for the last three years)

Eurostat Provided by the DCC team

This indicator is available in Eurostat: Individuals who used the internet for interaction with public authorities (isoc_r_gov_i) NUTS 2 level (unit of measure=% of individuals; time=last three years; calculation=average). Note: If the city is not included in the Eurostat database it would need to be explored if such data can be collected by the public administrator. If possible a distinction between households and enterprises to be made.

Open data

Data scope and accuracy

Availability of open datasets [Y/N] Public administration


Number of downloads of open datasets in last 12 months [#]



% of open datasets offering real time information [%]


Numerator: # open databases offering real time information Denominator: # open databases

Usage of open data

Number of cases of digital companies using open data to develop a new service or to support their business operation [#]

Industry associations

Data to be inquired to representatives of industry associations. Open data considers those from both public and private companies. (See data collection template in Appendix A)

Number of cases of non-digital companies using open data to develop a new service or to support their business operation [#]

Industry associations

Data to be inquired to representatives of industry associations. Open data considers those from both public and private companies. (See data collection template in Appendix A)

Digital skillset and education

Digital education

% of people who bought or ordered goods or services over the internet in past 12 months [%]

Eurostat This indicator is available in Eurostat: Individuals who ordered goods or services over the internet for private use (isoc_r_blt12_i) NUTS 2 (unit of measure=% of individuals; time=last three years; information society indicator= last online purchase in 12 months; calculation=average).

DIGITAL Cities

17


% of students in digital subjects over the last 5 years [%]

Educational establishment

Numerator: # of students in tertiary education (i.e. post secondary education) on a digital subject related diploma (e.g. computer engineering, big data, cybersecurity, web design, artificial intelligence etc.) Data to be inquired to all educational establishments in the city. Denominator: # of students in tertiary education (i.e. post secondary education) (See data collection template in Appendix A)

% of ICT graduates employed in the city over the last 5 years


Numerator: # ICT graduates employed in the city Denominator: # ICT graduates Data to be inquired at alumni databases of higher education institutes (See data collection template in Appendix A)

% of non ICT/digital diplomas at university colleges, universities including digital courses


Numerator: # of non ICT diplomas including digital courses (e.g., medicine, economics, biology, agriculture, etc.) Denominator: # of diplomas (See data collection template in Appendix A)

Attraction of IT talent

Number of employees in digital companies [#]

National register

# of employees in ICT companies. The definition of ICT companies is based on the NACE rev.2 classification as defined by the OECD and the EU project PREDICT (see Appendix ICT company definition).

Number of vacancies for digital jobs [#]

Web-crawling Provided by the DCC team

To construct this indicator, you need to identify the major online job search engines in your city. You have to web crawl the job advertisements and search for digital related vacancies. For the 15 model demonstrator cities this indicator will be provided by the advisory team.

Number of vacancies for digital jobs not filled in 6 months [#]


To construct this indicator, you need to identify the major online job search engines in your city. You have to web crawl the job advertisements and search for digital related vacancies. For the 15 model demonstrator cities this indicator will be provided by the advisory team.

% of foreign students in digital subjects [%]


Numerator: # of foreign students in tertiary education (i.e. post secondary education) on a digital subject related diploma (e.g. computer engineering, big data, cybersecurity, web design, artificial intelligence etc.) Denominator: # of foreign students (See data collection template in Appendix A)

Digital competencies of companies

Competencies % of companies with internet website [%]

National register of companies

Numerator: # of companies with internet website Denominator: # of companies Database to be inquired by the national register of companies. This assumes that the presence of a website is a compulsory input.

DIGITAL Cities

18


% of companies offering online payment option


To construct this indicator, you need a database of local companies registered in your city with their internet homepage address. You need to web crawl the website of these companies and look for keywords (translated into your language) such as

• webshop • e-shop • purchase online • online payment

If possible, there is a need for manual checks and data cleaning in order to eliminate false positives. For the 15 model demonstrator cities this indicator will be provided by the advisory team.

% of manufacturing companies offering digital services (e.g., company offering remote maintenance)


To construct this indicator, you need a database of local companies registered in your city with their internet homepage address. You need to web crawl the website of these companies and look for keywords (translated into your language) such as

• mobile platform, digital platform • online service centre • digital service • digital solution • connected solution • connected digital product and system • online management system • online service management • mobile business system • mobile device connection

If possible, there is a need for manual checks and data cleaning in order to eliminate false positives. For the 15 model demonstrator cities this indicator will be provided by the advisory team.

Digital applications

Number of mobile applications available in the city on smartphone [#]


#of mobile applications. This indicator includes mobile applications such as food delivery, peer-to-peer car sharing etc. These include both internationally developed applications and locally developed applications.

Number of users of mobile applications available in the city on smartphone [#]


# of users in the city. Data to be inquired by the administrators of the mobile applications such as food delivery, peer-to-peer car sharing etc.

DIGITAL Cities

19


Community

Ecosystem collaboration

Number of ICT clusters and # of ICT companies joined as cluster member in any cluster organised/formed in the city [#]

Public administration /Industry associations

Information to be inquired by the public administration and by the existing cluster organisations.

Number of digital start-ups [#] Public administration/ National registers

# of digital start-ups (young firms aged five or less years) to be identified within the national registers of companies database.

Networking and mentoring

Number of events on digital topics and/or for digital companies in the last five years


# of events on digital topics and/or targeting specifically digital companies organised in the city in the last years. Sources include https://www.meetup.com or other local sources of events.

Finance

Public

Grants / tax incentives provided at city level to support digital start-ups in last 12 months [EUR]


Support to digital start-ups (young firms aged five or less years) in EUR in the form of grants in EUR granted in the last 12 months and tax incentives measured according to the initial revenue loss method of the Frascati manual (2015): the amount by which tax revenue is reduced as a consequence of the introduction of tax expenditure, based upon the assumption of unchanged behaviour and unchanged revenues from other taxes.

Number of digital start-ups which received grants / tax incentives at city level in last 12 months [#]


# of digital start-ups (young firms aged five or less years) which received grants / tax incentives at city level in last 12 months.

Grants / tax incentives provided at city level to support non-digital companies for digital projects in last 12 months [EUR]


Support to non-digital companies for digital projects in the form of grants in EUR granted in the last 12 months and tax incentives measured according to the initial revenue loss method of the Frascati manual (2015): the amount by which tax revenue is reduced as a consequence of the introduction of tax expenditure, based upon the assumption of unchanged behaviour and unchanged revenues from other taxes.

Number of non-digital companies which received grants / tax incentives for digital projects at city level in last 12 months [#]


# of non digital companies which received public support in the form of grants or tax incentives for digital projects in the last 12 months.

Private Number of digital start-ups receiving a loan in last 12 months [#]

Financial institution

To be inquired to financial institutions. Digital start-ups are young firms aged five or less years. (See data collection template in Appendix A)

DIGITAL Cities

20


Number of digital start-ups received venture capital in last 12 months [#]

Venture capital firms

To be inquired to venture capital firms or financial institutions or other entrepreneurship support initiatives in the city. Digital start-ups are young firms aged five or less years. (See data collection template in Appendix A)

Availability of business angels for digital start-ups [Y/N]

Financial institution

This is a yes or no indicator to be inquired to financial institutions. (See data collection template in Appendix A)

Support services

Innovation lab & accelerators

Number of innovation labs / accelerators/ incubators [#]


This indicator captures the local presence of innovation labs, accelerator, or incubators.

Number of start-ups / companies attached to innovation labs / accelerators/ incubators [#]


# of start-ups/companies that have taken their ideas to innovation labs/ accelerators/ incubators.

Awareness raising

Number of participants in awareness raising events organised in the area of digital transformation/Industry 4.0 etc. [#]


# of participants in awareness raising events in the area of digital transformation/ industry 4.0.

Other support services

Number of support services (other than financial) available for supporting digital transformation in the economy [#]

Public administration A description of the type of support services should be briefly provided.

Governance and leadership

Shared vision Availability of digital strategy [Y/N] Public administration


Coordination

Availability of clear executive responsible for digital development plan [Y/N]



Number of man hours of executive responsible on weekly basis dedicated to coordination of digital development plan [hours]


This indicator assumes the existence of a digital development plan and that the executive responsible is partially dedicated to this task (less than one full time equivalent). The indicator should be provided in hours per week.

Implementation and monitoring

Existence of a monitoring framework for the implementation of the city digital strategy [Y/N]



DIGITAL Cities

21

Templates for SAT and KPI collection

Telco Providers Our city has been selected to participate in The Digital Cities Challenge, an initiative of the European Commission that enables cities to foster local innovation ecosystems for digital transformation and industrial modernisation. Specifically, our city will be among the 15 model demonstrator cities which will receive support in the form of field advisory services provided by a group of high level experts and peer reviewers, and will offer the possibility for city representatives to participate in a series of capacity building and networking seminars. The advisory services will include a self assessment to determine the digital maturity of our city and to identify the starting points for discussion on how to (further) develop and improve our digital transformation strategies. The self assessment will be coupled by Key Performance Indicators that can diagnose the current status in terms of digital maturity and measure the progress made during and at the end of The Digital Cities Challenge initiative. We would therefore like to ask you to join us in this process by completing the Self Assessment tool and providing us with data for the construction of the Key Performance Indicators.

TELCO PROVIDERS QUESTIONNAIRE

Question 1

Please provide the number of households with broadband internet at home in city xxx Notes Broadband internet should include: DSL, wired fixed (cable, fiber, Ethernet, PLC), fixed wireless (satellite, WiFi, WiMax) and mobile wireless (3G/UMTS)

Question 2

Please provide the number of households with internet at home in city xxx. Notes Internet connection used by the household includes dial up, DSL, wired fixed (cable, fiber, Ethernet, PLC), fixed wireless (satellite, WiFi, WiMax) and mobile wireless (3G/UMTS).

Question 3

Please provide the number of enterprises with broadband internet at home in city xxx Notes Broadband internet should include: DSL, wired fixed (cable, fiber, Ethernet, PLC), fixed wireless (satellite, WiFi, WiMax) and mobile wireless (3G/UMTS)

Question 4

Please provide the number of enterprises with internet at home in city xxx. Notes Internet connection used by the household includes dial up, DSL, wired fixed (cable, fiber, Ethernet, PLC), fixed wireless (satellite, WiFi, WiMax) and mobile wireless (3G/UMTS).

Question 5 Please provide the average speed of internet [mbps] in city xxx.

Question 6

Please provide the average cost of broadband internet in city xxx. The Broadband Internet Access Cost is defined as the monthly price of the broadband offer, composed of one-time non-recurring charge and monthly recurring charge. The following baskets and parameters are considered:

Baskets Average cost (one time non-recurring and monthy recurring charge)

DIGITAL Cities

22

Public transportation companies Our city has been selected to participate in The Digital Cities Challenge, an initiative of the European Commission that enables cities to foster local innovation ecosystems for digital transformation and industrial modernisation. Specifically, our city will be among the 15 model demonstrator cities which will receive support in the form of field advisory services provided by a group of high level experts and peer

Metered offers (limited access to the

Internet)

Non metered offers (unlimited access to

the Internet) Basket 1: 144kbps-1Mbps (included) Basket 2: 1Mbps-2Mbps (included) Basket 3: 2Mbps-4Mbps (included) Basket 4: 4Mbps-8Mbps (included) Basket 5: 8Mbps-12Mbps (included) Basket 6: 12Mbps-30Mbps (included) Basket 7: 30Mbps-100Mbps (included) Basket 8: 100+Mbps

Notes: Non recurring charges may include: installation; modem or router; software driver; activation; additional administrative charges; television decoder; other charges. [based on the DG CONNECT study - Broadband internet access cost (BIAC) 2014]

Question 7

Please provide the number of people using mobile internet to go online in the last 12 months Notes: Online internet includes Laptop, Tablet, Handset use.

Question 8

Please provide the square meters in city xxx covered by advanced fourth generation mobile broadband (LTE protocol) In case the above is not possible include this question: Please provide the areas in city xxx covered by advanced fourth generation mobile broadband (LTE protocol) Notes Please indicate the areas using street names.

Question 9

Please provide the average cost of mobile internet in city xxx. The mobile Internet Access Cost is defined as the monthly price of the broadband offer, composed of one off charges and monthly subscription charges. The following baskets and parameters are considered:

Average cost of mobile internet Laptop use

(data volumes) Tablet use

(data volumes) Handset use

(data volumes+voice/SMS basket) Basket Prepaid Postpaid Basket Prepaid Postpaid Basket Prepaid Postpaid 500 MB 250 MB 100 MB + 30 calls basket 1 GB 500 MB 500 MB + 100 calls basket 2 GB 1 GB 1 GB + 300 calls basket 5 GB 2 GB 2 GB + 900 calls basket 10 GB 5 GB 2 GB + 100 calls basket 20 GB 10 GB 4 GB + 900 calls basket

Notes: One off charges: these charges relate to the cost for activating or installing the mobile services; these can also include the costs related to shipment of the equipment. For the pre-paid offers, these costs relate e.g. to the start-pack (e.g. upfront payment for the SIM-card). Monthly subscription charges: for the post-paid offers, these are the monthly charges as advertised on the operator’s website, excluding any discounts that apply at a given moment and excluding overage charges. [based on the DG CONNECT study - Mobile Broadband prices (prices as of February 2016)]

DIGITAL Cities

23

reviewers, and will offer the possibility for city representatives to participate in a series of capacity building and networking seminars. The advisory services will include a self assessment to determine the digital maturity of our city and to identify the starting points for discussion on how to (further) develop and improve our digital transformation strategies. The self assessment will be coupled by Key Performance Indicators that can diagnose the current status in terms of digital maturity and measure the progress made during and at the end of The Digital Cities Challenge initiative. We would therefore like to ask you to join us in this process by completing the Self Assessment tool and providing us with data for the construction of the Key Performance Indicators.

Educational Establishments Our city has been selected to participate in The Digital Cities Challenge, an initiative of the European Commission that enables cities to foster local innovation ecosystems for digital transformation and industrial modernisation. Specifically, our city will be among the 15 model demonstrator cities which will receive support in the form of field advisory services provided by a group of high level experts and peer reviewers, and will offer the possibility for city representatives to participate in a series of capacity building and networking seminars. The advisory services will include a self assessment to determine the digital maturity of our city and to identify the starting points for discussion on how to (further) develop and improve our digital transformation strategies. The self assessment will be coupled by Key Performance Indicators that can diagnose the current status in terms of digital maturity and measure the progress made during and at the end of The Digital Cities Challenge initiative. We would therefore like to ask you to join us in this process by completing the Self Assessment tool and providing us with data for the construction of the Key Performance Indicators.

PUBLIC TRANSPORTATION COMPANIES QUESTIONNAIRE

Question 1 Please provide the number of public transportation tickets purchased online in last 12 months

Question 2 Please provide the number of public transportation tickets purchased in last 12 months

DIGITAL Cities

24

Industry associations Our city has been selected to participate in The Digital Cities Challenge, an initiative of the European Commission that enables cities to foster local innovation ecosystems for digital transformation and industrial modernisation. Specifically, our city will be among the 15 model demonstrator cities which will receive support in the form of field advisory services provided by a group of high level experts and peer reviewers, and will offer the possibility for city representatives to participate in a series of capacity building and networking seminars. The advisory services will include a self assessment to determine the digital maturity of our city and to identify the starting points for discussion on how to (further) develop and improve our digital transformation strategies. The self assessment will be coupled by Key Performance Indicators that can diagnose the current status in terms of digital maturity and measure the progress made during and at the end of The Digital Cities Challenge initiative. We would therefore like to ask you to join us in this process by completing the Self Assessment tool and providing us with data for the construction of the Key Performance Indicators.

EDUCATIONAL ESTABLISHMENT QUESTIONNAIRE

Question 1 Please provide the number of students on a digital subject related diploma (e.g. computer engineering, big data, cybersecurity, web design, artificial intelligence etc.) currently enrolled in your educational establishment

Question 2 Please provide the number of students enrolled in your educational establishment

Question 3 Please provide the number of foreign students on a digital subject related diploma (e.g. computer engineering, big data, cybersecurity, web design, artificial intelligence etc.) currently enrolled in your educational establishment

Question 4 Please provide the number of foreign students enrolled in your educational establishment

Question 5 Please provide the number of ICT graduates over the last 5 years employed in the city

Question 6 Please provide the number of ICT graduates over the last 5 years

Question 7 Please provide the number of non ICT diplomas including digital courses (e.g., in medicine, economics, biology, agriculture, etc.)

Question 8 Please provide the total number of diplomas available at your educational establishment

DIGITAL Cities

25

Financial institutions Our city has been selected to participate in The Digital Cities Challenge, an initiative of the European Commission that enables cities to foster local innovation ecosystems for digital transformation and industrial modernisation. Specifically, our city will be among the 15 model demonstrator cities which will receive support in the form of field advisory services provided by a group of high level experts and peer reviewers, and will offer the possibility for city representatives to participate in a series of capacity building and networking seminars. The advisory services will include a self assessment to determine the digital maturity of our city and to identify the starting points for discussion on how to (further) develop and improve our digital transformation strategies. The self assessment will be coupled by Key Performance Indicators that can diagnose the current status in terms of digital maturity and measure the progress made during and at the end of The Digital Cities Challenge initiative. We would therefore like to ask you to join us in this process by completing the Self Assessment tool and providing us with data for the construction of the Key Performance Indicators.

Venture capitalist Our city has been selected to participate in The Digital Cities Challenge, an initiative of the European Commission that enables cities to foster local innovation ecosystems for digital transformation and industrial modernisation.

INDUSTRY ASSOCIATIONS QUESTIONNAIRE (in case industry associations are able to provide such information)

Question 1 Please provide the number of cases of digital companies using open data to develop a new service or to support their business operation. For each case provide a short description.

Question 2 Please provide the number of cases of non-digital companies using open data to develop a new service or to support their business operation. For each case provide a short description.

Question 3 3.1) Please provide the number of ICT clusters organised/formed in the city. 3.2) Please provide the number of ICT companies members of any other cluster in the city.

FINANCIAL INSTITUTIONS QUESTIONNAIRE

Question 1 Please provide the number of digital start-ups receiving a loan in last 12 months. Note Digital start-ups are young firms aged five or less years.

Question 2 Please indicate the availability of business angels for digital start-ups Yes No

Question 3 Please provide the number of digital start-ups receiving venture capital in the last 12 months

DIGITAL Cities

26

Specifically, our city will be among the 15 model demonstrator cities which will receive support in the form of field advisory services provided by a group of high level experts and peer reviewers, and will offer the possibility for city representatives to participate in a series of capacity building and networking seminars. The advisory services will include a self assessment to determine the digital maturity of our city and to identify the starting points for discussion on how to (further) develop and improve our digital transformation strategies. The self assessment will be coupled by Key Performance Indicators that can diagnose the current status in terms of digital maturity and measure the progress made during and at the end of The Digital Cities Challenge initiative. We would therefore like to ask you to join us in this process by completing the Self Assessment tool and providing us with data for the construction of the Key Performance Indicators.

Questionnaire

Dimensions Questions

Infrastructure

To what extent is the broadband infrastructure in your city helping to accelerate the digitalisation of local industry?

How advanced is the mobile internet coverage in the city?

What is the availability of free wireless internet in public spaces?

Is ICT being used in public transport to offer digital products and services, such as tickets and real-time traffic monitoring?

Are utilities providers (electricity, natural gas, water, sewage) using ICT to increase the effectiveness and efficiency of their activities?

How is ICT used in facility management for public and private buildings?

Is ICT being used in healthcare to offer e-health services?

How advanced is the usage of e-goverment services in the city?

VENTURE CAPITALIST QUESTIONNAIRE

Question 1 Please provide the number of digital start-ups receiving venture capital in the last 12 months

DIGITAL Cities

27


Open data

Are public sector institutions and organisations in the city involved in open data contribution?

To what extent is open data used in business development of digital companies (including start-ups)?

To what extent is open data used for policy making?

To what extent is open data used in business development of non-digital companies?

Digital skillset and education

Is the digital and entrepreneurial mind-set of children triggered at school?

To what extent can young people apply for higher education institutes in digital subjects such as IT, computer sciences, digital technologies?

How advanced is the level of digital training offered in higher education related to non-digital subjects in the city (e.g. medicine or economist students having relevant courses on ICT or digital)?

To what extent can individuals obtain training through courses organised by private companies or non governmental organisations in the city that aim at enhancing digital skills?

Are the companies in your city able to attract local IT talent?

Digital competencies of companies

Are manufacturing companies embracing Industry 4.0 concepts (mass customization, predictive maintenance, smart products…)?

Do the companies in your city have access to relevant local IT solution providers?

Is the use of digital processes in companies being driven by senior management?

To what extent are companies in your city using cybersecurity solutions and privacy procedures?

How advanced is the level of training offered by companies to their employees that are aimed at enhancing their digital skills?

Community

Is there a tech-community in the city with stakeholders from various sectors (e.g. government, financial services, healthcare, etc.)?

Is there collaboration amongst digital and non-digital stakeholders from various sectors within the city (e.g. government, financial services, healthcare, etc.)?

Are there networking events for digital companies organised in the city?

DIGITAL Cities

28


Are there networking events that bring together digital and non-digital companies?

Finance

Is the city encouriging digital start-ups by providing grants / tax incentives?

Is the city encouraging digital development of non-digital companies by providing grants / tax incentives for digital projects?

What is the willingness of banks to provide bank loans to non-digital companies for digital projects in the city?

What is the willingness of banks to provide bank loans to digital companies in the city?

What is the willingness of private investors to invest in non-digital companies for digital projects in the city?

What is the willingness of private investors to invest in digital companies in the city?

Are there alternative financing practices to fund digital projects the city?

Support services

Are there innovation labs / accelerators / fablabs/ citylabs where non-digital companies can develop digital projects?

Does the city or its stakeholders create awareness about the importance of digital development for SMEs through testimonials or case studies?

Does the city or its stakeholders provide support services to its non-digital companies to foster digitalisation?

Governance and leadership

Does the city and its stakeholders have a shared vision on digital development?

Did the city assign one authority responsible for overall planning and implementation of a digital development plan?

Does the city have clear and defined measurable goals to monitor progress of a digital development plan?

DIGITAL Cities

29

Sample email to city stakeholders

Dear Ms/Mr, I am contacting you in the framework of the ‘Digital Cities Challenge’ initiative of the European Commission that has been launched in 2017 with the objective to fostering local capacity-building in digital transformation and industrial modernisation. Our city has been selected to participate in this initiative as one of the 15 model demonstrator cities which will receive support in the form of field advisory services provided by a group of high level experts and peer reviewers, and will offer the possibility for city representatives to participate in a series of capacity building and networking seminars. The advisory services will include a self-assessment to determine the digital maturity of our city and to identify the starting points for discussion on how to (further) develop and improve our digital transformation strategies. The concept of the self-assessment tool is that all relevant types of local stakeholders fill it in at the same time, hence, we cordially invite you to respond to the questionnaire on the Digital Cities Challenge website: <link to be inserted>. Please login to the tool by using the following password: <to be added> and fill in the questionnaire by the <add deadline>. Looking forward to your kind reply, With best regards,

DIGITAL Cities

30

ICT company definition

Please find below the codes for defying ICT companies for the purposes of the KPIs.

Table 1: ICT definition

NACE rev. 2 codes Description (operational definitions)

261-264, 582, 61, 62, 631, 951 ICT Total

261-264 ICT manufacturing industries (operational)

261 Manufacture of electronic components and boards

262 Manufacture of computers and peripheral equipment

263 Manufacture of communication equipment

264 Manufacture of consumer electronics

582, 61, 62, 631, 951 ICT services industries

61 Telecommunications

582, 62, 631, 951 Computer and related activities

Source: http://publications.jrc.ec.europa.eu/repository/bitstream/JRC106713/jrc106713_2017_predict_dataset_methodology.pdf

Date post:	07-Apr-2020
Category:	Documents
Upload:	others
View:	4 times
Download:	0 times

Guidelines to the Self-Assessment Tool and Key Performance ... · Pierre Bastien (Roland Berger)...

Documents