+ All Categories
Home > Documents > Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey...

Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey...

Date post: 03-Jul-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
23
C3S User Satisfaction Survey Report (2017) Issued by: Copernicus User Support, ECMWF Date: 15 th September 2017 ECMWF COPERNICUS I REPORT 0G permicus Europe's eyes on Earth ernicus Climate Change Service C opermicus Europe's eyes on Earth IMPLEMENTED BY ECMWF
Transcript
Page 1: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

C3S User Satisfaction Survey Report (2017)

Issued by: Copernicus User Support, ECMWF

Date: 15th September 2017

ECMWF COPERNICUS I REPORT

0GpermicusEurope's eyes on Earth

ernicus Climate Change Service

CopermicusEurope's eyes on Earth

IMPLEMENTED BY

ECMWF

Page 2: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

Contents

Executive Summary ......................................................................................... 1

About the survey ............................................................................................. 3

Target audience............................................................................................ 3

The questionnaire ......................................................................................... 4

Q1: Where are you based?................................................................................ 6

Results........................................................................................................ 6

Recommendations......................................................................................... 6

Q2: Which sector does your organisation belong to?.............................................. 8

Results........................................................................................................ 8

Recommendations......................................................................................... 8

Q3: Overall, how satisfied are you with the Copernicus Climate Change Service? ....... 9

Results........................................................................................................ 9

Recommendations......................................................................................... 9

Q4: How useful are the C3S products and services for you, and how satisfied are you with them? ....................................................................................................10

Results.......................................................................................................10

Recommendations........................................................................................11

Q5: If you use the ERA-Interim or ERA5_test datasets, how do you download this data?............................................................................................................12

Results.......................................................................................................12

Recommendations........................................................................................13

Q6: How useful are, and how satisfied are you with non-data services? ...................14

Results.......................................................................................................14

Recommendations........................................................................................16

Q7: What would you like to see in the future from C3S?........................................18

Results.......................................................................................................18

Recommendations........................................................................................19

Q8: Do you have any other suggestions how we can improve the Copernicus Climate Change Service for you? ..................................................................................20

us

Page 3: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

1

Executive Summary

Users of the Copernicus Climate Change Service (C3S)1 are overall satisfied with the service provided by C3S and rate the service with an overall satisfaction rating of 85% (3.4 out of 4).

C3S serves a global user community: 60% of survey participants are from outside Europe, and 40% from Europe. Within Europe significantly more participants are from Western European countries than from Eastern Europe. Globally three quarters of respondents are academics and researchers, and within Europe two thirds work in this sector, other users are equally based in the private and public sector.

The utility of C3S products and services varies significantly: by far the most popular service is the support service for ERA-Interim reanalysis data (an ECMWF dataset for which the Copernicus User Support Team provides a technical support service). This service also receives the highest satisfaction ratings. Other C3S products are primarily monthly charts, plus some pre-release data and services. For all of these products user uptake and satisfaction ratings are low, however, considering that all of these products are still under development and many still in early stages, the low user numbers should not give cause for concern. Indeed, many feature requests raised in the survey are already planned for implementation in upcoming products and services like ERA5, seasonal forecasts and Climate Data Store (CDS), indicating that C3S is well aligned with user requirements.

Users are also mostly satisfied with supporting services, in particular with the available data access mechanisms and with the C3S service desk. However, the newer C3S services seem to attract more users with non-meteorological background who require other data access mechanisms, data formats and documentation than the meteorological community. Another issue is low awareness of C3S communications activities like the C3S newsletter and mailing list.

For the upcoming ERA5 and CDS there is a clear requirement for reanalysis data in high spatial and temporal resolution, and for the data portal for online processing and visualisation tools, as well as for tools for custom data extracts. All these requirements will be met by ERA5 and the CDS.

The usage demographics, usage patterns and satisfaction ratings reflect the heritage of C3S as a science driven service. C3S did not so far manage to establish itself firmly in the commercial and public sector.

The survey identified three main areas for improvement: (a) the footprint of C3S in Eastern Europe (b) the attractiveness of C3S to private and public sector users, (c) access to future products tailored to users’ specifications. It was highlighted that some users were having difficulties downloading large amount of data with the current infrastructure. The upcoming CDS plus the toolbox will play a vital role attracting more and more users, as they will serve the data as well as providing the computing power.

Respondents to the survey are mostly users of the ECMWF ERA-interim dataset and respondent numbers from other products and services are too small to further stratify

1 http://climate.copernicus.eu

C'k

Page 4: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

2

and derive meaningful conclusions. Hence the results of this survey should be considered indicative but not representative of the overall utility and satisfaction with C3S.

This being the first C3S User Satisfaction Survey, no trends can be identified. The survey establishes a baseline for future annual surveys though.

C'k

Page 5: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

3

About the survey

Gathering of user feedback is important in Copernicus and is currently under development at programme level at the European Commission (EC), with pilot survey run in partnership with ESA (for the Copernicus Open Access Hub) and EEA (for the Copernicus Land Monitoring Service - CLMS Pan-European and Local components). Having collaborate/coordinated with the European Commission, the Copernicus User Support Team at ECMWF (European Centre for Medium-Range Weather Forecasts) conducted the first CAMS user satisfaction survey in 2017.

Target audience

The purpose of the C3S user satisfaction survey 2017 was to understand how satisfied C3S users are with services provided, to collect feedback, analyse them and help improve C3S services.

The survey was carried out via an online questionnaire, in English only, which was open from 13th June to 8th July 2017.

An invitation to participate in the survey was sent to 24,878 distinct email addresses:

24,707 registered users of the ERA-Interim reanalysis dataset 406 registered users of C3S User Support 94 registered subscribers of the C3S newsletter

(Some users are registered for multiple services, so the figures do not add up.)

The survey was also advertised to the public via the C3S newsletter, the C3S and Copernicus websites and C3S and Copernicus social media.

The survey targeted primarily registered users of C3S. This is to capture the actual use of C3S, rather than awareness among the general public. This also means primarily users of ERA-Interim, user support and the newsletter were captured; for monthly maps and plots on the C3S website, which are accessible anonymously, only a small number of users is captured (the ones who also are in one of the target groups) and the survey results do not indicate the overall number of maps/plots users.

The vast majority of addressees comes from the ERA-Interim user group. The ERA-Interim dataset is an ECMWF data product predating C3S, but C3S provides a technical support service for this data, hence users of this product are included in the survey. In this report we refer to C3S products other than ERA-Interim as ‘C3S core products’(Monthly temperature maps, Monthly sea ice maps, Seasonal forecast charts) and exclude ERA-Interim users from analysis where appropriate. Also, no analysis is carried out for satisfaction with ERA-Interim, since this product is to be replaced by the forthcoming ERA5 product.

In total 1,298 responses were collected (1,280 responses from email invites plus 18 from web links), i.e. the overall response rate is response rate 5.2%. Out of the 1,298 responses 72 responses (6%) are from users of C3S core products (products excluding ERA-Interim as described above), and 38 responses (3% of total) from EU-based users of C3S core products.

EU-based non-EU-

based

Total

responses

EU-based non-EU-

based

Total

responses

C'k

Page 6: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

4

core products 38 34 72 core products 3% 3% 6%

ERA-Interim 346 880 1,226 ERA-Interim 27% 68% 94%

Total responses 384 914 1,298 Total responses 30% 70% 100%

Table 1: Responses by product type and region, absolute numbers (left) and percent of total (right)

This is the first C3S User Satisfaction survey, hence it is not possible to identify trends in the analysis.

For further information please contact [email protected].

The questionnaire

The following questionnaire was used:

Q1: Where are you based? (List of countries and territories)

Q2: Which sector does your organisation belong to? (Public authorities / University and Research / Commercial or private sector / International organisation, NGO / Other)

Q3: Overall, how satisfied are you with the Copernicus Climate Change Service? (1 = not satisfied, 4 = very satisfied)

Q4: How useful are the following C3S products and services for you, and how satisfied are you with them?

Reanalysis data (Era-Interim) Monthly temperature maps Monthly sea ice maps Seasonal forecast charts

Q5: If you use the ERA-Interim or ERA5_test datasets, how do you download this data? I usually use…

Variables (temperature, precipitation, wind, etc.): A single parameter or species / A few at a time / Many

Dates: A single date / Multiple dates / Long time series Height levels: Surface only, or a single specific model or pressure level / Multiple

model or pressure levels / All model or pressure levels

Q6: How useful are, and how satisfied are you with ...

C3S website Automated data download (WebAPI) Data download portal (apps.ecmwf.int) Available data formats Documentation Knowledge base Helpdesk / Support Mailing list Newsletter

Q7: What would you like to see in the future from C3S?

Interactive web maps Subset data to a specific geographical area

C'k

Page 7: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

5

Time series at custom locations Vertical profiles at custom locations Additional variables More OGC services (WMS, WCS) More documentation Additional data formats Additional units of measurement Other

Q8: Do you have any other suggestions how we can improve the Copernicus Climate Change Service for you?

C'k

Page 8: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

6

Q1: Where are you based?

Results

The survey respondents are distributed across the globe, with the largest numbers in South and East Asia. Among all respondents, 30% are based in the European Union, and there mostly in Western Europe(Figure 1).

Excluding ERA-Interim users, 53% of responses are EU-based (Figure 2), and again Western Europe is dominant.

Recommendations

Respondent numbers are relatively high in Western Europe and low in Eastern Europe. Future C3S user uptake activities should consider targeting specifically users in Eastern Europe.

C3S core products are accessed anonymously, thus only few user contact details are available for the user satisfaction survey. Future surveys should target users more through anonymous channels, e.g. the C3S website.

Figure 1: Geographical distribution of all respondents, where >= 1% of total (total 1,294 responses)

CI\

India

8.3%China

7.4%Indonesia

United Statesof America

5.4%

United Kingdomof Great...

4.9%

Germany 4.3%

Brazil 4.2%

Iran (IslamicRepublic of) _111 3.8%

Italy 3.6%

Spain 3.2%

France 2.8%

Republic ofKorea 2.6%

Canada 2.1%

Portugal 2.1%

Japan 1.9%

RussianFederation 1.6%

Australia 1.5%

Norway 1.5%

Taiwan 1.5%

Greece 1.4%

Netherlands 1.2%

Nigeria 1.2%

Vietnam 1.2%

Argentina _I.1.2%

Colombia111111

1.2%

0% 1% 2% 3% 4% 5% 6% 7% 8% 9% 10%

Page 9: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

7

Figure 2: Geographical distribution of respondents using C3S core products (72 responses)

United Kingdomof Great...

United Statesof America

Germany

China 5.6%

France 5.6%

Iran (Islamic5.6%Republic of)

Italy 5.6%

Spain 4.2%

Belgium 2.8%

Brazil 2.8%

Canada 2.8%

India 2.8%

Nigeria

Argentina ■

Australia ■

Austria ■

Benin ■

1.4%

1.4%

1.4%

1.4%

Cameroon 1.4%

Czech Republic ■ 1.4%

Ecuador II 1.4%

Finland ■ 1.4%

Greece ■

1.4%

Indonesia

Israel

Luxembourg

Netherlands ■

Norway ■

RussianFederation

1.4%

1.4%

1.4%

1.4%

1.4%

1.4%

Uganda ■ 1.4%

2.8%

9.7%

16.7%

0% 2% 4% 6% 8% 10% 12% 14% 16% 18% 20%

Page 10: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

8

Q2: Which sector does your organisation belong to?

Results

At 76% a vast majority of respondents work in academia and research, followed by 13% in the public sector (Figure 3). Looking only at EU-based responses, the picture is similar but less pronounced (Figure 4).

Excluding users of the ERA-Interim dataset, i.e. considering only users of core C3S products like plots and charts, academia is still dominant with 47% of responses, but the commercial sector is strongly represented at 23% and the public sector at 19% (Figure 5).

This indicates that (a) the C3S core products find significant uptake in the private and public sector, and (b) compared to previous climate data products like ERA-interim the user base is becoming less academic.

Figure 3: Responses by sector, all (1,295

responses)Figure 4: Responses by sector, EU only (383

responses)

Figure 5: Responses by sector, C3S core

products (74 responses)

Recommendations

The strong interest from the private and public sector in the core C3S products is encouraging and suggests that no radical changes to the C3S product strategy are required.

Other4% (46)

Commercial orprivate sector

7% (87)

76% (983) University andResearch

8Other%(6)

Internationalorganisation, NGO

3% (2)

Commercial orprivate sector

23% (17)

Public authorities(European, Nationalor local)

0 (162)

Public authorities(European, Nationalor local)

9% (14)

University andResearch 47% (35)

Other -\2% (9)

Commercial orprivate sector

13% (51)

62% (239) University andResearch

C'k

Public authorities(European, Nationalor local)

20% (78)

Page 11: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

9

Q3: Overall, how satisfied are you with the Copernicus Climate Change Service?

Results

Over 90% of respondents are ‘very satisfied’ or ‘mostly satisfied’ (Figure 6), indicating high utility and quality of C3S products and services. This result refers mostly to ERA-Interim, reflects how well established ERA-Interim product is, and also indicates significant demand for the upcoming ERA5 product.

Figure 6: Overall satisfaction, all responses (827 responses)

Looking only at C3S core products, respondents are still highly satisfied, albeit overall satisfaction is lower (Figure 7). This is mostly due to many service elements still being under development and available only in limited ways, e.g. as plots but not data.

Respondent numbers for the C3S core products are too low to further stratify, e.g. by industry sector and region, and derive meaningful conclusions.

Figure 7: Overall satisfaction, C3S core product users (39 responses)

Recommendations

The results indicate that current and future C3S products and services are considered useful by the targeted user communities, and they suggest that the current service strategy is suitable and should be pursued further.

“Actually, it is my first time using your

services”

“We are waiting for ERA5. Pre-release

support has been helpful”

“It would be important to have access

not only to chart but also to numerical

values”

Selected respondents’ comments (see

annex for all comments):

“I was only aware of ERA-Interim

products - not any others. However, I

am very satisfied with ERA-interim”

“An invaluable resource in my

research”

very satisfied --52% (431)

very satisfied38% (15)

not satisfied( 3% (22)

somewhat satisfied5% (43)

not satisfied13% (5)

— mostly satisfied40% (331)

somewhat satisfied10% (4)

mostly satisfied38% (15)

Page 12: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

10

Q4: How useful are the C3S products and services for you, and how satisfied are you with them?

Results

The vast majority of respondents work with reanalysis data, i.e. the ERA-Interim product, and this group is highly satisfied with the services provided (Figure 8).

At the time of the survey many core C3S products are still forthcoming (e.g. ERA5, seasonal forecast), but there is alreadyremarkably high awareness of these products among respondents, indicating that these products will meet significant demand.

Figure 8: Utility and satisfaction with products and services, all responses (802 responses)

Looking only at users of C3S core products (Figure 9), many respondents in this group also use reanalysis data, indicating that the C3S core products and reanalysis data are complementary to each other rather than mutually exclusive.

“This Interim data is a very valuable

source for researchers.”

“I haven’t look at seasonal forecasts

but probably I'll do in the future.”

How useful

Reanalysis I

data...

Monthly

temperature...

Monthly sea

Ice maps

Seasonalforecast

charts

Reanalysis

data...

Monthly

temperature...

Monthly seaIce maps

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

▪ Am not aware of it • Irrelevant 1.1 Somewhat useful Very useful

▪ Essential

How satisfied

Seasonal I

forecast

charts

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

1. Not satisfied at all El Somewhat satisfied • Very satisfied

▪ Extremely satisfied

Page 13: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

11

The monthly maps and seasonal charts are considered useful, despite the underlying data not being provided yet.

However, while awareness of these C3S core products was surprisingly high among all users, many users of C3S core product are only aware of specific products, and not of the overall portfolio.

Most respondents are ‘extremely satisfied’ or ‘very satisfied’ with the C3S core products. Anecdotal evidence suggests the main limiting factor is that currently mostly plots are available, but not numerical data. C3S will release more numerical data in 2017/18 though, reducing these barriers.

Respondent numbers for the C3S core products are too low to further stratify and derive meaningful conclusions.

Figure 9: Utility and satisfaction with products and services, (36 responses)

Recommendations

The current C3S user community requires access to numerical data and eagerly awaits the release of data from C3S, in particular the ERA5 and seasonal forecast products. Corresponding work is ongoing at C3S and should continue.

The user community is highly familiar with reanalysis data; this suggests there will be strong uptake of the forthcoming ERA5 product. Other products are not well known and C3S should consider increasing efforts to communicate the overall service portfolio.

“It would be great if the seasonal

forecast data were free

downloadable”

“I only use and need data not maps

or charts.”

Reanalysisdata...

Monthlytemperature...

Monthly seaIce maps

Seasonalforecastcharts

Reanalysisdata...

Monthlytemperature...

Monthly seaIce maps

How useful

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

▪ Am not aware of it • Irrelevant Somewhat useful • Very useful

In Essential

How satisfied

Seasonalforecastcharts

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Er Not satisfied at all Somewhat satisfied In Very satisfied

▪ Extremely satisfied

Page 14: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

12

Q5: If you use the ERA-Interim or ERA5_test datasets, how do you download this data?

Results

This question relates more to user requirements than to current user satisfaction and was included to inform the evolution of the technical service infrastructure.

Among all respondents an overwhelming majority (69%) works with time series data, again reflecting the dominance of reanalysis users in the survey population (Figure 10).In terms of parameters and vertical levels no clear picture emerges, indicating diversity of user applications.

Figure 10: Reanalysis data access patterns, all respondents (772 responses)

Looking only at users of C3S core products the pattern is very similar (Figure 11), except that these respondents are particularly interested in all vertical levels of the atmosphere: 14 out of 34 respondents to this question said they download all model or pressure levels, and out of these 14 respondents 10 are academics, so this pattern appears to be driven by academic interest. Respondent numbers are too small to derive meaningful conclusions though.

I usuallydownload ...

Variables (temperature, precipitation, wind. etc.)

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

1.1 A single parameter El A few at a time 1.1 Many

Dates

I usuallydownload ...

I usuallydownload ...

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

A single date Multiple dates 1.1 Long time series

Height levels

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Surface only, or a single specific model or pressure level

El Multiple model or pressure levels All model or pressure levels

Page 15: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

13

Figure 11: Reanalysis data access patterns, users of C3S core products (34 responses)

Recommendations

There is significant demand for long term climate data. C3S seems to meet this demand well and should continue to do so.

In the evolution of the technical service infrastructure C3S should implement facilities and tools that allow (a) rapid access to time series data at surface level and (b) custom data extracts.

I usuallydownload ...

Variables (temperature. precipitation, wind, etc.)

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

1.1 A single parameter El A few at a time I Many

Dates

I usuallydownload ...

I usuallydownload ...

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

El A single date III Multiple dates II Long time series

Height levels III

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

• Surface only, or a single specific model or pressure level

1.1 Multiple model or pressure levels • All model or pressure levels

Page 16: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

14

Q6: How useful are, and how satisfied are you with non-data services?

Results

This questions relates not to C3S data services, but to supporting C3S services. Respondents to this question again are mostly users of ERA-Interim, thus answers are at best indicative, but not representative of satisfaction with the overall portfolio of services supporting C3S.

This demographic are mostly professional and experienced users of climate data and of the ECMWF data archive, so they are mostly interested in the actual data and rate accessmechanisms to the data most important, including formats they are familiar with, data download options, and documentation (Figure 12).

Many of the free text comments submitted on this question state performance and availability issues with the current data access mechanisms. C3S expects that the C3S Climate Data Store (CDS), a new data access platform forthcoming in 2017/2018, will be mitigating many of these issues.

C'k

Page 17: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

15

Satisfaction with supporting services is overall very high, although in all supporting services there also is a significant number of respondents who are only ‘somewhat satisfied’, suggesting that not all user requirements are met.

Figure 12: Utility and satisfaction with supporting services, all respondents (743 responses)

“We use ERA interim for our

commercial products. We are not

satisfied with the service

because: a) data comes out very

late, compared to MERRA, CFSR

b) downloading ERA-Interim is a

pain”

“I find the [data portal] interface

difficult to use. It's hard to find

what I need to download.”

“The data download speeds are

very slow.”

C3S webslte

Automateddata

download...

Datadownload

portal...

Available dataformats

Documentation

Knowledgebase

Helpdesk /Support

Mailing list

Newsletter

How useful

1M-•

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Am not aware of it Irrelevant r Somewhat useful Very useful El Essential

C3S website

Automateddata

download...

Datadownload

portal...

Available dataformats

Documentation

How satisfied

Knowledge Ibase

Helpdesk / ISupport

Mailing list I

Newsletter

-"M

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Not satisfied at all • Somewhat satisfied Very satisfied 111 Extremely satisfied

Page 18: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

16

Looking only at users of C3S core products and services, responses are similar to the overall population (Figure 13). Notably users of C3S core products use less the available documentation and to a greater extent rely on personal support and advisory.Considering that these users predominantly use new and in many cases pre-operationalproducts and services, this pattern is not surprising.

The existing communication channels (website, mailing list and newsletter) seem to have little relevance for users.

Users of C3S core products and services are satisfied with the available data download options, despite anecdotal evidence indicating widespread technical problems.

Satisfaction is lowest with the available documentation anduser communications (website, mailing list and newsletter).

Figure 13: Utility and satisfaction with supporting services, users of C3S core products (37 responses)

Recommendations

The overall survey population is biased by users of the ERA-interim data and the ECMWF data portal. For C3S these will be replaced by the ERA5 data and CDS platformforthcoming in 2017/2018, so no actions should be taken related to ERA-Interim and the ECMWF data portal.

“C3S is still developing its' services,

we'll have to wait and see. WebAPI

is considered very useful, especially

for business but it's not user

friendly.”

“The data download speeds are very

slow. The amount of time a request

takes while being processed on a

mars server is very long.”

C3S website

Automateddata

download...

Datadownload

portal...

Available dataformats

Documentation

Knowledgebase

Helpdesk /Support

Mailing list

Newsletter

Answered: 37 Skipped: 37

How useful

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Am not aware of it • Irrelevant 1.1 Somewhat useful El Very useful Essential

How satisfied

C35 website

Automateddata

download...

Datadownload

portal...

Available data

■formats

Documentation I

Knowledge

■base

Helpdesk /Support

Mailing Ilst

Newsletter

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Not satisfied at all 1.1 Somewhat satisfied i Very satisfied Extremely satisfied

Page 19: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

17

Development of the CDS platform should make sure the CDS provides adequate download speed and performance and is not subject to bottlenecks like the ones encountered with the ECMWF data portal.

For C3S core products it is suggested that documentation and communication tools should be improved.

C'k

Page 20: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

18

Q7: What would you like to see in the future from C3S?

Results

Among the overall survey population, i.e. mostly ERA-interim users, there is a strong demand for data processing tools, in particular tools to extract data for custom time series, specific locations and areas, and vertical profiles (Figure 14). These users seem to prefer local processing and visualisation tools over online tools.

Free text comments highlight demand specifically for:

Data formats: NetCDF, ASCII/TXT/CSV, GRIB Additional marine parameters (rather than atmospheric) Additional scientific documentation (rather than technical documentation)

Figure 14: Feature wish list, all respondents (750 responses)

“It would be great if we could have

a table in txt or csv format for a

location (point), based on lat and

lon information which would be

informed by the user.”

“Data formats should be available

for a more user friendly experience,

such as txt, csv, excel and also

more "plug and play" GIS formats

such as SHP.”

“Interactive monthly or lower

resolution maps for any cross

section.”

“Rather than more documentation,

clearer documentation is key! E.g. it

took quite some time to understand

how the fluxes were integrated in

time.”

“Quick links to parameter

explanation could be useful.”

“Ocean variables, measurements

rather than models”

“Frozen soil depth variable would be

good for forest industry in cold

regions”

“Pressure level heat flux data and

heating rate”

“Surface wind (…) hourly, daily,

monthly”

Interactive

■web maps

Subset data

to

a specific...

Time series at

custom...

Vertical

profiles at...

Additional

variables...

More OGC

services

(WM...

More

documentatio.

Additional

data

formats...

Additional

units of...

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

1.1 Not important 1.1 Nice-to-have Important a Very important

Page 21: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

19

Users of C3S cores products and services request largely the same features as the overall survey population, i.e. customized data extracts for time series, areas and vertical profiles, and also have with a higher demand for interactive maps, additional data formats and more documentation (Figure 15).

Figure 15: Feature wish list, users of C3S core products (35 responses)

Recommendations

The forthcoming release of ERA5 will make ERA-interim a legacy product, no actionsshould therefore be taken related to the ERA-interim data.

New C3S products and services should include tools for interactive online visualisation as maps and graphs and multiple options for customized data extracts.

New C3S products and services should provide data in GRIB, NetCDF and ASCII formats.

“Documents about wetland, land,

desertification, biodiversity, solar

power plants, dams & climate

change, water crisis, food crisis,”

“Re data formats: consider HDF Re

additional units of measurement:

consider geometric altitude”

“netcdf files, csv, .m”

Interactive

web maps

Subset datato

a specific...

Time series atcustom...

Vertical

profiles at...

Additional

variables...

More OGC

services

(WM...

More

documentatio..

Additional

data

formats...

Additional

units of...

.EN

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Not important • Nice-to-have II Important In Very important

Page 22: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

20

Q8: Do you have any other suggestions how we can improve the Copernicus Climate Change Service for you?

This is an open question. Respondents’ suggestions cover a wide range of scientific and technical topics and user applications for C3S products and services. Most suggestions reiterate conclusions from other questions though, hence no further analysis is undertaken and no additional recommendations are identified.

Specifically among user of C3S core products response numbers are too low for meaningful analysis.

“Climate science is not advanced

enough to provide a reliable service

yet. Hence you should first focus on

improving the science basis.”

“Simplify finding and accessing

data. The products and formats are

fantastic, but navigating the web

site, account authorizations, and

using the web APIs is cumbersome

and most of the time difficult.”

“Allow data processing online so we

don't have to download large

amounts of data and then analyse

them locally.”

“More info on where the data comes

from (e.g. map of weather

stations), and […] the modelling

that has been applied (suitable for

non-expert to understand!).”

“More training, like summer schools

and workshops”

C'k

Page 23: Europe's eyes on Earth - Homepage | Copernicus · conducted the first CAMS user satisfaction survey in 2017. Target audience The purpose of the C3S user satisfaction survey 2017 was

Copernicus Climate Change Service

climate.copernicus.eu copernicus.eu ecmwf.int

ECMWF Shinfield Park Reading RG2 9AX UK

us


Recommended