Finnish CollaborativeGround Segment

Jyri HeilimoFinnish Meteorological Institute

Finland NCP

Local reception of Sentinel-1 Direct Broadcast• Focus on NRT and Quasi-Real-Time

products• Baltic Sea Ice service

Sentinels’ data local mirror site• Safe long-term archive of scientific data• Local mirroring of: S1, S2, S3, S5P• Automated data processing lines for

specific products• Bulk processing• Sentinels data dissemination:

https://finhub.nsdc.fmi.fi

Data processing services• Virtualization environment for operational

product processing• Hosted processing (IaaS, PaaS)• Calvalus – Processing Cluster for

efficient Remote sensing data storageand processing

4.12.2018 FMI Arctic Space Centre

Finnish Collaborative Ground Segment

• Utilises the ESA developed DHuS system• Allows easy migration from Open Access

Hub• AOI covers Baltic Sea Drainage basin and

some more

• Operational and open for public since May2015

• Total 316 registered users• ~60% increase of users annually

• Mostly Finnish research institutes:• FMI, SYKE, VTT, …

• But also other European users• Nordic countries (SE, IS)• Baltic countries (EE, LV)• Switzerland, Italy, France, Germany …

• Also from overseas: Canada, Tunis, Japan, China, Zimbabwe

4.12.2018

FinHUB

FMI Arctic Space Centre

316

~90%

340 TB

367837

Data access• Focusing on Nordic and Arctic regions• Most data is available online • A single REST API to access Sentinels’ data

• HTTP(s) based, Open data protocol (Odata), Open Search (Solr) • Programing language agnostic• Easy migration from OpenHUB

• Safe long-term archive of scientific data• Ceph storage offers well scalable storage capacity• S3 object storage for efficient and fast data access• Current capacity ~800TiB

• OGC services supported for satellite data products• No self registration

• Statistics, audit trail of who access what

4.12.2018 FMI Arctic Space Centre

Tools and processing services• Virtualization environment for operational product processing

and hosted processing• Based on existing – mostly open source tools

• Libraries and CLI, Interactive GUIs• A catalogue of pre-defined VM images

• Pre-installed with tools relevant for use cases• Libraries, Desktop applications

• VM Images can contain direct data access via API clients• VM Images can be specialized and can cater for different

use cases• Leverage “big data” technologies, like Hadoop

• Calvalus – Processing Cluster• Smartmet/brainstorm server

4.12.2018 FMI Arctic Space Centre

• Flexibility, availability and response• Provide reliable access to Sentinels’ data for Finnish users and partners• Maintain local long-term archive of Sentinels’ data from Baltic sea region

• Scientific use, long-term change detection, data resilience• Special needs – special applications

• Provide fast access of S1 scenes for Baltic Sea ice monitoring and icebreaker support• Process local and/or NRT products

• e.g. Baltic Sea water quality, Flood detection and impact assessment etc.• Perform bulk processing of data for local use

• e.g. S2 L1b -> L1c with national DEM (TBC)• Operational since 2015 – DIAS’ enter into V0 in 2018

• Interface to DIAS’• FINHUB will run SMARTMET/BRAINSTORM - and GEOServer for in-situ and satellite

data• DIAS’ is will be one data source of FINHUB• FINHUB can use DIAS services

4.12.2018

Why National satellite data centre? How does it work with DIAS?

FMI Arctic Space Centre

APPLICATIONS AND SERVICES

4.12.2018 FMI Arctic Space Centre

Baltic Sea Ice Monitoring• Commercial and environmental needs

• Finland is essentially an island• ~90% of Finland’s import and export via sea routes• Gulf of Finland is one of the most busiest marine routes

for oil transport• Operative Service

• Availability target 99.9%• Quasi-real-time / NRT needs• Daily products

• Customer:• Finnish Transport Agency• Finnish, Swedish, Estonian Ice breakers• CMEMS

• Operations:• Fully automated processing lines at Sodankylä• Operators and ice analysts in 2 shift• 24/7 monitoring of the processing lines

4.12.2018

L1 processing

L2 processing

L0 processing

Ice Service

FMI Sodankylä

FMI Helsinki 24/7 monitoring

Ice analysts

S1CSK

CMEMSRSAT2CSKTSX

Data need:• Sentinel-1 EW HH+HV pass-through• Radarsat 2, Cosmo-Skymed, TerraSAR-X• AOI: Baltic Sea• Time: Nov – May

FMI Arctic Space Centre

Flood detection and monitoring• Annual flooding of rivers in Bothnia

• Spring floods due snow melt• Autumn floods due heavy rain

• Operational service for regionalauthorities

• Flood covered area, Flood depth• Forest floods

4.12.2018

• Data needs• SAR data: Cosmo-SkyMed and Sentinel-1• Polarisations: HH + HV • Time: Apr-May• Timeliness: NRT ~3hrs• AoI: Finland

FMI Arctic Space Centre

Terrain corrected SAR image Water detection

Removal of natural watersand bogs

Filtered flood areas

Flood extent and depthmaps

11

Copernicus Global Land Service Cryosphere products

Snow Extent, Snow Water Equivalent, Lake Ice Extent (by FMI, ENVEO, SYKE)Finnish Meteorological Institute (FMI), ENVEO and Finnish Environment Institute (SYKE) are producing daily near-real time products on snow cover and lake ice for Pan-European domain and Northern Hemisphere. The products have a long-standing legacy from ESA GlobSnow and EC Cryoland projects.

Lake Ice Extent (LIE) for Baltic Sea areaPan-European Snow Extent (SE)

Northern-Hemisphere Snow Extent (SE)

Northern Hemisphere SWE

Pan-European SWE

The cryosphere products have been developed in close collaboration between FMI, ENVEO and SYKE and will be produced jointly at the FMI production centre.

Issues, lessons learned and future plans• Ceph object storage

• Not compatible with DHUS• NFS mount of object storage is not as fast as local disc• Hopefully swift API will be updated to support Ceph

• Sentinels data format• Difficult to non-expert users• New data dissemination methods under development

• Future plans• Improve statistics collection• Migration to Docker• Ecflow to improve system monitoring

4.12.2018 FMI Arctic Space Centre

Kuva: Matias Takala

Contact info:Jyri HeilimoArctic Space CenterFinnish Meteorological Institute Erik Palménin aukio 1P.O.Box 503FIN-00101 HelsinkiFinlandTel: +358 50 568 0802Email: jyri.heilimo@fmi.fi

4.12.2018 FMI Arctic Space Centre