INSPIRE Conference - Krakow, Poland - June, 25 2010 1
INSPIRE Compliant Repository for Remote Sensing Data
Community Image Data Portal (CID portal)
Franck Eyraud, Pär-Johan Åstrand, Armin [email protected] [email protected],
http://cidportal.jrc.ec.europa.eu
INSPIRE Conference - Krakow, Poland - June, 25 2010 2
Presentation overview
Background
The CID portal
INSPIRE
Link with other initiatives
Data Policy
WorldView1, Maussane (FR) - © DigitalGlobe [2008]
WorldView2, Maussane (FR) - © DigitalGlobe [2010]
Geoeye-1, panmerge of Ljubljana (SI); ©Telespazio/e-Geos [2008]
INSPIRE Conference - Krakow, Poland - June, 25 2010 3
Presentation overview
Background
The CID portal
INSPIRE
Link with other initiatives
Data Policy
INSPIRE Conference - Krakow, Poland - June, 25 2010 4
BackgroundUse of Earth Observation (EO) data at the JRC• Heterogeneous storage and metadata management
• Large amount of image data: 100 000’s images, > 80TB
User requirements• Central storage with long-term archive (data curation)
• Image catalogue
• Access internally at high speed via file system
• Access via FTP and OGC services (WMS, WCS) from inside and from internet
• Access based on data licensing terms & conditions
INSPIRE Conference - Krakow, Poland - June, 25 2010 5
Presentation overview
Background
The CID portal
INSPIRE
Link with other initiatives
Data Policy The Community Image Data portal (CID);
http://cidportal.jrc.ec.europa.eu/imagearchive
INSPIRE Conference - Krakow, Poland - June, 25 2010 6
The CID portal - architectureFront End• Web server• Services• Loading application
Back End• Network attached storage• Metadata database• Loading scripts• Central authentication service
INSPIRE Conference - Krakow, Poland - June, 25 2010 7
Search data in the catalogue
Public access for data discoveryLimited preview (thumbnails)Reading metadata
Authenticated usersFull preview in HTML viewersDefine data service portfolios
Internal JRC usersFile system access to imagesVirtual file structures
The CID portal – Online image catalogue
INSPIRE Conference - Krakow, Poland - June, 25 2010 8
The CID portal – data servicesDiscovery : OGC CSWView : OGC WMS, ECWPDownload : OGC WCS, FTP
Processing : semi-automated orthorectification of various satellite sensors using area-based matching algorithmsimplemented also as OGC WPS service
Defined and activated through the Web portal
INSPIRE Conference - Krakow, Poland - June, 25 2010 9
Presentation overview
Background
The CID portal
INSPIRE
Link with other initiatives
Data Policy
INSPIRE Conference - Krakow, Poland - June, 25 2010 10
INSPIRE directiveCID decided to follow INSPIRE rules and principles
(COM (2006) 51: the INSPIRE infrastructure should cover spatial data sets and service held at Institutions and bodies of the EU)
Orthoimagery, Elevation data part of Spatial Data Themes in Annex IICID hosts Source imagery, Orthoimagery, Elevation data, and selected derived data
Regulation for network servicesDiscovery CSW is compliantView WMS is compliantDownload WCS (WFS not suitable for images)
Regulation for metadataINSPIRE concerns Orthoimagery metadata applied also to raw images
INSPIRE Conference - Krakow, Poland - June, 25 2010 11
INSPIRE - metadataMetadata already present in existing catalogueGeographical bounding box Temporal extentSpatial resolution Condition applying to access and useResponsible party name & role Metadata point of contact & dateResource type & identifier Resource & metadata language
Metadata that had to be added for INSPIRE compliancyResource title Resource abstract Resource locatorTopic categories Keywords Lineage
Adapted the databaseChanged the loading application to include them
INSPIRE Conference - Krakow, Poland - June, 25 2010 12
Presentation overview
Background
The CID portal
INSPIRE
Link with other initiatives
Data Policy
INSPIRE Conference - Krakow, Poland - June, 25 2010 13
Link with other initiativesINSPIRE Geoportal
CID catalogue harvested from http://www.inspire-geoportal.eu/
GEO/GEOSSEuropean Commission member of GEOCID portal registered as component and service : part of the GEOSSFollowing evolution on data sharing policy
GENESI DR / DEC (Ground European Network for Earth Science Interoperations)FP7 projects led by ESACID portal is an integrated repository of the GENESI network
GMESProviding experience feedback and knowledge on data access and data policy for the GMES Data Access Portfolio, for the Delegation Agreement and for GMES Initial Operations
INSPIRE Conference - Krakow, Poland - June, 25 2010 14
Presentation overview
Background
The CID portal
INSPIRE
Link with other initiatives
Data Policy Area of focus for spatial data policy © H Dufourmont, GMES, 2009
INSPIRE Conference - Krakow, Poland - June, 25 2010 15
Data PolicyAccess to EO data and their usage is regulated by the various licensing terms and
conditions imposed by image providers
To fulfill its public tasks JRC needs to share data with• other Institutions and bodies of the EU and their contractors• Grant Holders benefitting from a grant attributed by the European
Commission• Public authorities• Research/Academic organisations• International organisations and NGO’s for humanitarian and development
purposes
through data services: discover, view, download
Imperative for JRC to negotiate adequate licensing Terms & Conditions in Framework Contracts to permit adequate data usage
INSPIRE Conference - Krakow, Poland - June, 25 2010 16
LR, MR data: free of charge, or at production cost (e.g. NOAA, NASA, or ESA Cat 1), but not always distributable directly to all without permission.
HR data: some of coarser res. moving to free of charge, or at production cost (e.g. Landsat), also free of charge if specific research collaboration/ benchmark, but otherwise relying on commercial T&C.
VHR data: free of charge if specific research collaboration or benchmark, but otherwise always following commercial T&C.
Data Policy - the JRC case (80+ TB data)
Image courtesy: Eumetsat © Meteosat, ESA Envisat Meris, SPOTImage © CNES SPOT, Eurimage © DigitalGlobe Quickbird.
LR= Low Resolution (resolution km range), MR=Medium Resolution (100’s of meters resolution)
HR= High Resolution (resolution 5-100m), VHR= Very High Resolution (< 5m resolution)
INSPIRE Conference - Krakow, Poland - June, 25 2010 17
Data Policy - new JRC Framework ContractsOpen / Negotiated tendering to set up Framework Contracts in 2009/2010 for all major
commercial satellite image providers
Licensing Terms & Conditions (T&C) in new JRC Framework Contracts took into account data sharing principles of initiatives
• INSPIRE• GEO/GEOSSand followed the Commission Communication:• COM (2006) 51: the INSPIRE infrastructure should cover spatial data sets and services held at
Institutions and bodies of the EU
=> Clear definition and transparent T&C for• user categories: e.g. Institutions and bodies of the EU, Public Authority, research organisation,
etc.• data types: source, primary derived data, secondary derived data• data sharing services: discovery, view, download
Similar principles are being applied to satellite remote sensing data for the GMES Delegation Agreement (DA) and the GMES Initial Operations (GIO) (2010-2013)
INSPIRE Conference - Krakow, Poland - June, 25 2010 18Type A USER CATEGORIES:
• Institutions and bodies of the EU and their contractors for the EU Public tasks• Grant Holders for the EU Public tasks• Public Authorities within 1/9 chosen GEO Societal Benefit Area
Type C USER CATEGORIES:
• Type B without restriction to any of the 9 GEO Societal Benefit Areas• VIEW services to PUBLIC of primary derived product
Type B USER CATEGORIES:
• Type A plus:• Research and Academic Organisations within the chosen 1/9 GEO Societal Benefit Area• International Organisations and Non-Governmental Organisations for humanitarian and development purposes within the chosen 1/9 GEO Societal Benefit Area
VIE
W to
any
use
r
VIE
W ,
DO
WL
OA
D to
allo
wed
use
r
DIS
CO
VE
RY
to a
ny u
ser
CID portal Data Licensing T&C; user categories and usage services :
mark-up % in product price between Licensing Type A, Type B, and Type C
INSPIRE Conference - Krakow, Poland - June, 25 2010 19
Thank you !
Franck Eyraud, Pär-Johan Åstrand, Armin [email protected], [email protected],
http://cidportal.jrc.ec.europa.eu
INSPIRE Conference - Krakow, Poland - June, 25 2010 20
CID portal overviewJRCData Owner
DataProvider
JRC staff
User
DATAstorage
METADATAdatabase
SRS dataprocessing
SRS dataacquisition
SRS dataloading
AUTH.service
NFS4CIFS
AUTH.service
CSWWMS WCS
KML
CID spec.service
CIDdata serving
serviceActor
INSPIRE Conference - Krakow, Poland - June, 25 2010 21
Data Policy (extra)JRC Framework Contracts with commercial image providers
Sensors involved:Quickbird2 ; [Worldview1/2] ; [Landsat5/7, LDCM] ; Terra/Aster ; ENVISAT/ASAR ; RADARSAT1,2 ; Cartosat2 ; Theos [Ikonos2, GeoEye1] ; CSK (1-3) ; Eros A, B ; [SPOT 1, 2, 4, 5, SPS, Pleiades, Kompsat2, Formosat2] ; DMC all series ; RapidEye 1-5 ; [TerraSAR-X, Tandem X] , [IRS P5 (Cartosat1), IRS P6 (Resourcesat-1)]
JRC Licensing Terms and Conditions (T&C) overrule image providers T&C.
