1 Tools and Components of the HUMBOLDT Framework Dr. Christine Giger (Swiss Federal Institute for...

1

Tools and Components of the HUMBOLDT Framework

Dr. Christine Giger (Swiss Federal Institute for Technology and Giger GeoIT)

HUMBOLDT Scientific Manager and Member of the Executive Board

Swiss National Contact Point for INSPIRE

Athens, Greece, March 28, 2011

HUMBOLDT Workshop HCMR, Athens, March, 2011 © 2011 HUMBOLDT Consortium Fraunhoferstraße 5 64283 Darmstadt http://www.esdi-humboldt.eu

2

Key components


3

The HUMBOLDT Framework

HUMBOLDT Conceptual Schema

Transformer


Transformer

HUMBOLDT Coordinate

Transformation Service

HUMBOLDT Coordinate


HUMBOLDT Edge Matching

Service


Service

Desktop GIS or

GIS-Client

Desktop GIS or

GIS-Client

HUMBOLDT Workflow Design andConstruction Service


HUMBOLDT Language


HUMBOLDT Language


HUMBOLDT GeoModel Editor


HUMBOLDT Alignment Editor

(HALE)


(HALE)

HUMBOLDT Mediator Service


Database/Repository

Database/Repository

HUMBOLDT Tools

HUMBOLDT Services

GI data integrator/ GIS developer

GI data integrator


End user of geodata or spatial information

configure/store model

provide data/ modelsDatabase access

involve mediator for process execution or directly access single services

execute services

specify workflow

specify schema translation

specify target

Provideworkflow definition

provide transformation specification

external servicesexternal services


4



Transformer


Transformer

HUMBOLDT Coordinate


HUMBOLDT Coordinate



Service


Service

Desktop GIS or

GIS-Client

Desktop GIS or

GIS-Client



HUMBOLDT Language


HUMBOLDT Language





(HALE)


(HALE)



Database/Repository

Database/Repository

HUMBOLDT Tools

HUMBOLDT Services


GI data integrator






execute services

specify workflow


specify target





5

Creation of Target

Creation of target

Target

User knowledge

Defining the information product (target schema, SRS, spatial extent, …) to

which the processed data needs to be transformed


6

The HUMBOLDT GeoModel Editor

UML editor developed to support the process of data specification

Main goals:

Easy-to-use for application experts

Collecting all required information on the data

Providing formal representation of the information in order to feed it into a harmonisation process

Implemented on a framework (Eclipse)

Usage of a “spatial UML” (HUMBOLDT modelling language)

Producing/providing a graphical and a textual representation of the data model

basic data model containing basic spatial data types

Support of vertical mapping: serialisation possible to transfer standards or other representation (e.g. XMI, GML, ISO19131, ...)


7


8



Transformer


Transformer

HUMBOLDT Coordinate


HUMBOLDT Coordinate



Service


Service

Desktop GIS or

GIS-Client

Desktop GIS or

GIS-Client



HUMBOLDT Language


HUMBOLDT Language





(HALE)


(HALE)



Database/Repository

Database/Repository

HUMBOLDT Tools

HUMBOLDT Services


GI data integrator






execute services

specify workflow


specify target





9

Process step: Schema to Schema Mapping

Source Target

Input for transformation

(mapping rules)

User knowledge

?


10

The HUMBOLDT Alignment Editor (HALE)

HUMBOLDT Alignment Editor is a tool for geodomain application experts and

GI experts, especially data custodians.

It provides means to create executable mappings on the conceptual level

and to derive the schema transformation on the logical level.

It provides the means to ensure the validity of a mapping on the base of the

source and target schema as well as on the base of the source and a

reference data set.

It uses schemas created in the HUMBOLDT GeoModel Editor or other

Modelling Tools.

It uses the Ontology Mapping Language (OML) to formalize the mappings

Output schema mapping transformed in GML


11

HALE

workflow:

1. Schemas Import (Shapefiles, WFS and GML Application Schemas)

2. Creation of mappings between classes, their attributes and relations.

3. Storing the mapping description either locally or in the HUMBOLDT Model

Repository

4. Output schema mapping transformed in GML


12


13

HALE functions

rename attributes

change geometry datatypes

fill an attribute by values (a given value, numerical expression,

NULL)

identifiers (specification of the key attribute, geographic name)

replace a date

replace strings

create new spatial objects

INSPIRE functions


14

Schema mapping operations

1. Filtering: conditional statements applied to source data to filter features (extract sub-sets)

Source Schema (VA)

Class „Gewaesser“

Att. „LEVEL“, values (selected)

Definition Value

Fluss, Bach ( > 20 m) (river, rivulet) 1

Fluss, Bach (5-20 m) 2

Fluss, Bach ( < 5 m) 3

Wasserleitung (unterirdisch) (pipe) 5

See, Teich (> 10 km) (lake, pond) 11

Sumpf, Moorboden (marsh, bog) 19

... ...

Class „Watercourse“

Target Schema (INSPIRE HY)

Class „Pipe“


Class „StandingWater“


Class „Wetland“



15


2. Reclassification of attribute values

Source Schema (BY)


Att. „Widmung“, values (selected)

Definition Value

1. Ordnung (Bundeswasserstraße)(1st order under federal law)

1501

1. Ordnung (Landesgewässer)(1st order under state law)

1502

Gewässer 2. Ordnung (2nd order) 1503

Gewässer 3. Ordnung (2nd order) 1504



Att. „waterCourseHierarchy “, values

1st

2nd

3rd

4th

5th

other


16


3. Renaming of feature classes or attributes

4. Merge / split of features or attributes

Source Schema (VA)


Att. „NAME“ (string)



Att. „geographicalName/spelling/text“ (CharacterString)

Source Schema (XY)

Class „Building“

Att. „NameOfStreet“ (string)

Att. „HouseNr“ (string)

Att. „City“ (string)

Target Schema (XY)

Class „Building“

Att. „Address“ (string)

5. Change of attribute order

concatenation


17


6. Type conversions

Spatial types

– Spaghetti lines to Network

– MultiLineString to LineString

– Line/Polygon to Point (centroid)

– Point/Line to Polygon (buffer)

– Polygon to Line (skeleton/centreline)

Other types

– Integer to float

– String to numeric

Example from German watercourses: < 12 m wide: line> 12 m wide: polygon


18


7 Value conversions

Spatial conversions

– Generalisation, e.g. simplification

– Conflation (but see: Merge)

Units of measurement

8 Augmentation’ Deriving values for target schema properties missing in source schema – based e.g.

on values of other properties in source schema (ex. using interpolation)

Adding derived spatial properties (e.g. centroid of a polygon)

Filling in default property values in target schema


19



Transformer


Transformer

HUMBOLDT Coordinate


HUMBOLDT Coordinate



Service


Service

Desktop GIS or

GIS-Client

Desktop GIS or

GIS-Client



HUMBOLDT Language


HUMBOLDT Language





(HALE)


(HALE)



Database/Repository

Database/Repository

HUMBOLDT Tools

HUMBOLDT Services


GI data integrator






execute services

specify workflow


specify target





20

WorkFlow Design and Construction Service

Allow users to register processes (WPS) to the system

Allow users to visually compose the workflow graph out of

geoprocessing components and data sources

Manual Workflow Definition, Automated Execution

Exports such workflows in different workflow dialects via a WSDL /

SOAP Interface


21

Analysis of input data sets to determine harmonisation requirements

Automated combination of processing services into executable workflows

Definition of “Basic Workflows” via Workflow Designer

WorkFlow Design and Construction Service


22

Workflow Design and Construction Service


23

© 2009 Humboldt Consortium / CEN/TC287 Workshop Malta



Transformer


Transformer

HUMBOLDT Coordinate


HUMBOLDT Coordinate



Service


Service

Desktop GIS or

GIS-Client

Desktop GIS or

GIS-Client



HUMBOLDT Language


HUMBOLDT Language





(HALE)


(HALE)



Database/Repository

Database/Repository

HUMBOLDT Tools

HUMBOLDT Services


GI data integrator






execute services

specify workflow


specify target





24

Mediator Service

Download Service that encapsulates the capability to execute

predefined transformation workflows

Execution of workflows retrieved from the HUMBOLDT Workflow

Repository Service

Ability to read data from Web Feature Services and Web Coverage

Services and to feed into transformation services

Invoke transformation processes via several standardised interfaces

Ability to work with internal transformation services and external

transformation services


25

© 2009 Humboldt Consortium / CEN/TC287 Workshop Malta



Transformer


Transformer

HUMBOLDT Coordinate


HUMBOLDT Coordinate



Service


Service

Desktop GIS or

GIS-Client

Desktop GIS or

GIS-Client



HUMBOLDT Language


HUMBOLDT Language





(HALE)


(HALE)



Database/Repository

Database/Repository

HUMBOLDT Tools

HUMBOLDT Services


GI data integrator






execute services

specify workflow


specify target





26

Process step: Execution of transformation services

Analysis of sources

Creation of target

Input for transformation

(mapping rules)

Source TargetSchema

Transf.

Edge

Matching …

Executed technical processes

User knowledge


27

HUMBOLDT Web Processing Services

Conceptual Schema Transformer. Web Processing Service for

transforming data from one application schema to another

Edge Matching Service. Web Processing Service implementation of a

service that aligns edges and points of vector geometries so that they will

be gapless

Coordinate Transformation Service. WPS implementation of a service

that allows to transform coordinates between various geographic

reference systems

Language Transformation Service. Web Processing Service that is

capable of transforming/translating all information that becomes visible to

a user from one language to another


28

The HUMBOLDT Conceptual Schema Transformer (CST)

Transformation of source data from source schema to target schema

‘Executes’ the schema mappings made in HALE. (Now integrated in the LAST

version of HALE)

Java platform

Makes use of GeoTools libraries

Test with OGC CQL (Common Query Language) for filtering and value

conditions

The CST can be used via request to a Web Processing Service (WPS)

Or as part of a data harmonisation workflow chained with other HUMBOLDT

services


29

© 2009 Humboldt Consortium http://www.esdi-humboldt.eu

The HUMBOLDT Edge Matching Service (EMS)

WPS implementation

Aligns LineStrings and Polygons of vector geometries so that they will be gapless and with no overlaps

Three modes of operation:

CleanDataset: when only one dateset is provided, then the gaps and overlaps will be removed.

Align-to-Reference: all candidate data sets will be transformed using the reference dataset so that points are moved up to a maximum distance also provided as input.

Distribute-Errors: In this case, there is no reference data set that can be used as "ground truth", therefore all geometries will be transformed. No point or edge will be moved further than a client-specified amount.


30


EMS Clean Dataset Process – Results

Input:


31


EMS Clean Dataset – Results

Output:


32

Further HUMBOLDT Transformation Services

Coordinate Transformation Service

Implemented and in use

Language Transformation Service

Early implementation

Multiple Representation Merging Service

Prototype implementation available


33

HUMBOLDT Developer Community

Download software

Access documentation

Capture requirements

Report bugs

Progress tracing

Discuss issues, build a

knowledge base of solutions


34

HUMBOLDT Open Source Software

http://www.community.esdi-humboldt.eu/

HUMBOLDT Model Editor For the creation of UML application schemas

HUMBOLDT Alignment Editor Definition of conteptual schema transformation

Workflow Service Service Composition for handling transformation needs

Mediator Service Execution of transformation chains

Transformation Service Exposed as Web Processing Services (e.g. CTS, Edge Matching)

We invite developers to test the design and

expandability of the framework.

Suggestions and contributions are highly

welcome


35

Who is the Community?

You!The users and developers in the HUMBOLDT scenarios

GENESIS: Sharing of Methodology

GS-Soil: INSPIRE harmonisation and transformation, tools reuse

ESDIN: HALE and CST dissemination, feedback

Geoland 2: establish collaboration agreement

Plan4all: NDA for document exchange for WP2 results in preparation

NatureSDI+: HUMBOLDT training planned

eSDI-Net+: Networking, joint meetings

GIGAS: Contributions to the Technology Watch activities

INSPIRE Data Specification Drafting Teams

Snowflake, 1spatial, FME, …HUMBOLDT Workshop HCMR, Athens, March, 2011 © 2011 HUMBOLDT Consortium Fraunhoferstraße 5 64283 Darmstadt http://www.esdi-humboldt.eu

36

Thank you for your attention!


Date post:	12-Jan-2016
Category:	Documents
Upload:	deirdre-mccormick
View:	219 times
Download:	0 times

1 Tools and Components of the HUMBOLDT Framework Dr. Christine Giger (Swiss Federal Institute for...

Documents