OpenEarth

OpenEarthTools =

Open source management of

Data, Models and Tools for

marine & coastal

science & technology.. and what about

More information at:

http://openearth.deltares.nl

Data Tools

Models

XBeach

Information

SSB P 15

Data Tools

Models

Information

• Data quality, availability and accessibility for analysis is substandard

• Models and tools used and developed by specialists are insufficiently documented and often lack version control

• Developments to remedy the two above points are often hampered by the existence of (artificial) project boundaries

• Working like this is grossly inefficient

We can do much better!!

Although data, models, tools and information are the corner stones of hydraulic engineering projects:

Introduction

Surely you recognize the following emotions?• ohh , I used the wrong version• ahh, where is the last version• hmm, where was this measured• oops, I forgot to include the timezone• wow, you can actually show that in GoogleEarth?• aarghh, the guy who measured it left?• sigh, surely someone must have solved this problem before me!

OpenEarth was started as a bottom up initiative by project engineers to break this apparent endless string of disappointment and frustration by introducing an open and project superseding approach.

So how does it work?

Introduction

Calculate missing (lat,lon) on the fly

1. PCTRANS marine: much ado with external files

2. General Mapping Toolbox: only *.eps on linux

3. arcGIS: $

4. matlab mapping: $

5. etc.

6. matlab CTRANSDV: Rijksdriehoek, UTM, LonLat

• Zitman > Verploeg > Bonekamp > Elias > de Boer > ?

7. OpenEarth SuperTrans

• Maarten van Ormondt (Deltares)

• GUI & matlab command line

• ~ 3000 EPSG transfomations

• free if you join OpenEarthTools

>> [x,y]=ConvertCoordinates(5,52,EPSG,'WGS 84','geo','WGS 84 / UTM zone 31N','xy',...)

Gradual improvement by cooperation Example: coordinate transformation

What is OpenEarth?

What is OpenEarth

1. philosophy

2. community

3. repository

4. delivery (datawarehouse)

Cooperate

What is OpenEarth

1. philosophy

2. community

3. repository

4. delivery (datawarehouse)

Cooperate

1. PHILOSOPHY

1. PHILOSOPHY

• Non-zero sum game: collaboration most efficient for everybody (more pie)

• Tit-for-tat is what people start using for cooperation

• People stop collaborating after 1st bad experience

• Tiny % of free riders gradually destroys collaboration• Tit-for-tat+1 approach would maintain collaboration

• Stop collaboration only after 2nd bad experience.

• Noise in system: delays + misunderstandings + force majeure

• also gradually cooperativeness erodes.• Tit-for-tat+many maintains collaboration

• Mutual trust

• Positive attitude

• Cooperative atmosphere

• Only 1 needed

• OET = car starter

2. COMMUNITY

• all collaborating is not enough• chaos• coordination needed• but no overall boss• like wikipedia

Project nProject 1

Data Tools

Models

Cooperate

central storage

3. REPOSITORY

Cooperate1. philosophy

2. community

3. repository

4. delivery

central storage

3. REPOSITORY

check that out

Cooperate1. philosophy

2. community

3. repository

4. delivery

OpenEarth repository McTools

repository

Company repository

3. REPOSITORY

central storage

4. DELIVERY

data providers

data users1. philosophy

2. community

3. repository

4. delivery

central storage

4. DELIVERY

Cooperate

data providers =

data users

1. philosophy

2. community

3. repository

4. delivery

Summarizing: What is OpenEarth?

In summary, OpenEarth is:• A community of users …• That cooperate on the philosophy …• That all data, models, tools and information …• Should flow openly

To facilitate effective cooperation OpenEarth:• Offers a free infrastructure composed of the best available open

source components adhering to widely accepted international standards …

• Shares all data, models, tools and information provided by previous OpenEarth projects from one shared storage location …

• Provides training for users to gain the (minimum) skills to cooperate effectively

Some more details about the OpenEarth infrastructure …

OPeNDAP Server

ToolsModels

Subversion Server

User

Provider

Pros:

• Easy Backup

• Version control:

• Shared access to …

• one central version

Pros:

• Uniform workflow:

• More efficient collaboration

Raw Data

Pros:

• For NetCDF & OpenDAP:

• Free visualization tools

Free ICT required

• Subversion server

• Linux (file) server

• OPeNDAP server

For private use a

OpenEarth clone costs:

• 20 k€ hardware (10TB)

• Few days of installation (training)

OpenEarth infrastructure: data, model output, …

Extract Transform Load Provide

tools

models

add meta information

netCDF on web server

transform to netCDF

netCDF on OPeNDAP

server

data providers = data users

data (volts)

Make user-friendly formats

Dynamic database

Charts & MapsTools & websites

Archive native formats

Every file is logged …

… and every line in every file is logged.

OpenEarth infrastructure: …, model code and tools

OpenEarth infrastructure: information

OpenEarth: regular training sessions

OpenEarth: successful application in projects

And many others …

• Delft – USGS coop

• Delft Cluster North Sea and Coast

• Kustlijnzorg

• MoS2 monitoring of SPM for MVII

• etc.

OpenEarth

OpenEarthTools =

Open source management of

Data, Models and Tools for

marine & coastal

science & technology.. and what about

More information at:

http://openearth.deltares.nl