Web Weather Request and Distribution System (WebWerdis (2006/7)) Fechner, Siegfried...

Web Weather Request and Distribution System (WebWerdis (2006/7))

Fechner, Siegfried([email protected])

Contents:

– WebWerdis – What is it?

– WebWerdis – Design and components

– WebWerdis – Relation to WIS

S. Fechner, DWD, [email protected] 2006, November

WebWerdis (2006/7) – What is it?

Aims:

– Accommodation of special usergroups with meteorological data and products (delivery via pull and push/subscription mode)

– Harmonisation of the metadata (product, distribution and customer catalogues) of the currently main distribution tools of the DWD (based on on the recommendation of the “CBS INTER-PROGRAMME EXPERT TEAM ON METADATA IMPLEMENTATION“, http://www.wmo.int/web/www/WDM/IPET-MI-II/IPET-MI-II_Final_report.doc)

– Unification of the request/response interfaces between the distribution tool and the different datasources as well as production tools of the Deutscher Wetterdienst


Web Weather Request and Distribution System, WebWerdis, is a new generation of internet based distribution system. It is one part of redesigned Meteorological Portal of the DWD (start in 2007; preoperativ installation: “http://werdis-cbs.dwd.de/bvbw/bvbwDWD.portal”).

WebWerdis (2006/7) – What is it?


Technical standards:

Programming– Java (jdk 1.4 or 1.5), jakarta struts 1.1, EJB 2.0– Opensource components:

AFD http://www.dwd.de/AFDquartz http://www.opensynphony.com/quartzOGSA-DAI http://ogsadai.org.uk

Metadata design– Product and product instance catalogue (WMO-core metadata standard “formal draft

version 1.0”; 2005, St. Petersburg)

Server– Webfrontend (Bea-Portal, Weblogic 8.1.5)– Web-Business-components (each J2EE-container/server)– OGSA-DAI-gridservice (servlet or J2EE-container/server, e.g. Tomcat or Oracle

Applicationserver)– Database (Oracle 9i XML-DB)

WebWerdis (2006/7) – roots of WebWerdis

WebWerdis 2001/2- https://tiofas13.dwd.de/- without metadata catalogues- hardcoded navigation- GTS-global dataset- DWDSat-products- inflexible structure and

products

CBS-Prototype 2005- http://vgisc-2.dwd.de/vgisc/- WMO-metadata vers. 02- customised product

(timeseries, only pull)- pull and push for routine data

(GTS-bulletins and DWDSat-products)


Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS

„GTS-Customer“MSS

DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no

GRID-Service Climate DB

Intranet fmi


Internet

Intranet KMA


Webfrontend(DWD-Portal)

„GTS-Customer“

WebWerdis (2006/7) – Design and components

legend:data flow: metadata flow: internet: intranet: GTS:


Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

- registered customers:research centres and universities in germany,

- access to customised range of products for pull and push (question of data policy),

- pull: view, download, email, ftp,

- Push (subscription): ftp, email attachment,

- access to all product metadata,

- single-handed administration of own carts, destination details and subscriptions (only push)




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

„GTS-Customer“:- demonstration of connection to the GTS via push-technology

(WebWerdis),

- metadata publication of new defined bulletins in the Metadata DB (product description)

- routinely generation of bulletins and storing in the datapool,

- formulation of subscriptions to transfer these bulletins into the GTS




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

- product, product instance catalogue based on WMO-core standard version 0.2 (WMO-volume A (station catalogue), volume C (GTS-bulletins), DWD-internal metadata (DWDSat- and model description)),

- customer catalogue (customer data for authorisation and authentication),

- distribution catalogue (carts, destination details, subscriptions),

- logging catalogue (custimised production and transfer logging informations)




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

- part of the new DWD-portal (Bea-portal-2006),

- secondary version: runnable on each J2EE-conform webcontainer,

- customised webfrontend for registrated customer(s) or „free user“




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

- implementation: sessionbeans (J2EE),

- controls the product discovery and selection,

- controls the definition and administration of customised carts, destinations and subscriptions (push-distribution),

- controls the requests to the MSS-, Datapool- and Unidart-adapters for pull and interprets the adapter responses (show, download or send data via email)




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

- implementation based on:„job scheduling system – quartz “ : http:www.opensynphony.com,„Automatic File Distributor“: http://www.dwd.de/AFD,

- generates an activity list, based on incoming subscription list (for the Metadata DB),

- controls the time triggered and the event triggered scheduler (schedulers send requests to the adapters),

- controls the responses from the MSS-, Datapool- and Unidart-adapters

- sends the products to the customers (via ftp or email attachment)




WebWerdis (2006/7) – push or subscription-software

AFD(AutomaticFileDistributor–opensource

Controller(time triggered)

based onquartz-software(opensource:

http://www.open-synhony.com/

quartz)

subscription-directory

Distributionvia email ftp…

customised datavia OGSA-DAI-Gridservice

MSS-Adapter

customised bulletinsvia DWD-MSS

routine data(GTS-bulletins, other datafrom global data set anddwd-specifical data…

Distribution-Layer Scheduler-Layer Adapter-Layer

universalInterface

(request and response)

subscription listas XML-document

(Metadata DB)

Activity List Generator

Generation of an acitvity list, based on incomingsubscription list

based onAFD-software(opensource:

http://www.dwd.de/AFD)

legend:data flow: metadata flow:

Unidart-Adapter

Datapool-Adapter

Controller(event triggered)


Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

- request routing to the datapool(s), - interpretation of adapter response

metadata,- packaging of response data for

transfer (push or pull)




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

filebased datapool(s),contents: routine products like:

- GTS-standard bulletins

- DWDSat -products (satellite images, maps, ...)




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

- formulation of an validated MSS statement,- request routing to the DWD MSS,- interpretation of adapter response metadata,- transfer of response data into files (bulletin-,

ascii-text- or other formats),- packaging of response files for transfer (push

or pull)




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“- dispatch of incoming routine bulletins

(corresponding to WMO volume C) to the datapool(s),

- generation of customised bulletins (request from MSS-adapter),

- dispatch of customised bulletins back to the MSS-adapter




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

- formulation of an validated UNIDART request statement,

- request routing to the GRID-Services,- interpretation of adapter response

metadata,- transfer the response data into file(s)

(xml-format),- packaging of response files for transfer

(push or pull)




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

- OGSA-DAI-gridservice UNIDART-project (DWD, Germany),

- part of DWD-Intranet,

- connector to climate database and NWP (numerical weather predication) model(s) database (planned),

- customised database request




Web-BusinessLogic

Push-software

Unidart-Adapter

MSS-Adapter

Datapool-Adapter

Datapool(s)

GTSGTS


DWDMSS

Climate DB

GRID-Service

Model DB

Customer(s)

Metadata DB

Intranet DWD

Intranet met.no


Intranet fmi


Internet

Intranet KMA



„GTS-Customer“

- OGSA-DAI-gridservice UNIDART-project (fmi, Finland).

- certified gridservice,

- connector to climate database,


- OGSA-DAI-gridservice UNIDART-project (met.no, Norway),

- certified gridservice,



- OGSA-DAI-gridservice UNIDART-project (KMI, Republic of Korea),

- VPN, certified gridservice,






WebWerdis (2006/7) – Relation to WIS

WebWerdis is not a prototype of an GISC or VGISC. The primary aim was the development of a modern internet based request and distribution system as part of the redesigned DWD Meteorological portal.

but:

– WebWerdis design is geared to the design principles for the WIS data communication structure of the “INTER-COMMISSION COORDINATION GROUP ON THE WMO INFORMATION SYSTEM, THIRD Session” (http://www.wmo.int/web/www/ISS/ICG-WIS-III/Doc3-1(3)WIS-ComStructure.doc)

– Metadata structures are be based on the recommendation of the “CBS INTER-PROGRAMME EXPERT TEAM ON METADATA IMPLEMENTATION“, http://www.wmo.int/web/www/WDM/IPET-MI-II/IPET-MI-II_Final_report.doc)

– Structure and implementation would be incorporate into future WIS distribution tools (e.g. VGISC/SIMDAT- or UNIDART-project: http://www.ecmwf.int/services/grid/simdat/wiki/do/get/simdat or http://www.dwd.de/UNIDART/)



Next planned adjustments:

– Extension of the range of data and products (currently range: climatological information from selected stations across Germany, Norway, Finland and the Republic of Korea; Weather messages in accordance with the international exchange of data and a selection of satellite images, of weather forecast charts and of analytic-data)

– Redesign of all metadata catalogues to bring them into agreement with the recommendation of the “CBS INTER-PROGRAMME EXPERT TEAM ON METADATA IMPLEMENTATION“, http://www.wmo.int/web/www/WDM/IPET-MI-II/IPET-MI-II_Final_report.doc). Important requirements are:

as ISO-19100 documents.

– Incorporation of the main components of WebWerdis into the VGISC/SIMDAT project


1. the appropriation of the main catalogues (e.g. WMO Meteorological Bulletins Volume C1 and Volume A) and

2. the redesign of the DWD-internal product and station catalogues



Date post:	16-Dec-2015
Category:	Documents
Upload:	lana-rigby
View:	216 times
Download:	2 times

Web Weather Request and Distribution System (WebWerdis (2006/7)) Fechner, Siegfried...

Documents