GML Data Models and Web GML Data Models and Web Services for GPS and Services for GPS and Earthquake CatalogsEarthquake Catalogs

Marlon Pierce, Galip AydinMarlon Pierce, Galip AydinCommunity Grids Lab,Community Grids Lab,

Indiana UniversityIndiana Universitympierce@cs.indiana.edumpierce@cs.indiana.edu

QuakeSim ApplicationsQuakeSim Applications Several QuakeSim codes work directly with Several QuakeSim codes work directly with

observational data. observational data. Examples discussed at ACES includeExamples discussed at ACES include

• GeoFEST, VirtualCalifornia, Simplex, and Disloc all depend GeoFEST, VirtualCalifornia, Simplex, and Disloc all depend upon fault models.upon fault models.

• RDAHMM and Pattern Informatics codes use seismic RDAHMM and Pattern Informatics codes use seismic catalogs.catalogs.

• RDAHMM primarily used with GPS dataRDAHMM primarily used with GPS data ProblemProblem: We need to provide a way to integrate : We need to provide a way to integrate

these codes with the online data repositories.these codes with the online data repositories.• QuakeTables Fault Database was developed QuakeTables Fault Database was developed • What about GPS and Earthquake Catalogs? What about GPS and Earthquake Catalogs? • Many formats, data available in tars or files, not searchable, Many formats, data available in tars or files, not searchable,

not easy to integrate with applicaitonsnot easy to integrate with applicaitons SolutionSolution: use databases to store catalog data; use : use databases to store catalog data; use

XML (XML (GMLGML) as exchange data format; use ) as exchange data format; use WebWeb ServicesServices for data exchanges, invoking queries, and for data exchanges, invoking queries, and filtering data.filtering data.

What Are Web Services?What Are Web Services? Web Services are not web Web Services are not web

pages, CGI, or Servletspages, CGI, or Servlets Web Services framework is Web Services framework is

a way for doing distributed a way for doing distributed computing with XML.computing with XML.• WSDLWSDL: Defines interfaces : Defines interfaces

to functions of remote to functions of remote components.components.

• SOAPSOAP: Defines the : Defines the message format that you message format that you exchange between exchange between components.components.

XML provides cross-XML provides cross-language supportlanguage support

Suitable for both human Suitable for both human and application clientsand application clients

WebServer

DB

JDBC

Browser

WebServer

SOAP

Appl

SOAPWSDL

WSDL

WSD

LWSD

L

Geographical Information Service Geographical Information Service (GIS) Data Formats and Services(GIS) Data Formats and Services

OpenGIS Consortium is an international group for defining OpenGIS Consortium is an international group for defining GIS data formats and services.GIS data formats and services.

Main data format language is the XML-based Main data format language is the XML-based GMLGML..• Subdivided into schemas for drawing maps, representing Subdivided into schemas for drawing maps, representing

features, observations, …features, observations, … First StepFirst Step: design GML schemas and build specialized Web : design GML schemas and build specialized Web

Services for GPS and Earthquake data.Services for GPS and Earthquake data. OGC also defines services.OGC also defines services.

• Services include Web Features Services, Web Map Services, Services include Web Features Services, Web Map Services, and similar.and similar.

• These are currently pre-Web Service, based on HTTP Post, but These are currently pre-Web Service, based on HTTP Post, but they are being revised to comply with WS standards.they are being revised to comply with WS standards.

Next StepNext Step: Implement OGC compatible Web Services for : Implement OGC compatible Web Services for this problem.this problem.• Also build services to interact with QuakeTables Fault DB.Also build services to interact with QuakeTables Fault DB.

GML and Existing Data FormatsGML and Existing Data Formats GPS or seismic data used in this project GPS or seismic data used in this project

are retrieved from different URLs and are retrieved from different URLs and have different text formats.have different text formats.

Seismic data formatsSeismic data formats• SCSN, SCEDC, Dinger-Shearer, Haukkson SCSN, SCEDC, Dinger-Shearer, Haukkson

GPS data formatsGPS data formats• JPL, SOPAC, USGS JPL, SOPAC, USGS

We defined 2 GML Schemas to unify We defined 2 GML Schemas to unify thesethese• http://http://grids.ucs.indiana.edu/~gaydin/servogrids.ucs.indiana.edu/~gaydin/servo

A summary of all supported formats and A summary of all supported formats and data sources can also be found there.data sources can also be found there.

So We Built ItSo We Built It First version of the First version of the

system availablesystem available• Tried XML databases Tried XML databases

but performance was but performance was awfulawful

• Currently database uses Currently database uses MySQLMySQL

Download results are Download results are in GML, but we can in GML, but we can convert to appropriate convert to appropriate text formats.text formats.

Search DB For Earthquake Search DB For Earthquake CatalogsCatalogs

Results

Search XML DB For GPS CatalogsSearch XML DB For GPS Catalogs

1

Use Ours or Set Up Your OwnUse Ours or Set Up Your Own

URL to access our browser interface:URL to access our browser interface:• http://gf3.ucs.indiana.edu:6060/cce/sql/http://gf3.ucs.indiana.edu:6060/cce/sql/

URL to download and set up your URL to download and set up your ownown• http://complexity.ucs.indiana.edu/~gaydin/cce/http://complexity.ucs.indiana.edu/~gaydin/cce/

install/install.htmlinstall/install.html

Fault Quest: QuakeTables+OGC Fault Quest: QuakeTables+OGC Web Map Service DemoWeb Map Service Demo

http://rio.ucs.indiana.edu:8080/wmsClient/

ConclusionsConclusions

This is a little discussion with a big This is a little discussion with a big conclusion--conclusion--

If you want to build iSERVO or If you want to build iSERVO or something like it, data access something like it, data access services are an important foundation.services are an important foundation.

GML Schemas as Data Models for GML Schemas as Data Models for ServicesServices

Fault and GPS Schemas are based on GML-Fault and GPS Schemas are based on GML-Feature object.Feature object.

Seismicity Schema is based on GML-Observation Seismicity Schema is based on GML-Observation object.object.

Working schema available from Working schema available from http://http://grids.ucs.indiana.edu/~gaydin/schemasgrids.ucs.indiana.edu/~gaydin/schemas//

JSP + Client Stubs

DB Service 1

JDBC

DB

Job Sub/Mon And FileServices

Operating andQueuing Systems

Browser Interface

Viz Service

Host 1 Host 2 Host 3

RIVA

QuakeSim Portal ShotsQuakeSim Portal Shots

Other IssuesOther Issues We want to abstract the data storage system to allow We want to abstract the data storage system to allow

simple federation of relational and XML databasessimple federation of relational and XML databases• UK e-Science’s UK e-Science’s OGSA-DAIOGSA-DAI project is an interesting but project is an interesting but

complicated example.complicated example. We’d like to simplify this approachWe’d like to simplify this approach

MetadataMetadata is also important is also important• Useful for capturing Useful for capturing datadata pedigreepedigree and and validationvalidation..

““This fault data generated with Simplex by Jay Parker using the This fault data generated with Simplex by Jay Parker using the parameters….”parameters….”

““Those 1935 Fault measurements aren’t so good.”Those 1935 Fault measurements aren’t so good.” We have developed some general applications for We have developed some general applications for

metadata managementmetadata management• Newsgroups, citations, references, glossaries as examples.Newsgroups, citations, references, glossaries as examples.• Would like to apply to scientific metadataWould like to apply to scientific metadata

Future DirectionsFuture Directions We are interested in We are interested in SemanticSemantic WebWeb markups (particularly markups (particularly

RDFS) to provide metadata descriptions of RDFS) to provide metadata descriptions of • InstrumentsInstruments• Data setsData sets• Computing hardwareComputing hardware• Applications/codesApplications/codes

We want this to form the basis for building composite We want this to form the basis for building composite services.services.

Infrastructure improvements: reliable, Infrastructure improvements: reliable, fault tolerantfault tolerant grid grid infrastructure needed as grid components come and go.infrastructure needed as grid components come and go.

Component based portalsComponent based portals: reuse portal interfaces between : reuse portal interfaces between projects.projects.

ISERVOISERVO: International collaborations with Australia, Japan, : International collaborations with Australia, Japan, and possibly other countries and possibly other countries • Through ACES: APEC Cooperation for Earthquake SimulationThrough ACES: APEC Cooperation for Earthquake Simulation

AcknowledgementsAcknowledgements

CommunityCommunity GridsGrids: Geoffrey Fox, : Geoffrey Fox, Choonhan Youn, Galip Aydin, Choonhan Youn, Galip Aydin, Mehmet AktasMehmet Aktas

NASANASA JPLJPL: Andrea Donnellan (PI), Jay : Andrea Donnellan (PI), Jay Parker, Peggy Li, Robert GranatParker, Peggy Li, Robert Granat

UC-DavisUC-Davis: John Rundle: John Rundle UC-IrvineUC-Irvine: Lisa Grant: Lisa Grant USCUSC: Dennis Mcleod : Dennis Mcleod BrownBrown: Terry Tullis: Terry Tullis

Problems: Data Access and Problems: Data Access and Sharing, Code IntegrationSharing, Code Integration

Codes all use custom text formats for Codes all use custom text formats for describing input and output.describing input and output.

Input and output data often combined Input and output data often combined with code-specific information.with code-specific information.• Number of iterations, array sizes, etc.Number of iterations, array sizes, etc.

Data files often created by hand from Data files often created by hand from journals, online repositoriesjournals, online repositories• Online repositories themselves use differing Online repositories themselves use differing

formatsformats Challenges are to develop common data Challenges are to develop common data

formats, access services, and client query formats, access services, and client query tools.tools.

Web Services for Data Access and Web Services for Data Access and Computing Service InvocationComputing Service Invocation

Web services: Web services: • WSDLWSDL: Interface definition language, describes your : Interface definition language, describes your

service service ““GeoFEST may be invoked with these input types”GeoFEST may be invoked with these input types”

• SOAPSOAP: Transport envelope for remote procedure : Transport envelope for remote procedure calls/messagescalls/messages

““Invoke GeoFEST with this set of input”Invoke GeoFEST with this set of input” Together, WSDL and SOAP are useful for Together, WSDL and SOAP are useful for

manipulating, returning XML data valuesmanipulating, returning XML data values• So GML schemas act as our data models and return valuesSo GML schemas act as our data models and return values

Status: built several general purpose services Status: built several general purpose services • Remotely executing codes, monitoring queuing systems, Remotely executing codes, monitoring queuing systems,

manipulating/moving files around, describing applications, manipulating/moving files around, describing applications, storing portal session values, accessing data bases of storing portal session values, accessing data bases of faults,…faults,…

Work underway to build data servicesWork underway to build data services

QuakeSim BasicsQuakeSim Basics

Under development in collaboration with Under development in collaboration with researchers at researchers at JPLJPL, , UC-DavisUC-Davis, , USC, USC, and and BrownBrown University. University.

Geoscientists develop Geoscientists develop simulationsimulation codescodes, , analysisanalysis and and visualizationvisualization toolstools..

We need a way to bind distributed codes, We need a way to bind distributed codes, tools, and data sets.tools, and data sets.

We need a way to deliver it to a larger We need a way to deliver it to a larger audienceaudience• Instead of downloading and installing the code, Instead of downloading and installing the code,

use it as a use it as a remoteremote serviceservice. .

What’s the Problem?What’s the Problem? Data sources typically were provided in single downloadsData sources typically were provided in single downloads

• Tar bundles or textTar bundles or text• This has changed for SCEC catalogs since we developed this This has changed for SCEC catalogs since we developed this

project.project.• SCIGN is adopting a Web Services approach for GPS data.SCIGN is adopting a Web Services approach for GPS data.

Formats defined but presented as textFormats defined but presented as text• Use XML to re-format the data.Use XML to re-format the data.• Buys us investment in many XML manipulation, validation, and Buys us investment in many XML manipulation, validation, and

messaging tools.messaging tools. We wanted to use databases to store and manage the We wanted to use databases to store and manage the

information.information. This makes the data queryableThis makes the data queryable

• Retrieve all entries > 1970Retrieve all entries > 1970• Retrieve all entries with M>3.0Retrieve all entries with M>3.0

Data Sources SummaryData Sources Summary A summary of all supported A summary of all supported

formats can be found here formats can be found here • http://http://

grids.ucs.indiana.edu/~gaydin/servogrids.ucs.indiana.edu/~gaydin/servo Information about supported Information about supported

Earthquake catalog formats can be Earthquake catalog formats can be found in found in http://www.data.scec.org/http://www.data.scec.org/

Information about supported GPS Information about supported GPS data formats can be found in data formats can be found in http://www.scign.orghttp://www.scign.org

What Are Web Services?What Are Web Services? Web services framework is Web services framework is

a way for doing distributed a way for doing distributed computing with XML.computing with XML.• WSDLWSDL: Defines interfaces : Defines interfaces

to functions of remote to functions of remote components.components.

• SOAPSOAP: Defines the : Defines the message format that you message format that you exchange between exchange between components.components.

XML provides cross-XML provides cross-language supportlanguage support

Suitable for both human Suitable for both human and application clientsand application clients

WebServer

DB

JDBC

Browser

WebServer

SOAP

Appl

SOAPWSDL

WSDL

WSD

LWSD

L

Delivering Data for Human and Delivering Data for Human and Application ConsumptionApplication Consumption

We still have to get the results to the We still have to get the results to the (remote) client.(remote) client.

The client may be a user or an application.The client may be a user or an application. Web Services provide a way to do this.Web Services provide a way to do this. Note Web Services are NOTNote Web Services are NOT

• Web pagesWeb pages• ServletsServlets• CGI scriptsCGI scripts