+ All Categories
Home > Documents > Kepler includes contributors from GEON, SEEK, SDM Center and Ptolemy II, supported by NSF ITRs...

Kepler includes contributors from GEON, SEEK, SDM Center and Ptolemy II, supported by NSF ITRs...

Date post: 05-Jan-2016
Category:
Upload: adam-gordon
View: 213 times
Download: 0 times
Share this document with a friend
Popular Tags:
1
Kepler includes contributors from GEON, SEEK, SDM Center and Ptolemy II, supported by NSF ITRs 022567 (SEEK), EAR-0225673 (GEON), DOE DE-FC02-01ER25486 (SciDAC/SDM), and DARPA F33615-00-C-1703 (Ptolemy). The installer for Kepler 1.6a is available for download at http://kepler-project.org Kepler is a system for design and execution of scientific workflows. Built on top of the powerful Ptolemy II modeling tool, Kepler allows scientists to design, prototype and execute in a single environment a wide spectrum of scientific workflows, ranging from high-level domain-specific ones (e.g.mineral classification) to low-level “Grid workflows”. With an intuitive drag&drop interface, Kepler is an effective tool for scientists who need a flexible and extensible workflow environment. Geosciences problems often require complex data access and computational analysis. These can be composed in a meaningful order into a geosciences workflow. Kepler provides the following components to assist geologists in scientific discovery: Data handling features: • Data extraction and registration workflows • Metadata based data search and access • Local and remote data access: • Relational and Geospatial databases • Web service data access (query) • Storage Resource Broker (SRB) • File Transfer Protocols: GridFTP, SCP, SRB Processing tools: • Generic web service client • Legacy application integration via Shell- Command actor e.g. R, GMT • Browser user interface for visualization and user interface • Domain specific applications: • ArcIMS services • Point in polygon classification algorithm • Grid interpolation algorithms Workflow prototyping tool (for napkin drawings) Local and remote execution environments: • Local Kepler application • Execution from a portal environment • Coming soon: peer to peer execution model Future Directions: • A workflow for integrating seismic events focal mechanisms (beach balls) with ArcIMS image services • Mapping workflows onto the grid, using Pegasus, to handle massive datasets (e.g., LIDAR) • A unified framework for accessing dataset and registering workflow products within the portal • Additional portal execution Kepler as a Modeling Tool: Gravity Modeling Design Workflow Integrating heterogeneous gravity depth sources to create a 3-D gravity model. Component Component (actor) (actor) libraries libraries inline inline documentation documentation Randy Keller, Ann Gates Observed Gravity Model Implemented part Grid Grid interpolation interpolation actor actor Coming Soon: Mapping Workflow onto the Grid Processing Lidar dataset using a grid-mapper director (pegasus). Searching for Lidar datasets and registering them Into a db2 spatial database. Lidar Processing Output Lidar datasets Processing Browser Browser display of display of results results Pluggable Pluggable Web Web Services Services Kepler and GEON: A Scientific Workflow Approach Kepler and GEON: A Scientific Workflow Approach to Processing Geosciences Data to Processing Geosciences Data Efrat Frank, Ilkay Altintas, Bertram Ludaescher San Diego Supercomputer Center GEON Mineral and Rock Classifier • Mineral Classification for naming Igneous rocks using IUGS classification diagrams. • Rock Classification for extracting Atype bodies. Integrating relational and spatial databases. Support for portal environment execution. Input formats: • Igneous rock relational and spatial databases • Classification diagrams (SVGs) Process reusability: Classification of samples Next step: Represent the 3-D geometry of Atype bodies through modeling of gravity data. Future step: Classification of orogenic basins. Local & remote Local & remote JDBC access JDBC access Classification algorithm sub-workflow Rock Classifier Mineral Classifier PointInPoly PointInPoly gon gon ArcIMS ArcIMS service service s Composite Composite actor actor SVG Diagram Atype Output
Transcript
Page 1: Kepler includes contributors from GEON, SEEK, SDM Center and Ptolemy II, supported by NSF ITRs 022567 (SEEK), EAR-0225673 (GEON), DOE DE-FC02-01ER25486.

Kepler includes contributors from GEON, SEEK, SDM Center and Ptolemy II, supported by NSF ITRs 022567 (SEEK), EAR-0225673 (GEON), DOE DE-FC02-01ER25486 (SciDAC/SDM), and DARPA F33615-00-C-1703 (Ptolemy).

The installer for Kepler 1.6a is available for download at http://kepler-project.org

Kepler is a system for design and execution of scientific workflows. Built on top of the powerful Ptolemy II modeling tool, Kepler allows scientists to design, prototype and execute in a single environment a wide spectrum of scientific workflows, ranging from high-level domain-specific ones (e.g.mineral classification) to low-level “Grid workflows”. With an intuitive drag&drop interface, Kepler is an effective tool for scientists who need a flexible and extensible workflow environment.

Geosciences problems often require complex data access and computational analysis. These can be composed in a meaningful order into a geosciences workflow. Kepler provides the following components to assist geologists in scientific discovery:

Data handling features:• Data extraction and registration workflows• Metadata based data search and access• Local and remote data access:

• Relational and Geospatial databases• Web service data access (query)• Storage Resource Broker (SRB)• File Transfer Protocols: GridFTP, SCP, SRB

Processing tools:• Generic web service client• Legacy application integration via Shell- Command actor e.g. R, GMT• Browser user interface for visualization and user interface• Domain specific applications:

• ArcIMS services• Point in polygon classification algorithm• Grid interpolation algorithms

Workflow prototyping tool (for napkin drawings)

Local and remote execution environments:• Local Kepler application• Execution from a portal environment• Coming soon: peer to peer execution model

Future Directions:• A workflow for integrating seismic events focal mechanisms (beach balls) with ArcIMS image services• Mapping workflows onto the grid, using Pegasus, to handle massive datasets (e.g., LIDAR)• A unified framework for accessing dataset and registering workflow products within the portal• Additional portal execution support• GRASS support

Kepler as a Modeling Tool: Gravity Modeling Design Workflow

Integrating heterogeneous gravity depth sources to create a 3-D gravity model.

Component Component (actor) libraries(actor) libraries

inline inline documentationdocumentation

Randy Keller, Ann GatesObserved Gravity Model

Implemented part

Grid Grid interpolation interpolation

actoractor

Coming Soon: Mapping Workflow onto the Grid

Processing Lidar dataset using a grid-mapper director (pegasus).

Searching for Lidar datasets and registering themInto a db2 spatial database.

Lidar Processing Output

Lidar datasets Processing

Browser Browser display of display of

resultsresults

Pluggable Pluggable WebWeb

ServicesServices

Kepler and GEON: A Scientific Workflow ApproachKepler and GEON: A Scientific Workflow Approachto Processing Geosciences Datato Processing Geosciences Data

Efrat Frank, Ilkay Altintas, Bertram LudaescherSan Diego Supercomputer Center

GEON Mineral and Rock Classifier

• Mineral Classification for naming Igneous rocks using IUGS classification diagrams.• Rock Classification for extracting Atype bodies. Integrating relational and spatial databases. Support for portal environment execution. Input formats:

• Igneous rock relational and spatial databases• Classification diagrams (SVGs)

Process reusability: Classification of samplesNext step: Represent the 3-D geometry of Atype bodies through modeling of gravity data.Future step: Classification of orogenic basins.

Local & Local & remoteremote

JDBC accessJDBC access

Classification algorithm sub-workflow

Rock Classifier

Mineral Classifier

PointInPolyPointInPolygongon

ArcIMS ArcIMS serviceservice

ss

Composite Composite actoractor

SVG Diagram

Atype Output

Recommended