+ All Categories
Home > Documents > DRAFT April 28, 2005 ESIP AQ Cluster, [email protected] The data life cycle consists of the...

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected] The data life cycle consists of the...

Date post: 12-Jan-2016
Category:
Upload: gabriella-robertson
View: 212 times
Download: 0 times
Share this document with a friend
Popular Tags:
43
DRAFT April 28, 2005 ESIP AQ Cluster, [email protected] • The data life cycle consists of the acquisition and the usage parts Usage Activities Data Acquisition Data Acquisition and Usage Activities • The collected and cleaned data are stored in the repository Data Repository • The acquisition part processes the sensory data by firmly linked procedures • The usage activities are more iterative, dynamic procedures • The usage activities transform the data into knowledge for decision making Decisions The Federation presumes there is a repository and focuses on usage activities
Transcript
Page 1: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

• The data life cycle consists of the acquisition and the usage parts

Usage ActivitiesData Acquisition

Data Acquisition and Usage Activities

• The collected and cleaned data are stored in the repository

Data Repository

• The acquisition part processes the sensory data by firmly linked procedures

• The usage activities are more iterative, dynamic procedures• The usage activities transform the data into knowledge for decision making

Decisions

The Federation presumes there is a repository and focuses on usage activities

Page 2: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

ScientistScience

DAACs

• Current info systems are project/program oriented and provide end-to-end solutions

Info UsersData Providers Info System

AIRNowPublicAIRNow

AIRSCompliance

Manager

AQ Information Systems: Current and with DataFed

• Part of the data resources can be shared for re-use through DataFed

• Through the Federation, the data are homogenized into multi-dimensional cubes

• Data processing and rendering can then be performed through standard web services

• Each project/program can be augmented by Federation data and services

Page 3: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

ScientistScience

DAACs

• Current info systems are project/program oriented and provide end-to-end solutions

Info UsersData Providers Info System

Now/ForecastPublicAIRNow

ModelCompliance

Manager

AQ Information Systems: Current and with DataFed

• Part of the data resources can be shared for re-use through DataFed• Through the Federation, the data are homogenized into multi-dimensional cubes

• Data processing and rendering can then be performed through standard web services

• Each project/program can be augmented by Federation data and services

Data Catalog Data Wrapping Web Services

Federation Infrastructure

Page 4: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

• Data are distributed geographically by autonomous providers

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

• Data includes emissions

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

Information Landscape: Provider Geography, Content, Agency, Form

• Data includes emissions, ambient data,

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

• Data includes emissions, ambient data, satellite data

Satellite

Satellite

SatelliteSatellite

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

• Data includes emissions, ambient data, satellite data and model output

Model

Model

ModelModel

Satellite

Satellite

SatelliteSatellite

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

• Data are provided by multiple agencies: EPA, NOAA, NASA and others

NASAMission

NOAAGASP

NASAIDEA

NASA DAACs

NOAA ASOS

EPA-AQSDataMart

EPA AIRNow

RPO VIEWS

FS FireInv

State/LocalEmission

EPA NEISGEI

EPA NEI

NOAA WeaMod

EPAAQModel

NOAA Forecast

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

NASA DAACs

NOAA GASP

NASAIDEA

NASA Missions

EPA NEI

EPA NEISGEI

FS FireInv

State/Local Emission

NOAA ASOS

RPO VIEWS

EPA AIRNow

EPA-AQS AIRS

NOAA WeaMod

EPA AQModel

NASA GloModel

NOAA Forecast

• Furthermore, data are provided in varied formats and access protocols

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

• Data on Internet are geography-independent and can be ‘linearized’

Internet

NASA DAACs

EPA-AQS AIRS

EPA AIRNow

others

Page 5: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

• Users are distributed geographically

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

Policy

Policy

Policy

• Users includes policy makers

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

• Users includes policy makers, the public

Policy

Policy

Policy PublicPublic

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

• Users includes policy makers, the public, AQ managers

Policy

Policy

Policy PublicPublic

Manager Manager

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

and scientist

Policy

Policy

Policy PublicPublic

Manager ManagerScientist Scientist

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

• Users are affiliated with multiple agencies: EPA, NOAA, NASA, as well as others

Policy

Policy

Policy PublicPublic

Manager ManagerScientist Scientist

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

• Furthermore, users need various types of information provided in multiple formats

Policy

Manager

Policy

Scientist

ManagerScientistScientist

Policy

Public Public

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

Information Landscape: UsersTypes, Agency, Info Needs

• Since the users are also on the Internet, their geographic location is irrelevant

Public

Manager

Scientist

Internet

other

Page 6: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Information Landscape: Info System Data Access, Processing and Products

Providers

NASA DAACs

EPA R&DModel

EPA AIRNow

others

Public

Manager

Scientist

Users

other

• The info system transforms the data into info products for each user • In the first stage the heterogeneous data are prepared for uniform access

Uniform Access

• The second stage performs filtering, aggregation, fusion and other operations

Data Processing Web Service Chain

Custom Processing

SciFlo

DataFed

Info Products Reports, Websites

Forecasting

Compliance

Other

Sci. Reports

• The third stage prepares and delivers the needed info products

Page 7: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Data Acquisition and Usage Activities

•The data usage activities are more iterative, dynamic procedures

Data Usage

•The acquisition activates are sequential, firmly linked procedures

Data Acquisition

•The acquisition and the usage parts are linked through the repository

•The usage can be enhanced by data and tools from the Federation

Page 8: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Current Delivery and Integration SystemsData:

Emission, Surface Satellite, Model

Single Datasets

•Distributed data access …………………………………………………………………………………………………………………………………………•All of processing, analysis and synthesis must be done by people

Reports

•Resulting in reports and other data-derived products ………………

Page 9: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Future Integrated AQ information System (Draft for Feedback)

NOAA WeaMod

EPA AQModel

FS FireInv

NOAA ASOS

RPO VIEWS

EPA-AQS DataMart

EPA NEI

NASA Missions

EPA AIRNow

NASA DAACs

NASAIDEA

EPA NEISGEI

NASA GloModel

NOAA GASP

NOAA Forecast

Data Providers Distributed Access, User-specific

•Stuff goes here ………….……………………………………………………………………………………………………………………………………………………

•Stuff goes here …….………………………………………………………………………………………………………………………………………………………….

AQ Forecasting

AQ Compliance

Status &Trends

Network Assess.

Info Products Reports, Websites

•Stuff goes here ……………………………………………………………………………………………………………………………………………………………….

Uniform Access

Standard

•Stuff goes here ……….……………………………………………………………………………………………………………………………………………………….

Data Processing Filtering, Aggregation, Fusion

Web Service Composition

SciFlo

DataFed

Custom Processing

Page 10: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Current AQ Information System

•Data are distributed geographically by autonomous providers

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data,

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data, satellite data

Satellite

Satellite

SatelliteSatellite

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data, satellite data and model output

Model

Model

ModelModel

Satellite

Satellite

SatelliteSatellite

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data are provided by multiple agencies: EPA, NOAA, NASA, as well as others

NASAMission

NOAAGASP

NASAIDEA

NASA DAACs

NOAA ASOS

EPA-AQSDataMart

EPA AIRNow

RPO VIEWS

FS FireInv

State/LocalEmission

EPA NEISGEI

EPA NEI

NOAA WeaMod

EPAAQModel

NOAA Forecast

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

NASA DAACs

NOAA GASP

NASAIDEA

NASA Missions

EPA NEI

EPA NEISGEI

FS FireInv

State/Local Emission

NOAA ASOS

RPO VIEWS

EPA AIRNow

EPA-AQS AIRS

NOAA WeaMod

EPA AQModel

NASA GloModel

NOAA Forecast

•Furthermore, data are provided in varied formats and access protocols (plugs)

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Since the data are Internet-accessible, their geographic location is irrelevant

Internet

NASA DAACs

EPA-AQS AIRS

EPA AIRNow

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

Page 11: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Current AQ Information System

•Users are distributed geographically

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

Policy

Policy

Policy

•Users includes policy makers

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Users includes policy makers, the public

Policy

Policy

Policy PublicPublic

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Users includes policy makers, the public, AQ managers

Policy

Policy

Policy PublicPublic

Manager Manager

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

and scientist

Policy

Policy

Policy PublicPublic

Manager ManagerScientist Scientist

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Users are affiliated with multiple agencies: EPA, NOAA, NASA, as well as others

Policy

Policy

Policy PublicPublic

Manager ManagerScientist Scientist

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Furthermore, users need various types of information provided in multiple formats

Policy

Manager

Policy

Scientist

ManagerScientistScientist

Policy

Public Public

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Since the users are also on the Internet, their geographic location is irrelevant

Public

Manager

Scientist

Internet

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

Page 12: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

User-Centered View

•Users have private and federated resources pool to work with

UsersUsers

•Some resources are computer-accessible and can be shared

Data,Tool Data,Tool

•Users have access only to their own private resources

User 1 User 2

•The Federation aids resource (re)use

Federated ResourcesData, Services, Tools

•Shared resources can become part of the federation

Other Feds, Portals

•Other Federations and Portals can also be shared

•Providers gain a larger market to distribute their data

•The entire community benefits from a more effective and efficient information system

Page 13: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

• The challenge is to design a general supportive infrastructure• Simply connecting the relevant provides and users for each info product is messy

Integrated Data System for Air Quality-IDAQ

ESIP AQ Cluster 050510 Draft [email protected]

• The info system infrastructure needs to facilitate the creation of info products

AQ Compliance

Nowcast/Forecast

Status & Trends

Find Data Gaps

ID New Problems

………

Info Needs

Reports

• Providers supply the ‘raw material’ (data and models) for ‘refined’ info products

EmissionSurface Satellite

Model

Single Datasets

Providers

Wrappers

Where?

What?

When?

Federate Data

Structuring

• Structuring the heterogeneous data into where-when-what ‘cubes’ simplifies the mess

Slice & Dice

Explore Data

Viewers

• The ‘cubed’ data can be accessed and explored by slicing-dicing tools

Programs

Integrate

Understand

• More elaborate data integration and fusion can be done by web service chaining• This infrastructure support for IDAQ can be provided by the ESIP Federation

Non-intrusive Linking & Mediation Data UsersData Providers

Page 14: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Current Air Quality Information ‘Ecosystem’ (Draft for Feedback)

AQ information includes emissions, ambient & satellite data and model outputs

The distributed data are produced and provided by agencies, mostly through portals

Providers have different access protocols, formats, and information usage conditions

This lack of interoperability causes the under-utilization of the rich data resources

Page 15: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

New Information System Capabilities

• Evolvable Technical Infrastructure• Seamless Data Access• Interactive Data Analysis• Interoperable Information Services• Responsive Information Delivery

• Verifiable Information Quality

• Scalable Analysis Portals

• Community Modeling Frameworks

• Assisted Data & Service Discovery

• Assisted Knowledge Building

Page 16: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Page 17: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Page 18: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

DRY

DRY

DRY

WARM

VERY WET

WET

WET

WET

VERYDRY

COLD

COLD

Petabytes 1015

Terabytes 1012

Gigabytes 109Megabytes 106

Calibration, Transformation To Characterized Geophysical Parameters Interaction Between

Modeling/Forecasting and Observation Systems

InteractiveDissemination

Multi-platform, multi-parameter, high spatial and temporal resolution, remote

& in-situ sensing

Advanced Sensors Data Processing Information Synthesis & Analysis Access to Knowledge

Enable AQ Management Through IT

Predictions

Page 19: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Information

Information Value Creation System

Informing Knowledge

ActionProductive Knowledge

Data

Organizing Grouping

Classifying Formatting Displaying

AnalyzingSeparatingEvaluating Interpreting

Synthesizing

Judging Options

Quality Advantages

Disadvantages

Deciding Matching goals Compromising Bargaining

Deciding

Info Value

Transform. Processes

‘Actionable’ AQ

Compliance Source Contrib.

Forecast Status & Trends Data Gaps

ID New Problems

Decision Maker Public

Env.Manager Scientist Policy

Maker Network Designer Sensor

Developer

Actions Change Behavior Emission Control

Conduct Research Set/Adopt Policy

Develop Sensors Adopt Network

Who

Data Source Emissions

Surface AQ Obs. Satellite

Transport/Meteor Whatever Whatever

Data Used Emissions Surface AQ Obs.

Satellite Transport/Meteor

Whatever Whatever

Info Form

Data Used Emissions Surface AQ Obs.

Satellite Transport/Meteor

Whatever Whatever

AQ Assessor Public Media Advisory Committee Sci. Workgroup

Policy Analyst Network Analyst Sensor Sensor

Data Analyst Data Analyst

Modeler Data Integrator

Process Scientist Sensor

Analyst

Data Processor ……. ……

……. ….

……………… ……..

Page 20: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Information Value Creation System

Petabyte 1015

Terabyte 1012

Gigabyte 109

Megabyte 106

Informing Knowledge

ActionProductive Knowledge

InformationData

Quantity

Quality

Page 21: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Information Value Creation System

‘Actionable’ AQ

Compliance Source Contrib.

Forecast Status & Trends Data Gaps

ID New Problems

Actions Change Behavior Emission Control

Conduct Research Set/Adopt Policy

Develop Sensors Adopt Network

Data Source Emissions

Surface AQ Obs. Satellite

Transport/Meteor Whatever Whatever

Data Used Emissions Surface AQ Obs.

Satellite Transport/Meteor

Whatever Whatever

Data Used Emissions Surface AQ Obs.

Satellite Transport/Meteor

Whatever Whatever

Petabyte 1015

Terabyte 1012

Gigabyte 109

Megabyte 106

Informing Knowledge

ActionProductive Knowledge

InformationDataInfo Value

Info Form

Organizing Grouping

Classifying Formatting Displaying

AnalyzingSeparatingEvaluating Interpreting

Synthesizing

Judging Options

Quality Advantages

Disadvantages

Deciding Matching goals Compromising Bargaining

Deciding

Decision Maker Public

Env.Manager Scientist Policy Maker

Network Designer Sensor Developer

AQ Assessor Public Media

Advisory Committee Sci.

Workgroup Policy Analyst

Network Analyst Sensor Sensor

Data Analyst Data Analyst

Modeler Data Integrator

Process Scientist Sensor

Analyst

Data Processor ……. …… ……. ….

……………… ……..

Transform. Process

Participants

Page 22: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Data Sources by Content

SatelliteEmissions Surf.AQ ModelsDataMart

VIEWS

NEISGEI AIRNow

AQModelDAACs

ASOS

NEI

NEI

IDEA

GASP

Missions WeaModel

Forecast

GloModelFireInv

Page 23: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Future Integrated AQ information System (Draft for Feedback)

DataMart

VIEWS

NEISGEI

AIRNow

AQMod

DAACs

ASOS

NEI

Emission

IDEA

GASP

Missions

WeaMod

Forecast

GloMod

FireInv

Data Federation Distributed, Virtual, Uniform

AQ Forecasting

AQ Compliance

Status and Trends

Network Assess.

Data Processing Filtering, Aggregation, Fusion

Info Products Reports, Websites

Data are maintained by custodians and exposed through ‘portals’ Mediators uniformly ‘wrap’ data and provide processing servicesAnalysts program the services to create application-specific productsResponsibility is shared among data providers and mediator/ integratorsESIPFed can provide the infrastructure and tools for the AQ info system

Mediators

Page 24: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Advanced Sensors Data Processing & Analysis Information Synthesis Access to Knowledge

Enable AQ Management Through IT

Page 25: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Data Acquisition and Usage Activities

• The data life cycle consists of the acquisition and usage activities• The acquisition activates are single-track, firm procedures• The data usage activities are multi-track, dynamic procedures• The Infosystem for usage assumes the existence of validated data

Data Acquisition Data Usage

Page 26: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Current Delivery and Integration Systems

Data: Emission, Surface Satellite, Model

Single Datasets

Reports

Page 27: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Future Integrated AQ information System (Draft for Feedback)

NOAA WeaMod

EPA AQModel

FS FireInv

NOAA ASOS

RPO VIEWS

EPA-AQS DataMart

EPA NEI

NASA Missions

EPA AIRNow

NASA DAACs

NASAIDEA

EPA NEISGEI

NASA GloModel

NOAA GASP

NOAA Forecast

Data Providers Distributed Access, User-specific

•Stuff goes here ………….……………………………………………………………………………………………………………………………………………………

Uniform Access

•Stuff goes here ……………………………………………………………………………………………………………………………………………………………….

Data Processing Filtering, Aggregation, Fusion

Web Service Composition

•Stuff goes here ……….……………………………………………………………………………………………………………………………………………………….•Stuff goes here …….………………………………………………………………………………………………………………………………………………………….

AQ Forecasting

AQ Compliance

Status &Trends

Network Assess.

Info Products Reports, Websites

Standard

SciFlo

DataFed

Custom Processing

Page 28: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

User-Centered View

Data,Tool Data,Tool

Users have access only to their own private resources

Users have private and federated resources pool to work with

UsersUsers

Some resources are computer-accessible and can be shared

User 1 User 2

The Federation aids resource (re)use

Other Federations and Portals can also be shared

Other Feds, Portals Federated Resources

Data, Services, Tools

Shared resources can become part of the federation

Page 29: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Federated Air Quality Data System - Draft

Text 1Text 2

Wrappers

Where?

What?

When?

Federate Data

Structuring Slice & Dice

Explore Data

Viewers Programs

Integrate

Understand

AQ Compliance

Nowcast/Forecast

Status & Trends

Find Data Gaps

ID New Problems

………

Info Needs

Reports

EmissionSurface Satellite

Model

Single Datasets

Providers

Networking Reuse

ESIP AQ Cluster 050510 Draft [email protected]

Run and click PPT Slideshow to see chart animations

Non-intrusive Linking & Mediation Data UsersData Providers

Page 30: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Current AQ Data Provides

• Data includes emissions, surface data, satellite data and models• It is distributed geographically and providing agencies• Data sets are added and and removed by their autonomous providers• Data integration is hampered by incompatible form and access protocols

NOAA

GASP

NASA

DAACs

NASA

IDEA

NASA

Missions

EPA

NEI

EPA

NEISGEIFS FireInv

State/Local

Emission

NOAA

ASOS

RPO

VIEWS

EPA AIRNow

EPA-AQS

DataMart

NOAA

WeaModEPA

AQModel

NASA

GloModelNOAA

Forecast

Emission

Ambient

Satellite

Model

Content | Agency | Form

EPA

NOAA

NASA

Other

Page 31: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Future Integrated AQ information System (Draft for Feedback)

NOAA WeaMod

EPA

AQModelFS

FireInv

NOAA

ASOS

RPO VIEWS

EPA-AQS DataMart

EPA NEI

NASA Missions

EPA AIRNow

NASA DAACs NASA

IDEA

EPA NEISGEI

NASA

GloModel

NOAA GASP

NOAA Forecast

Current AQ Data Distributed Access, User-specific

•Stuff goes here ………….……………………………………………………………………………………………………………………………………………………

Data Federation Uniform Access, Content Focus

DataMart

VIEWS

NEISGEI

AIRNow

AQMod

DAACs

ASOS

NEI

Emission

IDEA

GASP

Missions

WeaMod

Forecast

GloMod

FireInv

•Stuff goes here ……………………………………………………………………………………………………………………………………………………………….

Data Processing Filtering, Aggregation, Fusion

Mediator Web Services

•Stuff goes here ……….……………………………………………………………………………………………………………………………………………………….•Stuff goes here …….………………………………………………………………………………………………………………………………………………………….

AQ Forecasting

AQ Compliance

Status and Trends

Network Assess.

Info Products Reports, Websites

Page 32: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Market Drivers for the Further-processed food Industry

Page 33: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Current AQ Information System

EPA AIRNow

EPA-AQS AIRS

NASA DAACs

Public

Manager

Scientist

•Since the users are also on the Internet, their geographic location is irrelevant

Federation

Page 34: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

•Users are distributed geographically

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

Policy

Policy

Policy

•Users includes policy makers

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Users includes policy makers, the public

Policy

Policy

Policy

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

PublicPublic

Current AQ Information System

•Users includes policy makers, the public, AQ managers

Policy

Policy

Policy

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

PublicPublic

Manager Manager

and scientist

Policy

Policy

Policy

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

PublicPublic

Manager ManagerScientist Scientist

Scientist

•Users are affiliated with multiple agencies: EPA, NOAA, NASA, as well as others

Policy

Policy

Policy PublicPublic

Manager ManagerScientist Scientist

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Furthermore, users access data in varied formats and access protocols

ManagerManager

Policy

Policy

Scientist

ScientistScientist

Policy

Public Public

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

Public

Manager

Scientist

•Since the users are also on the Internet, their geographic location is irrelevant

Page 35: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Current AQ Information System

•Data are distributed geographically by autonomous providers

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data,

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data, satellite data

Satellite

Satellite

SatelliteSatellite

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data, satellite data and model output

Model

Model

ModelModel

Satellite

Satellite

SatelliteSatellite

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data are provided by multiple agencies: EPA, NOAA, NASA, as well as others

NASAMission

NOAAGASP

NASAIDEA

NASA DAACs

NOAA ASOS

EPA-AQSDataMart

EPA AIRNow

RPO VIEWS

FS FireInv

State/LocalEmission

EPA NEISGEI

EPA NEI

NOAA WeaMod

EPAAQModel

NOAA Forecast

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

NASA DAACs

NOAA GASP

NASAIDEA

NASA Missions

EPA NEI

EPA NEISGEI

FS FireInv

State/Local Emission

NOAA ASOS

RPO VIEWS

EPA AIRNow

EPA-AQS AIRS

NOAA WeaMod

EPA AQModel

NASA GloModel

NOAA Forecast

•Furthermore, data are provided in varied formats and access protocols (plugs)

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

NASA DAACs

NOAA GASP

NASAIDEA

NASA Missions

EPA NEI

EPA NEISGEI

FS FireInv

State/Local Emission

NOAA ASOS

RPO VIEWS

EPA AIRNow

EPA-AQS AIRS

NOAA WeaMod

EPA AQModel

NASA GloModel

NOAA Forecast

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

EPA AIRNow

EPA-AQS AIRS

NASA DAACs

•Since the data are Internet-accessible, their geographic location is irrelevant

Page 36: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

•Users are distributed geographically

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

Policy

Policy

Policy

•Users includes policy makers

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Users includes policy makers, the public

Policy

Policy

Policy

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

PublicPublic

Current AQ Information System

•Users includes policy makers, the public, AQ managers

Policy

Policy

Policy

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

PublicPublic

Manager Manager

and scientist

Policy

Policy

Policy

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

PublicPublic

Manager ManagerScientist Scientist

Scientist

•Users are affiliated with multiple agencies: EPA, NOAA, NASA, as well as others

Policy

Policy

Policy PublicPublic

Manager ManagerScientist Scientist

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Furthermore, users access data in varied formats and access protocols

ManagerManager

Policy

Policy

Scientist

ScientistScientist

Policy

Public Public

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

Public

Manager

Scientist

•Since the users are also on the Internet, their geographic location is irrelevant

Page 37: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

•Data are distributed geographically and accessible through the internet

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data,

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data, satellite data

Satellite

Satellite

SatelliteSatellite

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data, satellite data and model output

Model

Model

ModelModel

Satellite

Satellite

SatelliteSatellite

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data are provided by multiple agencies: EPA, NOAA, NASA, as well as others

NASA

Mission

NOAA

GASP

NASA

IDEA

NASA

DAACs

NOAA

ASOS

EPA-AQS

DataMart

EPA

AIRNow

RPO

VIEWS

FS

FireInv

State/Local

Emission

EPA

NEISGEI

EPA

NEI

NOAA

WeaMod

EPA

AQModel

NOAA

Forecast

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

NASA DAACs

NOAA GASP

NASA

IDEA

NASA Missions

EPA NEI

EPA NEISGEI

FS

FireInv

State/Local Emission

NOAA

ASOS

RPO VIEWS

EPA AIRNow

EPA-AQS DataMart

NOAA WeaMod

EPA

AQModel

NASA

GloModelNOAA Forecast

Emission

Ambient

Satellite

Model

Content | Agency | Form

EPA

NOAA

NASA

Other

•Furthermore, data are provided in varied formats and access protocols (plugs)

•All data providers are autonomous, however some are linked

Current AQ Data Provides

Page 38: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Current AQ Information System

•Users are distributed geographically

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

Policy

Policy

Policy

•Users includes policy makers

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Users includes policy makers, the public

Policy

Policy

Policy PublicPublic

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Users includes policy makers, the public, AQ managers

Policy

Policy

Policy PublicPublic

Manager Manager

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

and scientist

Policy

Policy

Policy PublicPublic

Manager ManagerScientist Scientist

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Users are affiliated with multiple agencies: EPA, NOAA, NASA, as well as others

Policy

Policy

Policy PublicPublic

Manager ManagerScientist Scientist

Scientist

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Furthermore, users need various types of information provided in multiple formats

Policy

Manager

Policy

Scientist

ManagerScientistScientist

Policy

Public Public

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

•Since the users are also on the Internet, their geographic location is irrelevant

Public

Manager

Scientist

Internet

EPA

NOAA

NASA

Other

Stakeholder | Agency | Form

Policy

Manager

Public

Scientist

Page 39: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

•AQ info systems provide end-to-end data-analysis support to projects/programs

Public

Manager

Scientist

UsersProviders

NASA DAACs

EPA-AQS AIRS

EPA AIRNow

Compliance

Science

AIRNow

•Through a Federation the data are homogenized into multi-dimensional cubes

AQ Information Systems: Current and Future

•Data processing and rendering can then be performed through standard web services

Processor

•In future systems part of the data resources can be shared for re-use

Federation

•Each project/program can be augmented by data and services from the Federation

Processor

Page 40: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

Current AQ Information System

•Data are distributed geographically by autonomous providers

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data,

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data, satellite data

Satellite

Satellite

SatelliteSatellite

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data includes emissions, ambient data, satellite data and model output

Model

Model

ModelModel

Satellite

Satellite

SatelliteSatellite

Ambient

Ambient

Ambient

Ambient

Emission

Emission

Emission

Emission

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Data are provided by multiple agencies: EPA, NOAA, NASA, as well as others

NASAMission

NOAAGASP

NASAIDEA

NASA DAACs

NOAA ASOS

EPA-AQSDataMart

EPA AIRNow

RPO VIEWS

FS FireInv

State/LocalEmission

EPA NEISGEI

EPA NEI

NOAA WeaMod

EPAAQModel

NOAA Forecast

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

NASA DAACs

NOAA GASP

NASAIDEA

NASA Missions

EPA NEI

EPA NEISGEI

FS FireInv

State/Local Emission

NOAA ASOS

RPO VIEWS

EPA AIRNow

EPA-AQS AIRS

NOAA WeaMod

EPA AQModel

NASA GloModel

NOAA Forecast

•Furthermore, data are provided in varied formats and access protocols (plugs)

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

•Since the data are Internet-accessible, their geographic location is irrelevant

Internet

NASA DAACs

EPA-AQS AIRS

EPA AIRNow

Emission

Ambient

Satellite

Model

EPA

NOAA

NASA

Other

Content | Agency | Form

Page 41: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

AIRSCompliance

Manager

ScientistScience

AIRNow

• Current info systems are project/program oriented and provide end-to-end solutions

PublicAIRNow

Info UsersData Providers Info System

AQ Information Systems: Current and with DataFed

• Through the Federation, the data are homogenized into multi-dimensional cubes• Data processing and rendering can then be performed through standard web services• Each project/program can be augmented by data and services from the Federation

• Part of the data resources can be shared for re-use through DataFed

DAACs

Page 42: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]

ModelCompliance

Manager

ScientistScience

AIRNowPublicAIRNow

DAACs

Page 43: DRAFT April 28, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

DRAFT April 28, 2005 ESIP AQ Cluster, [email protected]


Recommended