Interoperable Information System of Systems for HTAP

GEOSS/AMI Domain of ActionsBased on ideas of P. Senge: Architecture of Learning Organizations

Possible DataFed Roles:

1. Guiding Idea: Refine, solidify, evangelize the System of Systems idea

2. Methods and Tools: Develop, promote, implement standards; Coordinate SoS use cases

3. Infrastructure: Maintain the DataFed middleware for distributed data access; Supply Agency champions with SoS ‘sales’ material

P. Senge et. al, 1994: Fifth Discipline Fieldbook (Link)

Guiding Idea: System of Systems

Methods, Tools: Standards, Use Cases

Infrastructure: Web 2.0, Local Champs

Domain of ActionOrganizational Architecture

Characteristics of a 5D World

• Time and place are no longer barriers to participation and interaction • Access is open to specialists and non-specialists alike• Information is the primary driver for progress• Possibilities expanded by new capabilities, resources, mechanisms

The world is flat -Thomas FriedmanThe flat world is expanding - Anonymous

More room for innovation (Emergence)New spaces for learning and discovery (Web is Expanding)Expanded opportunities for collective collaboration and interaction Greater capabilities for research and education

NSF GoalsTo catalyze the development of a system of science and engineering data collections that is open, extensible and evolvable.To support development of a new generation of tools and services facilitating data acquisition, mining, integration, analysis, and visualization.

http://datafed.net/

GEOSS-Like Air Quality System of Systems?

Characteristics of System of Systems (SoS)(Based on DoD Descriptions)

• Autonomous constituents managed/operated independently• Independent evolution of each constituent• Displays emergent behavior

Must recognize, manage, exploit the characteristics:

• No stakeholder has complete SoS insight• Central control is limited; distributed control is essential• Users, must be involved throughout the life of a SoS

Some major AQ Information System Challenges(Same as the DoD, ES Challenges?)

WCS/WMS

App

App

App

App

Are WCS/WMS Convergence Protocols?

Connecting Humans!

What few things must be the same so that everything else can be different? (GEOSS)

Right Level of Networking?

From GADS (1990) to GEOSS (2010) Information Systems

• Build on existing systems to provide comprehensive, coordinated Earth observations and transforming the data into vital information for society

• Implement interoperability arrangements using open standards, shared architecture

• Goal: Advance air quality model-observation complex to level of meteorological FDDA systems

• Build Organizational frameworks : IGACO-EMEP efforts• Data base, IT standards: data unification center? Practical LRTAP task?• Standardization/QAQC Reference material, or method (aerosols)• Adopt model evaluation/fusion as a design principle• Support linkage of ground based and satellite observation platforms through

development of a sustainable vertical profiling system (aircraft and ground based lidar)

• Address integration of disparate data bases– QA/QC: provide requirements for data standards/metadata descriptions– Data base unification

• Harness the communities around major tools, platforms and programs. – Air quality modeling platforms (GEOS-chem, MOZART, CMAQ,….more)– Satellite Instruments (MODIS, OMI)– Existing routine surface (AIRNow, VIEWS, EMAP,…) and aircraft programs– Integration efforts (AEROCOM)

Generic Decision Support for Air Quality Decisions

Global Earth Observing System of Systems

GEOSS

Architecture Framework

Knowledge into the Minds of

Regulatory Analysts

Knowledge into the Minds of

Technical Analysts

Observations

Reports:Model Forecasts,

Obs. Evidence

Models

DecisionsKnowledge

into the Minds of

Decision- making managers

Decision Support System

Coarse Outline

• GEOSS Approach – GEOSS System of Systems – GEOSS Information - Internet - Architecture diagram – International Standards – What few things... Convergence protocols – User - driven – Infrastructe - extension of current systems

• Data Model Hanrmonisation – Data-Data comparison – Model-Model omparison – Model-Data Comparison -> Integration

• Analysis System for HTAP – Obs Evidence – Model Evidence – Integrated Model Obs

• Reporting System – Writing

• Information Science, Engineering Technology fpr HTAP – Information Science, Architechure (Master Framworks, SOA) – Engineering, Linkages, Driving forces (Services, Network, Linkages) – Technologies (Web Services, Workflow, Wiki, Social Software)

• Application Examples – Exceptional Event – Model Intercomaprison – ...

Plan for Action (NSF)

• Coherent Organizational Framework – Diversity of approaches– Communities of practice– Community proxy roles of collections– Dynamic and evolving system

• Flexible Technological Architecture– Layered capabilities– Metadata– Data analysis and visualization tools– Promoting and use of stable standards

• Coherent Data Policies

– Transparent policy frameworks

– Data management plans

– Interagency coordination

– International cooperation

For SEAS not DataFed

Here are a few quotes resonate with my thinking: 

 • Charles Vest, MIT  on the idea of  Meta University : "What we are observing

is the early emergence of a Meta University -- a transcendent, accessible, empowering, dynamic community-constructed framework of open material and platforms on which much of higher education worldwide can be constructed or enhanced." 

• Our School could be active member of the community that constructs the frameworks and populates it with open materials and platforms..

•  • NSF Strategic Plan for Data, Data Analysis, and Visualization

“… a vision in which science and engineering digital data are routinely deposited in well-documented form, are regularly and easily consulted and analyzed by specialists and non-specialists alike, are openly accessible while suitably protected, and are reliably preserved.”

• In atmospheric chemistry and pollution, we are already a major center for openly accessible global-scale information resources. Together, we could do and show much more. 

• A disruptive technology or disruptive innovation is a technological innovation, product, or service that eventually overturns the existing dominant technology or product in the market. Disruptive innovations can be broadly classified into lower-end and new-market disruptive innovations. A new-market disruptive innovation is often aimed at non-consumption, whereas a lower-end disruptive innovation is aimed at mainstream customers who were ignored by established companies. Sometimes, a disruptive technology comes to dominate an existing market by either filling a role in a new market that the older technology could not fill (as more expensive, lower capacity but smaller-sized hard disks did for newly developed notebook computers in the 1980s) or by successively moving up-market through performance improvements until finally displacing the market incumbents (as digital photography has begun to replace film photography).