Development of Cyberinfrastructure During Development of Cyberinfrastructure During Rapid and Interconnected ChangeRapid and Interconnected Change

Dan LubinDan LubinCyberinfrastructure Program ManagerCyberinfrastructure Program Manager

NSF Office of Polar ProgramsNSF Office of Polar Programsdlubin@nsf.govdlubin@nsf.gov

Also thanks to Also thanks to Bill WisemanBill WisemanArctic Natural SciencesArctic Natural Sciences

NSF Office of Polar ProgramsNSF Office of Polar Programs

Arctic ForumArctic Forum15 May 2008 Washington DC15 May 2008 Washington DC

How must research adapt to a How must research adapt to a rapidly changing Arctic?rapidly changing Arctic?

August 1941 August 2004Muir and Riggs Glaciers, AKCourtesy Mark Parsons, NSIDC

Cyberinfrastructure becomes a Cyberinfrastructure becomes a critical considerationcritical consideration

Historical data in all forms must be preserved.Historical data in all forms must be preserved.– In a rapidly changing Arctic, data from past decades are a In a rapidly changing Arctic, data from past decades are a

priceless benchmark.priceless benchmark.

We’re past IPCC 2007 Physical Science Basis.We’re past IPCC 2007 Physical Science Basis.– On to assessment of ecological, human impacts, adaptation, On to assessment of ecological, human impacts, adaptation, – Increasing international collaboration.Increasing international collaboration.– Redouble climate observations for both physical and life Redouble climate observations for both physical and life

sciences.sciences.

The physical, life science, and social science disciplines The physical, life science, and social science disciplines must be able to talk to each other!must be able to talk to each other!– Data of all types must be made interoperable across disciplines.Data of all types must be made interoperable across disciplines.– Large data sets such as satellite remote sensing and GCM Large data sets such as satellite remote sensing and GCM

model output must be accessible and interpretable across model output must be accessible and interpretable across disciplines.disciplines.

Cyberinfrastructure by ComponentsCyberinfrastructure by Components

Learning & Work Force Learning & Work Force Needs & OpportunitiesNeeds & Opportunities

Virtual Virtual Organizations for Organizations for

Distributed Distributed CommunitiesCommunities

High High Performance Performance ComputingComputing

Data Data Visualization Visualization & Interaction& Interaction

CourtesyLucy Nowell, OCI

Required Reading!Required Reading!

High High PerformancPerformanc

e e ComputingComputing

High High PerformancPerformanc

e e ComputingComputing

Data, Data Data, Data Analysis & Analysis & VisualizatioVisualizatio

nn

Data, Data Data, Data Analysis & Analysis & VisualizatioVisualizatio

nn

Virtual Virtual OrganizatioOrganizatio

nsns

Virtual Virtual OrganizatioOrganizatio

nsns

Learning & Learning & Workforce Workforce DevelopmeDevelopme

ntnt

Learning & Learning & Workforce Workforce DevelopmeDevelopme

ntnt

Cyberinfrastructure Vision, March 2007

Available on NSF Office of Cyberinfrasturcture web sitewww.nsf.gov/pubs/2007/nsf0728/index.jsp

Transformative Application - to

enhance discovery & learning

R&D to enhance technical and social effectiveness of future

CI environments

Provisioning -Creation,

deployment and operation of advanced CI

Cyberinfrastructure in Practice

Courtesy Dan Atkins, OCI Director

Office of Cyberinfrastructur

e

provides shared and connecting CIcatalyzes

Borromean Ring: The three rings taken together are inseparable, but remove any one ring and the other two fall apart. See www.liv.ac.uk/~spmr02/rings/

OCI Science Drivers apply directly to OCI Science Drivers apply directly to today’s Arctic climate change problemstoday’s Arctic climate change problems

• Inherent Inherent complexity and multi-scalecomplexity and multi-scale nature of nature of todays frontier science challenges.todays frontier science challenges.

• Requirement for Requirement for multimulti-disciplinary, -disciplinary, multimulti--investigator, investigator, multimulti-institutional approach (often -institutional approach (often international).international).

• High High data intensitydata intensity from simulations, digital from simulations, digital instruments, sensor nets, observatories.instruments, sensor nets, observatories.

• Increased value of data and demand for data Increased value of data and demand for data curation & preservationcuration & preservation of access. of access.

• Exploiting infrastructure Exploiting infrastructure sharing sharing to achieve to achieve better stewardship of research funding.better stewardship of research funding.

• Strategic need for Strategic need for engaging more studentsengaging more students in in high quality, authentic science and engineering high quality, authentic science and engineering education.education.

Dan Atkins, OCI Director

Emerging OCI Coordination StructureEmerging OCI Coordination Structure

CI COUNCILCI COUNCILDirectorDirectorDep. DirDep. Dir

BIOBIOCISECISEEHREHRENGENGGEOGEOMPSMPSOISEOISEOCIOCIOPPOPPSBESBE

CI COUNCILCI COUNCILDirectorDirectorDep. DirDep. Dir

BIOBIOCISECISEEHREHRENGENGGEOGEOMPSMPSOISEOISEOCIOCIOPPOPPSBESBE

HPC Coordinating HPC Coordinating GroupGroup

HPC Coordinating HPC Coordinating GroupGroup

Other Federal Other Federal Research & Research &

Mission Agency Mission Agency ProgramsPrograms

Other Federal Other Federal Research & Research &

Mission Agency Mission Agency ProgramsPrograms

Data Data Coordinating Coordinating

GroupGroup

Data Data Coordinating Coordinating

GroupGroup

Directorate/Office CI Directorate/Office CI Coordinators CommitteeCoordinators Committee

Directorate/Office CI Directorate/Office CI Coordinators CommitteeCoordinators Committee

SubcommittSubcommitt

ee on ee on Networking Networking & IT R&D& IT R&D

SubcommittSubcommitt

ee on ee on Networking Networking & IT R&D& IT R&D

National National Science & Science &

Technology Technology Council Council (OSTP)(OSTP)

National National Science & Science &

Technology Technology Council Council (OSTP)(OSTP)

Committee Committee on on

TechnologyTechnology

Committee Committee on on

TechnologyTechnology

Other Other Coordinating Coordinating Groups TBDGroups TBD

Other Other Coordinating Coordinating Groups TBDGroups TBD

Inter Agency Inter Agency Data GroupData GroupInter Agency Inter Agency Data GroupData Group

International e-International e-science, cyber science, cyber

science science programsprograms

International e-International e-science, cyber science, cyber

science science programsprograms

Advisory Committee Advisory Committee on on

CyberinfrastructureCyberinfrastructure

Advisory Committee Advisory Committee on on

CyberinfrastructureCyberinfrastructure

OCIOCIOCIOCI

Additional linkage within NSF through joint appointments and every OCI Program Officer having a liaison role with another Directorate or

Office

Liaison with each Directorate/Office

ACCI Task ACCI Task Force Force

GroupsGroups

ACCI Task ACCI Task Force Force

GroupsGroups

Dan Atkins,Director OCI

Track 1: One solicitation funded

over 4 years: $200M acquisition +

additional O&M cost.Track 2: Four

solicitations over 4 years: $30M/yr

acquisition + additional O&M cost. First track 1

approved 8-07

TeraGrid• Large-scale operational CI for national open science community

11 resource providers1 Grid Infrastructure Group (GIG)

• Single unified allocation process• Comprehensive user support

Advanced applications & software integrationScience gateways

• RS & Modeling: Don’t be afraid to check it out!

High Performance Computing

Drivers for OCI Data & Data Interoperability StrategyDrivers for OCI Data & Data Interoperability Strategy

Increased scale & Increased scale & heterogeneity of Dataheterogeneity of DataDemand for federation & Demand for federation & semantic interoperabilitysemantic interoperabilityIncreased expectations for Increased expectations for sharing & opennesssharing & opennessMore systematic quality More systematic quality control & long-term control & long-term accessaccess

Examples from CADIS(AON Program)

Lucy Nowell, OCI

OCI Data StrategyOCI Data StrategyOCI Data StrategyOCI Data Strategy

Federal Agencies, Academia, Library & Preservation Sector, Foundations & Non-profits, Commercial Sector, National

Laboratories, International Agencies

MechanismsMechanisms

Act

iviti

esA

ctiv

ities

DATANETPartners

Exec-level Review of NSF Data Policies

Blue Ribbon task force on sustainable data repositories

Lucy Nowell, OCI

Funded Funded ProgramsPrograms

Policy Policy ConsiderationConsideration PartnershipsPartnerships

National National FrameworkFramework

DATANET DATANET

PartnersPartners

Digital Data Digital Data Coordinating Coordinating GroupGroup

IInteragency Data nteragency Data Working GroupWorking Group

Culture Culture ChangeChange INTEROPINTEROP

Exec-LevelExec-Level

Review of NSFReview of NSF

Data PoliciesData Policies

Blue Ribbon Task Blue Ribbon Task Force on Force on Sustainable data Sustainable data repositoriesrepositories

Tools & Tools & ResourcesResources SDCI, STCISDCI, STCI NSF DataNSF Data Policies & Policies &

Registry ServicesRegistry ServicesNSF-wide data NSF-wide data working groupworking group

Opportunity Opportunity ExplorationExploration

Federal Agencies, Academia, Library & Preservation Sector, Federal Agencies, Academia, Library & Preservation Sector, Foundations & Non-profits, Commercial Sector, National Foundations & Non-profits, Commercial Sector, National

Laboratories, International AgenciesLaboratories, International Agencies

P: people, I: information, F: facilities, instruments

ST-SPST-SPPP: Physical mtgs: Physical mtgsII: Print-on-paper : Print-on-paper books, journalsbooks, journalsFF: Physical labs, : Physical labs, studios, shopsstudios, shops

DT-SPDT-SPPP: Shared : Shared notebooknotebookII: Library : Library reservesreservesFF: Time-shared : Time-shared physical labs, ...physical labs, ...

DT-SPDT-SPPP: Shared : Shared notebooknotebookII: Library : Library reservesreservesFF: Time-shared : Time-shared physical labs, ...physical labs, ...

ST-DPST-DPPP: AV : AV conferenceconferenceII: Web search: Web searchFF: Online : Online instrumentsinstruments

ST-DPST-DPPP: AV : AV conferenceconferenceII: Web search: Web searchFF: Online : Online instrumentsinstruments

DT-DPDT-DPPP: Email: EmailII: Knowbots: KnowbotsFF: Autonomous : Autonomous observatoriesobservatories

DT-DPDT-DPPP: Email: EmailII: Knowbots: KnowbotsFF: Autonomous : Autonomous observatoriesobservatories

TimeSame

(synchronous)Different

(asynchronous)

Geog

rap

hic

P

lace S

am

eD

iffere

nt

Virtual Organizations offer additional modes of interaction between People, Information, and

FacilitiesCourtesyDiana Rhoten, OCI

Virtual Organization ExamplesVirtual Organization ExamplesNanoHUB (www.nanohub.org)NanoHUB (www.nanohub.org)– Serving the nanotechnology communityServing the nanotechnology community– One of the most successful sets of VO portal software, now One of the most successful sets of VO portal software, now

spinning of as HUBzero (www.hubzero.org)spinning of as HUBzero (www.hubzero.org)

National Ecological Observatory Network National Ecological Observatory Network (www.neoninc.org)(www.neoninc.org)– Continental-scale research platform investigating impacts of Continental-scale research platform investigating impacts of

climate change, land use change, and invasive species on ecologyclimate change, land use change, and invasive species on ecology

Network for Earthquake Engineering Cyberinfrastructure Network for Earthquake Engineering Cyberinfrastructure Center (NEESgrid) (http://it.nees.org)Center (NEESgrid) (http://it.nees.org)– Real-time access to remote experiments in earthquake engineeringReal-time access to remote experiments in earthquake engineering

Arctic Observation Network Arctic Observation Network (www.eol.ucar.edu/projects/aon-cadis/)(www.eol.ucar.edu/projects/aon-cadis/)– Instrument deployment underwayInstrument deployment underway– Cooperative Arctic Data and Information Service (CADIS) evolving, Cooperative Arctic Data and Information Service (CADIS) evolving,

very promisingvery promising

Cyberinfrastructure considerations Cyberinfrastructure considerations lead to philosophical considerationslead to philosophical considerations

Data interoperability and virtual organizations require Data interoperability and virtual organizations require consideration of ontologies, semantics and provenance.consideration of ontologies, semantics and provenance.Data Product Suites versus Observation SuitesData Product Suites versus Observation Suites““Place-based” observations (e.g., LTER model) versus Place-based” observations (e.g., LTER model) versus Large-scale observations (e.g.,NEON model)Large-scale observations (e.g.,NEON model)Is your science plan capability based (What can we do?) Is your science plan capability based (What can we do?) or requirements based (What should be done?), and is or requirements based (What should be done?), and is this choice appropriate?this choice appropriate?Does your plan for measuring climate and ecological Does your plan for measuring climate and ecological forcings contain built-in assumptions about which are forcings contain built-in assumptions about which are most important?most important?Rigorous consideration of CI requirements will compel Rigorous consideration of CI requirements will compel you to answer these questions!you to answer these questions!

Requirements for Success with OCI Requirements for Success with OCI SolicitationsSolicitations

Domain Science (everything we do) must have an equal partnership with Domain Science (everything we do) must have an equal partnership with Computer Science.Computer Science.– Computer Science must Computer Science must notnot appear to be the servant of the Domain Science. appear to be the servant of the Domain Science.– If you do anything If you do anything polarpolar – you are a – you are a domain scientistdomain scientist!!

OCI panels tend to be heavily weighted by computer scientists’ input!OCI panels tend to be heavily weighted by computer scientists’ input!– Not always by number, sometimes by unique expertise, strong personalities!Not always by number, sometimes by unique expertise, strong personalities!

You should have a bona fide computer scientist as a collaborator.You should have a bona fide computer scientist as a collaborator.– Computer scientist, informatician, sociologist, etc., depending on solicitation.Computer scientist, informatician, sociologist, etc., depending on solicitation.– Someone actively publishing in the area of his/her contribution.Someone actively publishing in the area of his/her contribution.– Involve, or (even better) potential to publish: research in top-flight computer or Involve, or (even better) potential to publish: research in top-flight computer or

information science peer-review journals.information science peer-review journals.– Computer trade journals, software manuals, not sufficient for your reference list!Computer trade journals, software manuals, not sufficient for your reference list!– Your work/management plan must clearly discuss everyone’s role, even on a 5-Your work/management plan must clearly discuss everyone’s role, even on a 5-

page preproposal. A “token” computer scientist, or name dropping, won’t fly!page preproposal. A “token” computer scientist, or name dropping, won’t fly!– Broader Impacts must be robust and credible, not boilerplate!Broader Impacts must be robust and credible, not boilerplate!

Challenge: Panels are multidisciplinary, highly competitive – you must Challenge: Panels are multidisciplinary, highly competitive – you must engage the reviewers and keep them excited about your work!engage the reviewers and keep them excited about your work!Positive:Positive: Great interest in global climate change issues throughout OCI! Great interest in global climate change issues throughout OCI!

Proposal versus PreproposalProposal versus PreproposalPreparing a ProposalPreparing a Proposal– You take lots of long walks.You take lots of long walks.– You write the best 15 pages you can, finishing a draft at least You write the best 15 pages you can, finishing a draft at least

several days before the deadline.several days before the deadline.– You do a lot of proofreading, editing, and polishing before You do a lot of proofreading, editing, and polishing before

submitting the proposal.submitting the proposal.– You can count on ~10 minutes of discussion about your proposal You can count on ~10 minutes of discussion about your proposal

in the NSF panel.in the NSF panel.

Preparing a PreproposalPreparing a Preproposal– You need to take just as many long walks.You need to take just as many long walks.– You only need to write 5 pages, but you need to engage the You only need to write 5 pages, but you need to engage the

reviewers, convince them that your project is worth doing and will reviewers, convince them that your project is worth doing and will break new ground.break new ground.

– Convince reviewers that your team is well constituted.Convince reviewers that your team is well constituted.– Convince reviewers that details of methods and literature survey Convince reviewers that details of methods and literature survey

will follow in the full proposal.will follow in the full proposal.– You do just as much proofreading, editing, and polishing before You do just as much proofreading, editing, and polishing before

submitting the preproposal.submitting the preproposal.– You can count on ~5 minutes of discussion in the NSF panel.You can count on ~5 minutes of discussion in the NSF panel.

Cyberinfrastructure and OPPCyberinfrastructure and OPPOCI will very likely set the standard for future OCI will very likely set the standard for future OPP investments in data management and OPP investments in data management and interoperability, cyber-enabled collaboration, and interoperability, cyber-enabled collaboration, and other requirements for computational resources.other requirements for computational resources.

Most of the OCI solicitations lend themselves Most of the OCI solicitations lend themselves very well to polar concerns. Do consider very well to polar concerns. Do consider submitting proposals!submitting proposals!

There has already been good interest in OCI There has already been good interest in OCI proposal submission by polar researchers earlier proposal submission by polar researchers earlier this year. Can we keep it up next year?this year. Can we keep it up next year?

Polar Researchers: I’m on your side! Polar Researchers: I’m on your side! (dlubin@nsf.gov, 703-292-7416)(dlubin@nsf.gov, 703-292-7416)