The chasm of cyberinfrastructures

The Chasm of Cyberinfrastructures

Harold Teunissen et al. #I2SUMMIT14, April 2014

A Dutch Perspective

Early adopters

2The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.

Serving Dutch Higher Education


The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.

Cyberinfra Corp.

• All ICT activities for Higher Education and Research in the Netherlands are under one umbrella

4

Shared Professional Services

Scientific Computing& Data

Commercial ICT Products & Services

National Research & Education Network

eScience Collaboration and Tools

Core Elements


Adapted from: Berman, 2001 & Lippincott, 2011

CYBERINFRASTRUCTURE

People & Training

Broadband Network Connectivity

Large Databases & Libraries

InstrumentationHigh Performance Computing

Collaboration

Big Hype


2005 130 EB

2010 1,227 EB

2015 7,910 EXABYTE

2020 1,000 ZETABYTE?

2000

Out or in control?


Entropy


KNOWLEDGECHAOS

Too Big Data

Required Processing Power

Am

oun

t o

f D

ata

Max. AvailableProcessing Power

Long tail of science


# of researchers

Scal

e

Large Scale, Multi-

Disciplinary and Complex

Small Scale but getting complexer

ACCELERATION

Secret of their success


Vision of Cyberinfra


Glueing the components…


GLUE

…or just patchwork?


Network BNetwork ANetwork C

Just within our reach


We started building


http://static4.depositphotos.com/1000992/514/i/950/depositphotos_5146031-Laboratory-glassware.jpg

Generic resource broker



• Interfacing to domain specific resource brokers • Aggregation of available resources provided by

specific brokers • Authorisation based on federated identity attributes • Advance reservation • Reporting and monitoring • Scheduling • Brokering • Accounting • Auditing

Ultimate functionality

17

Technical Challenges


Organizational Differences


Financial Hurdles


“How to eat an elephant?”


ENLIGHTEN YOUR RESEARCH


Enlighten your research

22

Radio Astronomy — Pulsar Research

Climate Modeling for Scientist and Decision Makers

CineGRID — 4K+ Video Distribution Testbed

Next Generation DNA Sequencing

Jungle ComputingCentralized Imaging for Large Scale Population Imaging

Contest

SURF Outreach & Support


Erasmus MC

TU Delft

WUR

RUG

Life Science Grid ClusterLUMC

AMCVU MC

Complete Genomics, LA, CA. (BGI)

BGI, Hong Kong

EYR3 : NG DNA SQ


Big Data Big Deal! - #tnc2013 - Maastricht, NL

Chasm


Source: Geoffrey A. Moore c.s.

Techies Visionaries Pragmatics Conservatives Laggards

Chasm

WAITING TO HAPPEN

...solutionsand convenience

...technology and performance

time

# o

f cu

sto

mer

s


Bandwidth on demand


Source: Geoffrey A. Moore c.s.

Techies Visionaries

Chasm

ALMOST HAPPENING

time

# o

f cu

sto

mer

s

… The Rest

7-9 YEARS

20142006 2009 2016

Rethinking the vision


Physical Infrastructure Layer

Data Center (Storage & Compute) Network Constellation Science DMZ

S3

Virtualization of resources


Infastructure Virtualization



S3

Coordinated virtualization




Coordinated Infrastructure Virtualization

Data Center Virtualization Network Vitualization Instrumentation Virtualization


S3

Link to the applications




S3

Cyberinfastructure as a Service

Infastructure VirtualizationCoordinated Infrastructure Virtualization


Orchestration of infrastructure




Virtual CyberinfrastructureComposition & Orchestration

Virtual Cyberinfrastructure Operation & Management


S3

Applications Applications Applications Business Logic



Inspired by: Brocade, “DS of the Future” & S. Peng et al., “DSaaS”, 2013

Cyberinfrastructure as a Service







S3




CIaaS

Inspired by: Brocade, “DS of the Future” & S. Peng et al., “DSaaS”, 2013

Standards and implementations







S3




CIaaS

OpenFlow

FortNOX

Fresco

NSI OSCARS

FlowScale

Beacon

FlowVisor

OpenStack

OCCI

Maestro

vSphere

Hypervisor

Ideal world


Inspired by: S. Peng et al., 2013




CIaaS

Data Center Network Science DMZ

S3

Virtual Collaboration

Quite a challenge






S3

Domain I Domain II Domain III Domain IV Domain V

CIaaS

Virtual Collaboration

?

Federation of CIaaS


Cyberinfrastructure as a Service



Virtual Data Center Composition & Orchestration

Virtual Data Center Operation & Management

Coordinated Infrastructure Virtualization



S3

?


Outlook


Innovation Trigger

Peak of Inflated

Expectation

Through of Disillusions Slope of Enlightment

Plateau of Productivity

Software Defined Networking

SDN

VIRTUALIZATION

SDx

time

Exp

ecta

tions

Source: Gartner July 2013

JULY 2013

5-10 YEARS

2-5 YEARS TO REACH PLATEAU

LESS THAN 2 YEARS

OpenFlow

OpenStack

[email protected] haroldteunissen

mailto:[email protected]

mailto:[email protected]

Date post:	11-Nov-2014
Category:	Education
Upload:	harold-teunissen
View:	211 times
Download:	5 times