Metro-Area High Performance Networks and Emergency Preparedness

Invited Talk to

SBC Technology Resources, Inc.

Austin, TX

December 4, 2001

Larry Smarr, Department of Computer Science and Engineering, Jacobs School of Engineering, UCSD,

Director, Cal-(IT)2

• Broadband to the Home and Small Businesses

• Parallel Lambdas in Long Haul and Metro

• Wireless Access--Anywhere, Anytime

• Vast Increase in Internet End Points– Embedded Processors

– Sensors and Actuators

– Information Appliances

• Emergence of a Distributed Planetary Computer– Storage of Data Everywhere

– Distributed Scalable Computing Power

Driving a Future Internet Mass Market for New Applications and Services

Governor Davis Has Initiated Four New Institutes for Science and Innovation

UCSBUCLA

California NanoSystems Institute

UCSF UCB

California Institute for Bioengineering, Biotechnology,

and Quantitative Biomedical Research

UCI

UCSD

California Institute for Telecommunications and Information Technology

Center for Information Technology Research

in the Interest of Society

UCSC

UCDUCM

www.ucop.edu/california-institutes

Cal-(IT)2

An Integrated Approach to the Future Internet

www.calit2.net

220 UCSD & UCI FacultyWorking in Multidisciplinary Teams

With Students, Industry, and the Community

The State’s $100 M Creates Unique Buildings, Equipment, and Laboratories

Over Fifty Industrial Sponsors From a Broad Range of Industries

Akamai Technologies Inc.AMCCAmpersand VenturesArch VenturesThe Boeing CompanyBroadcom CorporationCAIMIS, Inc.Conexant Systems, Inc.Connexion by BoeingCox CommunicationsDiamondhead VenturesDupontEmulex Corporation

Network SystemsEnosys MarketsEnterprise Partners

Venture CapitalEntropia, Inc.Ericsson Wireless

Communications, Inc.ESRIExtreme NetworksGlobal Photon SystemsGravitonIBM

ComputersCommunications

SoftwareSensors

BiomedicalStartups

Venture Capital

Newport CorporationOracleOrincon IndustriesPanoram TechnologiesPrintronixQUALCOMM IncorporatedQuantumThe R.W. Johnson Pharmaceutical Research InstituteSAICSamueli, Henry (Broadcom)SciFrame, Inc.Seagate Storage ProductsSGISilicon WaveSonySTMicroelectronics, Inc.Sun MicrosystemsTeraBurst NetworksTexas InstrumentsTime DomainUCSD HealthcareThe Unwired FundWebEx

IdeaEdge VenturesThe Irvine CompanyIntersil CorporationIrvine Sensors CorporationJMI, Inc.Leap Wireless InternationalLink, William J. (Versant Ventures)Litton Industries, Inc.MedExpert InternationalMerckMicrosoft CorporationMission VenturesNCR

$140 M Match From Industry

Cal-(IT)2 “Living-in-the-Future” Laboratories

• Undergraduate Education– UCSD Sixth College

• Graduate Education and Scientific Research– UCSD Computer Science Department– UCSD Scripps Institution of Oceanography

• Metro Broadband– San Diego Telecommunications Laboratory– Chicago Metro Net

• Medical Research and Clinical– UCSD SOM / Veterans Admin / Scripps Clinic / UCSD Healthcare

• Transportation– UCI Campus Parking– UCI ZEVNET

• Environmental Monitoring– SDSU Santa Margarita Ecological Reserve

CONTROL

PLANE

Clusters

DynamicallyAllocatedLightpaths

Switch Fabrics

PhysicalMonitoring

Cal-(IT)2 is Partnering with Chicago Researchers Creating Metro LambdaGrid Laboratories

• NSF-funded GMPLS Extensions

• Developing GigE and 10GigE Applications and Services

• Testing Optical Switches

• Linking Chicago to San Diego Metro Labs with Long Haul Fiber

Apps Middleware

EVL

LAC UIC StarLight/Northwestern

10x10 GigE

10GigE

10GigE 2x 10GigE

TNV1 TNC1

Router

TND1

RouterRouter

DWDM

TNV1 TND1

Router

DWDM

LambdaGrid On-Ramps Phase I (2002-2003)Gigabit Ethernet NICs to 10 Gigabit Ethernet MAN

• TND1 = Datamining Clusters at NU and UIC Lab. for Advanced Computing– 32 Pentium Processors With Raid Disks and GigE Networking Each

• TNV1 = Visualization Clusters (Gigapixel/sec) at NU and UIC EVL– 27 Pentium processors (5x5 screen array plus control/tracking) and GigE

• TNC1 = TeraGrid Computing Clusters at EVL– 16 Itanium processors for code construction and testing for the TeraGrid

• Match Cluster I/O to MAN Speeds– at 1990’s Workstation Prices

Source: Tom DeFanti, EVL, UIC

LambdaGrid On-Ramps : Phase II (2004-2005)10x10 Gigabit Ethernet and 2x80 Gbps MAN

• TND2 = Datamining Clusters at NU and UIC Lab. for Advanced Computing – 32 Deerfield processors with 10GigE networking each, NetRam storage

• TNV2 = Visualization Clusters at NU and UIC EVL– 27 Deerfield processors with 10GigE networking each, 25 screens

• TNC2 = TeraGrid Computing Clusters at EVL– 32 Deerfield processors with 10GigE networking each

LAC

10x 10GigE

UIC

O-O-Oswitch

EVL

TNV2 TNC2

router

10x10GigE

2x40GigE

2x40GigE

TND2

router

StarLight/Northwestern

TND2TNV2

router

DWDM DWDM

O-O-Oswitch

…

Source: Tom DeFanti, EVL, UIC

Research Topics in Metro Optical Networks

• Provide Integrated Services in the Tbit/s Range– Lambda-Centric Communication & Computing Resource Allocation– Middleware Services for Real-Time Distributed Programs – Extend Internet QoS Provisioning Over a WDM-Based Network

• Develop a Common Control-Plane Optical Transport Architecture With GMPLS: – Transport Traffic Over Multiple User Planes With Variable Switching

Modes– Lambda Switching– Burst Switching – Inverse Multiplexing (One Application Uses Multiple Lambdas)

– Extend GMPLS:– Routing– Resource Reservation – Restoration

UCSD, UCI, USC, UIC, & NW

Research Topics in Metro Optical Networks

• Enhance Security Mechanisms:– End-to-End Integrity Check of Data Streams– Access Multiple Locations With Trusted Authentication Mechanisms– Use Grid Middleware for Authentication, Authorization, Validation,

Encryption and Forensic Analysis of Multiple Systems and Administrative Domains

• Distribute Storage While Optimizing Storewidth:– Distribute Massive Pools of Physical RAM (Network Memory)– Develop Visual TeraMining Techniques to Mine Petabytes of Data – Enable Ultrafast Image Rendering – Create for Optical Storage Area Networks (OSANs)

– Analysis and Modeling Tools– OSAN Control and Data Management Protocols – Buffering Strategies and Memory Hierarchies for WDM Optical

Networks

UCSD, UCI, USC, UIC, & NW

The NSF TeraGridPartnerships for Advanced Computational Infrastructure

NCSA8 TF

4 TB Memory240 TB disk

Caltech0.5 TF

0.4 TB Memory86 TB disk

Argonne1 TF

0.25 TB Memory25 TB disk

TeraGrid Backbone (40 Gbps)

SDSC4.1 TF

2 TB Memory250 TB disk

This will Become the National Backbone to Support Multiple Large Scale Science and Engineering Projects

DataCompute

VisualizationApplications

Note: Weakly Optically Coupled Compared to Metro Clusters

Intel, IBM, Qwest

Creating Metro, Regional, State, National, and Planetary Optical Networking Laboratories

Seattle

Portland

Caltech

SDSC

NYC

SURFnet, CERN

CANARIE

Asia-Pacific

Asia-Pacific

AMPATH

TeraGrid

*ANL, UIC, NU, UC, IIT, MREN

AMPATH

Source: Tom DeFanti, Maxine Brown

Potential Extension

A Layered Software Architecture is Needed for Defense and Civilian Applications

www.ndia-sd.org/docs/NDIA_20June00.pdf

SPAWARSystemsCenter

San Diego

Grid Requirements for Internet Middleware Systems

• Identity & authentication• Authorization & policy• Resource discovery• Resource characterization• Resource allocation• (Co-)reservation, workflow• Distributed algorithms• Remote data access• High-speed data transfer• Performance guarantees• Monitoring

• Adaptation• Intrusion detection• Resource management• Accounting & payment• Fault management• System evolution• Etc.• Etc.• …

Source: Carl Kessleman

IBM Adopts Open Source Globus!

From Telephone Conference Calls to Access Grid International Video Meetings

Access Grid Lead-ArgonneNSF STARTAP Lead-UIC’s Elec. Vis. Lab

Creating a Virtual Global Research LabUsing IP Multicast

Millions of Video Cameras Are Attaching to the Net

• London Underground– Initially 25,000 Video Cameras– Expansion to 250,000 Possible– British Transport Police Switch to Any Camera in 1 Sec.

– Source: Telindus

• British CCTV System– Currently 2.5 Million CCTV Cameras Installed (NY Times)

– Average London Citizen is Seen by 300 Cameras Per Day

– Face Recognition Software Added in High Crime Areas

• Up to 6 Million Surveillance Cameras Across the USA in 5-7 Years– Privacy International Prediction

Integrating Wireless, Sensor and Data-Management Technologies

Source: Graviton, a Cal-(IT)2 Partner

Prototyping Early Warning Systems and Disaster Response Systems

• Three Tier System– Wireless SensorNets Brings Data to Repositories– Collaborative Crisis Management Centers– Remote Wireless Devices Interrogate Databases

• Cal-(IT)2 Will Focus on High Performance Grids– Analysis, Collaboration, and Crisis Management– Broadband Wireless Sensornets– Metro Optical Network Testbed

• Build a “Living-in-the-Future” Laboratory– UCSD, UCI, and SDSU Campuses– San Diego, Orange County, Cross Border– Early Access to HW/SW from Industrial Partners

Prototyping a Data Grid for the Geosciences

IGPP, SIO, UCSD

Cal-(IT)2 Multi-Megapixel Displays for Seismic and Geosciences Monitoring

Cal-(IT)2 / SIO / SDSC / SDSU

Linking Analysis and Visualization Facilitiesby Optical Networks is the Next Step

• Multiple Uses– Data Analysis– Crisis Management– Governmental and Private Sector Virtual Enterprises

• Distributed Collaboration– Multiple Video and Large Image Streams– Software to Enable Real Time Group Decisions

• Data and Compute– PC Clusters– AI Data Mining

• Driven by Data-Intensive Applications– Safety of Civil Infrastructure– Subsurface Oil and Gas Discovery and Management– Intelligent Transportation Systems– Distributed Medical Facilities

Multi-Sensor Data Fusion Control Rooms are Needed for Managing Crisis Response

• Create Through Telecommunications and IT– Situational Awareness– Common Operational Picture– Local Data Warehouse with Remote Data Access– AI Data Mining of Distributed Databases– Spatial Data Analysis – Consequences Assessment Tool Set

Source: Panoram Technologies

HOTLINKs for Damage Locations using GPS and Digital Photos on

GIS

Integrate Remote Reconnaissance with Satellite Imagery and Ground SensorNets

Maria Feng UCI Civil & Environmental Engineering

GIS Based Crisis Management Software Tools--SAIC’s Consequences Assessment Tool Set (CATS)

• Prediction of Disaster Evolution– Hurricane, Earthquake, Terror

• Casualty Distribution Probabilities• Response Management

Source: SAIC

Web Browser - Portal Interface

Portal Engine User PreferencesState Values

Data Gather

XML HTML

Legacy and Problem Specific Databases, Collections, & Literature

Analysis Tools:- Pattern Recognition- GIS Queries- Data Mining- Multi-Sensor Fusion

Applications:- Epidemiology- Transportation Systems- ...

Common Portal ArchitectureCustomized for Crisis Management

Built on Prior SDSC and NCSA Work

Data Mining Across Agency Stovepipes Is an Essential Next Step

CRIMINALJUSTICE

EMERGENCYRESPONSE

PUBLICHEALTH

SECURITY

INTEGRATEDINTELLIGENCE

SYSTEM

Local

State

Federal

INFORMATIONSOURCES

Cal-(IT)2 is Partnering With SAIC On Emergency Preparedness