Erik-Jan Bos Director of Network Services SURFnet, The ...proj.sunet.se/TP10/Slides/SURFnet.pdf ·...

SUNET, Kiruna, SE, March 30th-31st, 2004

SURFnet6Integrating the IP and Optical worlds

SURFnet6SURFnet6Integrating the IP and Optical worlds Integrating the IP and Optical worlds

Erik-Jan BosDirector of Network Services SURFnet, The Netherlands

TrefPunkt Kiruna, 30-31 mars 2004


Presentation contentsPresentation contentsPresentation contents

• SURFnet and GigaPort: The environment

• NetherLight: The testbed

• SURFnet6: Where IP and Optical meet in the production network

• Conclusions






• Conclusions


SURFnet, the organization (1)SURFnet, the organization (1)SURFnet, the organization (1)

• Provides the Dutch National Research Network• Not for profit company, 50 employees• 150 connected organizations; 182 physical

connections; 800,000 users• Turnover (2002): 30 million Euro• Infrastructure services:

– innovation paid for by government– cost effective exploitation for higher education and

research


SURFnet, the organization (2)SURFnet, the organization (2)SURFnet, the organization (2)

• Three “product” departments:– Advanced Services– Middleware Services– Network Services

• Two “outlet” departments:– Account Advising– Community Support

• All operations subcontracted


SURFnet network generationsSURFnet network generationsSURFnet network generations

• SURFnet1: DECnet Phase 4 over public X.25• SURFnet2: DECnet and IP over private X.25• SURFnet3: IP and X.25 over leased lines• SURFnet4: IP over ATM over SDH -> IP over SDH• SURFnet5: IP over unprotected lambda

• Moving towards simpler architectures (KIS)…


SURFnet, connecting the customersSURFnet, connecting the customersSURFnet, connecting the customers

SURFnet4155 Mbit/s

SURFnet19,6 kbit/s

SURFnet264 kbit/s

SURFnet32 Mbit/s

SURFnet434 Mbit/s

SURFnet520 Gbit/s

100 Gbit/s

1 Gbit/s

10 Mbit/s

100 kbit/s

10 kbit/s

1 Mbit/s

100 Mbit/s

10 Gbit/s

1987 1989 1992 1995 1997 2002

Acc

ess

capa

city


GigaPortGigaPortGigaPort

• Research networking is innovation engine between research and market introduction of new services

– GigaPort (1999-2003): • Applications and Network [SURFnet5]• government grant: 70 million Euro • contribution of industry : ≥ 90 million Euro

– GigaPort Next Generation Network [SURFnet6] (2004-2008): • consortium of 50 organizations• government grant: 40 million Euro • contribution of industry and institutions: ≥ 56 million Euro


SURFnet5SURFnet5SURFnet5

• Partners BT and Cisco

• 15 concentrator PoPs connected by thirty 10 Gbit/s unprotected lambdas

• Managed dark fiber to Remote PoPs

• Dual stack IPv4 and IPv6 since mid 2001

• 122 customer connections at Gbit/s level: 67% @GE


SURFnet5 topologySURFnet5 topologySURFnet5 topology


SURFnet5 IPv6SURFnet5 IPv6SURFnet5 IPv6

• Problem:– SURFnet5 was built using E2 and E4 LCs

• Solution:– At the edges: Replaced almost all E2 cards by E3 cards– In the backbone: 6PE (IPv6 over MPLS)

• Result:– SURFnet5 is close to wire speed IPv6 at 10 Gbit/s

• Next challenge: IPv6 multicast


0

20

40

60

80

100

120

140

1999 2000 2001 2002 2003

Num

ber o

f gi

gabi

t per

sec

ond

cust

omer

con

nect

ions

Number of Gbit/s customer connectionsNumber of Gbit/s customer connectionsNumber of Gbit/s customer connections


SURFnet’s traffic growthSURFnet’s traffic growthSURFnet’s traffic growth

Growth factor = 2,4

10

100

1000

10000

1999 2000 2001 2002 2003

Tera

byte

s pe

r qua

rter

Traffic on SURFnetTrend line traffic on SURFnet


SURFnet’s external connectivitySURFnet’s external connectivitySURFnet’s external connectivity

ChicagoStarLightChicagoStarLight

AmsterdamInternet

Exchange

AmsterdamInternet

Exchange

ISPs

Level 3 Global Crossing

10 Gbit/s2.5 Gbit/s

1 Gbit/s 1 Gbit/s

1 Gbit/s 1 Gbit/s

1 Gbit/s

1 Gbit/s

0.6 Gbit/s

1 Gbit/s

1 Gbit/s

Private peerings

1 Gbit/s

10 Gbit/s

European ResearchNetworks

Other ResearchNetworks

Rest of the world

SURFnet5

ISPs


GigaPort results (1999 - 2003)GigaPort GigaPort resultsresults (1999 (1999 -- 2003)2003)

• SURFnet5

• Fiber to the dormitories

• GigaMAN

• Access pilots

• NetherLight

• Playground

10 Gbit/s lambda based network up and running since mid 2001

20,000 students via 10/100 Mbit/s switchedEthernet

development of market for managed dark fiber

mobility and middleware

international testbed for lambda networking

for new applications


Market: Unequal spread of infraMarket: Unequal spread of infraMarket: Unequal spread of infra

Pictures: Yuri Demchenko






• Conclusions


NetherLightNetherLightNetherLight

• Optical Internet exchange point in Amsterdam • Built and operated by SURFnet • Experiments with light path provisioning in a

multi domain environment• Other optical exchanges, e.g.:

– StarLight in Chicago, IL, USA– NorthernLight in Stockholm, SE– CzechLight, Praha, CZ


International light path network 2Q2004International light path network 2Q2004International light path network 2Q2004

DWDM SURFnet

lambda service path

IP service path

10 Gbit/s

SURFnet10 Gbit/s

SURFnet10 Gbit/s

IEEAF10 Gbit/s

DwingelooASTRON/JIVE

DwingelooASTRON/JIVE

PragueCzechLight

PragueCzechLight

2.5 Gbit/s

NSF10 Gbit/s

LondonUKLightLondonUKLight

StockholmNorthernLightStockholm

NorthernLight

2.5 Gbit/s

New YorkMANLANNew YorkMANLAN

TokyoWIDETokyoWIDE

10 Gbit/s

10Gbit/s

10 Gbit/s

2x10 Gbit/s

IEEAF10 Gbit/s

2x10 Gbit/s

10 Gbit/s

2.5 Gbit/s

2.5 Gbit/s

TokyoAPANTokyoAPAN

GenevaCERN

GenevaCERN

ChicagoChicago AmsterdamAmsterdam


How it worksHow it worksHow it works

• SONET/SDH muxes:– WAN-side: SONET/SDH framed lambdas– LAN-side: Ethernet ports

StarLightNetherLight

10G lambda GbE

GbE

GbE

GbE

GbE

10G lambda

XXLight

STS-24c provisioning

AAA


TransLightTransLightTransLight

European lambdas to US–8 GigEs Amsterdam—Chicago–8 GigEs London—Chicago

Canadian lambdas to US–8 GigEs Chicago-Canada-NYC–8 GigEs Chicago-Canada-Seattle

US lambdas to Europe–4 GigEs Chicago—Amsterdam–3 GigEs Chicago—CERN

European lambdas–8 GigEs Amsterdam—CERN –2 GigEs Prague—Amsterdam–2 GigEs Stockholm—Amsterdam–8 GigEs London—Amsterdam

TransPAC lambda (yellow)–4 GigE Chicago—Tokyo

IEEAF lambdas (blue)–8 GigEs NYC—Amsterdam–8 GigEs Seattle—Tokyo

TransLightLambdas


Lambda Workshop Reykjavik, August 2003Lambda Workshop Reykjavik, August 2003Lambda Workshop Reykjavik, August 2003

• Lambda planning and coordination activity attended by 33 participants from Europe, Asia and North America

• Where it was agreed to continue under the name:

GLIF: Global Lambda Integrated Facility• GLIF will be managed as a cooperative activity• GLIF.IS was recently launched as home for all

interested in the GLIF activities


Day-to-day lightpath useDayDay--toto--day lightpath useday lightpath use

• Part of lambda capacity for lightpath research community

– Changes on weekly/monthly basis, upon request– Has a experimental status

• Part of lambda capacity statically configured for IP production traffic

– Router-to-router SONET circuits between Amsterdam and Chicago for SURFnet and others (e.g. NSF link)

– Link & interface state monitored by SURFnet NOC


VLBI at JIVE in Dwingeloo, NL todayVLBI at JIVE in Dwingeloo, NL todayVLBI at JIVE in Dwingeloo, NL today


eeEVNEVN: European VLBI Network: European VLBI Network

11--3030GbpsGbps

Data processing centre: 16 Gbps (2005)1 Tbps (2010)

China

USA

South Africa

Russia

asymmetric star topology

This slide courtesy of Richard Schilizzi <[email protected]>


Know the userKnow the userKnow the user

BW requirements

# of users

C

A

B

ADSL GigE LAN

A -> Lightweight users, browsing, mailing, home use

B -> Business applications, multicast, streaming, VPNs, mostly LAN

C -> Special scientific applications, computing, data grids, virtual-presence

A -> Need full Internet routing, one to many

B -> Need VPN services on/and full Internet routing, several to several

C -> Need very fat pipes, limited multiple Virtual Organizations, few to few

This slide courtesy of Cees de Laat, UvA


Paradigm shiftParadigm shiftParadigm shift

SURFnet4 project GigaPort

DWDM

Lambdas

POS

GigaPortNext Generation

SURFnet4 network

SURFnet5 network

ATM

SURFnet6 network

1995 1999 2003 2007

Next generation is not a simple extrapolation of current networks






• Conclusions


SURFnet6 overviewSURFnet6 overviewSURFnet6 overview

• Realization of a next generation hybrid network with seamless end-to-end communication:

– Based on dark fiber– Native IPv4, IPv6 and Lambda Services over a single

transmission infrastructure managed via a single control plane

– Multi-domain networking– Ethernet services as part of the WANs– Intelligence of networks and the associated responsibilities

at the edges, but always honoring “KIS”

• Paving the way to a ubiquitous and scalable Services Grid


SURFnet6 will be based on dark fiberSURFnet6 will be based on dark fiberSURFnet6 will be based on dark fiber

• Over 3500 km fiber pairs available today; average price paid for 15 year IRUs: 7 EUR/meter per pair

• Managed dark fiber infrastructure will be extended with new routes, approx. 500 – 1000 km more to be ready for SURFnet6


The search for an Industry PartnerThe search for an Industry PartnerThe search for an Industry Partner

• Participates in realization GigaPort NG Network • Supplies, implements, maintains and supports

transmission, switching and routing equipment • Provides a major own contribution to the project

• Selection via European procurement procedure – Qualification phase: eight candidates– Four consortia submitted a valid proposal– Negotiations started end of November 2003– Contracting done, signing happened March 23rd, 2004


SURFnet’s new Industry Partner (2004-2010)SURFnet’s new Industry Partner (2004SURFnet’s new Industry Partner (2004--2010)2010)

• Leader of the consortium• Optical equipment• Ethernet equipment• Network management equipment

• Routing equipment

• Installation services• Maintenance services


Timelines SURFnet6Timelines SURFnet6Timelines SURFnet6


SURFnet6 Architecture HighlightsSURFnet6 Architecture HighlightsSURFnet6 Architecture Highlights

• Hybrid Optical & Packet Networking• Small core IP routed network• Extensive 1G & 10G Ethernet infrastructure• Advanced plug and play photonic networking• SURFnet and Nortel will conduct joint Research on

Networks projects


Provisioning of IP ServicesProvisioningProvisioning of IP Servicesof IP Services

ExternalIP connectivity SURFnet6

Core Routers

SURFnet6Border Routers

SURFnet6Layer 2 / Layer 1 network

Customer Router

Layer 3 functionalityNon-SURFnet


Light Path ProvisioningLightLight PathPath ProvisioningProvisioning

SURFnet6Layer 2 / Layer 1 network

Light Path Provisioningvia Control Plane

Layer 3 flowdata collectionand analysis

OperationsManagement

OGSAApplications

WebserviceBroker

SURFnet6Routers

Light Path


Research on Networks topicsResearch on Networks topicsResearch on Networks topics

• Optical networking• High performance routing and switching• Management and monitoring• Grids and access: reaching out to the user• Testing methodology






• Conclusions


ConclusionsConclusionsConclusions

• NREN users need new services that current networks cannot support

• Data communication infrastructures will become part of the Grid and will be integrated in scientific instruments

• Hybrid networks delivering IP and Lambda Services can meet user demand within budget constraints, using IP-GE-lambda + overprovisioning + KIS

• SURFnet6 will be a showcase for hybrid networks


What did we learn so farWhatWhat diddid we we learn so farlearn so far

• Point to point lambdas are a powerful service• Current Optical-Electrical-Optical equipment can

allocate sub-lambdas to individual applications• Management is still cumbersome

Hybrid network architecture seems to be the onlyvaluable NREN option for the future:

– Packet switched internet for regular many-to-many usage– Light Paths for new high speed/volume few-to-few usage


New ways for the network to fail…New ways for the network to fail…New ways for the network to fail…


Thank you. Questions?Thank you. Questions?

More information:http://www.surfnet.nl/http://www.gigaport.nl/

http://www.netherlight.net/http://www.glif.is/

Author’s e-mail address:[email protected]


Back-up slidesBackBack--up slidesup slides


Dual use of SURFnet’s infrastructureDual use of SURFnet’s infrastructureDual use of SURFnet’s infrastructure

Production transport services Experimental

or breakable L3 gear

ProductionL3 gear

Productionfiber

(2nd pair)

Production fiber(1st pair)

Experimentalor breakable

L1-3 gear

Production (point-to-point) Light Path Provisioning1 GbE, 10 GbE & 2.5 and 10 G SONET/SDH framed; upgrades to 40 and 100 G

Production IP services10 GbE, 1GbE ports

Experimentalor breakable

L2-3 gearProductionL2-3 gear

Ethernet service1 GbE, 10 GbE ports

Infr

astr

uctu

re

Experimentalor breakablemiddleware

Productionmiddleware

Infrastructure use

Operated by SURFnet, customer or researcherSURFnet operatedProduction useResearch use


OM

E-S

SURFnet6 Network ArchitectureSURFnet6 Network ArchitectureSURFnet6 Network Architecture

OM

E-S

OME6500

OM

E-S

OM

E-S

OM

E-S

OM

E-S

PhotonicSwitch

OM5000

ControlPlane

NM

Broker

OME6500

RouterB

PP8600

RouterA

OME6500

OME6500

Photonic Layer

External Lightpath Connectivity

External IP Connectivity

Built-inLayer-2Switch


SURFnet6 ProductsSURFnet6 ProductsSURFnet6 Products

• Next generation photonic transport• Photonic switches• OM 5000 for 10G dynamic wavelength allocation• OME 6500 for 1GE dynamic wavelength allocation

and Ethernet switching (RPR)• Passport 8600 for Ethernet switching and

aggregation• Avici SSR for core IP routing • OME-S for 1GE termination• Broker for cloud bypass


Functional LayersFunctional LayersFunctional Layers

RouterA RouterB

Built-inLayer-2Switch

+OME6500

OME6500

OME6500

OME6500

Photonic LayerPP

8600

PP8600

Photonic Layer

RouterA RouterB

1GELAN

OM5000

OM5000

OM5000

OM5000

+OM

5000OM

5000

PhotonicSwitch

OM5K

OM5K

Photonic Layer


External IP Connectivity

Lightpath Switching @ 1GE&

Ethernet Switching for IP Services at small sites @ 1GE

Major Sites:Ethernet Switching for

IP Services @ 1G & 10G

Lightpath Switching @ 10GE


Lightpath Switching & Cloud BypassLightpath Switching & Cloud BypassLightpath Switching & Cloud Bypass

OME6500

OME6500

OME6500

OME6500

Control Plane

PhotonicSwitch

OM5K

OM5K

ASTN MeshFor GE Lightpath

OM5K

Broker

Photonic Transport Layer


Photonic Switchfor 10GE Lightpath


Layer-2 for Cloud BypassLayerLayer--2 for Cloud Bypass2 for Cloud Bypass

Routed IP NetworkRouted IP NetworkControlPlane

Broker

GE

Customer A

VLAN YCloud Bypass

VLAN XRouted IP

Layer-1 OME Managed Bandwidth

Layer-1 OME Managed Bandwidth

VLAN XRouted IP

CustomerAnetwork

CustomerAnetwork

Customer B

CustomerBnetwork

CustomerBnetwork

High-cap userHigh-cap user

GE

UNI

PP8600

PP8600

Flows differentiatedOn IP Subnet or port


European hub in GLORIAD: NetherLightEuropean hub in GLORIAD: NetherLightEuropean hub in GLORIAD: NetherLight

• GLObal RIng network for ADvanced applications development• A series of “Starlight” type facilities providing services for

lambda-switching, Ethernet-switching, IPv6 routing, IPv4 routing • Also, a testbed for advanced network research• See www.gloriad.org for more information

Hong Kong

Beijing

AmsterdamSeattle Chicago Moscow

Date post:	12-Jun-2020
Category:	Documents
Upload:	others
View:	1 times
Download:	0 times

Erik-Jan Bos Director of Network Services SURFnet, The ...proj.sunet.se/TP10/Slides/SURFnet.pdf ·...

Documents