Post on 12-Jun-2020
transcript
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet6Integrating the IP and Optical worlds
SURFnet6SURFnet6Integrating the IP and Optical worlds Integrating the IP and Optical worlds
Erik-Jan BosDirector of Network Services SURFnet, The Netherlands
TrefPunkt Kiruna, 30-31 mars 2004
SUNET, Kiruna, SE, March 30th-31st, 2004
Presentation contentsPresentation contentsPresentation contents
• SURFnet and GigaPort: The environment
• NetherLight: The testbed
• SURFnet6: Where IP and Optical meet in the production network
• Conclusions
SUNET, Kiruna, SE, March 30th-31st, 2004
Presentation contentsPresentation contentsPresentation contents
• SURFnet and GigaPort: The environment
• NetherLight: The testbed
• SURFnet6: Where IP and Optical meet in the production network
• Conclusions
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet, the organization (1)SURFnet, the organization (1)SURFnet, the organization (1)
• Provides the Dutch National Research Network• Not for profit company, 50 employees• 150 connected organizations; 182 physical
connections; 800,000 users• Turnover (2002): 30 million Euro• Infrastructure services:
– innovation paid for by government– cost effective exploitation for higher education and
research
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet, the organization (2)SURFnet, the organization (2)SURFnet, the organization (2)
• Three “product” departments:– Advanced Services– Middleware Services– Network Services
• Two “outlet” departments:– Account Advising– Community Support
• All operations subcontracted
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet network generationsSURFnet network generationsSURFnet network generations
• SURFnet1: DECnet Phase 4 over public X.25• SURFnet2: DECnet and IP over private X.25• SURFnet3: IP and X.25 over leased lines• SURFnet4: IP over ATM over SDH -> IP over SDH• SURFnet5: IP over unprotected lambda
• Moving towards simpler architectures (KIS)…
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet, connecting the customersSURFnet, connecting the customersSURFnet, connecting the customers
SURFnet4155 Mbit/s
SURFnet19,6 kbit/s
SURFnet264 kbit/s
SURFnet32 Mbit/s
SURFnet434 Mbit/s
SURFnet520 Gbit/s
100 Gbit/s
1 Gbit/s
10 Mbit/s
100 kbit/s
10 kbit/s
1 Mbit/s
100 Mbit/s
10 Gbit/s
1987 1989 1992 1995 1997 2002
Acc
ess
capa
city
SUNET, Kiruna, SE, March 30th-31st, 2004
GigaPortGigaPortGigaPort
• Research networking is innovation engine between research and market introduction of new services
– GigaPort (1999-2003): • Applications and Network [SURFnet5]• government grant: 70 million Euro • contribution of industry : ≥ 90 million Euro
– GigaPort Next Generation Network [SURFnet6] (2004-2008): • consortium of 50 organizations• government grant: 40 million Euro • contribution of industry and institutions: ≥ 56 million Euro
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet5SURFnet5SURFnet5
• Partners BT and Cisco
• 15 concentrator PoPs connected by thirty 10 Gbit/s unprotected lambdas
• Managed dark fiber to Remote PoPs
• Dual stack IPv4 and IPv6 since mid 2001
• 122 customer connections at Gbit/s level: 67% @GE
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet5 topologySURFnet5 topologySURFnet5 topology
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet5 IPv6SURFnet5 IPv6SURFnet5 IPv6
• Problem:– SURFnet5 was built using E2 and E4 LCs
• Solution:– At the edges: Replaced almost all E2 cards by E3 cards– In the backbone: 6PE (IPv6 over MPLS)
• Result:– SURFnet5 is close to wire speed IPv6 at 10 Gbit/s
• Next challenge: IPv6 multicast
SUNET, Kiruna, SE, March 30th-31st, 2004
0
20
40
60
80
100
120
140
1999 2000 2001 2002 2003
Num
ber o
f gi
gabi
t per
sec
ond
cust
omer
con
nect
ions
Number of Gbit/s customer connectionsNumber of Gbit/s customer connectionsNumber of Gbit/s customer connections
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet’s traffic growthSURFnet’s traffic growthSURFnet’s traffic growth
Growth factor = 2,4
10
100
1000
10000
1999 2000 2001 2002 2003
Tera
byte
s pe
r qua
rter
Traffic on SURFnetTrend line traffic on SURFnet
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet’s external connectivitySURFnet’s external connectivitySURFnet’s external connectivity
ChicagoStarLightChicagoStarLight
AmsterdamInternet
Exchange
AmsterdamInternet
Exchange
ISPs
Level 3 Global Crossing
10 Gbit/s2.5 Gbit/s
1 Gbit/s 1 Gbit/s
1 Gbit/s 1 Gbit/s
1 Gbit/s
1 Gbit/s
0.6 Gbit/s
1 Gbit/s
1 Gbit/s
Private peerings
1 Gbit/s
10 Gbit/s
European ResearchNetworks
Other ResearchNetworks
Rest of the world
SURFnet5
ISPs
SUNET, Kiruna, SE, March 30th-31st, 2004
GigaPort results (1999 - 2003)GigaPort GigaPort resultsresults (1999 (1999 -- 2003)2003)
• SURFnet5
• Fiber to the dormitories
• GigaMAN
• Access pilots
• NetherLight
• Playground
10 Gbit/s lambda based network up and running since mid 2001
20,000 students via 10/100 Mbit/s switchedEthernet
development of market for managed dark fiber
mobility and middleware
international testbed for lambda networking
for new applications
SUNET, Kiruna, SE, March 30th-31st, 2004
Market: Unequal spread of infraMarket: Unequal spread of infraMarket: Unequal spread of infra
Pictures: Yuri Demchenko
SUNET, Kiruna, SE, March 30th-31st, 2004
Presentation contentsPresentation contentsPresentation contents
• SURFnet and GigaPort: The environment
• NetherLight: The testbed
• SURFnet6: Where IP and Optical meet in the production network
• Conclusions
SUNET, Kiruna, SE, March 30th-31st, 2004
NetherLightNetherLightNetherLight
• Optical Internet exchange point in Amsterdam • Built and operated by SURFnet • Experiments with light path provisioning in a
multi domain environment• Other optical exchanges, e.g.:
– StarLight in Chicago, IL, USA– NorthernLight in Stockholm, SE– CzechLight, Praha, CZ
SUNET, Kiruna, SE, March 30th-31st, 2004
International light path network 2Q2004International light path network 2Q2004International light path network 2Q2004
DWDM SURFnet
lambda service path
IP service path
10 Gbit/s
SURFnet10 Gbit/s
SURFnet10 Gbit/s
IEEAF10 Gbit/s
DwingelooASTRON/JIVE
DwingelooASTRON/JIVE
PragueCzechLight
PragueCzechLight
2.5 Gbit/s
NSF10 Gbit/s
LondonUKLightLondonUKLight
StockholmNorthernLightStockholm
NorthernLight
2.5 Gbit/s
New YorkMANLANNew YorkMANLAN
TokyoWIDETokyoWIDE
10 Gbit/s
10Gbit/s
10 Gbit/s
2x10 Gbit/s
IEEAF10 Gbit/s
2x10 Gbit/s
10 Gbit/s
2.5 Gbit/s
2.5 Gbit/s
TokyoAPANTokyoAPAN
GenevaCERN
GenevaCERN
ChicagoChicago AmsterdamAmsterdam
SUNET, Kiruna, SE, March 30th-31st, 2004
How it worksHow it worksHow it works
• SONET/SDH muxes:– WAN-side: SONET/SDH framed lambdas– LAN-side: Ethernet ports
StarLightNetherLight
10G lambda GbE
GbE
GbE
GbE
GbE
10G lambda
XXLight
STS-24c provisioning
AAA
SUNET, Kiruna, SE, March 30th-31st, 2004
TransLightTransLightTransLight
European lambdas to US–8 GigEs Amsterdam—Chicago–8 GigEs London—Chicago
Canadian lambdas to US–8 GigEs Chicago-Canada-NYC–8 GigEs Chicago-Canada-Seattle
US lambdas to Europe–4 GigEs Chicago—Amsterdam–3 GigEs Chicago—CERN
European lambdas–8 GigEs Amsterdam—CERN –2 GigEs Prague—Amsterdam–2 GigEs Stockholm—Amsterdam–8 GigEs London—Amsterdam
TransPAC lambda (yellow)–4 GigE Chicago—Tokyo
IEEAF lambdas (blue)–8 GigEs NYC—Amsterdam–8 GigEs Seattle—Tokyo
TransLightLambdas
SUNET, Kiruna, SE, March 30th-31st, 2004
Lambda Workshop Reykjavik, August 2003Lambda Workshop Reykjavik, August 2003Lambda Workshop Reykjavik, August 2003
• Lambda planning and coordination activity attended by 33 participants from Europe, Asia and North America
• Where it was agreed to continue under the name:
GLIF: Global Lambda Integrated Facility• GLIF will be managed as a cooperative activity• GLIF.IS was recently launched as home for all
interested in the GLIF activities
SUNET, Kiruna, SE, March 30th-31st, 2004
Day-to-day lightpath useDayDay--toto--day lightpath useday lightpath use
• Part of lambda capacity for lightpath research community
– Changes on weekly/monthly basis, upon request– Has a experimental status
• Part of lambda capacity statically configured for IP production traffic
– Router-to-router SONET circuits between Amsterdam and Chicago for SURFnet and others (e.g. NSF link)
– Link & interface state monitored by SURFnet NOC
SUNET, Kiruna, SE, March 30th-31st, 2004
VLBI at JIVE in Dwingeloo, NL todayVLBI at JIVE in Dwingeloo, NL todayVLBI at JIVE in Dwingeloo, NL today
SUNET, Kiruna, SE, March 30th-31st, 2004
eeEVNEVN: European VLBI Network: European VLBI Network
11--3030GbpsGbps
Data processing centre: 16 Gbps (2005)1 Tbps (2010)
China
USA
South Africa
Russia
asymmetric star topology
This slide courtesy of Richard Schilizzi <schilizzi@jive.nl>
SUNET, Kiruna, SE, March 30th-31st, 2004
Know the userKnow the userKnow the user
BW requirements
# of users
C
A
B
ADSL GigE LAN
A -> Lightweight users, browsing, mailing, home use
B -> Business applications, multicast, streaming, VPNs, mostly LAN
C -> Special scientific applications, computing, data grids, virtual-presence
A -> Need full Internet routing, one to many
B -> Need VPN services on/and full Internet routing, several to several
C -> Need very fat pipes, limited multiple Virtual Organizations, few to few
This slide courtesy of Cees de Laat, UvA
SUNET, Kiruna, SE, March 30th-31st, 2004
Paradigm shiftParadigm shiftParadigm shift
SURFnet4 project GigaPort
DWDM
Lambdas
POS
GigaPortNext Generation
SURFnet4 network
SURFnet5 network
ATM
SURFnet6 network
1995 1999 2003 2007
Next generation is not a simple extrapolation of current networks
SUNET, Kiruna, SE, March 30th-31st, 2004
Presentation contentsPresentation contentsPresentation contents
• SURFnet and GigaPort: The environment
• NetherLight: The testbed
• SURFnet6: Where IP and Optical meet in the production network
• Conclusions
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet6 overviewSURFnet6 overviewSURFnet6 overview
• Realization of a next generation hybrid network with seamless end-to-end communication:
– Based on dark fiber– Native IPv4, IPv6 and Lambda Services over a single
transmission infrastructure managed via a single control plane
– Multi-domain networking– Ethernet services as part of the WANs– Intelligence of networks and the associated responsibilities
at the edges, but always honoring “KIS”
• Paving the way to a ubiquitous and scalable Services Grid
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet6 will be based on dark fiberSURFnet6 will be based on dark fiberSURFnet6 will be based on dark fiber
• Over 3500 km fiber pairs available today; average price paid for 15 year IRUs: 7 EUR/meter per pair
• Managed dark fiber infrastructure will be extended with new routes, approx. 500 – 1000 km more to be ready for SURFnet6
SUNET, Kiruna, SE, March 30th-31st, 2004
The search for an Industry PartnerThe search for an Industry PartnerThe search for an Industry Partner
• Participates in realization GigaPort NG Network • Supplies, implements, maintains and supports
transmission, switching and routing equipment • Provides a major own contribution to the project
• Selection via European procurement procedure – Qualification phase: eight candidates– Four consortia submitted a valid proposal– Negotiations started end of November 2003– Contracting done, signing happened March 23rd, 2004
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet’s new Industry Partner (2004-2010)SURFnet’s new Industry Partner (2004SURFnet’s new Industry Partner (2004--2010)2010)
• Leader of the consortium• Optical equipment• Ethernet equipment• Network management equipment
• Routing equipment
• Installation services• Maintenance services
SUNET, Kiruna, SE, March 30th-31st, 2004
Timelines SURFnet6Timelines SURFnet6Timelines SURFnet6
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet6 Architecture HighlightsSURFnet6 Architecture HighlightsSURFnet6 Architecture Highlights
• Hybrid Optical & Packet Networking• Small core IP routed network• Extensive 1G & 10G Ethernet infrastructure• Advanced plug and play photonic networking• SURFnet and Nortel will conduct joint Research on
Networks projects
SUNET, Kiruna, SE, March 30th-31st, 2004
Provisioning of IP ServicesProvisioningProvisioning of IP Servicesof IP Services
ExternalIP connectivity SURFnet6
Core Routers
SURFnet6Border Routers
SURFnet6Layer 2 / Layer 1 network
Customer Router
Layer 3 functionalityNon-SURFnet
SUNET, Kiruna, SE, March 30th-31st, 2004
Light Path ProvisioningLightLight PathPath ProvisioningProvisioning
SURFnet6Layer 2 / Layer 1 network
Light Path Provisioningvia Control Plane
Layer 3 flowdata collectionand analysis
OperationsManagement
OGSAApplications
WebserviceBroker
SURFnet6Routers
Light Path
SUNET, Kiruna, SE, March 30th-31st, 2004
Research on Networks topicsResearch on Networks topicsResearch on Networks topics
• Optical networking• High performance routing and switching• Management and monitoring• Grids and access: reaching out to the user• Testing methodology
SUNET, Kiruna, SE, March 30th-31st, 2004
Presentation contentsPresentation contentsPresentation contents
• SURFnet and GigaPort: The environment
• NetherLight: The testbed
• SURFnet6: Where IP and Optical meet in the production network
• Conclusions
SUNET, Kiruna, SE, March 30th-31st, 2004
ConclusionsConclusionsConclusions
• NREN users need new services that current networks cannot support
• Data communication infrastructures will become part of the Grid and will be integrated in scientific instruments
• Hybrid networks delivering IP and Lambda Services can meet user demand within budget constraints, using IP-GE-lambda + overprovisioning + KIS
• SURFnet6 will be a showcase for hybrid networks
SUNET, Kiruna, SE, March 30th-31st, 2004
What did we learn so farWhatWhat diddid we we learn so farlearn so far
• Point to point lambdas are a powerful service• Current Optical-Electrical-Optical equipment can
allocate sub-lambdas to individual applications• Management is still cumbersome
Hybrid network architecture seems to be the onlyvaluable NREN option for the future:
– Packet switched internet for regular many-to-many usage– Light Paths for new high speed/volume few-to-few usage
SUNET, Kiruna, SE, March 30th-31st, 2004
New ways for the network to fail…New ways for the network to fail…New ways for the network to fail…
SUNET, Kiruna, SE, March 30th-31st, 2004
Thank you. Questions?Thank you. Questions?
More information:http://www.surfnet.nl/http://www.gigaport.nl/
http://www.netherlight.net/http://www.glif.is/
Author’s e-mail address:bos@surfnet.nl
SUNET, Kiruna, SE, March 30th-31st, 2004
Back-up slidesBackBack--up slidesup slides
SUNET, Kiruna, SE, March 30th-31st, 2004
Dual use of SURFnet’s infrastructureDual use of SURFnet’s infrastructureDual use of SURFnet’s infrastructure
Production transport services Experimental
or breakable L3 gear
ProductionL3 gear
Productionfiber
(2nd pair)
Production fiber(1st pair)
Experimentalor breakable
L1-3 gear
Production (point-to-point) Light Path Provisioning1 GbE, 10 GbE & 2.5 and 10 G SONET/SDH framed; upgrades to 40 and 100 G
Production IP services10 GbE, 1GbE ports
Experimentalor breakable
L2-3 gearProductionL2-3 gear
Ethernet service1 GbE, 10 GbE ports
Infr
astr
uctu
re
Experimentalor breakablemiddleware
Productionmiddleware
Infrastructure use
Operated by SURFnet, customer or researcherSURFnet operatedProduction useResearch use
SUNET, Kiruna, SE, March 30th-31st, 2004
OM
E-S
SURFnet6 Network ArchitectureSURFnet6 Network ArchitectureSURFnet6 Network Architecture
OM
E-S
OME6500
OM
E-S
OM
E-S
OM
E-S
OM
E-S
PhotonicSwitch
OM5000
ControlPlane
NM
Broker
OME6500
RouterB
PP8600
RouterA
OME6500
OME6500
Photonic Layer
External Lightpath Connectivity
External IP Connectivity
Built-inLayer-2Switch
SUNET, Kiruna, SE, March 30th-31st, 2004
SURFnet6 ProductsSURFnet6 ProductsSURFnet6 Products
• Next generation photonic transport• Photonic switches• OM 5000 for 10G dynamic wavelength allocation• OME 6500 for 1GE dynamic wavelength allocation
and Ethernet switching (RPR)• Passport 8600 for Ethernet switching and
aggregation• Avici SSR for core IP routing • OME-S for 1GE termination• Broker for cloud bypass
SUNET, Kiruna, SE, March 30th-31st, 2004
Functional LayersFunctional LayersFunctional Layers
RouterA RouterB
Built-inLayer-2Switch
+OME6500
OME6500
OME6500
OME6500
Photonic LayerPP
8600
PP8600
Photonic Layer
RouterA RouterB
1GELAN
OM5000
OM5000
OM5000
OM5000
+OM
5000OM
5000
PhotonicSwitch
OM5K
OM5K
Photonic Layer
External Lightpath Connectivity
External IP Connectivity
Lightpath Switching @ 1GE&
Ethernet Switching for IP Services at small sites @ 1GE
Major Sites:Ethernet Switching for
IP Services @ 1G & 10G
Lightpath Switching @ 10GE
SUNET, Kiruna, SE, March 30th-31st, 2004
Lightpath Switching & Cloud BypassLightpath Switching & Cloud BypassLightpath Switching & Cloud Bypass
OME6500
OME6500
OME6500
OME6500
Control Plane
PhotonicSwitch
OM5K
OM5K
ASTN MeshFor GE Lightpath
OM5K
Broker
Photonic Transport Layer
External Lightpath Connectivity
Photonic Switchfor 10GE Lightpath
SUNET, Kiruna, SE, March 30th-31st, 2004
Layer-2 for Cloud BypassLayerLayer--2 for Cloud Bypass2 for Cloud Bypass
Routed IP NetworkRouted IP NetworkControlPlane
Broker
GE
Customer A
VLAN YCloud Bypass
VLAN XRouted IP
Layer-1 OME Managed Bandwidth
Layer-1 OME Managed Bandwidth
VLAN XRouted IP
CustomerAnetwork
CustomerAnetwork
Customer B
CustomerBnetwork
CustomerBnetwork
High-cap userHigh-cap user
GE
UNI
PP8600
PP8600
Flows differentiatedOn IP Subnet or port
SUNET, Kiruna, SE, March 30th-31st, 2004
European hub in GLORIAD: NetherLightEuropean hub in GLORIAD: NetherLightEuropean hub in GLORIAD: NetherLight
• GLObal RIng network for ADvanced applications development• A series of “Starlight” type facilities providing services for
lambda-switching, Ethernet-switching, IPv6 routing, IPv4 routing • Also, a testbed for advanced network research• See www.gloriad.org for more information
Hong Kong
Beijing
AmsterdamSeattle Chicago Moscow