Janet UpdateMartin Dunmore
Multi-Service Networks 2012Cosener’s House, Abingdon, 12th July 2012
Topics•Intro to Janet
•Janet6
• Support for Network Research
Introduction to Janet
Area SitesHigher Education 211Further Education 520Local Authority
123Self-funded
53Research Council 41
948
Use of Janet
LA / Schools
HE/FE
Adult
Relative sizes of sectors: from funding body statistics on staff & student numbers
18 million possible users of JANET.
ConnectionsUsers
Network Figures
Routing equipment: ~100 routers in the core of JANET ~300 regional area routers ~520 end organisation routers
Circuits/fibres: ~1,500 circuits make up JANET
non-trivial task to monitor~80% of total outage time
The SuperJanet5 Network
•Six core points of presence.•A core across the UK of 20Gbit/s, 80Gbit/s and 100Gbit/s.
•19 regional distribution areas.
•Multiple connections for resilience.
•~900 organisations connected.
•Point to point “light path” connections for research.
•~400Gbit/s external connectivity.
Global Transit#2
Global Transit#1
Glasgow
Leeds
London
Bristol
Warrington
Reading
Telecity HX
Telehouse
10G40G
100G
The Network
Telecity Manchester
Global Transit#3
Major Peerings
Regularly Hitting > 100Gb/s of Traffic
From Janet To JanetMean 18.5 Gb/s 58.6 Gb/sMax 29.7 Gb/s 115 Gb/sMin 5.72 Gb/s 9.57 Gb/s
Typical week in May…
Total Janet Traffic PredictionJa
n'10
Mar
'10
May
'10
Jul'1
0
Sep'
10
Nov'
10
Jan'
11
Mar
'11
May
'11
Jul'1
1
Sep'
11
Nov'
11
Jan'
12
Mar
'12
May
'12
Jul'1
2
Sep'
12
Nov'
12
Jan'
13
Mar
'13
May
'13
Jul'1
3
Sep'
13
Nov'
13
Jan'
14
Mar
'14
May
'14
Jul'1
4
Sep'
14
Nov'
14
Jan'
15
Mar
'15
May
'15
Jul'1
5
Sep'
15
Nov'
15
0
100
200
300
400
500
600
All External TrafficActuals Projected If Traffic doubles every 2 Years (from Jan'2010)
Gbps
SuperJanet5 Janet6
Janet6
• Similar topology to SJ5.• Two north-south paths• New east-west path from
Birmingham to Nottingham– Erdington to Lowdham
• No backbone PoP at Reading– Still have a regional PoP
• New PoP in Acton, West London
Janet6: Backbone Resilience
• Contractual– Favourable: Mandated 40Gbit/s in 2006 contract– Favourable: Worked with Verizon for deployment of
100GE– Less Favourable: Maximum bandwidth available for use
on each link• Increasing those needed technical and legal negotiations
• Engineering– Legacy of layered optical systems
• Provide 40G SDH and 100GE over system not designed for it
• Large “guard bands” of wasted bandwidth
Limits of SuperJANET5
• Manage the optical layer directly• For more detail see Networkshop presentation
– ROADM• Flexible optical platform
– DWDM– Theoretically 80 channels
– 100Gbit/s per lambda from day 1– Plans for 400Gbit/s and 1Tbit/s with better spectral
density• “Data DelugeBonanza”
– Big Science• LHC, SKA, Bioinformatics, ITER, Radio Astronomy, Climate
Data– Day-to-day usage
Removing SJ5’s limits
• Original 2006 T-640 chassis still in service– 40Gbit/s per slot, 32 10Gbit/s ports per chassis
• Most upgraded to T-1600– Same chassis, new switching fabric and PSUs– 100Gbit/s per slot
• T-4000– Same chassis, new switching fabric and PSUs– 240Gbit/s per slot, 192 10Gbit/s ports per chassis– Two power supplied for resilience
• Each one takes 6, 60A, 48VDC feeds – 17kVA!• Migration
– Janet6 will be in new PoPs– Can’t move all the connections overnight– New routers and hand back the old
Janet6 IP Platform
• Investigated provisioning over optical platform– Not enough competitive offers for smaller chassis
• Investigated merging Lightpath and IP platforms– IP platforms are already short on chassis space, some
locations would require additional chassis• Keep on current MX960 platforms
– Upgrade interconnects to 100GE– Move 10GE lightpaths from lambdas to EoMPLS circuits
• Scope for point to point circuits without committed bandwidth– Shared with Janet IP access
Janet6 Lightpath Network
Janet6 Procurement Strategy• Options appraisal
• Procure dark fibre infrastructure
• Procure optical transmission equipment
• Management in-house by the Janet NOC
• Why? Agility• Janet NOC will have a view from the fibre up the stack to the
routers• Fewer contract/administrative boundaries or chains to cross• Directly translate the community’s requirements into engineering
• Why? Different contractual vehicles for fibre and equipment• Fibre: long-term, little need to change
• Optical equipment: rapidly evolving, highly competitive
competitive dialogue procedure
Janet6 Procurement Timeline
Progress to date• Procurement kicked off October 2011• Dialogue with 6 bidders during first half of
2012• Bids received from 2 suppliers
Procurement Update – Fibre
Current Status• SSET selected as preferred supplier• Design optimisation• Finalising contract & schedules• Signature by end July 2012
Procurement Update – Fibre
Progress to date• Procurement kicked off November 2011• Dialogue with 6 bidders during first half of
2012
Procurement Update – Equipment
Current Status• Bids received from all 6 suppliers• Evaluation underway• Selection by end July 2012• Signature by mid September 2012
Procurement Update – Equipment
• Fibre delivery by end March 2013• Equipment delivery by end April 2013• Commissioning• Migration by end July 2013
Rollout & Transition
Support for Network Research
Stuff we can help with•Router configs•Network diagrams•Access to Netsight (SNMP data)
– Be careful what you wish for!•Netflow data
– SBR exporters (1:10 to 1:50)– Some BAR exporters– Regional routers as and when we can
• TVN, Eastern– Subject to agreement data is non-anonymised– We don’t have much disk space to store it – 100GB!
UK Testbed for Loc / ID Research•Loc / ID – Decoupling Location and Identity from the IP address
– LISP, HIP, ILNP, SHIM6, others•Stimulate synergy between UK researchers in this area•Janet wants to get a handle on the operational pros/cons•Call for proposals should go out later this year
– Has been ready for a while but we need to resource internally•Modest funding: max 30k•12 months but testbed would stay up after that
SDN / OpenFlow Testbed?•Start off small scale
– 3x OF switches in Core PoPs– 10G inter-switch– 1G switch to user
• ‘Usual Suspects’– 1 or 2 controllers
•Scale up organically•Who manages the
– HW ?– Service ?
THANK YOU