Technical Update - Ken Hodge
The cabling system
Build & function• Metro• Backbone• General office• Data Centre• Industrial Premises• Residential…..
IT Applications• Voice• Data• Broadcast technologies• Ethernet & IP technologies• QoS & demand priority….
Planned life of the installation• 3 year• 5 year• 10 year• 10+ year……
Protocols• Gigabit Ethernet• PoE & PoE+• 10GbE• 40GbE &100GbE• 1, 2, 4G & 10G FC• Infiniband• FCoE• Data Centre Ethernet
Cabling Decisions
Technology Advances
Intel:• ‘the HPC of today is the PC of tomorrow’• ‘the #1 High Performance Computer (HPC)
performs at 1PetaFlop• 1 PetaFlop = 1015 FLoating Point Operations Per Second
• ‘an ExaFlop (1018) will be required by 2020’
IBM roadrunner
Transmission Technology Developments:• TeraBit transceivers
• 25 x 40Gbps externally modulated lasers• 40GBps transceivers
• 40Gbps serial laser technology (1300nm)• 2x20G VCSELS (840 & 860nm) with CWDM
• Higher bandwidth MMF 4700MHz.km• Low bend loss SMF
Source: Vertically Integrated Systems
802.3az Energy Efficient Ethernet (EEE) expected to be approved in Sept 2010
802.3ba High Speed Ethernet (HSE) 40GbE & 100GbE expected to be approved in June 2010
802.3av 10G EPON approved in Sept 2009
802.3at PoE-plus approved in Sept 2009
802.3aq 10GbE LRM 802.3an 10GBASE-T 802.3ae 10GbE
New Applications in DevelopmentIEEE
CFITF
ReviewWG
Ballot
SponsorBallot Standard
StudyGroup
J F M A M J J A S O N D2007
J F M A M J J A S O N D2008
Task Forcesanctioned
J F M A M J J A S O N D2009
J A S O N D2006
J F M A M 2010
1. support full-duplex operation only2. preserve 802.3 Ethernet frame format3. preserve 802.3 min/max frame sizes
4. support a BER of > 10-12 at MAC/PHY interface5. support a MAC data rate of 40G + PHY specs:
for at least 10km on SMF for at least 100m on OM3* for at least 7m on copper cabling for at least 1m over a backplane
6. support a MAC data rate of 100G + PHY specs: for at least 40km on SMF for at least 10km on SMF for at least 100m on OM3* for at least 7m on copper cabling
7. provide appropriate support for OTN
IEEE 802.3ba HSE Project Objectives
* and 125m on OM4 cabling
• Basics– Multi-lane transmission– MPO connector (IEC 61754-7)– Cable Skew 80ns (50/125 ≈ 16.2m)
• 40G–40GBASE-SR4
• 4x10G transmission• 8f OM3 cable
• 100G–100GBASE-SR10
• 10x10G• 20f OM3 cable
QSFP
Tx Rx
Tx
Rx
MPO
IEEE 802.3ba 100m MMF
Original
1260 – 1360
Extended
1360 - 1460
Water Peak Band
Short
1460 -1530
Conv
1530 –
1565
Long
1565 –
1625
UL
1625 -
1675
ITU-T definition of optical wavelength bands
Dis
pe
rsio
n (㎰
/㎚-㎞
)
Att
en
ua
tion
(d
B/㎞
)
SSMF IEC 60793-2-50 type B1.1
ITU-T G.652B
ESMF (enhanced)IEC 60793-2-50 type B1.3
ITU-T G.652D
1264 –
1277
1284 –
1297
1304 –
1317
1324 –
1337
CWDM1264-1337nm
40GBASE-LR4
DWDM1294-1310nm
100GBASE-L & E
IEEE 802.3ba SMF
Source: IEEE 802.3ba barbieri_01_0908 (Cisco)IEEE 802.3ba HSE roadmap - CISCO
Market forecast – Data Centre servers
Port speed in serverssource Intel HSSG 2007
0
2
4
6
8
10
12
14
16
18
20
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
Ser
ver
po
rts
(mil
lio
ns/
year
)
100G
40G
10G
1G
100M
10G server speeds grow strongly from 2009
Market forecast – LAN switches
Port speed in switches
0
50
100
150
200
250
300
350
400
450
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
Ser
ver
po
rts
(mil
lio
ns/
year
)
100G
40G
10G
1G
100M
10M
Sources: Del Oro 2006 & Cisco 2008
10G switches grow share from 2009
40Gbps on Structured cabling?
A further development?
“the imperative of self accelerating growth is limited by the environment”, Morgan-Mercer-Flodin
‘BASE-T’ technology:• 10Mbps 12.5MHz • 100Mbps 31.25MHz• 1G 80MHz
• 10G 416MHz
Ethernet over TP
Frequency (MHz)
Dat
a R
ate
(Mbp
s)
0 200 400 600 800 1000 1200 1400 1600 1800 2000
40Gbps = 2000MHz
• 40G ≈ 2 GHz
U-mediaPlus
Cable Standards U-mediaPlus cables
Class F, 600MHzEN50288-4IEC 61156-5
Class FA, 1GHzDraft EN50288-9, EN50441-3Draft IEC 61156-5 edition 3
UM10, 600/100023 AWG S/FTPS/FTP P27
UM12, 1/1.2 GHz22 AWG S/FTPS/FTP P27
Cable only 1.2GHzIEC 61556-7 (-8 draft)Draft EN50288-12
Cable only 2GHzNWIP in IEC & CENELEC
UM15, 1.2/1.5 GHz22 AWG S/FTPS/FTP P##
UM20, 2 GHz22 AWG S/FTPS/FTP P##
Rectangular connectors IEC 61076
System characteristics• Shannon
– S/N @ 2GHz > 18dB – IL/NEXT– IL/RL– PSD/Background noise
NB: There is no current work in IEEE on twisted pair cabling for 40G
S/N - link with 'square' connector
-100
-90
-80
-70
-60
-50
-40
-30
-20
-10
0
0 500 1000 1500 2000
Frequency (MHz)
dB
50m
100m
Class FA NEXT
IEC 61076-3-105 connector
40GBASE-T = 2GHz Cu cabling?
40Gbps capable cabling
Cat7ACat7Cat6A
Cat6
100 250 600 1000 2000
MHz
1Gbps
10Gbps
40Gbps
Cat5e
500
40GBASE-T = 2GHz Cu cabling?
ISO/IEC
CENELECANSI/TIA/EIA
ECBS
IEEE
Standardisation & Regulation
Design Specification InstallationOperation & Maintenance
EN 50346 & A.1: 2007Testing installed cabling
EN 50310: 2006Application of equi-potential
bonding & earthing
EN 50174-3: 2003Installation planning &
practises outside buildings
EN 50174-2: 2008Installation planning & practises in buildings
EN 50174-1: 2008Specification & Quality
Assurance
EN 50173-5: 2006Data Centres
EN 50173-1: 2007Generic Cabling
EN 50173 Generic IT Cabling:
• EN 50173-1: General Requirements• EN 50173-2: Office Premises• EN 50173-3: Industrial Premises• EN 50173-4: Homes• EN 50173-5: Data Centres
Open projects:
• EN 50173-1 Amm1 – EA & FA channel
• EN 50173-1 Amm2 – EA & FA, OM4, OS1a&b, 40 & 100G
• EN 50173-2 Amm1• EN 50173-3 Amm1• EN 50173-4 Amm1 • EN 50173-5 Amm1
• OM3 & ClassEA recommended• EN 50288-10 & 13: 500MHz Cables• IEC 60603-7-41 & 51: 500MHz
Connectors
Cabling Standardisation
The Class EA standard set is not completed
Brand-Rex has been offering Z50 (OM4) cabled optical fibre for over 4 years in indoor and outdoor cables
Advantages of OM4:• Allows 10GBASE-SX more power budget for 300m, or shorter, links• Allows 10GBASE-SX devices to reach up to 550m• Potential for extended 40G/100G links if IEEE approve
Brand-Rex optical cables with the fibre code Z50 contain optical fibre to the highest 50/125 bandwidth specification – this performance level is now being standardised by ISO/IEC and IEC as OM4 cabled optical fibre
Brand-Rex Z50 (OM4) cabled optical fibre
OM4 cabled optical fibre as defined by ISO/IEC 11801 (draft)
10GbE Optical Loss Budgets
Cabling Maximum channel insertion loss (dB) for 10GBASE-
type Freq. (nm)E L LX4 LRM S
Laser Laser Laser Laser VCSEL
OS1 SMF1550 11.0 x x x x
1310 x 6.2 6.2 x x
OM3 MMF1300 x x 2.0 1.9 x
850 x x x x 2.6
OM2 MMF1300 x x 2.0 1.9 x
850 x x x x 1.8
OM1 MMF1300 x x 2.5 1.9 x
850 x x x x 1.6
9/3/2009 Brand-Rex Copyright 2009
New methods to measure optical links
New Methods• ISO/IEC 11801 & AM1: Generic
Cabling• ISO/IEC 14763-3 & AM1
– Testing Optical Fibre cabling• IEC 61280-4-1
– Multi-mode attenuation measurement
9/3/2009 Brand-Rex Copyright 2009 23
Offset connector
LED
VCSEL
Laser
EF encircled flux - fraction of cumulative near field power to total output power as a function of radial distance from the optical centre of the core
- -1.9 dB2.3 dB
- -1.9 dB2.3 dB
Optical Link Margin Errosion
Upgrading links to 40GbE
10GbE to 40GbE link example:
10GbE → 40GbE
6 x 10GbE connections
6 duplex LC Cords
MPO to LC
MPO to LC
12f cable
MPO to MPO
MPO to MPO
12f cable
1 off 8 fibre MPO Cord
1 x 40GbE connections
802.3af • DC Power at 48V on 45,78• 37V x 350mA = 12.95W at the outlet• End point & mid span 100BASE-T• Cat5 or better cabling
802.3at• 30W power, 25.5W at the outlet on 100m link• End Point & mid span on 1000BASE-T
• Targetting mid span on 10GBASE-T• Operates on Cat5e or better cabling
• temperature rise of cable bundles see draft ISO/IEC TR 29125• Status - Publication expected Sept 2009 (imminent)
IEEE 802.3at Power over Ethernet+
Temperature rise vs. cable category & bundle size (720mA per pair)
“Cabling Guidelines for Remote Powering of DTEs - Guidance on Cable Thermal Behaviour”
ISO/IEC TR 29125
Fire Prevention & Safety
• European Regulation– 18th May 2009 - Mandate 443 issued to CENELEC
• Reaction to fire – 1994/611/EC• Resistance to Fire – 2000/367/EEC• Dangerous substances – 76/769/EEC
CENELEC ‘Reaction to Fire’ Test Methods
Integrated fire test:– Flame Spread– Smoke – Heat
• prEN 50399-2-1– FIPEC 20 scenario1– 20kW burner
• prEN 50399-2-2– FIPEC 20 scenario2– 30kW burner & backboard
Cabling ISO/IEC
Cabling CENELEC
Cabling EIA/TIA
Cabling UK
Cable ISO/IEC
Cable CENELEC
Connectors ISO/IEC
Pre 2009 2009 2010 ………….. 2018Event map
EN 50288-11
IEC61076-4-103 & 104
IEC 61076-4-###
EN 50441-1,2,3
IEC 61156-5 ed2
EN 50288-10
IEC 60603-7-41 & 51 & 71
IEC 61156 ammendmentsIEC 61156-1 ed3IEC 61156-1 ed2
Technology optical
Technology Cu
VCSEL
eMMF
eSMF
Level IIIe
OM4
2GHz 4 pair?
SFF connectors
10GBpstwinax
SFP+
10GBps 4 pair
500MHz 4 pair
Hybrid SMF/MMF?
40GBpstwinax
QSFP
1GHz 4 pair
40GBps4 pair?
EthernetFibre Channel Infiniband
PoE
10GbE
802.3af
10GBASE-T Data Centre switching100G+ &
FCoE?
802.3at
40GbE 100GbE
Office switching 10G & PoE++?
16GFC8GFC4GFC
32GFC10GFC
40GBASE-T?
64GFC20GFC
10G DDR 20G EDR10G QDR60G 12xDDR 120G 12xQDR 240G 12xEDR
IS 11801
EN50173-1 ed2
TSB155TIA 942
EN 50173-5 ammendment
TIA 568CTIA 568B.2-10
EN 50173-5
IS 14763-2
BS 6701 BS 8492
IS 24702
IS 15018
IS 24750
EN50173-1 ed3
BS 7671
TIA 942 ammendment?
IS 24750 IS 24764
IS 11801 Amm 1 Class EA & FA
IS 11801 Amm 2 Class EA & FA
IS 11801 Ed 3
EN50174-1 ed2 EN50174-2 ed2
Forecasts
Copper and Optical LAN cabling
Ou
tlet
s (m
illi
on
s)
Cu Cable – Data Centres (source: BSRIA)
Source: BSRIA 2007
History - Installed Cu Cabling
0
20
40
60
80
100
120
140
160
180
1995
1996
1997
1998
1999
2000
2001
2002
2003
2004
2005
2006
2007
Cat 7
10G
Cat 6
Cat 5e
Cat 5
1000BASE-T 10GBASE-T
Forecasts for Cu cabling
BR forecastSource: BSRIA 2009
10G cabling grows significant share from 2009
BR forecast
Forecasts for Optical cabling (LAN)
Source: BSRIA 2009
Enhanced MMF continues to grows strongly
Review
• Trends– Faster speeds & higher data rates – Switches will quickly adopt the new higher speeds– 40GbE speeds will be in Data Centre servers by 2011– 100GbE in Data Centre servers by 2018
• Technology– 10Gbps technology is established– 40G & 100G devices will appear in 2010– FCoE, Data Centre Ethernet– 40GbE on Cu, if developed, ≈2GHz cabling
• Implications to Cabling– Class EA Cu cabling will grow– OM3 & OM4 fibre will grow– Providing cabling for 40GbE should be considered now