20
10GBASE-T
• Jonathan Jew, President,– J&M Consultants (Telecommunication Engineering Firm)– Co-chair TR42.1.1, Data Center Standard
• Phil Isaak, Associate, Senior Communications Engineer,– Mazzetti & Associates (Engineering Firm)
• William Baxter, Telecommunications Practice Leader– OWP/P (A&E Firm)
Contributors:
10GBASE-T
Customer Premise
Internet DataCenter
Local Loop-service provided
Serviceprovider- Distribution Node-Central Office
Service ProviderBackbone•Customerlease
Customer Premise
Internet DataCenter
DATA/Voice Infrastructure
Local Loop-serviceprovided
HomeSOHO
HomeSOHO
Telecommunication Infrastructure
Serviceprovider- Distribution Node-Central Office
Enterprise Enterprise
• Data Center• EFM- Access Networks
ISP ISP
10GBASE-T
Campus Network: California State University Data Center -80’s
10GBASE-T
Cornell Campus Network, -87
10GBASE-T
Ethernet Networking -LAN/WAN/SAN
Switch
FileServers
Firewall
WAN Router
Internet
WebServers
EmailServers
ApplicationServers
BackboneSwitch / Router
1 Gb/s10 Gb/s100
Mb/s10
Mb/s
1Gb/s
Remote Enterprise
1 Gb/s
Equipment Room
10 Gb/s
10 Gb/s
SAN
10 Gb/s
LAN
WAN
10GBASE-T
Generic Generic Cabling - ISO/IEC 11801 - TIA/EIA-568
HC
HCTO
ICMC
HC
HC
HC
HCTO
IC
HC
HC
HC
HCTO
IC
HC
HC
HC
HCTO
ICMC
HC
HCWAN/RAN/MAN
LAN
LAN
TPTO
Interbuilding backbone 2000 m
Intrabuilding backbone 500 m
Horizontal Cable 100 m
Geographical Span ~3 kilometer
10GBASE-T
TIA-942-Data Center Standard
• The standard is being developed by the TIA/TR42
• Engineering Committee - subcommittee-TR-42.1.1 NetworkDistribution Nodes - Project No. 3-0092
• Participants include:– Architecture & Engineering Firms– Consultants– End Users– Manufacturers
• The standard will become TIA-942
• To be submitted for approval by ANSI and CSA
• Draft 3.0 - expected to be issued by TIA end of November
• Anticipated ballot closure early January
10GBASE-T
Data Center- Relationship of Spaces
BUILDING SITE
DATA CENTERDATA CENTERELECTRICAL &MECHANICAL ROOMS
SUPPORTSTAFFOFFICES
OPERATIONSCENTER
STORAGE ROOMS& LOADING DOCKS
BUILDING SHELLGENERAL OFFICESPACE
OFFICE BUILDINGSUPPORT SPACE
ENTRANCEROOM(S)
TELECOM ROOMS &EQUIPMENT ROOMSfor spaces outside datacenter
COMPUTER ROOM
TELECOM ROOM(S)for data centersupport spaces
10GBASE-T
MC
IC IC IC IC
Entrance Facility
MC
Carriers Carriers
HC
Offices, OperationsCenter, Support Rooms
Data Center
HC HC HC
Carriers
Carriers
Active Equipinterconnect
Active EquipStorage Area Devices
interconnect
Active Equip
interconnect
Active Equipinterconnect
Active Equipinterconnect
Active Equipinterconnect
Secondary Entrance Room
Entrance Room
Back boneCabling
Active Equipinterconnect
ZoneDistribution
Data Center Topology
HorizontalCabling
10GBASE-T
In a data center, horizontal cabling is the cabling from the horizontal cross-connect (in the main distribution area or horizontal distribution area) to theoutlet in the equipment distribution area or zone distribution area.
Data Center Horizontal cable distance
MC
IC IC
MC
HC HC
Active Equipinterconnect Active Equip
interconnect
Active Equipinterconnect
ZoneDistribution
Area
HorizontalCabling
MainDistribution
Area
HorizontalDistribution
Area
EquipmentDistribution
Area
BackboneCabling
10GBASE-T
Physical Layer Design Considerations:
• Active Equipment -– Network topology, including operating distances and numbers of connectors– PMD types
+ copper+ optics, mode conditioning patch cords
– Equipment densities per linear rack unit .
• Cabling– Cabling components: cable, connectors, patch cords– installation: connecterization– cabling density– Field testing
• Compatibility with existing (installed Network)
• Total Network Cost
10GBASE-T
Network Design
Site Survey
Copper/Fiber Link Analysis
Site Diagram
Network Schematic Diagram
Distribution Subsytem Design
Wiring Concept Design
Cost Analysis
1. BOM2. InstallationRequirements
Design Complete
yes
Customer Requirements
e.g., Storage Area Network
e.g., Service Provider, Corporate (enterprise)
no
10GBASE-T
MC
IC IC
MC
HC HC
Active Equipinterconnect Active Equip
interconnect
Active Equipinterconnect
ZoneDistribution
Area
HorizontalCabling
MainDistribution
Area
HorizontalDistribution
Area
EquipmentDistribution
Area
BackboneCabling
Active Equip
interconnect
Active Equip
interconnect
Data Center: Network Cabling Design Considerations
• Placement of active equipment and usage of interconnect versus cross-connects:
10GBASE-T
Data Center Type Data Center Size (sq ft) 0-30 m 31-45 m 46-55m 56-75m 76-100m
Corporate 5000 100% 0% 0% 0% 0%Corporate 8000 90% 10% 0% 0% 0%
Govt 10000 70% 20% 10% 0% 0%Corporate 20000 70% 25% 5% 0% 0%Corporate 20000 90% 9% 1% 0% 0%Internet 40000 60% 35% 5% 0% 0%
Corporate 45000 65% 25% 8% 1% 1%Internet 60000 35% 48% 15% 1% 1%Internet 60000 55% 35% 8% 1% 1%Internet 80000 55% 35% 8% 1% 1%Internet 100000 55% 35% 8% 1% 1%
Average 67.7% 25.2% 6.2% 0.5% 0.5%
Data Center: Horizontal Cabling Length: J&M Consultants (Engineering Firm)
Source: Jonathan Jew, J&M Consultants, Co-chair TR42.1.1- Data Center Standard
• Data centers recently built by (J&M) type and size– 93% of data center horizontal cables are <= 45m– 99% of data center horizontal cables are <= 55m
10GBASE-T
Data Center: Horizontal Cabling Length: Mazzetti & Associates (Engineering Firm)
Source: Phil Isaak, Associate, Senior Communications Engineer, Mazzetti & Associates (Engineering Firm)
• Data centers recently built by (M&A) type and size– 83% of data center horizontal cables are <= 45m– 94% of data center horizontal cables are <= 55m
Data Center Type Data Center Size (sq ft) 0-30 m 31-45 m 46-55m 56-75m 76-100m
Corporate 5000 100% 0% 0% 0% 0%Corporate 10000 8% 23% 38% 31% 0%Financial 25000 74% 19% 6% 1% 0%Corporate 30000 99% 1% 0% 0% 0%Internet 60000 47% 46% 5% 1% 1%Internet 75000 44% 50% 4% 1% 1%Internet 120000 35% 32% 27% 5% 1%
Average 58.1% 24.4% 11.4% 5.6% 0.4%
10GBASE-T
Data Center: size versus percentage built
Data Center Size (sq ft) Size Category Percentage built
</= 5000 small 50%</=15000 midrange 30%>15000 large 20%
•80% of data centers recently built by (J&M) are ≤≤ 15000 sq ftSource: Jonathan Jew, J&M consultants, Engineering Firm
Data Center Size (sq ft) Size Category Percentage built
</=5,000 small 30%</=15,000 midrange 45%>15,000 large 25%
•75% of data centers recently built by (M&A) are ≤≤ 15000 sq ft Source: Phil Isaak, Associate, Senior Communications Engineer, Mazzetti & Associates (Engineering Firm)
10GBASE-T
Data Center Cabling by Category: Percentage Usage (avg.)
Category 1999 2000 2001 2002 2003Category 5 10.00 1.67 0.33 0.33 0.33Category 5e 66.67 60.00 55.00 46.67 35.00Category 6 23.33 38.33 44.67 53.00 64.67
Source:
Jonathan Jew, J&M Consultants (Telecommunication Engineering Firm)Phil Isaak, Associate, Senior Communications Engineer, Mazzetti & Associates (Engineering Firm)William Baxter, Telecommunications Practice Leader, OWP/P (A&E Firm)
10GBASE-T
Under Floor Space Overhead Cable Tray
Data Center Cabling: Pathways and Spaces
10GBASE-T
Example of Wire Basket Cable Trays For CablingUnder Raised Floor
24"On Center
RAISED FLOOR TILE
SUPPORT STRUT
36"
24"
4"
9"
FIBER
5"
SUPPORT STRUT
18"
COPPERCABLING4"
13.5"
DIVIDER
FIBER
5"18"
COPPERCABLING
12"
1.375"
1"
1"
Open Area
