Date post: | 31-Dec-2015 |
Category: |
Documents |
Upload: | ocean-ortega |
View: | 194 times |
Download: | 0 times |
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF
March 25 – 27th, 2014 І Orlando, FL
#AvayaATF© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya.
Data Center Design Using Avaya Fabric Connect
Carl DeVincentis
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF
Evolution of the Data Center
Once, Campus-class was good enough
• 20-30 microseconds for every hop
• Modern applications have an average of 8 transactions
Traditional networks are designed for north/south traffic – ToR Switches interconnected by the Core or Aggregation…
Rack 1 Rack 4Rack 2 Rack 3
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 3
Evolution of the Data Center
What this meant: Application traffic
traverses multiple Switch hops – Access / Core / ToR / Core / Access
Uplinks were more important than Inter-Rack capacity
Racked Servers
Traditionally:The North-South to East-West ratio has been 80:20
Top-of-RackSwitches
Traffic Patterns were Traditional
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 4
“By 2014, network planners should expect more than 80% of traffic in the Data Center’s local area network to be between Servers”*
*Gartner, 2011
Your Data Center Network Is Heading for Traffic Chaos
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 5
Distributed ToR
How to address the new traffic needs
• DToR costs just 1 microseconds switch hop
Distributed ToR is specifically designed for east/west traffic – ToR
Switches directly interconnected…
WebVM
WebVM
AppVM
D/BVM
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 6
Distributed ToR
Now this means: Server-to-Server, Rack-to-
Rack traffic dramatically increases
Inter-Rack capacity is now crucial
Traditional designs introduce significant latency and degrade application performance
Eliminate the bottlenecked uplinks
The future:East-West traffic will dominate Data Center traffic* – ‘the new 80%’
Top-of-RackSwitches
Avaya delivers the industry’s only low-latency Distributed ToR solution
Alternatives introduce latency & congestion, additional equipment, consume more ports
* Gartner: ‘Your Data Center is heading for traffic chaos’ – April, 2011
Racked Servers
80%
20%
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 7
Scalability with Flexibility
Fabric Connect in the Data Center offers: Architectural Flexibility
Small, Medium & Large data centers Centralized and distributed Layer 2 overlays with Layer 3 VRFs Interoperates with non-Avaya platforms
Scale Increasing L2 scale while decreasing L2 complexity and
improving mobility Distributed ToR utilizes multiple 40G uplinks Eliminates the “choke points” of uplinks Handles East-West traffic natively
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 8
Distributed Top-of-Rack
Two operational modes for true deployment flexibility
Fabric-mode DToRFlexible Interconnect: up to 500 Switches
(16,000 10GbE Ports & 280Tbps)
Stack-mode DToRStructured Interconnect: 8 Switches
(256 10GbE Ports & 5.12Tbps)
Row A
Row B
Row C
Row D
From small to very large – D-ToR can handle it!
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 9
VM Evolution – The Need For Scale & Flexibility
APP A
Physical Servers
Rack 1
APP B
APPs A-HPer
Rack
Virtual Servers
APPsI-PPer
Rack
Rack 1 Rack 2
While application scale & server utilization is poor, network complexity is simple
Server virtualization brings scale and efficiency to applications. VMs become essentially “jailed” and network flexibility is reduced.
Members of the same VM domain must remain in the same subnet
VM Mobility is seriously limited. What is the alternative…?
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 10
VM Evolution – The Need For Scale & Flexibility
Fabric Connect provides the VMs & therefore, the applications a “get out of jail free” card
No longer bound by physical & logical constraints, VMs can be moved anywhere
This creates the flexibility to improve availability, simplify maintenance and enhance application expansionJailbreak..! Put your VMs where you need them..!
Rack 1 Rack 2 Rack 3 Rack 4
Row A
Row B
Row C
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 11
Introducing the Virtual Services Platform 7000
Overview & Highlights Perfect for Today
Versatile support for 1 or 10 Gigabit Ethernet
Distributed Top-of-Rack delivers Industry’s fastest virtual backplane
Fabric networking delivered directly to the Server
Media Dependent Adaptor flexibility Lossless hardware & software
architecture Front-back or back-to-front cooling Small form-factor & energy-efficient
Future-Ready for Tomorrow Seamless integration of 40/100G Data Centre Bridging-ready to
integrate Storage Convergence
Wire-speed performance
Delivering mass 1/10 Gigabit today
Optimizes application performance Future-proofed for 40/100 Gigabit &
Storage convergence (SDSN)
Highlights
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 12
VSP 7000 – Avaya FI (Fabric Interconnect)
Avaya FI (Fabric Interconnect) provides the new DNA for your Data Center Network.
Enabling unparalleled scalability and low latency interconnect to address East-West traffic requirements
FI Stacking supports 2-16 switches offering up to 512 10GE ports with 10.24Tbs Fabric.
FI Mesh supports 4-500 switches offering up to 16,000 10GE ports with 280Tbs Fabric.
Avaya FI – the new DNA for your Data Center Network
Sidney Duffy
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 13
VSP 7000 – Front Ports
Data RJ-45 Console Port 24 ports of 1/10 Gigabit SFP+ MDA Slot for flexible expansion Comprehensive array of status LEDs Unit Master Select switch Out of Band 10/100/1000 Management Port USB Host Port
24 SFP+ PortsRJ-45 Console Port MDA Slot
Status LEDsManagement Port * USB Port
Master Switch* Indicates future functionality
** Supports currently SFP/SFP+ & DAC (as per VSP 9000)
8 port 10GigBaseT MDA8 port SFP+ MDA
1HCY142 port 40Gbps MDA
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 14
VSP 7000 – Rear PortsModes of Operation
A significant challenge in many data centres is the growing amount of East-West traffic which requires higher bandwidth between adjacent racks in the data centre.
Each VSP 7000 features 4 Fabric Interconnect ports.
Fabric Interconnect can be used in two mutually exclusive modes: Fabric Interconnect Stacking, in which up to 8 units create a vToR (virtual Top of
Rack) or 16 units in a dToR (distributed Top of Rack) delivering up to 10Tbps using two clusters of 8 switches.
Rear Port Mode, in which two choices are available, Raw supporting SMLT/IST only over rear ports and SPB for Fabric Interconnect Mesh supporting SPB and SPB plus IST over rear ports.
Fabric Interconnect Ports
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF
Distributed Top-of-RackStack-mode DToR
Structured Interconnect: 8 Switches 256 10GbE Ports
Fabric-mode DToRFlexible Interconnect: up to 200 Switches
6,400 10GbE Ports
North-South/Core-ToR Interconnects
Fabric ConnectCore
DistributedData Center
VSP 9000
ERS 8800
VSP 7000
SDSN
SDSN
SDSN
Scaling Concerns
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 16
Introducing Fabric ConnectLeveraging IEEE 802.1aq & IETF RFC 6329
Avaya’s optimized, end-to-end virtualized Ethernet Built using multiple product options, and leveraging any topology
Configuration is simple – becoming automatically self-aware of all & best paths Creates an end-to-end solution that is transparent to the physical layer
Creates a layer of end-to-end virtual Ethernet – perfect for L2 connectivity Also creates a flexible Routing solution – mandatory for real-world L3
interconnectivity Layer 2 services are deployed using simple edge-only, one-touch
provisioning Traditional end-to-end interconnectivity is supported by flexible Routing services Services easily scale and extend – delivering any-to-any connectivity
Geo-redundant routing services ensure optimum performance and resource utilization
Additional services are deployed at will – a common ID links any and all end-points
Multi-Tenant scenarios are natively supported, leveraging the same, simplified provisioning model
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 17
VSP 7000 & VENA Distributed ToR
DToR delivers at least 20x more performance than competing solutions Stack-mode scales up to 8
Switches & 5.12Tbps per vToR Fabric-mode scales up to 500
Switches & 280Tbps
Reduces multi-hop server-to-server latency
Delivers maximum efficiency – all Server ports remain active 0
1000
2000
3000
4000
5000
6000
Arista Avaya Brocade Cisco Force10 Juniper
Max Interconnect Speed (Gbps)
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 18
Fabric Interconnect Stacking
Up/Down port pairs are 320Gbps each pair for a total of 640Gbps per switch
Recommended Fabric Interconnect stacking configuration for odd and even stacks
37 33
38-40 34-36
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 19
Fabric Interconnect Stacking (SMLT to Core)
L2 Service and Inter-VSN routing supporting VRRP and Back-up Master for routing North-South and off-net traffic 100% application uptime during switch maintenance through VM
mobility
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 20
Fabric Interconnect Stacking (SPBM to Core)
Allows for SPB attached switch clusters and LAG attached servers 100% application uptime during switch maintenance through use
of SMLT
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 21
VSP 7000 vToR (Virtual ToR)Fabric Interconnect Stacking Reference
Non-Resilient Server connections 32 x10G ports per Rack / 256 10GE ports per Pod5Tbps East-West Bandwidth
ToR
32 Servers
per Rack
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 22
VSP 7000 dToR (distributed ToR)Fabric Interconnect Stacking Reference
Fully Resilient 32 x10G ports per Rack / 512 10GE ports per Pod10Tbps East-West Bandwidth
ToR Cluster 1
ToR Cluster 2
IST`
32 Servers
per RackDual
Attached
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 23
Fabric Interconnect Stacking Benefits Allows for Fault-tolerant or Load sharing NIC teaming into stack Up to 8 units create a vToR (virtual top-of-rack) delivering up to 5Tbps using
two FI cables in parallel between switches for a total of 256 10GE ports Up to 16 units in a dToR (distributed top-of-rack) delivering up to 10Tbps
using two clusters of 8 switches for up to 512 10GE ports High bandwidth and low latency between servers (2.1µs – 5.3us) Highly resilient stacking technology with scalable uplinks Flexibility to spread across multiple data cabinets (100s of servers) Ideal for Grid Computing/High-Performance Computing Solutions
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 24
VSP 7000 Fabric InterconnectRear Port Speeds
The 4 physical Fabric Interconnect ports provide different bandwidth capabilities (see rear-ports feature for more details).
Three different colours are used to represent the different capabilities. Optimum performance will be achieved when ports of the same throughput are connected to one another.
Colour Physical Fabric Interconnect Port ThroughputNumber of ports in LAG
Black FI Up (right) Top 240Gbps 3 x 40G
Red FI Down (left) Top 240 or 160Gbps3 x 40G (raw) or 2 x 40G (SPB)
Blue FI Bottom (both Up (right) & Down(left)) 80Gbps 1 x 40G
37 33
38-40 34-36
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 25
Fabric Interconnect Mesh
Rear Port Mode Standard SPB is not supported when the rear port mode is set to standard (raw) mode The IST must be made up of a minimum of two ports, i.e. use both rear blue ports
or you could use either the red or black rear ports as each has 3 ports each LACP must be disabled prior to enabling IST or SMLT using the rear ports SMLT square and triangle topologies are supported in rear port raw mode; SMLT
full mesh is not supported Rear Port Mode SPB
Only SPB L2VSNs are supported For routing, the L2VSN must be terminated on at least one VSP 9000, VSP 4000,
or ERS 8800 that either has IP Shortcuts or L3VSN enabled; it is recommended to terminate the L2VSN on a second VSP 9000, VSP 4000, or ERS 8800 and use VRRP
The IST must be made up of at minimum two port, i.e. use both rear port blue ports or you could use either the red rear ports (2 ports) or black rear ports (3 ports) Please note that one of the red ports is used as a SPB loopback port, hence,
the number of ports is reduced by one
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 26
Fabric Interconnect – Rear Port Mode Standard
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 27
Fabric Interconnect – Rear Port Mode SPB
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 28
Fabric Interconnect – Rear Port Mode SPB
Switch stacking and clustering with SPB supported in 10.3
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 29
Recommended ISIS Metrics Link Speed
(Gbps)Interface Type ISIS L1-metric
1 Native Ethernet 3502 MLT bundle 175
10 Native Ethernet 3520 MLT bundle 1740 Native Ethernet / FI Blue 5 (9 if separate LAG group)80 MLT bundle / FI Red 5 (5 if separate LAG group)
100 Native Ethernet 5120 MLT bundle / FI Black 5 (3 if separate LAG group)
5
3
95
5 5
9 9 9
3
3 3
35
35
353
5
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 30
Rear Port Mode SPB – Inter Rack Connections
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 31
Fabric Interconnect Mesh Benefits
FI mesh SPB scalability from 4 to 480 switches Providing low latency fabric. Fabric is scalable up to 262.5Tbps. Extensible up to 15,360 10GE ports. Designed to enable either 24/32/48/64 10GE ports per rack
Fabric Interconnect ports interconnect each VSP7000: Can use mix of different Fabric Interconnect cable lengths. Optimum performance will be achieved when the same color designated ports are
connected to one another Rear port
The rear ports provide up 640Gbps of connectivity LACP and VLAN tagging is automatically enabled for the rear ports The 4 physical Fabric Interconnect ports provide different bandwidth capabilities
(see rear-ports feature for more details). Three different colors are used to represent the different capabilities. Optimum
performance will be achieved when the same colored ports are connected to one another.
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 32
Putting it all together
dToR with SMLT and SPB
FI Mesh with SMLT and rear port SPB
Add L2VSN betweenData Center #1 andData Center #2 for vMotion or othershared services
Active/Active LAG
Active/Active LAG
Terminate VSP 7000 L2VSNon any of these nodes and enableIP Shortcuts for routing to the rest of the network
Terminate the same L2VSN on asecond node and enable VRRPBackup-Master for active/active resilience
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF 33
In Summary
Avaya has created a solution that leapfrogs the rest of the industry. Solves the East-West DC traffic problems vToR and dToR provides for massive scale Eliminates traditional network limitations (STP & VLANs) Allows FULL VM mobility without sacrificing performance
Additional benefits: Provides PCI compliance without the high cost & expense Improves Disaster Recovery to Business Continuance.
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF#AvayaATF
Thank You!
© 2014 Avaya Inc. Avaya – Confidential & ProprietaryDo not duplicate, publish or distribute further without the express written permission of Avaya. #AvayaATF
BE SURE TO TWEET YOUR FEEDBACK ON THIS PRESENTATION
#AvayaATF
35
BEST OF ATF SPEAKER AND TEAM AWARD
Winners will be announced at closing of event
#AvayaATF