Who works with 100G Ethernet?
What is it used for?What is it used for?
How to test it?
©Xena Networks, May 2012
What is driving 100G Ethernet?
Explosive traffic demand pushing existing networksMobile broadband data and videoEthernet wholesale and mobile backhaul servicesCloud services and cloud-based applications
Simplify networksAlready, many are using n x 10GE links to interconnect sites y, y gOperate fewer, higher-capacity links, overcome link aggregation limitations, simplify routing, simplify MPLSL ki t t k b tt d t f t ti ti l lti l i Looking to take better advantage of statistical multiplexing
Ride down the Ethernet cost curveRide down the Ethernet cost curveWith “Ethernet everywhere” 100GE solutions will become affordable enough to be deployed to control network costs
©Xena Networks, May 2012
100G Ethernet adoption
Infrastructure componentsMultiple suppliers shipping 100GE optical modulesComponent companies shipping FPGA’s, ASICs, NPUsA dozen equipment vendors shipping platforms with 100GETest solutions are available for 100GE Layer 1 3 testingTest solutions are available for 100GE Layer 1-3 testing
Operators and service providersp pFirst strategic adoptions by the end of 2012Significant adoption of 100GE by end of 2013
DatacentersIntel Romley server 10GE "LAN on Motherboard” and PCI Intel Romley server 10GE LAN-on-Motherboard , and PCI Express Gen 2/3 to drive growth in top-of-rack 40GE interconnect
©Xena Networks, May 2012
100G Ethernet Testing Status
• Automated production testing for 100GE• High port density testbeds
• QoS and stream integrity• Switching and routing performance
Layer 2/3
• Telecom PoC aggregation links, and WDM• Industry benchmarks (RFC2544, RFC2889)
Layer 2/3
• Forwarding and Throughput Capacity
• PCS layer
• Optical transceiver and cable bit-error ratio
• Packet IntegrityLayer 1
©Xena Networks, May 2012
p
100G Optical Family
100G SR10100m MMF (OM3/4)
100G LR4, ER410, 40 km SMF
100G 10x1010 km SMF
100 and 40G optical100G migrating to
ll f f t CXP, CFP CFP CFPsmaller form factorsCurrent 100G LR4 cost too high
CFP CXP CFP CFPg
10x10 CFP, lower cost (Santur, Google Brocade ?
CXP2 (2013) CFP2 (2013) QSFP2 (2014)
Google, Brocade, JSDU)New CMOS-based
40G SR4100m MMF (OM3/4)
QSFP+, CFP
40G LR4, ER410, 40 km SMF
CFP
100G LR4 Gearbox devices will reachmarket in 2012,
QSFP+ CFP CFP CFP
,reducing power and cost
QSFP+
©Xena Networks, May 2012
CFP-based Test Equipment
All 10/40/100G optical interfaces available in CFP10G LR/SR, 40G LR4/SR4, 100G LR4/SR10Natively or via CFP adapter
CFP adapters (QSFP+, CXP, SFP+)p (Q , , )
Forward compatible
CFP <-> QSFP+ CFP <-> CXP CFP <-> 4 x SFP+ (Cisco ”FOURX”)
Future CFP2, QSFP2, CXF2 is optical and host compatible with existing CFP opticswith existing CFP optics
Xena 40/100G tester compatible with 10GETh l T i S d 8 10G 2 40G 1 100G
©Xena Networks, May 2012
The only Tri-Speed: 8 x 10G, 2 x 40G, or 1 x 100G
New 100/40G PCS and PMA architecture
PCS and PMA architectureCAUI, 100G, 20 x 5 Gbps lanesXLAUI, 40G, 4 x 10 Gbps lanes
CAUI 100G LR4 PCS/PMA architecture
PCS Lanes20 x 5 Gbps
CAUI Interface10 x 10.3125
4 x 25 Gbps 4 x λ
CAUI 100G LR4 PCS/PMA architecture
SMF20 x 5 Gbps
0
10 x 10.3125 Gbps SerDes
λ0
λ1
.PCS
012
01.
01 PMD
λ2
λ3PMA 10:4
PMA 20:10.
.
19 9
.
.23 λ0
λ1
λ2
Gearbox20:10
©Xena Networks, May 2012
9 λ2
λ3
Physical Layer Testing (PMA)
Increased complexity of 100G optics Testing and screening during development and productionCareful inspection and cleaning of connectorsUse an unframed PRBS per lane to determine if your 100/40 Gbps optical transceivers function correctly100/40 Gbps optical transceivers function correctly.
How To:1. Insert the transceiver optics into the Xena tester and an
optical loopback cable in the CFP module. 2 Then enable PRBS for all lanes and run the test for 24 2. Then enable PRBS for all lanes, and run the test for 24
hours minimum to verify no PRBS errors are detected.
The loopback cable must be clean and able to pass error-free traffic on any other known good transceiver.
©Xena Networks, May 2012
Physical Layer Testing (PMA)
CAUI/XLAUI SerDes characterizationAccess to electrical CAUI SerDes allows for accurate host PCB h t i ti d i R&DPCB characterization during R&DTune host board voltage swing and pre-emphasis settings
©Xena Networks, May 2012
Physical Layer Testing (PCS)
Lane skewSkew is an issue for any parallel high-speed busValidate per lane buffer and alignment using skew insertionSkew tolerances specified by IEEE 802.3ba
λ0SP6
SP4Rx PCS
Skewpoint
Maximum Skew at 100GBASE-R
SP1 29 ns (150 UI)
.
.PCS
012 PMA
20:10
01
.
.
PMA 10:4Gearbo
012
PMD
λ0
λ2
λ0
SP6SP5
SP1 29 ns (150 UI)
SP2 43 ns (222 UI)
SP3 54 ns (278 UI).
19
0
9
. x 23 λ0
λ0
λ2
λ0SP1SP2
SP3Tx PCS
SP4 134 ns (691 UI)
SP5 145 ns (748 UI)
SP6 160 ns (824 UI)SP3
At Rx PCS 180 ns (928 UI)
Note that for 40GBASE-R, 1 UI is equal to 97 ps at PCS lane signaling rate of 10.3125 Gbps
©Xena Networks, May 2012
o a o 0 , U qua o p a a g a g a o 0 3 5 bpNote that for 100GBASE-R, 1 UI is equal to 194 ps at PCS lane signaling rate of 5.15625 Gbps
Physical Layer Testing (PCS)
Lane skewLane skewing errors can lead to interface link-down problems th t diffi lt t d b i d l d tthat are difficult to debug in deployed systems.
How to:How to:1. Insert 10 UI (bits) skew on multiple lanes and verify that the
PCS markers remain aligned. 2. Then, increase the skew incrementally until lane alignment
lock is lost to find the maximum skew for the DUT.
IEEE 802.3ba requires a skew tolerance of 928 UI at the Rx PCS
©Xena Networks, May 2012
Physical Layer Testing (PCS)
Lane swappingLane swapping errors can lead to interface link-down problems th t diffi lt t d b i d l d tthat are difficult to debug in deployed systems.
How to:How to:1. Configure tester to transmit L2/3 traffic from the tester
across the DUT and back to the same tester port. 2. Then, verify that header lock and alignment lock works on
all Rx lanes, to check all lanes are recognized and are aligned. g
3. Then swap lanes randomly and verify the new Rx lane mapping and that L2/3 traffic is passing error free
©Xena Networks, May 2012
RFC 2544 benchmarking
RFC 2544 - PURPOSEVerifies forwarding performance, including th h t ( f il bilit ) b k t b k throughput (performance availability), back-to-back (link burstability), latency (transmission delay) and frame loss (service integrity) measurements.
Xena testers can perform RFC 2544 for 100G and 40G Ethernet interfaces at all frame sizes and at full40G Ethernet interfaces at all frame sizes and at full-line rate.
BENEFITHelps vendors and service providers certify that the link is efficient and error free at 100% utilization at link is efficient and error-free at 100% utilization at Layer 2 (VLAN) or layer 3 (IP).
©Xena Networks, May 2012
RFC 2889 benchmarking
RFC 2889 - PURPOSEFor testing 40G and 100G datacenter switches
Mesh testing of large-scale switches, and multicast-only throughput test cases where latency y g p yand throughput are key performance parameters
X t t f RFC 2889 f 100G d Xena testers can perform RFC 2889 for 100G and 40G Ethernet interfaces at all frame sizes and at full-line rate.
BENEFITHelps data centers verify the switch can meet Helps data centers verify the switch can meet stringent demand for low-latency and lossless throughput performance
©Xena Networks, May 2012
Automation environments for quality
Automated test environments for production
Multirate test equipment for testing multirate data center switches, and telecom equipment
Broadcom 40/100G switch silicon is multirate 10/40/100G enabled
Id l h i i l ifi d t tb d f d ti t ti f Ideal having a single unified testbed for production testing of both 10, 40, and 100 Gbps modes of operation
Command line TCP/IP based scriptingCommand line TCP/IP based scriptingfrom any client environment(Tcl, Java, Perl, Python, VBA)
©Xena Networks, May 2012
Cisco Catalyst 6500, 4 x 40G, or 16 x 10G
CASE STUDY - Cabling Manufactures
Furukawa Industrial - Japan
Tested OM4 MMF channel links over distances from 70 to 520 meters by simulating a real network. (The standard defines 150m with OM4 MMF Cables.)150m with OM4 MMF Cables.)
100G c
XenaCompactMMF
a b
c
Optical MPO to MPO cables 12 Fibers MMF OM4
Reichle & De-Massari (R&M) – Switzerland
Optical MPO to MPO cables 12 Fibers MMF OM4
Lossless transmission over 550 meters of fiber optic cable and nine MPO connectors / 6-hour demonstration with no bit errors
©Xena Networks, May 2012
CASE STUDY – Global ISP
London New York
Infinera DTN Infinera DTN
Brocade10x 10G
connections Brocade10x 10G
connectionsBrocadeRouter
BrocadeRouter
connections
Tier 1 ISPGlobal IP
Xena 100G Tester Xena 100G
Global IP Network
©Xena Networks, May 2012
Tester Tester
Selecting a 40/100G test platform (1/2)
High port density for 40 GE and 100 GE testing 6 x 100GE, 12 x 40GE, or 48 x 10G in 4U chassisIndustry’s only 1U rackmount 1 x 100G / 2 x 40G / 8 x 10G
Industry price/performance leader for 100/40G testingy p /p / g
Comprehensive testing of the physical coding sublayerCh k li IEEE STD 802 3bChecks compliance to IEEE-STD 802.3baUnframed layer 1 BERT per PCS lane, for testing both MMF and SMF optics.a d op
Software selectable 8 x 10 GE, 2 x 40 GE or 1 x 100GEIndustry’s only 10G compatible 100G Tester
©Xena Networks, May 2012
Selecting a 40/100G test platform (2/2)
Layer 1-3 testing with wire rate traffic generationWire-speed stream based traffic generation and statisticsTraffic filter statistics, histogramsJumbo frame support (9200B)
Analyzes full wire rate 40 / 100 GE trafficReal-time latency, Packet loss, Data integrity, Packet capturey, , g y, pPacket capture with Wireshark support
S i ti b TCP/IP k t C d Li I t f Scripting by TCP/IP socket Command Line Interface From any TCP/IP environment, no drivers or APIs needed Same CLI spec for any port speed (10M – 100G)Same CLI spec for any port speed (10M 100G)
Industry benchmark tests RFC2544, RFC2889
©Xena Networks, May 2012
Y.1564 test suite to be released soon
Corporate Profile
Founded 2007 by group of communications professionals
Corporate HQ in Copenhagen (Denmark), Boston (US)
Self funded through organic growthSelf-funded through organic growth
Winner of global awards for price-performance leadership g p p pincl. Frost & Sullivan and Red Herring
©Xena Networks, May 2012