Brocade FCoE Storage Community Call

© 2009 IBM Corporation

IBM Storage Networking

Introduction CEE/FCoE Solutions from BrocadeVersion 10.08.2009

JÜRGEN KRESSIG

BROCADE SAN Specialist - IBM Account

IBM Storage Community Call – August 2009


Dynamic Infrastructure Data Center Networking

2

Legal Disclaimer

All or some of the products detailed in this presentation may still be under development and certain specifications, including but not limited to, release dates, prices, and product features, may change. The products may not function as intended and a production version of the products may never be released. Even if a production version is released, it may be materially different from the pre-release version discussed in this presentation.

NOTHING IN THIS PRESENTATION SHALL BE DEEMED TO CREATE A WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, STATUTORY OR OTHERWISE, INCLUDING BUT NOT LIMITED TO, ANY IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NONINFRINGEMENT OF THIRD PARTY RIGHTS WITH RESPECT TO ANY PRODUCTS AND SERVICES REFERENCED HEREIN.

Brocade, the Brocade B weave logo, Fabric OS, Secure Fabric OS, and SilkWorm are registered trademarks and Tapestry is a trademark of Brocade Communications Systems, Inc., in the United States and/or in other countries. All other brands, products, or service names are or may be trademarks or service marks of, and are used to identify, products or services of their respective owners.



3

Brocade is IBM’s First SAN Supplier (3/2000) and longest OEM relationship

Deep History of relationships at INRANGE, CNT, McDATA (now part of Brocade)

Significant majority share of IBM switch and director market

IBM Market Share 96% SAN switches and 84% directors (NE IOT Q2/09)

Highlights of our Partnership with

February 2009 : Brocade FC-HBA’s come available

– 8G Single/Dual Port HBAs for x-Series Server

– Single Port (46M6049), Dual Port (46M6050)

April 2009 : IBM DCN Announcements

– Ethernet switches and routers products

– CEE/FCoE switches and CNA (Preview)

NEW



4

The big difference: Integrated networks with IBM

10 GbE L2-3 m-series

L4-7

10 GbE L2-3 s-series

10 GbE L2-3 m-series

SAN

SAN768B SAN Backbone Director

8G FC & 10G CEE/FCoE

8 Gbps FC

Switch / Director

SAN384B

SAN256B

SAN80B-4

SAN40B-4

SAN24B-4

Storage Arrays

GbE ToRg-series

GbE ToRc-series

GbE ToR c-series

10 GbE MoRs-series

WAN

10 Gb CEE ToR FCoE/CEE 8000

1 GbE

8 Gbps FC

10 GbE

4 Gbps FC

10 Gbps CEE

CEE/FCoE

FC-HBA & NIC CNA – Only !



5

Today: Before Unified I/O Parallel SAN and LAN

Potentially less optimal use of networks, but it works

Four or more connections per server:

– Higher adapter and cabling costs

– Adds CapEx and OpEx

– Each connection adds points of failure

Slower server provisioning

Additional redundancy and security due to separate physical infrastructures

Separate management realms

LAN SAN A SAN B

FC HBAs(FC Traffic)

NICs(Ethernet Traffic)

FCoE and CEEEthernetFC

June 2009



6

General Unified I/O Usage Case

One fabric infrastructure at the server edge for tier 2/3 app servers and VMs

FC and CEE L2/L3 multipathing end-to-end (as standard is finalized)

Fewer components to deploy

Leverages existing network and storage infrastructure

Lower TCO

Disk array, FICON, and tape will require FC for years to come

CEE/FCoE Switches

Converged Network Adapters (CNA)

FC SANCorporate

“Traditional” LAN

FCoE and CEEEthernetFC

LAN SAN A SAN B



7

Enabling FCoE with CNAs

Fibre Channel Drivers

Ethernet Drivers

Operating System

Fibre Channel Drivers

Ethernet Drivers

Operating System

PCIe

Fib

re C

han

ne

l E

thern

et

10GE

10GE

Link

Fib

re C

han

nel

PCIe

8G H

BA

8G H

BA

Link

PCIe

Eth

ernet

GE

GE

Link

LAN

Next: Two CNAs per server

HBA

Now: Four adapters per server



8

Fibre Channel over Ethernet (FCoE)

A mechanism to carry Fibre Channel

protocol on top of Converged Enhanced Ethernet

Encapsulates FC frames over CEE

Leverages the rich set of FC fabric services

for storage connectivity

– Name services, zoning, WWN structure,

management, multi-pathing

Preserves investment in SAN infrastructure

Converged server connectivity through one physical connection

10 GigE Physical

Converged Enhanced Ethernet (CEE)

IP Stack

IP Stack

HPC Stack

HPC Stack

FCoE Stack

FCoE Stack

Middleware

Application

EthernetLink

FCoE Traffic

HPCIP

60%10%30%



9

Layer 1

Layer 2

FCoE

Ethernet is Enhanced Through StandardsConverged Enhanced Ethernet

FC-2

FC-3

FC-4Use of IEEE 802.1p:

Multiple logical lanesUse of Per-Priority PauseClass Based Flow Control

+IEEE 802.1au:

Congestion Notification

Converged EnhancedEthernet

The customer value from CEE adoption requires open standards implementations

Lossless characteristic : Guaranteed Bandwidth, No Frame drop, In order delivery



10

Fibre Channel over Ethernet

Encapsulation protocol for transporting FC over Ethernet (Lossless Ethernet: CEE)

CEE FC Traffic IP Traffic

FC frame remains intact: FC does not change Ethernet needs a larger frame: Larger than 1.5 KB Ethernet must become lossless to carry storage data with integrity

Traditional

Ethernet IP Traffic

Eth

ern

et

He

ad

er

FC

oE

He

ad

er

FC

He

ad

er

FC Payload CR

C

EO

F

FC

S

Same as a physical FC frame

Control information: version, ordered sets (SOF, EOF)

Ethernet Frame, Ethertype = FCoE=8906h



11

CEE and FCoE Standards ActivitiesDeveloping standards, approval expected by late 2009

IETFTRILL - Transparent Interconnection of Lots of Links (multipath)

IETFTRILL - Transparent Interconnection of Lots of Links (multipath)

T11 ANSI

FCoESPMA FPMA address discovery

T11 ANSI

FCoESPMA FPMA address discovery

Implementation Agreement

IEEE802.1Qbb Priority Flow Control (PFC)

802.1Qaz Enhanced Transmission Selection (ETS)

DCBX Data Center Bridging Exchange protocol proposal for 802.1Qaz

802.1Qau Congestion Notification

IEEE802.1Qbb Priority Flow Control (PFC)

802.1Qaz Enhanced Transmission Selection (ETS)

DCBX Data Center Bridging Exchange protocol proposal for 802.1Qaz

802.1Qau Congestion Notification

Approved Draft In Development



12

CEE: Ethernet with FC Characteristics Lossless Ethernet that creates the potential for I/O consolidation at the server edge by

transporting storage, networking, and clustering traffic Lossless characteristic : Guaranteed Bandwidth, No Frame drop, In order delivery Transport for FCoE storage traffic, data center applications, and clustering CEE can link to traditional Ethernet, but loses these characteristics at the link

Feature/Standard Benefit

Priority Flow Control (PFC)IEEE 802.1Qbb

Helps enable a lossless network, allowing storage and networking traffic types to share a common network link

Enhanced Transmission Selection (Bandwidth Management) IEEE 802.1Qaz

Enables bandwidth management by assigning bandwidth segments to different traffic flows

Congestion Management IEEE 802.1Qau

Provides end-to-end congestion management for Layer 2 networks

Data Center Bridging Exchange Protocol (DCBX)

Provides the management protocol for CEE

L2 Multipathing: TRILL in IETF Recovers bandwidth, multiple active paths; no spanning tree

FCoE/FC awareness Preserves SAN management practices

*

*

*Still in Development



13

Hype Cycle for Storage Technology - 2009

Gartner views the following impediments to convergence:

• Financial• $50B FC installed

based• 10 GbE/CEE backbone

costs• Initial increased power• Recabling of data

center

• Technical• Six different standards

must come together• Cannot yet match

clustering latency and performance

• Cultural• Storage is 7/24

production network vs. IP failover

FCoE is

here



14

SAN and HBA Port Shipments

Source : Dell’Oro 08/2009



15

Brocade FCoE/CEE Solutions Today

LAN

Fibre Channel SAN

Brocade 1010/1020

CNAs

Brocade 8000 Top-of-Rack Switch

CEE

FC Traffic

IP Traffic

FC ports

CEE ports

FC Traffic

10GbE Ports

24

FC ports 8 @ 8Gbps

Total 10GbE Bandwidth

240 Gbps

Total FC Bandwidth

64 Gbps

Brocade DCFM

Brocade 1010/1020 CNA’s for server

Early Access Program has already started !

IBM CNAFeature code : 42C1820



16

IBM Converged Switch B32 (3758-B32) Multi-protocol, multi-layer DCF switch

FCoE switching for server-to-storage connect

CEE and L2 switching for server-server & server-LAN connections

Cut Through, Non-Blocking Switch Architecture

Compatible with Brocade FC installed base & works with FCoE CNAs

Built on Brocade Fabric OSTM v6.1.2_cee

1 U form factor, 350W redundant power supply, standard rack width, hot swappable Fan FRUs

Back to Front Airflow (port side front)

24 ports 10 GbE CEE/FCoE + 8 ports 1/2/4/8G FC

Support for SR, LR SFP+ Optics

Twinax (Copper - 10GigE only)

24 ports 10 GbE CEE + 8 ports 8G FC



17

IBM Converged Switch B32 (3758-B32)

CEE switch + FC Switch +

FCoE – FC translation entity The FCoE translation entity is a internal

function

The FCoE translation entity Functions

– Detection, FC encapsulation, and redirection of FCoE fabric login frames

– Encapsulation of an FC frame in an FCoE Ethernet packet (FC->FCoE)

– Extraction of an FC Frame from an FCoE Ethernet packet (FCoE->FC)

– The mapping of FC destination Virtual Fabric and destination FC_ID to Ethernet Virtual LAN and destination MAC address

Ethernet Fibre ChannelFCoE



18

IBM Converged Switch B32 (3758-B32)Port Numbering and Serial Number There are two sets of ports: CEE and FC

– 24 CEE ports which are numbered 0 – 23 and support a data speed of 10 GbE– 8 FC ports which are numbered 0 -7 and support data speeds from 1/2/4/8 Gbit/sec

The IBM Converged Switch offers the following SFP optical transceivers:For FC Ports : 8 Gbps SW (#45W0500) and 10 Km LW (#45W1216) SFPFor CEE Ports :10 Gbps SR (#45W2411) and 10 Gbps LR (#45W2420) SFP+For CEE Ports : Twinax Active 1 m (#45W2398), 3 m (#45W2408), and 5 m (#45W3039)

Transceivers are also available in 8-pack convenience packages:For FC Ports : 8 Gbps SW (#45W0501) and 10 Km LW (#45W1218) SFPFor CEE Ports : 10 Gbps SR (#45W2414) and 10 Gbps LR (#45W2421) SFP+For CEE Ports : Twinax Active 1 m (#45W2401), 3 m (#45W2409), and 5 m (#45W3042)

Brocade branded SFP‘s only !



19

IBM Converged Switch B32 (3758-B32) – CEE Media



20

IBM Converged Switch B32 (3758-B32)– FC Media

10 Km LW(#45W1216) SFP



21

IBM Converged Switch B32 (3758-B32) - Features

Fabric OS v6.1.2_CEEx FC optionally licensed features supported on the B8000:

– ISL Trunking (#45W0528)

– Advanced Performance Monitoring (#45W0527)

– No POD license required ! All ports are available !

Fabric OS v6.1.2_CEE FC features not supported on the B8000:

– FICON

– Adaptive Networking (Ingress Rate Limiting and QoS)

– Hot code load activation

– Integrated Routing

– Admin Domains

– Extended Fabrics

– Traffic Isolation Zones



22

Brocade Converged Network Adapters (CNA)IBM x-Series GA date June 26, 2009

Dual-port 10 Gigabit Ethernet CEE

PCIe 2.0 Gen 2 x8 host bus interface:

– Four independent PCI functions

– Wire speed

SFP+ copper and optical models

Multifunction capability:

– NIC: Advanced Link Layer Offload: TCP/IP

acceleration, RSS, jumbo frames, VLANs,

priority, PAUSE, link aggregation

– Storage: Hardware FCoE offload

10Gb FCoE / CEE AdaptersIBM Feature Code # 42C1820Brocade 10Gb CNA for IBM System x

IBM Feature Code # copper & opticalBrocade 10Gb SFP+ SR # 49Y4216

Twinax Active 1 m # 45W2398Twinax Active 1 m 8-Pack # 45W2401Twinax Active 3 m # 45W2408Twinax Active 3 m 8-Pack # 45W2409Twinax Active 5 m # 45W3039Twinax Active 5 m 8-Pack # 45W3042



23Brocade Data Center Convergence Overview

CNA Software Overview Operating systems support FW v2.0

Drivers (storage and networking)– Windows Server: 2003, 2008 – Red Hat Linux: RHEL 4, 5– SUSE: SLES 9, 10– VMware: ESX 3.5 & 4.0– Solaris 10: X86, SPARC– More in development

Management APIs– SNIA HBA API v2.0, FDMI

June 2009

Same driver version for FC-HBA !



24

Single Server Cabinet

Server Rack

ToLAN &SAN

RackServers

IBM B32 (ToR)FCoE Switch

SAN LAN

Simplify cabinet cabling

using Twinax (max. 5m)

or optical cable

10GE short reach or

long reach (OM3)

Consolidate SAN and

LAN connections

Lower I/O adapters and

cables count

IBM Converged Switch B32 – “Top of Rack”Multi-protocol, multi-layer DCF switch



25

IBM Converged Switch B32–24 ports FCoE and 8 ports 8 Gbps FC

Cisco Nexus 5010 for IBM System Storage20 ports FCoE plus choice of three expansion modules 6-port FCoE, 4-port 4 Gbps FC + 4-port FCoE, or 8-port 4 Gbps FC

Cisco Nexus 5020 for IBM System Storage40 ports FCoE plus choice of three expansion modules 6-port FCoE, 4-port 4 Gbps FC + 4-port FCoE, or 8-port 4 Gbps FC

IBM new FCoE – “Top of Rack” Switches



26

Brocade FCoE/CEE Solutions Tomorrow

Fibre Channel SAN

CEE

FC Traffic

IP Traffic

LAN

Future DCX FCoE/CEE Blade

• 24x 10GbE CEE Ports

• FCoE entity

•Add to existing chassis without disruption

Brocade DCFM

Expected in Q4/2009

Brocade 1010/1020 CNA’s

IP Traffic

Fibre Channel over Ethernet Switching (FCoE) – Enables server connectivity to storage

FC Features - Standard Brocade 1/2/4/8G FC Switch

Standard L2 Ethernet Features and Converged Enhanced Ethernet (CEE) Switching



27

Is Fibre-Channel dead

… the answer is NO !!!– FCoE is an extension of an existing technology (Fiber Channel) on a new transport (CEE). – There is a large installed based of FC storage (>$50Billion US-dollars)– CEE/FCoE is not completely ratified today ! – BROCADE‘s next gen ASIC for 16G-FC is ready !

… what are our Storage OEMs are saying:– FC continues to be the main interface

– No reason for storage vendors to implement FCoE natively

– Storage vendors slow in bringing new interfaces (iSCSI)

– FICON/Mainframe is a “wait and see mode”



28

IBM System Storage SAN Product FamilyThe Leading SAN Connectivity Solutions for Open Systems & Mainframe Environments

SAN256B(2109-M48)16 to 384-ports1, 2, 4, 10 Gbps

FC, FICON

SAN768B(2499-384)

16 to 384-ports1, 2, 4, 8, 10Gbps

FC, FICON

SAN Health

SAN24B-4(2498-B24)8, 16, 24-ports

1, 2, 4, 8 Gbps FC

SAN40B-4(2498-B40)

24, 32, 40-ports1, 2, 4, 8 Gbps

FC, FICON

SAN80B-4(2498-B80)

48, 64, 80-ports1, 2, 4, 8 Gbps

FC, FICON

SAN04B-R (2005-R04)

4 & 8* Gbps SAN Switch Module

for IBM BladeCenter®

1, 2, 4, 8 Gbps FC

IBM DCFM 10.1.3Data Center Fabric Manager

- upgrade license to SAN18B-R

- FICON Accelerator

NEW

SystemX Brocade FC HBAs (46M6049 / 46M6050)8G FC Single and Dual Port

SAN384B(2499-192)

16 to 192-ports1, 2, 4, 8, 10Gbps

FC, FICON

NEW

CNA FCoE/CEE Adapter (42C1820)10GE Dual Port CNA

IBM Converged Switch B32 (3758-B32)24x10GE FCoE + 8x 8G FC

NEW

* Planed GA is Q4/09

NEW


Thank you!

JÜRGEN KRESSIGBROCADE SAN Specialist - IBM [email protected]+49 171 5700 820

Date post:	25-Dec-2015
Category:	Documents
Upload:	innovite
View:	222 times
Download:	0 times

Brocade FCoE Storage Community Call

Documents