+ All Categories
Home > Documents > Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN...

Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN...

Date post: 22-Jun-2018
Category:
Upload: nguyenthuy
View: 242 times
Download: 5 times
Share this document with a friend
86
Building Data Centre Networks with VXLAN BGP EVPN
Transcript
Page 1: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Building Data CentreNetworks with

VXLAN BGP EVPN

Page 2: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Agenda

Introduction to Data Centre Fabrics

VXLAN with BGP EVPN

Overview

• Underlay

• Control & Data Plane

• Multi-Tenancy

Page 3: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Introduction to DataCentre Fabrics

Page 4: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Data Centre “Fabric” Journey (Standalone)STP

VPC

FabricPath

VXLAN

MAN/WA

N

VXLAN

/EVPN

FabricPath

/BGP

MAN/WAN

MAN/WAN

Page 5: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Data Centre Fabric Properties

Extended Namespace

Scalable Layer 2 Domains

Integrated Route & Bridge

Multi-Tenancy

Page 6: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Overlay Based Data Centre Fabrics

Desirable Attributes:

Mobility

Segmentation

Scale

Automated & Programmable

Abstracted consumption models

Full Cross Sectional Bandwidth

Layer-2 + Layer-3 Connectivity

Physical + Virtual

RR RR

Page 7: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Overlay Based Data Centre: Edge Devices

Network Overlays Hybrid OverlaysHost Overlays

Physical and Virtualoverlays which are terminated on the network nodes

VV

V

VV

V

VXLAN encapsulation or overlay on the host

Page 8: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Data Centre Fabric Properties

Any subnet, anywhere, rapidly

Reduced Failure Domains

Extensible Scale & Resiliency

Profile Controlled Configuration

RR RR

Page 9: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Spine/Leaf Topologies

High Bi-Sectional Bandwidth

Wide ECMP: Unicast or Multicast

Uniform Reachability, DeterministicLatency

High Redundancy: Node/LinkFailure

Line rate, low latency, for all traffic

Page 10: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Variety of Fabric SizesMore Spine, More Bandwidth, More Resiliency

• if we need more bandwidth or more

resiliency, we can add more spines on the

top.

• by adding more of the spine switches we

get more ports down to the leaf switches

and achieve resiliency

• when we get more leaf and do that

horizontal scale out, I get more ports and

I get more capacity, so I can add more

endpoints

Page 11: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

VXLAN with BGP EVPN

Page 12: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Agenda

Introduction to Data Centre Fabrics

VXLAN with BGP EVPN

• Overview

• Underlay

• Control & Data Plane

• Multi-Tenancy

Page 13: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 14: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Overview

Introducing VXLAN

• Traditionally VLAN is expressedover 12 bits (802.1Q tag)

• Limits the maximum number ofsegments in a Data Centre to 4096VLANs

• VXLAN leverages the VNI field witha total address space of 24 bits• Support of ~16M segments

• The VXLAN Network Identifier(VNI/VNID) is part of the VXLANHeader

CRC(new)

UDP(8)

DMAC SMAC 802.1Q Etype CRCPayload

DMAC SMAC Payload

Page 15: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 16: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Data Centre Fabric Properties

Extended Namespace

Scalable Layer-2 Domains

Integrated Route and Bridge

Multi-Tenancy

Page 17: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

• Layer 2

• Layer 3

• Layer 2 and Layer 3

Tunnel EncapsulationUnderlay Transport

Network

Control Plane

• Peer Discovery mechanism

• Route Learning and Distribution

– Local Learning

– Remote Learning

Data Plane

• Overlay Layer 2/Layer 3 Unicast traffic

• Overlay Broadcast, Unknown Unicast,Multicast traffic (BUM traffic) forwarding

– Ingress Replication

– Multicast

Understanding Overlay Technologies

Overlay Services

Page 18: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Why VXLAN?

• “Standards” based Overlay (RFC 7348) which

• flood and learn segments on top of an IP routed

segment

• gives me multiple different things:

1) Segmentation

2) IP mobility

3) Scale

Page 19: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 20: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 21: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Getting the Puzzle Together!

DrivingStandards based

Overlay-Evolution with

VXLAN BGPEVPN

Page 22: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

What is VXLAN with BGP EVPN?

• multiprotocol BGP with the address family is define as “Ethernet VPN”

• allows me to now use a BGP based control plan

• allows me to have layer 2 and layer 3 information in the BGP

• Forwarding decision based on Control-Plane

• Integrated Routing/Bridging (IRB) for Optimized Forwarding in the Overlay

• Multi-Tenancy At Scale

Page 23: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

EVPN – Ethernet VPN

Control-

Plane

Data-

Plane

Multi-Protocol Label Switching(MPLS)

draft-ietf-l2vpn-evpn

EVPN MP-BGP - RFC 7432

Provider Backbone Bridges

(PBB)draft-ietf-l2vpn-pbb-evpn

Network Virtualisation Overlay(NVO)

draft-ietf-bess-evpn-overlay

EVPN over NVO Tunnels (ie VXLAN) for Data CentreFabric encapsulations

Provides Layer-2 and Layer-3 Overlays over simple IP

Networks

Page 24: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Getting the Puzzle Together!

Now the Puzzle Is Really about:• Having an underlay Which Scales and Allows Me to Do Network Transport

between the VTEP edge Devices. • t's about the Overlay Which Get Facilitated by VXLAN Encapsulation • It's Also the Control Plane Which Is the BGP-EVPN Piece• Last but Not Least, Integrated route and Bridge Which Allows Me to Do

Bridging and routing at the Same Time from the Edge Devices

Page 25: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Getting the Puzzle Together!Optimised Networks with VXLAN

Page 26: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Agenda

Introduction to Data Centre Fabrics

VXLAN with BGP EVPN

• Overview

• Underlay

• Control & Data Plane

• Multi-Tenancy

Page 27: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Deployment Considerations

MTU and Overlays

Unicast Routing Protocol and IPAddressing

Multicast for BUM* TrafficReplication

*BUM: Broadcast, Unknown Unicast & Multicast

Page 28: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Un

der

lay

50

(54

)B

yte

so

fO

ver

hea

d

Over

lay

VXLAN adds 50 Bytes (or 54 Bytes)to the Original Ethernet Frame

Avoid Fragmentation by adjustingthe IP Networks MTU

Data Centres often require JumboMTU; most Server NIC do supportup to 9000 Bytes

Using a MTU of 9216* Bytesaccommodates VXLAN Overheadplus Server max. MTU

MTU and VXLAN

Outer MAC Header

Outer IP Header

UDP Header

VXLAN Header

Original Layer-2 Frame

Page 29: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Building your IP Network – Routing Protocols; OSPF

• OSPF – watch your Network type!

• Network Type Point-2-Point (P2P)

Preferred (only LSA type-1)No DR/BDR election

Suits well for routed interfaces/ports

(optimal from a LSA Databaseperspective)

• Full SPF calculation on Link Change

• Network Type Broadcast• Suboptimal from a LSA Database

perspective (LSA type-1 & 2)

DR/BDR electionAdditional election and Database

Overhead

Page 30: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Building your IP Network – Routing Protocols; IS-IS

• IS-IS – what was this CLNS?

Independent of IP (CLNS)

Well suited for routed interfaces/ports

No SPF calculation on Link change;only if Topology changes

Fast Re-convergence

Not everyone is familiar with it

*CLNS: Connection-Less Network Service

Page 31: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Building your IP Network – Routing Protocols; eBGP

• eBGP – Service Provider style

Two Different Models• Two-AS• Multi-ASBGP is a Distance Vector• AS* are used to calculate the Path

(AS_Path)

If Underlay is eBGP, your Overlay

becomes eBGP

Page 32: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Building your IP Network – Routing Protocols; eBGP

• eBGP – TWO-AS, yes it works!

• Total of 8 eBGP Peering (with 4Spine)• eBGP peering for Underlay-Routing based

on physical interface

• 4 Spines = 4 BGP Peering per Leaf

• Advertise all Infrastructure Loopbacks

• eBGP peering for Overlay-Routing(EVPN)

• Loopback to Loopback Peering

• 4 Spines = 4 BGP Peering

• Requires some BGP config knobs• Disable BGP AS-Path check• Next-Hop needs to be Unchanged• Retain all Routes on Spine (not a RR)

AS#65500

Page 33: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Building your IP Network – Routing Protocols; eBGP

• eBGP – Multi-AS

• Total of 8 eBGP Peering (with 4Spine)• eBGP peering for Underlay-Routing based

on physical interface

• 4 Spines = 4 BGP Peering per Leaf

• Advertise all Infrastructure Loopbacks

• eBGP peering for Overlay-Routing(EVPN)

• Loopback to Loopback Peering

• 4 Spines = 4 BGP Peering

• Requires some BGP config knobs• Next-Hop needs to be Unchanged• Retain all Routes on Spine (not a RR)

AS#65500

Page 34: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Multicast Enabled Underlay

May use PIM-ASM or PIM-BiDir (Different hardware has different capabilities)

• Spine and Aggregation Switches make good Rendezvous-Point (RP) Locations in

Topologies

• Reserve a range of Multicast Groups (Destination Groups/DGroups) to service the Overlay

and optimise for diverse VNIs

• In Spine/Leaf topologies with lean Spine

Use multiple Rendezvous-Point across the multiple Spines

Map different VNIs to different Rendezvous-Point for simple load balancing measure

Use Redundant Rendezvous-Pint

• Design a Multicast Underlay for a Network Overlay, Host VTEPs will leverage this Network

Multicast Mode

Nexus 1000v

IGMP v2/v3

Nexus 3000

PIM ASM

Nexus 5600

PIM BiDir

Nexus 7000/F3

PIM ASM / PIM BiDir

Nexus 9000

PIM ASM

ASR 1000CSR 1000

PIM BiDir

ASR 9000

PIM ASM / PIM BiDir

Page 35: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

• Multi-Destination Traffic (Broadcast, Unknown Unicast, etc.) needs to bereplicated to ALL VTEPs serving a given VNI• Each VTEP is Multicast Source & Receiver

For a given VNI, all VTEPs act as a Sender and a Receiver

Head-End Replication will depend on hardware scale/capability

Resilient, efficient, and scalable Multicast Forwarding is highly desirable

Choose the right Multicast Routing Protocol for your need (type/mode)Use redundant Multicast Rendezvous Points (Spine/Aggregation generally preferred)99% percent of Overlay problems are in the Underlay (OTV experience)

To Remember - Multicast Enabled Underlay

Page 36: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Agenda

Introduction to Data Centre Fabrics

VXLAN with BGP EVPN

• Overview

• Underlay

• Control & Data Plane

• Multi-Tenancy

Page 37: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Multiprotocol BGP (MP-BGP) Primer

RR RR

V2V1

V3

BGP Route-ReflectorRR

iBGP Peering*

*eBGP supported without BGP Route-Reflector

Multiprotocol BGP (MP-BGP)

Extension to Border GatewayProtocol (BGP) - RFC 4760

• VPN Address-Family:

• Allows different types of addressfamilies (e.g. VPNv4, VPNv6, L2VPNEVPN, MVPN)

• Information transported across singleBGP peering

Page 38: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Imp Route-Target 65500:50000 (auto)Route-Target 65500:50000 (auto)

Multiprotocol BGP (MP-BGP) Primer

• VPN segmentation for tenant routing(Multi-Tenancy)

• Route Distinguisher (RD)

• 8-byte field of VRF parameters

• value to make VPN prefix unique:

• RD + VPN prefix

Page 39: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Multiprotocol BGP (MP-BGP) Primer

• Cisco’s VXLAN/EVPN does provideautomated Route Distinguisher (RD) VRF Info

Page 40: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 41: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 42: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 43: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 44: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 45: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 46: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN
Page 47: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Subnet Route Advertisement

• IP Prefix Redistribution

• From “Direct” (connected), “Static” ordynamically learned Routes

• VTEP V1 advertises local Subnetthrough redistribution of “Direct”(connected) routes

• IP Prefix, IP Prefix Length, and L3VNI

• Additional route attributesadvertised

• MPLS Label (L3VNI)

• Extended Communities

Page 48: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Subnet Route Advertisement

• If multiple VTEP announce same IPPrefix, Equal Cost Multipath (ECMP)will apply

• VTEP V1 advertises local Subnetthrough redistribution of “Direct”(connected) routes

• IP Prefix, IP Prefix Length, and L3VNI

• Additional route attributesadvertised

• MPLS Label (L3VNI)

• Extended Communities

Page 49: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Subnet Route Advertisement

• IP Prefix Learning

• via BGP with VRF-Lite (Inter-AS

Option A)

• via LISP on Nexus 7000/7700

• via other routing protocol (static ordynamic)

VTEP V1 participated in externalPeering (LISP, BGP, OSPF etc.)and advertises learned IP Prefixesinto the Fabric

• IP Prefix

• IP Prefix Length

• L3VNI

Page 50: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

ARP SuppressionVXLAN/EVPN

Host AMAC_A / IP_A

1

Page 51: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

ARP Handling on Lookup “Miss” (1)VXLAN/EVPN

1

2

Page 52: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

ARP Handling on Lookup “Miss” (2)VXLAN/EVPN

RR RR

Page 53: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Packet Forwarding (Bridge)VXLAN/EVPN

RR

Page 54: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Host AMAC_A / IP_A

Packet Forwarding (Route)VXLAN/EVPN

RR

1

Page 55: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Packet Forwarding (Route) – Silent HostVXLAN/EVPN

Host AMAC_A / IP_A Host F

MAC_F, IP_F

Page 56: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Data Centre Fabric Properties

Extended Namespace

Scalable Layer-2 Domains

Integrated Route and Bridge

Multi-Tenancy

Page 57: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

• a network addressing and

routing methodology

datagrams sent from a singlesender to the topologically

nearest node

group of potential receivers,all identified by the samedestination address

Anycast – One-to-Nearest Association

RR RR

Page 58: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Distributed IP Anycast Gateway

• Distributed Inter-VXLAN Routing at

Access Layer (Leaf)• All Leafs share same gateway IP and

MAC Address for a given Subnet

• Gateway is always active

• no redundancy protocol, helloexchange etc.

• Distributed state - Smaller ARPtables• Only local attached End-Points

(Servers)

RR RR

SVI 100

SVI 200

SVI 100

SVI 200

SVI 100

SVI 200

SVI 100

SVI 200

SVI 100

SVI 200

Page 59: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Distributed IP Anycast Gateway

Page 60: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Integrated Routing and Bridging (IRB)

VXLAN/EVPN based overlays follow

two slightly different IntegratedRouting and Bridging (IRB) semantics

• AsymmetricUses an “asymmetric path” from the•Host towards the egressing port of theVTEP vs. the way back

• Symmetric*Uses an “symmetric path” from the•Host towards the egressing port of theVTEP vs. the way back

RR RR

Page 61: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Consistent Configuration

• Logical Configuration (VLAN, VRF,VNI) consistently instantiated on ALLLeafs

• Optimal for Consistency

• Every VLAN/VNI Everywhere

• Sub-Optimal for Scale

• Instantiates Resources (VLAN/VNI)even if no End-Point uses it

RR RR

SVI 100

SVI 200

SVI 300

SVI 100

SVI 200

SVI 300

SVI 100

SVI 200

SVI 300

SVI 100

SVI 200

SVI 300

SVI 100

SVI 200

SVI 300

SVI 100

SVI 200

SVI 300

Page 62: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Scoped Configuration

• Logical Configuration (VLAN, VRF,VNI) scoped to Leafs with respectiveconnected End-Points

• Optimal for Scale• Instantiates Resources (VLAN/VNI)

where End-Points are connected

• Consistency with End-Points• Configuration Consistency depends

on End-Points

RR RR

SVI 100

SVI 200

SVI 200

SVI 300

SVI 100

SVI 100

SVI 200

SVI 300

SVI 300

SVI 200

Page 63: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

SV

I3

00

SV

I2

00

SV

I2

00

SV

I3

00

Asymmetric IRB

Similar to todays Inter-VLAN routing

Requires to follow a consistentconfiguration of VLAN and L2VNIacross all Switches

Post routed traffic will leveragedestination Layer 2 Segment(L2VNI), same as for bridged traffic

RR RR

Page 64: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

SV

I2

00

SV

I3

00

Asymmetric IRB

RR

Page 65: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Asymmetric IRB

L2VNI 30001

L2VNI 30002

Page 66: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

SV

I3

00

SV

I2

00

SV

I2

00

SV

I3

00

Symmetric IRB

Similar to Transit Routing Segments

Scoped Configuration ofVLAN/L2VNI; only required whereEnd-Points (Server) reside

New VNI (L3VNI) introduced pervirtual routing and forwarding (VRF)context

Routed traffic uses transit VNI(L3VNI), while bridged traffic usesL2VNI

RR RR

Page 67: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

SV

I3

00

SV

I2

00

SV

I2

00

SV

I3

00

Symmetric IRB

RR RR

Page 68: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Symmetric IRB

L3VNI 50001 (VRF)

Page 69: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Data Centre Fabric Properties

Extended Namespace

Scalable Layer-2 Domains

Integrated Route and Bridge

Multi-Tenancy

Page 70: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Introduction to Data Centre Fabrics

VXLAN with BGP EVPN

• Overview

• Underlay

• Control & Data Plane

• Multi-Tenancy

Agenda

Page 71: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

A mode of operation, where multiple independent instances (tenant)operate in a shared environment.

Each instance (i.e. VRF/VLAN) is logically isolated, but physically

integrated.

What is Multi-Tenancy

Page 72: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Where can we apply Multi-Tenancy

Multi-Tenancy at Layer-2

Per-Switch VLAN-to-VNI mapping

Per-Port VLAN Significance

Multi-Tenancy at Layer-3

VRF-to-VNI mapping

MP-BGP for scaling with VPNs

Page 73: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Layer-2 Multi-Tenancy

Page 74: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Host1MAC: AA:AA:AA:AA:AA:AA

IP: 192.168.1.11

VLAN 100

VXLAN VNI 30001

Host3MAC: CC:CC:CC:CC:CC:CC

IP: 192.168.1.33

VLAN 100

VXLAN VNI 30001

V

VLAN 100

V

VLAN 100

Layer-2 Multi-Tenancy – Bridge Domains

VXLAN Overlay

(VNI 30001)

Leaf

Bridge Domain

Page 75: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Layer-2 Multi-Tenancy – Bridge Domains

VXL

Page 76: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

VLAN-to-VNI Mapping

Host1MAC: AA:AA:AA:AA:AA:AA

IP: 192.168.1.11

VLAN 100

VXLAN VNI 30001

Host3MAC: CC:CC:CC:CC:CC:CC

IP: 192.168.1.33

VLAN 100

VXLAN VNI 30001

Leaf

V

VLAN 100

V

VLAN 100

VXLAN Overlay(VNI 30001)

Host2MAC: BB:BB:BB:BB:BB:BB

IP: 192.168.1.22

VLAN 100

VXLAN VNI 30001

Page 77: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Host1MAC: AA:AA:AA:AA:AA:AA

IP: 192.168.1.11

VLAN 100

VXLAN VNI 30001

Host3MAC: CC:CC:CC:CC:CC:CC

IP: 192.168.1.33

VLAN 200

VXLAN VNI 30001

V

VLAN 200

Per-Switch VLAN-to-VNI Mapping

VXLAN Overlay(VNI 30001)

Leaf

V

VLAN 100

Host2MAC: BB:BB:BB:BB:BB:BB

IP: 192.168.1.22

VLAN 100

VXLAN VNI 30001

Page 78: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Host1MAC: AA:AA:AA:AA:AA:AA

IP: 192.168.1.11

VLAN 100

VXLAN VNI 30001

Host3MAC: CC:CC:CC:CC:CC:CC

IP: 192.168.1.33

VLAN 300

VXLAN VNI 30001

V

VLAN 100 VLAN 300

Per-Port VLAN-to-VNI Mapping

VXLAN Overlay(VNI 30001)

Leaf

V

Host2MAC: BB:BB:BB:BB:BB:BB

IP: 192.168.1.22

VLAN 200

VXLAN VNI 30001

VLAN 200

Page 79: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Layer-3 Multi-Tenancy

Page 80: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Layer-3 Multi-Tenancy – VRF-VNI or L3VNI

VRF-B(VNI 50002)

Routing

VRF-A(VNI 50001)

Routing

Page 81: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Layer-3 Multi-Tenancy – VRF-VNI or L3VNI

VRF-A VRF-B

Page 82: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Layer-3 Multi-Tenancy – VRF-Lite

VLAN 1001EthernetVLAN 1002

Page 83: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Layer-3 Multi-Tenancy – MPLS L3VPN

VPN Label “Blue”

MPLSVPN Label “Red”

Page 84: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

V

SVI 300SVI 200SVI 100

Host1

MAC: AA:AA:AA:AA:AA:AA

IP: 192.168.1.11 (VRF-A)

VLAN 100

VXLAN VNI 30001

Host2

MAC: BB:BB:BB:BB:BB:BB

IP: 10.10.10.22 (VRF-B)

VLAN 200

VXLAN VNI 30002

Host3

MAC: CC:CC:CC:CC:CC:CC

IP: 172.16.1.33 (VRF-B)

VLAN 300

VXLAN VNI 30003

Host4

MAC: DD:DD:DD:DD:DD:DD

IP: 10.44.44.44 (VRF-A)

VLAN 400

VXLAN VNI 30004

SVI 400

Layer-3 Multi-Tenancy – VXLAN EVPN

L3VNI 50001

VXLANL3VNI 50002

Leaf

V

Page 85: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Integrated Route & Bridge + Multi-Tenancy

Page 86: Building Data Centre Networks with VXLAN BGP EVPN Data Centre Networks...EVPN –Ethernet VPN Control-Plane Data-Plane Multi-Protocol Label Switching (MPLS) draft-ietf-l2vpn-evpn EVPN

Integrated Route & Bridge + Multi-Tenancy


Recommended