Netronome Cloud SDN Demo: How Hardware Acceleration Boosts Efficiency and Lowers TCO of Cloud...

© 2017 NETRONOME SYSTEMS, INC.

Netronome Agilio OVS Offload Acceleration Architecture

Agilio® SmartNIC Platform Accelerates Virtual

Switching Performance 5X

Nuage Networks from NokiaVirtual Services Platform

Mark Iskra, Nuage Networks

Edwin Peer, Netronome

© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.

CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION

Nokia Venture

Headquartered in Mountain View, CA

Additional R&D in Raleigh, NC and Antwerp, BE

Global Nuage technical organization

Global sales and support through NOKIA

Staffed by IP Routing and Virtualization Experts

Leading SDN/Network Virtualization market share

VPN

VPN

VPN

VPN

NetworkVirtualization

Internet

IP RoutingPolicy-based

Endpoint Attachment

SOFTWARE DEFINED NETWORKING

Introducing Nuage Networks



3

Nuage Networks EcoSystem



Nuage connects applications according to business policies

App 1 can only communicate with App 2 via a firewall

Nuage SDN

Faster time to deploy

Increase security

Freedom of workload, location and vendor

App 1 App 2

BranchBare Metal

Containers

Public

CloudsHypervisors

Nuage Networks Virtualized Services Platform (VSP)



Virtualized Services Directory (VSD)• Interface with orchestration platforms• Declarative Network Policies

Virtualized Services Controller (VSC)• Convert policies into networking protocols• Dynamically build SDN tunnels

Virtual Routing & Switching (VRS)• Open Source distributed switch and router• Nuage application for any workloads type

App 1 App 2

IP config,

TCP port,

etc.

BranchBare Metal Containers Public CloudsHypervisors




Device model

Overlay model (used in Nuage Networks)

Based on VXLAN Overlay SDN Model

Virtual Overlay Subnet


© 2017 NETRONOME SYSTEMS, INC. 7

Netronome Offers NFV Acceleration for COTS Servers

Delivers compelling TCO in NFV, public, private and hybrid cloud infrastructures

Low profile, less than 25W PCIe Gen3x8 Adapters

2 x 10/25/40GbE solutions

Agilio® CX SmartNICs

Relieving the NFV Performance Bottleneck and Reclaiming Server CPU Cycles

Brings the speed of software innovation to hardware

OpenStack-managed Open vSwitch, OVS Firewall and Contrail vRouter

Agilio® Server-Based

Networking Software


Nuage Data Plane with Netronome Agilio CX OVS Offload

Netronome Agilio CX SmartNICs available in 10GbE,

25GbE and 40GbE with OVS kernel acceleration

Nuage Virtual Routing and Switching (VRS) uses

OVS kernel

▶ Nuage VRS control plane - features

▶ OVS offload - performance without DPDK per-

core penalty

Offloads

▶ classification (OVS table match)

▶ packet processing (ACL, QoS, switch, route,

VXLAN tunnel header processing)

SR-IOV or XVIO (Virtio) VM connectivity

Any CMS

User

Kernel

SoftwareVSC

VSD

Agilio CX SmartNIC

Acceleration

OVS-vswitchd

OVS-kernel module

Offloaded vSwitchHardware


Netronome XVIO Technology Simplifies Deployment

Combines the best of open source technologies and server networking hardware

VM

Virtio

VM

Virtio

XVIO

Vhost-User Interface

Hardware Offload DPDK and SR-IOV

Networking

Applicatione.g. vSwitch,

vRouter

Hardware Datapath in SmartNIC

Agilio Hardware and Software

XVIO

SR-IOV DPDKVirtio • VM always sees standard Virtio interface

• MultiQ Architecture for High Performance

Complete VM Workload Mobility and Hardware Independence with Express Virtio (XVIO)


Netronome Datapath Offload of Nuage Networks VRS

Open vSwitch (VRS)

x86 User Space

x86 Kernel

Nuage

vSwitchd

Apps

Virtual Machine

Self

Learning

Exact Match

Flow Tracker

OVS

Kernel DP

Match/Act

Execute

Action

Agilio SmartNIC

Any CMS

OVS

Kernel DP

Match

OVS

Kernel DP

Match/Act

offloaded OVS Datapath

Miss

Hit

Miss

Miss

PCIe

Fast Path

VSD VSC

Open Flow

Virtio

4

1 2

3

5

XVIO

6

7

▶ Arriving VXLAN packets are matched against known flows in the SmartNIC

▶ Packets with known destination are Fast Path on the SmartNIC

▶ Payload is delivered to destination via XVIO

▶ Unmatched flows are resolved by OVS kernel module cache

▶ OVS kernel module contacts vSwitchd

▶ vSwitchd contacts VSC

▶ SmartNIC caches newly learned flows



Baseline DemoNo OVS Offloading



Bi-Directional Throughput Test Setup

KVM

VM11 VM12

KVM

VM21 VM22

Data/Mgmt Plane (192.168.50.0/24)

.201 .202V1 (Centos 7.2) V2 (Centos 7.2)

VXLANalubr0alubr0

NIC

VRSVRS

NICCPU

Load Generation (tx):Trafgen-DPDK

CPU

Listener (rx):Trafgen-DPDKOverlay

Throughput (Gbps)



KVM

VM11 VM12

KVM

VM21 VM22

Data/Mgmt Plane (192.168.50.0/24)

.201 .202V1 (Centos 7.2) V2 (Centos 7.2)

VXLANalubr0alubr0

NIC

VRSVRS

NIC

Load Generation (tx):Trafgen-DPDK Load Generator

Listener (rx):DPDK Packet MirrorLatency

(microsec)

Round Trip Latency Test SetupTrafgen samples timestamp change of returning packets



Stateless NIC Offloads:

Inner/outer checksum computation

Segmentation of large write requests

Some Encap/Decap

Line speed is achievable with iperf or netperf type load generators to 40Gbps and beyond

Small packets present a new challenge

4/27/2017

14

DPDK Application (trafgen) sending UDP datagramsbetween a pair of VMs.

Note: 80Gbps is the max bi-directional line speed

VXLAN With Only Stateless OffloadsLatency Non-Offloaded = 20-30 millisec



OVS Offload Demo


CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION 4/27/2017

16

Test Cases:

• Baseline—virtio with stateless

VXLAN offloads only

• VIRTIO--XVIO and OVS flows fully

offloaded

• SRIOV--VF to the VM and OVS

flows fully offloaded

Results:

• 5x-50x higher throughput with Agilio

• 18Mpps from 1 VM at 64B (CX)

• No CPU load with SRIOV and

minimal impact with XVIO (virtio)

Smart NIC VXLAN Offload for Nuage Networks VSP SDNLatency is 0.2 millisec (50-100x lower)



17

Test Cases:

• Baseline—virtio with stateless

VXLAN offloads only

• VIRTIO--XVIO and OVS flows fully

offloaded

• SRIOV--VF to the VM and OVS

flows fully offloaded

Results:

• 5x-50x higher throughput with Agilio

• 18Mpps from 1 VM at 64B (CX)

• No CPU load with SRIOV and

minimal impact with XVIO (virtio)

Smart NIC VXLAN Offload for Nuage Networks VSP SDNThroughput increases with larger packet sizes even though PPS is lower



Active Flows Throughput Test Setup

KVM

VM11 VM12

KVM

VM21 VM22

Data/Mgmt Plane (192.168.50.0/24)

.201 .202V1 (Centos 7.2) V2 (Centos 7.2)

VXLANalubr0alubr0

NIC

VRSVRS

NICCPU

Load Generation (tx/rx):Trafgen-DPDKUsing N Ports

CPU

Listener (tx/rx):Trafgen-DPDKUsing N Port

OverlayThroughput (Gbps)



19

Nuage-OVS-vswitchd

OVS-kernel module

Netronome vSwitch NIC

Any CMS

User

Kernel

Software

HardwareVSC

VSD

1

2

3

1 2 3

VXLAN Performance vs Active Flows Single virtio VM pair, SRIOV VMs would be higher throughput



Live MigrationTestbed

KVM

VM11

KVM

VM22

Data/Mgmt Plane (192.168.50.0/24)

.201 .202V1 (Centos 7.2) V2 (Centos 7.2)

VXLANalubr0alubr0

NIC

VRSVRS

NICCPU

Load Generation (tx):Trafgen-DPDK

CPU

Listener (rx):Trafgen-DPDK

VMOBI

Throughput (Gbps)

SSH

© 2017 NETRONOME SYSTEMS, INC.

Thank you

Date post:	23-Jan-2018
Category:	Technology
Upload:	nuage-networks
View:	938 times
Download:	1 times