+ All Categories
Home > Technology > Thu 430pm solarflare_tolley_v1[1]

Thu 430pm solarflare_tolley_v1[1]

Date post: 04-Dec-2014
Category:
Upload: bruce-tolley
View: 329 times
Download: 0 times
Share this document with a friend
Description:
Building Smarter Networks for Big Data: It Is Not Just Fatter Pipes. Presented at the Hadoop Summit in San Jose
11
Slide 1 | PROPRIETARY AND CONFIDENTIAL Copyright © 2011 Solarflare Communications, Inc. All Rights Reserved. It’s Not Just Fatter Pipes Building Smarter Networks
Transcript
Page 1: Thu 430pm solarflare_tolley_v1[1]

Slide 1 | PROPRIETARY AND CONFIDENTIALCopyright © 2011 Solarflare Communications, Inc. All Rights Reserved.

It’s Not Just Fatter PipesBuilding Smarter Networks

Page 2: Thu 430pm solarflare_tolley_v1[1]

Slide 2 | PROPRIETARY AND CONFIDENTIAL

Introducing Solarflare

• High-performance software and hardware for 10GbE server networking

• Mission-critical applications– Securities and trading– HPC– Storage– Cloud/Web 2.0

• Leader in financial services• Partnerships with Arista,

Cisco, Couchbase, IBM, Juniper, Redhat, Oracle, VMware

“Solarflare’s product, EnterpriseOnload is a robust, rigorously tested and fully supported solution that addresses our demanding support and service level requirements. In addition to providing the highest-performance, lowest-latency hardware, Solarflare’s unique and innovative application acceleration software can be used to deploy quickly without any need to re-write our applications.”

Andrew BachSenior Vice President of Network Services for NYSE Euronext

Page 3: Thu 430pm solarflare_tolley_v1[1]

Slide 3 | PROPRIETARY AND CONFIDENTIAL

Data VolumeGrowing 44x

2020: 35.2 Zettabytes

2010:1.2

Zettabytes

Data is Growing Faster than Moore’s Law

Business Analytics Requires a New Approach

Source: IDC Digital Universe Study, sponsored by EMC, May 2010

The Network is the Bottleneck

IDC Digital Universe

Study 2011

Page 4: Thu 430pm solarflare_tolley_v1[1]

Slide 4 | PROPRIETARY AND CONFIDENTIAL

But Computing is More than Just Moore’s Law

• SandyBridge-Based Servers/ Aka Romley Motherboards

• Intel Integrated I/0• Reduced bottlenecks• Increase performance

up to 80%

Up to 4 channels DDR3 1600 Mhz memory

Up to 8 coresUp to 20 MB cache

Integrated PCI Express* 3.0Up to 40 lanes per socket

[ Transactions per second ]

Xeon 5600

Series

Xeon 2600

Family

Can more than DoubleI/O Performance1

Direct Data I/O (DDIO)

Page 5: Thu 430pm solarflare_tolley_v1[1]

Slide 5 | PROPRIETARY AND CONFIDENTIAL

SFN6122F & Xeon E5-2600 Deliver Winning Combination

• SFN6122F single-stream latency is superb over all message rates on Romley platforms, right up to the point of CPU core utilization

• Ultra-low jitter (sub-micro at 99Percentile)

• Benefits from Intel® Data Direct I/O (DDIO) and chipset IO – memory bandwidth

• Message rate headroom – 20Mpps with 4x sfnt-streams

sfnt-stream / openonload-201109-u2

“Westmere” = 2x Xeon 5687 (3.6GHz)

“Romley” = 2x E5-2687W (3.1GHz) – DDR 1333

Page 6: Thu 430pm solarflare_tolley_v1[1]

Slide 6 | PROPRIETARY AND CONFIDENTIAL

Standard Server I/O Networking: RSS

• RSS spreads flows randomly over cores

• Packets within a flow go to same core

• Works well when– Connections

are long lived– One thread per

connection– And the thread

happens to run on the right core

– Great for network benchmarks

NIC

VNIC VNIC VNICVNIC

receive-side scaling

core0 core1 core2 core3

App App App App

ISR ISR ISR ISR

Page 7: Thu 430pm solarflare_tolley_v1[1]

Slide 7 | PROPRIETARY AND CONFIDENTIAL

Smarter Server I/O Networking: Flow Affinity

• Hardware deterministically directs flows to the ideal core for handling the load

• Google developed Receive packet steering (RPS)

• Solarflare developed Accelerated RFS for multiqueue hardware

• Supported today on Solarflare adapters

NIC

VNIC VNIC VNICVNIC

receive-side scaling

core0 core1 core2 core3

App App App App

ISR ISR ISR ISR

Page 8: Thu 430pm solarflare_tolley_v1[1]

Slide 8 | PROPRIETARY AND CONFIDENTIAL

Cisco and Solarflare Achieve Dramatic Latency Reductions for Interactive Web 2.0 Applications

Page 9: Thu 430pm solarflare_tolley_v1[1]

Slide 9 | PROPRIETARY AND CONFIDENTIAL

Big Data Management Solution

April 9, 2023 © 2012 Zettaset, Inc. | Proprietary and Confidential

9

I/O Network Interface

CPU Big Data Management

OS

3 - ioDrive2 Duo

1.2TB ioMemory

3 GBytes/sec

HadoopFramework

SFN5122FSFP + Dual Port 10GbE

Server Adapter2 - X5690 6 Core

12 Threads, 3.4 GHz96GB RAM V 1.0

Enterprise 6.2

• Hyve BigD series8 from Synnex

• Turnkey appliance-based big data management solution

• Fully integrated, optimized, and easily deployed, enabling rapid implementation of a Hadoop environment in days rather than months

Page 10: Thu 430pm solarflare_tolley_v1[1]

Slide 10 | PROPRIETARY AND CONFIDENTIAL

END

Page 11: Thu 430pm solarflare_tolley_v1[1]

Slide 11 | PROPRIETARY AND CONFIDENTIAL

Other Tuning Tips

• RSS Spreading– Changing the default RSS spreading so that the card uses an RX queue per CPU

core. This is done by setting the driver’s module parameter rss_cpus=cores. See section “Receive Side Scaling (RSS)” on page 193-194 for more details. If you can, we also suggest you disable the irqbalancer service before doing this, as the irqbalancer tends to undo the good work of spreading the networking interrupts over the available CPU cores (see page 196)

• Enable LRO– Double check LRO is enabled using ethtool. As mentioned RHEL 6 libvirtd daemon

can cause this to be disabled. See “TCP Large Receive Offload (LRO)” on page 191-192 for details of LRO and how to change RHEL6 behaviour

• Interrupt Moderation– IF (and only if) you think the benchmark is latency sensitive then we suggest

disabling interrupt moderation. The driver by default uses adaptive interrupt moderation and tries to tune based on traffic patterns. However, if you know you have a ping/pong – transactional app then helps to disable this completely (see page 189 – “ethtool –C <ethX> rx-usecs-irq 0 adaptive-rx off”). BUT if you are streaming large blocks of storage data between the servers then don’t do this - the default is best.

 


Recommended