Windows Server 2012 Networking Performance and ManagementPrabu RambadranProduct Marketing ManagerMicrosoft Corporation

Beyond Virtualization

Windows Server 2012 offers a dynamic, multi-tenant infrastructure that goes beyond virtualization to provide maximum flexibility for delivering and connecting to cloud services.

Modern Workstyle, Enabled

Windows Server 2012empowers IT to provide users with flexible access to data and applications from virtually anywhere on any device with a rich user experience, while simplifying management and helping maintain security, control and compliance.

The Power of Many Servers, the Simplicity of One

Windows Server 2012 offers excellent economics by integrating a highly available and easy to manage multi-server platform with breakthrough efficiency and ubiquitous automation.

Every App, Any Cloud

Windows Server 2012 is a broad, scalable and elastic server platform that gives you the flexibility to build and deploy applications and websites on-premises, in the cloud and in a hybrid environment, using a consistent set of tools and frameworks.

Resource Metering

A two-tenant environment built with Hyper-V in Windows Server 2012

Basic model of Resource Metering

PowerShell CmdletsEnable resource Metering:Get-VM -ComputerName <Host Name> | Enable-VMResourceMetering

Get VM metering data:Get-VM -ComputerName <Host Name> -Name <VM Name> | Measure-VM

IP Address Management(IPAM)

.

.

.

.

.

.

.

.

WS 2012 IPAM

WS 2012 IPAM

Network discoveryNetwork discovery

Multi-server mgmt

(MSM)

Multi-server mgmt

(MSM)

Visibility & auditVisibility & audit

..

..Automatic discovery of

DC, DHCP and DNS servers, and dynamic IP

addresses in use

Centralized configuration and update of MS DHCP/DNS

servers

Track and audit changes and provide real-time

view of status

Address space mgmt

(ASM)

Address space mgmt

(ASM)

Organize, assign, monitor and manage static and dynamic

IPv4/v6 addresses. Integration with SCVMM

In-box solution that complements – and seamlessly integrated with – MS DHCP and DNS offerings

Suitable for MS DHCP/DNS customers looking for an economic, capable and scalable IPAM solution

WS08; WS08 R2 & SPs; WS 2012

Win 8 (RSAT) & WS 2012

WS 2012 in-box

Agentless architecture

Distributed deployment, scale, and DR

IPAM

Performance Features and Improvements

• Processor. One physical processor, which can consist of one or more nodes. A physical processor is the same as a package, a socket, or a CPU.

• Non-uniform memory architecture (NUMA) node. A set of logical processors and cache that are close to one another.

• Core. One processing unit, which can consist of one or more logical processors.

• Logical processor (LP). One logical computing engine from the perspective of the operating system, application, or driver. In effect, a logical processor is a thread.

• Kernel Group. A set of up to 64 logical processors.• Affinity. A preference indicated by a thread, process, or

interrupt for operation on a particular processor, node, or group.

Processor or SocketProcessor or Socket

NUMA NodeNUMA Node

Core Core

LP LP LP

Kernel Group (KGroup)Kernel Group (KGroup)

Processor or SocketProcessor or Socket

NUMA NodeNUMA Node

Core Core

LP LP LP

Processor or SocketProcessor or Socket

NUMA NodeNUMA Node

Core Core

LP LP LP

Processor or SocketProcessor or Socket

NUMA NodeNUMA Node

Core Core

LP LP LP

Processor or SocketProcessor or Socket

NUMA NodeNUMA Node

Core Core

LP LP LP

• Latency. The time required for an operation to complete. Lower is better.

• Scalability. The ability to adapt to increasing demand on system resources. Higher is better.

• Throughput. The amount of data transferred or processed in a given time period. Higher is better.

• Path Length. The number of CPU cycles divided by the throughput. Lower is better.

• Variability / Jitter. Fluctuation in throughput and/or latency. Lower is better.

L

S

T

P

J

• RSC can help by coalescing multiple inbound packets into a larger buffer and effectively reduce per packet CPU cost

• Preliminary data shows up to a 20% reduction in CPU cycles depending on the workload

• All inbox 10G network adapters support the feature and have it on by default

RSC: Multiple Inbound Packets

Coalesced to reduce CPU load

Receive Segment Coalescing (RSC)

• Use RSS to distribute the receive network traffic either across multiple processors or multiple NUMA nodes

• IT Pros should use new Power Shell cmdlets to control RSS behavior based on their workload characteristics

DynamicStatic

NUMA aware

NonNUMA

Profile 1

Profile 2Profile 3(default)

Profile 0 (like WS08

R2)

NIC with 8 RSS queues

Node 0 Node 1 Node 2 Node 3

Incoming Packets

New RSS profiles improve scalability on multi-node servers by distributing TCP/UDP receive traffic across nodes

Receive Side Scaling (Continued)

Single Process

Hardware: 40LPs, 4 NUMA nodes , 10GigE, 128GB RAMWorkload: mixed Web scenario

Note: Measurements reflect release defaults

50%

201%

Multiple Processes (2 and 4)

43%

115%

• Use VMQ to dynamically distribute the receive network traffic across multiple VMs based on destination and network load

• Most inbox 10Gig Ethernet adapters support the feature which is enabled by default

Network IO path without VMQ Network IO path with VMQ

• Registered I/O (RIO) delivers low latency by “pinning” the application memory and reduces CPU cost

• RIO improves predictability with message latency (jitter)

• Example APIs: RIORegisterBuffer and RIOReceive

Winsock Application Winsock Application (E.g. Using localhost as TCP destination)(E.g. Using localhost as TCP destination)

AFDAFD

TCP/IPTCP/IP

NDISNDIS

kernel

user

Win08 R2 Loopback Path

Windows 2008 R2

Windows Server 2012 Loopback Path

New: Shorter Path

• Customer should use new IOCTL SIO_LOOPBACK_FAST_PATH socket option to take new shorter path

• Both sides of connection must set new option but can’t have SO_OOBINLINE, TCP_EXPEDITED_1122, or TCP_STDURG socket options

TCP Loopback fast path

• IT Pro wants to fine tune their system for low latency application and minimize jitter

• Best Practices include:• Disable C-states from BIOS• Set Power Policy to High Performance• Use powercfg utility

• Disable NIC Interrupt Moderation setting• Disable Flow Control• Disable Receive Side Scaling• Disable Receive Segment Coalescing (RSC)• Use thread affinity in Task Manager to

partition work by nodes

• Check out http://technet.microsoft.com/en-us/library/hh831415.aspx

Performance Analysis and Tools

Original Setting is derived from system tuning, empirical

evidence

EXAM

PLE R

ULE

Identifying performance bottlenecks using SPA 3.0

EVERYTHING is configurable through PowerShell

Performance Metric

Loopback Fast Path

Registered I/O (RIO)

Large Send Offload (LSO)

Receive Segmentation Offload (RSC)

Receive Side Scaling (RSS)

Virtual Machine Queues (VMQ)

Remote DMA (RDMA)

Single Root I/O Virtual(SR-IOV)

Lower End-to-End Latency

X X X X

Higher Scalability

X X X

Higher Throughput

X X X X X X X X

Lower Path Length

X X X X X X

Lower Variability

X

Sample Fill

Sample Fill

Sample Fill

Sample Fill

Sample Fill

Sample FillSample Fill

Video Title

WSV321: Windows PowerShell Crash CourseWSV307: Windows Server 2012 IP Address ManagementWSV314: Windows Server 2012 NIC Teaming and Multichannel SolutionsVIR303: An Overview of Hyper-V Networking in Windows Server 2012VIR305: Hyper-V Network Virtualization for Scalable Multi-Tenancy in Windows VIR307: Get Hands-on with the New Hyper-V Extensible Switch in Windows Server 2012WSV14 – HOL: Managing Your Network Infrastructure with IP Address ManagementWSV24 – HOL: Managing Network Infrastructure with Windows Server 2012

Resource 1

Resource 2

Resource 3

Resource 4

Required Slide *delete this box when your slide is finalized

Track PMs will supply the content for this slide, which will be inserted during the final scrub.

DOWNLOAD Windows Server 2012 Release Candidate

microsoft.com/windowsserver

#TEWSV304 DOWNLOAD Microsoft System Center 2012 Evaluation

microsoft.com/systemcenterHands-On Labs

Connect. Share. Discuss.

http://europe.msteched.com

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Resources for Developers

http://microsoft.com/msdn

http://europe.msteched.com/sessions

Submit your evals online