Consolidation & Virtualization

Manuel Padilha and Nuno Afonso

Copyright ©

IBS

2004

Agenda

• Server Consolidation• Blades

– Blade Kinds– Consolidation Steps– System Management– Case Studies

• VMware– VMware Workstation, GSX e ESX– VMware P2V– VMware VirtualCenter– VMware Future– Case Studies

Server Consolidation

Copyright ©

IBS

2004

Consolidation

Common problems:

Growing number of Intel-based servers Difficult hardware management Hardware upgrade can be complicated Poor resource usage Hard to implement good Disaster Recovery policies Server migration is always complex

Copyright ©

IBS

2004

Benefits of Server Consolidation

Server consolidation offers the following benefits:

Lower TCO (Total Cost of Ownership) Boosts efficiency Allows higher service levels Makes infrastructure growth feasible Single point of control Reduces specific education needs Optimizes use of skilled resources

Copyright ©

IBS

2004

Kinds of Consolidation

Server consolidation can be seen as a phased procedure, with increasingly difficult steps:

Local Centralization Physical Consolidation Information Integration Application Integration

Copyright ©

IBS

2004

Server Consolidation

Copyright ©

IBS

2004

Local CentralizationThe easiest way to centralize is by concentrating all servers on a single location.After performing local centralization, all servers are managed by the same IT staff, with the same tools.

Copyright ©

IBS

2004

Physical Consolidation

Physical consolidation is the process by which small, entry-level, servers are replaced by larger, high-end, servers, within the same processor architecture.Centralization is a pre-requisite for physical consolidation.

Copyright ©

IBS

2004

Physical Consolidation: Virtual Machines

The concept of virtual machine (VM) was invented by IBM and used on mainframes. According to this concept, there is a virtualization layer that is executed directly on top of the physical hardware, and virtual machines that are isolated and hardware-independent are placed above.

Copyright ©

IBS

2004

Information Integration

Information integration is the process of gathering information in a single repository, under a unified schema.

Copyright ©

IBS

2004

Application IntegrationApplication Integration can be achieved by providing multiple, similar, applications on a single server.It can also be the process by which an application is migrated to a larger system. Example: 4 Lotus Domino Servers with 100 users can be migrated to a single, larger Domino with 500 users capacity.

Blades

Copyright ©

IBS

2004

What is a “Blade”?• A “server in a card” – Each one has:

–Processor–Ethernet ports–Memory–Optional storage

• The “BladeCenter” has:–Redundant* KVM (Keyboard, Video, Mouse)

–Redundant power supplies*–Redundant fans*–Redundant network and optical fibre*–CD-ROM* –Floppy disk* –USB ports

IBM Blade – vista horizontal

IBM Blade – vista vertical

Chassis IBM BladeCenter - 7U* Hot plug device

Copyright ©

IBS

2004

BladeCenter HS20 – Intel Xeon DP Processors• Intel Xeon DP Processors

– Up to 3.6Ghz-2MB cache, with 800Mhz Front Side Bus (some models support Intel EM64T)

– Up to 8GB RAM Chipkill Third Generation

• Integrated Raid 1 for local IDE/SCSI disks

• Support for “Boot from SAN”

• Support for additional SAN FC 2Gbit expansion

• Two integrated Ethernet 10/100/1000

• Dedicated connection for systems management

• Serial over LAN

• Supported OS– Windows 2000, 2003– Red Hat and SUSE Linux– VMWare ESX– Novell Netware

Copyright ©

IBS

2004

BladeCenter JS20 with POWER4 Chip• Two PowerPC 970 2.2GHz processors (POWER4 Architecture)

• VMX Capability: Better performance on intensive computing

• Support for SuSE Linux, Red Hat e AIX

• Support for IBM Director and Cluster Systems Management

• Heterogeneous platform integrated in the same chassis

Copyright ©

IBS

2004

• Uses same infrastructure– Same chassis as HS20 e JS20– Same options as HS20– 4 integrated ethernet 10/100/1000 ports– Up to 7 servers with 4 processors in 7U (4 with local SCSI

option)– Up to 16GB RAM Chipkill Third Generation– Support for “Boot from SAN”

• Intel Xeon MP Processors– Up to 4 processors per server– Intel Xeon MP Processors up to 3.0GHz 4MB L3 cache

• Typical applications– Back end workloads (SQL Server, DB2, Oracle)– Larger Mid-Tier Applications (Exchange, Notes, WebSphere)– OS: Microsoft Windows, Linux and VMware

BladeCenter HS40 – 4 Intel Xeon MP Processors

Copyright ©

IBS

2004

• Gigabit Ethernet Switches – Portfolio of switches (IBM,Cisco,Nortel)– Lower cost via Integration– Functions range from Layer 2 thru Layer 7

• Fibre Channel Switches (2Gb FC Fabric)– Portfolio of Switches (IBM, Brocade)

– Potentially lower cost via integration

– Full support of FC-SW-2 standards

• Power Subsystem– Upgradeable as required

– Redundant and load balancing for high availability

• Calibrated, Vectored Cooling™– Highly fault tolerant

– Allow maximum processor speeds

• BladeCenter Management Modules– Full remote video redirection– Out-of-band / lights out systems management– Concurrent Serial connectivity

BladeCenter Chassis

Copyright ©

IBS

2004

Layer 2 Switches

SSL Appliances

Caching Appliances

Storage Fibre

Switches

Storage Fibre

Switches

SSL Appliances

Caching Appliances

Step 1Consolidate Servers

ApplicationServers

SAN

Layer 4-7 Switches

Public Internet/Intranet Clients

Routers (Layer 3

Switches)

Firewalls

Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending

Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence

FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM

Copyright ©

IBS

2004

Storage Fibre

Switches

SSL Appliances

Caching Appliances

SSL Appliances

Caching Appliances

Step 2Integrate First Layerof the Network (L2)

Storage Fibre

Switches

SAN

Layer 4-7 Switches

Public Internet/Intranet Clients

Routers (Layer 3

Switches)

Firewalls

Layer 2 Switches

Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence

FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM

Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending

Copyright ©

IBS

2004

Storage Fibre

Switches

Storage Fibre

Switches

SSL Appliances

Caching Appliances

SSL Appliances

Caching Appliances

Step 3Integrate Storage Fabric

Layer 4-7 Switches

Public Internet/Intranet Clients

Routers (Layer 3

Switches)

Firewalls

SAN

Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence

FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM

Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending

Copyright ©

IBS

2004

SSL Appliances

Caching Appliances

SSL Appliances

Caching Appliances

Layer 4-7 Switches

Public Internet/Intranet Clients

Routers (Layer 3

Switches)

Firewalls

SAN

Step 4Integrate Second Layerof the Network (L4-7)

Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence

FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM

Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending

Copyright ©

IBS

2004

SSL Appliances

Caching Appliances

SSL Appliances

Caching Appliances

Public Internet/Intranet Clients

Routers (Layer 3

Switches)

Firewalls

SAN

Step 5Consolidate Applications

Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence

FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM

Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending

Copyright ©

IBS

2004

Public Internet/Intranet Clients

Routers (Layer 3

Switches)

Firewalls

SAN

ResultBladeCenter Collapses Complexity

Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence

FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM

Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending

Copyright ©

IBS

2004

BladeCenter: System Management

Remote Targets

RDM Image Library

Deployment

Preconfigured "Donor"system

Image Capture

• Native hardware management (Web based)

• Firmware update

• Remote control

• IBM Director 4.2

• Powerful management tools (Capacity manager, System availability, Event action plans, etc.)

• Remote Deployment Manager

• Create, maintain and deploy images from a single drag and drop user interface

Blades - Case Studies

Copyright ©

IBS

2004One BladeCenter with:

• 5 Blades with 2 Processors, 4 GB RAM and 2 SCSI HDD (Raid 1) each

• Windows 2000 Server

• Citrix MetaFrame XPe 1.0

• 500 Remote Users

(customer information redacted)

Copyright ©

IBS

2004Three BladeCenters with:

• 42 Blades with 2 Processors and 4 GB RAM each

• Boot from SAN

• Windows 2000/2003 Server

• E-Banking

• Web Servers

• 1 Enterprise Storage Server with 15TB

(customer information redacted)

VMwareWorkstation, GSX e ESX

Copyright ©

IBS

2004

Benefits of Virtual Machines

• Compatibility– Operating system “sees” a standard Intel x86 environment

• Isolation– The state of a virtual machine does not affect the state of others – OS, registry, applications and files of each VM are fully separated

• Encapsulation– One virtual machine is made of only a small set of files

• Hardware Independence– Virtual hardware can be configured the same way, independently of

the differences in underlying hardware

Copyright ©

IBS

2004

Why use Virtual Machines?

• Free operating systems and applications of physical hardware– Hardware maintenance is easier to perform– Hardware upgrades and replacements require no reconfiguration– New Disaster Recovery options

• An image of the Virtual Machine can be easily created– Configure OS and applications once and clone many– Backup of a VM requires the backup of only a small set of files

• Several VMs can run on the same physical hardware– Better resource usage

Copyright ©

IBS

2004

VMware Products

Desktop

Server

VMware Workstation• Productivity Tool• Best suited for

programmers• Performance 70-

90% of native

VMware GSX Server• Server consolidation

for departments• Remote

Management• Performance 70-

90% of native

VMware ESX Server• Server consolidation for the

Data Center• High Performance and

Scalability• Advanced Resource

Management• Remote Management• Performance 83-98% of

native

Copyright ©

IBS

2004

VMware Products Architecture

• Hosted (Workstation, GSX Server)– Maximum device

compatibility– Installs like an application– Lower price

• Native (ESX Server)– Maximum performance– Less overheads– Dynamic resource

management– Virtual SMP

x86 hardware

Windows/Linux

Workstation/GSX Server

x86 hardware

VM VM

VMkernel

VM VM

Service Console

Copyright ©

IBS

2004

(Up to 2 CD-ROMs)

1-4 ports 1-4 ports

1-4 adapters 1-2 drives

Up to 3.6GB RAM1 CPU

(2 CPUs with VMware SMP)

Virtual Machine Contents

Copyright ©

IBS

2004

• Minimum Rate• Maximum Rate• Share Allocation• Virtual SMP • CPU Load Balancing• Processor Affinity• Hyperthreading

• Minimum Size• Maximum Size• Share Allocation• Dynamic Allocation• Memory Overcommitment• Memory Sharing

• Traffic Shaping• NIC Teaming

• Share Allocation

VMs Resource Optimization Tools

Copyright ©

IBS

2004

Proportional Shares: static example• 3 active VMs

– 300 shares VM A– 200 shares VM B– 100 shares VM C– 600 shares total

• Rights = fraction of shares– 50% VM A (300 / 600)– 33% VM B (200 / 600)– 17% VM C (100 / 600)

• Relative allocations• Guaranteed minimums

VM C17%

VM A50%

VM B33%

Copyright ©

IBS

2004

Proportional Shares: dynamic example

• Changing VM sharesDynamic reallocation

• New VM Graceful degradation

• Shutdown VMRemaining VMs explore available

resources

Copyright ©

IBS

2004

Clustering

• Cluster in a box

• Cluster across boxes

• Cluster between physical and virtual

Copyright ©

IBS

2004

SAN

• Boot from SAN• Multipathing with

HBA Failover• Multipathing with

Storage Port Failover

• Clustering Support (Raw Device Mappings)

Copyright ©

IBS

2004

SAN Disaster Recovery

Copyright ©

IBS

2004

Hardware

• IBM BladeCenter• IBM xSeries 235• IBM xSeries 255• IBM xSeries 330• IBM xSeries 335• IBM xSeries 336• IBM xSeries 345• IBM xSeries 360• IBM xSeries 365• IBM xSeries 440• IBM xSeries 445

VMware P2V

Copyright ©

IBS

2004

VMware P2V

VMware VirtualCenter

Copyright ©

IBS

2004

VMware VirtualCenter

Single Management Console

Easy creation of servers Virtual Machine Dashboard VMotion enabled Secure Management

Copyright ©

IBS

2004

VMware VMotion

VMotion: virtual machines can be moved from one ESX server to another without downtime

Copyright ©

IBS

2004

VMware VMotion & Server Upgrades

VMware Future

Copyright ©

IBS

2004

VMware Future

• 4 Processors SMP (last quarter 2005)

• Policy-based automatic VMotion (VC plug-in)• Autonomic Computing• Server farms

VMware - Case Studies

Copyright ©

IBS

2004One BladeCenter with:

• 5 Blades with 2 Processors, 4 GB RAM and 2 SCSI HDD (Raid 1) each

• 4 with VMware ESX (12 Virtual Machines)

• 1 with Windows 2000 (Backup and Systems Management)

• 1 IBM FastT600 with 1TB

(customer information redacted)

Copyright ©

IBS

2004

• 6 IBM xSeries 445 with 8 processors, 16GB RAM and 2 SCSI HDD (Raid 1) each

• 2 IBM xSeries 440 with 8 processors, 16GB RAM and 2 SCSI HDD (Raid 1) each

• All have VMware ESX

• 126 Virtual Machines with Windows 2000/2003 and Linux

• SQL, Domino, Print Server, File Server, etc.

• 1 Enterprise Storage Server with 15TB

(customer information redacted)

Copyright ©

IBS

2004i5 Model 550 (4 Processors, 28Gb of Memory, 12.000CPW – 6 Partitions V5R3)

(customer information redacted)

Copyright ©

IBS

2004

(customer information redacted)

Questions

?(Consolidate! Only one question

please :)