Consolidation & Virtualization
Manuel Padilha and Nuno Afonso
Copyright ©
IBS
2004
Agenda
• Server Consolidation• Blades
– Blade Kinds– Consolidation Steps– System Management– Case Studies
• VMware– VMware Workstation, GSX e ESX– VMware P2V– VMware VirtualCenter– VMware Future– Case Studies
Server Consolidation
Copyright ©
IBS
2004
Consolidation
Common problems:
Growing number of Intel-based servers Difficult hardware management Hardware upgrade can be complicated Poor resource usage Hard to implement good Disaster Recovery policies Server migration is always complex
Copyright ©
IBS
2004
Benefits of Server Consolidation
Server consolidation offers the following benefits:
Lower TCO (Total Cost of Ownership) Boosts efficiency Allows higher service levels Makes infrastructure growth feasible Single point of control Reduces specific education needs Optimizes use of skilled resources
Copyright ©
IBS
2004
Kinds of Consolidation
Server consolidation can be seen as a phased procedure, with increasingly difficult steps:
Local Centralization Physical Consolidation Information Integration Application Integration
Copyright ©
IBS
2004
Server Consolidation
Copyright ©
IBS
2004
Local CentralizationThe easiest way to centralize is by concentrating all servers on a single location.After performing local centralization, all servers are managed by the same IT staff, with the same tools.
Copyright ©
IBS
2004
Physical Consolidation
Physical consolidation is the process by which small, entry-level, servers are replaced by larger, high-end, servers, within the same processor architecture.Centralization is a pre-requisite for physical consolidation.
Copyright ©
IBS
2004
Physical Consolidation: Virtual Machines
The concept of virtual machine (VM) was invented by IBM and used on mainframes. According to this concept, there is a virtualization layer that is executed directly on top of the physical hardware, and virtual machines that are isolated and hardware-independent are placed above.
Copyright ©
IBS
2004
Information Integration
Information integration is the process of gathering information in a single repository, under a unified schema.
Copyright ©
IBS
2004
Application IntegrationApplication Integration can be achieved by providing multiple, similar, applications on a single server.It can also be the process by which an application is migrated to a larger system. Example: 4 Lotus Domino Servers with 100 users can be migrated to a single, larger Domino with 500 users capacity.
Blades
Copyright ©
IBS
2004
What is a “Blade”?• A “server in a card” – Each one has:
–Processor–Ethernet ports–Memory–Optional storage
• The “BladeCenter” has:–Redundant* KVM (Keyboard, Video, Mouse)
–Redundant power supplies*–Redundant fans*–Redundant network and optical fibre*–CD-ROM* –Floppy disk* –USB ports
IBM Blade – vista horizontal
IBM Blade – vista vertical
Chassis IBM BladeCenter - 7U* Hot plug device
Copyright ©
IBS
2004
BladeCenter HS20 – Intel Xeon DP Processors• Intel Xeon DP Processors
– Up to 3.6Ghz-2MB cache, with 800Mhz Front Side Bus (some models support Intel EM64T)
– Up to 8GB RAM Chipkill Third Generation
• Integrated Raid 1 for local IDE/SCSI disks
• Support for “Boot from SAN”
• Support for additional SAN FC 2Gbit expansion
• Two integrated Ethernet 10/100/1000
• Dedicated connection for systems management
• Serial over LAN
• Supported OS– Windows 2000, 2003– Red Hat and SUSE Linux– VMWare ESX– Novell Netware
Copyright ©
IBS
2004
BladeCenter JS20 with POWER4 Chip• Two PowerPC 970 2.2GHz processors (POWER4 Architecture)
• VMX Capability: Better performance on intensive computing
• Support for SuSE Linux, Red Hat e AIX
• Support for IBM Director and Cluster Systems Management
• Heterogeneous platform integrated in the same chassis
Copyright ©
IBS
2004
• Uses same infrastructure– Same chassis as HS20 e JS20– Same options as HS20– 4 integrated ethernet 10/100/1000 ports– Up to 7 servers with 4 processors in 7U (4 with local SCSI
option)– Up to 16GB RAM Chipkill Third Generation– Support for “Boot from SAN”
• Intel Xeon MP Processors– Up to 4 processors per server– Intel Xeon MP Processors up to 3.0GHz 4MB L3 cache
• Typical applications– Back end workloads (SQL Server, DB2, Oracle)– Larger Mid-Tier Applications (Exchange, Notes, WebSphere)– OS: Microsoft Windows, Linux and VMware
BladeCenter HS40 – 4 Intel Xeon MP Processors
Copyright ©
IBS
2004
• Gigabit Ethernet Switches – Portfolio of switches (IBM,Cisco,Nortel)– Lower cost via Integration– Functions range from Layer 2 thru Layer 7
• Fibre Channel Switches (2Gb FC Fabric)– Portfolio of Switches (IBM, Brocade)
– Potentially lower cost via integration
– Full support of FC-SW-2 standards
• Power Subsystem– Upgradeable as required
– Redundant and load balancing for high availability
• Calibrated, Vectored Cooling™– Highly fault tolerant
– Allow maximum processor speeds
• BladeCenter Management Modules– Full remote video redirection– Out-of-band / lights out systems management– Concurrent Serial connectivity
BladeCenter Chassis
Copyright ©
IBS
2004
Layer 2 Switches
SSL Appliances
Caching Appliances
Storage Fibre
Switches
Storage Fibre
Switches
SSL Appliances
Caching Appliances
Step 1Consolidate Servers
ApplicationServers
SAN
Layer 4-7 Switches
Public Internet/Intranet Clients
Routers (Layer 3
Switches)
Firewalls
Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending
Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence
FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM
Copyright ©
IBS
2004
Storage Fibre
Switches
SSL Appliances
Caching Appliances
SSL Appliances
Caching Appliances
Step 2Integrate First Layerof the Network (L2)
Storage Fibre
Switches
SAN
Layer 4-7 Switches
Public Internet/Intranet Clients
Routers (Layer 3
Switches)
Firewalls
Layer 2 Switches
Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence
FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM
Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending
Copyright ©
IBS
2004
Storage Fibre
Switches
Storage Fibre
Switches
SSL Appliances
Caching Appliances
SSL Appliances
Caching Appliances
Step 3Integrate Storage Fabric
Layer 4-7 Switches
Public Internet/Intranet Clients
Routers (Layer 3
Switches)
Firewalls
SAN
Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence
FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM
Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending
Copyright ©
IBS
2004
SSL Appliances
Caching Appliances
SSL Appliances
Caching Appliances
Layer 4-7 Switches
Public Internet/Intranet Clients
Routers (Layer 3
Switches)
Firewalls
SAN
Step 4Integrate Second Layerof the Network (L4-7)
Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence
FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM
Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending
Copyright ©
IBS
2004
SSL Appliances
Caching Appliances
SSL Appliances
Caching Appliances
Public Internet/Intranet Clients
Routers (Layer 3
Switches)
Firewalls
SAN
Step 5Consolidate Applications
Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence
FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM
Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending
Copyright ©
IBS
2004
Public Internet/Intranet Clients
Routers (Layer 3
Switches)
Firewalls
SAN
ResultBladeCenter Collapses Complexity
Enterprise data warehouse:•Risk and market analysis•sales and account monitoring Credit Validation•Product Development•Company metrics and Performance tracking•Business intelligence
FM front officeCall CenterSelf service (kiosks, Internet Trading, PDA)B2B PartnersCRM
Corporate Back Office•Trade Processing•Trade Settlements•Clearing•Fund Management•Asset Custody•Trust Management•Statements/billing•Accounting•Lending
Copyright ©
IBS
2004
BladeCenter: System Management
Remote Targets
RDM Image Library
Deployment
Preconfigured "Donor"system
Image Capture
• Native hardware management (Web based)
• Firmware update
• Remote control
• IBM Director 4.2
• Powerful management tools (Capacity manager, System availability, Event action plans, etc.)
• Remote Deployment Manager
• Create, maintain and deploy images from a single drag and drop user interface
Blades - Case Studies
Copyright ©
IBS
2004One BladeCenter with:
• 5 Blades with 2 Processors, 4 GB RAM and 2 SCSI HDD (Raid 1) each
• Windows 2000 Server
• Citrix MetaFrame XPe 1.0
• 500 Remote Users
(customer information redacted)
Copyright ©
IBS
2004Three BladeCenters with:
• 42 Blades with 2 Processors and 4 GB RAM each
• Boot from SAN
• Windows 2000/2003 Server
• E-Banking
• Web Servers
• 1 Enterprise Storage Server with 15TB
(customer information redacted)
VMwareWorkstation, GSX e ESX
Copyright ©
IBS
2004
Benefits of Virtual Machines
• Compatibility– Operating system “sees” a standard Intel x86 environment
• Isolation– The state of a virtual machine does not affect the state of others – OS, registry, applications and files of each VM are fully separated
• Encapsulation– One virtual machine is made of only a small set of files
• Hardware Independence– Virtual hardware can be configured the same way, independently of
the differences in underlying hardware
Copyright ©
IBS
2004
Why use Virtual Machines?
• Free operating systems and applications of physical hardware– Hardware maintenance is easier to perform– Hardware upgrades and replacements require no reconfiguration– New Disaster Recovery options
• An image of the Virtual Machine can be easily created– Configure OS and applications once and clone many– Backup of a VM requires the backup of only a small set of files
• Several VMs can run on the same physical hardware– Better resource usage
Copyright ©
IBS
2004
VMware Products
Desktop
Server
VMware Workstation• Productivity Tool• Best suited for
programmers• Performance 70-
90% of native
VMware GSX Server• Server consolidation
for departments• Remote
Management• Performance 70-
90% of native
VMware ESX Server• Server consolidation for the
Data Center• High Performance and
Scalability• Advanced Resource
Management• Remote Management• Performance 83-98% of
native
Copyright ©
IBS
2004
VMware Products Architecture
• Hosted (Workstation, GSX Server)– Maximum device
compatibility– Installs like an application– Lower price
• Native (ESX Server)– Maximum performance– Less overheads– Dynamic resource
management– Virtual SMP
x86 hardware
Windows/Linux
Workstation/GSX Server
x86 hardware
VM VM
VMkernel
VM VM
Service Console
Copyright ©
IBS
2004
(Up to 2 CD-ROMs)
1-4 ports 1-4 ports
1-4 adapters 1-2 drives
Up to 3.6GB RAM1 CPU
(2 CPUs with VMware SMP)
Virtual Machine Contents
Copyright ©
IBS
2004
• Minimum Rate• Maximum Rate• Share Allocation• Virtual SMP • CPU Load Balancing• Processor Affinity• Hyperthreading
• Minimum Size• Maximum Size• Share Allocation• Dynamic Allocation• Memory Overcommitment• Memory Sharing
• Traffic Shaping• NIC Teaming
• Share Allocation
VMs Resource Optimization Tools
Copyright ©
IBS
2004
Proportional Shares: static example• 3 active VMs
– 300 shares VM A– 200 shares VM B– 100 shares VM C– 600 shares total
• Rights = fraction of shares– 50% VM A (300 / 600)– 33% VM B (200 / 600)– 17% VM C (100 / 600)
• Relative allocations• Guaranteed minimums
VM C17%
VM A50%
VM B33%
Copyright ©
IBS
2004
Proportional Shares: dynamic example
• Changing VM sharesDynamic reallocation
• New VM Graceful degradation
• Shutdown VMRemaining VMs explore available
resources
Copyright ©
IBS
2004
Clustering
• Cluster in a box
• Cluster across boxes
• Cluster between physical and virtual
Copyright ©
IBS
2004
SAN
• Boot from SAN• Multipathing with
HBA Failover• Multipathing with
Storage Port Failover
• Clustering Support (Raw Device Mappings)
Copyright ©
IBS
2004
SAN Disaster Recovery
Copyright ©
IBS
2004
Hardware
• IBM BladeCenter• IBM xSeries 235• IBM xSeries 255• IBM xSeries 330• IBM xSeries 335• IBM xSeries 336• IBM xSeries 345• IBM xSeries 360• IBM xSeries 365• IBM xSeries 440• IBM xSeries 445
VMware P2V
Copyright ©
IBS
2004
VMware P2V
VMware VirtualCenter
Copyright ©
IBS
2004
VMware VirtualCenter
Single Management Console
Easy creation of servers Virtual Machine Dashboard VMotion enabled Secure Management
Copyright ©
IBS
2004
VMware VMotion
VMotion: virtual machines can be moved from one ESX server to another without downtime
Copyright ©
IBS
2004
VMware VMotion & Server Upgrades
VMware Future
Copyright ©
IBS
2004
VMware Future
• 4 Processors SMP (last quarter 2005)
• Policy-based automatic VMotion (VC plug-in)• Autonomic Computing• Server farms
VMware - Case Studies
Copyright ©
IBS
2004One BladeCenter with:
• 5 Blades with 2 Processors, 4 GB RAM and 2 SCSI HDD (Raid 1) each
• 4 with VMware ESX (12 Virtual Machines)
• 1 with Windows 2000 (Backup and Systems Management)
• 1 IBM FastT600 with 1TB
(customer information redacted)
Copyright ©
IBS
2004
• 6 IBM xSeries 445 with 8 processors, 16GB RAM and 2 SCSI HDD (Raid 1) each
• 2 IBM xSeries 440 with 8 processors, 16GB RAM and 2 SCSI HDD (Raid 1) each
• All have VMware ESX
• 126 Virtual Machines with Windows 2000/2003 and Linux
• SQL, Domino, Print Server, File Server, etc.
• 1 Enterprise Storage Server with 15TB
(customer information redacted)
Copyright ©
IBS
2004i5 Model 550 (4 Processors, 28Gb of Memory, 12.000CPW – 6 Partitions V5R3)
(customer information redacted)
Copyright ©
IBS
2004
(customer information redacted)
Questions
?(Consolidate! Only one question
please :)