Planning and Designing a Virtual Unified Communication Solution
BRKUCC-2225
Laurent Pham
Technical Marketing Engineer
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Cisco Collaboration Design
Traditional Deployments New Deployments
MCS End-of-Sale Cisco Collaboration Release 10 virtual only
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Laurent PhamTechnical Marketing Engineer
AGENDA
❑ Overview
❑ Platform Options
❑ How to Design
❑ Other Design Considerations
❑ How to Deploy
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Server Virtualization
Traditional Architecture Virtual Architecture
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
With MCS servers
Moving towards Virtualization
Virtualization
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Virtualization Overview and Definitions
Definition Support
Guest Virtual Machine Cisco Collaboration application release 8.0(2)+ in general
Hypervisor Software allowing to run VMs on a host
VMware vSphere ESXi only. Release 4.0, 4.1, 5.0, 5.1, or 5.5
Host Physical Server Cisco UCS or other VMware compatible servers
Guest - Cisco Collaboration application VM
Hypervisor - VMware vSphere ESXi
Host - Physical server
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
OVA – Open Virtualization Archive
Definition Support
OVA(Open Virtualization Archive)
File containing VM configuration
(e.g. virtual hardware)
OVAs must be used when installing a VM.Ensure proper VM configuration and
application partition alignment
OVA
Partition Alignment
BlockBlockChunkStorage
VMFSApplication Block
BlockBlock Block
Chunk
BlockBlockChunkStorage
VMFSApplication Block
BlockBlock Block
Chunk
OVA
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
“DocWiki”: Main Reference for UC Virtualization
• Covers all aspects of Cisco Collaboration Virtualization (Collaboration applications, VMware and platform support for UC virtualization)
• Frequent changes with new updates – check back often
Guide for
UC Virtualization
http://www.cisco.com/go/uc-virtualized
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
✓ Overview
✓ Hardware Options
✓ How to Design
✓ Other Design Considerations
✓ How to Deploy
AGENDA
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Hardware Options
Tested Reference Configuration (TRC) Specs-Based
Any vendor
Business Edition 6000/7000 “UC on UCS” “UC on UCS” “UC on 3rd party servers”
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
UCS 5108 Chassis
UCS 6200Fabric Interconnect
SAN
10GbECatalyst
Nexus
MDS
FC
FCoE
1GbE
Cisco UCS Architecture Overview with TRCs
Fiber Channel Storage Array
UCS B-series TRCs(B200, B230, B440)
Business Edition 6000/7000UCS C-series TRCs(C220, C240, C260)
UCS 2200Fabric Extender
LAN
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
TRC Servers
#Users
# A
pps
*
VM VM VM VM VM
VM VM VM VM VM
VM VM VM VM
<1K users(1.2-2.5K devices)
1K-5K users(<15K devices)
>5K users(>15K devices)
BE 6000 MD Server Small TRC, 8c
BE 6000 HD Server Small Plus TRC,16c Medium TRC*, 12c
Medium TRC*, 8c
Large TRCs*, 16c
Extra-Large TRCs*, 20c
2X-Large TRC*, 40c
VM VM VM VM
VM VM VM VM VM
VM VM VM VM VM
VM VM VM
VM VM VM
VM VM VM
VM VM VM
VM VM VM
VM VM VM
*VM counts are averages/examples only
and vary by design.
Full PerformanceRestricted Performance
Legend8c: 8 cores
BE6000
BE7000
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Component Modifications Allowed?Server Model/Generation ✖
CPUModel ✔ Within the same familyQuantity and # cores ✖Speed ✔ Yes, if higher
Physical Memory ✔ Yes, if higher
DAS StorageQuantity, RAID, technology ✖Disk speed and size ✔ Yes, if higher
AdaptersC-series (NIC Type, vendor, technology) ✖C-series (NIC card quantity) ✔ Yes, if higherB-series (Mezzanine card) ✔
TRC – Allowed DeviationsTRC – Allowed deviations
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
BusinessEdition 6000 UC on UCS
Less
Less More
“Tell me what to do…” “I know what I’m doing…”
More
UC on UCS 3rd-Party
TAC Noteshttp://www.cisco.com/en/US/customer/products/ps6884/products_tech_note09186a0080bf23f5.shtml
Specs-Based – Flexibility
Any Server
BusinessEdition 7000
“Choices”Existing Investment Leverage
“Assurance”“Simplicity”
Tested Reference Configuration (TRC) Specs-Based
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Limited Cisco UCS servers
Any server
UCS C: Limited DAS optionsUCS B: FC SAN only Flexible DAS & SAN
UCS C: Limited OptionsUCS B: Flexible Adapters Flexible adapters
Limited CPUs More CPUs options
Xeon 5600 or 7500 - 2.53+ GHzE5-2400/2600/4600 v1/v2 - 2.0+ GHz (Restricted Performance) E5-2600/4600 v1/v2 - 2.5+ GHzE7-2800/4800/8800 - 2.0+ GHz (Restricted Performance)E7-2800/4800/8800 - 2.4+ GHz
Any Storage compatible with Server and VMwareE.g. Flexible DAS config, FC, FCoE, iSCSI, NFS NAS
vCenter required (for historical logs and statistics)
Any adapters compatible with server and VMware
ANY Server (VMware compatible)
Optional Required
Specs-Based - Requirements
TRC Specs-Based
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
✓ Overview
✓ Hardware Options
✓ How To Design
✓ Other Design Considerations
✓ How To Deploy
AGENDA
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
How to Design - Overview
Application Design
Overall Application DesignApplication Sizing
VM Placement
1
2 New with Virtualization
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Application Design
Resources- Solution Reference Network Design (SRND): www.cisco.com/go/ucsrnd- Cisco Preferred Architecture: http://www.cisco.com/go/cvd/collaboration- Cisco Validated Design CVD: http://www.cisco.com/go/cvd/collaboration- Docwiki: http://www.cisco.com/go/uc-virtualized- Cisco Collaboration Sizing Tool: http://www.cisco.com/go/cvd/collaboration
Same as with MCS
Almost same as with
MCS
1 Application Design• Overall Application Design
- Architecture and Deployment Models- High Availability Design
• Application Sizing- VM Configuration Selection- Determine Number of VMs Required
Simplified design
with BE6000
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
How to Select a VM Configuration
Application VM Config vCPU Restricted UC Performance CPU:BE6000, Small(+)
TRC
Full UC Performance CPU:
BE7000, Medium TRC or larger
Unified CM 10.0
10,000 4 ✗ ✔
7,500 2 ✗ ✔
2,500 1 ✗ ✔
1,000 2 ✔ ✔
IM & Presence
10.0
15,000 4 ✗ ✔
5,000 2 ✗ ✔
2,000 1 ✗ ✔
1,000 full UC
1 ✔ ✔
Unity Connection
20,000 7 ✗ ✔
10,000 4 ✗ ✔
5,000 2 ✗ ✔
1,000 1 ✔ ✔
Select Appropriate VM ConfigConsider:
# users and # vCPU
VM Config compatible with
Hardware?
Yes
No Change VM Config or
Platform
Docwiki: www.cisco.com/go/uc-virtualized
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
How to Determine the Number of VMs Required
Cisco Collaboration Sizing Tool (CST) available to Partners, Cisco Account Teams, and Cisco Advanced Services
http://tools.cisco.com/cucst
Estimate SizingDesign Guides - SRND
Validate Sizing for complex deploymentCollaboration Sizing Tool (CST)
No CST for BE6000
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
VM Placement
Resources- Docwiki: http://www.cisco.com/go/uc-virtualized- VM Placement Tool (VMPT): http://www.cisco.com/go/vmpt
New with Virtualization
VM Placement• Goal: Determine the number of physical servers required
• How to do VM Placement?- Manual placement using the rules in the docwiki- Use VM Placement Tool (VMPT)
2
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Logical Processors
CPU Resources – Physical Core
Consider the number of PHYSICAL cores on the server
Core 1 Core 2
Core 3 Core 4
Core 5 Core 6
Do not consider the number of LOGICAL cores obtained through Hyper-threading
CPU Cores
Core 1 Core 2
Core 3 Core 4
Core 5 Core 6
Dual sockets, 6 cores per socket
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
CPU Resources - Mapping
No oversubscription: The number of vCPUs can’t exceed the number of physical cores
Mapping: One vCPU = One physical core
Cores
vCPUUCM-PUB UCM-SUB1 IM&P-1 CER-1 CCX-1
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
CPU Resources – Unity Connection
With Unity Connection only:Reserve a spare core for the ESXi scheduler
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Other Hardware Resources
◆ Memory▪ No Oversubscription▪ Reserve RAM for ESXi scheduler
• ESXi 5.1 or earlier: 2 GB• ESXi 5.5: 4 GB
◆ Storage▪ Ensure enough storage space is available▪ Thick vs. Thin provisioning
• TRC with DAS: Thick provisioning required• Specs-Based or SAN: Thick provisioning recommended, Thin provisioning allowed
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Co-Residency: Mixing Applications
Limited(includes no co-residency) UC with UC Only Full
Cisco UC+ Non-UC/3rd party
3rd Party/Non-UC(e.g. Nexus 1000v, vCenter)
Specific Cisco UC
Examples:CUCM 8.6(2)+IM&P 8.6(1)+CUC 8.6(2)+CCX 8.5+CCE 10+
Examples:CWMSCCE Logger 8.x
Examples:CUCM 8.6(1)-IM&P 8.5(x)-CUC 8.5(1)-CCX 8.0CCE Logger 9.x
Specific Cisco UC
Cisco UC Cisco UC Cisco UC
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Co-residency with 3rd party applications
More info in the docwiki:http://docwiki.cisco.com/wiki/Unified_Communications_Virtualization_Sizing_Guidelines
• The co-residency rules and categories apply to TRC and Specs-Based• Number and Type of 3rd party co-resident applications limited with Cisco
Collaboration virtualization SW OEMs (Cisco UC Virt. Hypervisor/Foundation, default ship with BE6000/BE7000)
• TAC TechNote: http://www.cisco.com/en/US/products/ps6884/products_tech_note09186a0080bbd913.shtml
• UC on UCS rules also imposed on 3rd party VMs (e.g. no Oversubscription allowed for 3rd party apps)
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
VM Placement Tool
• Visual VM placement tool
• Greatly simplifies VM Placement
• Most co-residency rules are implemented
Virtual Machine Placement Tool (VMPT): http://www.cisco.com/go/vmpt
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
VM Placement Tool
2
3
4
15
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
VM Placement – Example with 5000 users
Best Practices• Spread VMs across different
nodes to minimize failure impact.
• Provide spare capacity for future growth, server maintenance, or Collaboration application upgrades possibly requiring more resources.
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
✓ Overview
✓ Platforms
✓ How To Design
✓ Other Design Considerations:➢ Storage and Network Considerations➢ VMware features support
✓ How To Deploy
AGENDA
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Storage Array Requirements
HypervisorKernel Command Latency
< 4ms
Physical Device Command Latency< 20ms
SAN NAS
Total Guest Latency< 24ms
Reference: http://docwiki.cisco.com/wiki/UC_Virtualization_Supported_Hardware
Performance Requirements
UCS B-series TRC Specs-BasedStorage Vendor Any Vendor compatible with Server and VMware
Storage Technology FC only Flexible (FCoE, iSCSI, NFS…)
Other RequirementsMeet Performance Requirements
Thick Provisioning Recommended (not required) Flexible RAID Configuration
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Storage Array Performance Design
BHCA Average IOPS10K ~3525K ~5050K ~100CUCM upgrades generate 800 to 1200 IOPS in addition to steady state IOPS
Unity Connection VM size Average IOPS Peak IOPS2 vCPU (5,000 users) ~130 ~7154 vCPU (10,000 users) ~220 ~870
Unified CM
Unified CCX VM Size Average IOPS Peak IOPS2 vCPU (300 agents) ~150 ~1500
Presence VM Size Average IOPS1000 users ~60
Traffic Type: In general, I/Os are mostly sequential writes
Reference: www.cisco.com/go/uc-virtualized > Collaboration Application
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
DAS Storage Requirements
TRC and BE6000 / BE7000 Specs-Based
BOM (Disks/RAID controllers)
Fixed. Exceptions: Faster/Larger
disks okFlexible
RAID configuration Fixed Flexible
Thick/Thin Provisioning Thick only Thick recommended
Storage Performance Design
No IOPS calculation needed
• Use TRC as reference• Or calculate IOPS
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Networking Considerations with UCS C-series• In general, use all ports available… Or
Calculate Bandwidth requirements for each VM– Bandwidth Formulas available in the Design Guides and SRND.– Only account for traffic in/out of the host (not within host)– Consider traffic streams that carry media, especially Video
• Plan for upstream switch redundancy.With redundancy, need 2x number of ports.
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
VMware vSphere Release Compatibility
• ESXi release support varies with UC application (many apps do not support ESXi 5.5)
• ESXi Updates (e.g. U1, U2, etc…) implicitly supported unless specified otherwise
• For the exact release of Cisco Collaboration application or ESXi, refer to the docwiki
For details and latest support: http://www.cisco.com/go/uc-virtualized > Application
Application ESXi 4.0 ESXi 4.1 ESXi 5.0 ESXi 5.1 ESXi 5.5CUCM 8.0(2) and later 8.0(2) and later 8.0(2) and later 8.0(2) and later 9.X or later
CUP/Unified IM&P
8.0(2) or later 8.0(2) or later 8.6(1) or later 8.6(4) or later 9.1(1) or later
CUC 8.0(2) or later 8.0(2) or later 8.0(2) or later 8.0(2) or later 9.X or laterCCX 8.0(2) to 9.x 8.0(2) or later 8.0(2) or later 8.5(1) or later 10.0(1) or later
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
VMware vSphere compatibility with ApplicationDocwiki reference example
For YourReference
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
VMware Feature Support
VMware Features vMotion Storage vMotion
CopyClone
HA VMware DRS
Fault Tolerance
CUCM Y (C) Y (C) Y (C) Y (C)
N N
CUP / IM & Presence
Y (P) N Y (C) Y (C)
N N
CUC Y (P) N Y (C) Y (C)
N N
CCX Y (C) Y (C) Y (C) N N N
LEGEND:Y(C) – Supported with CaveatsY(P) – Partial or LimitedN – Not Supported
• vMotion– Y(C): supported with Caveat: Can be done with live traffic, but slight risks to impact calls.– Y(P): Partial: During maintenance window only.
• Copy / Clone– Y(C): supported with Caveat: Shutdown VM first
• VMware Distributed Resource Scheduler (DRS)– Not supported at this time. No real benefits since Oversubscription is not supported
VMware vSphere Requirementshttp://docwiki.cisco.com/wiki/Unified_Communications_VMWare_Requirements
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
High Availability (HA) DesignApplication HA vs. VMware HA
Best Practice:VMware HA is allowed but…Use Cisco Collaboration application built-in redundancy first
Collaboration application HA
VMware HA
DAS Storage Support Yes No (requires shared
storage)VM file system corruption Protection Yes NoFailover Time Faster LongerAdditional mechanisms required to ensure failover does not result in an unsupported configuration
No Yes
Fully Supported Yes No
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Backup StrategyApplication vs. VMware Backup
Cisco Disaster Recovery System
(DRS)
VMware Copy / Clone / vDP
Backup can be taken when VM is running Yes No(Power Off VM)
Restore time Longer Short
Best Practice:Can use VMware Copy for fast restore but…Always perform a DRS Back Up
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
✓ Overview
✓ Platforms
✓ How To Design
✓ Other Design Considerations
✓ How To Deploy➢ Installation➢ Migration to virtualization
AGENDA
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Installation1. Configure platform (e.g. RAID)
2. Install VMware ESXi
3. Deploy OVA template• Use the OVA available on cisco.com for virtual HW settings and for Disk Alignment
cucm_10.0_vmv8_v1.7.ova
UC App UC App release VM Hardware VersionESXi4:vmv7, ESXi5:vmv8
OVA Version
• When deploying the VM template, select VM configuration
5. Install Cisco Collaboration applicationCisco Collaboration on Virtual Servers:http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/virtual/CUCM_BK_CF3D71B4_00_cucm_virtual_servers.pdf
Not needed with
BE6000/BE7000Block
BlockChunkStorage
VMFSApplication Block
BlockBlock Block
Chunk
BlockBlockChunkStorage
VMFSApplication Block
BlockBlock Block
Chunk
Not needed with
BE6000/BE7000
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Migration to Virtualization
CUCM on MCSUpgrade… DRS
• Follow the normal Server Replacement procedure: DRS backup, Install using the same UC release, DRS restore.
• Upgrade… if current CUCM release doesn’t support virtualization.In general, virtualization requires 8.0(2)+.
CUCM release supporting virtualization
CUCM – Virtual
Migration
if current CUCM release doesn’t support virtualization
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Migration to VirtualizationIf done manually, could be long and laborious…
CUCM on MCS
Upgrade DRS Migrate
CUCM release supporting virtualization
CUCM – Virtual
CUCM on MCS Upgrade
or Bridge Upgrade
CUCM – VirtualUpgrade
CUCM 6.1.4, 6.1.5, 7.1.3 or 7.1.5 on MCS
DRS backup
install 6.1.4, 6.1.5, 7.1.3 or 7.1.5 virtual
“Interim” CUCM 9.1.2virtual
Upgrade to 9.1.2
Apply RU Cop file DRS Restore
“Jump” to VM
DRS backup
Final CUCM 9.1.2 virtual
DRS Restore migrate licenses to ELM
Isolated Lab Environment
Reinstall VM
Jump Upgrade to 9.1(2)
(Partition alignment)
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Migration to Virtualization… Or it could be faster and simpler with Prime Collaboration Deployment (PCD)!
Migration with PCD• For Migration to CUCM / IM & Presence 10.0+• Direct upgrade to 10.0+ and Automated Migration Process• Can change IP address / Hostname during migration• Not based on Disaster Recovery System (DRS)
CUCM 6.1.5, 7.1.3 , 7.1.5, 8.x, 9.x on MCS
CUCM 10.0+ virtualPCD Migration
Migration path to UCM 10.0+
Also:• Free of charge• Can perform tasks (change IP/networking, upgrade, switch versions)• Minimum virtualization SW license requirements:
Cisco UC Virt. Foundation or vSphere Standard Edition
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Summary
Application Design
VM Placement
▪ Perform the Application Design as usual – Deployment Model, High Availability, VM Config, Number of VMs…
▪ VM Placement– Select type of platforms (TRC vs. Specs-based, B vs. C,…)– VM placement: Sizing and Co-residency– Storage, Networking, VMware considerations
▪ Plan how to install/migrate
SRND: www.cisco.com/go/ucsrnd Cisco Collaboration Sizing Tool: http://tools.cisco.com/cucstDocwiki: www.cisco.com/go/uc-virtualized
Docwiki: www.cisco.com/go/uc-virtualizedVM Placement Tool: www.cisco.com/go/vmptCisco Collaboration on Virtual Servers
http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/virtual/CUCM_BK_CF3D71B4_00_cucm_virtual_servers.pdf
Questions ?
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Need more?
• Want more details?– BRKUCC-1903 - Migration and Co-Existence Strategy for Collaboration
Applications in a Virtualized Environment (tomorrow, 8:00am)– BRKUCC-2346 - UC on UCS Overview
(recording available on Cisco Live 365)– Upgrade Resource Central https://communities.cisco.
com/community/partner/collaboration/migration
• Questions after you go home? Ask the BU at Collaboration User Group– http://communities.cisco.
com/community/technology/collaboration/usergroups/collaboration – Technical design information at www.cisco.com/go/uc-virtualized
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Complete Your Online Session Evaluation• Give us your feedback and you
could win fabulous prizes. Winners announced daily.
• Complete your session evaluation through the Cisco Live mobile appor visit one of the interactive kiosks located throughout the convention center.
Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online
© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public
Continue Your Education• Demos in the Cisco Campus
• Walk-in Self-Paced Labs
• Table Topics
• Meet the Engineer 1:1 meetings