+ All Categories
Home > Technology > POWER VM with IBM i and live partition mobility

POWER VM with IBM i and live partition mobility

Date post: 22-May-2015
Category:
Upload: common-europe
View: 643 times
Download: 0 times
Share this document with a friend
Description:
COMMON Europe Congress 2012 - Vienna
Popular Tags:
42
1 IBM Power Systems © 2012 IBM Corporation IBM i PowerVM Virtualization with VIOS and Partition Mobility for IBM i 3605 Highway 52 North Rochester, MN 55901 Tel 507-253-2367 Fax 845-491-2347 [email protected] Gottfried Schimunek Senior Architect Application Design IBM STG Software Development Lab Services IBM ISV Enablement © 2012 IBM Corporation 2 IBM Power Systems Acknowledgements Thanks to Kris Whitney for providing this comprehensive and detailed presentation
Transcript
Page 1: POWER VM with IBM i and live partition mobility

1

IBM Power Systems

© 2012 IBM Corporation

IBM i PowerVM Virtualization with VIOS and Partition Mobility for IBM i

3605 Highway 52 NorthRochester, MN 55901

Tel 507-253-2367 Fax 845-491-2347

[email protected]

Gottfried Schimunek

Senior ArchitectApplication DesignIBM STG Software Development Lab Services

IBM ISV Enablement

© 2012 IBM Corporation2

IBM Power Systems

Acknowledgements

� Thanks to Kris Whitney for providing this comprehensive and detailed presentation

Page 2: POWER VM with IBM i and live partition mobility

2

© 2012 IBM Corporation3

IBM Power Systems

PowerVM: Virtualization Without Limits

� Sold with more than 70% of Power Systems

� Improves IT resource utilization

� Reduces IT infrastructure costs

� Simplifies management

© 2012 IBM Corporation4

IBM Power Systems

PowerVM Technologies

� Hypervisor �Support for multiple operating environments

� Dynamic Logical Partitioning�Micro-partitioning, resource movement

� Multiple Shared Processor Pools�Cap processor resources for a group of partitions

� Virtual I/O Server�Virtualizes resources for client partitions

� Integrated Virtualization Manager �Simplifies partition management for entry systems

� Lx86�Supports x86 Linux applications

� Live Partition Mobility�Move running AIX and Linux partitions

� System Planning Tool�Simplifies the planning for and installation of Power servers with PowerVM

The leading virtualization platform for UNIX, i and Linux enables a more agile and responsive infrastructure

Power Hypervisor

VIOS

Page 3: POWER VM with IBM i and live partition mobility

3

© 2012 IBM Corporation5

IBM Power Systems

PowerVM Editionsoffer a unified virtualization

solution for any Power workloads

PowerVM Editions: Built to Meet Client Virtualization Needs

��������Suspend/Resume

����Live Partition Mobility

����

����

VMControlIVM

1+2 / Server

Express

��������PowerVM Lx86

����Active Memory Sharing

��������Multiple Shared Processor Pools

��������Virtual I/O Server

VMControlIVM, HMC

VMControlIVM, HMC

Management

10 / Core10 / CoreMaximum LPARs

EnterpriseStandardPowerVM Editions

� PowerVM Express Edition– Evaluations, pilots, PoCs– Single-server projects

� PowerVM Standard Edition– Production deployments– Server consolidation

� PowerVM Enterprise Edition– Multi-server deployments– Cloud infrastructure

© 2012 IBM Corporation6

IBM Power Systems

6/12/2012

Emerging: Virtual Appliances & Workload mobility within

scalable and centrally managed System Pools (Ensembles)

Workload Mobility

Optimized for ….• Availability• Performance• Energy

Shared Storage

Shared Network

Virtualization

Compute Memory

VM/LPAR

OSSW

VM/LPAR

OSSW

Network

Virtualization

Compute Memory

VM/LPAR

OSSW

Storage Network

Maturing: Multi-system virtualization managed across

Physical Servers

App

OS

Image

App

OS

Image

App

OS

Image

App

OS

Image

Image LibraryVirtual Appliance

Deployment

Virtual IO Svr

Virtl NW

Virt Storage

Virtual IO Svr

Virtl NW

Virt Storage

+ Mobility of Virtual Machines

+ Manually intensive server/storage/network mobilit y management

+ VM-based Availability/Resilience Mgmt

+ Storage Pools

+ IO virtualization and virtual switching

+ Hypervisor clustered fs access to virtual storage

Virtualization

Compute

Storage

Memory

Network

Virtual Server

OSSW

Established: Physical systems with local virtualization

Virtual IO Svr

Virtl NW

Virt Storage

OSSW

Virtual Server

• Physical resource discovery / configuration / provisioning / update / system health

• OS provisioning

• Virtual IO

• Virtual Machine lifecycle mgmt

• Dynamic resource optimization within a physical system

• VLAN

• External virtualized storage

• External virtualized switches

StoragevSwitch

vSwitch

+Mobility of workloads with automated and integrated server, network & storage provisioning

+ Workload-based Availability/Resilience Mgmt

+ Converged Datacenter Network fabric

+ Storage Pools with advanced capabilities (cloning, snapshot, thin provisioning, …)

+ Managing to QoS Policies (intelligent placement)

+ VM Security Appliance

Evolution towards: Fully Virtualized, Simplified, Lower cost

Page 4: POWER VM with IBM i and live partition mobility

4

© 2012 IBM Corporation7

IBM Power Systems

Two I/O Server Options

IBM i

Hypervisor

IBM i

POWER6Hypervisor

POWER6

IBM iVIOS

• Built into IBM i

•Host Disk, Optical, Tape

•Consolidate Ethernet Traffic

•Same technology as hosting AIX, Linux, and iSCSI

•VIOS Server

•Host Disk, Optical, Tape

•Bridge Ethernet Traffic

•Attach external storage

•Advance Virtualization Functions

© 2012 IBM Corporation8

IBM Power Systems

IBM i Hosting IBM i

� IBM i-based Virtualization– IBM i partition uses I/O resources from another IBM i

partition– Eliminates requirement to buy adapters and disk drives

for each IBM i partition– Supports simple creation of additional partitions …. e.g.,

for test and development– Requires POWER6 server with IBM i 6.1– Can mix virtual and direct I/O in client

� Platform support– Most IBM Power6 servers (except blade)

� Storage support– Determined by host IBM i partition ( EXP24, 12S, other

integrated disk and native attached external storage)

� LPAR management– HMC

IBM i

Hypervisor

IBM i

POWER6

* All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Page 5: POWER VM with IBM i and live partition mobility

5

© 2012 IBM Corporation9

IBM Power Systems

IBM i 6.1 Host and Client Partitions: Overview

IBM i Host

Virtual SCSI connection

IBM i Client

FC 5294

EXP24/12S

DS8000

DVD

DDxxN

WS

ST

Gs

DDxx

OPTxxDVD

OPTxx

IVE Virtual LAN connection

CMNxx

� Requirements– POWER6 hardware– IBM i 6.1 on host and client– PowerVM not required– HMC

� DASD– Hardware assigned to host LPAR in

HMC– DASD can be integrated or SAN– DASD virtualized as NWSSTG objects

� Optical– DVD drive in host LPAR virtualized

directly (OPTxx)– Optical IMGCLG in host LPAR may be

virtualized

� Networking– Network adapter (such as HEA) and

Virtual Ethernet adapter in host LPAR– Virtual Ethernet adapter in client LPAR

� Tape– New support as of 7.1 TR2

© 2012 IBM Corporation10

IBM Power Systems

Virtualizing disk storage with IBM i or VIOS

� Single IBM i or VIOS host provides access to SAN or internal storage

– AIX, IBM i, or Linux client partitions– Protect data via RAID-5, RAID-6, or

RAID-10

� Redundant VIOS hosts multiple paths to attached SAN storage with MPIO

– AIX, IBM i, and Linux client partitions– One set of disk

� Redundant IBM i or VIOS hosts provide access SAN or internal storage

– AIX, IBM i, and Linux client partitions– Client LPAR protects data via mirroring– Two sets of disk and adapters

Page 6: POWER VM with IBM i and live partition mobility

6

© 2012 IBM Corporation11

IBM Power Systems

IBM i Host VSCSI Virtual Optical

-Load images into the IMGCLG on the Server.

- Share the physical DVD/CD in the Server

-Utilize them to install or save to in the Client.

-Automatic switching of images

© 2012 IBM Corporation12

IBM Power Systems

IBM i Hosting IBM i Positioning

� Same technology as IBM i hosting AIX, LINUX, and iSCSI x86 servers

� Leverage existing hardware investment– Create new IBM i 6.1 LPARs using only virtual

hardware (No IOAs, IOPs, disk units, I/O slots necessary for client partitions), but may also use physical I/O.

� Rapidly deploy new workloads– Virtual disk created with 1 command or several

clicks in System i Navigator– New LPAR, virtual resources deployed

dynamically

� Create test environments without hardware provisioning

– Virtual resources allow new test environments of exact size to be created, deleted without moving hardware

– Test new applications, tools, fixes in virtual test LPAR– Test the next release in the client partition

IBM i

Hypervisor

IBM i

POWER6

* All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Page 7: POWER VM with IBM i and live partition mobility

7

© 2012 IBM Corporation13

IBM Power Systems

Hypervisor

POWER6

– IBM i partition uses I/O resources from Virtual I/O Server (VIOS)

– VIOS is included with all PowerVM Editions.– Requires POWER6 systems with IBM i 6.1

� Platform support– IBM Power servers – IBM BladeCenter JS12 , JS22, JS23, JS43, PS701,

PS702

� Storage support– Enables attachment to DS3000, DS4000, DS5000,

Storewize V7000, SVC, XIV, DS8000– Direct Attach Storage (Internal Storage)

• SSD

� LPAR management– HMC or IVM

� Integrated Virtualization Manager– Software for creating and managing

partitions, part of VIOS– Requires IBM i to use only virtual I/O

resources

IBM iVIOS

VIOS-based Virtualization

© 2012 IBM Corporation14

IBM Power Systems

What is the VIOS?

� A special purpose appliance partition– Provide I/O virtualization– Advanced Partition Virtualization enabler

� First GAed 2004

� Built on top of AIX, but not an AIX partition

� IBM i first attached to VIOS in 2008 with the IBM i 6.1

� VIOS is licensed with PowerVM

Page 8: POWER VM with IBM i and live partition mobility

8

© 2012 IBM Corporation15

IBM Power Systems

Why use the VIOS?

� I/O Capacity Utilization

� Storage Allocation Flexibility

� Ethernet Flexibility

� Memory Sharing

� Suspend/Resume

� Mobility

© 2012 IBM Corporation16

IBM Power Systems

I/O Virtualization on POWER

I/O Bus Virtualization with Dedicated Adapters

Hypervisor

Fabric

I/O Adapter Virtualization with VIO Server

Func

PCI adapter

Port

Func

Port

Hypervisor

VIOS LPAR

LPAR A

PhysicalAdapterDevDrv

Virtual Fabric

Virtual AdapterServer

Virtual AdapterDevDrv

Virtual AdapterServer

LPAR B

Virtual AdapterDevDrv

LPAR A LPAR B

PhysicalAdapterDevDrv

PhysicalAdapterDevDrv

Fabric

Func

Port

PCI adapter

PCI adapter

Increasing

Adapter BW

& LPAR

Density

per Slot

Page 9: POWER VM with IBM i and live partition mobility

9

© 2012 IBM Corporation17

IBM Power Systems

IBM i + VSCSI (Classic)

Source

VIOS IBM i Client (System 1)

POWER6 with IBM i 6.1.1

System 1

System 2

System 3

FC HBA

IBM i Client (System 2)

IBM i Client (System 3)

Hypervisor

•Assign storage to the physical HBA in the VIOS

•Hostconnect is created as an open storage or AIX hosttype,

•Requires 512 byte per sector LUNsto be assigned to the hostconnect

•Cannot Migrate existing direct connect LUNs

•Many Storage options supported

6B22Device Type

6B22Device Type

6B22Device Type

© 2012 IBM Corporation18

IBM Power Systems

IBM i + VSCSI (Classic) Storage Virtualizer

VIOS

POWER6 with IBM i 6.1.1

FC HBA

IBM i Client

Hypervisor

6B22Device Type

VSCSI SERVER

VSCSI Client

vhostXXX hdisk1

hdisk2

•Storage is assigned to the VIOS partition

•Within the VIOS you map the hdisk (lun) to the vhost corresponding to the client partition

•Storage management allocation is done from both the external storage box and the VIOS

•Flexible disk sizes up to 2Tb -512

•16 disks per vscsiadapter

Page 10: POWER VM with IBM i and live partition mobility

10

© 2012 IBM Corporation19

IBM Power Systems

IBM i + VSCSI File Backed Disks

VIOS

POWER6 with IBM i 6.1.1

FC HBA

IBM i Client

Hypervisor

6B22Device Type

VSCSI SERVER

VSCSI Client

vhostXXX

•Storage is assigned to the VIOS partition

•Within the VIOS you map the logical volume backed or file backed virtual disks to the vhostcorresponding to the client partition

•Allows more granular use of the virtual disk

•Flexible disk sizes up to 2Tb -512

•Not supported for suspend/resume or mobility

fbDisk1

fbDisk2

fbDisk3

fbDisk1

fbDisk2

fbDisk3

© 2012 IBM Corporation20

IBM Power Systems

IBM i + VSCSI Tape and optical

VIOS

POWER6 with IBM i 6.1.1

IBM i Client

Hypervisor

VSCSI SERVER

VSCSI Client

vhostXXX

•Storage is assigned to the VIOS partition

•Within the VIOS you map physical tape or optical or file backed virtual optical to the vhost corresponding to the client partition

•No tape library support with vscsi adpaters. Must use VFC adapers.

cd1

rmt1

CD1

RMT1TAP01

OPT01

Page 11: POWER VM with IBM i and live partition mobility

11

© 2012 IBM Corporation21

IBM Power Systems

IBM i + NPIV ( Virtual Fiber Chanel )

Source

VIOS IBM i Client (System 1)

POWER6 with IBM i 6.1.1

System 1

System 2

System 3

8Gbs HBA

IBM i Client (System 1)

IBM i Client (System 1)

Hypervisor

•Hypervisor assigns 2 unique WWPNs to each Virtual fiber

•Hostconnect is created as an iSeries hosttype,

•Requires 520 byte per sector LUNsto be assigned to the iSeries hostconnect on DS8K

•Can Migrate existing direct connect LUNS

•DS8100, DS8300, DS8700, DS8800, DS5100 and DS5300 supported

Virtual address example C001234567890001

Note: an NPIV ( N_port ) capable switch is required to connect the VIOS to the DS8000 to use virtual fiber.

© 2012 IBM Corporation22

IBM Power Systems

NPIV Concepts � Multiple VFC server adapters may map to the same physical adapter port.

� Each VFC server adapter connects to one VFC client adapter; each VFC client adapter gets a unique WWPN.

� Client WWPN stays the same regardless of physical port it is connected to.

� Support for dynamically changing the physical port to virtual port mapping.

� Clients can discover and manage physical devices on the SAN.

� VIOS can’t access or emulate storage, just provides clients access to the SAN.

� Support for concurrent microcode download to the physical FC adapter

Page 12: POWER VM with IBM i and live partition mobility

12

© 2012 IBM Corporation23

IBM Power Systems

NPIV Configuration - Server Adapter Mappings

© 2012 IBM Corporation24

IBM Power Systems

NPIV Configuration - Limitations

� Single client adapter per physical port per partition– Intended to avoid single point of failure– Documentation only – not enforced

� Maximum of 64 active client connections per physical port– It is possible to map more than 64 clients to a single adapter port– May be less due to other VIOS resource constraints

� 32K unique WWPN pairs per system platform– Removing adapter does not reclaim WWPNs

• Can be manually reclaimed through CLI (mksyscfg, chhwres…)• “virtual_fc_adapters” attribute

– If exhausted, need to purchase activation code for more

� Device Limitations– Maximum of 128 visible target ports

• Not all visible target ports will necessarily be active• Redundant paths to a single DS8000 node• Device level port configuration• Inactive target ports still require client adapter resources

– Maximum of 64 target devicesAny combination of disk and tapeTape libraries and tape drives are counted separately

Page 13: POWER VM with IBM i and live partition mobility

13

© 2012 IBM Corporation25

IBM Power Systems

NPIV Performance

NPIV vs D irect Attach (DS8300)

0

0.001

0.002

0.003

0.004

0.005

0.006

0.007

0.008

0.009

0.01

0 20 40 60 80 100 120

CPW Use rs

App

licat

ion

Res

pons

e T

ime

npiv run2 direct attach

© 2012 IBM Corporation26

IBM Power Systems

IBM i + NPIV ( Virtual Fiber ) with PowerHA

Source

VIOS

POWER6 with IBM i 6.1.1

SYSBAS

IASP8Gbs HBA

Hypervisor

VIOS 1 IBM i Client 1 IBM i Client 2

Each port is assigned separate WWPNs by the Hypervisor

Each port is seen as a separate adapter by IBM i – so PowerHA reset it individually.

Reduces the hardware for a single partition from 4 to 2 adapters for PowerHA

•Note, This configuration can support up to 64 IBM i partitions without adding any more adapters

SYSBAS

IASP

Page 14: POWER VM with IBM i and live partition mobility

14

© 2012 IBM Corporation27

IBM Power Systems

PowerHA in the Virtual I/O Environment

� With VSCSI–All Logical replication solutions supported including iCluster–PowerHA for i - Geographic mirroring–PowerHA for i – Storwize V7000 Metro and Global Mirror support

(4Q2011)

� With NPIV–All Logical replication solutions supported including iCluster–PowerHA for i - Geographic mirroring–PowerHA for i – Storwize V7000 Metro and Global Mirror support

(4Q2011)

Plus:–DS8000 Metro Mirroring–DS8000 Global Mirroring–DS8000 Lun level switching

© 2012 IBM Corporation28

IBM Power Systems

Fibre Channel Tape library support with NPIV

+

•10/2009 with 6.1.1

•3584 (TS3500) with LTO drives

•3573 (TS3100 TS3200) with LTO drives

•2/2010 with 6.1.1

•3577 (TS3400) with (TS1120/TS1130 ) drives

•3584 (TS3500) with (TS1120/TS1130 ) drives

•3576 (TS3310) with LTO drives

•TS7650, TS7610

Page 15: POWER VM with IBM i and live partition mobility

15

© 2012 IBM Corporation29

IBM Power Systems

Redundant VIOS with NPIV

VIOSVIOS

POWER6

IBM i

Physical FC connections

SYSBASIASP

Server VFC

adapters

Client VFC

adapters

1

� Step 1: configure virtual and physical FC adapters– Best Practice to make VIOS redundant or

separate individual VIOS partitions where a single hardware failure would not take down both VIOS partitions.

� Step 2: configure SAN fabric and storage– Zone Luns to the virtual WWPNs.– Each DASD sees a path through 2 VIOS

partitions

2

•Notes: Support up to 8 paths per LUN

•Not all paths have to go through separate VIOS partitions.

•New multi-path algorithm in 7.1 TR2

© 2012 IBM Corporation30

IBM Power Systems

VIOS – Storage attach

Three categories of storage attachment to IBM i through VIOS

1) Supported (IBM storage)- tested by IBM; IBM supports the solution and owns resolution -

IBM will deliver the fix

2) Tested / Recognized (3rd party storage including EMC and Hitachi)- IBM / storage vendor collaboration, solution was tested (by vendor, IBM, or both); - CSA in place, states that IBM and storage vendor will work together to resolve the issue - IBM or storage vendor will deliver the fix

3) Other- not tested by IBM, maybe not have been tested at all

No commitment / obligation to provide fix

Category #3 (Other) was introduced in the last few years, “other” storage used to invalidate the VIOS warranty. IBM Service has committed to provide some limited level of problem determination for service requests / issues involving "other” storage. To the extent that they will try to isolate it to being a problem within VIOS or IBM i, or external to VIOS or IBM i (ie. a storage problem). No guarantee that a fix will be provided, even if the problem was identified as a VIOS or IBM i issue

Page 16: POWER VM with IBM i and live partition mobility

16

© 2012 IBM Corporation31

IBM Power Systems

Support for IBM Storage Systems with IBM i

Notes- This table does not list more detailed considerations, for example required levels of firmware or PTFs required or configuration performance considerations- POWER7 servers require IBM i 6.1 or later- This table can change over time as addition hardware/software capabilities/options are added# DS3200 only supports SAS connection, not supported on Rack/Tower servers which use only Fibre Channel connections, supported on Blades with SAS## DS3500 has either SAS or Fibre Channel connection. Ractk/Tower only uses Fibre Channel. Blades support either SAS or Fibre Channel (either BCS or BCH)### Not supported on IBM i 7.1. But see SCORE System RPQ 846-15284 for exception support* Supported with Smart Fibre Channel adapters – NOT supported with IOP-based Fibre Channel adapters** NPIV requires Machine Code Level of 6.1.1 or later and requires NPIV capable HBAs (FC adapters) and switches@ BCH supports DS3400, DS3500, DS3950 & BCS supports DS3200, DS3500@@ N Series can only be used as file server. No load source/boot support. Support only through IFS. No IBM i data base support% NPIV support for DS5100/DS5300 requires IBM i 7.1 TR2 and must have POWER7 firmware: Ax730_xxx or the POWER6 firmware Service Pack that will be released 2Q2011

VIOS

NPIV**

VIOS

NPIV**VIOSVIOSn/aVIOSVIOSVIOSVIOS

IFS

(NAS)

IBM i Attach

IBM i Version

Hardware

IBM i Attach

IBM i Version

Hardware

6.1 / 7.1

POWER6/7

IFS / NFS

(NAS)

IFS / NFS

(NAS)

5.4 / 6.1 / 7.1

POWER5/6/7

N Series@@

6.1 / 7.1

POWER6/7

(BCH)

VIOS

6.1 / 7.1

POWER6/7

SVC

6.1 / 7.1

POWER6/7

(BCH)

VIOS

6.1 / 7.1

POWER6/7

XIV

Not

supported

Direct

5.4 / 6.1

POWER5/6/7

Not 7.1 ###

POWER5/6/7

DS6800

6.1 / 7.1

POWER6/7

(BCH)

Direct or VIOS –VSCSI and

NPIV**

5.4 / 6.1 / 7.1

POWER5/6/7

DS8100

DS8300

6.1 / 7.1

POWER6/7

(BCH)

VIOS

6.1 / 7.1

POWER6/7

Storwize

V7000

6.1 / 7.1

POWER6/7

(BCH)

6.1 / 7.1

POWER6/7

(BCH)

6.1 / 7.1

POWER6/7

(BCH)

6.1 / 7.1

POWER6/7 @, #, ##Power

Blades

Rack / Tower

Systems

Table as of

April 5, 2011

Direct* or VIOS –VSCSI and

NPIV%

6.1 / 7.1

POWER6/7

DS5100DS5300

Direct or VIOS –VSCSI and

NPIV**

VIOSVIOS

5.4 / 6.1 / 7.1

POWER5/6/7

6.1 / 7.1

POWER6/7

6.1 / 7.1

POWER6/7

Not DS3200#,

Yes DS3500##

DS8700

DS8800

DS4700

DS4800

DS5020

DS3200

DS3400

DS3500

DS3950

For more details, use the System Storage Interoperability Center: www.ibm.com/systems/support/storage/config/ssic/Note there are currently some differences between the above table and the SSIC. The SSIC should be updated to reflect the above information

© 2012 IBM Corporation32

IBM Power Systems

IBM PowerVM Virtual Ethernet

� PowerVM Ethernet switch– Part of PowerVM Hypervisor– Moves data between LPARs

� Shared Ethernet Adapter– Part of the VIO server– Logical device– Bridges traffic to and from

external networks

� Additional capabilities– VLAN aware– Link aggregation for external networks– SEA Failover for redundancy

PowerVM Hypervisor

Virtual I/O Server

CMN(Phy)

SharedEthernetAdapter

CMN(Vir)

VLAN-Aware Ethernet Switch

Client 2

CMN(Vir)

Client 1

CMN(Vir)

EthernetSwitch

Page 17: POWER VM with IBM i and live partition mobility

17

© 2012 IBM Corporation33

IBM Power Systems

SEA Failover Configuration

VIOSV

ET

HPartition

VE

TH

SE

A

ET

H

Hypervisor

VE

TH

VIOS

SE

A

ET

H

VE

TH

VE

TH

ClientnetworkNetwork

Partition

VE

TH

VE

TH

© 2012 IBM Corporation34

IBM Power Systems

Virtual Ethernet Limits

8 primary, 1 backupMaximum number of physical adapters in a link aggregation

4094Maximum number of VLAN IDs

16Number of virtual adapter per single SEA sharing a single physical network adapter

21 VLAN (20 VID, 1 PVID)

Maximum number of VLANs per virtual adapter

256Maximum virtual Ethernet adapters per LPAR

LimitDescription

Page 18: POWER VM with IBM i and live partition mobility

18

© 2012 IBM Corporation35

IBM Power Systems

PowerVM Active Memory Sharing

� Supports over-commitment of logical memory with overflow going to a paging device

� Intelligently flow memory from one partition to another for increased utilization and flexibility

� Memory from a shared physical memory pool is dynamically allocated among logical partitions as needed to optimize overall memory usage

� Designed for partitions with variable memory requirements

� PowerVM Enterprise Edition on POWER6 and Power7 processor-based systems

– Partitions must use VIOS for I/O virtualization* All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

POWER Server

VirtualI/O

Server

Paging

PowerVM Hypervisor AMS

DedicatedMemory

CPU

Shared Memory

Shared CPU

�Reduce memory costs by improving memory utilization on Power Servers

© 2012 IBM Corporation36

IBM Power Systems

AMS Geographic Mirroring Environment

DS3200

JS12 in BladeCenter

DS3200

VIOS IBM i IBM i

SAS

DS3K

BCS3B2P2BCS3B2P1 BCS3B2P3

10 drivesIASP

10 drivesIASPGeographic

Mirroring

5 drivesysbas

5 drivesysbas

16 GB Total Physical Mem

IBM i 1

12 GBIBM i 212 GB

MEMORY

PagingDevices

Page 19: POWER VM with IBM i and live partition mobility

19

© 2012 IBM Corporation37

IBM Power Systems

LPAR Suspend/Resume – Customer Value

� Resource balancing for long-running batch jobs– e.g. suspend lower priority and/or long running workloads to free resources.

� Planned CEC outages for maintenance/upgrades– Suspend/resume may be used in place of or in conjunction with partition

mobility.

– Suspend/resume may require less time and effort than manual database

shutdown and restart, for example

Requirements:• All I/O is virtualized

• HMC version 7 releases 7.3

• FW: Ax730_xxx

• IBM i 7.1 TR2

• VIOS 2.2.1.0 FP24 SP2

© 2012 IBM Corporation38

IBM Power Systems

StorageSubsystem

ReservedStorage PoolLUN

Validate environment for appropriate

resources

Power7 System #1

A

Hypervisor

VIOS

A

vscsi0

vtscsi0

vhost0

fcs0

en2(if)

VLAN

ent2SEA

ent0

ent1

en0(if)

ent1

MoverService

VASI

Suspended PartitionIBM i Client 1

Partition Suspended

Suspend Partition CPU and I/O

Ask partiton if it’s ready for suspend

M M M M M M

Partition Suspend/Resume supported on POWER7IBM i 7.1 TR2

C

Move Memory and CPU to Storage Pool

C C

Partition Suspend/Resume

Page 20: POWER VM with IBM i and live partition mobility

20

© 2012 IBM Corporation39

IBM Power Systems

39

Rebalance processing power across servers when and

where you need it

Reduce planned downtime by moving workloads to another server during

system maintenance

Movement to adifferent server with no loss of

service

Virtualized SAN and Network InfrastructureVirtualized SAN and Network Infrastructure

Live Partition Mobility requires the purchase of the optional PowerVM Enterprise Edition

Move a running partition from one Power7 server to another with no application downtime

Live Partition Mobility

© 2012 IBM Corporation40

IBM Power Systems

PowerVM Live Partition Mobility

•Move running partition from one system to another with almost no impact to end users

•Requires POWER7 systems or later, PowerVM

Enterprise, and all I/O must be through the Virtual I/O Server

•Will require IBM i 7.1 with TR4

Potential Benefits• Eliminate planned outages • Balance workloads across systems• Energy Savings

Movement of the OS and

applications to a different server with no loss of

service

Virtualized storage and Network InfrastructureVirtualized storage and Network Infrastructure

Live Partition Mobility

IBM i 7.1 TR4

Page 21: POWER VM with IBM i and live partition mobility

21

© 2012 IBM Corporation41

IBM Power Systems

Requirements & Planning

� Source and destination must be mobility capable and compatible.– Enhanced hardware virtualization capabilities.– Identical or compatible processors.– Compatible firmware levels.

� Source and destination must be LAN connected – same subnet.

� All resources (CPU, Memory, IO adapters) must be virtualized prior to migration.– Hypervisor will handle CPU and Memory

automatically, as required. Virtual IO adapters are pre-configured, and SAN-attached disks accessed through Virtual IO Server (VIOS)

� Source and destination VIOS must have symmetrical access to the partition’s disks.– e.g. no internal or VIOS LVM-based disks.

� OS is migration enabled/aware.– Certain tools/middleware can benefit from being

migration aware also.

SAN

LAN

BootPaging

Application Data

LPAR

HMC

© 2012 IBM Corporation42

IBM Power Systems

42

Partition Mobility: Active and Inactive LPARs

Active Partition Mobility� Active Partition Migration is the actual movement of a running LPAR from one

physical machine to another without disrupting the operation of the OS and applications running in that LPAR.

� Applicability� Workload consolidation (e.g. many to one)� Workload balancing (e.g. move to larger system)� Planned CEC outages for maintenance/upgrades� Impending CEC outages (e.g. hardware warning received)� Ability to move from Power7 servers to Power8 servers (when available)

without an outage

Active Partition Mobility� Active Partition Migration is the actual movement of a running LPAR from one

physical machine to another without disrupting the operation of the OS and applications running in that LPAR.

� Applicability� Workload consolidation (e.g. many to one)� Workload balancing (e.g. move to larger system)� Planned CEC outages for maintenance/upgrades� Impending CEC outages (e.g. hardware warning received)� Ability to move from Power7 servers to Power8 servers (when available)

without an outage

Inactive Partition Mobility� Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not

running) from one system to another.

Inactive Partition Mobility� Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not

running) from one system to another.

Suspended Partition Mobility� Suspended Partition Migration transfers a partition that is suspended from one

system to another.

Suspended Partition Mobility� Suspended Partition Migration transfers a partition that is suspended from one

system to another.

Page 22: POWER VM with IBM i and live partition mobility

22

© 2012 IBM Corporation43

IBM Power Systems

43

Requirements

� SDMC/HMC/Firmware� version 7 releases 7.5 � FW: 7.3.X SP, 7.4.X

� PowerVM Enterprise Edition� VIOS 2.2.1.4

� Supported client operating systems� IBM i 7.1 TR4

Software

I/O� All I/O through the VIOS

�VSCSI, NPIV, VE

� External Storage

�Same storage to both source and destination

� Power7 Hardware

�Both source and destination on same Ethernet network

© 2012 IBM Corporation44

IBM Power Systems

44

MOnce enough memory

pages have been moved, suspend the

source system

Create shell partition on target system

Validate environment for appropriate

resources

Live Partition Mobility

Power7 System #2Power7 System #1

StorageSubsystem

A

HMC

Hypervisor

VIOS

A

DC01

vtscsi0

vhost0

fcs0

en2(if)

VLAN

ent2SEA

ent0

ent1

LIN1

CMN01

Hypervisor

VIOS fcs0

en2(if)

VLAN

ent2SEA

ent0

ent1

A

DC01

LIN1

CMN01

vtscsi0

vhost0

MoverService

VASI

MoverService

VASI

Shell PartitionSuspended Partition IBM i Client 1IBM i Client 1Finish the migration

and remove the original LPAR

definitions

Start migrating memory pages

Create virtual SCSI devices

M M M M M M M M M M M M MMM

Partition Mobility supported on POWER7IBM i 7.1 TR4

Page 23: POWER VM with IBM i and live partition mobility

23

© 2012 IBM Corporation45

IBM Power Systems

45

If using 5250 interactive support, ensure both the source and target systems have the "5250 application capable" set to “True”.

© 2012 IBM Corporation46

IBM Power Systems

46

Configuration

Page 24: POWER VM with IBM i and live partition mobility

24

© 2012 IBM Corporation47

IBM Power Systems

47

VIOS - Mover service partition (MSP)

� Required for ACTIVE Partition Mobility only

� Maximum of four (4) concurrent migrations per control point

� Provides VIOS functions:– Asynchronously extracts, transports, installs partition state during

migrations

© 2012 IBM Corporation48

IBM Power Systems

48

Page 25: POWER VM with IBM i and live partition mobility

25

© 2012 IBM Corporation49

IBM Power Systems

49

© 2012 IBM Corporation50

IBM Power Systems

IBM i Restrictions� The logical partition must have all disks backed by physical volumes.

� The logical partition must not be assigned a virtua l SCSI optical or tape device or an NPIV attached tape device.

� The logical partition cannot be activated with a pa rtition profile which has a virtual SCSI server adapter: can not be hosting another par tition.

� The logical partition cannot be activated with a pa rtition profile which has a virtual SCSI client adapter that is hosted by another IBM i logical partition: can not be a hosted partition.

� No virtual SCSI server adapters can be dynamically added to the logical partition.

� No virtual SCSI client adapters that are hosted by another IBM i logical partition can be dynamically added to the logical partition being moved.

� The logical partition must not be an alternative er ror logging partition.– An alternative error logging partition is a target from the HMC for error logs.

� The logical partition cannot collect physical I/O s tatistics.

� The logical partition must not be a time reference partition.– Used to synchronize time between partitions

• The VIOS partitions will do this automatically as part of the migration

50

Page 26: POWER VM with IBM i and live partition mobility

26

© 2012 IBM Corporation51

IBM Power Systems

51

IBM i + VSCSI Zoning Source

System 1VIOS IBM i Client

(System 1)

POWER7 with IBM i 7.1 TR4

FC HBA

Hypervisor

DestinationVIOS

POWER7 with IBM i 7.1 TR4

FC HBA

Hypervisor

All zoning is done to the physical HBA in the VIOS

Assign storage to the physical HBAs in both the VIOS lpars

Make sure to set no_reserve on the hdisks (chdev -dev hdiskX -attr reserve_policy=no_reserve)

© 2012 IBM Corporation52

IBM Power Systems

52

IBM i + NPIV Zoning for Mobility

Source

VIOS IBM i Client (System 1)

POWER7 with IBM i 7.1 TR 4

System 1

8Gbs HBA

Hypervisor

Destination VIOS

POWER7 with IBM i 7.1 TR 4

8Gbs HBA

Hypervisor

1. Zone your storage ports to both WWPNson the Virtual FibreChannel Adapter.

2. Zone both source and target VIOSes to see the same FC targets

3. Only assign storage to the virtual WWPNs

Page 27: POWER VM with IBM i and live partition mobility

27

© 2012 IBM Corporation53

IBM Power Systems

53

Processor Pool assignment upon Migration?

© 2012 IBM Corporation54

IBM Power Systems

� Questions

Page 28: POWER VM with IBM i and live partition mobility

28

© 2012 IBM Corporation55

IBM Power Systems

Requirements

If you have items your business requires, Submit a requirement!

Help IBM understand how we can help you.

© 2012 IBM Corporation56

IBM Power Systems

Page 29: POWER VM with IBM i and live partition mobility

29

© 2012 IBM Corporation57

IBM Power Systems

© 2012 IBM Corporation58

IBM Power Systems

58

Migration Process

Page 30: POWER VM with IBM i and live partition mobility

30

© 2012 IBM Corporation59

IBM Power Systems

59

Source Managed System – Migrating From

Destination Managed System – Migrating To

© 2012 IBM Corporation60

IBM Power Systems

60

� Validate - Live Partition Mobility and Mobility Readiness Check

� Migrate - Live Partition Mobility via Wizard

� Recover – Process implemented after Failed Migration

Logical Partition Mobility - Processes

Page 31: POWER VM with IBM i and live partition mobility

31

© 2012 IBM Corporation61

IBM Power Systems

61

� Validate - Live Partition Mobility and Mobility Readiness Check

� Select the IBM i partition to be validated

� Operations – Mobility - Validate

Logical Partition Mobility - Process

© 2012 IBM Corporation62

IBM Power Systems

62

Page 32: POWER VM with IBM i and live partition mobility

32

© 2012 IBM Corporation63

IBM Power Systems

63

Migration Validation

© 2012 IBM Corporation64

IBM Power Systems

64

HMC validation� Checks the source and destination systems, POWER Hypervisor, Virtual I/O

� Servers, and mover service partitions for active partition migration capability and compatibility

� Checks that the RMC connections to the mobile partition, the source and destination Virtual I/O Servers, and the connection between the source and destination mover service partitions are established

� Checks that there are no required physical adapters in the mobile partition and that there are no required virtual serial slots higher than slot 2

� Checks that no client virtual SCSI disks on the mobile partition are backed by logical volumes and that no disks map to internal disks

� Checks the mobile partition, its OS, and its applications for active migration capability.

� Checks that the logical memory block size is the same on the source and destination systems

� Checks that the mobile partition is not configured with barrier synchronization registers

� Checks that the mobile partition is not configured with huge pages

� Checks that the partition state is active or running

� Checks that the mobile partition is not in a partition workload group

� Checks the uniqueness of the mobile partition’s virtual MAC addresses

� Checks that the mobile partition’s name is not already in use on the destination server

� Checks the number of current active migrations against the number of supported active migrations

Page 33: POWER VM with IBM i and live partition mobility

33

© 2012 IBM Corporation65

IBM Power Systems

65

IBM i Validation

� During validation HMC sends a command to the partition to prepare for hibernation.

� Work Management has 3 exit points for suspend/resume or mobility– The first one exit program to ask if it’s ok to proceed.– The exit program is called again for any action required before the

operation.– The exit for resume is called after the partition is resumed or moved

and it allows for any necessary cleanup.

� Current functions that will prevent suspend/resume– The partition is a member of an active cluster– A tape resource varied on.*

� Current functions that will prevent a migration– A tape resource varied on

© 2012 IBM Corporation66

IBM Power Systems

66

� No Network Connection – RMC won’t function

� Internal Storage would cause another failure on Validation - must be shared external storage

Page 34: POWER VM with IBM i and live partition mobility

34

© 2012 IBM Corporation67

IBM Power Systems

67

© 2012 IBM Corporation68

IBM Power Systems

68

Page 35: POWER VM with IBM i and live partition mobility

35

© 2012 IBM Corporation69

IBM Power Systems

69

Migrated partition “y0112p6” to destination server

© 2012 IBM Corporation70

IBM Power Systems

70

Migrate

Page 36: POWER VM with IBM i and live partition mobility

36

© 2012 IBM Corporation71

IBM Power Systems

Migration wizard

71

© 2012 IBM Corporation72

IBM Power Systems

Migration wizard continued…

72

Page 37: POWER VM with IBM i and live partition mobility

37

© 2012 IBM Corporation73

IBM Power Systems

Migration wizard continued…

73

© 2012 IBM Corporation74

IBM Power Systems

Migration wizard continued…

74

Page 38: POWER VM with IBM i and live partition mobility

38

© 2012 IBM Corporation75

IBM Power Systems

Migration wizard continued…

75

© 2012 IBM Corporation76

IBM Power Systems

Migration wizard continued…

76

Page 39: POWER VM with IBM i and live partition mobility

39

© 2012 IBM Corporation77

IBM Power Systems

Migration wizard continued…

77

© 2012 IBM Corporation78

IBM Power Systems

Performance Considerations

� Active partition migration involves moving the stat e of a partition from one system to another while the partition is s till running.– Partition memory state is tracked while transferring memory state to

the destination system– Multiple memory transfers are done until a sufficient amount of

clean pages have been moved.

� Memory updates on the source system affect transf er time– Reduce the partition’s memory update activity prior to the migration

� Network speed affects the transfer time– Use a dedicated network, if possible– At least 1Gb speed– Possibly use link aggregated ports for more bandwidth

78

Page 40: POWER VM with IBM i and live partition mobility

40

© 2012 IBM Corporation79

IBM Power Systems

Application impacts during migration

� In general, applications and the operating system are unaware that the partition is moved from one system to another.

� There are some exceptions to this:– Collection Services; when the partition is starting to run

on the target system, the Collection Services collector job will cycle the collection so correct hardware information is recorded on the target system.

79

© 2012 IBM Corporation80

IBM Power Systems

806/12/2012

Workload (Virtual Server) Resilience within a System Pool

� Relocate Virtual Servers between Hosts within the P ool- Determine best host placement within the pool- Supports single virtual servers and host evacuation

� Move virtual servers away from a failing host syste m.- Automate relocation and placement of virtual servers in response to

predicted host system failures with no disruption.

� Restart virtual servers when a host system fails.- Automate remote restart and placement of virtual servers in response

to host system failures with minimal disruption.- From a checkpoint in the future.

� Resilience policy associated with the workload- Provide workload resilience – yes/no- Enables host system monitoring for failures and predictive failures- Automates recovery action based on desire level of automation

� Automation policy associated with the workload- Automate = Advise / Automate- Advise – VMControl recommends actions and requires confirmation- Automate – VMControl automates actions

View In Animation Mode

System Pool (Ensemble)

Page 41: POWER VM with IBM i and live partition mobility

41

© 2012 IBM Corporation81

IBM Power Systems

Resources and references

� Techdocs – http://www.ibm.com/support/techdocs(presentations, tips & techniques, white papers, etc.)

� IBM PowerVM Virtualization Introduction and Configuration - SG24-7940http://www.redbooks.ibm.com/abstracts/sg247940.html?Open

� IBM PowerVM Virtualization Managing and Monitoring - SG24-7590http://www.redbooks.ibm.com/abstracts/sg247590.html?Open

� IBM PowerVM Virtualization Active Memory Sharing – REDP4470http://www.redbooks.ibm.com/abstracts/redp4470.html?Open

� IBM System p Advanced POWER Virtualization (PowerVM) Best Practices - REDP4194http://www.redbooks.ibm.com/abstracts/redp4194.html?Open

� Power Systems: Virtual I/O Server and Integrated Virtualization Manager commands (iphcg.pdf)

http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/iphcg/iphcg.pdf

© 2012 IBM Corporation82

IBM Power Systems

Our Mission and Profile

� Support the IBM Systems Agenda and accelerate the adoption of new products and solutions

� Maximize performance of our clients’ existing IBM systems

� Deliver technical training, conferences, and other services tailored to meet client needs

� Team with IBM Service Providers to optimize the deployment of IBM solutions (GTS, GBS, SWG Lab Services and our IBM Business Partners)

Our Competitive Advantage

� Leverage relationships with the IBM development labs to build deep technical skills and exploit the expertise of our developers

� Combined expertise of Lab Services and the Training for Systems team

� Skills can be deployed worldwide to assure all client needs can be met

Mainframe Systems

Power Systems

System x & Bladecenter

System Storage

IT Infrastructure Optimization

Data Center Services

Training Services

IBM Systems Lab Services and Training

Successful worldwide history: 17 years in Americas, 9 years in Europe/Middle East /Africa,

5 years in Asia Pacific

www.ibm.com/systems/services/labservices [email protected]

Page 42: POWER VM with IBM i and live partition mobility

42

© 2012 IBM Corporation83

IBM Power Systems

Performance and Scalability Services� The IBM i Performance & Scalability Services Center in Rochester can provide facilities, hardware and technical expertise

to assist you in testing hardware or software changes

� “Traditional” benchmarks

� Proofs of Concept (e.g. HA alternatives, SSD analysis, external storage, etc.)

� Stress test your system

� Evaluate application scalability

� Performance optimization and tuning

� Assess application performance when migrating to a new release of IBM i

� Determine impact of application changes

� Virtualization, consolidation, migration services

� Release-to-release upgrades

� Capacity planning

� .… all with the availability of Lab Services IBM i experts and development personnel

� To request any of these services, submit at:

• http://www.ibm.com/systems/services/labservices/psscontact.html

• Or email Cindy Mestad at [email protected]

© 2012 IBM Corporation84

IBM Power Systems

84

Trademarks

The following are trademarks of the International B usiness Machines Corporation in the United States, other countries, or both.

The following are trademarks or registered trademar ks of other companies.

* All other products may be trademarks or registered trademarks of their respective companies.

Notes : Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area.All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.

For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml:

*, AS/400®, e business(logo)®, DBE, ESCO, eServer, FICON, IBM®, IBM (logo)®, iSeries®, MVS, OS/390®, pSeries®, RS/6000®, S/30, VM/ESA®, VSE/ESA, WebSphere®, xSeries®, z/OS®, zSeries®, z/VM®, System i, System i5, System p, System p5, System x, System z, System z9®, BladeCenter®

Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not actively marketed or is not significant within its relevant market.

Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.


Recommended