Veritas Cluster Server Deep Dive
Anthony Herr Product Manager, Information Availability
SYMANTEC VISION 2013
Disclaimer
Any information regarding pre-release Symantec offerings, future updates or other planned modifications is subject to ongoing evaluation by Symantec and therefore subject to change. This information is provided without warranty of any kind, express or implied. Customers who purchase Symantec offerings should make their purchase decision based upon features that are currently available.
2 IA B06:VCS Deep Dive
SYMANTEC VISION 2013
Tiers of Availability
Disaster Recovery
High Availability
Just-In-Time Availability
Application Management
IA B06:VCS Deep Dive 3
SYMANTEC VISION 2013
Tiers of Availability
Disaster Recovery
High Availability
Just-In-Time Availability
Application Management
Business Continuity
IA B06:VCS Deep Dive 4
SYMANTEC VISION 2013
Tiers of Business Continuity
• Application Management
– Manage applications without in-depth application knowledge
– Ensure an application stays online even without a failover target
• Single Pane-of-Glass Configuration and Control
– Allow an enterprise view and manageability across UNIX/Linux/Windows hosts
– Enables notification, health checks and reporting over the enterprise
• Multi-Tier Application Support
– Enable top to bottom visibility of an application that crosses OS boundaries
– Provide cross application dependencies on different cluster
• High Availability and Disaster Recovery
– Ensure an application (physical or virtual environment) maintains its availability
– Supports an application’s Service Level Agreement (SLA)
IA B06:VCS Deep Dive 5
SYMANTEC VISION 2013
Agenda
IA B06:VCS Deep Dive 6
Updated VCS Features 1
I/O Fencing 2
Multi-Tier Application Support 3
Availability in Virtualized Environments 4
A Sneak Peak at Upcoming VCS Features 5
SYMANTEC VISION 2013
Updated VCS Features
IA B06:VCS Deep Dive 7
SYMANTEC VISION 2013
How does VCS Monitor Applications?
• Legacy(Poll Based) Monitoring
– Checks to see if the application is online or offline over an interval of time
– Attributes for VCS monitoring which are controlled per resource type:
• MonitorInterval when the application is online (default 60 sec)
• OfflineMonitorInterval when the application is offline (default 300 sec)
• MonitorTimeout is the amount of time given to a monitor process before giving up (default 60 sec)
– Resources are monitored on all systems they are configured to run on
• If an Oracle database is configured to run on a 3 node cluster then each of the three systems will validate the state of the resource based on the current resource state—online/offline
– Each instance of a resource is monitored
• If there are 20 mount resources in a service group, then 20 monitors will be run per system in the cluster based on the current resource state—online/offline
IA B06:VCS Deep Dive 8
SYMANTEC VISION 2013
Faulting…
Traditional Monitoring Framework
Most Clustering Solutions Poll based Monitoring
Resources Being Monitored
• Time to Detect • CPU Cost for polling • Limits number of Resources
From polling to asynchronous monitoring Faster failure detection
Polling
IA B06:VCS Deep Dive 9
Faulted
SYMANTEC VISION 2013
Intelligent Monitoring Framework
Veritas Cluster Server (Introduced in version 5.1 SP1)
Resources Being Monitored
From polling to asynchronous monitoring Faster failure detection
Asynchronous
IA B06:VCS Deep Dive 10
Registering…
Intelligent Monitoring Faulted
• Immediate fault detection • Zero polling overhead • Automatic Enablement
SYMANTEC VISION 2013
IMF Enabled Agents for UNIX/Linux:
• VCS 6.0.1 – OpenIMF
– DiskGroup Agent
• VCS 6.0
– Virtualization based agents
• Solaris Zones
• AIX WPAR
– Application agents
• Sybase
– IMF updates
• Agent Framework update (Custom Agent support
• Support for IMF-PCV
Prevention of Concurrency Violation
Application Agent with MonitorProcesses
• VCS 5.1 SP1
– Process based agents
• Physical environments, containers
– IMF is enabled for Process agents
running within a container
• Oracle agent, Netlsnr agent
• CVMvxconfigd
• DB2 agent with VCS 5.1SP1RP1
– Mount based agents
• Mount, CFSMount
– Application agent
• Using PidFiles or MonitorProcess for Application Agent monitoring
IMF support is continually expanding as updates to agents are introduced in quarterly agent packs
IA B06:VCS Deep Dive 11
SYMANTEC VISION 2013
IMF coverage for Windows
– GenericSerivce
– ServiceMonitor
– IP
– NIC
– MountV
– Mount
– VMDg
– Oracle
– NetLsnr
– Process
– RegRep
– SQLServer2005
– SQLAgService2005
– SQLOlapService2005
– MSDTC
– SQLServer2008
– IIS
– ExchService2007
– Exchange2010DB
• VCS 6.0
IA B06:VCS Deep Dive 12
SYMANTEC VISION 2013
From detection to prevention of concurrent application Reduced administrative overhead and data risk
IA B06:VCS Deep Dive 13
Concurrency Violation Detection
N1 (Active)
N2 (Standby)
Concurrency Violation
App App Reactive
• Concurrency Detection Delayed • Offline Monitoring • Protection Reactive
SYMANTEC VISION 2013
From detection to prevention of concurrent application Reduced administrative overhead and data risk
IA B06:VCS Deep Dive 14
Concurrency Violation Prevention
N1 (Active)
N2 (Standby)
Concurrency Violation
App App
• Concurrency Detection Immediate • IMF Offline Monitoring • Protection Proactive
Proactive
SYMANTEC VISION 2013
I/O Fencing IA B06:VCS Deep Dive 15
SYMANTEC VISION 2013
From disk based to network based arbitration Reduced data risk in more environments
SCSI3-Persistent Reservation Based Data Protection
Coordinator Disks
N1 (Active)
N2 (Standby)
Data Disks
Winner
IA B06:VCS Deep Dive 16
• SCSI3-PR Data Protection • Membership Arbitration • Supports CPS and Coordinator Disks
SYMANTEC VISION 2013
From disk based to network based arbitration Reduced data risk in more environments
Coordination Point Server Based Protection
IA B06:VCS Deep Dive 17
• CP Servers used for Multiple Clusters • Focused on Environments without SCSI3 support
Coordinator Point Servers
N1 (Active)
N2 (Standby)
Data Disks
Winner
SYMANTEC VISION 2013
I/O Fencing Protecting against Split-Brain
Membership Arbitration Split-Brain Protection
• On membership change, each subcluster will elect a racer node to race for the CP Servers
• The first racer node to reach CP server will remove the registration of other racer node from CP server
• The racer node which has its registration on greater than ½ of the configured CP servers is the winner
• The losing racer node alerts all losing nodes in the subcluster to panic, resolving the network partition
IA B06:VCS Deep Dive 18
Coordinator Point Servers (CPS)
Winner
APP APP
SYMANTEC VISION 2013
From neutral to preferred fencing Avoid unnecessary application failover
Traditional Fencing Preferred Fencing
IA B06:VCS Deep Dive 19
N1 (Active)
N2 (Standby)
Needless failover to handle network split
APP
N2 (Down)
N1 (Active)
APP
N1 (Down)
N2 (Active)
APP
N1 (Active)
N2 (Standby)
N1 (Active)
N2 (Standby)
Preferred Node
Arbitration in favor of preferred node
APP
APP
SYMANTEC VISION 2013
Multi-tier Application Support IA B06:VCS Deep Dive 20
SYMANTEC VISION 2013
Multi-Tier Applications & Services
Database
Application
Web server
Billing
DB
FS IP
VVR
Service Group
VCS
App
IP
Service Group
VCS
Web
VM
Service Group
Web
VM
Service Group
ApplicationHA
Veritas Cluster Server HA/DR
Veritas Cluster Server HA
Symantec ApplicationHA
app app app
Veritas Operations Manager
IA B06:VCS Deep Dive 21
SYMANTEC VISION 2013
Transition to Virtual Business Service Seamlessly
Database SG
Application Server SG
Web Server SG
Billing Virtual Business Service
Veritas Operations Manager
Start/Stop Order
Inter-cluster fault policy
Database
Application
Web server
Billing
app app app
DB
FS IP
VVR
Service Group
VCS
App
IP
Service Group
VCS
Web
VM
Service Group
Web
VM
Service Group
ApplicationHA
IA B06:VCS Deep Dive 22
SYMANTEC VISION 2013
Veritas Operations Manager
How Virtual Business Service Works Start/Stop Orchestration
Communication Flow Between Clusters
Apache1_sg
Oracle_Apps_sg
Oracle_sg
Billing Virtual Business Service
VBS
VBS
VBS
START
START
START
Simplicity • Single sign-on • VM start/stop • Also through CLI
START
IA B06:VCS Deep Dive 23
SYMANTEC VISION 2013
How Virtual Business Service Works High Availability
Fault Propagation Between Clusters
Apache1_sg
Oracle_Apps_sg
Oracle_sg
Billing Virtual Business Service
VBS
VBS
VBS
Configurable Fault Reaction • Soft • Firm • Restart
Automatic Fault Propagation • No external brain • No heartbeats • Secure
Soft
Restart
IA B06:VCS Deep Dive 24
SYMANTEC VISION 2013
VBS
VBS
VBS
VBS
VBS
VBS
Veritas Operations Manager
How Virtual Business Service Works Disaster Recovery
Leveraging VCS Global Clusters for Service Level DR
Apache1_sg
Oracle_Apps_sg
Oracle_sg
Billing Production VBS
Flexibility • Production & DR can have
different configurations
Billing DR VBS
START
START
START
Apache2_sg
Oracle_Apps2_sg
Oracle2_sg
STOP
STOP
VCS HA/DR
DR
STOP START
No new infrastructure • Leverages existing Global Cluster
for DR of entire service
IA B06:VCS Deep Dive 25
SYMANTEC VISION 2013
Virtual Business Service Unparalleled Support Matrix
Operating Systems
Solaris
HP-UX
AIX
Linux
Windows
Virtualization
VMware
OracleVM, Zones
WPAR, LPAR
KVM
Hyper-V
High Availability
VCS 5.1, 6.0
VCS 5.1 SP1 (Unix)
VCS 5.1 SP2 (Win)
ApplicationHA 5.1 SP2
ApplicationHA 6.0
Databases
Oracle
Sybase
SAP
DB2
MySQL
Applications
Informatica
WebSphere
Microsoft Exchange
WebLogic
PeopleSoft
Replication
Veritas Replicator
Oracle Dataguard
EMC SRDF
NetApp SnapMirror
IA B06:VCS Deep Dive 26
SYMANTEC VISION 2013
Availability in Virtualized Environments IA B06:VCS Deep Dive 27
SYMANTEC VISION 2013
Virtualization brings challenges for visibility and availability of applications
IA B06:VCS Deep Dive 28
• Application manageability
• OS and application visibility
Application Control & Visibility
VMware ESX
VM C
OS
VM B
SQL
OS
VM A
ORA
OS
• Reduce downtime
• Reduce outage during OS & application patching
Application Recovery
• Application relationships
• Physical and virtual
Multi-tier Application Management
VMware ESX
VM C
OS
VM B
ISS
OS
VM A
ORA
OS
VMware ESX
VM C
OS
VM B
ISS
OS
SQL
VM A
ORA
OS
VMware ESX
VM C
OS
VM B
ISS
OS
SQL
VM A
ORA
OS
VMware ESX
VM C
OS
VM B
ISS
OS
SQL
VM A
ORA
OS
• Application Management • Application Protection • Cross-Tier Service Protection
SYMANTEC VISION 2013
HOST Veritas Cluster Server
VM1
VM2
VMx
Veritas Cluster Server & Symantec ApplicationHA Application Availability in Virtualized Environments
App1 App2 Appx
Symantec Application
HA
Symantec Application
HA
Symantec Application
HA
Application Availability
Infrastructure Availability
ApplicationHA Support
• Solaris LDOM • Red Hat KVM • AIX DLPAR
IA B06:VCS Deep Dive 29
SYMANTEC VISION 2013 IA B06:VCS Deep Dive 30
VM3
OS
VM6
OS
VM1
OS
VM4
OS
VMware ESX
VMware ESX
VCS
VMware HA VMware HA
VMware ESX
VMware HA
SQL1 SQL1
ApplicationHA ApplicationHA ApplicationHA
Jboss SAP1 SAP1 SQL1 IIS
OS
ORA1 ORA1
VM2
OS
ORA1 ORA1
VCS
Configured on Windows and Linux VMware Virtual Machines
Enables Wizard Based Auto Configurations
Provides Application protection within the Virtual Machine
Managed through a vSphere plug-in or Veritas Operations Manager (VOM)
Works in conjunction with VMwareHA
Supports VMware vMotion
ORA1
Symantec Availability with VMware Virtual Machines
SYMANTEC VISION 2013
Using the power of VCS to control VM access to storage
IA B06:VCS Deep Dive 31
Graceful Switchover:
• When the application SG is switched from VM1 to VM2
– The offline routine of VMwareDisks detaches the disks from VM1
– The online routine on the failover target node then attaches the disks to VM2.
• VCS also supports:
―DRS
―SRM
―vMotion
PrivateLinks
VM1 Boot VM2 Boot
SQL Data
Shared Datastore
Detach Data Disks
VM1
SQL
ESXi 1
Offline SQL
Attach Data Disks
to VM2
Online SQL
VM1
SQL
ESXi 1
VM2
SQL
ESXi 2
VM2
SQL
ESXi 2
SYMANTEC VISION 2013
VCS Upcoming Features IA B06:VCS Deep Dive 32
SYMANTEC VISION 2013
SFHA 6.1 Beta Program
Beta Program Options Download Beta Program
– Install on your site
Sales Led Customer Enablement Beta Program
– Cloud VMs
Customer Ease of Use Program
- Symantec Connect Group
https://www-secure.symantec.com/connect/groups/storage-foundation-and-veritas-cluster-server-61-beta-program
See the VCS Vision Booth for more info
SFHA Certification
IA B06:VCS Deep Dive 33
Thank you!
Copyright © 2012 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.
IA B06:VCS Deep Dive 34
Anthony Herr