+ All Categories
Home > Documents > SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform...

SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform...

Date post: 18-Apr-2020
Category:
Upload: others
View: 9 times
Download: 0 times
Share this document with a friend
20
000042 Best Practices SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide Abstract This document provides best practices and configuration guidelines for Dell EMC XC Series Appliances and XC Core Systems for SAP HANA deployment using 14th generation PowerEdge technology and Nutanix software. December 2019
Transcript
Page 1: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

000042 Best Practices

SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide

Abstract

This document provides best practices and configuration guidelines for

Dell EMC XC Series Appliances and XC Core Systems for SAP HANA

deployment using 14th generation PowerEdge technology and Nutanix

software.

December 2019

Page 2: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Revisions

2 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

Revisions

Date Description

September 2018 Initial release

September 2018 Minor updates.

December 2018 Added new image with added node

December 2019 Updated to include support for Intel Xeon Cascade Lake processor

The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the information in this

publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose.

Use, copying, and distribution of any software described in this publication requires an applicable software license.

© 2019 Dell Inc. or its subsidiaries. All Rights Reserved. Dell, EMC, Dell EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other

trademarks may be trademarks of their respective owners.

Dell believes the information in this document is accurate as of its publication date. The information is subject to change without notice.

Page 3: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Table of contents

3 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

Table of contents

Revisions............................................................................................................................................................................. 2

Table of contents ................................................................................................................................................................ 3

Executive summary ............................................................................................................................................................. 5

1 Introduction ................................................................................................................................................................... 6

1.1 Objectives ........................................................................................................................................................... 6

1.2 Audience ............................................................................................................................................................. 6

1.3 Terminology ........................................................................................................................................................ 6

2 Technology overview .................................................................................................................................................... 7

2.1 Dell EMC XC Family ........................................................................................................................................... 7

2.2 Dell EMC XC Family architecture ....................................................................................................................... 8

2.3 SAP HANA .......................................................................................................................................................... 8

3 SAP HANA on Dell EMC XC Family ............................................................................................................................ 9

3.1 Cluster architecture ............................................................................................................................................ 9

3.2 SAP HANA VM configuration .......................................................................................................................... 10

3.3 Storage configuration ....................................................................................................................................... 10

3.4 CPU configuration............................................................................................................................................. 11

3.5 Memory configuration ....................................................................................................................................... 12

3.6 Drives layout ..................................................................................................................................................... 12

3.7 Network configuration ....................................................................................................................................... 12

4 Best practices and recommendations ........................................................................................................................ 13

4.1 Prerequisites ..................................................................................................................................................... 13

4.2 Design recommendation ................................................................................................................................... 13

4.2.1 CPU and memory ..................................................................................................................................... 13

4.2.2 Network .................................................................................................................................................... 14

4.2.3 Storage ..................................................................................................................................................... 14

4.2.4 High availability ........................................................................................................................................ 14

4.2.5 Additional settings .................................................................................................................................... 14

4.3 VM recommendation ........................................................................................................................................ 15

4.4 SAP HANA sizing considerations ..................................................................................................................... 16

4.5 Health check and performance monitoring ....................................................................................................... 16

4.5.1 Health check ............................................................................................................................................. 16

4.5.2 Software update ....................................................................................................................................... 17

4.5.3 Performance monitoring ........................................................................................................................... 17

Page 4: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

4 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

5 References ................................................................................................................................................................. 18

5.1 Dell EMC XC Family ......................................................................................................................................... 18

5.2 Nutanix .............................................................................................................................................................. 18

5.3 SAP HANA ........................................................................................................................................................ 18

A Appendix ..................................................................................................................................................................... 19

A.1 SAP HANA cluster setup used for certification ................................................................................................. 19

A.2 Certified configurations ..................................................................................................................................... 19

Page 5: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Executive summary

5 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

Executive summary

NOTE: The information in this document applies to both Dell EMC XC Series Appliances, and the Dell EMC

XC Core System offering. Sections or information that apply to only one of the offerings (XC Series or XC

Core) are called out explicitly.

This document provides all necessary guidelines and best practices to get the best of your SAP HANA

deployment on Dell EMC XC Family devices, which include both XC Series Appliances and XC Core Systems

and Nutanix AHV.

The Dell EMC XC Family is a hyperconverged solution that combines storage, compute, networking, and

virtualization using industry-leading Dell EMC PowerEdge™ servers and Nutanix software. By combining the

hardware resources from each server appliance into a shared-everything model for simplified operations,

improved agility, and greater flexibility, Dell EMC, and Nutanix together deliver simple, cost-effective solutions

for enterprise workloads.

The XC Family devices are hypervisor agnostic and support your choice of hypervisor. With a focus on ease-

of-use and the ability to rapidly deploy multiple virtualized workloads, the XC Family is the preferred platform

for many enterprises and midmarket customers alike. The XC Family devices use the Nutanix Distributed

Storage Fabric (DSF), which delivers a unified pool of storage from all appliances across the cluster, using

techniques including mirroring, replication, auto-tiering, error detection, failover, and automatic recovery. XC

Family delivers storage through multiple protocols such as NFS, SMB, and iSCSI while using standard

network infrastructure.

Page 6: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Introduction

6 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

1 Introduction

The Dell EMC XC Family integrates 14th generation PowerEdge server technology and Nutanix software to provide enterprise-class, infrastructure solutions for virtualized environments.

The XC Family incorporates many advanced software technologies that power leading cloud infrastructures and include key features such as:

• Hyperconverged – Seamlessly integrates server and storage resources in a self-healing system

• Software defined and distributed - Allows an IT professional to perform automatic software

deployment anywhere with a single click.

• Scale-out – Increase performance and/or capacity one node at a time, even across multiple

generations.

• Automation and analytics – Extensive automation and rich system-wide monitoring.

1.1 Objectives This paper documents:

• An overview of Dell EMC XC Series Appliances and XC Core Systems.

• An overview of SAP HANA.

• Dell EMC XC Family cluster configuration for SAP HANA.

• SAP HANA sizing considerations.

• SAP HANA best practices on Dell EMC XC.

1.2 Audience The document is intended for SAP HANA administrators, system administrators, storage administrators, and

presales architects who design mission-critical SAP HANA systems to be deployed on Dell EMC XC Family

devices. You should have basic knowledge of XC Family devices and Nutanix software.

1.3 Terminology Useful terminology

Term Description

CVM Controller Virtual Machine

DSF Distributed Storage Fabric

iDRAC Integrated Dell Remote Access Controller for remote server management

NUMA Non-Uniform Memory Access

Software-defined Software-defined delivers all services through software using proven Dell EMC hardware.

XC Family cluster An XC Family cluster is a hyperconverged infrastructure solution that consolidates compute and storage into a single integrated appliance and creates a distributed virtual computing platform. Each node in the cluster runs an industry standard hypervisor and all the appliances work together to form a cluster which is scalable.

LVM Linux Logical Volume Manager

Page 7: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Technology overview

7 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

2 Technology overview

2.1 Dell EMC XC Family The Dell EMC XC Family devices are a hyperconverged solution that combines storage, compute,

networking, and virtualization into an industry-proven appliance based on an x86 Dell PowerEdge™ server

running Nutanix software. Besides, it is worth noticing the devices are not just off the shelf PowerEdge. The

processor, memory, drives, firmware, and BIOS are tailored for Nutanix. By combining the hardware

resources from each device into a shared-everything model for simplified operations, improved agility, and

greater flexibility, Dell EMC, and Nutanix together deliver simple, cost-effective solutions for enterprise

workloads. Nutanix Distributed Storage Fabric (DSF) delivers a unified pool of storage from all nodes across

the cluster, using techniques including striping, replication, auto-tiering, error detection, failover, and

automatic recovery.

The XC Family architecture is a scalable cluster of high-performance appliances each running a standard

hypervisor and containing processors, memory, and local storage (consisting of SSD, NVMe, or combination

of both drives). The CVM running on each node aggregates the storage resources and make it available to all

hosts through a fault tolerant architecture. Each appliance runs virtual machines just like a standard

hypervisor host.

XC Family architecture

Page 8: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Technology overview

8 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

2.2 Dell EMC XC Family architecture Dell EMC XC Family provides a hyperconverged platform that uses Distributed Storage Fabric to share and

present local storage to all the virtual machines in the cluster. The general XC Family architecture is shown in

the following figure:

The nodes easily scale without the constraints of traditional storage.

DSF virtualizes the storage across all nodes and presents the same to the hypervisor as one large pool of

shared storage. The DSF replicates writes synchronously to at least one other XC Family node to ensure

cluster resiliency and availability. Local storage for each XC Family node in the architecture is presented as

one large pool of shared storage to the hypervisor. Data Locality of an XC Family node can keep compute,

and storage close together that helps in consistent performance and availability of the data.

In addition, DSF virtualizes local storage from all appliances into a unified pool. DSF uses local SSDs and

disks from all nodes to store virtual machine data. Virtual machines running on the cluster write data to DSF

as if they were writing to shared storage.

Dell EMC XC Family offers you choice of hypervisors without being locked-in.

The Nutanix CVMs are virtual machines running on AHV hosts. They have direct control of the drives on the

AHV hosts. They come preconfigured with modest settings so that you can start using the storage platform

without much startup time.

2.3 SAP HANA SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It

is a revolutionary platform that is best suited for performing real-time analytics and developing and deploying

real-time applications.

The data is kept in the RAM of one or multiple SAP HANA worker hosts. All database operations (reads,

inserts, updates, or deletes) are performed in the main memory of the host. This feature differentiates SAP

HANA from traditional databases, where only a part of the data is cached in RAM and the remaining data

resides on disk. To ensure that the SAP HANA database can be restored to its most recent committed state,

persistent storage is used to provide a fallback if there is failure.

Page 9: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

SAP HANA on Dell EMC XC Family

9 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

3 SAP HANA on Dell EMC XC Family Dell EMC XC Family supports up to three SAP HANA production VMs on a quad socket XC940 node and

one SAP HANA production VM dual socket XC740xd node. The minimum number of recommended nodes for

SAP HANA production scenario on an XC Family cluster are four nodes (three active nodes + one standby

node). This ensures the high availability of HANA VMs during one node failure. This section explains

recommended architecture for SAP HANA systems on Dell EMC XC Family devices.

3.1 Cluster architecture The Dell EMC XC Family cluster for SAP HANA consists of two socket XC740xd nodes or four socket XC940

nodes. It is recommended a minimum of four nodes and the mixing of two socket and four socket nodes is

allowed within a cluster. This approach provides flexibility as you can start small and scale based on your

requirements.

The cluster architecture that is shown in Figure 3 consists of a mix of both 2-socket and 4-socket nodes.

Here, one XC940 node and two XC740xd nodes were part of active nodes, with one SAP HANA production

system per socket. For example, the XC940 node was hosted with three production HANA VMs and the

XC740xd node was hosted with one production HANA VM. The fourth node (XC940) was a stand-by node.

This node must have equivalent compute resources available to accommodate the SAP HANA VMs during

node failure scenarios.

Dell EMC XC Family cluster set up for SAP HANA

Page 10: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

SAP HANA on Dell EMC XC Family

10 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

3.2

3.3

Figure 3 represents one of the Dell EMC XC Family cluster configurations that is supported for SAP HANA

deployments. The cluster is formed using two XC740xd nodes and two XC940 nodes with three active nodes

and one standby node for HA. Dell EMC representatives are available to assist in sizing and designing the

cluster configuration based on customer requirements.

SAP HANA VM configuration For production HANA systems on Dell EMC XC Family nodes, it is recommended one HANA VM per socket,

considering one dedicated socket for CVM. For a quad socket node, you can host three production HANA

VMs per node. For a dual socket node, you can host one production HANA VM per node.

For nonproduction HANA systems, you can allocate one HANA VM with half a node socket. You can host

three HANA nonproduction VMs on dual socket node and seven host HANA nonproduction VMs on the quad

socket node.

Figure 3 shows an XC Family cluster that is configured with five SAP HANA production VMs. Three HANA

production VMs are hosted on an XC940 node with one HANA production VM per XC740xd node. Each of

these VMs is set with host affinity to meet the above configuration.

Storage configuration All HANA VM storage was created by allocating number of vdisks (virtual disk) from the cluster storage pool

based on the HANA memory size and database storage requirement. This can be performed using Nutanix

PRISM VM update option.

On each VM, HANA data volume and log volumes were created by adding four vdisks each. LVM is used to

create two separate volume groups, each volume group is created using physical volumes. On each of these

two volume groups, two logical volumes are created with the stripe size of 64 KB and then mounted to HANA

data volumes and HANA log volumes. More details on LVM and volume groups are mentioned in VM recommendation section.

Page 11: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

SAP HANA on Dell EMC XC Family

11 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

3.4 CPU configuration

Dell EMC XC Family is SAP HANA certified for dual sockets and quad sockets CPUs with Intel ® Xeon ®

Gold or Intel ® Xeon ® Platinum processors (Skylake or Cascade Lake based) with minimum 8C/16T or

above.

Hyper-threading is a hardware technology on Intel processors that enables a physical processor core to act

like two processors. In general, there is a performance advantage of enabling hyper-threading on the newer

Intel processors.

Dell EMC does not recommend sharing of CPU sockets between SAP HANA production VMs (NUMA node

sharing). It is recommended using only one VM deployed on dual socket node (Dell EMC XC740xd) and 3

VMs on quad socket node (Dell EMC XC940). Besides, it is recommended that you set NUMA node affinity so

that all the cores of single socket are entirely allocated to a single VM.

Page 12: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

SAP HANA on Dell EMC XC Family

12 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

3.5 Memory configuration With the NUMA architecture, each processor has its local memory and can also access the non-local memory

of the other processors over an advanced memory controller. Even though this is a high-performance

connection, access to local memory is always faster than access to the non-local memory of the other

processors. The memory is equally divided and assigned to the VM when an XC740xd and the VM get 50

percent of the memory. With the XC940, the memory is divided to four equal chunks and allocated to three

VMs.

3.6 Drives layout The XC940 and XC740xd nodes support 24 drives (mix of SSDs and NVMe drives are supported). Based on

the capacity requirement, you can populate the nodes to achieve enough storage. Populate the NVMEs with

SSDs to achieve better I/O performance.

3.7 Network configuration Dell EMC XC Family supports both 10 GbE and 25 GbE networks for communication between the nodes, with

10 GbE minimum recommended network configuration. For better performance of SAP HANA systems, you

can consider a 25 GbE network with NVMe drives.

It is recommended keeping the same MTU size for all HANA VMs within the XC Family cluster. Mismatch in

MTU size between hosts and VM would lead to network instability and communication issues.

Network components

Components Description

Data and management network 10 GbE switch

XC Family internode connection (VM traffic) 10 GbE switch

iDRAC inband network 1 GbE switch

Cabling CAT6 coaxial and 10 G twin axial

Page 13: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Best practices and recommendations

13 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

4 Best practices and recommendations To deliver the best performance for SAP HANA on hyperconverged infrastructure on production environment,

you must verify specific settings and enable certain options. This section provides the best practices for

improving the performance of SAP HANA system.

4.1 Prerequisites The following are the prerequisites for a successful SAP HANA solution:

• Latest version of AHV hypervisor and Nutanix AOS is recommended.

• Apply operating system level patches and settings for HANA VMs as in the SAP note 2205917

(SLES).

• For a supported Operating System for SAP HANA, go to

http://service.sap.com/sap/support/notes/2235581.

• Verify that the XC Family cluster is in healthy state by performing health check option available from

Nutanix Prism. Details on health check and performance monitoring can be found in Health check

and performance monitoring.

4.2 Design recommendation There are certain parameters for you to consider while designing production SAP HANA systems on the XC

Family hyperconverged infrastructure.

4.2.1 CPU and memory This section outlines the best practices for CPU and memory.

• Dell EMC XC nodes for SAP HANA require Intel® Xeon® Skylake or Cascade Lake based Gold or

Platinum processors, offering different clock speeds and core counts.

• SAP allows installation of full socket SAP HANA production VMs with minimum eight physical cores

assigned.

• It is not recommended to share the socket of production HANA VM with controller VM or any VMs.

• The memory should be equally divided among the VMs in such a way that it is not shared. Over

commitment of memory would affect SAP HANA performance and therefore not recommended.

- For XC740xd, half of the total memory available is allocated to a single SAP HANA VM.

- For XC940, minimum 1/4th of the total memory available is allocated to a single SAP HANA

VM.

• For production HANA systems, ensure that following guidelines are followed:

- For dual socket platform – One VM with one socket worth of CPU and memory

- For quad socket platform – Maximum three VMs with one socket worth of CPU and memory

for each. If there are a smaller number of VMs, then you can assign more cores to the VMs.

- Example: Two VMs on quad core – First VM with one socket worth of CPU and memory,

second VM with two sockets worth of CPU and memory.

• For non-production HANA systems, configure VMs with half a socket worth of CPU and memory.

Note: This might lead to performance degradation.

Page 14: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Best practices and recommendations

14 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

4.2.2 Network This section outlines the best practices for networking.

• SAP HANA network communication must be separated in different logical networks for internode,

storage, backup, replication, client, and so on.

• When selecting and setting up SAP HANA production systems, follow the SAP HANA networking

recommendations as described in SAP HANA Network Requirements, which involves ensuring the

availability of enough physical and virtual network interfaces.

• Based on the SAP HANA production environment requirement, adequate VM network interfaces

should be configured for the various logical network configurations.

• These network requirements can be met using Dell EMC XC Family by configuring the nodes with

adequate number of physical network interfaces. For more details, see Dell EMC XC Family data

sheet.

4.2.3 Storage This section outlines the best practices for storage.

• For sizing the usable storage on Dell EMC XC Family clusters, it is recommended to use the SAP

Quick Sizer tool to determine the required capacity for the SAP HANA data and log devices.

• If the sizing details are not available, it is recommended to configure the usable storage size based

on SAP HANA database memory footprint. The usable storage space available is recommended to

be 4 * the SAP HANA database memory footprint. For more details on sizing, see the latest available

SAP note on HANA sizing consideration.

4.2.4 High availability The minimum number of nodes that are recommended for SAP HANA cluster with production systems are

four nodes (three active and one standby) to achieve high availability for the VMs.

Nutanix recommends planning for failover capacity in the form of N+1. It is recommended to follow the steps

in the Prism Web Console Guide to configure the cluster for high availability.

4.2.5 Additional settings It is not recommended to enable core data service features like compression, deduplication, and EC-X on the

storage container that holds the production database.

To ensure maximum performance and availability, adjust the following hypervisor settings:

1. To allow for energy saving when a CPU is idle, you can instruct the CPU to enter a low-power mode.

There are various power modes available to each CPU; the various power modes are referred to as

"C-states”. Nutanix recommends disabling C-states three and four.

2. To disable these modes automatically, run the following commands from one of the controller VMs:

hostssh chkconfig --add cstate hostssh service cstate start

Page 15: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Best practices and recommendations

15 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

4.3 VM recommendation The virtual machine recommendations are as follows:

• Use minimum four vdisks to create HANA data volumes and HANA log volumes respectively.

• Ensure that you have used the supported file system as described in SAP note 405827.

• Use of the Linux Logical Volume Manager (LVM) is fully supported by SAP, as described in SAP note

597415.

• Both HANA data volume and HANA log volume should be using separate LVM volume group with the

striping done using all physical volume in that volume group.

To create the respective file system, follow these steps:

1. Create log, data, and shared volume groups for SAP HANA:

vgcreate hanalog /dev/sd{b,c,d,e}

vgcreate hanadata /dev/sd{f,g,h,i}

vgcreate hanashared /dev/sdj

2. Create logical volumes for log and data striped across four vdisks with 64 K stripe size and

readahead= none. Use all logical extents of a volume group for the logical volumes:

lvcreate -i 4 -I 64 -l <LogicalExtentsNumber> -r none -n vol hanalog

lvcreate -i 4 -I 64K -l <LogicalExtentsNumber> -r none -n vol hanadata

lvcreate –l <LogicalExtentsNumber> -r none -n vol hanashared

3. Create XFS file systems on the log and data volumes.

mkfs.xfs /dev/mapper/hanalog-vol

mkfs.xfs /dev/mapper hanadata-vol

mkfs.xfs /dev/mapper hanashared-vol

4. Create mount points /hana/log, /hana/data and /hana/shared

mkdir -p /hana/{log,data,shared}

5. When creating the virtual machine, ensure that the following settings are in place:

a. VM NUMA affinity can be set by running the following acli command from host CVM, and ensure

the VMs are powered off before running this command:

acli vm.update <vm name> num_vnuma_nodes=<number of virtual sockets>

Example:

acli vm.update SAP-HANA num_vnuma_nodes=1

b. Memory allocation to the VMs can be changed either updating VMs from Nutanix Prism or from

CVM acli.

acli vm.update <vm name> memory=<memory size>

6. Power on the VM on host using:

vm.on <vm_name> host=<Hypervisor/host IP>

Page 16: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Best practices and recommendations

16 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

Once NUMA node affinity is set and memory is assigned, the details can be verified by running

following command from respective AHV host.

[root@NTNX-XXXXXX ~]# numastat qemu-kvm

Example of 2 sockets node with NUMA node affinity set for HANA VM -

Per-node process memory usage (in MBs)

PID Node 0 Node 1 Total

----------------- --------------- --------------- ---------------

7322 (qemu-kvm) 32813.17 4.78 32817.95

257682 (qemu-kvm) 15.34 184353.31 184368.64

----------------- --------------- --------------- ---------------

Total 32828.50 184358.09 217186.59

7. Enable the VM metrics host daemon as described in SAP note 2656072.

8. After installation of SAP HANA max_parallel_io_requests for Data and log can be set by running the

following command:

su - <sidadm>

hdbparam --show

hdbparam --paramset fileio.max_parallel_io_requests=256

Up to HANA1SP12, the hdbparam tool was part of the HANA installation and was used to manage a

subset of HANA configuration parameters. Starting with SAP HANA 2.0, the hdbparam command-line

tool has been deprecated. Instead, the parameters are defined as normal parameters in global.ini.

Set the parameter as follows in the global.ini file:

max_parallel_io_requests[DATA]=256

max_parallel_io_requests[LOG]=256

For more information, see SAP Note 2399079: Elimination of hdbparam in HANA 2.

4.4 SAP HANA sizing considerations With SAP HANA Tailored Datacenter Integration (TDI) phase 5, SAP introduced customer-workload-driven

SAP HANA system sizing. With this new sizing, SAP application performance standard (SAPS) requirements

for specific customer workloads are used to determine the type and number of processors that are required to

run SAP HANA. You can use the SAP HANA Quick Sizer tool and sizing reports and share the results with

Dell EMC to determine the optimal number of Dell EMC XC Family nodes, CPU types, and memory sizes for

their SAP HANA environment.

4.5 Health check and performance monitoring

4.5.1 Health check It is recommended to keep the cluster in a healthy state by regularly performing NCC health check option

available from Nutanix PRISM or running the following command from a Host CVM.

nutanix@NTNX-XXX:~$ ncc health_checks run_all

Page 17: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Best practices and recommendations

17 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

The Health dashboard displays dynamically updated health information about VMs, hosts, and disks in the

cluster.

Nutanix Prism Health Dashboard

4.5.2 Software update It is recommended to regularly update AOS, hypervisor, and firmware versions to the latest available.

4.5.3 Performance monitoring Monitor cluster performance for a wide range of parameters using Nutanix PRISM. The Analysis dashboard

lets you create charts that can monitor various performance measures. If required, you can export these

charts to any external system.

Nutanix Prism Analysis – Performance chart

Page 18: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

References

18 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

5 References See the following referenced or recommended resources that are related to this document:

Note: The referenced links are open to customers although some may require registration for access.

5.1 Dell EMC XC Family

• Dell EMC XC Series – Product page

https://www.dell.com/support/home/us/en/19/products/converged_infrastructure/hyperconverged_syst

ems/hyperconverged_systems_xcseries

• XC Series and XC Core Marketing page

https://www.dellemc.com/en-us/converged-infrastructure/xcseries/index.htm

• XC Series and XC Core Solutions document page

https://www.dellemc.com/en-us/converged-infrastructure/xcseries/technical-resources.htm

• Dell EMC 14th Generation Datasheet

https://www.dellemc.com/en-us/collaterals/unauth/data-sheets/xc-series-data-sheet.pdf

• Dell EMC XC Series Networking Deployment and Best Practices Guide v2.0

https://downloads.dell.com/solutions/networking-solution-

resources/XC_Series_Networking_Guide_v2.0.pdf

5.2 Nutanix • The Nutanix Bible by Steven Poitras

• Nutanix blog by Michael Webster+

• Best Practices Guide: AHV on Nutanix

• Best Practices Guide: SAP HANA on Nutanix

• NCC health check using My Nutanix portal

• Enabling High Availability for the Cluster

5.3 SAP HANA • The Ultimate Guide to Effective Sizing of SAP HANA by Alper Somuncu

• SAP HANA Storage Requirements based on TDI approach

Page 19: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Appendix

19 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

A Appendix

A.1 SAP HANA cluster setup used for certification

The cluster hardware details for the certification process are provided in the following table:

Cluster hardware details

Server model

CPU Number of sockets

Memory Disk Network Network B/W used

Dell EMC XC940-24

Intel® Xeon® Gold 6126 CPU @ 2.6 GHz

4 sockets with 12 cores each

48 DIMMS 64 GB each DDR4 – 3 TB

4 * SSD 1490.42 GB 10 * SSD 894.25 GB

Integrated network adapter 1: Intel(R) 4P X550-t rNDC network adapter Slot 3: Intel(R) 10 GbE 4P X710 Adapter Ports=4

10 GbE

Dell EMC XC740xd-24

Intel® Xeon® Gold 6150 CPU @ 2.70 GHz

2 sockets with 18 cores each

6 DIMMS 64 GB each DDR4 – 384 GB

8 * SSD 894.25 GB

Integrated network adapter 1: MLNX25GbE 2P ConnectX4LX RNDC network adapter Slot 7: MLNX25GbE 2P ConnectX4LX Adapter Ports=2

10 GbE

Note: The configuration that is mentioned above were used for SAP HANA certification and validation. For

recommended configuration, see Best practices and recommendations and Certified configurations.

A.2 Certified configurations

Dell EMC supports SAP HANA on XC740xd and XC940 with the following configurations or higher:

Certified configurations

XC740xd-24, 2U/1 Node XC940-24, 3U/1 Node

Intel ® Xeon ® Gold or Intel ® Xeon ® Platinum processors (Skylake or Cascade Lake based) with minimum 8C/16Tor above.

Intel ® Xeon ® Gold or Intel ® Xeon ® Platinum processors (Skylake or Cascade Lake based) with minimum 8C/16Tor above.

24 DIMM slots; up to 3 TB RAM (1.5 TB per processor)

48 DIMM slots; up to 6 TB RAM

(1.5 TB per processor)

24 x 2.5” drive slots, all flash SSD only or SSD + NVMe (80 TB max)

24 x 2.5” drive slots, all flash SSD only or SSD + NVMe (80 TB max)

Page 20: SAP HANA on Dell EMC XC Appliances and XC Core Systems ...SAP HANA is an in-memory data platform that is deployable as an on-premises appliance, or in the cloud. It is a revolutionary

Appendix

20 SAP HANA on Dell EMC XC Appliances and XC Core Systems Best Practices Guide | 000042 | A03

Networking: 2x10, 4x10 or 2x25 GbE

Networking: 2x10, 4x10 or 2x25 GbE

Power: Titanium 750 W, Platinum 495 W, 750 W, 1100 W, 1600 W, and 2000 W

48 VDC 1100 W, 380HVDC 1100 W, 240 HVDC 750 W

Power: Platinum 1100 W, 1600 W, 2000 W, 2400 W, 336 - 380 VDC 1100 W, Gold 48 VDC 1100 W


Recommended