Jaydeep Marfatia...•Highly available, highly scalable Infrastructure as a Service (IaaS) cloud...

Cloud, IOT and Analytics

Baremetal with Apache CloudStackApacheCon Europe 2016

Jaydeep Marfatia

© 2016 Accelerite. All Rights Reserved.2

Me

Director of Product ManagementCloud Products

Accelerite

Background

Project lead for open source projectXenMan/ConVirt

Co-Founder Convirture Corp.

Architect for Oracle 10g Enterprise Manager


Apache CloudStack

• Highly available, highly scalable Infrastructure as a Service (IaaS) cloud computing platform

• Easy to deploy, turnkey solution that includes the entire "stack" of features most organizations want with an IaaS cloud

• Used by many enterprises for their private cloud, as well as for running large public clouds !

• CloudStack currently supports the most popular hypervisors: VMware, KVM, Citrix XenServer, Hyper-V and more


Accelerite

• Enterprise Infrastructure software company

• Acquired CloudPlatform from Citrix early this year

• Commercial product based on CloudStack

• 50+ engineers and adding more


Recent contributions by Accelerite

• Template upload from browser

• DHCP/DNS Offload

• LDAP integration

• CoreOS/Docker on CloudStack

• VPN enhancements

• VMWare Networking improvements

• Baremetal enhancements

• 200+ Bug fixes in the product

CloudStackUser Interface


User Console


Admin Console


Self-service VM Provisioning

Zone Template Compute Disk Affinity Network Launch


Monitoring Cloud Infrastructure

© 2016 Accelerite. All rights reserved.

Baremetal Team


Team

• Harikrishna Patnala – Apache Committer, working on CloudStack 4+ years

Expertise : Baremetal and Virtual Router

• Jayapal Uradi – Apache Committer, 4+ years

Expertise : CloudStack Networking

• Suresh Sadhu – Quality Assurance of CloudStack, 5+ years

Expertise : All rounder

Motivation for Baremetal


Why Baremetal?

• Meet high performance computing requirements

• Hadoop, Spark, HPC

• Take advantage of specialized hardware

• GPUs, Blade Micro-servers

• Databases

• Virtual Desktop Infrastructure management

• Desired for Docker Containers

Requirements


Data Center


Data Center

Servers

Switch

Rack

Secondary Storage


Workload Partitioning

Hadoop

Switch

Secondary Storage

Kubernetes

Rack


Multi-Tenancy

Tenant 1

Switch

Secondary Storage

Tenant 2

Rack


Multi-Tenancy and Workload partitioning

Tenant 1

Switch

Secondary Storage

Tenant 2

Tenant 1 - DBRack


Data Center – VMs and Baremetal

Tenant 1 Network

Rack

Tenant 2 Network


Baremetal in CloudStack

• Ability to deploy Baremetal servers as easy as spinning up a VM

• Multi-tenant Baremetal orchestration with network isolation

• Flexibility of using mixed environments of VM and Baremetal

• DB tier on Baremetal and other tiers on VMs for a multi-tier application

• Extensible architecture for different flavors of hardware and network

elements

What all do we need ?


PXE server

• Basic Networking

• Flat network

• External PXE/DHCP/DNS Servers

• Advanced Networking

• Isolation using VLANs

• Additionally VR acts as PXE

• All VM networking services mapped to Baremetal

© 2016 Accelerite. All Rights Reserved.

Advanced Networking

Network isolation with VLAN

Guest1

VM1

Guest1

VM2

Guest1

VM3Guest1

VR

VLAN2000

Management

Storage

Public VLAN99

Hypervisor 1 Hypervisor 2

Switch

Console, Storage VMs

Hypervisor 2

Hypervisor 2

Public

VLAN99


Advanced Networking

Network isolation with VLAN

Guest1

VM1

Guest1

VM2

Guest1

VM3Guest2

VM1

Guest2

VM2Guest2

VM3

Guest2

VRGuest1

VR

VLAN2000

VLAN2001

Management

Storage

Public VLAN99

Hypervisor 1 Hypervisor 2

Switch

Console, Storage VMs

Hypervisor 2

Hypervisor 2

Public

VLAN99


Advanced Networking

VLAN based isolation

Networking services:

• DHCP

• DNS

• Source NAT

• Static NAT

• Port Forwarding

• Load Balancing

• Firewall

• VPN

• PXE


Templates

• PXE Server hosts the Installer Kernels and Kickstart files

• Template Registration is done by giving the URL from where OS Packages can be retrieved

PXE Server/VR

Kickstart, Installer Kernels

NFS

OS Package Repository

Baremetal Host

HTTP

TFTP


Example Template URL

• ks=http_link_to_kickstartfile;kernel=nfs_path_to_pxe_kernel;initrd=nfs_path_to_pxe_initrd

• ks=http://10.147.28.7/export/home/hari/rhel65/ks1.ks;kernel=10.147.28.7:/export/home/hari/rhel65/RHEL65/images/pxeboot/vmlinuz;initrd=10.147.28.7:/export/home/hari/rhel65/RHEL65/images/pxeboot/initrd.img

http://10.147.28.7/export/home/hari/rhel65/ks1.ks;kernel=10.147.28.7:/export/home/hari/rhel65/RHEL65/images/pxeboot/vmlinuz;initrd=10.147.28.7:/export/home/hari/rhel65/RHEL65/images/pxeboot/initrd.img


Service Offering

• Service offering allows administrator to determine size of the VM in

terms of CPU and memory

• e.g. small vm 2 cpu, 512 MB ram

• For baremetal, CPU and memory information is specified while adding

the host along with a tag and IPMI details

• e.g. host-44, 8 cpu, 32 GB ram –tag ssd_bm, ipmi info : ip, user, password

• Tagging scheme is used to map service offerings and baremetal host

• e.g. SSD baremetal medium – 8 cpu, 32 GB ram – tag ssd_bm


Switch Configuration

• Switch credentials

• Switch topology information

• host – switch port mapping Switch

BaremetalNodes

MS NodeVR on Hypervisor

Template

Storage

{ "racks": [{ "l2Switch": { "ip": "10.147.28.11", "username": "admin",

"password": "password", "type": "Force10” },

"hosts":[{ "mac": "d4:ae:52:7a:a5:9c", "port": "tengigabitethernet:0/30"

}, { "mac": "d4:ae:52:7a:a5:9d", "port": "tengigabitethernet:0/31"

} ]

} ]}

Provisioning Flow


Management Server

Baremetal Provisioning Flow – Advanced Zone

Management Server

Physical Switch

Management ServerBaremetal

Hosts

VR(w/ PXE &

DHCP/DNS)

1. User Requests Baremetal Instance

2. Management Server configures PXEDHCP on VR and physical switch with VLANS

3. Baremetal host started with IPMI commandto PXE boot

4. Host gets DHCP

5. Host pulls PXE image

6. Image is pulled and installed

7. Host pulls user data from VR


Windows Baremetal Provisioning (Approach)

• Windows Deployment server needs to be programmed

• Need to invoke powershell commands from Linux

• Agent to be present in WDS Server

• Using RPC/or Event Queue mechanism, send Powershell commands to WDS

• AD / DHCP is used for authentication and PXE booting


Management Server

Windows Baremetal Provisioning Flow

Management Server

DHCP/DNSActive

Directory

Management ServerBaremetal

Hosts

WDS (w/ PXE)

1. User Requests Baremetal Instance

2. Management Server configures WDS Server with PXE, switch configured

3. Baremetal host started with IPMI commandto PXE boot

4. Host gets DHCP

5. Host pulls PXE image

6. Image is pulled and installed

7. Host pulls user data from VR

Switch


KubernetesCluster

Baremetal Use Case for Container Deployment

1. Install CoreOS on Baremetal hosts

2. Setup networking – Basic or Isolated (program the switch)

3. Create k8s cluster using cloud-config sent via userdata service on VR

4. Use Kubernetes dashboard within CloudStack UI to deploy and manage containers

5. All CloudStack tenanting and isolation features apply

MgmtServer

Virtual Router

Node1

Node2

MasterDashboard

cloud-config

CoreOS Images

Extensibility


Network Switch Plugin<<interface>>

BaremetalSwitchBackend

• getSwitchBackendType()• prepareVlan()• removePortFromVlan()

Force10BaremetalSwitchBackend

• getSwitchBackendType() { return TYPE }• prepareVlan()• removePortFromVlan()

public static final String TYPE = "Force10"


Network Switch Plugin

• Currently, a Dell Force10 switch is implemented

• To Extend to other types, implement following two methods as a plugin

Arista plugin Implementation Details:1.Implement AristaBaremetalSwitchBackend.java and implement the interface BaremetalSwitchBackend. For example interface refer to https://github.com/apache/CloudStack/blob/master/plugins/hypervisors/baremetal/src/com/cloud/baremetal/networkservice/Force10BaremetalSwitchBackend.java.2. Need to implement the following three functions with appropriate actions for Arista switches in the abovefile. (definition of interface is in https://github.com/apache/CloudStack/blob/master/plugins/hypervisors/baremetal/src/com/cloud/baremetal/networkservice/BaremetalSwitchBackend.java):public interface BaremetalSwitchBackend {

String getSwitchBackendType();void prepareVlan(BaremetalVlanStruct struct);void removePortFromVlan(BaremetalVlanStruct struct);

}3. Add AristaBaremetalSwitchBackend bean configuration into https://github.com/apache/CloudStack/blob/master/plugins/hypervisors/baremetal/resources/META-INF/CloudStack/core/spring-baremetal-core-context.xml.

https://github.com/apache/cloudstack/blob/master/plugins/hypervisors/baremetal/src/com/cloud/baremetal/networkservice/Force10BaremetalSwitchBackend.java

https://github.com/apache/cloudstack/blob/master/plugins/hypervisors/baremetal/src/com/cloud/baremetal/networkservice/BaremetalSwitchBackend.java

https://github.com/apache/cloudstack/blob/master/plugins/hypervisors/baremetal/resources/META-INF/cloudstack/core/spring-baremetal-core-context.xml

Looking forward


Baremetal Projects : Contributions welcome

• WDS integration (WIP)

• Baremetal in VPC Network

• Add switch integration from different vendors

• NIC Bonding

• RAID

• UEFI Boot

• Redfish integration

• Auto-discovery of hosts and NIC details

Q&A

Date post:	25-Jun-2020
Category:	Documents
Upload:	others
View:	7 times
Download:	0 times

Jaydeep Marfatia...•Highly available, highly scalable Infrastructure as a Service (IaaS) cloud...

Documents