Integrating - events.static.linuxfound.org · CloudOpen 2015 Agenda Introducing Open-Source...

Post on 23-Mar-2020

2 views 0 download

transcript

CloudOpen 2015

Integrating oVirt, Foreman And Katello

To Empower YourData-Center Utilization

Yaniv BronhaimSenior Software Engineer, Maintainer @ RHEV

Red Hat IL, RaananaAugust 2015, CloudOpen Europe

CloudOpen 2015

Agenda● Introducing Open-Source solutions

● oVirt, Foreman and Katello

● New third-party integration in oVirt 3.6● Using Foreman for Bare-Metal Provisioning● Using Katello for displaying Errata (update)

content information for hosts, Vms and Engine

● oVirt 3.6 Upgrade Manager

● oVirt 4.0 plans

CloudOpen 2015

Large scale, centralized management for server and desktop virtualization

Provide an open source alternative to vCenter/vSphere

Focus on KVM for best integration/performance

CloudOpen 2015

Focus #1 : Performance And Scalability

Maintain a large amount of resources

Data Centers

Storage

Linux Hypervisors

Guests \ VMs

Network

CloudOpen 2015

Focus #2 : User Intuitive

Different type of users and requirements

CloudOpen 2015

Focus #3 : Secure and Recoverable

It hurts to lose your VM in the cloud

CloudOpen 2015

Data Centers

Storage

Linux Hypervisors

Guests \ VMs

Network

CloudOpen 2015

oVirt Engine Redhat Enterprise Virtualization

http://www.ovirt.org/Quick_Start_Guide

CloudOpen 2015

CloudOpen 2015

Host DeployThe Basic Of Utilizing The Hypervisor

Client (Web Portal)Engine

CloudOpen 2015

Deploy Host Flow

Client (web portals)Engine

CloudOpen 2015

Deploy

(Configure)

New Host

CloudOpen 2015

Host DeploymentThe process of preparing an operating systemenvironment suitable to host virtual machines and to be managed by the ovirt back-end

● VDSM packages are installed.● Clock is 'soft' synchronized.● Management bridge created.● Firewall rules applied.● SSH trust obtained.● PKI trust obtained.● VDSM certificate issued.● Services' boot state set.● Host tuned for virtualization.

CloudOpen 2015

oVirt Node● Standalone hypervisor

– Small footprint < 100MB

● Customized 'spin' of Fedora + KVM

● 'Just enough' Fedora to run virtual machines

● Runs on all RHEL hardware with Intel VT/AMD-V CPUs

– Easy to install, configure and upgrade

● PXE boot, USB boot, CD or Hard drive

● Upcoming – Using Atomic

CloudOpen 2015

CloudOpen 2015

/usr/libexec/qemu-kvm -name vm-f16-buildmachine -S -M rhel6.4.0 -cpu Westmere -enable-kvm -m 2048 -smp 2,sockets=2,cores=1,threads=1 -uuid a8ccdb60-8a42-44f5-9669-d74c3b2eff43 -smbios type=1,manufacturer=Red Hat,product=RHEV Hypervisor,version=6Server-6.4.0.4.el6,serial=30353036-3837-4247-3831-30394635324C_78:e7:d1:22:46:d8,uuid=a8ccdb60-8a42-44f5-9669-d74c3b2eff43 -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/vm-f16-buildmachine.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2013-10-08T12:16:16,driftfix=slew -no-shutdown -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x4 -drive if=none,media=cdrom,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-drive,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -drive file=/rhev/data-center/f79b0b28-c82f-11e0-8739-78e7d1e48c4c/5bab6470-8825-4e3a-b408-ebcde93678b6/images/4c213cd2-c4d5-441b-a1ac-dfb1a6868699/11b3e132-50a5-481b-b48b-e3b1f2879e69,if=none,id=drive-virtio-disk0,format=qcow2,serial=4c213cd2-c4d5-441b-a1ac-dfb1a6868699,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/rhev/data-center/f79b0b28-c82f-11e0-8739-78e7d1e48c4c/5bab6470-8825-4e3a-b408-ebcde93678b6/images/02330fa2-d1ff-48e0-a843-842c2376756f/5a283126-4d27-4eef-86dd-fb538d8d08e4,if=none,id=drive-virtio-disk1,format=qcow2,serial=02330fa2-d1ff-48e0-a843-842c2376756f,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk1,id=virtio-disk1 -netdev tap,fd=31,id=hostnet0,vhost=on,vhostfd=32 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:23:12:13,bus=pci.0,addr=0x3,bootindex=2 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/vm-f16-buildmachine.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/vm-f16-buildmachine.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev spicevmc,id=charchannel2,name=vdagent -device virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0 -spice port=5904,tls-port=5905,addr=10.35.16.4,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on -k en-us -vga qxl -global qxl-vga.ram_size=67108864 -global qxl-vga.vram_size=67108864

CloudOpen 2015

CloudOpen 2015

Prepare Virtual Environment

21CloudOpen 2015

Live Migration• Dynamically move virtual machines

between hosts● No service interruption

● Applications continue to run

• Migrate even I/O intensive workloads such as databases

• Perform hardware maintenance without application downtime

• Dynamically balance workloads between host systems

22CloudOpen 2015

• Build a highly available enterprise infrastructure

• Continually monitor host systems and virtual machines

• Automatically restart virtual machines in case of host failure

● Restart virtual machine on another node in the cluster

• Use live migration to “fail-back” a VM to it's original host when the server is restored

High Availability

23CloudOpen 2015

System Scheduler • Dynamically balance workloads in the data center.

• Automatically live migrate virtual machines based on resources

• Define custom policies for distribution of virtual machines

• Define policies to optimize workload on a fewer number of servers during “off-peak” hours

CloudOpen 2015

CloudOpen 2015

CloudOpen 2015

CloudOpen 2015

Live snapshot

Task ManagementAsync Operations

Live Migration

OvercommitCPU, Memory, I/O

Hotplug

Thirdparty Integration

Hosted Engine

Live Storage Migration

KSMKernel Same-Page

Mering

NUMA

SPICEMemory

Ballooning

OS supportsVirt

PCI pass through

QuotaLimit Resources

Import Storage Domain

VIRT V2V & P2V

MoM

AAA

Progress Live Processes

Iscsi , NFSManagement

Network InterfacesManagement

Cinder Templates

Node Registration

Events

User Roles

Kdump fencingPPC Support

Discovery Hosts Provisioning

UpgradeManagement

Expose PackagesInformation

CloudOpen 2015

Live snapshot

Task ManagementAsync Operations

Live Migration

OvercommitCPU, Memory, I/O

Hotplug

Thirdparty Integration

Hosted Engine

Live Storage Migration

KSMKernel Same-Page

Mering

NUMA

SPICEMemory

Ballooning

OS supportsVirt

PCI pass through

QuotaLimit Resources

Import Storage Domain

VIRT V2V & P2V

MoM

AAA

Progress Live Processes

Iscsi , NFSManagement

Network InterfacesManagement

Cinder Templates

Node Registration

Events

User Roles

Kdump fencingPPC Support

Discovery Hosts Provisioning

UpgradeManagement

Expose PackagesInformation

CloudOpen 2015

Complete lifecycle management tool for physical and virtual servers.

Initial Start Configure Monitor

CloudOpen 2015

CloudOpen 2015

CloudOpen 2015

CloudOpen 2015

CloudOpen 2015

Foreman

Provision

Foreman

Configurator

Foreman

Management

How it's being done by Foreman

CloudOpen 2015

Fedora

CentOS

RHEL

Ubunto

PXE Boot

Foreman

Provision

Foreman

Configurator

Foreman

Management

Smart Proxy

DNSDHCPTFTP

CloudOpen 2015

Puppet

Chef

Reports

PasswordsKeysUsers

Services

Foreman

Provision

Foreman

Configurator

Foreman

Management

Configuration Management

Provision templates

Host groups

Puppet classes

Parameters

CloudOpen 2015

Foreman

Provision

Foreman

Configurator

Foreman

Management

Interface

UI, API, Cli

Rest API

Web Interface

CloudOpen 2015

Remote Management● Bare metal provisioning = Register servers to

central management software● Ability to locate the physical hardware and know

its specification● Configure and monitor the servers

CloudOpen 2015

Provision

Connect

Your Data Center

CloudOpen 2015

S1-A = 00:11:22:33:44:23S2-A = 0A:1B:C2:CC:44:55C8-E = A3:AA:C7:92:12:32C4-E = A3:BB:D7:92:42:32

C8-E

C7-E

C6-E

C5-E

C5-F = A3:EB:F4:92:12:32D5-E = A3:BC:D7:92:12:22

B5-E = A3:BB:D7:92:12:12

Configure

CloudOpen 2015

Install OS

Manual Provision Process

CloudOpen 2015

Initial Setup

Configure

CloudOpen 2015

Monitor And Update –

Drift Management

5Monitor

CloudOpen 2015

Bare Metal Provisioning Feature

Client (web portals)Foreman

CloudOpen 2015

Client (web portals)Foreman

CloudOpen 2015

Client (web portals)Foreman

CloudOpen 2015

Client (web portals)Foreman

CloudOpen 2015

CloudOpen 2015

CloudOpen 2015

● Create, organize, and manage local yum and puppet repositories

● Sync remote repositories

● Create custom Content

Views

● Install package and errata

updates

CloudOpen 2015

CloudOpen 2015

CloudOpen 2015

CloudOpen 2015

Integrating to oVirt

Host Lifecycle

Management

Host Content Management

Provision Bare-Metal

Host

Gather Content

Information

ERRATA Info

Deploy Hypervisor

CloudOpen 2015

How does Provisioning integrate with oVirt ?Host

Lifecycle Management

Provision Bare-Metal

Host

Deploy Hypervisor

CloudOpen 2015

Provision

CloudOpen 2015

serv1.bob.redhat.com

New Host

Going Back To Adding New Installed Host Using Host Deploy

CloudOpen 2015

New Host

serv1.bob.redhat.com

CloudOpen 2015

Deploy

(Configure)

New Host

CloudOpen 2015

Hypervisor

CloudOpen 2015

CloudOpen 2015

Adding External Provider - Foreman

Client (web portals)

CloudOpen 2015

Adding New Discovered Host

CloudOpen 2015

Engine

CloudOpen 2015

Engine

00:11:22:33:44:55

0A:1B:C2:CC:44:55

A3:AA:C7:92:12:32

CloudOpen 2015

CloudOpen 2015

00:11:22:33:44:55=192.168.1.2

0A:1B:C2:CC:44:55=192.168.1.56

A3:AA:C7:92:12:32=192.168.1.66

CloudOpen 2015

Engine

CloudOpen 2015

Engine

CloudOpen 2015

CloudOpen 2015

Engine

CloudOpen 2015

CloudOpen 2015

Provision

Provision Hostnewbob.redhat.com

CloudOpen 2015

Provision

Provision Host 192.168.1.53

CloudOpen 2015

Deploy

(Configure)API Request to deploy host

oVirt Provision Plugin

CloudOpen 2015

Provision is Done!

CloudOpen 2015

Host Content Management

Gather Content

Information

ERRATA Info

How does Content Management integrate with oVirt ?

CloudOpen 2015

Host Content Information

CloudOpen 2015

API Request To Gather Information About Host Or Virtiual Machine

CloudOpen 2015

Collecting Content Flow:

CloudOpen 2015

Reads And Reports Content StatusBy Using Katello Agent

CloudOpen 2015

#2 : Host Content Information

ErrataReports

CloudOpen 2015

Hosts and VMs Content Information

CloudOpen 2015

CloudOpen 2015

Engine Content

CloudOpen 2015

oVirt 3.6 Upgrade Manager For Hosts

– Using Host Management

Gathering Main Packages Info and trigger an update

Mostly for upgrading

cluster level Polling for yum\dnf update info

CloudOpen 2015

Notify For Upgrade Availability

CloudOpen 2015

CloudOpen 2015

oVirt Host MgmtProcess

CloudOpen 2015

Host Management The process of upgrading content environment for suitable cluster (usually VDSM version upgrade)

● Direct SSH trust obtained.● Allows to retrieve current

installed packages information.● Perform YUM\DNF operations

for specific virt packages.

CloudOpen 2015

Summary● Katello, Foreman, oVirt

● Discover new hosts and utilizing them

● Manage content and cluster updates

The feature pages:● http://www.ovirt.org/Features/ForemanIntegration● http://www.ovirt.org/Home/Features/KatelloIntegration● http://www.ovirt.org/Home/Features/UpgradeManager

CloudOpen 2015

Future Plans:

● VM Provisioning● Full Host Configuration Management Through

oVirt● Multiply Selection For Hosts Provisioning ● Upgrade Hosts by Katello API● Cluster Upgrades

CloudOpen 2015

● Homepage

http://ovirt.org

● Overall Projects

http://gerrit.ovirt.org

● Mails lists

users@ovirt.org

devel@ovirt.org

● #ovirt on OFTC

● Homepage

http://theforeman.org

● Overall Projects

Github.com/theforeman

● #theforeman on freenode

● Homepage

http://katello.org

● Overall Projects

Github.com/Katello

● #katello on freenode

CloudOpen 2015

Questions?

Yaniv Bronhaim.

bronhaim@gmail.comybronhei@redhat.com

CloudOpen 2015

THANK YOU !

Yaniv Bronhaim.

http://www.ovirt.orgybronhei@redhat.com