7/26/2019 os-4

1/21

KIDSON

THE

BLOCK

NEW

THEpresented by mike perez

7/26/2019 os-4

2/21

BLOCK

http://www.flickr.com/photos/nooccar/5844185400

cinder core developer

MIKE

PEREZJoined the communityOctober 2010

Wrote the start of Cinder V2API

Cinder API documentation

Cinder API references

Compatibility hammer

More code reviews than Iknow what to do with

senior develo er for Datera

http://www.flickr.com/photos/nooccar/5844185400

7/26/2019 os-4

3/21

WHAT

http://www.flickr.com/photos/neilhinchley/294337822/

project exists since Folsom release,spun off Nova-volume

cinder manages block storage

not object storage not file level storage

volumes attach to VM Instances

Instances can boot from volume

volumes have a lifecycleindependent of VM instance

http://www.flickr.com/photos/neilhinchley/294337822/

7/26/2019 os-4

4/21

ARCHITECTURALOVERVIEW

Cinder Client

Cinder API

Cinder Volume Cinder BackupCinder Scheduler

SQL DB

AMPQAMPQ

AMPQ

AMPQ

7/26/2019 os-4

5/21

CINDER

APIVolume create/delete/list/show

Create from image, snapshot

Snapshot create/delete/list/show

Backups create/restore/list/delete/showVolume attach/detach (called by Nova)

Manage quotasVolume extend

Volume migrateTransfer volumes from tenant to tenant

7/26/2019 os-4

6/21

ARCHITECTURALOVERVIEW

Cinder Client

Cinder API

Cinder Volume Cinder BackupCinder Scheduler

SQL DB

AMPQAMPQ

AMPQ

AMPQ

7/26/2019 os-4

7/21

CINDER

VOLUMEDrivers: Called by Manager, contains back-end-specific code

to communicate with various storage types (e.g., Linux LVM,storage controllers from various vendors, distributed filesystems, etc.)

Admin can run multiple cinder-volume instances, each with

its own configuration file describing settings and the storageback-end

Each backend driver is configured to interact with onestorage pool

7/26/2019 os-4

8/21

ARCHITECTURALOVERVIEW

Cinder Client

Cinder API

Cinder Volume Cinder BackupCinder Scheduler

SQL DB

AMPQAMPQ

AMPQ

AMPQ

7/26/2019 os-4

9/21

CINDER

SCHEDULERChooses which back-end to place a new volume onConfigurable plugins for schedulers

Filter scheduler has filters and weighers

Filter scheduler Flow Example:

Starts with list of all cinder volume hosts

Filters according to capabilities

Drivers report capabilities and state (e.g., free space)

Default filters

Volume types

Sorts according to weights e.g., available free space

Returns best candidate

7/26/2019 os-4

10/21

VOLUME

TYPESAdmin can create tiers of storage. e.g. two LVMbackends, one with SSDs and the other with HDDs.

Users can specify a tier they want when creating avolume.

C C

7/26/2019 os-4

11/21

ARCHITECTURALOVERVIEW

Cinder Client

Cinder API

Cinder Volume Cinder BackupCinder Scheduler

SQL DB

AMPQAMPQ

AMPQ

AMPQ

7/26/2019 os-4

12/21

CINDER

BACKUPA backup is an archived copy of a Volume stored in aobject store.

A backup is just the data that was written, unlike asnapshot which is the entire block.

Use Swift, Ceph, or IBM Tivoli Storage Manager

HIGH L d

7/26/2019 os-4

13/21

HIGHLEVEL

Nova Cinder

VM InstanceLinux Volume

Manager

KVM

ISCSIInitiator

LegendPersistent Volume DataPersistent Volume Control

/dev/hda

/dev/vda

Target

C

7/26/2019 os-4

14/21

ATTACH

THAT Nova calls Cinder via its API, passing connection information.

e.g., host name, iSCSI initiator name, FC WWNNs

Cinder API passes message to Cinder Volume.

Manager does initial error checking and calls volume driver.

Volume driver does any necessary preparation to allow the connection.e.g., give the nova host permissions to access the volume.

Volume driver returns connection information, which is passed to Nova.e.g., iSCSI iqn and portal, FC WWNN.

Nova creates the connection to the storage using the returned information.

Nova passes the volume device/file to the hypervisor.

VOLUME

THE

7/26/2019 os-4

15/21

THE

GRID

DRIVER

7/26/2019 os-4

16/21

DRIVER

REQUIREMENTS Volume Create/Delete Volume Attach/Detach

Snapshot Create/Delete Create Volume from Snapshot

Get Volume Stats

Copy Image to Volume Copy Volume to Image

Clone Volume

Extend Volume

DRIVER

7/26/2019 os-4

17/21

DRIVER

CERTIFICATION Driver certification test exists in devstack today.

Wrapper around OpenStack integration testsTempest.

Requires driver maintainers in EACH release to

provide results from running Tempest againstCinder with their driver as a backend.

CURRENT

7/26/2019 os-4

18/21

CURRENT

DRIVERSCoraid (AoE)EMC VMAX/VNX (iSCSI)

GlusterFS (GlusterFS)

HP 3PAR (iSCSI/FC)

HP LeftHand (iSCSI)

Huawei T-series/Dorado (iSCSI)

IBM Storwize family/SVC (iSCSI/FC)

IBM XIV (iSCSI), LVM (iSCSI)

NetApp (iSCSI/NFS)

Nexenta (iSCSI)

NFS (NFS)

RBD (Ceph)

Scality SOFS (scality)

Sheepdog (sheepdog)

Solaris (iSCSI)

SolidFire (iSCSI)

Windows Server 2012 (iSCSI)

Zadara (iSCSI)

Dell EqualLogic

VMware VMDK

IBM General Parallel File System (GPFS)

ICEHOUSE

7/26/2019 os-4

19/21

ICEHOUSE

RELEASEGeneral FeaturesFC SAN Zone / Access Controlmanagement

Volume retype

Cinder API can run on multipleprocesses

Ceilometer notifications

TSM Backup Driver

Import/export backup metadata

New Drivers:

HP Lefthand array iSCSI

HP MSA 2040

IBM SONAS

IBM Storwize V7000

EMC VNX Direct

293 bug fixes!

J

7/26/2019 os-4

20/21

Juno

BOUNDGeneral FeaturesCreate volume on same compute host

Project quotas

Support Accept-Langauge header in API

Rollback volume to snapshot

Volume replication

New Drivers:

Generic ZFS ISCSI

Astute NFS

Fusion-io ISCSI

ProphetStor Federator

Nimble ISCSI

X-IO ISE ISCSI and FC

THANKWeb: http://thing ee

http://thing.ee/

7/26/2019 os-4

21/21

THANK

YOU!Get started with Cinder:

https://wiki.openstack.org/wiki/Cinder

Source Code:

http://github.com/openstack/cinderREST API Docs:

http://bit.ly/1ebzbMZ

Web: http://thing.ee

Github: thingee

Twitter: @thingee

IRC on Freenode: thingee

Email: thingee@gmail.com

mailto:thingee@gmail.comhttp://thing.ee/http://bit.ly/1ebzbMZhttp://github.com/openstack/cinderhttps://wiki.openstack.org/wiki/Cinder