Ceph and cloud stack apr 2014

transcript

20140411

Ian Colle Director of Engineering, Inktank ian@inktank.com @ircolle www.linkedin.com/in/ircolle ircolle on oftc/freenode inktank.com | ceph.com

AGENDA

CEPH UNIFIED STORAGE

FILE SYSTEM

BLOCK STORAGE

OBJECT STORAGE

CloudStack

Geo-Replication

Native API

Multi-tenant

S3 & Swift

CloudStack

Linux Kernel

Clones

Snapshots

CIFS/NFS

Distributed Metadata

Linux Kernel

CEPH OVERVIEW

PHILOSOPHY TODAY

HISTORY

Included in Linux kernel

Integrated into CloudStack

Open sourced for the first time

Project starts at UCSC

Failure is normal Self managing Scale out on commodity hardware

Everything runs in software

TRADITIONAL STORAGE VS. CEPH

TRADITIONAL ENTERPRISE STORAGE

STRONG & GROWING COMMUNITY

37,946

11,500

1,418 2,715

2011-Q3 2011-Q4 2012-Q1 2012-Q2 2012-Q3 2012-Q4 2013-Q1 2013-Q2 2013-Q3

IRC chatlines

ML messages

Commits

ARCHITECTURE

S3/SWIFT HOST/HYPERVISOR iSCSI CIFS/NFS SDK

MONITORS OBJECT STORAGE DAEMONS (OSD)

BLOCK STORAGE FILE SYSTEM OBJECT

STORAGE

hash(object name) % num pg

CRUSH(pg, cluster state, rule set)

§  CRUSH §  Pseudo-random placement algorithm

§  Fast calculation, no lookup §  Repeatable, deterministic

§  Statistically uniform distribution §  Stable mapping

§  Limited data migration on change §  Rule-based configuration

§  Infrastructure topology aware §  Adjustable replication §  Weighting

HOW DO YOU SPIN UP

HUNDREDS OF VMs INSTANTLY

AND EFFICIENTLY?

instant copy

CEPH AND CLOUDSTACK

§  Wido den Hollander wido@42on.com §  If you don’t know him, you should

§  Developed §  rados-java §  libvirt support for RBD §  CloudStack integration

THIS IS THE HOUSE THAT WIDO BUILT

ARCHITECTURAL COMPONENTS

APP HOST/VM CLIENT

CEPH WITH CLOUDSTACK

§  Ceph (Firefly in rc) §  http://www.ceph.com/download/

§  libvirt (1.2.3 released on 01APR2014) §  http://libvirt.org/sources/

§  QEMU (2.0 in rc, or 1.7.1) §  http://wiki.qemu.org/Download

§  Cloudstack (4.2 or newer) §  http://cloudstack.apache.org/downloads.html

WHAT DO I NEED?

§  Set up a ceph cluster §  http://ceph.com/docs/master/start/

§  Install/configure QEMU §  http://ceph.com/docs/master/rbd/qemu-rbd/

§  Install/configure libvirt §  http://ceph.com/docs/master/rbd/libvirt/

§  Create your Cloudstack pool §  ceph osd pool create cloudstack

§  Add Primary Storage §  For Protocol select RBD

WHAT DO I DO?

WHAT’S NEXT FOR CEPH?

CEPH ROADMAP

Firefly Giant H-Release

CACHE TIERING - WRITEBACK

5 PB HDD OBJECT STORAGE

500TB writeback cache

CACHE TIERING - READONLY

5 PB HDD OBJECT STORAGE

200TB redonly cache

150TB readonly cache

Costs you 30MB of storage

Costs you ~14MB of storage

NEXT STEPS

NEXT STEPS WHAT NOW?

•  Read about the latest version of Ceph: http://ceph.com/docs

•  Deploy a test cluster using ceph-

deploy: http://ceph.com/qsg

§  Most discussion happens on the mailing lists ceph-devel and ceph-users. Join or view archives at http://ceph.com/list

§  IRC is a great place to get help (or help others!) #ceph and #ceph-devel. Details and logs at http://ceph.com/irc

•  Deploy a test cluster on the AWS free-tier using Juju: http://ceph.com/juju

•  Ansible playbooks for Ceph: https://github.com/ceph/ceph-ansible

§  Download the code: http://www.github.com/ceph

§  The tracker manages bugs and feature requests. Register and start looking around at http://tracker.ceph.com

§  Doc updates and suggestions are always welcome. Learn how to contribute docs at http://ceph.com/docwriting

Ian R. Colle Director of Engineering

ian@inktank.com @ircolle

www.linkedin.com/in/ircolle ircolle on oftc/freenode

Ceph and cloud stack apr 2014

Technology