Ecosystem UpdateCeph Day Los Angeles 2015

ECOSYSTEM UPDATE

Events

Metrics

Projects

DEVELOPMENT STATUS

Releases

Major efforts

AGENDA

2

COMMUNITY

Focused on being non-disruptive

RHEL / Fedora / CentOS coverage

Maintaining Ubuntu / SUSE coverage

Co-existing with Gluster Learning is fun!

LIVING IN A RED HAT WORLD

4

CEPH DAYS

You’re here!

Turning up the heat

Community-focused

Upcoming

Chicago

Raleigh

Singapore

5

Hosted by Intel in Hillsboro, OR 10-13 Aug <25 people Real work!

Performance (Mark Nelson) RBD focus RGW features and integration

Spread the word! Email pmcgarry@redhat.com

CEPH HACKATHON

6

CEPH DEVELOPER SUMMIT

7

Quarterly developer summit

100% online (Blue Jeans / IRC)

Jewel summit recently completed

Videos on Ceph YouTube channel

METRICS

8

USER COMMITTEE

9

Started after Dumpling

Next chair: Wido den Hollander

Periodic meetings to discuss community matters

Most recently: Release cadence

Contributor credits

Meetups

RADOS Gateway use cases

Upcoming work

First steps towards broader governance structure

GOOGLE SUMMER OF CODE

10

Ceph project’s second year

6 slots given, used 4

Last year Wireshark

Reliability Model

Work published on Ceph wiki

Outreachy, too

Get involved!

CENTOS STORAGE SIG

11

Creating a collection of packages

http://wiki.centos.org/SpecialInterestGroup/Storage/Proposal

Easier to deploy CentOS as a storage node

Early days (still)

Packages for Ceph & Gluster

Get involved!

DEVELOPMENT

APRIL 13, 2015: CEPH HAMMER

13

cephfs: journal scavenger repair tool (John Spray)

crush: new and improved straw2 bucket type (Sage Weil, Christina Anderson, Xiaoxi Chen)

doc: improved for CephFS early adopters (John Spray)

librbd: add per-image object map for improved performance (Jason Dillaman)

librbd: copy-on-read (Min Chen, Li Wang, Yunchuan Wen, Cheng Cheng)

librados: fadvise-style IO hints (Jianpeng Ma)

mds: many many snapshot-related fixes (Yan, Zheng)

mon: new ‘ceph osd df’ command (Mykola

Golub)

mon: new ‘ceph pg ls …’ command (Xinxin Shu)

osd: improved high-performance backends

osd: improved recovery behavior (Samuel Just)

osd: improved cache tier behavior with reads (Zhiqiang Wang)

rgw: S3-compatible bucket versioning support (Yehuda Sadeh)

rgw: large bucket index sharding (Guang Yang, Yehuda Sadeh)

RDMA “xio” messenger support (Matt Benjamin, Vu Pham)

Meaningful contributions from: Intel Fujitsu Mellanox CERN Deutsche Telekom SanDisk Yahoo

More than just code! Event promotion & hosting Ceph Developer Summit participation

HAMMER CONTRIBUTORS

14

CEPHFS

15

Lots of hard work!

Dogfooding

Code src/mds: 366 commits, 19,417 lines added/removed

src/client: 131 commits, 4289 lines

src/tools/cephfs: 41 commits, 4179 lines

ceph-qa-suite: 4842 added lines of FS-related python

Tracker 108 FS tickets resolved since Firefly (of which 97 were

created since Firefly)

83 ticket currently open for FS, of which 35 were created since Firefly

31 feature tickets resolved

LIBRADOS

16

Many more deployments/apps using direct librados

Native library for accessing RADOS librados.so shared library

C, C++, Python, Erlang, Haskell, PHP, Java (JNA)

Direct data path to storage nodes Speaks native Ceph protocol with cluster

Exposes Mutable objects

Rich per-object API and data model

Hides Data distribution, migration, replication, failures

Making your intelligent storage more intelligent! Allows you to dynamically extend objects in RADOS Examples

MD5 hashes Image thumbnails Log post-processing

Uses LUA Ask Noah!

OBJECT CLASSES

17

THANK YOU!

Ross TurkRed Hat Storage

ross@redhat.com

@rossturk

YOUR PICTURE HERE