ToanDominoSkype: bui.songtoan

August 23, 2015

Anthony Young

OpenStack SwiftIntroduction & Architecture

What We’ll Cover

• Swift Use Cases

• Intro to Swift

• Swift Architecture

• Demo

2

Swift Use Cases

3

From now until 2020, the digital universe will about double every two years.

40,000 exabytes by 2020

Requirements for Data Storage

• Durability

• Accessibility

• Low cost

• Manageability

Object Store

7

What is Object Storage?

8

- Attached directly to an OS(ex: SAN, iSCSI, local disks)

- Lowest level- Useful for app with

heavy random I/O.. - Openstack: Cinder

- Use of a network file system that acts as abstraction layer between the OS and NAS device (NFS)-Allows different OS-File locking

- Access via API at application-level

- ~ Flat structure- Storing objects in

containers (massive scalability)

- Metadata lives with the object

- Scalability- Durability- Cost

What is Object Storage?

• Good for:• Media (images, music, video)• Documents• Backups

• Not suited for• Relational Databases• Data requiring random access/updates within objects

9

CAP Theorem

10

CAP Theorem

11

Consistency (C)

Partition Tolerance

(P)

Availability (A)

CAP Theorem

12

CAP Theorem

• Swift chose availability and partition tolerance and dropped consistency

13

Why???

Storage as a service

14

Storage as a service

• PUT, GET, HEAD, DELETE…• RESTful API• Multi-path upload, ACL support, versioning• Metadata, distributed & replicated• Mutil-tenant service• Web/Mobile app• Massive concurrency

15

Storage as a service

16

Storage as a service

17

Storage as a service

18

Storage as a service

19

Viet Nam???

VDrive

20

Intro to Swift

21

What is Swift?

• Object Store• Highly Scaleable• Durable• Highly Concurrent• Open Source• Runs on Commodity Hardware • Developer Friendly (Static Content, Expiring Objects, Quotas, Direct

form upload…)

22

Swift is not

• RAID• Distributed Filesystem• CDN• SAN/NAS/DAS

23

Swift Architecture

24

Swift Architecture

25

Swift Architecture

• Account service• Container service• Object service• Consistency service

26

Swift Architecture (Account service)

27

Swift Architecture (Account service)

28

Swift Architecture (Container service)

29

Swift Architecture (Container service)

30

Swift Architecture (Container service)

31

Swift Architecture (Object service)

• Use file system to store files• Files named by timestamp• Directory structure

• /mount/data_dir/partition/hash_suffix/hash/object.ts

32

Swift Architecture (Consistency service)

• Replicators• Auditors

33

Swift Architecture

34

Swift Architecture

35

Swift Architecture

36

Swift Architecture (Proxy tier)

37

• Handles Incoming Request

Swift Architecture (Ring)

• Maps data (account, containner, objects) to storage server

38

Swift Architecture (Zones)

39

• Isolate Physical failures

Swift Architecture

• Write

40

Swift Architecture

• Read

41

Swift features

• CORS• Upload directly from the browser via javascript to Swift

• Versioning• Allow versioning all object in a container

• TempURL• Temporary URL generation for objects

• FormPost• Translate a browser form post into a regular Swift object PUT

• Account Quotas• Give operator ability to limit or set as read only accounts

42

Swift features

• Binding for different languages: python, ruby, java..• Mutiple CLI tools: python-swiftclient, jcloud, fog..• Vv..

43

Referent

• https://www.youtube.com/watch?v=5N5a_cgxotg• http://www.slideshare.net/openstackcommgr/

openstack-swift-overview-oscon2011• http://www.slideshare.net/Hostingdotcom/openstack-

swift-in-the-enterprise• http://www.florentflament.com/blog/openstack-swift-

ring-made-understandable.html• http://www.rackspace.com/blog/introduction-to-object-

storage/

44

Principal Architect, Rackspace Cloud BuildersAnthony Young

Thank You!