Tim Feldman Technologist Product Development @timfoon
OpenStack Icehouse Design Summit November 2013
Agenda
••••
•–
»»
–
»
•
•–
Workload Generation, Tracing and Analysis
Detailed look a 3 of 60 drives
disk s2b1/sdn (low)
s3b1/sdd (ave)
s3b1/sdp (high)
trace duration [minutes] 29.2 29.1 29.1 command rate [IOPS] 37.4 52.5 57.9 data transferred [GB] 20.8 23.6 25.9
data throughput [MB/s] 11.9 13.5 14.8
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
0.1 1 10 100 1000 10000 100000
Cum
ulat
ive
Port
ion
Sequential Run Length [KiB]
swift-bench 20-MiB objectsSequential Run Counts and Data Transfer Counts by Sequential Run Size
high seq'l run count
med. seq'l run count
low seq'l run count
high data xfer count
med. data xfer count
low data xfer count
90% of the disk ops move 1% of the data
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
0.1 1 10 100 1000 10000 100000
Cum
ulat
ive
Port
ion
Sequential Run Length [KiB]
swift-bench 20-MiB objectsSequential Run Counts and Data Transfer Counts by Sequential Run Size
high seq'l run count
med. seq'l run count
low seq'l run count
high data xfer count
med. data xfer count
low data xfer count
When, where and how big
A new open storage platform
Disintermediated Hardware and Software
•–
•
–
•–
–
•–
Disintermediate
Disaggregated Storage
•
–
–
•–
–
•–
Disaggregate
Seagate’s Kinetic Open Storage Platform
•••
SAS versus Kinetic Open Storage
•••
Device Functional Model
Kinetic
•–
•–
–»»
Kinetic Open Storage API
Partition Collection Name Chunk id
•–
–
–
–
Kinetic Open Storage API
•–
•–
–
•–
–
Kinetic Open Storage API
•–
–
–»»
–»
Kinetic Open Storage API
•»
–
–
–
•–
–
–
–
–
Kinetic Open Storage API
•–
–
–»»»»
Kinetic Open Storage API
•»»
•»»»
Kinetic-Swift In Action
Kinetic-Swift Topology
Kinetic Open Storage Platform