HIGHLY RELIABLE PETABYTE S TORAGE

Enterprise LevelS afe S torage S olution

by Peter aNeutrino

24.04.201 2 d la Ge m ius

Classic storage is expensive

2/36

MooseFS

3/36

C o m p a r i s o n o f B a s i c , A d v a n c e d a n d

E n t e r p r i s e s u p p o r t c o n t r a c t s t y p e s

s u p p o r t r i g h t s b a s i c a d v a n c e d e n t e r p r i s e

p o s s i b i l i t y t o c o m e o n y o u r s i t e

p r o a c t i v e m o n i t o r i n g

r e q u e s t r e m o t e a s s i s t a n c e

c a ll u s - + 4 8 2 2 3 7 8 3 0 8 2

e - m a i l u s - h e lp @ m o o s e f s . c o m

c u s t o m e r p o r t a l

d e d i c a t e d t e c h n i c a l a d v i s o r

Levels of Technical Support

4/36

MooseFS

S a f e t y K n o w le d g e P e r f o r ma n c e

5/36

Table of Savings in AdOcean

6/36

90 TB +90TB (total 180TB) +220TB (total 400TB)

630 000 580 000 1 100 000

220 000 150 000 290 000

80 000 140 000 210 000

330 000 290 000 600 000

1 220 000

2 0 10 2 0 11 2 0 12

T h e s iz e o f s t o r a g e

2 0 11

A lt e r n a t iv e s t o r a g e

MooseFS equipmentIntel Storage Servers + disks

MooseFS support

S a v in g s

Sums in PLN

Recapitulation of gained profits (expenses in particular years):

M o o s e in N u m b e r s

L e n g t h : t o 2 m

H e ig h t : t o 3 m

W e ig h t : t o 7 0 0 k g

Creative Commons, Ryan Hagerty http://www.flickr.com/photos/usfwshq/6862339335/7/36

MooseFS in numbers:

M a x im u m s iz e o f in s t a n c e :

16 EiBM a x im u m f i le s iz e :

128 PiBM a x im u m n u m b e r o f f i le s :

536 millions

8/36

MooseFS in numbers,P R O D U C T IO N :

T h e la r g e s t in s t a n c e :

More than 6PB (for 2 years)

T h e la r g e s t f i le :

More than 8TB (from 2011)

T h e la r g e s t n u m b e r o f f i le s :

More than 100 million (for 4 years)(backup for 400 for linux)

9/36

B lo c k s t o r a g eDivision of space into memory blocks “vrtiual hard drives”

A d v a n t a g e s o f s u c h s t o r a g e s o lu t io n :

- availability on the market,

- ease of installation (“turning on with pushing the button”),

- standardisation,

- allows to install any file system.

10/36

B lo c k s t o r a g eDivision of space into memory blocks “virtual hard drives”

D is a d v a n t a g e s o f s u c h s t o r a g e s o lu t io n :

- limit of the scalability,

- drives that are certified by manufacturer of the matrix,,

- the necessity of all the drives to be the same sized,

- negative influence of the breakdowns at the efficiency of the system.

11/36

F i le s t o r a g eManagement of the files on any disk space (for example 15 0 0 h a r d

d r iv e s )

A d v a n t a g e s o f s u c h s o lu t io n :

- effective space management,

- utilization of processing power of the cluster for business applications,

- repairs are up to 1000 times faster,

- possibility to use it with cheap equipment.

12/36

F i le s t o r a g eManagement of the files on any disk space (for example 15 0 0 h a r d

d r iv e s )

D is a d v a n t a g e s o f s u c h s o lu t io n :

- less efficient with small size data,

- sometimes dedicated software is needed in order to connect given server to file storage resources..

13/36

Unrecoverable Read Error

Total Disk Faliure

Annual Fail Rate

Mean Time Before Failure

RAID 5RAID 6

R E P A IR T IM Erecovering of 1TB+ disk

is from 2 to 20h

14/36

In M o o s e F S The larger the storage The faster the recovery

15/36

Machanism of r e p l ic a t io n solves the problems of: AFR, MTBF, TDF

16/36

M o o s e F S has built-in fast and transparent c o n t r o l s u m s , that solve the URE problem

17/36

M o o s e F S has built-in fast and transparent c o n t r o l s u m s

18/36

M o o s e F S has built-in fast and transparent c o n t r o l s u m s

19/36

M o o s e F S has built-in fast and transparent c o n t r o l s u m s

20/36

WITH MooseFS IT IS WORTH TO USE DISKS 1TB+

21/36

ceny z serwisu CENEO

MooseFS is used by interactive internet television “IPLA” since 2008.

Tanks to MooseFS they have storage with the best ratio of price and GigaByte on the market.

22/36

R O I for block storage

23/36

R O I is higher with M o o s e F S

24/36

“We have chosen to use MooseFS because of the great opportunity of developing the infrastructure

(you can add any disks of any size)(...). ”

Giovanni Toraldo,http://blog.opennebula.org/?p=1512

25/36

Extra functions with MooseFS

26/36

S n a p s h o t s - fast and always possible

27/36

S n a p s h o t s - fast and always possible

28/36

S n a p s h o t s - fast and always possible

29/36

Admins and users adore t r a n s p a r e n t t r a s h function

30/36

M o o s e F S is free — G P L v 3

31/36

S a f e , e f f ic ie n t and t e s t e d storage solution

with e n t e r p r is e s u p p o r t

32/36

Since 2005, we work on the development and continuous improvementof M o o s e F S - foolproof distributed file system.

We provide professional servicesrelated to the use MooseFS:

- creation of client-specific solutions,

- technical support,

- providing trainings,

- verification and audit,

- providing consultations and advices.

34/36

35/36

Customer Driven Development

CDD

36/36