S3 Deduplication with StorReduce and Cloudian

Post on 15-Apr-2017

242 views 2 download

transcript

Agenda

1

2

3

4

5

Introductions

UseCases

Question&Answers

ProblemswithLegacyDeduplication

MovingDeduplicationtoaCloud1stModel

About Cloudian

3

CLOUDIAN PARTNERS

TECHNOLOGY

GLOBAL PRESENCE

HQ:SanMateo,CA;OfficesinUS,Japan,China,EMEA

TOP TECHNICAL TALENTWithdeepexperienceinstorage,bigdata&enterprisesoftware

TOP TIER INVESTORSIntel,Fidelity,GoldmanSachs,INCJ

BORN IN JAPANBASED IN SILICON VALLEYTofixstorageproblemscreatedbyexponentiallygrowingdata

�2011

�$44M

�80

�Global

CHANNEL

About StorReduce

Firsts:• Firstcloudcentricdeduplicationengine• 1 of8 launchpartnersGoogleColdline• 1 of4 launchpartnersAmazonS3-IA

Clientson3Continents

HQ:Sunnyvale,CAOffices:USA&AsiaPacific

“WeuseStorReduceinproductionforamajorUShealthcarecompany.StorReducedoesexactlywhatitsaysitwill.It'smarketchanging.”BillYoung,DirectorProfessionalServices,Equinix

ProblemswithLegacyDeduplication

NotBuiltforCloud

LegacyDeduplicationbuilttosupportCIFS/NFS• RequireExpensiveDiskBasedsolutions• Dataislockedintoandaccessibleonlyfromtheappliance• Unabletohandlehighlatencyconnections• NotStateless• MakesmovingtotheCloudharder&moreexpensive

NotallDeduplicationisEqual

FixedBlockSizeslimitefficiencyRequireaScale-UpapproachNoGlobalDeduplicationacrossDatasetsDatabasesbecomefragmentedon-recoveryFragmenteddataincreasesstoragecosts

PollIfyoucouldreuseyourbackupdata,howwouldyouuseit?DataMiningSearchDev/Test

IntroducingStorReduce withCloudianACloudFirstApproachtoDeduplication

10

CloudReadyBackups

11

CloudFirstDeduplication

StorReduce deduplicates S3streamsofdataPerfectfor:• PrimaryBackupData• TapeReplacement• HybridStorage• DatabaseBackups• HadoopBackups• OtherUnstructuredData

• VariableBlockDeduplication• ReduceNetworkBandwidthandDataStorage

• RemoteOfficeFriendly

StorReduce is…

Fast1400MBps/Instance,Inline&Multi-Threaded

StatelessAllData&MetaData storedinCloudian/PublicCloud

Scalable80PB/Instance

UnlimitedInstances

SoftwareDefinedDeployasVM,DockerContainerorRPM

SecureClientSideEncryption

orS3SSE

EnterpriseReadyHighAvailability,Read

Replicas&CloudReplication

CloudianScale-Out

13

HyperStore:ScaleOutPerformance&Capacity

CommodityServers ScaleOut Durable SimpletoUse

HeterogeneousNodes

500TB+Usable

Multi-Rack,Multi-Datacenter,Multi-Region

100TB+Usable

StartSmall&Expand

3PBUsable

StoragewithoutCompromise

REPLICATION(RF=1,2,3,4)

ERASURECODING(N+1,2,3,4)

CONSISTENCY(StrongorEventual)

PoliciesAppliedperBucket• ChooseDurability• ErasureCoded• Replicated

• ChooseGeographicAvailability• OneDatacenter• MultipleDatacenters• ReplicatedErasureCodes

• Plus+• StrongorEventualConsistency• TiertoAmazonS3orGoogleCloudStorage• Encryption

EncryptionSSEorSSE-C

GeographicDispersionAssignCopiesperDC

NewEconomicsofDeduplication

JBODStorReduce $0.07/GB

CloudianHyperStore$0.25

*BasedonAnalystreportedStreetPriceforObjectStorageandDeduplicationAppliances

JBOD

CPU/ControllerCloudian&StorReduce$0.32/GB

DataDomainorNetAppAltaVault

$1.00/GB• 66%CostSavingsincludingHardware• Payforwhatyouneed• NoForkliftUpgradeevery3-5Years

PollWhatisyourcurrentBackupApplication(s)NetBackupCommVaultIBMSpectrumProtect(TSM)VeeamOracleRMAN

UseCasesACloudFirstApproachtoDeduplication

18

NetBackup

NetBackupv7.7EnablesS3Backups• Full/IncrementalOnly• V8.0noannouncedsupportforDedupe

Clients NetBackupMediaServer(s)

StorReduce

CloudianHyperStore

19

Commvault

Clients CommvaultMediaAgent(s)

StorReduce

CloudianHyperStore

DeduplicationpoolbecomesfragmentedGarbagecollectionissuesonobjectstorage

Questions?ThankYou

www.cloudian.com

CloudStorageforEveryone