Date post: | 08-May-2015 |
Category: |
Business |
Upload: | aline-vazzoler |
View: | 705 times |
Download: | 0 times |
1º AWS LATAM Partners Summit
São Paulo, 9 de Maio de 2012
AWS Executive Briefing: Storage
AWS CONFIDENTIAL
Umesh Sampat | Solutions Architect
Agenda
What is AWS?Common Storage ChallengesStorage Overview S3 High Level S3 Deep Dive
Next Generation Enterprise StorageWhy AWS + S3?
AWS CONFIDENTIAL
What is AWS?: AWS Platform
Your Applications
Foundation Services
Building Block Services
Compute Storage Database Networking
Application Platform Services
Management & Administration
AWS Global InfrastructureRegions
Availability ZonesEdge Locations
Content Distribution
MessagingParallel
ProcessingLibraries &
SDKs
Administration Console
Identity & Access
Deployment Monitoring
AWS CONFIDENTIAL
Common Data Storage Challenges
Data growth spiraling out of controlTraditional technologies and processes don’t scaleTry to accurately predict storage needsOffsite / Secondary data centers are expensiveSAN systems are very expensiveNAS systems are expensiveArchive HW + SW is expensiveBackup HW + SW is expensiveTape is unreliable and cumbersomeMulti-site collaboration is often challengingIT response times can hinder the pace of innovation
AWS CONFIDENTIAL
What if you could……..Go global with a few key strokes?Go active in a few clicks?Eliminate capacity planning?Eliminate provisioning for peak demand?Eliminate the need for secondary sites?Consolidate Gold Copy, Backup, DR, and Archive?Slash your DR budget by 50%?Eliminate the need for tech refresh?Eliminate 30%+ of your storage footprint?Eliminate tape?
AWS CONFIDENTIAL
Amazon S3 offers a way to……
Confidently rethink storage strategy: Architecture Capacity Planning Provisioning Operations Consumption Run rate ROI Risk
US West Region (N. CA)
US West Region (Portland)
South America Region (Sao Paulo)
US GovCloud Region (Portland)
EU West Region (IRE)
US East Region (N. VA)
Japan Region (Tokyo)
APAC Region (Singapore)
AWS CONFIDENTIAL
No Up-Front Capital Expense
Pay Only for What You Use
Self-Service Infrastructure
Easily Scale Up and Down
Improve Agility & Time-to-Market
Low Cost
Amazon S3 Benefits
Deploy
AWS CONFIDENTIAL
What is Amazon S3?
Scalable
Reliable
Fast
Inexpensive
Simple
Simple Storage Service: Storage for the Internet
AWS CONFIDENTIAL
What is Amazon S3?
No SPOFAvailability: 99.99%Durability: 99.999999999%
Simple Storage Service: Storage for the Internet
Store 10,000 objects in S3 and expect to lose one object every 10,000,000 years.
AWS CONFIDENTIAL
Global: Global Infrastructure for Global Enterprises
US West(Northern California)
US East(Northern Virginia)
EU(Ireland)
Asia Pacific
(Singapore)
Asia Pacific(Tokyo)
AWS Regions
AWS Edge Locations
GovCloud(US ITAR Region)
US West(Oregon)
South America(Sao Paulo)
AWS CONFIDENTIAL
Durable: AWS Regions and Availability Zones
Customer Decides Where Applications and Data Reside
AWS CONFIDENTIAL
Scalable - Fast – Proven – Accepted
AWS CONFIDENTIAL
Peak Requests: 650,000+ per second192% Growth in 2011
Total Number of Objects Stored in Amazon S3
2.9 Billion 14 Billion 40 Billion102 Billion
762 Billion
262 Billion
905 Billion
Q4 2006 Q4 2007 Q4 2008 Q4 2009 Q4 2010 Q4 2011 Q1 2012
Secure
Identity and Access Management (IAM) Create and manage multiple users under a single AWS account Grant IAM users fine-grained control to your Amazon S3 bucket or
objects
Access Control Lists (ACLs) Use ACLs to selectively add (grant) certain permissions on
individual objects
Bucket Policies Add or deny permissions at the bucket level across some or all of
the objects within a single bucket
Query String Authentication Share Amazon S3 objects through URLs that are valid for a
predefined expiration time
AWS CONFIDENTIAL
Secure
Encryption Amazon S3 Encryption Client
• Encrypt your data before uploading to Amazon S3• Customer manages encryption keys
SSL Server Side Encryption
• AWS manages the keys with SSE
Logging Capture all requests made against a bucket or the objects
within the bucket These logs can be used for auditing purposes
AWS CONFIDENTIAL
Secure
AWS CONFIDENTIAL
Simple
No managementNo backupEliminate Rack & StackNo snapshotsNo provisioningFOCUS ON THE BUSINESS NOT THE TECHNOLOGY Speed business innovation
AWS CONFIDENTIAL
Inexpensive
Pricing Options: Standard Storage RRS
16 price reductions to dateAmazon S3 passes on AWS savings to the customer
AWS CONFIDENTIAL
Next Generation Enterprise Storage - S3
AWS CONFIDENTIAL
First, let’s visit some storage basics
AWS CONFIDENTIAL
Storage Basics - Block vs. File vs. Object Storage
• Block Storage:– Data organized as an array of unrelated blocks– Host File System places data on disk: Microsoft NTFS or Unix ZFS– Structured data is predicted to grow at 18.7% CAGR until 2018
• File Storage: – Unrelated data blocks managed by a file (serving) system– Native file system places data on disk: EMC UxFS or NTAP WAFL– Unstructured data is predicted to grow at 47.3% CAGR until 2018
• What is Object Storage?: – A new data access, data storage, and data management model
• API access to data vs. traditional block or file system access• Metadata Driven, Policy-based, Self Managing storage • No host overhead for storage functions
– A system that stores virtual containers that encapsulate the data, data attributes, metadata, and Object IDs
AWS CONFIDENTIAL
Storage Basics - SAN vs. NAS vs. Cloud Storage
SERVERS
Cloud Storage
NASNAS
SANSANDatacenter Proximity
Ethernet / Optical
Datacenter Proximity
Ethernet
Cloud Proximity
API / HTTP(S)
FILESYSTEMS
APPLICATIONShttps://
nfs / cifs
FC / iSCSI / FCoE
• SAN and NAS are integrated with clients via the operating system• Cloud Storage is an application level integration
AWS CONFIDENTIAL
Archiving is the process of moving data that is no longer actively used to a separate data storage device for long-term retention. Data archives are indexed and have search capabilities so that files and parts of files can be easily located and retrieved.
Backup or the process of backing up is making copies of data which may be used to restore the original after a data loss event. The primary purpose is to recover data after its loss, be it by data deletion or corruption. The secondary purpose of backups is to recover data from an earlier time.
Disaster recovery is the process, policies and procedures related to preparing for recovery or continuation of technology infrastructure critical to an organization after a natural or human-induced disaster.
S3 blurs the lines and collapses budgets
AWS CONFIDENTIAL
Storage Basics - Cloud Storage: SDK or Plug & Play?
SDK: Application Developers can
leverage the S3 SDK for custom application
integration
Plug & Play: IT can bridge on-premises environments
with familiar storage interfaces and
methodologies via Cloud Storage Gateways
AWS CONFIDENTIAL
Web Services API HTTP(S)
Cloud Storage Use-Cases for the Enterprise
AWS CONFIDENTIAL
Next Generation Enterprise Storage - Overview
AWS CONFIDENTIAL
Cus
tom
er D
ata
Cen
ter
HTTP(S)
US West Region (N. CA)
US West Region (Portland)
South America Region (Sao Paulo)
US GovCloud Region (Portland)
EU West Region (IRE)
US East Region (N. VA)
Japan Region (Tokyo)
Block File Archive Backup DR
Direct Connect or InternetWeb Services API
HTTP(S)
APAC Region (Singapore)
Cloud Storage Gateway Benefits
Eliminate Arch. HW / SW
Eliminate Tape
Recover in Cloud or in any Data Center
Reduce SAN Footprint
Next Generation:Gateway + Cloud Storage
Primary Block Storage
Disk Based Backup Storage
Tape Infrastructure & Management
Archival Storage
Replicated Storage for Disaster Recovery
Offsite Locations Geo-Resilience
Traditional: On-Premise Solutions
$$$$$ $
Eliminate Secondary Data Centers
Primary File Storage
Reduce NAS Footprint
AWS CONFIDENTIAL
Eliminate B.U. HW / SW
AWS CONFIDENTIAL
Next Generation Enterprise Storage Use Case: Backup & DR with the AWS Storage Gateway
Benefits ELIMINATE TAPE! Recover Seamlessly in EC2 Reduce DR cost by 50%
Eliminate Backup Software Backup with 11-9s of durability Low cost file server storage
Next Generation Enterprise Storage Use Case: Thin SAN Storage with S3
SAN GW
Benefits Massive SAN footprint reduction Simplify SAN storage Lower costs with data reduction
- Dedplication - Compression
Enterprise grade security Reduce DR cost by 50% Never migrate again!
Fast, online restores + tape elimination Integrated disaster recovery Low cost file server storage
Enterprise Class Dual Controller for High Availability No Single Point of Failure Non-Disruptive Software Upgrades Certified by Microsoft & VMware
iSCSI storage integrates transparently Self-protecting primary storage Secondary and data protection storage
Features that reduce cost, simplify storage
Thin provisioning Primary storage deduplication
Performance with cloud elasticity and cost
WSL and integrated tiering, SSD, and SAS Multiple cloud providers
Enterprise-grade security for the cloud Local keys and encryption of all cloud data Protecting both data-in-motion AND data-at-rest
Simplified, optimized data protection Fast online restores and elimination of tape Integrated disaster recovery at lowest cost,
complexityAWS CONFIDENTIAL
Next Generation Enterprise Storage Example: Thin SAN Storage with S3
NAS GW
Next Generation Enterprise Storage Use Case: Thin NAS Storage with S3
Benefits Massively Scalable NAS Storage Eliminate 30% of NAS storage
footprint Combine Production + Archive +
Backup + DR Global File Namespace Centralize Capacity Never run out of capacity Never under provision capacity!
Eliminate Backup Software for files Eliminate Archive Software for files
NAS GW
NAS GW
Next Generation Enterprise Storage Use Case: Thin NAS Storage (cont.)
HTTP(S)
US West Region (N. CA)
US West Region (Portland)
South America Region (Sao Paulo)
US GovCloud Region (Portland)
EU West Region (IRE)
US East Region (N. VA)
Japan Region (Tokyo)
APAC Region (Singapore)
AWS CONFIDENTIAL
Next Generation Enterprise Storage Example: Thin NAS Storage with S3
AWS CONFIDENTIAL
Next Generation Enterprise Storage Example: Fast File Transfer into AWS
Multi-part Upload Up to 700 Mb/s direct to Amazon S3
Internet
1Gb and 10Gb Connections
Next Generation Enterprise Storage Example: Fast File Transfer into AWS
Next Generation Enterprise Storage Use Case: File Archive with S3
NAS
NAS
NAS
Archive GW
Benefits Significant capital savings Eliminate NAS upgrades Reduce NAS capacity up to 80% Significantly scale existing systems Never under provision = reduced risk Never run out of capacity
Reduce backup times by 80% Reduced replication = bandwidth
savings
VNX
VNX
NTAP Celerra NS
File servers
Location 1 Location 2 Location 3 Location 4
HTTPS HTTPS HTTPS HTTPS
US West Region (N. CA)
US West Region (Portland)
South America Region (Sao Paulo)
US GovCloud Region (Portland)
EU West Region (IRE)
US East Region (N. VA)
Japan Region (Tokyo)
APAC Region (Singapore)
AWS CONFIDENTIAL
Next Generation Enterprise Storage Example: File Archive with S3
Local Storage Amazon
Local file system interface to the SOAP / REST API used by the Amazon storage cloud platform
Virtual namespace to seamlessly integrate local and Amazon cloud storage cloud for users
1
SOAP / REST
CIFS / NFS
2
Automatically identify inactive and other appropriate files to store in the Amazon storage cloud
3 4
Migrate files to Amazon storage cloud platform without disrupting user access or causing downtime
5
Encrypt every file stored in the Amazon storage cloud for data security
AWS CONFIDENTIAL
Next Generation Enterprise Storage Example: File Archive with S3
Next Generation Enterprise Storage Use Case: Email Archive with S3
Archive GW
Benefits Significant capital savings Eliminate email quotas Reduce Storage upgrades Increase mail store capacity by 80% Never run out of email capacity Keep all email online
Reduce backup times by 80% E-Discovery / Compliance Features Search
Integrates with major email systems100% Email capture Internal and internet Email
Unlimited storage Lifecycle and storage allocation
Full text indexing Header, body and attachments
Advanced searching based on indexing Advanced E-Discovery features Legal hold Add comments Mark as reviewed, saved, needs
attention Add tags
Multiple export options .pst, pdf, text, mime, .eml, HTML, etc.
100% Web-based access
AWS CONFIDENTIAL
Next Generation Enterprise Storage Example: Email Archive with S3
Next Generation Enterprise Storage Use Case: Tapeless Cloud Backup
Backup GW
Benefits Eliminate tape Eliminate tape hardware Eliminate VTLs (Data Domain) Never run out of backup capacity Maintain existing BU Software +
paradigms
Secure cloud backup Eliminate off-site tape storage
Random Access to ALL backup/archive files at all timesData integrityNO TAPES OR TAPE LIBRARIES!No human handlingInfinite Scalability
• Deduplication 90 day backup:Unstructured Data - 20:1Structured Data - 5:1Imaging Data – 3:1
• Throughput rates:Up to 800 Mbs sustained
• Ingest/Restore rates:8 TB/day raw16 TB/day deduplicated (first pass)
AWS CONFIDENTIAL
Next Generation Enterprise Storage Example: Tapeless Cloud Backup
AWS CONFIDENTIAL
Next Generation Enterprise Storage Use Case: Tapeless Cloud Backup
Next Generation Enterprise Storage Example: Backup Oracle Database with S3
Corporate Data center
Oracle RMAN
Oracle Secure Backup Module
S3
Region
Amazon S3 + AWS Ecosystem = Business Value
US West Region (N. CA)
US West Region (Portland)
South America Region (Sao Paulo)
US GovCloud Region (Portland)
EU West Region (IRE)
US East Region (N. VA)
Japan Region (Tokyo)
APAC Region (Singapore)
CloudFront
Cloud Search
EC2Direct Connect
Import / Export
Elastic Map Reduce (EMR)
DynamoDB
AWS CONFIDENTIAL
Benefits:Financial: Significant reduction in capital investments Pay for only what you use: Metered Utility Eliminate the need to over purchase AWS prices continue to fall over time
Operational: Streamline and simplify data management operations Reduction of systems and data centers Focus employees on proactive and innovative tasks
Business: Never stop the business as capacity is endless Never slow the pace of innovation Turn IT into an innovation enabler
AWS CONFIDENTIAL
For more information about S3, visit….
http://aws.amazon.com/S3/
AWS CONFIDENTIAL
Thank You
AWS CONFIDENTIAL