Date post: | 26-Jan-2015 |
Category: |
Technology |
Upload: | amazon-web-services |
View: | 108 times |
Download: | 0 times |
Rahul Pathak
Understanding Database Options on AWS
Senior Product Manager
@rahulpathak
We want to make it easy for you to go from
1. Zero to Application in ____ Minutes
2. Zero to Millions of users in ____ Days
3. Zero to “Profits!” ASAP
Focus on your application
Spectrum of options
SQL NoSQL
Low Cost High Cost
Do-it-yourself Fully Managed
Not available on AWS
Spectrum of options
SQL NoSQL
Do-it-yourself Fully Managed
RDS
- MySQL
- Oracle - SQL Server
Spectrum of options
SQL NoSQL
Do-it-yourself Fully Managed MySQL
Oracle
SQL Server
PostgreSQL Your favorite RDBMS
Spectrum of options
SQL NoSQL
Do-it-yourself Fully Managed
MongoDB
Cassandra
Redis
Memcache Amazon DynamoDB
Amazon ElastiCache
Thinking about the questions
Should I use SQL or NoSQL?
Should I use MySQL on EC2 or RDS?
Should I use MongoDB,
Cassandra, or DynamoDB?
Should I use Redis, Memcache, or ElastiCache?
?
Actually, thinking about the right questions
What are my scale and latency needs?
What are my transactional and
consistency needs?
What are my read/write, storage
and IOPS needs?
What are my time to market and server
control needs?
?
What’s important for your application and your team?
Factors SQL NoSQL
Application • App with complex business logic? • Web app with lots of users?
Transactions • Complex transactions, joins, updates? • Simple data model, updates, queries?
Scale • Developer managed • Automatic, on-demand scaling
Performance • Developer architected • Consistent, high performance at scale
Availability • Architected for fail-over • Seamless and transparent
Core Skills • SQL + Java/Ruby/Python/PHP • NoSQL + Java/Ruby/Python/PHP
Best of both worlds: Use both SQL and NoSQL models in one app
Where do you want to spend your time?
Factors Do it Yourself (DIY) Fully Managed
Replication • Granular, app managed • Transparent to the app and configured by the
service
Monitoring • Specific agents and custom • Automated and API driven
Security • Root access, custom configurations • Hardened by the service
Resources • Requires more dev resources and time • Requires minimal dev resources and time
Time to market • Sophistication vs. speed • Rapid iteration
Required Skills • Systems, databases, monitoring focused • Application development, User centric
Best of both worlds: Possible to manage different tiers differently
We believe in choice – one size does not fit all
Amazon RDS
+ ElastiCache
Amazon DynamoDB
Amazon Redshift
Just Launched!
Traditional Apps Relational DB Needs
New Web Apps Massive Scalability
High Performance, High Scale Data Warehouses
Amazon RDS is a fully managed SQL database service
Simple to deploy and scale
Without any operational burden
Reliable and cost effective
Choice of database engines
Schema design
Frequent server upgrades
Storage upgrades
Backup and recovery
Software upgrades
Patching
Hardware mgmt.
Query construction
Query optimization
Configuration management
Migration
Offload the “muck” to RDS
Focus on the App “innovation”
Amazon RDS drives developer and IT productivity
Amazon RDS Configuration
Improve Availability
Increase Throughput
Reduce Latency
Push-Button Scaling
Multi-AZ
Read Replicas
Provisioned IOPS
Read Replicas Push-Button Scaling Provisioned IOPS
Region
Multi-AZ
Availability
Zone
Availability
Zone
Amazon RDS high availability and performance options
Amazon RDS Read Replica
A few clicks or one API call
Do-it-yourself MySQL Read Replica
~30+ manual steps
Creating a read replica
Amazon RDS Multi-AZ
A few clicks or one API call
Do-it-yourself MySQL on AWS
Potentially ~100+ manual steps
Set up primary and standby instances
Set up identical volumes
Create synchronous replication
Create and manage DNS entries
Detect instance failure conditions
Detect network failure conditions
Detect storage failure conditions
Decide when to fail-over….
Re-establish primary secondary connections.
Creating high availability database deployments
Who is succeeding with RDS?
More than 30,000 developers use RDS every single day
Gaming Web Apps Mobile/Social Media
Amazon RDS – Recently announced features
• 3 TB database size & 30,000 IOPS
• Online conversion from Standard to Provisioned IOPS storage
• Promote Read Replica to Master
• Stay tuned…
Amazon ElastiCache is a fully managed
Memcached-compatible caching service
Easy to set up and operate
Scale cache clusters with push button ease
Without any operational burden
Ultra fast response time for read scaling
Amazon ElastiCache – Recently announced features
• Free tier & new instance sizes (Micros and Mediums)
• Amazon VPC support
• Auto Discovery
• Stay tuned…
Amazon DynamoDB is a fully managed NoSQL
database service
Store and retrieve any amount of data
Scale throughput to millions of I/O
Without any operational burden
Single-digit millisecond latencies
From the creators of the first NoSQL technology
Do-it-yourself NoSQL on AWS Amazon DynamoDB
Potentially ~100s of manual steps Three clicks or one API call
Select the right NoSQL Database engine
Deploy hardware configurations
Set up software configurations
Decide and deploy replication configurations
Create and manage DNS entries
Detect instance failure conditions
Detect network failure conditions
Detect storage failure conditions
Decide when to fail-over….
Re-establish application connections.
Creating NoSQL deployment on AWS
Amazon DynamoDB: who is succeeding with it?
Data warehousing done the AWS way
• No upfront costs, pay as you go
• Really fast performance at a really low price
• Open and flexible with support for popular tools
• Easy to provision and scale up massively
Amazon Redshift is a fast, powerful, fully managed,
petabyte-scale data warehouse service
10x cheaper
Without any operational burden
Easy to use
10x faster
Amazon Redshift architecture
• Columnar, massively parallel processing (MPP)
• Scales from hundreds of gigabytes to a
petabyte or more
• Connects to standard SQL-based clients and BI
tools using JDBC/ODBC via Postgres drivers
• Fully-managed service
• Pay as you go, no software license fees
• VPC, SSL, and transparent data encryption
10 GigE (HPC)
Ingestion Backup Restore
JDBC/ODBC
Medidata Solutions
Isaac Wong
VP of Platform Architecture
Choose the best tool for the job
• One size does not fit all
• Managed or do-it-yourself offerings for virtually all use cases
– These aren’t mutually exclusive
• Focus on your application
Resources & Questions
• Rahul Pathak | [email protected] | @rahulpathak
• http://aws.amazon.com/dynamodb
http://aws.amazon.com/rds
http://aws.amazon.com/elasticache
http://aws.amazon.com/redshift
• https://aws.amazon.com/marketplace