MySQL in the Cloud, is Amazon RDS for you?

transcript

MySQL in the Cloud,is Amazon RDS for you?

MC Brown, Senior Product Line Manager

Introducing Continuent

• The leading provider of clustering and replication for open source DBMS

• Our Product: Continuent Tungsten

• Clustering - Commercial-grade HA, performance scaling and data management for MySQL

• Replication - Flexible, high-performance data movement

Quick Continuent Facts

• Largest Tungsten installation by data volume processes over 800 million transactions per day on 225 terabytes of relational data

• Largest installation by transaction volume handles up to 8 billion transactions daily

• Wide variety of topologies including MySQL, Oracle, Vertica, and Hadoop in production

• Cross-site topologies widely deployed

Continuent Tungsten Customers

The Cloud Data Stampede

Enterprises Racing to the Cloud

Important Questions for Data

• What features are required for enterprise data management?

• How do you ensure full control over the DBMS environment and upgrades?

• How do you integrate cloud and on-premises operation?

• What is the right level of support for your business?

Point and Click DBMS: Amazon RDS

How it Works Inside

DRBDReplication

(Synchronous)

Read Replicas

MySQL NativeReplication(Async)

Active Primary

Inactive Standby

Applications

DNS CNAME

Amazon RDSArchitecture

RDS Illustrates Limits of Pure Cloud Data Services

• Operates only in Amazon cloud

• Replicas tied to a single AWS region

• Maintenance requires downtime

• Connectivity to replicas is an application problem

• No direct control over/access to DBMS

• Weak integration with other DBMS types

• Minimalist support model

Another Approach to Cloud Data Management

Database-as-a-Service enabled for easy

enterprise operation in any environment

Tungsten Cloud-Enabled Clusters for MySQL

Tungsten Database-as-a-Service

Tungsten clusters combine off-the-shelf open source DBMS servers into data services with:

• 24x7 data access • Scaling of load on replicas • Simple management commands

...without app changes or data migration

Amazon US West

apache /php

GonzoPortal.com

Connector Connector

Cluster Architecture

Application

Tungsten Connector

Application

Tungsten Connector

Replicator

Db3Db1

Replicator

Slave SlaveMaster

Manager Manager Manager

Monitoring and Control

Data Service: sjc

Tungsten Connector Basics

• Any MySQL client can connect

• Initiates connections using JDBC

App Native protocol COM_QUERY

COM_INIT_DBCOM_DROP_DB

Connector

Tungsten Connector Basics

• Pass-through operation after connection

• Full transparency & low overhead for clients

Protocol packet COM_QUERY

select * from t

ConnectorProtocol packet

OKResultSet Rows:1

Mapping Tungsten to Amazon Cloud

US-East-1

EU-West-1

US-West-1

AZ AZ AZAZ AZ AZAZ

Replicas across availability zones

Clusters across regions

Tungsten Primary/DR Deployment

Warm data and apps in secondary region(s)

ApplicationApplications ApplicationApplications

Amazon Region Amazon Region

Live data and apps

in primary region only

Multi-AZ deployment

Async replication between sites

Run in Amazon or on-premise

Tungsten Multi-Master Deployment

No app or data coupling across regions

Amazon Region Amazon Region

Live data and apps

in all regions

Multi-AZ deployment

Async replication between sites

Run in Amazon or on-premise

Top-to-Bottom Control of DBMS Services

Cloud-Ready Automation

• Vagrant host provisioning

• Host configuration using Puppet

• Install cluster using .ini file

[defaults]application-password=secretapplication-port=3306application-user=appreplication-password=secretreplication-port=13306replication-user=tungstenstart-and-report=trueuser=tungsten

[alpha]connectors=web1,web2,web3master=db1members=db1,db2,db3

https://github.com/continuent-vagrant

Demo: Multi-AZ Continuent Tungsten

Clusters

A Familiar Trouble-Shooting Model

Login and fix it!

Zero-Downtime SQL Schema Upgrade

Final UpgradeSwitchSlave Upgrade Slave Upgrade

• Shun slave 1, run upgrade, and return to cluster (Discard and recover on failure)

• Upgrade old master

(Cluster schema is now fully upgraded)

• Repeat for additional slave(s)

(Discard and recover on failure)

• Switch master to an upgraded slave (Revert to old master on failure)

Hybrid Cloud Operation

Competing Economic Models

Perils of a Single Vendor

Date Duration Amazon Failure Description

Apr 2011 2 days US-East EBS failure - “Cloudpocalypse”

Aug 2011 1 day EU-West power outage causes multi-AZ EBS, EC2, and RDS failures

Jun 2012 1-2 days US-East AZs fail due to weather, EBS & other services down

Oct 2012 6+ hours US-East EBS failure triggered by bug brings down RDS and ELB

Aug 2013 1+ hours US-East EC2 networking failure

Dec 2013 3 hours US-East EC2 connectivity failures (again)

On-Ramp to Cloud with Hybrid Operation

Use Amazon as DR

location

On-Prem Primary Cloud DR

Establish primary in

existing data center

Hardware-based cluster

Async replication between locations

Multi-AZ in Amazon

©Continuent 2014 29

Data Management Needs of Business-Critical

Applications

©Continuent 2014

What are the big trends in the market?

• High performance transaction processing with 24x7 availability

• Data distribution across sites

• Cloud and on-premises operation

• Real-time reporting on all corporate data

©Continuent 2014

Growth of Analytics Capabilities

Most Valuable Features According to Continuent Customers

Automatic Failover

Zero-Downtime Maintenance

Load Balancing

Performance

Multi-Site Ops

Disaster Recovery

Percentage of Respondents

0% 20% 40% 60% 80%

Customer Growth Trends

Increasing Clusters

Adding Analytics

Adding Both

Percentage of Respondents

0% 10% 20% 30% 40%

Continuent Tungsten 3.0

• Continuent Tungsten Clustering

• Certified Replication to Datawarehouse

• Straight from the cluster

• Hadoop (MapR, HortonWorks, Cloudera, IBM, Pivotal, Apache, Amazon EMR)

• HP Vertica

• Amazon RedShift

• Oracle (Bi-Directional)

Real-time Loading from Clustered MySQL to Data Warehouses

TungstenReplicator

cluster1 AmazonRedshift

cluster2

Hybrid Data Integration

Web-facing transaction processing

ApplicationApplications

AmazonEnterpriseResourcePlanning(ERP)

Corporate DC

Private Cloud

Hadoop-based analytics

AsynchronousReplication

Roadmap for CT 3.0 release

• All features described here are working with anchor customers

• We are polishing integrations and improving documentation

• We are looking for 3.0 beta customers now

• Full product release will occur during Q4

Enterprise-Class Support from Continuent

• Worldwide support team with 24x7 response

• Advice, workarounds, and bug fixes

• 1st line staffed by MySQL/clustering experts

• Fast escalation to engineering for problems

• Collaborative support model using Zendesk and GotoMeeting

• Implementation services for new deployments and upgrades

Wrap-Up

Tungsten clusters offer a better alternative to pure cloud services

• Cloud-only database services have significant limitations

• Tungsten enterprise-ready clusters function equally well in cloud and on-prem

• Continuent offers software and support to manage business-critical data for the most demanding applications

• Continued 24x7 transaction processing based on economical MySQL DBMS

• Certified hybrid multi-site operation

• Cloud-optimized Puppet/Chef provisioning

• Certified HA / analytics integration

www.continuent.comFollow us on Twitter @continuent

Tungsten Replicator:http://code.google.com/p/tungsten-replicator

Our Blogs: http://scale-out-blog.blogspot.com http://datacharmer.org/blog http://mcslp.com http://www.continuent.com/news/blogs http://flyingclusters.blogspot.com/

560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009 e-mail: sales@continuent.com

MySQL in the Cloud, is Amazon RDS for you?

Technology