Date post: | 17-Jan-2017 |
Category: |
Software |
Upload: | continuent |
View: | 403 times |
Download: | 1 times |
© 2015 VMware Inc. All rights reserved.
VMware Continuent Replication Enabling HA, DR, data warehouse loading, and license reduction for Oracle users
vCloud Air Data Services
September 24th, 2015
2
Agenda
1 Introduction to VMware Continuent
2 Using Continuent Replication to Solve Oracle Use Cases
3 Wrap-up and Questions
Introducing VMware Continuent
Software-as-a-Service (SaaS) Vendors E-commerce Financial Services Mobile Applications Oracle and MySQL Applications
Markets
Business continuity for business-critical Oracle and MySQL databases
Commercial-grade multi-site HA/DR
Database Clustering
Flexible, high-performance replication for Oracle and MySQL databases
Simple data loading into analytics and big data
Data Replication
Oracle to Oracle replication for reporting and data warehouse MySQL replication to and from Oracle MySQL Replication between MySQL, MariaDB and Percona servers
Solution Solution MySQL single site HA MySQL multi-site HA and DR
Architecture of VMware Continuent clusters
4
Manager Replicator
Manager Replicator
Manager Replicator
Secondary Primary Secondary
Continuent Connector Continuent Connector
Select VMware Continuent Customers
The top three RDBMS dominate the market by most measures of popularity and economic value
0%
10%
20%
30%
40%
50%
60%
0
200
400
600
800
1000
1200
1400
1600
Oracle MySQL MS SQL PostgresSQL DB2
Usage
Score
Survey of RDMS Usage
Popularity -- Db-engines.com Sep 2015 Business Critical Usage - InformationWeek 2014
Replication solves important problems for RDBMS users
• Real-time local copies in case the DBMS fails • Real-time remote copies in case the site fails • Loading data into quickly into analytic systems • Feeding edge applications from the Oracle mother ship • Migrating from Oracle to:
– New Oracle versions – Less expensive editions – Non-Oracle DBMS
7
8
Agenda
1 Introduction to VMware Continuent
2 Using Continuent Replication to Solve Oracle Use Cases
3 Wrap-up and Questions
VMware Continuent implements flexible, high-performance replication for Oracle and MySQL
9
Replicator mySQL
DBMS Logs
mySQL
Replicator
THL
THL
Download transactions via network or from file system
Apply using JDBC (Transactions + metadata)
(Transactions + metadata)
Primary
Secondary
Source
Target
Low latency transfer
Low application impact
VMware Continuent captures transactions directly from Oracle REDO logs
10
Replicator mySQL
REDO Logs
mySQL
THL
(Transactions + metadata)
Primary
(To secondary)
Capture data
dictionary
Source
Capture raw transactions
Staging area for REDO log
data
Replicator Host Oracle DBMS Host
Convert to serialized row
changes and DDL
VMware Continuent places minimal demands on source and target DBMS instances
• Source Oracle DBMS requirements: – Supplemental logging – Archive logs – Replicator metadata stored in DBMS – Replicator login with access to catalogs and flashback query – local process to read REDO logs
• Target Oracle DBMS requirements: – Replicator metadata stored in DBMS
11
Continuent logical replication applies transactions in serial order to targets
12
Transaction Log (Row changes + Statements)
0 Create table db1.foo 1 Create table db2.foo 2 insert into db1. foo values(1, … 3 Update db1.foo where id=1… 4 Insert into db2.foo values(5,…) 5 Insert into db1.foo values(3,…) 6 Delete from db2.foo where id=5
Source
Target
Continuent can apply transactions in parallel to increase performance and maximize use of target I/O bandwidth
13
THL Parallel queue (Transactions + metadata)
Target
Extract Filter Apply Extract Filter Apply
Extract Filter Apply
Extract Filter Apply
Extract Filter Apply
Stage Stage Stage
Replicator Pipeline
Source replicator
VMware Continuent can extract data in parallel to provision data on target while source applications are running
14
THL
(Transactions + metadata)
Extract Filter Apply Extract Filter Apply
Stage Stage
Replicator Pipeline
Source Multi-threaded data extraction using flashback queries
Continuent supports a wide range of replication topologies
15
Replicator Replicator
Replicator
Fan-in
Replicator Replicator
Replicator
Fan-out
Multi-primary Replicator Replicator
Continuent replication is platform-independent and supports a wide range of targets
16
Replicator Replicator
Replicator
Replicator
Source
Other RDBMS versions and OS platforms
Other RDBMS types
Non-relational DBMS
We can even divide logs into transaction sequences on keys
17
Table=db1.foo, key=1 2 insert into db1. foo values(1, … 3 Update db1.foo where id=1…
Table db2.foo, key=5 4 Insert into db2.foo values(5,…) 6 Delete from db2.foo where id=5
Table=db1.foo, key=3 5 Insert into db1.foo values(3,…) Source
Target
Ordering transactions around keys enables efficient data warehouse loading
18
Replicator
Source DBMS
CSV Files CSV Files CSV Files CSV Files
Load Script
HADOOP CLUSTER
Parallel loading
Map/Reduce View Generation
Demo Time!
19
Oracle Replication Demonstration
Oracle 11G Oracle 12C
Provisioning
Data Loading
Low-Latency Active
Replication
Source
High Availability Disaster Recovery Reporting
VMware Continuent provides a flexible alternative to Oracle GoldenGate and DataGuard
Oracle 9i (9.2), 10g, 11g, 12c Oracle SE, EE, SE One, Oracle RAC and Oracle XE ASM and direct files All common data types DDL operations Linux/Windows/Solaris/AIX
Non-Oracle Edge Applications
Target
Migration
Provisioning
Low-latency active Replication
VMware Continuent enables near real-time loading into analytic systems and big data processing pipelines
Source Nodes Target Data Warehouse
Where is VMware Continuent Going Next?
Provisioning
Data Loading
Low-Latency
Active Replication
Row Stores
DR & reporting
Real-time data loading into analytics and data warehouses
Reporting Data warehouse
Real-time data loading
Front-end web applications
New DBMS sources
23
Agenda
1 Introduction to VMware Continuent
2 Using Continuent Replication to Solve Oracle Use Cases
3 Wrap-up and Questions
Wrap-up • VMware Continuent Replication provides robust, flexible capabilities that have
been battle-tested in demanding customer environments • Replication features compare favorably to Oracle GoldenGate and DataGuard • Continuent VMware handles HA/DR, data warehouse loading, and edge
application use cases
24
For more information, contact us: Robert Noyes Alliance Manager, AMER & LATAM [email protected] +1 (650) 575-0958 Philippe Bernard Alliance Manager, EMEA & APJ [email protected] +41 79 347 1385
Eero Teerikorpi Sr. Director, Strategic Alliance [email protected] +1 (408) 431-3305
www.vmware.com/products/continuent