Post on 23-Feb-2018
transcript
<Insert Picture Here>
Oracle GoldenGate
Real-Time Transactional Data Management
Shilpa Mehta
Senior Systems Consultant, Data Integration Solutions
<Insert Picture Here>
Agenda
• Why Real-Time Data for BI?
• Architectures for Real-Time BI
• Oracle GoldenGate for Real-Time Data
Integration
• Customer Examples
2
• Customer Examples
• Summary
<Insert Picture Here>
Agenda
• Describe Oracle GoldenGate architecture
• Describe Oracle GoldenGate for Real Time
Data Integration
• Oracle GoldenGate vs. Active Data Guard
• Oracle GoldenGate and Oracle Data Integrator
3
• Oracle GoldenGate and Oracle Data Integrator
• Summary
Oracle GoldenGate provides low-impact capture, routing, transformation, and delivery of transactional data across heterogeneous environments in
real time
Key Differentiators:
Non-intrusive, low-impact, sub-second latency
What is Oracle GoldenGate?
Performance
4
Open, modular architecture - Supports heterogeneous sources and targets
Maintains transactional integrity - Resilient against interruptions and failures
Flexible and Extensible
Reliable
Oracle GoldenGate Use CasesEnterprise-wide Solution for Real Time Data Needs
Log Based, Real-
Time Change Data
Capture
Active-Active High
Availability
Zero Downtime
Migration and
Upgrades
Fully Active
Distributed Database
ReportingQuery Offloading
New DB/
OS/HW/App
•Reduce Costs
•Lower Risks
•Achieve Operational
5
Heterogeneous
Source Systems
EDWODS
EDWReal-time BI
Reporting
Database
ETL
ETL
Query Offloading
Data DistributionGlobal Data Centers
SOA/EDA
Oracle
GoldenGate•Achieve Operational
Excellence
How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.
6
LAN/WANInternet
Capture
SourceOracle & Non-Oracle
Database(s)
TargetOracle & Non-Oracle
Database(s)
How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.
Trail: stages and queues data for routing.
7
LAN/WANInternet
CaptureTrail
SourceOracle & Non-Oracle
Database(s)
TargetOracle & Non-Oracle
Database(s)
How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
8
LAN/WANInternet
CaptureTrail
Pump
SourceOracle & Non-Oracle
Database(s)
TargetOracle & Non-Oracle
Database(s)
How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
Route: data is compressed, encrypted for routing to target(s).
9
LAN/WANInternet
TCP/IP
CaptureTrail
PumpTrail
SourceOracle & Non-Oracle
Database(s)
TargetOracle & Non-Oracle
Database(s)
How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
Route: data is compressed, encrypted for routing to target(s).
Delivery: applies data with transaction integrity, transforming the data as required.
10
LAN/WANInternet
TCP/IP
CaptureTrail
Pump DeliveryTrail
SourceOracle & Non-Oracle
Database(s)
TargetOracle & Non-Oracle
Database(s)
How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
Route: data is compressed, encrypted for routing to target(s).
Delivery: applies data with transaction integrity, transforming the data as required.
11
LAN/WANInternet
TCP/IP
Bi-directional
CaptureTrail
Pump DeliveryTrail
SourceOracle & Non-Oracle
Database(s)
TargetOracle & Non-Oracle
Database(s)
Databases O/S and Platforms
Oracle GoldenGate Capture:
� Oracle
� DB2
� Microsoft SQL Server
� Sybase ASE
� Teradata
� Enscribe
� SQL/MP
Windows 2000, 2003, XP
Linux
Sun Solaris
HP NonStop
HP-UX
HP TRU64
Oracle GoldenGate 11g Supported Databases and OS
12
SQL/MP
� SQL/MX
�JMS message queues
Oracle GoldenGate Delivery:
� All listed above, plus:
� MySQL, TimesTen, Netezza, Greenplum,
HP Neoview and any ODBC compatible
databases
� ETL products
HP TRU64
HP OpenVMS
IBM AIX
IBM z/OS
z/linux
12
Oracle GoldenGate Topologies
UnidirectionalQuery Offloading
Zero-Downtime Migration
Bi-DirectionalHot Standby or
Active-Active for HA
Peer-to-PeerLoad Balancing, Multi-Master
13
Broadcast Data Distribution
Integration/ConsolidationData Warehouse
Data Distribution via Messaging
BPM
High Availability for Oracle Database When to Use Active Data Guard vs. GoldenGate
• Disaster Recovery / Data Protection
� Active Data Guard: simple full Oracle Database protection
� High-performance, simple, drop-in solution for HA and DR, readable at standby
� Zero data loss, integrated data corruption protection, switchover / failover
� DR for all data types & apps including packaged apps that can’t be changed
14
• Information Distribution, Flexible HA
�GoldenGate: heterogeneous, active-active, migrations
� Heterogeneous replication, transformations, subsetting, multiple topologies
� All sites fully active (read/write): avoid or manage conflicts at application level
� Enable minimal downtime app migrations with 2nd database copy
Powerful Combination!Integrated HA, DR and Active-Active Replication
Standby
Active Data Guard
- DR & Data Protection
- Real-time Query
Primary
RAC
- Scalability
- Server HA
15
GoldenGate
- Information Distribution
- Heterogeneous
Bi-directional
Replication Subsetting MySQL
Standby
DatabaseDatabase
Real-Time Data Integration for BI with ODILow-impact, change data capture, transformation, and delivery
BI Application
trans5 trans4 trans2 trans1trans3
Real-time streaming of transactions
Oracle GoldenGate
16
Production
OLTP Databases
ODS
• Sub-second latency
• No impact on source systems
• Read-consistent changed data with referential integrity
• Transformations at capture, delivery or within the database
• Certified for Oracle Applications to offload operational reporting
LAN / WAN /
InternetCapture
Source TrailTarget Trail
Delivery
Real-Time Data Integration for BI with DWFastest Real-Time Data Integration, Fastest Bulk Data Transformation
BI Application
tx6 tx5 tx4 tx2 tx1tx3
Real-time streaming of transactions
Oracle GoldenGate
ODI EE
& DQ
OBI EE
17
Production
OLTP Databases
DW
• Low-latency data for end users
• No source impact and reduced batch windows on target
• Thin middle-tier for high-performance, in-database transformations
• Complete data recoverability with persisted queuing
& DQ
LAN / WAN /
InternetCapture
Source TrailTarget Trail
Delivery