Date post: | 15-Feb-2018 |
Category: |
Documents |
Upload: | sharathk79 |
View: | 218 times |
Download: | 0 times |
of 30
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
1/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Oracle Data Integration Solutions GoldenGate New Features Sum m ary
Valarie BedardPrinciple Sales Consultant
Tony VelardoDIS Account Manager
OraclMovito Tra
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
2/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Note to Reader - March 2014This deck represents highlights of features in OGG 11.2 andOGG 12.x
It does not represent ALL features in either of these releasesIt is recommended that the reader review the Release Notes foreither version of OGG to get the complete picture of new featureper releaseIt is recommended that the reader review the OGG Install Guide
Admin Guide, and Reference Guides for either version tounderstand dependencies, usage and syntax for any functionalityor feature mentioned in this deck.
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
3/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Quick List of OGG Database Integration points Ability to ignore triggers when applying data (OGG V 12 default) Ability to ignore constraints (like cascade delete) when applying data
Optimized ASM capture - DBLOGREADER Access to Oracles Encryption Methods Transparent Data EncryptionTablespace Encryption
RMAN Integration log retention Automatic Schema level supplemental loggingIntegrated Capture - Capture compressed data including EHCCDatabase Vault accessOracles AES encryption algorithms for trail files OEM Grid Control Plug-in for Monitoring, control and metricsExadata DBFS optimizations for GoldenGate
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
4/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Oracle GoldenGate 11g Release2 Integrated Extract Conflict Detection and Resolution
Manageability and Monitoring Security and Performance Globalization Event Marker Enhancement
Coherence Integration
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
5/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Integrated Extract
Source database and Integrated Extract process are in the same machin
User/Application changes
Recordchanges
Capturechanges
Redo Logs
Capture
IntegratedExtract
Oracle Database
TrailFile ..
Source Machine
LCR1LCR2LCR3. .
.
Logical ChangeRecords
Leverages Proprietary Oracle Database LCR API
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
6/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Integrated Extract Benefits - Summary Category New Features Comments
Exadata Capture support for EHCC compression Enable capture from Exadata so
Compressions Capture support for OLTP, Segment compression
Distributed Transactions XA-RAC, PDML Support capture from XA originated from multiple no
RAC Simplified RAC management No need to modify parameter instance is not available
New Datatypes XML OR, XML Binary
LOB Full and Partial read from REDO log
REDO Processing Multithreaded support Performance gain from parallel
Deployment Source and Downstream capture support Helps to offload some of the extrafrom the source database;
DDL Captures tables created with column levelpassword specification
Others Support IOT with MAPPING table option
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
7/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Integrated Extract Expanded Deployment Options
User/Application changes
Recordchanges
Redo Logs
Capture
Oracle DatabaseSource Machine
Source database and Integrated Extract process are in different machin
StandbyRedo Logs
Oracle DatabaseDownstream Machine
Continuous REDOShipping
Capturechanges
LCR1LCR2LCR3. . .
Logical ChangeRecords
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
8/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Conflicts occur when the timing of simultaneous changes results in one of out-of-sync conditions: a replicated insert attempts to add a row that already exists in the target. the before image of a replicated update does not match the current row in the targ a replicated delete attempts to remove a row that does not exist in the target.
Conflict Detection and Resolution
C fli i d l i
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
9/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Conflict Detection and Resolution
INSERTROWEXISTS Insert
Overwrite
Ignore
Discard
USEMIN,USEMAX
UPDATEROWMISSING
Update
Overwrite
Ignore
Discard
UPDATEROWEXISTS
Overwrite
Ignore
Discard
USEMIN,USEMAX
USEDELTA
DELETEROWMISSING
Delete
Ignore
Discard
DELETEROWEXISTS Overwrite
Ignore
Discard
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
10/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Performance - Streaming
Prior to Oracle GoldenGate 11gR2 Synchronous data communication between data pump
extract and remote collector process
Data sent by data pump extract to remote collectorprocess must be followed with ACK from the remotecollector. Extract can only send out new data after ACK.
Oracle GoldenGate 11gR2 Acknowledgement message can be skipped for every
data sent Remote collector does not send an acknowledgement
to the data pump extract unless a packet contains aflag requesting a response, typically when the datapump extract must checkpoint or determine a writeposition .
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
11/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Security Enhancements: Encryption
TCP/IP
SourceDatabase
GGSCIInteractive
Interface
Manager Manager
LAN / WAN / INTERNETOver TCP/IP
Parameter Files Par
PASSWORDS
BLOWFISH, AES128, AES192,AES256
IPv6 support
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
12/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Database Object Name Enhancement Non US-ASCII Character Support (both DDL/DML)
Support database object name with any characters including European accent, multi-bywhite space and symbols as long as database supports
Database Like Object Level Case Sensitivity Support Oracle, DB2 and SQL/MX case sensitive object name Case sensitive from/to case insensitive mapping
Partial Character Set Conversion Implicit Character Set Conversion Support by replicat
Between two different character set CHAR/VARCHAR/CLOB columns CHAR/VARCHAR/CLOB from/to NCHAR/NVARCHAR/NCLOB columns
Globalization
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
13/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Event Marker System 11gR2
SourceDatabase
User/Application changes
Transaction Logs
LAN / WAN / INTERNETOver TCP/IP
ACTIONS
TRACE
LOG
CHECKPOINTBEFORE
IGNORE
DISCARD
ROLLOVER
REPORT
ABORT
CHECKPOINTAFTER
FORCESTOP/STOP
SHELL with parameters
SUSPEND/RESUME
DDL
Eventrecord
Eventrecord
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
14/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Coherence HotCache
Coherence/GoldenGate Integration Capture changes from DB
Pump the data to coherence node,using Java Toplink maps relational changes to
the objects Updates the cache User will see the latest data in their
cache in Real -Time after thedatabase is updated
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
15/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Oracle GoldenGate 12c HighlightsOptimized for Oracle Database 12c
Non-consolidated, Multitenant and Cloud-based Real-Time ReplicationThree part naming convention, New data types (Large VARCHAR)
Integrated Delivery for the Oracle Database
Leveraging high-speed, lightweight Streaming API built Exclusively for OGG to takeadvantage of database parallel apply server for auto dependency aware parallel apply
Coordinated Apply for Non-Oracle Databases
Orchestrates the High-Speed Apply Processes & Simplifies Setup and Management
Expanded Heterogeneity
12c Brings Support for New Databases and Enhancements to Existing Supported Platf
Improved Ease of Use
Automatic Discard File, Enhanced Debugging, Schema Wildcarding, and Improved Security
Enhanced High Availability for Zero Data Loss
Integration with Data Guard and FSFO for Automated & Transparent failover of
Expanded Oracle Application and Technology Support
Active/Active ATG, Low Downtime E-Business Suite Migrations and Cohere
O l G ld G 12 1 2 N F i li
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
16/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Oracle GoldenGate 12.1.2 New Functionality
New with OGG 12.x Oracle Installer Oracle database Version 12 CDB support 3 part object name support Automatic Discard Improved initial load with added data type support for remote task Improved SHOWSYNTAX Schema Wildcard Support Credential store for userid/(encrypted)password >> Alias Source time zone in trail, replicat sets its session to this Extract start at CSN ( Oracle SCN) Oracle dbms_goldengate_auth.grant-admin_priviledge Package
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
17/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Integrated Replicat
Integrated Replicat for Oracle target databases only 12.1.0.1 and 11.2.0.4
Leverages database parallel apply servers for automatic dependencyaware parallel apply
Minimal changes to replicat configuration Single replicat parameter file for all tables
Single Replicat, no need to use @RANGE or THREAD or othersplitting
Overview
I t g t d R li t
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
18/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Oracle Database
Integrated Replicat Architecture Diagram
LightweightStreaming API
Replicat
Receiver Preparer Coordinator
Applier 1
Applier N
Replicat
Reads the trail file
Constructs logical changerecords (LCRs)
Transmits LCRs to OracleDatabase via the LightweightStreaming API
Inbound Server (Database Apply Process)
Receiver : Reads LCRs
Preparer : Computes the dependencies between the transactions (primary key, uindexes, foreign key) , grouping transactions and sorting in dependency order.
Coordinator : Coordinates transactions, maintains the order between applier pr
Applier : Performs changes for assigned transactions, including conflict detectierror handling.
Inbound Server
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
19/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Integrated Replicat - Dependency Aware Apply Source Database Supplemental Logging
Supplemental logging of scheduling columns (PK, UI, FK) needed for dependency awareapply processing at targetNew default of ADD TRANDATA is to log all unique indexes and foreign key columns .
If Primary Key, Unique Index, Foreign Key columns are same at both source andtarget, ADD TRANDATA provides requisite information. If target has differentscheduling columns, then ADD TRANDATA [table] COLS format should beused to identify any additional columns
For old behavior specify NOSCHEDULINGCOLS option to only log primary key
ADD TRANDATA [table], NOSCHEDULINGCOLS
ADD SCHEMATRANDATA [schema], NOSCHEDULINGCOLS Scheduling columns must be present in trail file
Extract parameter LOGALLSUPCOLSIncludes any supplementally logged column in trail file
Automatically enables GETUPDATEBEFORES and NOCOMPRESSDELETES
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
20/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Converting to Integrated Replicat
Convert to integrated mode from existing nonintegrated replicatGGSCI> STOP REPLICAT repdb
GGSCI> ALTER REPLICAT repdb, INTEGRATED Updates checkpoint file to indicate INTEGRATED DB checkpoint table is not maintained when using integrated replicat
Consolidate the parameter files into a single file
Start replicat with proper parameter file GGSCI> START REPLICAT repdb
Registers replicat repdb1 database Starts and attaches to inbound server INFO REPLICAT repdb will show INTEGRATED in output
Coordinated Replicat
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
21/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Coordinated Replicat
Applicable to all databases Full barrier coordination across events requiring ordering
DDL (Oracle only) Primary Key Update EMI SQLEXEC
Ease of Use Simplify parameter file manageability (fewer param files) Simplify error recovery
Unified Parameter File (THREAD)
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
22/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Unified Parameter File (THREAD)
MAP sales.acct1, TARGET sales.acct1;
MAP sales.acct2, TARGET sales.acct2;
MAP sales.acct3, TARGET sales.acct3;
MAP sales.acct1, TARGET sales.acct1,THREAD(1);MAP sales.acct2, TARGET sales.acct2,THREAD(2);MAP sales.acct,3 TARGET sales.acct3,THREAD(3);
Unified Parameter File (THREADRANGE)
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
23/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Unified Parameter File (THREADRANGE)
MAP sales.acct, TARGET sales.acct, FILTER(@RANGE (1, 3, ID));
MAP sales.acct, TARGET sales.acct, FILTER(@RANGE (2, 3, ID));
MAP sales.acct, TARGET sales.acct, FILTER(@RANGE (3, 3, ID));
MAP sales.acct, TARGET sales.acct,THREADRANGE(1-3, ID));
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
24/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Key ConceptsCoordinated vs. Integrated Replicat
Coordinated Replicat Integrated Replicat
User Specified Partitioning Automatic Scheduling
Split transaction Semantics Does not split transactions
All databases Oracle specific with version requirements
Continues to employ SQL generation andexecution outside the database.
Apply is in the database server. Tightintegration with Oracle database.
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
25/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Integrated Extract
Integrated Extract was introduced in Oracle GoldenGate 11.2
Oracle GoldenGate 12.1.2 enhances the feature. With Oracle GoldenGate 12.1.2
By default, all newly created extracts will be integrated extract Upgrading from old IE you can use TRANLOGOPTION _LCRCAPTUREPRO
V2 _LCRCAPTUREPROTOCOL V2 provides better performance by
Streamlined for improved performance (V2 as fast or faster than Classic Extr Drastic improvement in LOB performance Reduced overhead on database Available when the mining server is 11.2.0.3 BP 14 and higher or Oracle 12c
Overview
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
26/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Integrated Extract
Requirements: Database must be running Oracle Database 12c (12.1.0.1), 11.2.0.4 and later versions. DDL Trigger Removal is required for CDB.
Behavior Integrated Extract running against Oracle Database 12c or 11.2.0.4 will automatically run in
mode No need to run DDL setup scripts DDL trigger can remain enabled
Integrated Extract running against Oracle Database 11g Release 11.2.0.3 will get metadatagathered from DDL trigger
Classic Extract will continue to require existence of DDL trigger
DDL Trigger Removal
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
27/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Integrated Extract and Replicat Review
Integrated Extract Oracle GoldenGate 12.1.2: the source database can be 11.1 or 11.2 or above. ... the MININ
database has to be version newer than the source database, but must be 11.2.0.3 BP 6 or hiSame as OGG 11.2.1.
If the source database is Oracle DB 12.1, then OGG 12.1.2 must be used. For Oracle Database 12c with CDB setup, integrated extract is required.
Integrated Replicat Target database has to be Oracle Database 12.1.0.1 and 11.2.0.4. The source database (Extract) can be other databases but have to include required supplem
logging information for dependency calculation. Oracle GoldenGate 11.1.1 and 11.2.1 versions or non Oracle source databases, use 2
parameters: GETUPDATEBEFORES and NOCOMPRESSDELETES, these are require For Oracle GoldenGate 12.1.2 use LOGALLSUPCOLS and UPDATERECORDFO
This works for classic and integrated extract only.
Oracle Database Only Support
Oracle GoldenGate 12c Database Support
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
28/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Oracle GoldenGate 12c Database Support
Oracle Database Oracle Database 12c
Multitenant Container Database (CDB) More Datatypes: Large VARCHAR2
Other Databases
MySQL 5.6 & NDB 7.x Clusters Sybase 15.7 DB2/LUW 10.1
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
29/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Join the Data Integration CommunityTwitter or Facebook twitter.com/ORCLGoldenGatefacebook.com/OracleDataIntegration
Oracle GoldenGate YouTube channel youtube.com/oraclegoldengate
Oracle.com/goto/dataintegrati
LinkedIn Oracle Data Integration
Oracles Data Integratiblogs.oracle.com/dataint
OracleTechnologyNetwork
Oracles Public Help Foruhttp://forums.oracle.comspa?forumID=860&start
OracleTechnologyNetwork
OTN: GoldenGate http://www.oracle.com/teware/goldengate/overvie
Oracle Learning Library http://apex.oracle.com/pls/apex/f?p=44785:1:0::NO
MOS Knowledgebase http://support.oracle.com/
7/23/2019 20140318 UNYOUG OGG New Features Brief Bedard
30/30
Copyright 2013, Oracle and/or its affiliates. All rights reserved.