CFM

www.cfm.fr www.cfm.fr

Presented by

ZDLRA implementation at CFM

© CFM 2017

Gabriel NitulescuProject Leader

October 04, 2017

CFM

www.cfm.fr

Fundamental research applied to financial marketsCFM invests in Science, Technology and Finance25 years of experience in managing trading systemsA rational process that produces robust Trading AlgorithmsProprietary software able to execute & control large volumes of data180 PeopleOffices in Paris, London, New York, Tokyo

Who Are We?

© CFM 2017 2

CFM

www.cfm.fr

Data Protection Desired Architecture

© CFM 2017 3

FREP

host@frep

DB_A_frep_00

host@frcn

DB_A_frcn_00DataGuard

Dat

abas

eba

ckup

Arch

ived

logs

bac

kup

data

base

back

up

Arch

ived

log

back

up

Backup system @ FREP Backup System @ FRCN

FREP

CFM

www.cfm.fr

Workload Characterization

© CFM 2017 4

CFM

www.cfm.fr

Oracle Best Practices Disk to Disk to Tape► Daily to Disk

RUN {

RECOVER COPY OF DATABASE WITH TAG 'UPDATABLE';

BACKUP INCREMENTAL LEVEL 1 FOR RECOVER OF COPY WITH TAG 'UPDATABLE' DATABASE;

BACKUP DEVICE TYPE SBT ARCHIVELOG ALL NOT BACKED UP ; }

► Weekly to TapeRUN { BACKUP DEVICE TYPE SBT RECOVERY AREA; }

MAA Best Practices Architecture► Two Independent Data Centers with Data Guard► No special procedures in case of disaster or maintenanceProduction Impacts► Large FRA size (1,7 DB Size)► High CPU Utilization During Backup► High Bandwidth Utilization for Weekly Backups

Legacy Data Protection Strategy

© CFM 2017 5

+RECO

+DATA

BD_A DB_B

Image copy 24 TB 38 TB

Inc0 5 TB 12 TB

Inc1 0.3 TB 0.2 TB

Archives / day 3 TB 1 TB

Flashback logs / day 1 TB 0.3 TB

CFM

www.cfm.fr

Technical advantages (Virtual Full & Real-Time Redo Transport)► Reduce CPU required for backup => no more backup window => sizing => licenses

► Backup & Recovery performances

Financial Aspects (Lower TCO)► Zero Data Loss Recovery Appliance Lower Cost than Primary Storage (FRA on Production Server)

> Savings of 40%

Why ZDLRA?

© CFM 2017 6

CFM

www.cfm.fr

White Paper Deploying the Zero Data Loss Recovery Appliance in a Data Guard Configuration► OEM based implementation

► Minimize downtime

OEM implementation

© CFM 2017 7

CFM

www.cfm.fr

SQL> exec DBMS_RA.ADD_DB (db_unique_name=> 'PRODOMR_FRCN_00', protection_policy_name => 'CFM_003_DAYS', reserved_space=>'51G');SQL> exec DBMS_RA.GRANT_DB_ACCESS (db_unique_name => 'PRODOMR_FRCN_00',username => 'vpccfm');SQL> select DB_UNIQUE_NAME,DBID,DB_KEY from ra_database ORDER BY DB_UNIQUE_NAME;

DGMGRL> switchover to 'prodomr_frcn_00';

[oracle@<DB_server_FREP>]$ rman target /@PRODOMR_FRCN_00_DR catalog /@zfrcn00_catalogRMAN> register database;database registered in recovery catalogstarting full resync of recovery catalogfull resync completeRMAN> show all;RMAN configuration parameters for database with db_unique_name PRODOMR_FRCN_00 are:CONFIGURE DEFAULT DEVICE TYPE TO 'SBT_TAPE';CONFIGURE CONTROLFILE AUTOBACKUP ON;CONFIGURE DEVICE TYPE 'SBT_TAPE' PARALLELISM 2 BACKUP TYPE TO BACKUPSET;CONFIGURE CHANNEL DEVICE TYPE 'SBT_TAPE' FORMAT '%d_%U' PARMS "SBT_LIBRARY=/u01/app/oracle/product/12.1.0.2/dbhome_1/lib/libra.so, ENV=(RA_WALLET='location=file:/u01/app/oracle/wallet credential_alias=ZFRCN00_CATALOG')";CONFIGURE DB_UNIQUE_NAME 'PRODOMR_FRCN_00' CONNECT IDENTIFIER 'PRODOMR_FRCN_00_DR';CONFIGURE DB_UNIQUE_NAME 'PRODOMR_FREP_00' CONNECT IDENTIFIER 'PRODOMR_FREP_00_DR';CONFIGURE ARCHIVELOG DELETION POLICY TO APPLIED ON ALL STANDBY BACKED UP 1 TIMES TO 'SBT_TAPE';

DGMGRL> switchover to 'prodomr_frep_00';

Enrolling Protected Databases

© CFM 2017 8

SQL> exec DBMS_RA.ADD_DB (db_unique_name=> 'PRODOMR_FREP_00', protection_policy_name => 'CFM_003_DAYS', reserved_space=>'51G');SQL> exec DBMS_RA.GRANT_DB_ACCESS (db_unique_name => 'PRODOMR_FREP_00',username => 'vpccfm');SQL> select DB_UNIQUE_NAME,DBID,DB_KEY from ra_database ORDER BY DB_UNIQUE_NAME;

[oracle@<DB_server_FREP>]$ rman target /@PRODOMR_FREP_00_DR catalog /@zfrep00_catalogRMAN> register database;database registered in recovery catalogstarting full resync of recovery catalogfull resync completeRMAN> show all;RMAN configuration parameters for database with db_unique_name PRODOMR_FREP_00 are:CONFIGURE DEFAULT DEVICE TYPE TO 'SBT_TAPE';CONFIGURE CONTROLFILE AUTOBACKUP ON;CONFIGURE DEVICE TYPE 'SBT_TAPE' PARALLELISM 2 BACKUP TYPE TO BACKUPSET;CONFIGURE CHANNEL DEVICE TYPE 'SBT_TAPE' FORMAT '%d_%U' PARMS "SBT_LIBRARY=/u01/app/oracle/product/12.1.0.2/dbhome_1/lib/libra.so, ENV=(RA_WALLET='location=file:/u01/app/oracle/wallet credential_alias=ZFREP00_CATALOG')";CONFIGURE DB_UNIQUE_NAME 'PRODOMR_FRCN_00' CONNECT IDENTIFIER 'PRODOMR_FRCN_00_DR';CONFIGURE DB_UNIQUE_NAME 'PRODOMR_FREP_00' CONNECT IDENTIFIER 'PRODOMR_FREP_00_DR';CONFIGURE ARCHIVELOG DELETION POLICY TO APPLIED ON ALL STANDBY BACKED UP 1 TIMES TO 'SBT_TAPE';

Enrolling Primary Protected Database with Recovery Appliance Repeat for Standby Protected Database with Recovery Appliance

CFM

www.cfm.fr

CLI Backup Scripts

© CFM 2017 9

$ cat backup_inc_l0.rman

run {

backup device type sbt tag 'INCFOREVER' cumulative incremental level 0 filesperset 1 section size 64g database plus archivelog not backed up filesperset 32;}

$ cat backup_inc_l1.rman

run {

backup device type sbt tag 'INCFOREVER' cumulative incremental level 1 filesperset 1 section size 64g database plus archivelog not backed up filesperset 32;}

$time rman target /@PRODOMR_FREP_00_DR catalog /@zfrep00_catalog cmdfile=backup_inc_l1.rman log=backup_inc_l1_${ORACLE_SID}.`date +"%Y%m%d%H%M%S"`.log &

allocated channel: ORA_SBT_TAPE_1

channel ORA_SBT_TAPE_1: RA Library (ZFREP) SID=47483A6E3C363BB5E053345B430A24E2

…

$time rman target /@PRODOMR_FRCN_00_DR catalog /@zfrcn00_catalog cmdfile=backup_inc_l1.rman log=backup_inc_l1_${ORACLE_SID}.`date +"%Y%m%d%H%M%S"`.log &

channel ORA_SBT_TAPE_1: RA Library (ZFRCN) SID=480AB266A1C90E9EE0533E5B460A5440

…

skipping archived logs of thread 1 from sequence 43350 to 43535; already backed up

…

Level 0: One time

Level 1: Daily

Actual OEM limitation

RMAN Backup Job Output

RMAN Backup Job Scripts

CFM

www.cfm.fr

Data Protection Architecture with Recovery Appliance

© CFM 2017 10

FREP

efrep00-vm01

DB_A_frep_00

back

up

FREP

efrcn00-vm01

DB_A_frcn_00

back

up

DataGuard

CFM

www.cfm.fr

Data Guard Concepts and Administration ► 6 Redo Transport Services

> 6.2.1.2 Redo Transport Authentication Using a Password File

SQL> create user vpccfm identified by xxxxxx;SQL> grant sysoper to VPCCFM;SQL> select * from V$PWFILE_USERS;USERNAME SYSDB SYSOP SYSAS------------------------ ----- -----SYS TRUE TRUE FALSEVPCCFM FALSE TRUE FALSESQL> ALTER SYSTEM SET redo_transport_user = 'VPCCFM' SCOPE=SPFILE;

SQL> ho scp orapwd${ORACLE_SID}

SQL> shutdown immediate;SQL> startup;SQL> show parameter redoNAME TYPE VALUE----------------------------------- ------------------------------redo_transport_user string VPCCFM

CLI real time redo: Redo Transport Authentication Using a Password File

© CFM 2017 11

All standby databases

Same User for Redo Transport and Backup (VPC)

CFM

www.cfm.fr

Enable Real-Time Redolog Shipping

© CFM 2017 12

@ FREP SQL> alter system set log_archive_dest_4='SERVICE=zfrep00_catalog VALID_FOR=(ALL_LOGFILES, ALL_ROLES) ASYNC DB_UNIQUE_NAME=zfrep' scope=both sid='*';

@ FRCN SQL> alter system set log_archive_dest_4='SERVICE=zfrcn00_catalog VALID_FOR=(ALL_LOGFILES, ALL_ROLES) ASYNC DB_UNIQUE_NAME=zfrcn' scope=both sid='*';

DGMGRL> add recovery_appliance ZFREP as connect identifier is 'ZFREP00_CATALOG';DGMGRL> enable recovery_appliance ZFREP;DGMGRL> add recovery_appliance ZFRCN as connect identifier is 'ZFRCN00_CATALOG';DGMGRL> enable recovery_appliance ZFRCN;DGMGRL> show configuration;Configuration - prodomr_dgProtection Mode: MaxPerformanceMembers:prodomr_frep_00 - Primary databaseprodomr_frcn_00 - Physical standby database zfrep - Backup appliance zfrcn - Backup appliance

No cascade redo propagation

SQL as rasys@ZFRCN00 > selectDB_UNIQUE_NAME, NZDL_ACTIVE, SPACE_USAGE/1024 as SPACE_USAGE_TB, DISK_RESERVED_SPACE/1024 as DISK_RESERVED_SPACE_TB, round(DEDUPLICATION_FACTOR,2)

fromRA_DATABASE

order by DB_UNIQUE_NAME;

DB_UNIQUE_NAME NZD SPACE_USAGE_TB DISK_RESERVED_SPACE_TB ROUND(DEDUPLICATION_FACTOR,2)-------------------------------- --- -------------- ---------------------- ---------------------------------------PRODOMR_FRCN_00 YES .01 .05 2.04

Configuring Log Archive Destination to RAUpdating DGMGRL Configuration

Confirming Configuration

CFM

www.cfm.fr

Real-Time Data Protection Architecture with Recovery Appliance

© CFM 2017 13

FREP

efrep00-vm01

DB_A_frep_00

back

up

FREP

efrcn00-vm01

DB_A_frcn_00

back

up

DataGuard

Rea

l tim

e R

edo

Ship

ping

Red

oSh

ippi

ng

CFM

www.cfm.fr

Real-Time Data Protection with Recovery Appliance & Data Guard Broker

© CFM 2017 14

FREP

efrep00-vm01

DB_A_frep_00

back

up

FREP

efrcn00-vm01

DB_A_frcn_00

back

up

DataGuard

Rea

l tim

e R

edo

Ship

ping

* RDBMS >= 12.1.0.2

* RDBMS >= 12.1.0.2Active far Sync

Rea

l tim

e R

edo

Ship

ping

CFM

www.cfm.fr

Backup Elapsed Time & Resource Usage

© CFM 2017 15

• DB Size = 12TB• RMAN Backup Channels = 8

CFM

www.cfm.fr

Results 1 of 2

© CFM 2017 16

CFM

www.cfm.fr

Results 1 of 2

© CFM 2017 17

CFM

www.cfm.fr

Results 2 of 2

© CFM 2017 18

CFM

www.cfm.fr

Results 2 of 2

© CFM 2017 19

CFM

www.cfm.fr

Summary

© CFM 2017 20

Technical:Minimized Backup WindowOffloaded Database Server CPUIncreased Recovery Performance

o Virtual full backup, Compression

Ability to implement the desired architecture

Price:Lower TCOReduce impact of CPU for backup => licenses« User TB » on RA vs FRA

Project:Implementation is less complex than first impression

Better OEM integrationMore Detailed DocumentationMore Oracle University CoursewareImproved Support Skills

Positive Results Improvements Needed