Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
Oracle Recovery Manager TipsandTricksforOn-PremisesandCloudDatabasesCON6677
MarcoCalmasiniSr.PrincipalProductManager,Oracle
GaganSingh,Sr.DatabaseArchitect,Intel
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedforOracle’sproductsremainsatthesolediscretionofOracle.
3
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
ProgramAgenda
4
RecoveryManagerHistory
RMANNewFeatures&Enhancements
RMANandDataDeduplication
RMANCloudModule
OracleSecureBackup12.2
RMANfor RecoveryAppliance,IntelExperience
1
2
3
4
5
6
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
RecoveryManagerHistory
5
Oracle8,Oracle8i,Oracle9i
Circa1997-2002
Oracle10g,Oracle11gCirca2003-2012
Oracle12cToday
••ParallelBackups••DUPLICATE••BlockMediaRecovery••AutomaticControlFile&SPFILEBackup••CONFIGUREPersistentSettings••BACKUPBACKUPSET••Andmore…
••FastRecoveryArea••FastIncrementalBackups••IncrementallyUpdatedBackups••SWITCHTOCOPY••OffloadBackupstoStandbyDatabase••Andmore…
••TableLevelRecovery••Cross-PlatformBackup&Recoveryenhancements••FastActiveDUPLICATE••FastStandbyDatabaseSynchronization••MultitenantDatabaseBackup&Recovery••Andmore..
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
RMAN
RMANBeyondtheBackupUtility
6
RMAN
CloningandPlatformMigration
DataGuard
Backuptodisk
Backuptocloudstorage
OracleSecureBackupor3rdpartybackupapplications
OracleZeroDataLossRecoveryAppliance
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
ProgramAgenda
7
RecoveryManagerHistory
RMANNewFeatures&Enhancements
RMANandDataDeduplication
RMANCloudModule
OracleSecureBackup12.2
RMANforRecoveryAppliance,IntelExperience
1
2
3
4
5
6
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
RMANandDataDeduplication• Hash-baseddeduplication solutions
– WorkwellforgenericfilesnotsogoodforOracleDBs– Singledigitdedup ratiosforRMANbackups– Longfullbackupwindows,slowrestore(re-hydration)
• IncrementalMerge-basedsolutions– BasedonstandardRMANfeature– Fastdataaccessforrecovery,butslowrestore– Incrementalforever-likebackups,butDBserverresourcesareusedbymergeprocess
• OracleRecoveryAppliance– Trueincrementalforever– basedonOracleblockchanges– MinimalloadonDBserver– nofullbackupwindowandresources– ZerotoSub-SecondRPO– real-timechangescapturedinbackupviaredotransport
8
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
• Backupstreamisdividedinvariable-lengthchunks
• Hashingalgorithmisappliedtochunkstocalculatehashvalues
• Hasharestoredinadatabaserunningoncontroller
• Hashdatabaseischeckedtodetermineifchunkisuniqueorduplicate
• Ifduplicate,dataarediscardedandreplacedwithapointer
• Ifunique,hashdatabaseisupdated
• Softwarecompressionisappliedanddatastored
• DonotuseRMANencryptionorcompression
• UseFILESPERSET=1
• Wholedataisreadfromdisk
• Wholedataistransferredovernetwork(targetsidededupe)orDBresourcesareusedfordeduplicationjob(sourcesidededupe)
• Incrementalandarchivedlogsprovideverypoordeduplicationratios(mostlyuniquedata)
9
Hashbaseddeduplication solutions
Howtheywork RMANimplications
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
Incrementalmergebasedsolutions • IncrementalLevel0imagecopybackuptakentoNFSshare
• IncrementalLevel1takentoanalternatelocation
• SnapshotofNFSsharecreatedtopreserveoriginalimagecopy
• Incrementals appliedtorollforwardimagecopytothesameSCNasincrementallevel1
• UsesDBserverresourcestoapplyincrementals toimagecopy
• Plus,storageoperationsinvolvedtorestoreoldersnapshotandcoordinatewithRMANrecovery
• Net-net:thisisanRMANfeature,notuniqueinstorageproducts
10
RUN { RECOVER COPY OF DATABASE WITH TAG 'incr_update'; BACKUP INCREMENTAL LEVEL 1 FOR RECOVER OF COPY WITH TAG 'incr_update' DATABASE; }
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
ZeroDataLossRecoveryAppliance
CreatedbyOracleDatabaseteamtoprotectyourOracledatabases
• Unique,deepdatabaseunderstanding
• RealIncrementalForever• DesignedforDBAandapplication
owners• Ensuresrapiddatabaserecoveryto
anypoint-in-time• Knowrecoverystatus- atalltimes• BackuponlychangedDBblocks• ReduceClientsLoadduringbackups
11
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
ProgramAgenda
12
RecoveryManagerHistory
RMANNewFeatures&Enhancements
RMANandDataDeduplication
RMANCloudModule
OracleSecureBackup12.2
RMANforRecoveryAppliance,IntelExperience
1
2
3
4
5
6
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
OracleDatabaseBackupCloudService
• Cloud Side• Cloud Object Storage
• Client Side• RMAN driven backup/recovery via SBT Module
• RMAN encryption* for backups is enforced (mandatory)
• RMAN compression* for optimal transfers (optional)
• Data is securely transmitted to the cloud over HTTPS
OracleDatabaseBackupCloudModule
13
DatabaseBackup
OracleRMAN
OracleDatabaseCloudBackupModule
CustomerDataCenter
*RMANCompression&RMANEncryptionincludedwithsubscription
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
BackupService:ForyourOn-PremisesDatabaseBackups
14
Simple4-StepProcess
CloudSubscription
• StorageCapacity• IdentityDomain• ServiceName• UserID/Password• Geo-Replication
1 2 3 4InstallRMANModule
• DownloadInstallerfromOTN
• RunInstallerontheDBServer
ConfigureRMAN
• “Tape”(SBT)Interface
• Encryption• Compression• Parallelism
PerformBackup&Recovery
• Schedulefull&Incrementalbackups
• Restore&Recoveryon-demand
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
Introducing:ArchiveStorageSupport
15
ArchiveStorageisforlongtermretention,infrequentlyaccesseddata.
4hoursdelayinaccessingarchiveddata
ArchiveStorageislessexpensivethanObjectStorage
RMANbacksuptoanarchiveortiering container,filesaremovedtoArchiveStoragebasedonpolicy
RMANRESTOREPREVIEWcommandisusedtodetermineifbackuppiecesareavailableforrestoreormustberecalledfromArchiveStorage
OracleRMAN
OracleDatabaseCloudBackupModule
Databases/FRA
DatabaseBackup
ObjectStorage ArchiveStorage
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
CloudBackupBestPractices• Bandwidthrequirements
– StartwithyourRTOandRPOrequirementsandconsider:• FullDBbackupset size,dailychangerate,archivelog production,compressibilityofyourdata• Useabandwidthcalculator
• Compression– UseLOWorMEDIUMcompression,HIGHsavesmorespacebutitisveryCPUintensive.
• #Channels,sectionsize– Usingmultiplechannelsinparallelmayimproveyourbackupspeed– Startwith4channelsandtestincreasinguntilyoureachthecap– Adaptsectionsizeaccordingly(largestsingledatafile /(numberofchannels*2))
• Usedualbackupstrategies(tolocalandcloudtargets)toreduceRTO
• UseBulkDataTransferserviceforworkloadsliftandshift
16
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
DualBackupStrategies:LocalImageCopy• Scenario
– Anumberofbusinesscriticalproductiondatabases– Wantstostorerecentbackupsonlocaldiskandolderbackupsinthecloudforlongtermretention
– Databaseserverisconnectedtotheinternet– ShorterRTOfornear-term,longerRTOforolderdata
– Retention• Localdisk:1month,Cloud:years
• Solution– DoRMANimagecopybackupstolocaldisk– Backupthoseimagecopiestothecloudusing
RMANfromthesameDBserver
17
OracleDatabaseBackupCloud
Service
SSL
3
LocalDiskBackup(ImageCopy)
On-PremisesDatabases
RMAN
1 2
RMAN> BACKUP DEVICE TYPE sbt COPY OF DATABASE;
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
DualBackupStrategy
• RMANbackupbackupset commandcannotbeusedbecauseofdifferentSBTlibraries
• OntheWeekends
– RunthelocalweeklyL0
– RunthecloudL0
18
BackingtoalocalSBTdestinationandcloudwithseparateFull/Incrementalpatterns.
set echo onrun {allocate channel c1 device type sbt parms "SBT_LIBRARY=<library>, ENV=(<envs>)";backup incremental level 0 tag LOCAL_TGT database format '%d_%U';}
set echo onrun {allocate channel c1 device type sbt parms "SBT_LIBRARY=<libopc>, ENV=(<envs>)";backup incremental level 0 tag CLOUD_TGT database format '%d_%U';}
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
DualBackupStrategy
• OntheWeekdays– Runthelocaldailyincremental
– Runthecloudincremental
19
BackingtoalocalSBTdestinationandcloudwithseparateFull/Incrementalpatterns.
set echo onrun {allocate channel c1 device type sbt parms "SBT_LIBRARY=<library>, ENV=(<envs>)";backup incremental level 1 for recover of tag LOCAL_TGT database format '%d_%U';}
set echo onrun {allocate channel c1 device type sbt parms "SBT_LIBRARY=<libopc>, ENV=(<envs>)";backup incremental level 1 for recover of tag CLOUD_TGT database format '%d_%U';}
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
DualBakcup Strategy• OnWeekendsandWeekdays
– RuntheArchivedLogsbackupscript
20
backup device type disk archivelog all tag ARCHIVE_DISK delete all input;
run {allocate channel c1 device type sbt parms "SBT_LIBRARY=<library>, ENV=(<envs>)";backup backupset from tag ARCHIVE_DISK force tag ARCHIVE_LOCAL format '%d_%U';}
run {allocate channel c1 device type sbt FORMAT '%d_%U' PARMS "SBT_LIBRARY=<libopc>, ENV=(<envs>)";backup backupset from tag ARCHIVE_DISK force tag ARCHIVE_CLOUD format '%d_%U';}
delete backup tag ARCHIVE_DISK;
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
LiftandShiftUsingBulkUpload
• UploadexistingDISKbackupstotheCloudStorage– EitherusingFTCLI,RESTAPIsortheStorageBulkTransferService
• StartaCloudDBinstanceconfiguredtoaccessthetargetcontainerandusetheRMANexportcommandto“export”thebackuppieces
• ExportcommandwillcreatethemetadataneededbyRMANtorestorethosepiecesfromobjectstorage
21
Linuxx64only
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
ProgramAgenda
22
RecoveryManagerHistory
RMANNewFeatures&Enhancements
RMANandDataDeduplication
RMANCloudModule
OracleSecureBackup12.2
RMANforRecoveryAppliance,IntelExperience
1
2
3
4
5
6
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.| 23
OSB12.2newfeatures
• Servesas FileSystemBackupsoftwareandMediaManagerforRMAN– SupportsTapeandDiskPooldevices
• IntroducingsupportforOracleCloudStorageandArchive– NowsupportsOracleCloudStorageasabackuptarget– ObjectStorageandArchiveStorage– Allcloudbackupsencrypted,keysstoredlocally
• NewStagingDevices– Supportstagingtodisk,tapeorcloud– ScheduledRule-basedmigrationorduplication– Independentretentiontime
• PolicyBasedCompression
• Perhostorperjob,4levelsHIGH,MEDIUM,LOW,BASIC
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
ProgramAgenda
24
RecoveryManagerHistory
RMANNewFeatures&Enhancements
RMANCloudModuleNewFeatures
RMANCloudModuleBestPractices
OracleSecureBackup12.2
RMANforRecoveryAppliance,IntelExperience
1
2
3
4
5
6
Gagan SinghSr. Database Architect
Technology and Manufacturing Group (TMG)
Intel Corporation
§ INTEL Corporation – Introduction
§ Database Environment Summary
§ Legacy Backup Overview
§ Challenges
§ Recovery Manager – Use Cases
§ ZDLRA integration with RMAN
§ Recovery Manager with ZDLRA – Key advantages
Agenda
History of Intel
27
• 1968: Intel is founded by Robert Noyce and Gordon Moore
• 1971: World’s first microprocessor
• Now: Innovation that expands the reach and promise of computing
28
§ Leading Manufacturer of Computer, Networking Communications Products, Memory solutions, Security & Programmable solutions.
§ $59.38B in Annual Revenues § Over 100K Employees Globally
Intel Corporation
Database Environment Summary§ Automated manufacturing with complex integrated systems.§ Goals include -Yield analysis, process improvement, failure mode analysis and test
time reduction.§ Database sizes ranging from few GB’s to ~350 TB.§ Mix of Oracle Engineered systems and other vendors§ 24 x 7 uptime.§ Monitoring and Availability is key.§ Strict reporting SLA’s.
Legacy Backup Overview
a• Main strategies àIncrementally updated backups and backupsets
b• Image copies à Daily Incremental à Merge to L0 à Move to Tape
c• Weekly L0 backupset àDaily Incremental à Move to Tape
d• No centralized recovery catalog
e• No compression
f• Backup Validation
Challenges§ Allocate equal storage for backups on Tier 1 SAN§ Several operational issues managing backups
§ Validation taking longer and resource intensive§ Data movement to SBT added another layer of complexity for VLDBs
§ Resource impact§ Prolonged Server resource utilization§ I/O impacts on Tier 1 SAN when writing backups to disks
§ Restores involved multiple steps and archive log management.§ Inconsistent scripts/backup types§ Multi vendor footprint – Challenges during troubleshooting.
Recovery Manager – Use Cases§ Leverage Block Change Tracking –> speeds up incremental backups § Validation: restore database validate, restore database preview§ Data Recovery Advisor -> checks recovery health and proactively flags issues§ Duplicate Database : Active Duplicate enhanced in 12c to use backup sets -> much
more network efficient than 11g§ Create standby DB with duplicate, and Migrate Database Cross-Platform
§ For VLDBs, Convert Older partitions to ‘Read ONLY’ -> reduces overall backup volume, as these tablespaces are only backed up once
§ Uniform secure configuration: Store RMAN scripts in catalog§ Transparent to Data Guard role changes.
§ Time and resource saving through ‘restore …… from service’ feature in 12c§ Use of Multi Section in 12c à Supported with Incremental backups and image copies.
ZDLRA integration with RMAN§ ZDLRA: Leverage different protection policies à”Recovery Window” is important § ZDLRA: Backups : FILESPERSET 1 for data files, as ZDLRA uses this value on
restores. MAXPIECESIZE not supported.§ ZDLRA: EM integration reduces operational overhead§ ZDLRA: Do not make any changes to Recovery Appliance§ ZDLRA: System Activity Script (Doc ID 2275176.1)§ Backup Strategy with ZDLRA :
One time Level 0 (backup set)
Enable Redo Shipping (optional) Daily Incremental
Recovery Manager with ZDLRA – Key advantages§ Reduce resource load on target (protected) DBs. § Storage saving through compression on ZDLRA layer.§ Uniform Backup Environment: Single backup strategy.§ Flexible Backup Retention: Protection Policies, Recovery Windows.§ Reduce operational overhead: Reporting and Monitoring through Enterprise Manager § Reliability, Availability & Performance: Hosted on Exadata HW§ Backup - Better RPO and RTO : Updated Level 0 restores§ Reduce vendor footprint.
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
WhereToGoNext?• ZeroDataLossRecoveryAppliance:TheWorld'sBestDatabaseProtection
– TimChien,Todayat4:30pm,Moscone West3006
• ZeroDataLossRecoveryAppliance:DeepDiveandBestPracticesfromDevelopmentKellySmith/JonySafi,Wednesdayat1:00pm,Moscone West3006
• MaximumAvailabilityArchitectureBestPracticesandTechniquesforOracleCloud– SridharRanganathan,Wednesdayat11:00am,Moscone West3006
• MaximumAvailabilityArchitectureBestPractices:OracleDatabase18c– MikeSmith,Tuesdayat5:45pm,Moscone West3006
Confidential– OracleInternal/Restricted/HighlyRestricted 36
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.| 37
Stay Informed After OpenWorld
Twitter: @OracleZDLRA
LinkedIn: Oracle IT Infrastructure group
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
SafeHarborStatementTheprecedingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedforOracle’sproductsremainsatthesolediscretionofOracle.
Note:ThespeakernotesforthisslideincludeinstructionsforwhentouseSafeHarborStatementslides.
Tip!Remembertoremovethistextbox.
Confidential– OracleInternal/Restricted/HighlyRestricted 38
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.| Confidential– OracleInternal/Restricted/HighlyRestricted 39