Using Oracle Multitenant to efficiently manage development and test databases

Marc Fielding Alex Gorbachev

March 2015

© 2014 Pythian 2

WHO IS PYTHIAN?

• 200+ leading brands trust us to keep their systems fast, up & secure

• Utterly elite DBA & SysAdmin workforce, 9 Oracle ACEs, 2 ACE directors, 5 Microsoft MVPs, 1 Cloudera Champion of Big Data

• Oracle, SQL Server, MySQL, Netezza, Cassandra, Hadoop and MongoDB plus UNIX SysAdmin and Apps DBA

• Big Data Services counter includes architects, R&D, data science and operations capabilities in one easy to buy vehicle

• Zero lock-in, utility billing model, easily blended into existing teams

38% Pythian has grown an average of 38% every year for

the past five years

345 Pythian employs more than 345 leading minds in

26 countries worldwide.

The Problem © 2014 Pythian 3 Photo: J. McIntyre via Flickr

Database challenges

© 2014 Pythian 4 Photo: lzee~by~the~Sea via Flickr

What we need •  Higher density

–  Better use of infrastructure investment –  Better use of software licenses

•  Less overhead –  Automated, repeatable processes

–  Self-service

•  Better management –  Usage tracking

© 2014 Pythian 5

Enabling technologies: Oracle Multitenant

© 2014 Pythian 6

Oracle Instance

PDB

Shared SGA PDB PDB PDB PDB PDB

PDB PDB PDB PDB PDB PDB

PDB PDB PDB PDB PDB PDB

The storage problem

© 2014 Pythian 7 Photo: V. Matassa via Flickr

Enabling technologies: storage cloning

© 2014 Pythian 8

Master “Golden” Image

…

Incremental Change Records

…

…

…

…

…

Other resources •  CPU time

•  Memory

•  I/O capacity

•  Network

© 2014 Pythian 9

Photo: kc_jake via Flickr

Resource management •  Database resource manager

–  CPU priority and limits –  Parallel query restrictions –  Restrict large, runaway queries

•  I/O restrictions –  IORM in Exadata –  Storage and OS-level

•  Oracle multitenant limits –  Storage space –  Temp space

•  Accounting and costing

© 2014 Pythian 10

Backup and recovery •  Even if it’s dev/test, data matters

•  RMAN backups –  At the PDB and CDB levels

•  Storage clones –  Don’t forget I/O to move to other device

•  Back up after provisioning –  Cloned PDBs are unrecoverable before backups

© 2014 Pythian 11

High availability

© 2014 Pythian 12 Photo: Ben Short via Flickr

Self service •  Obvious next step in reducing

overhead •  Developers managing their own

DB •  OEM implementation exists •  Business logic = custom •  Example Oracle APEX app

–  Multitenant Self-Service Provisioning

© 2014 Pythian 13

Photo: D.Alves via flickr

Oracle MSSP application •  Built using Oracle APEX •  Currently in beta •  Example only •  Only two user types •  Limited resource management

–  CPU priority –  Maximum storage size

•  Cloning support (but not enforcement)

© 2014 Pythian 14

Data cloning methods •  Single command:

–  create pluggable database db1_clone1 from db1 snapshot copy;

•  Actual actions depend on filesystem type –  ZFS appliance and NetApp

•  Database-initiated SNMP calls with stored credentials –  ACFS

•  Requires full clusterware stack –  CloneDB on NFS or local filesystem

© 2014 Pythian 15

Cloning via CloneDB •  Existed since 11.2.0.2 for non-PDB •  In 11gR2: direct NFS only, backed by a full RMAN

backup •  In 12.1.0.2: supports local (non-NFS) filesystems, and

RMAN backup not required •  Uses filesystem-level sparse files

•  Just one DB change –  alter system set clonedb=true;

© 2014 Pythian 16

Cloning with ACFS •  Lots of sanity checks (good!) •  Put source DB into read-only mode if not already

–  Sessions doing data changes get ORA-16000 error

•  Invokes acfsutil via oradism shadow process acfsutil snap create -w YYYYYYYY /acfsmounts/snapclones

•  Creates symbolic links for each file ln –s /acfsmounts/snapclones/.ACFS/snaps/XXXXX/datafile/o1_mf_system_xxxx_.dbf /acfsmounts/snapclones/DEMOCDB/YYYYY/datafile/o1_mf_system_yyyy_.dbf

•  Recreates the tempfile •  Creates the new pluggable database •  Enable writes to source DB (if enabled before)

© 2014 Pythian 17

Manual ACFS cloning •  Close and reopen source database read only •  Run clone command manually acfsutil snap create -w testclone1 /acfsmounts/snapclones mkdir -p /acfsmounts/snapclones/DEMOCDB/testclone1/datafile •  Set up symbolic links for datafile in /acfsmounts/snapclones/.ACFS/snaps/XXXXX//datafile/*; do ln -s $datafile /acfsmounts/snapclones/DEMOCDB/testclone1/datafile/$(basename $datafile); done •  Plug back in as a clone using new location create pluggable database newpdb from mypdb file_name_convert=('mypdb', 'newpdb') nocopy; •  Close and reopen source database •  Open cloned database

© 2014 Pythian 18

Issues and recommendations •  Oracle managed files •  ACFS clones entire mountpoints •  Error messages are very generic

ORA-65169: error encountered while attempting to copy file ORA-17517: Database cloning using storage snapshot failed on file

Check tracefile, and ACFS log at $CRS_HOME/log/(hostname)/acfs/commands/acfscmds.log

•  Issues with oradism process

© 2014 Pythian 19

Data refreshes © 2014 Pythian 20 Photo: Rob Antill via Flickr

Data masking

© 2014 Pythian 21 Photo: Mary Harrsh via Flickr

A sample implementation •  VirtualBox VM running Oracle Linux 6 •  Oracle Grid Infrastructure 12.1.0.2 with 1 node •  ACFS filesystem mounted at /acfsmounts/snapclones •  Oracle 12.1.0.2 (non-RAC)

•  CDB called DEMOCDB •  Oracle REST Data Services 2.0.9 (aka APEX listener)

in standalone mode •  Oracle Multitenant Self-Service Provisioning, beta 2

© 2014 Pythian 22

Demo time

© 2014 Pythian 23 Photo: Tom Coates via Flickr

Trying it out yourself •  VM or dedicated hardware

•  OS: Oracle Linux 6 recommended

•  Latest Oracle 12c software

•  CloneDB or ACFS storage

•  In the cloud: ACFS clusterware complications

© 2014 Pythian 24

Wrapping up •  More databases = need a smarter approach

–  Less infrastructure –  Less administrative effort

•  Key enabling technologies –  Oracle Multitenant –  Storage cloning –  Self-service

•  Tailored to business requirements •  Download and try it out yourself

© 2014 Pythian 25

Thanks and Q&A

© 2014 Pythian 26

fielding@pythian.com gorbachev@pythian.com

1-877-PYTHIAN

pythian.com/blog

http://is.gd/PythianFacebook

@mfild @alexgorbachev @pythian

http://linkedin.com/company/pythian

We’re hiring! pythian.com/careers

© 2014 Pythian 27

© 2014 Pythian 28

© 2014 Pythian 29

© 2014 Pythian 30

© 2014 Pythian 31

© 2014 Pythian 32

© 2014 Pythian 33

© 2014 Pythian 34

© 2014 Pythian 35

© 2014 Pythian 36

© 2014 Pythian 37

© 2014 Pythian 38

© 2014 Pythian 39

© 2014 Pythian 40

© 2014 Pythian 41

© 2014 Pythian 42

© 2014 Pythian 43

© 2014 Pythian 44

© 2014 Pythian 45

© 2014 Pythian 46

© 2014 Pythian 47

© 2014 Pythian 48

© 2014 Pythian 49

© 2014 Pythian 50

© 2014 Pythian 51