1 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
2 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Database Appliance
DOAG Regionaltreffen Hamburg/Nord 24.04.2012
Andreas Findert, Principal Sales Consultant Oracle Systems Presales
3 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
The following is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remain at the sole discretion of Oracle.
4 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Agenda
• Hardware
• Installation Overview
• Configuration and Setup
• Oracle 11g R2 Options
• Backup Strategies
• News & Other Topics
5 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Database Appliance – Hardware
6 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Database Appliance
Simple to implement
Designed and priced to scale
Performance improves as you scale
Highest levels of serviceability
Highest availability for this class of machine
• Ideal for SMBs and Departmental Systems
7 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Exadata Database Machine
Oracle Database Appliance
Quarter Rack
Half Rack
Full Rack
Engineered Systems for Oracle Database
8 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle ODA Components RAC-in-a-box
Node 0
Node 1
Interconnect
Shared Storage
9 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Chassis
• 4U Redundant Storage Server
• 2 Server Nodes (SN)
– 2 sockets per SN (each with 6 Cores)
– 2 internal 500GB 7.2K RPM SATA mirrored boot disks per SN
• 24 3.5” dual ported SAS/SATA/SSD disk slots
– 20x 600GB 15K RPM SAS (slots 0-19)
(Triple-mirrored:12 TB RAW, 4 TB Usable)
– 4x 73GB STEC GEN3 SSD (slots 20-23)
for redo logs (Triple-mirrored)
• 2 Hot-swap redundant power
• Redundant 5V and 12V disk backplane power
• Independent power, locate buttons and status per
SN
• Fixed configuration
• One order number for the hardware + another for
the power cord
• Plus SFP+ Transceivers and/or cables when using
10GbE
FRONT VIEW
REAR VIEW
12 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Server Node
Details 1/2
• 2 x Intel Xeon Processor X5675 (6C, 3.06 GHz, 95W) per SN
– 2-12 CPU Cores per SN enabled on demand
• 96 GB of memory per SN
– 12x 8GB DDR3 low-voltage DIMMs per SN
• 1 Internal low profile 8-lane PCI-E GEN-2 HBA per SN
– LSI SAS GEN2 Erie HBA
• 3 x low profile 8-lane PCI-E GEN-2 Slots via PCI riser per SN
– Slot 2: LSI SAS GEN2 Erie HBA
– Slot 1: Intel quad port 1GbE Northstar
– Slot 0: Intel dual port 10GbE Niantic
13 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Server Node
Details 2/2
• 2 x 1-GbE RJ45 connectors for Host per SN
• 2 x 1-GbE ports within chassis for SN to SN connectivity
• 2 x rear accessed hot-plug SATA 2.5” drive per SN
– Boot disks
• 2 x Rear, 1 internal USB connector per SN
• AST2100 Service Processor per SN
– 1 SP Serial, 1 SP Network, 1 SP VGA per SN
• 2 x Hot-swap 80MM counter-rotating fans per SN
14 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OS Boot
Disk
Internal
HBA
Internal
USB
PCI Riser
CPU0
CPU1
Server Node View
15 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
SAS, Chassis, FIM,
+5V disk, PSU
Signals
Server Node View
16 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Network port bonding
17 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Architectural Overview
• Each Node
– plugs into the chassis
– operates independent of the other
– has full access to the 24 front
mounted disks
– contains a dual port Ethernet
controller internally connected
• eliminates the need for external cables
• failure on one Node will not result in a service interruption on
the other Node
• Any service requests on a failed Node are maintained through
the surviving Node
21 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Hardware Benefits Review
• Internal chassis wiring
– Less potential of accidentally pulled cables
• Redundant and Hot-serviceable components
– Server Nodes
– Fan Assembly
– Power
• Two redundant PSU
• Individually power cabled from PSU to SN
• Independent buffer chip to each SN
– HDD and SSD
• Triple-mirrored
– Two internal networking to fuse cache across the clustered SNs
– Two dual-SAS controllers per SN
22 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Hardware Benefits Review
• Improved Performance
– SSDs used for redo logs
– Networking throughput
• CPU on demand
– Allows for growth by enabling more CPU cores to meet customer
demands
23 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Database Appliance
Pre Deployment & Installation Overview
24 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
About oakcli
• Command line interface to manage ODA
• Needs to be run as root.
• Invocations of CLI is logged to
/opt/oracle/oak/log/<hostname>/client/oakcli.log
# oakcli
Usage: oakcli <command> <object> [<options>]
commands:
show|locate|apply|deploy|update|validate|manage|unpack|copy|configure
objects :
disk|diskgroup|expander|controller|storage|core_config_key|version|firstnet
For complete usage, use: oakcli –h
For detailed help on each command and object and its options use:
oakcli <command> -h
oakcli <command> <object> -h
For details MOS Note 1417879.1:
Oracle Database Appliance: oakcli command reference
26 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Appliance Manager
• GUI-based enquiry
collects configuration
information
• Two modes – Configurator
– Deployment
• oakcli deploy
• oakcli config
27 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
4 Pre-Deployment Steps Done with oakcli • 1. Prepare Network Config (before ODA shipment)
– Use Offline Configurator (from OTN)
– Save configuration file
• 2. Get newest software images
– Download ODA software image and patch bundle from MOS
– Power on ODA and log into node 0 (remote via ILOM or local KMM)
• 3. Copy software to ODA
– Define temporary network access: oakcli configure firstnet
– Copy the software image to /tmp (Sftp or USB stick)
– Unpack software image: oakcli unpack -package /tmp/pxxxxxxxx_yyyyy_Linux-x86-64.zip
– Copy patch bundle to /tmp
– Unpack and apply patch bundle: oakcli unpack -package /tmp/pxxxxxxxx_yyyyy_Linux-x86-64.zip
oakcli update -patch x.x.x.x.x
– Repeat for node 1 (scp over internal network for software images)
• 4. Apply network configuration
– oakcli copy -conf /tmp/mynetworkconf.file
– Creates the onecommand.param file
28 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
1 Optional Pre-Deployment Step Configure for subcapacity
• No need to do anything if running at full capacity
• To change the CPU core count
– Log onto MyOracleSupport
– Declare configuration for servers
– Download encrypted key to reconfigure servers
– Run CLI to reconfigure servers (as specifed in key) in BIOS and
system will reboot
• Once configured for sub-capacity, core count can only
increase in subsequent reconfigurations
# /opt/oracle/oak/bin/oakcli apply core_configuration_key /tmp/myfile.txt
29 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
The Real Installation
• Login on Server Node 0 as root
• Start the X Window System
– startx
– use setxkbmap for a non US keyboard
• setxkbmap de (for german keyboard)
• Start the deployment
– Welcome Page opens, click Next
– Click Browse to load and select the onecommand.param file
– Review the configuration information and modify it as needed
– On the Summary Page, click Install to begin the configuration
and installation
# cd /opt/oracle/oak/bin
# ./oakcli deploy
Only about 1 hour (with the BIOS fix)
31 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Database Appliance – Configuration and Setup
32 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Build System Image Firmware Install OS
Connect System to Network & Power ON
Download SW from MOS
Provide Basic info to Configurator
Deploy Grid, DB with best Practices
Initiate HealthCheck
Fully Configured Database
Deployment Overview
33 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Appliance Manager Planning Required for typical type deployment
• Cluster Name
• Region, Timezone
• Domain
• DNS Servers
• Client Access Public Network Hostnames and its IPs
• Client Access Public Network netmask
• VIP Name (auto populated with –vip) and its IPs
• Scan Name (auto populated with –scan) and two scan IPs
• Database Type, Name, Class and Language
34 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Appliance Manager Planning Optional for custom type deployment
• NTP Servers
• ILOM network info
• Additional network info
• ACFS
• Backup type, database block size, and characterset
• ASR proxy and MOS username, password
36 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OAM Deployment overview
• oakcli deploy runs the command in linear workflow order.
• It is designed to be simple so that it can be used by users with
basic experience with Grid Infrastructure and RAC
• oakcli deploy does not provide complete control to the users
during install but does standardized install that works for
majority of the scenarios
37 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OAM Config Type
• Two types
– Typical
– Custom, including ntp, bond1,
bond2, xbond1, ilom, asr setup
on 1st node, and acfs
• Can load the pre-created
onecommand.params file at
/opt/oracle/oak/onecmd
38 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OAM System Info
Setup the customized System Name
Select from three Database Deployment Configurations:
RAC, RAC One Node, or Single Instance
39 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OAM Network Info Node and IP information for 2nd Node is automatically generated &
filled
VIP Name & IP information automatically generated & filled for
both nodes
SCAN name is auto generated
40 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OAM Database Info
Setup the customized Database Name
Select the Database Class type
41 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OAM Database Class
SGA= System Global Area, PGA= Program Global Area
Very
Small Small Medium Large
Very
Large
SGA (MB) 4096
8192
8192
16384
16384
24576
24576
49152 49152
PGA (MB) 2048
4096
4096
8192
8192
12228
12228
24576 24576
Log buffer (MB) 16 16 32 64 64
Processes 200 400 800 1200 2400
Redo Log (GB) 1 1 2 4 4
42 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OAM Network Validation
43 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OAM Network Validation Sample output
44 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OAM Custom type System Info
51 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
OAM Save the parameter file
One Button
Install
55 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Link to Installation, Configuration and
User's Guide
• http://download.oracle.com/docs/cd/E22693_01/doc.21/e2269
2.pdf
56 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Patching
• All patches (appliance manager, database, OS, firmware,
bios) are bundled in a patch set
– Validated firmware for hardware
– Validated kernel updates
– Validated OAK, HMP, ASR rpms
– Validated and Tested GI/RDBMS Bundle Patches
• One command/No user input is needed
• quarterly patch
• No rolling updates
– Planned for a later release
# /opt/oracle/oak/bin/oakcli update -patch 2.1.0.3.0
60 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Database Appliance – Oracle 11g R2
61 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Database on ODA
• Oracle 11gR2 Enterprise Edition
– Completely standard, no special testing required
– Single Instance, or...
– RAC One Node, or…
– RAC
• Oracle Grid Infrastructure 11g Release 2 (11.2.0.2)
– Oracle Clusterware
– Oracle Automatic Storage Management
62 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle 11gR2 on ODA
• Oracle Active Data Guard
• Partitioning
• Real Application Testing
• Advanced Compression
• Total Recall
• Advanced Security
• Label Security
• Database Vault
• Audit Vault
• OLAP
• Data Mining
• GoldenGate
• Spatial
• …
Database options
63 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Database Sizing Model for Oracle RAC http://docs.oracle.com/cd/E22693_01/doc.21/e22692/chklist.htm#CIHIEIHG
Very Small Small Medium Large Very Large
CPU (Core) for
each node 1 2 4 6 12
Memory (GB) for
each node 8 16 32 48 96
Database size
(GB) 136 273 546 819 1638
Log file size (GB) 1 1 2 4 4
Number of
databases 12 6 3 2 1
I/O per seconds
(IOPS) 300 600 1300 2000 4000
Throughput
(MB/second) 250 500 1000 1500 3000
Log generation
(MB/second) 6.83 6.83 13.65 27.30 27.30
64 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Creating Additional Databases: DBCA Same ODA Templates
78 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Database Appliance – Backup Strategies
79 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Backup
• RMAN, Oracle Secure Backup
Whitepaper: Backup and Recovery Strategies for the Oracle Database Appliance
80 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Supported Third Party Agents for the ODA
Company Backup
Application
Version RMAN Client Media Server
OS
Symantec Netbackup 7.1 7.1 Client OEL 5.7
CommVault Simpana 9 SP3 iDA for Oracle
Databases -
Linux
OEL 5.7
EMC Networker 7.6.2 "SP2" Networker
Module for
Databases and
Application
(NMDA) V1.1
OEL 5.7
IBM Tivoli Storage
Manager
6.3 Data Protection
for Oracle 6.3
OEL 5.7
HP Data Protector A.06.20 A.06.20 Client OEL 5.5
MOS 1415713.1: Oracle Database Appliance (ODA)
Software Agents and Multiple Oracle Homes support
• Beginning immediately software release, all Oracle or 3rd-
party software agents, including management, monitoring,
and authorization agents, will be supported on ODA
• We will no longer maintain a white list of agents that will be
supported
• Customers may load any software agent, or write and deploy
their own agents
• Oracle will provide patches for Oracle software and Linux
libraries. Agents that ship as part of the Oracle Linux
distribution will be automatically patched as part of our
appliance patching process
New
81 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Four possible Backup Strategies
• Back up to a Flash Recovery Area (FRA) on disk
• Back up to a file system such as NAS
• Back up to tape
• Remote replication using Data Guard (Disaster Recovery)
82 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
ODA Backup Sizing
• All disk groups are using high redundancy (triple-mirrored)
– 4TB of 12 TB are availabe.
• When using Cloud FS (ACFS)
Less space for the DATA disk group
• More disk space?
– Move (read only) tablespaces to NFS storage
– Option: Advanced Compression
FRA Backup NFS Backup
DATA 1.6 TB 3.2 TB
FRA 2.4 TB 0.8 TB
REDO 97.3 GB 97.3 GB
95 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Oracle Database Appliance – Features & Other Topics
96 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Features & Other Topics
• You can use
– Multiple DB instances in ODA
– Any options available on Oracle Database EE
• ODA is to be used exclusively as a DB server
– (Other applications are not supported)
– All Oracle or 3rd-party software agents, including management,
monitoring, and authorization agents, are now supported
• You can not change the ASM setup
• Multiple Oracle Database Homes will be supported
– The Grid Infrastructure home must be the latest appliance release
– Database homes can be any release supported by the appliance
– Target Release Date: Q3CY2012
New
New
97 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Features & Other Topics II
• Automatic Service Requests (ASR)
– is optional
– for existing ASR accounts
• ASR supports multiple assets
• ODA and its ILOM can be added to the account
• Always full access to disk, memory & network
– Does not depend on active CPU cores
• NFS expansion via 1- or 10-GbE network connectivity is
supported
– Best practices: Oracle ZFS Storage Appliance (HA configuration)
– ODA will support Hybrid Columnar Compression (HCC) for tables stored
on ZFS Storage Appliance
– Requires 11.2.0.3 (available in April) and Direct NFS (dNFS) access
New
98 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Features & Other Topics III
• Change of hardware config is not supported
– No InfiniBand
– No FC expansion
– No SAS expansion
– No memory upgrade
• 192.168.16.24/25 & 192.168.17.24/25 are used for the Private
Network
– Don‘t use 192.168.16.0 & 192.168.17.0 for client access
• What is needed for 10GbE connectivity?
– Small Form-factor Pluggable Plus (SFP+ ) transceivers and/or cables
(either optical or copper)
– Not included with ODA, but may configured separately on same quote
– Details: http://blogs.oracle.com/eSTEP/entry/oda_what_is_needed_for
99 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Appliance Manager 2.2 2012-04-19
• Support for Oracle Database 11g Release 2 (11.2.0.3.2)
• Support for Unbreakable Enterprise Kernel (Oracle Linux 5.8)
• Patching new features, including the following:
– Support to patch Oracle Grid Infrastructure and Oracle Database homes
separately
– New oakcli command options (-infra, -verify)
• Improved system diagnostics, including the following:
– ODA check: checks Oracle Database Appliance software stack, and
generates an HTML report
– Improved logging and patching information
• Support for local applications running on Oracle Database
Appliance --> FAQ to be released soon!
• Use of HCC with ZFS Storage Appliances with
Database version 11.2.0.3.2
104 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle Database Appliance Bootcamp - Technical Content
Useful ODA External Documents &
Links ● Landing Page:
http://www.oracle.com/us/products/database/database-appliance/index.html
● Oracle Technology Network: http://www.oracle.com/technetwork/server-storage/engineered-systems/database-appliance/index.html
● Documentation Library: http://docs.oracle.com/cd/E22693_01/index.htm
● White Paper English: http://www.oracle.com/us/products/database/oracle-db-appliance-whitepaper-495291.pdf
German: http://www.oracle.com/us/dm/111123-oda-whitepaper-german-1377922.pdf
● FAQ: English: http://www.oracle.com/us/products/database/oracle-database-appliance-faq-495423.pdf
German: http://www.oracle.com/us/dm/111123-oda-faq-german-1377916.pdf
● Datasheet English: http://www.oracle.com/us/products/database/oracle-database-appliance-ds-495410.pdf
German: http://www.oracle.com/webfolder/technetwork/de/community/dbadmin/docs/OracleDatabaseAppliance_DSv2_de.pdf