+ All Categories
Home > Documents > Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database...

Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database...

Date post: 03-May-2018
Category:
Upload: vuthuy
View: 221 times
Download: 2 times
Share this document with a friend
24
Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle
Transcript
Page 1: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Oracle BIWA Summit 2017

Oracle Database In-Memory: Enabling Real-time AnalyticsAndy Rivenes, Product ManagerOracle

Page 2: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedforOracle’sproductsremainsatthesolediscretionofOracle.

2

Page 3: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

WhatisDatabaseIn-Memory

3

Page 4: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

OracleDatabase In-MemoryGoals

4

Real-TimeAnalytics TrivialtoImplement

NoApplicationChangesNotLimitedbyMemory

100X

AccelerateMixedWorkload

AnalyticsTransactions

RunanalyticsonOperationalSystems

EnableReal-TimeBusinessDecisions

Real-TimeAnalytics100X

Risk-Free

ProvenScale-Out,Availability,Security

Page 5: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

Breakthrough:DualFormatDatabase

• BOTH rowandcolumnformatsforsametable

• Simultaneouslyactiveandtransactionally consistent

• Analytics&reportingusenewin-memoryColumnformat

• OLTPusesprovenrowformat

5

BufferCacheNewIn-MemoryColumnStore

SALES SALESRow

FormatColumnFormat

SALES

Page 6: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

OracleDatabase12c• DatabaseIn-MemoryisanoptionforOracleDatabase12cEnterpriseEdition

• DatabaseIn-Memoryisincludedinthefirstpatchset (12.1.0.2)for12.1

• AvailableintheCloudon12.2• Noadditionalstepsrequired

6

Page 7: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

Oracle Database In-Memory: Simple to Implement

1. Configure Memory Capacity• inmemory_size = XXX GB

2. Configure tables or partitions to be in memory• alter table | partition … inmemory;

3. Later drop analytic indexes to speed up OLTP

7

Page 8: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

OracleIn-MemoryAdvisor• NewIn-MemoryAdvisor• AnalyzesexistingDBworkloadviaAWR&ASHrepositories

• ProvideslistofobjectsthatwouldbenefitmostfrombeingpopulatedintoIMcolumnstore

Note:DatabaseTuningPacklicenserequired

Page 9: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

Howdoesitwork

9

Page 10: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

OracleIn-MemoryColumnarTechnology

10

SALES

SALES

PureIn-MemoryColumnar• Purein-memorycolumnformat

• Enableforsubsetofdatabase• Cheaptomaintain– nologgingorIO• AllowsefficientOLTP• Nochangetodiskformat

• Builtseamlessly intoOracleDatabase• Appearsasanewstoragetype• Transparent toApplications• AllEnterpriseFeatureswork..

• Availability– RAC,Flashback,DataGuard,etc.• Security– Encryption,Auditing,etc.

Page 11: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

In-MemoryArea:NewStaticAreawithinSGA

SystemGlobalAreaSGA

BufferCache

SharedPool

LogBuffer

LargePool

In-MemoryAreaOther

• ContainsdatainthenewIn-MemoryColumnFormat

• ControlledbyINMEMORY_SIZEparameter- Minimumsizeof100MB

• SGA_TARGETmustbelargeenoughtoaccommodatethisarea

11

Page 12: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

ScanningandfilteringdatamoreefficientlyReal-TimeAnalytics

StorageIndexesCompression

Scan&filterdataincompressedformat

Accessonlythecolumnsyouneed

ColumnarFormat SIMDVectorProcessing

ProcessmultiplecolumnvaluesinasingleCPUinstruction

VectorRegister

Loadmultipleregionvalues

VectorCompareallvaluesan1cycle

CPUCA

CACA

CA

Min1Max3

Min4Max7

Min8Max12

Pruneoutanyunnecessarydatafromthecolumn

12

Page 13: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

• Speedofmemory• ScanandFilteronlytheneededColumns

• VectorInstructions

Real-timeAnalyticsImprovesallaspectsofanalyticqueries

DataScans

VectorRegisterCPU

CA

CACA

CA

In-MemoryAggregation

•CreateIn-MemoryReportOutlinethatisPopulatedduringFastScan

•RunsReportsInstantly

Joins

•ConvertStarJoinsinto10XFasterColumnScans

•Searchlargetableforvaluesthatmatchsmalltable

HASHJOIN

TableA TableB

SALES

STATE=CA

13

Page 14: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

What’sNew

14

Page 15: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

• In-Memoryalwaysavailable• 248GBofRAMpernode• EasywaytohavecustomerstryDBIM

• Note:Memorytobeupgradedto768GBofRAMpernodewithX6basedservers

• In-MemoryavailableinDatabaseX50IM– 50GBofstorage/10GBSGA

• Limitedto5GfortheIn-MemoryArea

• Intendedfordevelopersandsmalldepartmentalusers

15

• In-MemoryavailableinExtremePerformanceservice– NotavailableinSE,Enterprise,orHighPerformanceEditions

– Upto240GBRAMpernode

• EasywaytohavecustomerstryDBIM

DatabaseIn-MemoryAvailableNOW intheCloud

Exadata Express Exadata CloudServiceDatabaseAsaService

Page 16: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

What’snewin12.2forDatabaseIn-Memory

2X FasterJoins5X FasterExpressions

Real-TimeAnalytics Automation

DynamicDataMovementBetweenStorage&Memory

MassiveCapacity

In-MemoryonExadataFlash

MixedWorkload

ActiveDataGuardSupport

Multi-model

NativesupportforJSONDatatype

16

{}JSON

Column

Page 17: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

DatabaseIn-MemoryandotherOracleDatabasefeatures

17

Page 18: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

DatabaseIn-Memory:ScalestoAnySize

18

Scale-Up

•Scale-UponlargeSMPs•NUMAOptimized

•Scale-OutAcrossServerstoGrowMemoryandCPUs

• In-MemoryQueriesParallelizedAcrossServers

Scale-Out CombinewithFlashandDisk

DISKPCIFLASHDRAM

ColdDataHottestData

ActiveData

•Easilyplacedataonmostcosteffectivetier

•SimultaneouslyAchieve:•Speed ofDRAM• I/OsofFlash•Cost ofDisk

Page 19: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.| 19

RAC

ASM

RMAN

Data Guard & GoldenGate

• Pure In-Memory format does not change Oracle’s storage format, logging, backup, recovery, etc.

• All Oracle’s proven availability technologies work transparently

• Protection from all failures- Node, site, corruption, human error, etc.

DatabaseIn-Memory:IndustrialStrengthAvailability

Page 20: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

DatabaseIn-Memory:TrivialtoImplement

20

SimpletoConfigure

NocomplexsetupSetcolumnstoresize

DeclareIn-Memorytables

FullFunctionality

NoSQLrestrictions

100%Compatible

Noapplicationchanges

Nodatamigration

EasytoDeploy

Page 21: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

HowarecustomersusingOracleDatabaseIn-Memory

Page 22: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

AT&TWiFi – DataWarehouse• BusinessObjectsreports100X faster

• ETLprocessesimprovedby50% faster

• NochangestoSAPBusinessObjectsreports

Villeroy &Boch – SAPBW• SAPBWCOPAqueries30– 33X faster

• SAPTransactionlistqueries4– 4,800Xfaster

• Avoidedexpensive&riskyupgradetoS4/Hana

22

BOSCH – SAPCRM• Dropped allcustomindexes

• Analyticqueries2-20Xfaster,DML2-3X faster

• Nochangestoapplicationrequired

DieMobiliar – MixedWorkload• Analyticqueries50-200X faster

• Databasesizereduced considerably

• PhaseoutofNetezza andmainframesystems

DatabaseIn-MemoryReferences

Page 23: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

WherecanIgetmoreinformation

23

Page 24: Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database In-Memory: Enabling Real-time Analytics Andy Rivenes, Product Manager Oracle

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

JointheConversation

24

https://twitter.com/TheInMemoryGuyhttps://blogs.oracle.com/in-memory/

WhitePapers(otn.com)• OracleDatabaseIn-MemoryWhitePaper• OracleDatabaseIn-MemoryAggregationPaper• WhentouseOracleDatabaseIn-Memory• OracleDatabaseIn-MemoryAdvisor

Videos• OracleDatabaseIn-MemoryYouTubeChannel• oracle.com- PoweringtheReal-TimeEnterprise- IndustryExpertsSharePerspectivesoracle.com/us/corporate/events/dbim/index.html

• YouTube- JuanLoaiza:SoftwareinSilicon

AdditionalQuestions• In-Memoryblog:blogs.oracle.com/In-Memory• Myemail:[email protected]

https://www.facebook.com/OracleDatabasehttp://www.oracle.com/goto/dbim.html

AdditionalResources


Recommended