8/6/2019 Varan_OBIA

1/71

Tips and Tricks for Oracle

Business Intelligence Application

Implementations

Shyam Varan NathOBIEE Architect, IBM

President BIWA SIGMay 2011

8/6/2019 Varan_OBIA

2/71

Agenda

BI Reporting Landscape OBIEE and BI Applications What is new? Sneak Peak to 7.9.6.3 Relational and Multi-Dimensional Reporting OBIA 7.9.6.x tips and tricks Real life issues Wrap Up

8/6/2019 Varan_OBIA

3/71

About Me!

A BI/DW professional with IBM GBS (Oracle Practice) OCP since 1998 on 4 different DB versions President/Founder of BIWA SIG an IOUG SIG for BI,

DW and Advanced Analytics professionals

Regular speaker at Oracle Open World (since 03),Collaborate (since

05), ODTUG-KScope (since

08),

BIWA Summit and RUGs (NY/RM/SF/NO etc.)

Bachelors from IIT-India, MBA and MS from FloridaAtlantic University, Boca Raton, FL

8/6/2019 Varan_OBIA

4/71

IBM and Oracle

IBM & ORCLAnalyticsOver last 1 yr

BI Platforms =>

8/6/2019 Varan_OBIA

5/71

Shyam

8/6/2019 Varan_OBIA

6/71

OBIA OTN Forum

Top Expert in the BI Apps Forum

8/6/2019 Varan_OBIA

7/71

Why De-Mystify OBIEE?

"Surveyed customers continueto indicate that OBIEE, for the

developer role, is more difficult

to use, on average, than other

BI platforms Gartner Magic

Quadrant Jan 2010

Gartner Magic Quadrant Jan 2011

What are the new features in OBIEE 11.1.1.5 !!!

8/6/2019 Varan_OBIA

8/71

Traditional Circular Join OBIEE Star (Logical/Physical

BI Apps Other Extreme

8/6/2019 Varan_OBIA

9/71

Why the Data Warehouse?

ERPs like Oracle EBS

are excellent in capturingbusiness data

Data warehouse/OBIEEleverages ERP data for analysis

Data warehouse also

gathers data frommultiple systems:Legacy, Demantra, etc.

ERP Systems

Should you point OBIEE to source systems or not?

8/6/2019 Varan_OBIA

10/71

Applications

EAI

CRM Apps

SCM Apps

Websites

Financials

Distribution

HCM Apps

Orchestration Data MartsReporting

Data Warehouse

ETL

BusinessIntellige

nce

DW

Operations

ERP Apps

Ideal Information Architecture

(OLAP)

Essbase

8/6/2019 Varan_OBIA

11/71

OBIEE Positioning

8/6/2019 Varan_OBIA

12/71

Some Recent Development

OBIEE 11.1.1.5 released for download onMay 6, 2011

OBI Apps 7.9.6.3 released same day! First time BI platform and BI apps are in-

sync

Last release 7.9.6.2 came after OBIEE11.1.1.3 but was

supported

not

certified

Focus on Mobile computing and Time-Ten

8/6/2019 Varan_OBIA

13/71

recent

BI Apps 7.9.6.3requires New BI platform

11.1.1.5

New Informaticaplatform 9.0.1

New DAC (not 11g yet)but hot fixed version10.1.3.4.1

Provides iPad/iPhonesupport out of box

Campaign PerformanceDashboard on iPad

BI Apps on iPhone

8/6/2019 Varan_OBIA

14/71

General Direction 7.9.6.3

In 7.9.6.3 focus was on making the rpd, web cat andsecurity model 11g ready.

Oracle switched to role based security from group based Some fixes in the rpd to satisfy the stricter consistency

checking in 11g

Leveraged some new Presentation capabilities in thereports and dashboards (such as presentationhierarchies).

OBIEE 11g now allows BI apps to unlock a bunch of newcapabilities such as mobile/iPad, better systemsmanagement, scorecards, etc.

No real new core functionality, ETL adapters for OracleERPs added (EBS R12.1.3 nominal support)

8/6/2019 Varan_OBIA

15/71

BI Apps Roadmap

8/6/2019 Varan_OBIA

16/71

General Challenges with BI Projects

Users often want oneplace / tool for

Operational and

Analytical reportingDegree of details inwarehouse

Right time data need for intra-day

ETLHighly Formattedreports

Security model across BIand Source Systems.

8/6/2019 Varan_OBIA

17/71

Case Studies

Family owned, 50 yrs old, $1b+

manufacturing company inAtlantaSeveral manufacturing plantsusing systems like JD Edwards,

Demantra, EPM/Planning and

Legacy/Main frame systems

ODS/Crystal Reports foorprintFirst formal DW initiative

OBIEE, ODI and BIP as tech stackNeed for Manufacturing, PlantShop floor analytics, job profitability

and Sales Analytics in first go

EPM-Workspace IntegrationHighly formatted and complex BIPublisher reports

Energy Services Company

publicly traded, ~$2b in Houston,TXNew EBS R12 implementation in 4divisions, HFM, Planning, one div

replacing SAP

First formal DW initiativeOBIEE and BI Applicationspurchased

Need for HR, SCM/Procurement,Finance Analytics

Go-live in Phases such as HR, Finand SCM

Other Energy industry specificapplications in use

Some SQL Server/Crystal Reports

8/6/2019 Varan_OBIA

18/71

Why OBIEE v/s BI Apps?

OBIEE

Need to integrate JD Edwardsdata with legacy mainframe data asmanufacturing plants are in

transition

In 2009 time frame BI apps forJDE Edwards have no coverage for

manufacturing, shop floorproduction data and job profitability

Cost allocation engine needed forjob costing and profitability

OBIEE, ODI and BIP as techstack, shop trying to stay as Oracle

tech/apps shop

Security with EPM-Workspaceneeded as Essbase/Planning in

use since V7

Resulted in 4 subject areas

BI Apps

New ERP implementation providesopportunities packaged analyticsfor rapid deployment as the starter

DW

One manufacturing divisionreplacing SAP, so challenges in

replacing existing SAP - EasyAccess functionality

EBS Versions sliding from R12.1.1to R12.1.3

No coverage for Oracle ProcessManufacturing, HR Advanced

Benefits etc in BI Apps today

HFM being used for consolidationand Eliminations

Resulted in HR, SCM/Ps and Finanalytics as starters

8/6/2019 Varan_OBIA

19/71

Custom Data Warehouse / OBIEE

Job Cost PDS

Sales

Production Data Summary Fact

Plant Dimension

Workcenter DimensionOperation Reference Dimension

Fiscal Day DimensionAssociate Dimension Work Order Dimension

Data Models

Developed forCompanys Need!

Developing the Data ModelStar Schemas, Two Time DimensionsInternationalization - Multi currency, multi UOM support

Skill Sets Enterprise Data Modeler

8/6/2019 Varan_OBIA

20/71

Information Flow from JD Edwards (E1) & Legacy

E1 PDfiles

SQLProgramsload PRS

staging

PRS

stagingfiles

SQLPrograms

load Dims &

Fact Tables

ProdTransFact

Table

Dimension

Tables

SalesFact

Table

Legacyfiles

Programsload PRSstaging

ODI

8/6/2019 Varan_OBIA

21/71

Security: Shared Services and OBIEE

8/6/2019 Varan_OBIA

22/71

EPM to OBIEE

8/6/2019 Varan_OBIA

23/71

How do we set it up?

Login in to the OBI Administrator Tool in Online mode. From the Menu tool bar click on Manage > Security. Select Custom Authenticators Right Click on the Custom Authenticator that appears in the

right pane and choose properties

Specify the following path

/OracleBI/web/bin64/libsawobisauthenticatorproxy643r.so Close the Security Window Click on File > Save Click on Yes when prompted to Check in Changes Click on File > Close Restart the EPM environment Restart OBIEE

8/6/2019 Varan_OBIA

24/71

Install Process BI Apps Route

End user machines requiresno software, browser basedassess

Windows boxes required forclient software and for

transferring some server

software (A and B)

Co-location of InformaticaPowerCenter Services and

DAC Server C

Clients can be installed onmultiple Windows boxes

8/6/2019 Varan_OBIA

25/71

OBIEE v/s Packaged BI Application

CRMANALYTICS

ERPANALYTICS

ORACLE BI ENTERPRISE EDITION (OBIEE)

AND OTHER OPERATIONAL AND ANALYTIC SOURCES

Sales

MarketingService andContactCenter

PriceLoyalty

FinancialsProcurementand Spend

Supply Chainand Order

Management

ProjectsHuman

Resources

8/6/2019 Varan_OBIA

26/71

8/6/2019 Varan_OBIA

27/71

OBIEE From Surface to Plumbing

8/6/2019 Varan_OBIA

28/71

Whats Below the Surface?

8/6/2019 Varan_OBIA

29/71

Supporting Infrastructure Informatica and DAC

8/6/2019 Varan_OBIA

30/71

BI Apps Customers to 11gTwo approaches:

Upgrade to BI Applications7.9.6.3 Certifies11.1.1.5, out of the box support

for 11g capabilities

Recommended choice for net newimplementations and existing BI Apps

customers needing 11.1.1.5 capabilitiesalike

Platform-only upgrade forexisting BI Apps deployments Fully supported with OBIEE 11.1.1.5 but

not without challenges Good option for heavily customizeddeployments with strong need for11.1.1.5 features

Case Study of 7.9.6.2 customer

8/6/2019 Varan_OBIA

31/71

8/6/2019 Varan_OBIA

32/71

Lessons Learnt 7.9.6.2 with OBIEE 11.1.1.3

Categories: RPD and Presentation LDAP and Security Write Back etc.

8/6/2019 Varan_OBIA

33/71

Summarizing the Pre-11.1.15 Release

for BI Apps Platform Upgrade

8/6/2019 Varan_OBIA

34/71

Tips and Tricks from the Field

8/6/2019 Varan_OBIA

35/71

Real World BI/DW Projects

8/6/2019 Varan_OBIA

36/71

Custom OBIEE Development

Example of ERP systems like Oracle EBSas source of data

Knowledge of different Schemas domain/functional knowledge

Naming conventions source side Security of Objects

8/6/2019 Varan_OBIA

37/71

EBS Object NamesObject Name Function of the object E.g.

_ALL Underlying table with all the values PO_DISTRIBUTIONS_ALL

_B Base of underlying table, same as _ALL RA_TERMS_B

_TL Language translation table with translation of

descriptive fields in different languages

_VL View based on translation table OKE_K_Deliverables_VL

_BASIC_V View on top of the Basic table

_DFV Descriptive Flex Field related view, it will

have the defined values as Column names

instead of generic attribute 1, ..2

_KFV Key Flex Field views contain the

concatenated fields as it would bedisplayed to the user. For e.g. A field may

consist of Division, Department and

Account fields and the KFV will have the

concatenated values.

8/6/2019 Varan_OBIA

38/71

EBS Naming Conventions

All objects accessed by EBS application have synonym in APPSschema, e.g.OKE.OKE_K_LINES has synonymAPPS.OKE_K_LINES

EBS Forms fetch data from a user friendly view with name ending is_V or _VL (e.g. OKE_K_Deliverables_VL).

Views have descriptive value as opposed to the numeric ids fieldsstored in the base table making it human-readable for reports.

Views also implement security and restrictions to the data in variousforms such as restrict values by language, org_id etc

These variables are set by EBS (session context) when the useraccesses data via the EBS application.

8/6/2019 Varan_OBIA

39/71

Some EBS Schema Names

AP - Oracle Payables

AR - Oracle Receivables

GL - Oracle General Ledger

INV - Oracle Inventory

MRP - Oracle Master Scheduling/MRP

PA - Oracle ProjectsPAY - Oracle Payroll

PER - Oracle Human Resources

PJM - Oracle Project Manufacturing

WIP - Oracle Work in Process

WMS - Oracle Warehouse Management System

WSH - Oracle Shipping

WSM - Shop Floor Management

8/6/2019 Varan_OBIA

40/71

Some EBS Related Tips

Take help from EBS usersHelp >Record History (table, views)Help > Examine (column)

Involve the users to develop MD50, MD70

Sometimes users can point to an OracleReport that has similar data source

The SQL from Oracle Report can help tojumpstart

Create views that OBIEE can use

8/6/2019 Varan_OBIA

41/71

JD Edwards

Tables The JD Edwards table

names are quite cryptic

This shows that that forbuilding custom OBIEEsolutions, deep ERPknowledge is required

Need for data modeler,ETL/OBIEE architect

and developers

8/6/2019 Varan_OBIA

42/71

Naming Standards!

Shyam Shally Sanya Sanat

BI Apps Naming Std

8/6/2019 Varan_OBIA

43/71

Case Study of Media Company

Complex hierarchies for GL, Cost Centeretc

Hierarchies maintained in Essbase outline not in Oracle EBS

EBS 11.5.10 and OBIA Fin in use Hyperion Strategic Finance in use

8/6/2019 Varan_OBIA

44/71

8/6/2019 Varan_OBIA

45/71

Data

EBS

OBAW/DW SchemaDrill through table

Franchise cost center map

DIMExtract data

Generate franchise Map

Load Data

DATA FLOW

Actual CubeEssbase

8/6/2019 Varan_OBIA

46/71

PeopleSoft - BI Apps

Unlike Oracle EBS, Siebel and JD Edwards, allof PeopleSoft is not in same database

HCM and Finance (FSCM) are in two differentPeopleSoft Instances, hence two different OLTP

DBs

Additionally, complete HR Analytics requiressome financial fact tables, HR related Financialmetrics

How do you create the Execution Plan forsame?

8/6/2019 Varan_OBIA

47/71

Execution Plan HCM + FSCM

Create a custom containercalled PeopleSoft 9.0 HCMfrom the existing containerPeopleSoft 9.0. From DAC

menu, useFile

NewSource System Container.

Similarly, create another newcustom container calledPeopleSoft 9.0 FSCM from

the existing containerPeopleSoft 9.0.

8/6/2019 Varan_OBIA

48/71

In PeopleSoft 9.0 FSCM, inactivate the 3 tasks

SDE_PSFT_GEOCountryDimension SIL_DayDimension_GenerateSeed SIL_DayDimension_CleanSeed

8/6/2019 Varan_OBIA

49/71

8/6/2019 Varan_OBIA

50/71

On the Parameters tab in the bottom pane,generate one copy of parameters (for eachcontainer). Then set the values of theparameters as follows:

8/6/2019 Varan_OBIA

51/71

Build this Execution Plan. In the Set up Physical Data Sources

tab, configure the connections for thephysical data sourcesDataWarehouse, PSFT_9_0_HCM,PSFT_9_0_ELM (if you usedLearning) and PSFT_9_0_FINSCM.

Execute the newly created EP HumanResources with GL PeopleSoft 9.0.

8/6/2019 Varan_OBIA

52/71

Other Case Studies - Tips

A very large Retailer BI Apps onExadata V2

BI Apps on Teradata and Netezza??(Terdata is supported for both OBIEE/OBIA,

Netezza is supported for OBIEE and not

for OBIA)

8/6/2019 Varan_OBIA

53/71

Teradata (TD) Considerations

NULL_VALUES_SORT_FIRST should be set to ON forTD

Leverage function shipping Set the Nullable flag appropriately

for join columns

8/6/2019 Varan_OBIA

54/71

BI Apps with Exadata

The Full Table Scan is no longer your enemy! FTS isvery quick in Exadata but not in the regular 11gdatabases

Hence, the performance configurations like indexesmight not be required in the Exadata boxes in

certain situations Drop the distinct key indexes and change stats method

change in customsql.xml

In certain situations we saw the performancebottleneck at the source system database as it was not

able to feed the Exadata box at it's import capacity consider flat file extracts from sources

8/6/2019 Varan_OBIA

55/71

BI Apps on Exadata

On larger tables like - AP_AE_LINES_ALL, avoid PARALLELquery option, the difference intime observed was from 4 hours to 2 minutes.

Disable or drop all indexes with distinct_keys = 1 (b-tree andbitmaps) reason being such indexes are ineffective, with oneunique value. So it's highly unlikely that Optimizer would everconsider them in building any execution plans.

Avoid query transformation into a union-all query andscanning all the big tables twice. Here we will need to find aworkaround to avoid the union-all to scan the tables once orfind a way to reduce full scanning of the tables (partitioning/index etc). e.g table W_GL_ACCOUNT_D 8 mil rows gettingscanned without any valid filtering

Partitioned tables must have stats at both table and partitionlevel

8/6/2019 Varan_OBIA

56/71

Query Predicate

Lets consider the example of full scan onW_GL_LINKAGE_INFORMATION_G if it's a huge table;it takes nearly five minutes. The predicate used in thereport is filter("T146781"."JOURNAL_LINE_INTEGRATION_ID"='1698893~69290')

in /shared/Financials/Payables/Invoice Details Queryexecutes for 6 minutes.

Suggestion: recreate indexW_GL_LINKAGEINFORMATION_G_M1(JOURNAL_LINE_INTEGRATION_ID,

DATASOURCE_NUM_ID). This index is registered inDAC as ETL index hence it is normally dropped afterETL; we need to make it permanent. This index shouldhelp to lower this table scan time down to a few seconds.

8/6/2019 Varan_OBIA

57/71

BI Apps 7.9.6.3 Sneak Peak

8/6/2019 Varan_OBIA

58/71

Oracle BI Applications 7.9.6.311g Features

Master Detail LinkingChart Sliders & ZoomingHierarchical ColumnsView promptsCascading Prompts

8/6/2019 Varan_OBIA

59/71

Procurement and Spend

Analytics

Chart zooming

8/6/2019 Varan_OBIA

60/71

Supply Chain and Order Management Analytics

8/6/2019 Varan_OBIA

61/71

Graph SlidersPlayback option

Supply Chain and Order Management Analytics

8/6/2019 Varan_OBIA

62/71

Graph Sliders

Master DetailLinking

Supply Chain and Order Management Analytics

8/6/2019 Varan_OBIA

63/71

Select 2009 Q4

Detail graph showsTrend by Month for the

selected quarter

Supply Chain and Order Management Analytics

8/6/2019 Varan_OBIA

64/71

Project AnalyticsIn-place Drill using

presentation hierarchies

8/6/2019 Varan_OBIA

65/71

In-place Drill usingpresentationhierarchies

Fiscal Quartershows only 2008

values

Cascading PromptsSelect Fiscal Year = 2008

Financial Analytics

Fi i l A l ti

8/6/2019 Varan_OBIA

66/71

Graph Sliders

Playback option

EnhancedVisualizations

Financial Analytics

8/6/2019 Varan_OBIA

67/71

Human Resources Analytics

O l M bil f BI A

8/6/2019 Varan_OBIA

68/71

Oracle Mobile for BI Apps

Native mobile apps with full Dashboardfunctionality and all BI content types Dashboard Drill/Navigate Catalog navigation Favorites Alerts Search

Actions Dashboards dynamically adjust to

exploit the form-factor of the device Device support

iOS iPhone and iPad in 11.1.1.5 Android next

Blackberry awaited??

8/6/2019 Varan_OBIA

69/71

Oracle BI Applications on Apple ipadExample: Marketing Analytics

8/6/2019 Varan_OBIA

70/71

8/6/2019 Varan_OBIA

71/71

n Recap OBIEEn Recap BI Applicationsn Technical Detailsn Questions

n Contact Information:ShyamVaran@Gmail.com

Shyam.Nath@US.IBM.com

Summary / Questions