#ibmiod

What Everyone Should Know about IBM Cognos TM1 and IBM Cognos Business Intelligence Integration

Session Number BPM-1942B

Brian Simpson, IBMJason Tavoularis, IBMRonnie Rich, IBM

#ibmiod

Please note

IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.

Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

#ibmiod

Acknowledgements and Disclaimers:

Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates.

The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.

#ibmiod4

Agenda• TM1 and BI – Where we’ve come from

• TM1 and BI – BC Egg Case Study

• Dynamic Query Mode

• Authoring and Consumption

• Report Server Best Practices

• eXtensible Query Engine

• Dynamic Cubes and Cube Technologies

• Upgrade and Migration

• Conformance

• Performance

• Cognos Insight

• What’s New

• In The Labs

#ibmiod5

Where We’ve Come From…

In-teractive Memory

Configurable OLAP

Passionate Customers

World Class BI

Robust Planning

Higher Scale

Platforms Global Growth Enterprise Scale

#ibmiod

TM1 and BI: Bringing It All Together…

Grading Stations Production Data

Biosecurity Surveys

ProducersFlock Count, Hatchery,

Fowl Removal

#ibmiod

#ibmiod

#ibmiod

BI Mobile reporting on TM1 Data

#ibmiod

10

IBM Cognos BI Dynamic Query Mode

#ibmiod

Dynamic Query Mode 101 - Definition

• Refers to the execution of BI content by Cognos 10’s Java-based extensible query engine

• 64-bit

• Performance

o In-memory caching

o Optimized query processing

11

#ibmiod

Flowchart

Report ServerReport ServerReport ServerReport Server

eXtensible Query EngineeXtensible Query Engine(Java)(Java)

Cognos BI User InterfacesCognos BI User Interfaces

Data sourcesData sources

v8.4.1 Query Enginev8.4.1 Query Engine(C++)(C++)

Query modeDynamic Compatible

#ibmiod

Authoring and consumption

13

Cognos Workspace - create & share interactive dashboards

- TM1 Websheets & CubeViews

Cognos Workspace Advanced

- seamlessly graduate a workspace widget to perform advanced data exploration

- author simple reports

Report Studio - author professional reports for a wide audience

- detailed control over the appearance

- bursting, prompts, maps, and advanced charting

- IBM Cognos Active Reports

CAFE - interactive OLAP analysis within Microsoft Excel

Query Studio

Analysis Studio

- ad hoc reporting and analysis

#ibmiod

Report Server• Primarily serves 2 purposes

o Routes query specifications to the query engines

o Renders the result sets delivered by the query engines

• When Report Server is configured as 32-bit on a 64-bit BI server

o DQM data access will be 64-bit

o CQM data access will be 32-bit

• When Report Server is configured as 64-bit

o Only DQM will work – use Advanced Dispatcher Routing for CQM content

• Rule of Thumb

o Configure 1.5 ReportService processes per CPU for 10.2 DQM

14

#ibmiod

eXtensible Query Engine (XQE)

• The lessons learned over decades of leading the BI industry culminated in the design of this next generation query engine

• Embraces the principles of extensibility and abstraction

Accelerated value in every new release

• 10.2 extensions

o Dynamic Cubes

o HiveQL (see session 2545A Thursday 10-11 AM)

o ERP/CRM providers

#ibmiod

Dynamic Cubes – Feature Mission

High performance analytics over growing data volumes

Aggregate awarenessAggregate optimization

Extends Dynamic Query with in-memory caching of members, data, expressions, results, and aggregates

#ibmiod

Application ObjectiveData Structure

Optimal Technology

Notes / Considerations

• Write-back• What-if analysis• High-volatility apps

TM1Medium data volumesAggregates on the fly

• High performance analytics• Large data volume• Star/snowflake schema

Dynamic Cubes

Optimized aggregates Aggregate-aware

• Operational / transactional system

• Consistent performancePowerCubes

Low / medium data volumes Data movement into cube: Latency

Cube groups to manage volume

• Operational / transactional system

• Tightly control latency (cached & non-cached data)

OLAP Over Relational

(OOR)

Low / medium data volumes Leverages Framework Manager model

No database aggregate support

Cube Technology Selection

#ibmiod

Search for “Cognos Dynamic Cubes”

18

#ibmiod

Compatible Query Mode

• Very similar query processing to that in version 8.4.1

• Will continue to be maintained

• Not actively enhanced

Easy upgrades from Cognos 8!

#ibmiod

Cognos 10 Upgrade Supported Path

20

C O G N O S

C O G N O SC O G N O S

Upgrade first, then leverage new features

Use LifecycleManager to

validate resultsCognos 8 and

Cognos 10

Acceptdesired results

Move business users

into Cognos 10

Use Lifecycle Manager to

validate resultsto leverage new

features

Accept desired results

Promote reports to production

Leverage Cognos 10 New Features (e.g. Dynamic Query, etc)

#ibmiod

Migration

• Highly recommend Dynamic Query Mode when starting new projects

• Enabling DQM on existing projects is an optional migration

o DQM performance may or may not be better

o There may be no re-authoring required, there may be significant re-authoring required

o DQM will issue an error to enforce certain best practices that are optional in CQM

• Overall, migration ROI is highest for OLAP data sources

• Overall, migration effort is highest with DMR

• Use Lifecycle Manager to understand the ROI of migrating existing applications to DQ

21

#ibmiod22

Migration Scenarios

2009

Example #1 – Hierarchy not consecutive

#ibmiod23

Migration Scenarios

2009

Example #2 – ‘Incorrect’ hierarchy level order

#ibmiod24

Migration Scenarios

2009

Example #3 – Same hierarchy in rows and columns

#ibmiod25

Levels and Attributes

#ibmiod26

Levels and Attributes

2009

World Country State CityContinent

Example:

#ibmiod27

Levels and Attributes

• Defined Levels should only be used when:

o there is a Balanced Hierarchy

o An author needs to select members by level

o Attributes are level specific

o The dimension does not have element security applied

• Levels should not be defined when:

o The hierarchy is Unbalanced

o The report author wants to make use of attributes that span levels

• Techdoc 1598902: Avoiding BI Problems with Duplicate Cube Elements

#ibmiod

28

Conformance

#ibmiod

DQM Conformance Roadmap

29

initial release supports:

• IBM Cognos TM1• SAP/BW• Oracle Essbase

10.1.0 10.1.1

added support for:

• IBM DB2• IBM Netezza• Teradata• Microsoft SQL Server• MS Analysis Services• Oracle

10.2.0

added support for:

• IBM Informix• IBM IMS• IBM InfoSphere BigInsights• SAP/ECC• Siebel• Salesforce.com

#ibmiod

Conformance: TM1 as a BI data source

30

IBM Cognos BI IBM Cognos BI

version version Supported IBM Cognos Supported IBM Cognos

TM1 server versionsTM1 server versions

10.2 10.1.x

9.5.x

10.1.1 10.1.0

9.5.x

10.1.0 9.5.1

9.5.0

8.4.1 9.5.x9.4.x

#ibmiod

31

Performance

#ibmiod32

As of TM1 9.5.2 and Cognos BI 10.1.0 FP1 (DQM)

• Query optimized

• MDX Engine is moved to the TM1 server, closer to the data

• Better use of the TM1 Stargate cache

• Null suppression done on the TM1 server*

Performance Improvements

#ibmiod33

Avoiding wait times during interactive analysis

• The following common usage pattern is NOT recommended:1) Drag item from the Insertable Objects pane to the rows / columns. 2) Drag specific members from the same hierarchy to the Context3) Since the result is sparse, turn on suppression to make it dense

• Best Practices

• Show only the top N members (elements)

• Explicitly place members (elements) of interest on crosstab edges instead of all members and then filtering

• Use parent members to avoid summary values computed in real-time

#ibmiod

Cognos Insight

34

#ibmiod

Cognos Insight

• Cognos Insight is many things:o It’s a personal BI Analytic applicationo It’s a contribution client for TM1o Its an integration point for BI and a

method to develop Consumer Insight dashboards

o If you’re a TM1 Customer of version 10.1+ any contribution licenses grant access to Insight as a contribution client, as well as a personal analytic tool.

o Cognos Insight while being a highly visual interactive analytic client, is in fact running TM1 Engine

o This allows Insight to respond instantaneously, and be able to quickly and efficiently handle large amounts of data.

35

#ibmiod

Cognos Insight• When used as a contribution client there are two distinct methods:

o Connected mode

• This is great for central application where users are on low latency lans. All interaction with the TM1 Server is realtime.

o Disconnected Mode

• This allows the user to download a cache of the TM1 Server slice they are working with.

• Interaction takes place locally and is committed back to the server

• Offline work is available as of 10.1.1

36

#ibmiod

Cognos Insight – Publishing to BI or TM1• Starting with a personal analytic workspace in Insight you can choose

to share this in two methods.

o You can publish your Insight workspace to Cognos BI

o You can also Publish your workspace to create a TM1 Server

o You can share your Insight file on Cognos Connection

37

#ibmiod

38

What’s New

#ibmiod

Enhanced modeling and metadata/data management in Performance Modeler

• Improved guided import for data and metadata from IBM Cognos BI packages and IBM Cognos Business Viewpoint

• Analytics server advancements for BI reporting, including calculated and aggregated data

Guided Import – PM and Insight

#ibmiod

Email notification on WFP state• In TM1 10.1.1 we introduced the ability notify stakeholders of either

status changes in the WFP or allow broadcast messages from the Admin.

• This requires Security Mode 5 (CAM Integration) and is dependent on the BI HTS Service and email notification service.

• This can be configured to show in their Portal inbox or to their corporate email.

• We have provided tags to simplify messaging

o Eg <owners> would broadcast to all node

owners.

40

#ibmiod

Rule Based Aggregate Awareness

• Have you ever built a great rule in TM1 only to notice your BI report doesn’t think it’s so great?

• Frustrated trying to recreate the outcome in your BI Report because you know it already exists in TM1?

41

2009

#ibmiod

Rule Based Aggregate Awareness• With the introduction of Rule

Based Aggregate Awareness this is no long a concern.

• We have updated how our MDX responds to a BI request and now present those great Rules you haave written

42

#ibmiod

43

In the Labs

#ibmiod

TM1 and BI Integration “In The Labs”• Performance

• CAFÉ

• Metrics

• Hierarchy Object

• Attribute-Based Hierarchies

• Subsets

• Views

• Strings

• Automated CAM Group Maintenance

• Cloud

#ibmiod45

Cognos Proven Practices on developerWorks

ibm.com/developerworks/analytics/practices.html

• Writing Efficient OLAP Queries

• IBM Cognos BI Dimensional Functions

• Using Dimensional Functions to Determine Current Period

• IBM Cognos TM1 FEEDERS