+ All Categories
Home > Documents > April, 2013 Leveraging IBM PureData for Analytics for...

April, 2013 Leveraging IBM PureData for Analytics for...

Date post: 06-Aug-2020
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
35
© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased Sales Jan Shineman, Director Alliance Management, IBM Michael Zeller, President, Zementis April, 2013
Transcript
Page 1: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Leveraging IBM PureData for Analytics for Increased SalesJan Shineman, Director Alliance Management, IBMMichael Zeller, President, Zementis

April, 2013

Page 2: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Why should ISV’s work with the IBM PureData System for Analytics?

IPDA has a compelling value proposition for ISV’s−Minimize risk in deployment−Easy to integrate−Large installed base for increased market penetration−Capitalize on IPDA client satisfaction

2

Page 3: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Agenda

Big Data is here

Why IPDA wins

How to work with IPDA

Partner Success Story - Zementis

Call to Action

Page 4: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Smartphones and 1.2 billion mobile employees by 2014

1Billion

Extended Reach

Speed Valueview cloud as critical to their plans

90%of digital content in 2012, up 50% from 2011

2.7ZB

New Insights

Intelligent business assets

20B+Responsiveness

1. Technology factors2. People skills3. Market factors4. Macro-economic factors5. Regulatory concerns6. Globalization

Factors impacting organizations:1

Source: IBM CEO Study 2012

For the first time, CEOs identify technology as the most important external force impacting their organizations

Page 5: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Increasing Variety of datarequires new techniques

Increasing Velocity of data requires higher performance

Increasing Volume of data

requires growing capacity

35 ZB

by 2020

Today’s big data challenges for both transactions and analytics are increasing demands on data systems

Millions oftransactions per second Telco subscriber activity logging

Mobile CloudSocial Big DataCommerce

2020

50x

2010

Analytics

Billions ofdevices & sensors

Smart Meters, RFIDs, GPS…

Page 6: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Agenda

Big Data is here

Why IPDA wins

How to work with IPDA

Partner Success Story - Zementis

Call to Action

Page 7: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Too complex an infrastructure Too complicated to deploy Too much tuning required

Too inefficient at analytics Too many people needed to maintain Too costly to operate

7

Traditional data warehouses

They are based on databases optimized for transaction processing—NOT to meet the demands of advanced analytics on big data.

are just too complex

Too long to get answers

Page 8: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

System for Analytics

Delivering data services for analytics

IBM PureData System for AnalyticsOptimized exclusively for analytic data workloads

Speed 10-100x faster than traditional custom systems* Patented MPP hardware acceleration

(Massively Parallel Processing)

Simplicity Data load ready in hours No database indexes No tuning No storage administration

Scalability Peta-scale data capacity

Smart Designed to run complex analytics in minutes,

not hours Richest set of in-database analytics

* Based on IBM customers' reported results. "Traditional custom systems" refers to systems that are not professionally pre-built, pre-tested and optimized. Individual results may vary.

Page 9: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

For apps like E-commerce… Database cluster services optimized for transactional throughput and scalability

For apps like Customer Analysis…Data warehouse optimized for high-speed, peta-scale analytics and simplicity

For apps like Real-time Fraud Detection…Operational data warehouse services optimized to balance high performance analytics and real-time operational throughput

Powered by Netezza technology

Meeting Big Data Challenges – Fast and Easy!

IBM PureData Family

System for Transactions

System for Analytics

System for Operational Analytics

Page 10: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

IBM PureData for Analytics Applications and Markets

– Revenue Assurance– Credit Risk– Dispute Management– SLA Assurance Measurement– Cybersecurity Analytics– Trading and Settlements– Route Optimization– Network Performance Analysis– Set-Top Box or NIU Usage & Performance Analysis– GIS/Spatial Analytics– Customer Behavior Analytics– Customer Acquisition, Churn, Lifetime Value Analysis– Customer Marketing and Segmentation– Click-Stream Analytics– Ad Hoc Reporting

10

Page 11: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

11

Inside the IBM PureData System for Analytics N2001Optimized

Hardware + Software

Hardware accelerated AMPPPurpose-built for high performance analyticsRequires no tuning

Snippet Blades ™

•Hardware-based query acceleration with FPGAsBlistering fast resultsComplex analytics executed as the data streams from disk

Disk EnclosuresUser data, mirror, swap partitions•High speed data streaming

SMP HostsSQL CompilerQuery PlanOptimizeAdmin

Page 12: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

IBM PureData Exceptional AdvantageThe Field Programmable Gate Array (FPGA)

A Real-Time silicon SQL accelerator

Dynamically reprogrammed for each individual query

Eradicates 90% of system I/O before the CPU ever sees it

Completely unique to Netezza

The FPGA eliminates the need for:•Unmaintainable Indexes•Complicated Partitions•Manual Compression Schemes•Inflexible Results Caching•Expensive Cubing•Complex Materialized Views

04/30/1312

Page 13: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

SimplifyMove analytics into the Data Warehouse

Integrate the server, storage, database and analytics into one optimized package

Move complex analytics into the database

Integrated, high performance analytics within the data warehouse

ServerServer

StorageStorage

DatabaseDatabase

AnalyticsAnalytics

Page 14: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Basic Math*

Permutation and Combination*

Greatest Common Divisor and Least Common Multiple*

Conversion of Values*

Exponential and Logarithm*

Gamma and Beta Functions ….etc .

Transformations MathematicalTime Series

Linear Regression+

Logistic Regression+

Classification

Bayesian

Sampling

Model Testing

Geospatial Data Type

Geometric Functions

Geometric Analysis

Predictive Geospatial

Data Profiling / Descriptive Statistics+

General Diagnostics

Statistics+

Sampling

Data prep

Pre-Built In-Database Analytics

Descriptive Statistics+

Distance Measures*

Hypothesis Testing*

Chi-Square & Contingency Tables*

Univariate & Multivariate Distributions+

Monte Carlo Simulation*

Autoregressive+

Forecasting*

Association Rules+

Clustering+

Feature Extraction+

Discriminant Analysis*

Data Mining

Statistics

Page 15: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Integrated by DesignIPDA In-Database Analytics

No data movement

Analyze deep and wide data

High performance, parallel computation

TransformationsTransformations

MathematicalMathematical

GeospatialGeospatial

PredictivePredictive

StatisticsStatistics

Time SeriesTime Series

Data MiningData Mining

050

100150200250

IBMNetezza

EMCGreenplum

Oracle Teradata

The MOST In-DatabaseAnaly c Func onsIn-Database

Analytics

Page 16: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

PureData System for Analytics

PureData for Analytics has two models N1001 – economical, high performance and scalability

N2001 – highest performance appliance to-date

PureData for Analytics continues to provide: Fastest Time to Value on the market today

Optimized Big Data analytics performance

Simple administration for fast and agile deployment

Accelerate analytic performance using large library of analytic functions

January 22Internal Announce

February 1Generally Available

February 5Public Announce

The new N2001 model addresses offers Increased performance

Better density• Data center efficiency

Scalability, Performance, Easy to Deploy and Maintain

Page 17: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Telecom

Other

Digital Media

Financial Services

Health & Life Sciences

Retail / Consumer Products

Clients -- Over 800+ and growing

Page 18: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation1818

Hive

Pig

MapReduceHDFS

HCatalog

Visualization

Development Tools

Let’s simplify Big Data …

Designed to… Simplify the building,

deploying and management of a Hadoop cluster

Speed the time-to-value for Hadoop and unstructured data

Maximize the overall analytic ecosystem

Provide enterprise security and platform management

From custom and complex

…To organized simplicity

DEPLOY8x

FASTER!1

DEPLOY8x

FASTER!1

1Based on IBM internal testing and customer feedback. "Custom built clusters" refer to clusters that are not professionally pre-built, pre-tested and optimized. Individual results may vary.

Page 19: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation1919

Announcing the new PureData System for Hadoop

Accelerate time to value Accelerate time to insight Simplify big data adoption and

consumption Extend the value of the data warehouse Implement enterprise class big data Minimize system setup and

administration

System for Hadoop

Page 20: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Agenda

Big Data is here

Why IPDA wins

How to work with IPDA

Partner Success Story - Zementis

Call to Action

Page 21: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

The Solution Validation Process

• Complete the ecosystem – over 150 current ISV’s; over 300 ISV certified products− Data Integration – ETL, Data Quality/Data Cleansing, MDM− Analytics – In-database analytics, ‘traditional analytics, data mining− BI/Reporting - reporting, visualization− Management tools - DR, replication

• Test and certify product Interoperability before customer implementation

− ISV’s “validate or certify” their products with the IBM Netezza appliance.

− IBM personnel can give technical support and help with best practices

− Proactively remove issues− Goal is for interoperability for the entire solution stack

Delight our joint customers with outstanding performance, low TCO, and rapid deployment

Page 22: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

“Ready For PureSystems”

22

Page 23: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Become a Member of IBM PartnerWorld

Execute the IPDA (Netezza) Solution Validation Attachment

Sign up for IBM Netezza Shared Partner Access ) Or – an emulator is available from developer works.)

Notify IBM when certification is complete. IBM will confirm.

Partner will be invited to join“Ready For Pure Data” andbe listed in the Pure SystemsCenter (Q2).

Next Steps

Page 24: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Some Examples

AB INITIO

Page 25: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Agenda

Big Data is here

Why IPDA wins

How to work with IPDA

Partner Success Story - Zementis

Call to Action

Page 26: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Case Study

Page 27: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation27

Software Products- ADAPAADAPA®® Decision Engine- Universal PMML Plug-inUniversal PMML Plug-in- ADAPA Add-in for Excel- ADAPA Control Center- PMML Converter- Transformations Generator

Consulting Services- Data Mining- Predictive Analytics- Statistical Data Analysis- Business Rules Development- Predictive Solutions, e.g.:

Credit Risk AssessmentCustomer PreferencesCredit Card FraudPredictive MaintenanceQuality ControlHealthcare Fraud/Abuse

San Diego and Hong Kong San Diego and Hong Kong

Operational Predictive Analytics Operational Predictive Analytics

Page 28: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Zementis - Operational Predictive AnalyticsGlobal Partners & Customers

Score Distribution1st Lien Stand-Alone Loans

0%

2%

4%

6%

8%

10%

12%

14%

50 100

150

200

250

300

350

400

450

500

550

600

650

700

750

800

850

900

950

1000

Score

% W

ithin

Cla

ss

GoodsBadsPoly. (Goods)Poly. (Bads)

% of Delinquent Loans per Month

0

10

20

30

40

50

60

70

80

90

Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov

Months

% o

f Del

inqu

ent L

oans

700750800850900950

28

Page 29: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Zementis & IBM Partnership

29

Model DeploymentModel Building

Statistics Modeler

Page 30: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Agenda

Big Data is here

Why IPDA wins

How to work with IPDA

Partner Success Story - Zementis

Call to Action

Page 31: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Common Factors for Success

YES: Applications that need large data warehouses ( at least 1TB)

Values simplicity, performance,

easy deployment and maintenance

Applications that need reporting,

analytics, geospatial applications

• Industries – FSI, Communications,

Digital Media, Retail, Healthcare, Utilities

SQL; ODBC; JDBC; OLE DB;

NO: OLTP

Unstructured data; no MDX

Singleton inserts, update, deletes

Page 32: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Summary

IPDA has a compelling value proposition for clients and ISV’s:• Simplicity and Performance!

ISV’s can sell into an established client base; utilize the leverage and scale of IBM; and minimize risk of deployment.

IPDA interoperability with other IBM software can increase pull –through (e.g. Cognos, SPSS, InfoSphere)

Strong foundation for client success

Page 33: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

33

Take the Next Step….

Discover the value and begin your journey with IBM PureSystems Visit ibm.com/puresystems to learn more

Join the conversation about this new category of computing:• Twitter: @IBM PureSystems

Hashtag: #IBMPureSystems or #expertintsys• YouTube Channel: expertintegratedsys• Blog: expertintegratedsystemsblog.com

Developers – Get started today with our no charge trial offerings!ibm.com/developerworks/puresystems/try

Explore PureSystem partner solutionsibm.com/puresystems/centre

Take a Test Driveibm.com/PureExperience

Page 34: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

Analytics without constraint

Big Data Meets Deep Analytics

Page 35: April, 2013 Leveraging IBM PureData for Analytics for ...public.dhe.ibm.com/software/dw/puresystems/tech...© 2012 IBM Corporation Leveraging IBM PureData for Analytics for Increased

© 2012 IBM Corporation

35

© International Business Machines Corporation 2012 International Business Machines Corporation New Orchard Road Armonk, NY 10504 IBM, the IBM logo, PureSystems, PureFlex, PureApplication, PureData and ibm.com are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. A current list of IBM trademarks is available on the Web at www.ibm.com/legal/copytrade.shtml All rights reserved. WAP12421-USEN-00

Thank You

Merci

GrazieGracias

Obrigado

Danke

Japanese

EnglishFrench

Russian

German

ItalianSpanish

Brazilian Portuguese

Arabic

Traditional Chinese

Simplified Chinese

Hindi

Tamil

Korean

Thai


Recommended