SAP Real-Time Data Platform

SAP Real-time Data Platform – nová strategická platforma SAP pre oblasť dátového manažmentu

Dušan Kachaňák Database&Technology Business Development, SAP CEE SAP Innovation Day, 18.10. 2012

SAP Real-time Data Platform Replication Server Power Designer Sybase IQ Summary


© 2012 SAP AG. All rights reserved. 4

New information sources driving data explosion

5B Mobile Phones in Use Smart phones

growing 20% y/y

30M networked sensors nodes growing 30% y/y

48 hours of video uploaded/minute

800M active users 30B pieces of

content shared/month Population of 7B

in 2011

Facebook


Today’s complex IT environment

ERP

DB

CRM

DB

Planning

DB

Other Apps

DB

EDW

DB

EDW

DB

EDW

DB

EDW

DM

DM

DM

DM

DM

DM

DM

DM


Complex IT environment and Trends

ERP

DB

CRM

DB

Planning

DB

Other Apps

DB

EDW

DB

EDW

DB

EDW

DB

EDW

DM

DM

DM

DM

DM

DM

DM

DM

Social Analytics Mobile Big Data Cloud


SAP data management vision Protect current and extend customers’ future needs

SAP Real-time Data Platform Extreme capabilities to

transact | move | store | process | analyze

Social Analytics Mobile Big Data Cloud


The future of database technology

In-m

emor

y C

ompu

ting

Adop

tion

Trad

ition

al D

atab

ase

Adop

tion

Time

2012 – Cost per Terabyte Disk Memory

$60 $4,900

1990 – Cost per Terabyte Disk Memory

$9,000,000 $106,000,000

Typical access speeds Disk Memory Speed

(13ms) 13,000,000 ns 10 ns

1,300,000

Falling prices move processing from Disk/SSD to In-Memory


Guiding principles SAP’s current innovative data assets

SAP Real-time Data Platform

SAP HANA

SAP Sybase SQL Anywhere

#1 Mobile and Embedded

Database

#1 Transactional Database with

Best TCO

SAP Sybase ASE SAP Sybase IQ

#1 Analytics Database with

Best TCO

Sybase ESP, Replication Server,

PowerDesigner, + SAP EIM

#1 Unified EIM platform for

Real-Time

Open for Partners


SAP Real-Time Data Platform – Conceptual View

Open Developer API’s and Protocols

SAP Analytics

SAP Business Suite

Com

mon Landscape

Admin &

Managem

ent SAP Big Data Applications 3rd Party

BI Clients

SAP Mobile

SAP Smart Data Services

Replication Data Services

SAP HANA Platform

SAP MDG, MDM, DQ


Big Data Transactional

Distributed

Streaming

SAP NetWeaver (On Premise / Cloud)

Com

mon

Mod

elin

g Sy

base

Pow

erD

esig

ner

HAD

OO

P N

oSQL M

PP

Scal

e-O

ut

Custom Apps


SAP Real-Time Data Platform Architected by SAP Sybase PowerDesigner


SAP Analytics

SAP Business

Suite

Com

mon

Lan

dsca

pe M

anag

emen

t

SAP Big Data Applications

3rd Party BI Clients

SAP Mobile

SAP Solutions for EIM

SAP Data Services

SAP HANA Platform

SAP MDG and MDM


SAP Sybase IQ SAP Sybase ASE

SAP Sybase SQLA

SAP Sybase ESP


Com

mon

Mod

elin

g Sy

base

Pow

erD

esig

ner

HA

DO

OP

N

oSQ

L

MPP

Sc

ale-

Out

Custom

Apps

SAP Business Warehouse

SAP Sybase Replication Server





SAP Analytics

SAP Business

Suite

Com

mon

Lan

dsca

pe M

anag

emen

t



SAP Mobile


SAP Data Services

SAP HANA Platform

SAP MDG and MDM



SAP Sybase SQLA

SAP Sybase ESP


Com

mon

Mod

elin

g Sy

base

Pow

erD

esig

ner

HA

DO

OP

N

oSQ

L

MPP

Sc

ale-

Out

Custom

Apps




Replication: What are we talking about?

Making replicas (copies) of data Two types of data replication:

Storage (disk block) Replication Database (transaction) Replication

Sybase sells database replication, based on changes

Sybase Replication is widely considered to be “best-

in-breed”

Storage Array Database


1. Client application updates data on primary DBMS server 2. Primary DBMS server records updates in transaction log 3. Rep Agent reads primary log; delivers updates to Rep Server 4. Rep Server propagates committed transactions to other sites 5. Rep Server manages database connections/network routes 6. Direct Connect component needed for heterogeneous targets

SYBASE REPLICATION ARCHITECTURE

Access data sources • Sybase ASE • Sybase SQL Anywhere • Oracle • Microsoft SQL Server • IBM UDB DB2 and DB2

mainframe

• ASE • SQL Anywhere • Sybase IQ • HANA

• Oracle • Microsoft • DB2

Replication Agent for Heterogeneous Sources

Direct Connect for Heterogeneous Targets

Real-time Events for Message Buses

• IBM MQ • TIBCO RV • JMS

1

Primary Site 2

Sybase Replication

Remote/ Secondary Sites

3 WAN

4

5

6

NOTE: Rep Agent & Direct Connect not required when connecting to

Sybase sources/targets

Sybase Products


Sybase Replication Use case Scenarios

Real-Time Data Movement

Data Distribution

Real Time Decision Support

Disaster Recovery and HA


DB Rep Server

Sybase Replication Replication and Live Decision Support

Platform and Vendor Independent

No Performance Penalty

Real Time

*HANA Support on Roadmap

Target Database Fully Usable

Application Database ODS or Data Mart

DB Rep Server


Sybase Replication - Data Distribution

Zagreb (sales department)

London (order processing)

London (finance department)

Chennai (manufacturing department)

Continuous replication of changed data

One source to many targets Guaranteed delivery. Publish and

subscribe architecture Propagate order info to related

downstream applications Can also have bi-directional

scenarios Can also have many – one and

many – many topologies

One example, many permutations

Order Entry Application

ASE Rep Server

Rep Option for Microsoft

Sales Support Application

Financial Reporting Application

Rep Option for Oracle

Rep Option for IBM

Manufacturing Planning Application

WAN

WAN

LAN


Sybase Replication - High Availability, Disaster Recovery

Minimize/eliminate user impact Protect against unplanned outages Software, hardware, application failure Unforeseen circumstances like data

corruption Protect against planned outages Software, hardware, application upgrades Enable ops to perform maintenance

activities Recover from natural disaster Without geographic restrictions

Philadelphia Operations

Denver Operations

Warm Standby

PRIMARY DATACENTER

ASE Replication

Server

SECONDARY DATACENTER

ASE Replication

Server

OFF LINE


Recognized as a leading replication product by major industry analyst firms: Gartner and Forrester

Leading product

3,000+ customers worldwide including ASE replication and heterogeneous database replication

Widely proven

Innovative and patented techniques to dramatically improve replication performance and reduce latency

Strength in performance

More than 170 new customers added in 2011 Adoption strength

Recognized as innovation leader with 10+ issued and pending patents and some key releases in the last 18 months

Innovation

Replication Server Fast Facts





SAP Analytics

SAP Business

Suite

Com

mon

Lan

dsca

pe M

anag

emen

t



SAP Mobile



SAP Data Services

SAP HANA Platform

SAP MDG and MDM



SAP Sybase SQLA

SAP Sybase ESP


Com

mon

Mod

elin

g Sy

base

Pow

erD

esig

ner

HA

DO

OP

N

oSQ

L

MPP

Sc

ale-

Out

Custom

Apps



Capture Design Communicate

Define current environment Document Existing Systems

Describe the interaction Model business & technical artifacts with related metadata

SAP Sybase PowerDesigner

Design & plan for future “As-is” and “to-be” modeling

Streamline implementation Generate Change

Integrate all aspects Tie business & technical viewpoints across the enterprise

Realize impact of change Graphical, bi-directional understanding from architecture to execution

Collaborate Central repository to communicate, report and share


Enterprise Modeling

Glossary: Unified

Business Language

Aligned Business & Technical Modeling

SAP Sybase PowerDesigner

Application & Technology Modeling

Architecture Impact Analysis

Fully Integrated

Business and Technology

Models

Design, manage and build the enterprise through architecture


Modeling and Design Solutions

Key Use Cases Organizations Solving Information Problems MDM, Analytics/BI, Data

Quality, Integration

Organizations Preparing for Business Transformation

Differentiators Full Spectrum Solution Link & Sync technology Open & Heterogeneous Enterprise Scalability


Modeling Tools Market Competitive Landscape

RDMS Developers

DBAs

Business Analysts

Enterprise Architects

Information Architects

Data Architects

Data Analysts

Business Architecture

Technical Design

Development Maintenance

CA ERwin

Embarcadero IBM (IDA) Oracle Designer Open Source

PowerDesigner

Types of Modelers Traditional EA Tools

Technical Architecture

Competitive Positioning of PowerDesigner Against DM, IA and EA tools


SAP Sybase PowerDesigner Product road map overview – key themes and capabilities

Planned Innovations Future Direction

This is the current state of planning and may be changed by SAP at any time.

TODAY Enterprise Architecture Role-based User Interface Repository-based Impact

Analysis & Library Models Project Branch Management New Quick Search

Information as an Asset Central Business Glossary Repository Portal Composer Extended “Link and Sync”

SAP RTDP Support SAP HANA Support SAP Sybase IQ Reference

Architecture Wizard SAP Sybase Replication

Server Architecture Support

MID-TERM Streamline Workflow Workflow Management SAP Solution Manager

(Lifecycle Management) BPMN XML Serialization

(Modeling Workflow & Process) SAP NetWeaver BPM

SAP RTDP Integration SAP-BO Universe Support SAP HANA API Integration SAP Data Services Support

Planning for Analytics XML Modeling Renovation

(Messaging, Canonical) WYSIWYG Reporting (Charts) Open XML Import (ANY XML)

FUTURE INNOVATION SAP Modeling Framework Modeling Framework for All

SAP Modelers (Design & Dev.) Full Web Interface (HTML 5) Eclipse-based Developer UI Windows/Mobile/Other UI

Unified SAP EIM & RTDP All Data Movement (Gen/Rev) All BI Reporting (Gen/Rev) SAP Data Services Integration SAP Information Steward SAP MDM & MDG Integration

Transformation Planning SAP NetWeaver BPM Business & IT planning

focused modeling & reporting

Current





SAP Analytics

SAP Business

Suite

Com

mon

Lan

dsca

pe M

anag

emen

t



SAP Mobile


SAP Data Services

SAP HANA Platform

SAP MDG and MDM



SAP Sybase SQLA

SAP Sybase ESP


Com

mon

Mod

elin

g Sy

base

Pow

erD

esig

ner

HA

DO

OP

N

oSQ

L

MPP

Sc

ale-

Out

Custom

Apps




What is Sybase IQ?

Sybase IQ is a market leading, high-speed columnar analytics server and data warehouse which is designed specifically for Data Analytics

• Columnar Database designed for high speed analytics

• Eliminates the problems caused by traditional row-based systems

Designed for Analytics

• Up to 1,000X faster than row-based systems

• Enables high speed performance of complex queries against large datasets

Unsurpassed Performance

• Reduce the need for aggregates and indexes

• Greatly decreased ongoing maintenance costs when compared with row-based systems

Lowest TCO

All Data Sources Large Data Volumes Single Data Warehouse Rapid Analytics


Column-Based Architecture

Query: How many MALES buy INSURANCE in OH?

800 Bytes/Row

Gender M M F M M -

10M ROWS

State NY TX CT OH IL VA

Row-based RDBMS Insurance

Y Y N Y N

10M Rows x 800 Bytes 4KB Page = 2,000,000 I/Os

Process large amounts of unused data

Often requires full table scan or space-intensive indexes and materialized views

M Y VA M N OH F Y NY M N OH

Gender Insured State

+ + 1 1 0 1

1 1 0 1

10M Bits

10M Bits x 3 column 512KB Page = 63 I/Os Column-based Sybase IQ

0 1 0 1

10M ROWS

Dramatically Reduced Disk ‘Hits’= Faster Query Results


SAP Sybase IQ Compression

LOAD

LOAD

Base table: 0.2 - 0.5 TB

Indexes: 0.05 - 0.3 TB

Aggr/Summ: 0 - 0.1 TB

Summaries Aggregates

1 - 2 TB

Indexes 0.5 - 3 TB

Base table “RAW data” no indexes

0.9 - 1.1 TB

2.4-6 TB

Conventional DBMS

Same INPUT Data: “Conventional DW” is 3x-6x larger than Sybase IQ DW

0.25 - 0.9 TB

This image cannot currently be displayed.

INPUT DATA:

1 TB Source: flat files,

ETL, replication,ODS

Managing large amounts of detailed data


SAP Sybase IQ is the leader in deployments

Sybase has more customers than all of the other specialty EDW leaders combined

Teradata

Oracle Exadata

IBM Netezza

EMC Greenplum

-

500

1 000

1 500

2 000

Others Sybase

Num

ber o

f cus

tom

ers

* Based on industry analyst and vendor statements about number of customers

* Vendors selected for ‘Others’ category based on i) ‘leadership’ position in Gartner MQ, ii) having a specialty Data Warehousing offering (i.e. General purpose databases are excluded)


But now also part of best of breed stack...

Operational

Now — A Complete Best of Breed Stack (after acquisition)


SAP HANA

Coinstar/Redbox Information Management Architecture

SQl Server

Source 2

Source 3

Source 4

Redbox .com

Kiosh

SAP Sybase IQ Enterprise Data

Warehouse

Data Sources Data Analytics DW

SAP Business Objects 4.0

SQ

L

MD

X

BIC

S

1 TB Compressed data (2-3 Raw data) “Near”-real time data storage Ad-hoc analytics Data structure modeling Modeling analytical views

Near-Line storage of historical data 3 TB (6-7 TB of raw Accessible any time from HANA platform as

needed

Data Modeling

SAP Data Services

Real Time Replication

SQ

L


SAP Sybase IQ

Strong, established, fast-growing customer base Patented data compression dramatically reduces data storage requirement; cuts TCO Only column-based solution to full text search, in-database analytics, and federated analytics Leader, Gartner Magic Quadrant for Data Warehouse DBMS Provides answers 10 – 1000X faster

http://www.itg.com/index.php



1

2

3

SAP guiding principles Data innovation without customer disruption

Innovation and expertise to benefit our customers and leapfrog the market

Protect and extend customer investments

Massive investment in data management technology

Customer Benefit: Increased results and lower risks


Innovation Pillars – SAP’s Market Categories

solutions analytics

applications

cloud

RDS

industries

LoB

s

Ďakujem za pozornosť!

Kontakt: Dušan Kachaňák [email protected]

Date post:	24-May-2015
Category:	Documents
Upload:	sap
View:	703 times
Download:	5 times

SAP Real-Time Data Platform

Documents