+ All Categories
Home > Documents > Accelerate Data Loading for Big Data Analytics...Enabling Live Reporting on NonStop Data 20 HP...

Accelerate Data Loading for Big Data Analytics...Enabling Live Reporting on NonStop Data 20 HP...

Date post: 20-May-2020
Category:
Upload: others
View: 6 times
Download: 0 times
Share this document with a friend
33
Attunity Click-2-Load for HP Vertica Accelerate Data Loading for Big Data Analytics Menachem Brouk, Regional Director - EMEA
Transcript

Attunity Click-2-Load for HP Vertica

Accelerate Data Loading for Big Data Analytics

Menachem Brouk, Regional Director - EMEA

Agenda

» Attunity update

» Solutions for :

1. Big Data Analytics

2. Live Reporting

3. Migration

4. Modernization

5. Mobile Integration

» Summary, Q&A,

2

3

Real-time information availability where & when needed

Focused on data and content, databases and files

For enterprise, big data, and cloud environments

Our Mission

Make Data Available Where and When Needed improving Business Intelligence, Operations & Processes

Global NASDAQ:ATTU 120+ Employees

2000+ Customers

Financial Services

Trusted by leading companies worldwide and half of the Fortune 100

Manufacturing / Industrials Government Health Care

Technology / Telecommunications Other Industries

4

Go-to-Market Partners

Partner of Choice to Technology Leaders

Strategic Partners

OEM Partners

Technology Partners

System Integrator & Consulting Partners

Trusted by leading global partners

5

» Working with HP since the 90’s

» Supports data on all HP platforms (BCS + ISS)

» CI Ready

» System Integration & Distribution Agreement with HP

» Focused on growth areas such as Big Data (HP HAVEn/Vertica)

Attunity is a Strategic HP Partner

6

Agenda

» Attunity update

» Solutions for :

1. Big Data Analytics

2. Live Reporting

3. Migration

4. Modernization

5. Mobile Integration

» Summary, Q&A,

8

STRUCTURED SEMI-STRUCTURED UNSTRUCTURED

Any Data Any Time Any Where

High Performance Lower Total Cost Quick Time to Value

Delivering Data for Big Data Analytics

WHERE DATA RESIDES

9

C-Level / Management

Line of Business

Analyst

Data Warehouse

BI/Analytics Server

Hadoop / HDFS

Cloud

WHERE DATA NEEDS TO BE

ANALYTICS VALUE BIG DATA

CRM

ERP

Content Management

Web Logs

HR Systems

Example Sources

APPLICATIONS

Sensors

OTHER

AND MORE…

Application Integration

Common Pains with Traditional ETL

Takes too long

Costs too much

Lack of developer resources

Not real-time

Hard to maintain

Accelerate Data Loading

Quick setup with end-to-end automation

Fast loading with optimized integration

High throughput with Turbo-Stream CDC

The Better Way To Get Data Into HP Vertica

Data Value

Fast. Easy. Optimized.

More Data

Less Time

Less Cost

• Easy, no development, no complexity

• Fully automated, end to end

• Fast, high performance integration

• Real-time CDC

• Significantly lower cost

Attunity Click-2-Load for HP Vertica

Monitoring and Control. Complete Confidence at a Glance.

Turbo-Stream CDC and Optimizations for loading HP Vertica High performance, low-latency, low-impact, and scalability

Zero Footprint Architecture. Nothing to install on source database server for Oracle and SQL Server

Click-2-Load. Drag. Drop. Done.

Complete, Heterogeneous Data Loading/Replication. Automating Schema Generation, Full Load, and Change Data Capture (CDC)

14

Attunity Click-2-Load for HP Vertica

15

Web-based Designer and Management Console

Replication Server

In Memory Stream Processing

Persistent Store

Source Database

Transaction Log

Data / Metadata

Data / Metadata

CDC

Bulk Loader

Stream Loader

Bulk Reader Transform

Filter

HP Vertica Optimized Integration • Oracle

• SQL Server • DB2 • DB2 for iSeries • DB2 for z/OS • Sybase • HP NonStop SQL • ODBC

Attunity Click-2-Load for HP Vertica TurboStream CDC

16

In Memory Stream Processing

TurboStream CDC

Transactional CDC Transactions applied in real-time, in order

High-Volume CDC

Staging Table

Vertica Database

CDC SQL ‘COPY

LOCAL’

CDC

SQL n 2 1

SQL SQL

Consolidation of change records to minimize transactions applied to target

R1 R1 R2 R1 R2

R1 R2

Batch tuning

17

Click-2-Load with end-to-end Automation

18

Agenda

» Attunity update

» Solutions for :

1. Big Data Analytics

2. Live Reporting

3. Migration

4. Modernization

5. Mobile Integration

» Summary, Q&A,

19

Enabling Live Reporting on NonStop Data

20

HP NonStop SQL Server (or other RDBMS)

Direct, SQL-based real-time access

Replicate a sub-set of data for query offloading

Virtual views, joining data across sources

NonStop SQL

Enscribe

SQL Server

Oracle

Excel, Crystal Reports, Business Objects, Cognos, Tableau, JasperSoft, QlikView, …

SQL/MP Enscribe

Hundreds of files & tables

Attunity ODBC

Direct SQL access

Federated views

HP NonStop Itanium

Customer: Nebraska Medical Center Live Reporting with HP NonStop Data

22

Agenda

» Attunity update

» Solutions for :

1. Big Data Analytics

2. Live Reporting

3. Migration

4. Modernization

5. Mobile Integration

» Summary , Q&A

23

Migration Solutions for HP NonStop

24

HP NonStop

Migrate RMS, Rdb, Oracle

Migrate VSAM, IMS, DB2

Agenda

» Attunity update

» Solutions for HP NonStop:

1. Big Data Analytics

2. Live Reporting

3. Migration

4. Modernization

5. Mobile Integration

» Summary , Q&A

25

Enable Modernization and SOA Extend across technologies and platforms

26

SQL/MP

HP NonStop

Enscribe

OSS

Guardian

Pathway Services

Windows, UNIX, Linux

Develop new apps in OSS using Java, C++ Enable 3rd party apps to run on OSS

Build composite apps in modern dev tools Integrate NonStop using modern SOA & EDA tools

Java .NET 3GL

Java 3GL

ESB BPM

Web Services

SOA

Make NonStop data accessible via SQL & XML Wrap Pathway as reusable services

Universal Connectivity

Comprehensive NonStop Connectivity Single install. Single design tool. Flexible licensing.

Attunity Enscribe SQL/MP SQL/MX with

MP tables SQL CLIENTS: Client Platforms ODBC - 32bit Windows + + +

Linux + + + Solaris + + + IBM AIX + + + HP-UX (RISC) + + + HP-UX (Integrity) + + +

ODBC - 64bit Windows + + + Linux + + + Solaris + + + IBM AIX + + + HP-UX (RISC) + + + HP-UX (Integrity) + + +

JDBC Linux/UNIX/Win + + +

HP NonStop - OSS + + +

ADO.NET Windows + + +

OLEDB Windows + + +

PLUS: XML Data Services + + + Data Federation On Platform + + + Data Federation Cross Platform + + + 29

Customer: US Foods Build SOA across HP Nonstop and IBM Mainframe

SQL/MP Enscribe

HP NonStop

Direct SQL access

Federated views

DB2 VSAM

IBM Mainframe

Direct SQL access

Federated views

Virtual SOA layer Common and uniform access

Customer: Shenzhen Stock Exchange Modernize trading applications with .NET & Java

HP NonStop

Enscribe

Guardian

Windows

VB.NET

JDBC ADO.NET

Enscribe Enscribe (stock data)

Secure, encrypted communications

Hierarchical metadata Native connectivity

Relational schema SQL data access

Java Apps

» Improve broker & investor productivity with modern apps

» Rapid development while data is reliably managed on NonStop

31

Agenda

» Attunity update

» Solutions for :

1. Big Data Analytics

2. Live Reporting

3. Migration

4. Modernization

5. Mobile Integration

» Summary, Q&A,

33

Enable Mobile Apps and Integration Leverage middleware to enable seamless access

34

SQL/MP

HP NonStop (Guardian)

Enscribe Pathway Services

Windows, UNIX, Linux Build applications that service mobile applications (native or web)

Java .NET

Web Services

Make NonStop data accessible via SQL & XML Wrap Pathway as reusable services

Universal Connectivity

OSS

Java

Agenda

» Attunity update

» Solutions for :

1. Big Data Analytics

2. Live Reporting

3. Migration

4. Modernization

5. Mobile Integration

» Summary, Q&A,

35

Attunity & HP = Great Partnership

» Trusted Partner and Solution

» HP Partner for many years, with reseller agreement in place

» Used by many NonStop customers (e.g. US Foods, Raymond James)

» Global, NASDAQ traded, 120 people, 2000 customers worldwide

» Enable many solutions customers are looking for:

» Big Data Analytics

» Live Reporting

» Migration

» Modernization

» Mobile Integration

36

Thank You


Recommended