Qlik Data Integration

Sunil Mistry, Solution ArchitectureData Integration, Qlik

2

Qlik’s 3rd Generation BI Vision

Democratization

of Data

All data, governed, and

universally accessible

Augmented

Intelligence

Raising Data Literacy

through technology

Embedded

Everywhere

From the edge

to the C-Suite

Enterprise-Class Technology

Hybrid, multi-cloud, and edge continuum

3

Qlik’s 3rd Generation BI Vision

Democratization

of Data

All data, governed, and

universally accessibleQlik Data Catalyst®

Attunity®

A Division of Qlik

4

Qlik’s 3rd Generation BI Vision

Democratization

of Data

All data, governed, and

universally accessibleQlik Data Catalyst®

Attunity®

A Division of Qlik

• From raw to analytics-ready, faster

• Accessible and actionable

• Reuse & collaborate, securely

Qlik Sense®

6

DataOps CatalogProfiling, Lineage,

Governance, Collaboration,

and Provisioning

Change Data CaptureReal-time streaming, replication,

Efficient Cloud Delivery

Data Warehouse AutomationETL generation, Self-Service Marts,

Cloud Optimization Data PreparationEnrichment, transformation,

protection of derivative

datasets

Data Lake PipelinesOrchestration and automation

Analytics-Ready Datasets

Qlik Data Integration Platform

• DataOps for Analytics

Qlik Data

Catalyst

Attunity(Qlik)

7

Shifting Data Architectures

$205B by 2020Cloud & Multi-cloudOn Premises

2X DATA Every 2 YearsCloud Warehouses

+ Data LakesData Warehouse

82%Adopting Real-TimeStreamingBatch

Sources: WW Public IT Cloud Services Revenue in 2020, IDC. The Digital Universe of Opportunities, IDC. Cloudview Survey, IDC.

8

Growing Demands

Automated, Agile

Data Delivery

Governed,

Enterprise-Ready

Data

Real-Time Data

SPEED SKILLS TRUST

11

Continuous Delivery & Refinement

MAINFRAME

SAP

Other…

Databases

PaaS DB

DatabaseReplication

Data Warehouse Automation

SAAS

APPS

FILES

DATA WAREHOUSE

RDBMS

StreamingData PipelineAutomation

Design & Manage

Generate Deliver Refine

change stream

to cloud, lakes

for analyticuse

Data Lake Automation

Other…

Data Warehouses

AzureSQL DW

Redshift

Other…

Cloud & Data Lakes

12

Database Replication

Enterprise-wide Data

Replication &

Distribution for

Multiple Analytics Use

Cases

Mainframe to Oracle

Data Consolidation for

Customer 360 Initiative

Oracle Transaction

Streaming and for

Multi-Channel

Customer

Engagement

Features

• Agentless, real-time data capture and

delivery

• Automated target table creation,

instantiation and mappings

• Supports RDBMS, file systems and

streaming targets, on-premise & Cloud

Benefits

• Ensures consistency and ease of use

across all major platforms (sources and

targets)

• No impact to production systems

• Easy to manage, automated, low TCO

13

Data Warehouse Automation

SQL Server Data

Warehouse

Automation Cut ETL

scripting time 96%,

accelerated change

process 6x

High-Scale, Multi-

sourced Data

Consolidation into

Azure Data Lake and

Azure SQL DW

Real-Time

Consolidation from

SAP, Oracle to

Snowflake for DW

Modernization

Features

• Automates Data Model/Data

Warehouse design, build, maintenance

and documentation

• Automated table creation, instantiation

and mappings

• Continuous, real-time data replication

Benefits

• Reduce risk, save time and money

– no scripting or coding required

• DW now built in hours, changed in

minutes

• Future-proof for new requirements and

new platforms

14

Data Lake Automation

Mainframe Data

Streaming and

Refinement for

Microservices

Enablement

Data Lake

Consolidation for

Marketing/Sales

Analytics and

Engagement

Multi-sourced Data

Integration and

Refinement for

Operational Analytics

Features

• Automates creation of tables, organizes

data structures and tracks lineage to

deliver a Managed Data Lake

• Instantiates data, maps source and

target, keeps schemas in sync

• Continuous, real-time data replication

Benefits

• Quickly and easily create high-scale

data pipelines

• Eliminate risky, expensive and complex

custom coding

• Close the “last mile” by provisioning

analytics-ready data in real-time

16

Qlik Data Catalyst Benefits

DATA ENGINEER

Brings new assets into the

data catalog

• Quickly add new datasets

• Understand the exact

content and condition of

onboarded data

• Easily filter, transform or

combine incoming data

DATA STEWARD

Makes sure naming conventions

and security standards are enforced

• Improve consumer‘s ability to

find the right dataset

• Systematically enforce and

monitor data policies and usage

• Ensure sensitive or personal

data is automatically masked

DATA CONSUMER

Find and utilize the data they

need to gain new insights

• Eliminate reliance on data

experts or IT

• Reuse and build on previously

created assets

• Easily export, share or

automatically publish data sets

17

Qlik Data Catalyst

Features

• Smart, Integrated Data Catalog of all

technical, operational & business metadata

• Data access and obfuscation capabilities to

guarantee that data is always protected

and secure

• Shop for Data with role-based security

• Quickly publish data to Qlik Sense, other BI

tools, and cloud storage platforms

Benefits

• Improved data literacy as users can find,

understand and generate insights faster

• Removes potential failure points, tightens

security, and reduces risk

• Removes the IT bottleneck through a

governed, self-service approach

• Reduced data onboarding from 8 weeks to as little as 2 hours

• Cost to onboard data 90% less vs. conventional ETL

• Cost of Environment 30x cheaper than least expensive RDBMS alternative

• Able to utilize cloud storage by carefully tracking and labeling PII data

19

DataOps for Analytics

17

AUTOMATE

REFINEMENTCONTINUOUS

DELIVERY

CATALOG

& GOVERN

1 Real Time Data for

Faster, Better Insights 2 Agile Data Delivery 3 Trusted, Enterprise

Ready Data

Qlik Data Catalyst®Attunity Replicate® Attunity Compose®

24

Qlik Data Integration – Guiding Principles

Independent Real-TimeUniversal

Agile &

AutomatedSelf-ServiceGoverned

25

Next Step

Read the Attunity and

Gartner report:

“Enabling DataOps

for Analytics”

@ www.qlik.com