+ All Categories
Home > Documents > Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon...

Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon...

Date post: 16-Oct-2020
Category:
Upload: others
View: 9 times
Download: 0 times
Share this document with a friend
17
Talend and Amazon Redshift May 2020
Transcript
Page 1: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

Talend and Amazon RedshiftMay 2020

Page 2: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

Turn raw datainto revenue

Innovate faster

Transform thecustomer experience

Dramatically reducecost and risk

TALEND INTRODUCTIONCloud Data Management Platform: Integration, Quality & Governance

Data Stewards

Data Architects/ Engineers

Integration Specialists

Analysts

Data Scientists

Citizen Integrators

Data Chaos

COLLECT GOVERN

SHARE TRANSFORM

A recognized Magic Quadrant Leader in Data Integration Tools and Data Quality

COMPLETE, COMPLIANT

AND TIMELY DATADATA LAKE | DATA WAREHOUSE | DATA PROCESSING | MIGRATIONS

Page 3: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

33

Demo Technical Reference Architecture

Best Practice Architecture for Cloud Data Warehousing

Source Systems

Stream Systems

Source to S3 S3 to Staged Staged to Curated Curated to BI

Files

Cloud Apps

Databases

Applications

Data QualityBulk Load

ELT/ETLMerge

STAGING CURATING

Amazon RedshiftData Quality

Bulk LoadELT/ETLMerge

STORING

Amazon S3

BI Layer

Extract & Load

Data PreparationData Stewardship

Data Governance

Data PreparationData Stewardship

Amazon Redshift

CURATED / AGGREGATEDSTAGEDRAW

Amazon QuickSight

Kafka

Amazon Kinesis

Page 4: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

Amazon Redshift components in Talend Studio

Page 5: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

55

Page 6: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

66

Page 7: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

ELT in Amazon Redshift with Talend Studio

Page 8: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

88

Page 9: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

99

ELT By The Numbers

Cloud Data Warehouse Test with ELT vs standard loading• 134m rows of data• 26 Gb• Jobs built in Talend Studio, run in Talend Cloud

• ELT: 23 seconds• Standard loading: >20 minutes

Your actual results may differ, however, it is clear that ELT loads data within a cloud data warehouse MUCH FASTER!

Page 10: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

Bulk Loading into Amazon Redshift with Talend Studio

Page 11: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

1111

Page 12: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

Amazon Redshift Cluster Management with Talend Studio

Page 13: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

1313

Page 14: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

Data Quality with Amazon Redshift with Data Preparation and Talend StudioDemonstration

Page 15: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

Demonstration

Page 16: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

Summary

Do you have Talend Studio?• Go use those components on current or past projects

• ELT, Bulk Loading, Cluster Management

Are you a Talend Cloud customer?• You have licenses for Data Preparation.

Go connect to Amazon Redshift today.

Are you new to Talend?• Go sign up for the Talend Cloud trial today.

Page 17: Talend and Amazon Redshift€¦ · Amazon Redshift CURATED / RAW STAGED AGGREGATED Amazon QuickSight Kafka Amazon Kinesis. Amazon Redshift components in Talend Studio. 5. 6. ELT in

Recommended