Real time Predictive Fraud Analytics using Databricks & Tableau
Prasad Kona Partner Solution Architect
2
Predictive Fraud Analytics
Payments Network
Database
Card Transaction
Data
Product Data
Location Data
Accounts
Contacts
RAW DATA LAKE
3
Predictive Fraud Analytics
Payments Network
Database
Card Transaction
Data
Product Data
Location Data
Accounts
Contacts
4
AI & Reporting
StreamingAnalytics
Business-level Aggregates
Filtered, CleanedAugmented
Raw Ingestion
The
Bronze Silver Gold
Quality
Delta Lake allows you to improve the quality of your data until it is ready for consumption.
warehouse
data lake
streams
nosql
5
Data Engineering using Delta
Payments Network
Database
Card Transaction
Data
Product DataLocation Data
SFDC AccountsSFDC Contacts
Card Transaction
Data
Product Data
Location Data
Accounts
Contacts
Raw Ingestion
Bronze
Filtered, Cleaned
Augmented
Silver
Business-level Aggregates
Gold
6
Data Engineering using Delta
Payments Network
Database
Customer 360 -Internal
Card Transaction
Data
Enriched - Card Transaction
Data
Product DataLocation Data
SFDC AccountsSFDC Contacts
Card Transaction
Data
Product Data
Location Data
Accounts
Contacts
Raw Ingestion
Bronze
Filtered, Cleaned
Augmented
Silver
Business-level Aggregates
Gold
7
Data Engineering using Delta
Payments Network
Database
Customer 360 -Internal
Customer 360
Card Transaction
Data
Enriched - Card Transaction
Data
Product DataLocation Data
SFDC AccountsSFDC Contacts
Predictions
ML
Card Transaction
Data
Product Data
Location Data
Accounts
Contacts
Raw Ingestion
Bronze
Filtered, Cleaned
Augmented
Silver
Business-level Aggregates
Gold
8
Machine Learning Lifecycle
Raw Data ETL
Train
Featurize
Score/ServeBatch + Realtime
Monitor Alert, Debug
Retrain
Update FeaturesProduction Logs
Customer 360 -Internal
Customer 360
Enriched - Card Transaction Data
Product DataLocation Data
SFDC AccountsSFDC Contacts
Predictions
Card Transaction Data
Build Model
Raw Ingestion
Bronze
Filtered, CleanedAugmented
Silver
Business-level Aggregates
Gold