Welcome
Automated Data Source Creation using Tableau SDK & Rest API
# T C 1 8
Sham Reddy
Solution Architect (BI & Data)
TriNet Group Inc.
Ram Mutupuru
Solution Architect (BI & Data)
TriNet Group Inc.
24th Oct 2018 | 12:00 PM – 1:00 PM | MCCNO - L2 - 297
Agenda
• Introduction
• Background
• DEMO
• Q&A
About Our Industry
* This information compiled from NAPEO and PEO websites to help explain what advantages a PEO brings to a business
Professional employer organizations
(PEOs) provide comprehensive HR solutions to
small and mid-sized businesses across the
country, including payroll, benefits, HR, tax
administration, and regulatory compliance
assistance
Through the scale of TriNet, employees of small
businesses gain access to a big company
employee experience, including: 401(k)plans;
health, dental, life, and other insurance; a mobile
app; and other benefits they might not typically
receive as employees of a small company.
Introduction - TriNet
* This information compiled from NAPEO and PEO websites to help explain what advantages a PEO brings to a business
TriNet Group Inc. is a leading PEO
organization supporting 16K clients with over
350K active WSE’s.
We are headquartered in Dublin, California.
Sources
HR
Finance
CRM
Telephony
Other Apps
ITSM Apps
Others
Data Warehouse
TriNet
Colleagues
Reporting
Stage EDWDashboards &
Reports
Oracle DB Platform Cognos
ODI ODI & PL-SQL
Nightly batch load
Legacy BI & reporting landscape
Today’s businesses are evolving fast & constantly changing. Our business demands are
many in area of data & analytics.
Some of the key requirements are -
Near Real Time
Data Level Security
Rich Visualization
Report Search
Share, Subscribe &
ScheduleImproved Query
Performance
Faster response
time (5-15 sec)
Row Level Security
Column Level
Security
Ad hoc Reporting
Cross Functional
Reporting
Enterprise
Scalability
Enterprise
Scalability
Favorites
User
Personalization
Data Snapshots
Historical Trend &
Audit Reporting
Attribute Groups
Global Filters &
Variables
Slowly Changing
Dimensions
Point in Time
Time Series
(YTD, MTD, QTD)
Usage Tracking
User Defined
Calculated fields
Metadata
Management
Ease of Use
Problem Statement
Data (Backend) Reporting & Collaboration (Front End)
TriNet
Colleagues
Finance
CRM
Telephony
Other Apps
Meta
data
Rep
osi
tory
ITSM Apps
Others
Dashboards
Analytical
Reports
Documents
Dashboards
Pre
sen
tatio
n L
aye
r
Reporting & Analytics
Data
So
urc
es
Customer App
Data
So
urc
es
TIGER
Tab
leau
AP
I’s
Near Real Time
LogicalDimensions (Type1 & Type2)
Facts
Snapshots
Core LayerPersistent
Stage
HR
FS
CRM
Telephony
Others
Oracle DB Platform
PL/SQL
Informatica
Informatica
Golden Gate
Tiger Portal & Tableau
Data Warehouse
Customers
Sources
HR
Current Landscape
Near Real Time
Data Level Security
Improved Query
Performance
Enterprise
Scalability
Data Snapshots
Slowly Changing
Dimensions
Rich Visualization
Report Search
Share, Subscribe &
Schedule
Faster response
time
Row Level Security
Column Level
Security
Ad hoc Reporting
Cross Functional
Reporting
Enterprise
Scalability
Favorites
User
Personalization
Historical Trend &
Audit Reporting
Attribute Groups
Global Filters &
Variables
Point in Time
Time Series
(YTD, MTD, QTD)
Usage Tracking
User Defined
Calculated fields
Metadata
Management
Ease of Use
Data (Backend)
Reporting & Collaboration (Frontend)
Solution meets following business
needs –
TriNet
Colleagues
Finance
CRM
Telephony
Other Apps
Meta
data
Rep
osi
tory
ITSM Apps
Others
Dashboards
Analytical
Reports
Documents
Dashboards
Pre
sen
tatio
n L
aye
r
Reporting & Analytics
Data
So
urc
es
Customer App
Data
So
urc
es
TIGER
Tab
leau
AP
I’s
Near Real Time
LogicalDimensions (Type1 & Type2)
Facts
Snapshots
Core LayerPersistent
Stage
HR
FS
CRM
Telephony
Others
Oracle DB Plaform
Informatica
Golden Gate
Tiger Portal & Tableau
Data Warehouse
Customers
Sources
HR
PL/SQL
Informatica
Current Landscape
Near Real Time
Data Level Security
Improved Query
Performance
Enterprise
Scalability
Data Snapshots
Slowly Changing
Dimensions
Rich Visualization
Report Search
Share, Subscribe &
Schedule
Faster response
time
Row Level Security
Column Level
Security
Ad hoc Reporting
Cross Functional
Reporting
Enterprise
Scalability
Favorites
User
Personalization
Historical Trend &
Audit Reporting
Attribute Groups
Global Filters &
Variables
Point in Time
Time Series
(YTD, MTD, QTD)
Usage Tracking
User Defined
Calculated fields
Metadata
Management
Ease of Use
Data (Backend)
Reporting & Collaboration (Frontend)
Solution meets following business
needs –
DB Platforms
EDW(Oracle)
Portal Java Services
Query
Preparation
Query
Generation
Data
Transformations
Additional Services
Mongo DB
Object
Repo
Entitlement
Service
Metadata API’sAttribute
Selector
Tableau
Visualization
Data Source
Metadata
Repository(Oracle)
AP
I G
ate
way
Presentation
Model
Tableau Rest
API’s
Redis
Portal Framework
Faster response
time
Row Level Security
Column Level
Security
Ad hoc Reporting
Cross Functional
ReportingAttribute Groups
Global Filters &
Variables
Time Series
(YTD, MTD, QTD)
Ease of Use
Solution meets following business
needs –
• Centralized enterprise presentation layer of all data subject areas with a user friendly
layout
• Supportability to cross functional reporting
• Row level security based on various data policies
• Column level security & Data masking for PII columns
• Supportability for different query patterns such as UNION, Analytical functions,
Timeseries (YTD, QTD, MTD) etc.,
• Dynamic Measures/Attribute groups for grouping multiple attributes and perform auto
PIVOT
• Optimal query generation
• Usage of global/recommended filters based on data subject area
• Data dictionary such as definition, description for all presentation fields
Tiger Portal - Presentation Model
Demo
Note: Data shown in the video’s is random mock-up data
TIGER
Tableau
Extract or
Live
Connection
Using TableauSDK module
generate the .tde/.hyper fileExtract
Lookup MongoDB metadata to
Identify the Personal Project
name for the User Logged
Lookup Tableau to get the
Project LUID based on the
Project Name using Query
Projects REST API
Python
Project
Exists
Publish the Data source
into the User folder by
calling “Publish Data
Source” REST API
Yes
Create User Personal
Project by calling
“Create Project” REST
API
No
Using Sample.tds file,
replace the SQL query
and create a new .tds
file
Portal executes the
query & passes JSON
file to Python script
Portal Passes the SQL
query to Python script
Live
Portal & Tableau Integration using Rest API
Update the Owner of
the Data source as the
User creating the DS
using “Update Data
Source” REST API
Python Script for Live Connection
Python Script for Extract
Python Script for Extract
Python Script – Location in GITHUB
https://github.com/mrams04/Tableau-Data-Source
Demo – Advanced Features
Note: Data shown in the video’s is random mock-up data
Q&A
Please complete the
session survey from the
Session Details screen
in your TC18 app
Thank you!
#TC18
Contact or CTA info goes here