TIBCO Analytics Meetup
TIBCO Data Science Team
April 2020
© Copyright 2000-2020 TIBCO Software Inc.
The information in this document is confidential information of TIBCO Software Inc. and/or its affiliates. Use, duplication, transmission, or republication for any purpose without the prior written consent of TIBCO is expressly prohibited.
This document (including, without limitation, any product roadmap or statement of direction data) illustrates the planned testing, release and availability dates for TIBCO products and services. This document is provided for informational purposes only and its contents are subject to change without notice. TIBCO makes no warranties, express or implied, in or relating to this document or any information in it, including, without limitation, that this document, or any information in it, is error-free or meets any conditions of merchantability or fitness for a particular purpose.
The material provided is for informational purposes only, and should not be relied on in making a purchasing decision. The information is not a commitment, promise or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for our products remains at our sole discretion.
During the course of this presentation, TIBCO or its representatives may make forward-looking statements regarding future events, TIBCO’s future results or our future financial performance. These statements are based on management’s current expectations. Although we believe that the expectations reflected in the forward-looking statements contained in this presentation are reasonable, these expectations or any such forward-looking statements could prove to be incorrect and actual results or financial performance could differ materially from those stated herein. TIBCO does not undertake to update any forward-looking statement that may be made from time to time or on its behalf.
CONFIDENTIALITY & DISCLAIMER
© Copyright 2000-2020 TIBCO Software Inc.
TIBCO Analytics Meetupopportunities to learn and network
Meetup group keeps growing and now has 825+ members!
Join this TIBCO Analytics Meetup group and receive automatic invites to future TIBCO Analytics Meetups
And you’ll get links to slides and Youtube recordings!
https://bit.ly/3aDL7ww
© Copyright 2000-2020 TIBCO Software Inc.
Welcome and TIBCO Connected Intelligence update by Michael O’ConnellDemo - Life Expectancy data analysis to understand longevity by Steven HillionDemo - Formula 1 simulator predictions for lap time and crashes by Colin GrayTIBCO Community update by Heleen SneltingLive Q&A
Please submit your questions at any time via Q&A optionWe will answer at the end or will get back to you via email
Agenda
© Copyright 2000-2020 TIBCO Software Inc.
5
by Michael O’Connell
Data Science update
© Copyright 2000-2020 TIBCO Software Inc.
TIBCO CONNECTED INTELLIGENCE
Swap Logoif neededIn master slide
6
TIBCO Connected Intelligence
Metadata
Master & Reference Data
Transactional Data
Powered by shared data assets
INFORMATION MANAGEMENT
Metadata (Data Governance, Data Catalog)
MDM / RDM
DATA OPERATIONS
Data Virtualization Master and Reference Data Management
Data Store 1 Data Store n EDW/Lake
Spark Compute & Store
METADATA
UNIFYDATA
DATA SOURCES
Enterprise Application 1
Enterprise Application n
Streaming Sources
In-memoryData Grid
...
EVENTS
Streaming / Events
INTEGRATION
Hybrid Integration
APIManagement
INTERCONNECTEVERYTHING
ANALYTICSACTIONS Data Science Operations AnalyticsVisual Analytics
PREDICTCONFiDENTLY
Cloud Native Open Platform AI Foundation
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
7
InsightEmpower everyone and
every system with data-driven insights &
predictions
DataSimplify data
access, wrangling, and exploration
1Action
Automate and act in real time
LearningLearn and optimize for the best outcomes, all
the time
Retail
Government Hospitality Manufacturing
TelecommunicationsTransportation
& LogisticsFinancial Services
Energy
Healthcare
2
3
4
© Copyright 2000-2020 TIBCO Software Inc.
TIBCO Connected Intelligence
Swap Logoif neededIn master slide
8
Modeling+ Visual composition + Multilingual Notebook+ Native ML & OS + AWS, AZURE, GCP+ AutoML, data prep
Operations Deployment+ Model lifecycle mgt+ Batch automation+ Real-time event processing+ REST, Apps, embedding
Data Access / Prep+ Distributed compute+ Feature engineering+ Reusable templates
Medic eg researcher on epidemic monitoring
Engineer eg aerodynamics engineer
Marketeer eg customer engagement analyst
Data ScientistCitizen Data Scientist
Data ScientistCitizen Data Scientist
Analytics OperationsIT / Software Engineer
FUNCTION
USER orAUTOMATION
Business UserAnalytic Operations IT / Administration
Business Applications+ Engineering/IoT+ Customer analytics+ Risk management+ Supply Chain
Visual Analytics& Data Science
© Copyright 2000-2020 TIBCO Software Inc.
TIBCO Data Science
Swap Logoif neededIn master slide
9
Spotfire Visual Analytics Appshttps://www.tibco.com/products/tibco-spotfire/learn/demos
Visual Analytics& Data Science
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
10
DEVELOPER DATA SCIENTIST BUSINESS ANALYST• Stays in Spotfire, but can view
discussions and analyses in TDS
• Enter parameters for Team Studio analysis + visual results in Spotfire
• Maintain interactivity in Spotfire while running jobs in Team Studio
• Gets notifications of long running jobs completing in email via automation services
• Example of business users:• Medical reviewers, Clinicians, • Translational scientists
• Example of use cases:• Healthcare Analytics• IoT / F1 Car Performance
• Develops analyses in Team Studio and Spotfire
• Configures analyses for use by Spotfire user
• Design data access (data sources, connection to Spotfire)
• Scalability/HPC in TeamStudio• Design interface in Spotfire• Develop Python, R and PySpark
scripts.
• Example of use cases:• Health Outcomes Modeling,
IoT Digital Twin• Python and ML libraries• Spark MLlib scalable machine
learning with PySpark
• Creates Team Studio MODS (custom operators) and advanced Python/R scripts
• Interconnects different analytics platforms and libraries, e.g. SageMaker, TensorFlow
• Shares reusable functions and connectors across the Data Science team
• Develops analyses in Team Studio• Example of use cases:
• Spark MLlib scalable machine learning applications
• AI engines in AWS or local workstations
• Microservices for interconnecting platforms
TIBCO Data Science - Personas
© Copyright 2000-2020 TIBCO Software Inc.
11
Full R and Python capabilities• R and Python engines -- included out of the
box; client and server• R Dataframes to Spotfire Datatables• Python pandas to Spotfire Datatables• Map objects (e.g. .wkb)• Spatial libraries: gdal, rgdal, …
Statistics and Cloud Services• Matlab, SAS and other compute engines• TIBCO Data Science (point-click)• Cloud Services - AWS, Azure, GCP
Spotfire: Embedded Data Science
© Copyright 2000-2020 TIBCO Software Inc.
Visual Analytics& Data Science
Location data – accurate geocoding, earth curvature
Multi-layer – inbuilt + WMS, TMS, Shape, ESRI services
Multi Coordinate systems – NAD27, NAD83, WGS84 overlays
Map Chart APIs – Map Chart as UX for location-based navigation
Spatial Data Functions - for advanced analytics e.g. optimal routes, contours, trade areas, ..Map anything – not just geographies
Spotfire: Geo-Analytics
© Copyright 2000-2020 TIBCO Software Inc.
Visual Analytics& Data Science
Swap Logoif neededIn master slide
13
Real Time Data Visualization• User selects time window• Data Streams shows live-updates• Calculations (forecast) on live visuals
Users and Data• Many real-time data sources supported• Simple data source connector • Brush-linking – static & real-time
visuals• Same behavior as rest of Spotfire
Spotfire: Data Streams
Real-Time Awareness and Action
© Copyright 2000-2020 TIBCO Software Inc.
Visual Analytics& Data Science
Spotfire: Data Wrangling
Visual data wrangling – smart joins
Script expressions & data functions – embedded R, Python• Author and audit with automatically recorded dataflow steps• Edit from data canvas – including upstream
© Copyright 2000-2020 TIBCO Software Inc.
Visual Analytics& Data Science
15
by Steven Hillion
Life Expectancy Demo
© Copyright 2000-2020 TIBCO Software Inc.
How a small team of data scientists and analysts came together in just
three days to analyze health outcomes around the globe
Read more on the TIBCO Community Blog
17
by Colin Gray
F1 Simulator Demo
© Copyright 2000-2020 TIBCO Software Inc.
TIBCO’s Own Digital Twin
BigData London 2019
The winning lap! 🡪
TIBCO Formula 1™ - Simulator
© Copyright 2000-2020 TIBCO Software Inc.
Live Streaming Spotfire Dashboard
TIBCO - F1™ 2019 Simulator - Architecture
Cloud, Laptop or On-Premise
Flogo IoT App
PostgreSQL
TIBCO Data Streams
TIBCO Streaming
MessageBroker AMS®
ML Repository
TIBCO Data Science
UDP Data
Stream
© Copyright 2000-2020 TIBCO Software Inc.
As used by the official Formula 1™ e-sportsChampionship and teams
1. Predict final lap time, in real-time as someone races their lap2. Predict the likelihood of a crash occurring which damages the car
TIBCO F1™ - Simulator – Data Science
© Copyright 2000-2020 TIBCO Software Inc.
No or little data was available before eventData needed to be manually generatedEvery race track is different
How to simulate different drivers?Higher standard of accuracy in Formula 1
Data and Modeling
Multiple technologies involved which all must integrate fully
i.e. data generated and models must be compatible across each
Technology
The Data Science Challenge:
21
F1™ Predictions – The Data Available
• One Lap of Brazil Circuit generates ~ 104,800 data points per lap• 10 rows of data per second• 131 columns per row
Track and Position Tyre, Brake, Suspension Driver Style, Behaviour
© Copyright 2000-2020 TIBCO Software Inc.
22
F1™ Damage Predictions – The Models
Solution: 2 Models – predicting different severities of crash
Model 1: Actual damage is 0 – predict probability for No, Some and Severe damage by the end of the lap
Model 2: Some damage present - predict probability of whether there be more (possibly severe) damage by the end of the lap
If there is already 100% damage, there is nothing to predict
© Copyright 2000-2020 TIBCO Software Inc.
Predicting likelihood of crashing and damaging the car…By analysing track position, each tyre’s surface i.e. on track or off track, steering etc. can we predict this?
23
by Heleen Snelting
TIBCO Community Update
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
24
TIBCO Community the platform for our users! community.tibco.com
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
25© Copyright 2000-2019 TIBCO Software Inc.
https://community.tibco.com/blog
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
26© Copyright 2000-2019 TIBCO Software Inc.
https://bit.ly/2QWTfQS
https://www.tibco.com/covid19
Swap Logoif neededIn master slide
27
Data Science Festival - TIBCO4Good
https://bit.ly/2JxYXo8
https://www.tibco.com/tibco4good
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
28
Spotfire Data Functions - Complete Set!
https://community.tibco.com/exchangeuse filters on page to help select items
https://bit.ly/2GGraIl
https://bit.ly/2EPx4Z8
https://bit.ly/2EPx4Z8 3 different items have been published
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
29
Natural Language Generation
https://community.tibco.com/exchangeuse filters on page to help select items
https://bit.ly/2ymal48
Wikipedia edits Analysis example ready to learn and use!
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
30
Anomaly Detection - Latest Assets
https://www.tibco.com/solutions/anomaly-detection
https://bit.ly/39zsOay
https://bit.ly/2JvkNZt
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
31
Hands-on with Data Science
3rd Wednesday of every month at 9AM PT
● Free 30-minute webinar● Interactive presentation aimed
at helping new and advanced practitioners of data science and machine learning
● Recordings on https://www.tibco.com/events/dr-data-science-office-hours
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
32
Spotfire Youtube Channel
Subscribe to find all this content:
● TIBCO Analytics Meetup recordings
● ‘what’s new in Spotfire’ sessions by Spotfire Product Managers - new on Youtube!
● Dr Spotfire sessions
● Spotfire Enablement videos
https://www.youtube.com/user/TibcoSpotfire
© Copyright 2000-2020 TIBCO Software Inc.
https://www.linkedin.com/groups/12253057/
Swap Logoif neededIn master slide
33
Spotfire Enablement Hub
https://community.tibco.com/wiki/spotfire-enablement-hub
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide
34© Copyright 2000-2020 TIBCO Software Inc.
https://bit.ly/2R583wM
Swap Logoif neededIn master slide
35
Benefits to you:● Network with peers● Showcase TIBCO acumen● Boost TIBCO skills● Access product releases● Provide feedback● Create content● Redeem special rewards● Free!
What’s in it for you?Engage with TIBCO on your own terms...
https://league.tibco.com/join/customer
© Copyright 2000-2020 TIBCO Software Inc.
36
What’s new pages in… for example TIBCO Spotfire
https://community.tibco.com/wiki/whats-new-tibco-spotfire
Customer Orientation and Customer Success Center - ideal for on-boarding and staying up to date
• https://community.tibco.com/wiki/tibco-spotfire-customer-orientation
• https://community.tibco.com/wiki/tibco-data-science-team-studio-orientation-page
• https://community.tibco.com/wiki/tibco-data-science-workbench-customer-orientation
• https://community.tibco.com/wiki/tibco-spotfire-customer-success-center
Dr Spotfire and Dr Data Science
https://community.tibco.com/wiki/doctor-spotfire-office-hours
https://www.tibco.com/events/dr-data-science-office-hours
AutoML for TIBCO Data Science
https://community.tibco.com/modules/automl-tibcor-data-science-team-studio
TIBCO Analytics Meetup pages with recordings and presentations
https://community.tibco.com/wiki/tibco-analytics-meetup
TIBCO Community links to bookmark
© Copyright 2000-2020 TIBCO Software Inc.
Questions & Contact
Michael O’[email protected]@MichOConnell
Heleen Snelting [email protected]@HeleenSnelting
TIBCO Communitycommunity.tibco.com
TIBCO Exchangecommunity.tibco.com/exchange
Spotfire Trialspotfire.tibco.com/trial
© Copyright 2000-2020 TIBCO Software Inc.
Swap Logoif neededIn master slide