Date post: | 15-May-2015 |
Category: |
Technology |
Upload: | impetus-technologies |
View: | 923 times |
Download: | 1 times |
Real-time Streaming Analytics
Business Value, Use Cases and Architectural Considerations
Big Data Solutions and Services Partner for Enterprises
Anand Venugopal – Sr. Director Business DevelopmentBig Data Solutions
1
Yue Cathy Chang – Sr. Director Business DevelopmentAlliances and Partnerships
Picture your house
2
What if this was happening now to your home ?
3 Recorded version available at http://bit.ly/1i6OrwR
When do you want to know ?
4
Later
or
Now ?
Recorded version available at http://bit.ly/1i6OrwR
Your best buddy from school
You haven’t met in years
5Recorded version available at http://bit.ly/1i6OrwR
Is in Vegas same time as you
Your buddyYour buddy
You You
6Recorded version available at http://bit.ly/1i6OrwR
When do you want to know ?
After you return
or
NOW ?
7Recorded version available at http://bit.ly/1i6OrwR
• Whether individual or Business
• Important things are always happening NOW
• NOW is the ONLY time life REALLY happens
• Maximize data value process and act sooner!
Life is happening NOW
Real-time insight preserves or creates value
8
Topics we will cover today
Why ?Business Value
What ? Is Real-time Streaming Analytics and what it is not
How?Architectural considerations
Use cases
Who and Where ?
What next ?Recommendations
9Recorded version available at http://bit.ly/1i6OrwR
What it is NOT
• Quick-response interactive analytics on static data
• Batch processing
• Could be close but still NOT – Micro Batch processing
What is Real-time Streaming Analytics ?
10Recorded version available at http://bit.ly/1i6OrwR
• Data analyzed in motion – as it arrives
• Routine: Monitoring, Counting, Alerting, Reporting
• Complex Decision Making with Predictive analytics
• Every incoming event is distinctly processible
• Receive, Inspect, Analyse, Store, Distribute
• Events may be stored later or in parallel
• Immediate actions possible after processing
What is Real-time Streaming Analytics ?
11Recorded version available at http://bit.ly/1i6OrwR
Real time vs. Batch analytics
Sec/
ms
Sec/
ms
Sec/
ms
Sec/
ms
BATCHBATCH
Real timeReal time
12Recorded version available at http://bit.ly/1i6OrwR
13
Topics we will cover today
Why ?Business Value
What ? Is Real-time Streaming Analytics and what it is not
How?Architectural considerations
Use cases
Who and Where ?
What next ?Recommendations
14Recorded version available at http://bit.ly/1i6OrwR
Business Value
Diminishes with the age of data
The drop is non-linear
$$$ ?
Before
• Predictive analytics based on current events
• Value depends on accuracy
$$ NOW
• Real-time• Certainty is high – REAL• Value based on quick
response
$$$
Later
• Descriptive
• Diagnostic
• Least value
15
Value of Data
Age of Data
• Routine business operations (Real time systems)
• Cutting preventable losses
• Finding and monetizing missed opportunities
• More revenue
• Cost savings
• Creating new opportunities
• New Business models (Products, Services, Revenue)
Business Value from RTSA
16Recorded version available at http://bit.ly/1i6OrwR
Topics we will cover today
Why ?Business Value
What ? Is Real-time Streaming Analytics and what it is not
How?Architectural considerations
Use cases
Who and Where ?
What next ?Recommendations
17Recorded version available at http://bit.ly/1i6OrwR
Routine Operations (RT systems)
• Manufacturing – Control Systems (Closed loop)
• IT - Systems & Network Monitoring
• Field Assets Monitoring and Alerting
• Trucks, Oil rigs, Vending machines, Radio towers
• Financial Transactions Processing
• Authentications, Validations, Fraud
18Recorded version available at http://bit.ly/1i6OrwR
Cutting Preventable Losses
• MH 370 – Loss of lives and assets
• GM – Manufacturing defects
• Target – Major Security breach
• Stock Exchange Meltdown
Many headline stories are failures inroutine operations and were preventable losses
19Recorded version available at http://bit.ly/1i6OrwR
Cutting Preventable Losses (2)
• Medical / Clinical – Complex analytics in ICU
• Disaster Warning Systems: Chile / Sandy
• Brokerage - Fraudulent or Risky Trades
• Preventive Maintenance – Machines, Plants
• Customer Churn
• Brand Reputation on Social Media
20Recorded version available at http://bit.ly/1i6OrwR
Missed Opportunities - Revenue
• Customer Service always happens in real-time
• Listening and Learning from customers (Social)
• Context sensitive inventory – Products, Ads
• Recommend - Upsell – Cross-sell
21Recorded version available at http://bit.ly/1i6OrwR
Missed Opportunities - Efficiency
• Operational Efficiency of systems or processes
• Network Optimization for cost, quality of service
• Dynamic capacity management
• Dynamic re-routing of traffic, cargo
• Insurance Adjudication – Drone image analysis
22Recorded version available at http://bit.ly/1i6OrwR
New Opportunities
• Tractors are becoming soil sensors
• Information service to farmers
• Nike – becoming a healthcare company ??
• Quantified self movement
• Telecom giants selling data and insights
23Recorded version available at http://bit.ly/1i6OrwR
Business Value of RTSA Summary
24Recorded version available at http://bit.ly/1i6OrwR
Topics we will cover today
Why ?Business Value
What ? Is Real-time Streaming Analytics and what it is not
How ?Architectural considerations
Use cases
Who and Where ?
What next ?Recommendations
25Recorded version available at http://bit.ly/1i6OrwR
Architectural Considerations (1/3)
ALW
AYS
ACCURATELY
APPROPRIATELY
26Recorded version available at http://bit.ly/1i6OrwR
Real time + Batch Analytics
27Recorded version available at http://bit.ly/1i6OrwR
Real time + Batch Analytics
28Recorded version available at http://bit.ly/1i6OrwR
Real time + Batch Analytics
29Recorded version available at http://bit.ly/1i6OrwR
Real time + Batch Analytics
30Recorded version available at http://bit.ly/1i6OrwR
Real time + Batch Analytics
31Recorded version available at http://bit.ly/1i6OrwR
Real-time streaming analytics pipeline and flow
32Recorded version available at http://bit.ly/1i6OrwR
Real-time streaming analytics pipeline and flow
Scale and Robustness
Reliability - Guarantees
Publish-Subscribe
Flexibility – Dynamic
Integration with Batch
Loose Coupling
Visualization
Ease of Administration
33Recorded version available at http://bit.ly/1i6OrwR
StreamAnalytix
34Recorded version available at http://bit.ly/1i6OrwR
•Proprietary platforms
• Vendor lock-in
• No leverage of open source movement
•Do it yourself
• Open source stitch up
• Integration and maintenance nightmare
• Significant delays in time-to-market
Approaches to Stream Analytics
35Recorded version available at http://bit.ly/1i6OrwR
• An “App Server” for real-time apps
• Based on best-of-breed Open source
• Focus on your Business logic leave infrastructure to the platform
• Handle all the 3V’s of Big Data in one platform
• Seamless integration with Hadoop, NoSQL or any other DB
• Rapidly operationalize pre-built analytical models or new ones
• Significant time to market acceleration
• Impetus provides full product support and professional services
Introducing ‘StreamAnalytix’
36Recorded version available at http://bit.ly/1i6OrwR
Topics we will cover today
Why ?Business Value
What ? Is Real time streaming anaytics and what it is not
How?Architectural considerations
Use cases
Who and Where ?
What next ?Recommendations
37Recorded version available at http://bit.ly/1i6OrwR
• Important things are always happening NOW
• Maximize data value process and act sooner!
• There is value – find it Improve Ops, Cut losses, Find missed & new opportunities
• Architecture: Sense Analyse Act Sense
RECAP
38
Real time insight preserves and creates business value
38
• Get Real time streaming analytics in your roadmap
• Talk to experienced peers and consultants
• Start now with opportunities search, solution architecture and vendor conversations
• Instrument (SENSE) everything – find gaps and fill
• Prove value with “faster batch” with current infra is possible
• Establish mechanisms to ACT on the insights
• Close the loop – Sense and Analyse effectiveness
• DO IT
RECOMMENDATIONS
39Recorded version available at http://bit.ly/1i6OrwR
Topics we will cover today
Why ?Business Value
What ? Is Real time streaming anaytics and what it is not
How?Architectural considerations
Use cases
Who and Where ?
What next ?Recommendations
40
Big Data Solutions and Services partner for Enterprises
Request a demo of StreamAnalytix
41Recorded version available at http://bit.ly/1i6OrwR
@impetustech