Le futur de
l’intelligence
d’affaire c’est le
temps réel! Charles Verdon
Technology Solutions Professional
Email: [email protected]
Twitter: @chverdon
Things!
30B30B
Data Analytics
& Insights
Intelligent
Systems
Cloud & Infrastructure
Devices &
Assets
10101010011000110101010111010011010101010100110111011110111001010100001101010101110100110101010111010011101010101011010011010101010101001101100010101111010011101010101011011110100111
10101010011000110101010111010011010101010100110111011110111001010100001101010101110100110101010111010011101010101011010011010101010101001101100010101111010011101010101011011110100111
Redefine
customer
service
Open new
business
opportunities
Build
competitive
edge
Gain insight
and agility
It’s Big
So many devices and so much data…
It’s Noisy
So many opinions…
It’s Confusing
So many possible decisions…
Should we
wait?
How (where)
do we get
started?
Who can
really help
us?
Do we need
to start over?
What
technology
do we need?
B5075212
Microsoft Confidential
The Internet of Things starts with
Your Things.
• Build on the infrastructure you already have.
• Add more devices to the ones you already own.
• Get more from the data that already exists.
Stop just running your business.
Start making it thrive. Start realizing the
potential of the Internet of Your Things.
Microsoft Azure IoT services:
Enable
innovation
Improve
efficiency
Transform
your business
You have data…You have things…
Generate new
insights to
create new
business value
Combine the
data you
already collect
Expand by adding new devices and assets, new services, new data
Utilize services
and the cloud
to jump-start
your efforts
Start by
connecting the
devices and LoB
Assets you
already have
London Underground
Analytics Platform System
(APS)
Portal
O
p
e
r
a
t
i
o
n
a
l
SAP BW
JDE
BaaN
SAP
etc
Enterprise
Data
Warehouse
(EDW)
D
a
s
h
b
o
a
r
d
s
&
K
P
I
s
Data Mart
Data Mart
Operational
Data Store
(ODS)
E
T
L
E
S
B
E
T
L
E
T
L
Reports
Ad-hoc
Dashboard
Semi-structured
Unstructured
Streaming
OSI Soft, etc
Hadoop
OLAP
OLAP
Where it starts…
Protocol reach to devices and platforms
Windows
Azure Service Bus
• Queues
• Topics
• Event hubs
/azure-sdk-for-python/
/azure-sdk-for-php/
/azure-sdk-for-node/
/azure-sdk-for-java/
/azure-sdk-for-ruby/
HTTP(S)
https://github.com/windowsAzure/AMQP 1.0
Other platforms
AMQP
1.0
Embedded
Quick Excursion: What is AMQP 1.0?• Advanced Message Queueing Protocol v1.0, ISO/IEC 19464:2014
• Bi-Directional, Reliable, Multiplexed Message Transfer
• Common Type System: structure like JSON, richer value types for scientific and business apps,
compact binary encoding
• Credit-based flow control model, delivery settlement
+5
{cursor here}
{cursor here}
{cursor here}
Machine Learning
I believe over the next decade computing will become even more ubiquitous and intelligence will become ambient This will be made possible by an ever-growing network of connected devices, incredible computing capacity from the cloud, insights from big data, and intelligence from machine learning
Satya Nadella, CEO
SQL Server
enables data
mining of
databases
Computers
work on users
behalf, filtering
junk email
Microsoft
Kinect can
watch users
gestures
Microsoft
launches Azure
Machine
Learning,
making years
of innovation
available
Microsoft
search engine
built with
machine
learning
Bing Maps
ships with ML
traffic-
prediction
service
Successful,
real-time,
speech-to-
speech
translation
Microsoft & Machine Learning20 years of realizing innovation
John Platt, Distinguished scientist at
Microsoft Research
1999 201220082004 201420102005
Machine learning is pervasive throughout
Microsoft products.“
”
Better Decisions with Data
Descriptive Diagnostic PrescriptivePredictive
BI Enablement Advanced Analytics
Enterprise Data Management
What happened? Why did it happen? What will happen? What should I do?
1 1 5 4 3
7 5 3 5 3
5 5 9 0 6
3 5 2 0 0
Generalization is the essence of machine learning
DataAbstraction Generalization
Machine Learning Applications Span
Industries and Scenarios
31
Web app optimization
Smart meter monitoring
Targeted Advertising
Life sciences research
Fraud detection
Healthcare outcomes
Weather forecasting
Natural resource exploration
Social network analysis
Telemetry Data Analysis
Buyer Propensity Models
Predictive Maintenance
Churn Analysis
Network Intrusion Detection
ThyssenKrupp Elevator
Data Science Process is All About Experimentation
Business Understanding
Data Understanding
Data Preparation
Modeling
Evaluation
Deployment and
Monitoring
Data
Machine Learning
Stream Analytics
Developers uses declarative SQL commands
Some functions take several lines of code versus thousands from other solutions
3 lines of code in Stream Analytics
Thousand lines of code in other solutions
Stream Analytics, End-to-End Overview
Data Source
Collect Process
Consume
Deliver
Event Inputs- Event Hub- Azure Blob
Transform- Temporal joins- Filter- Aggregates- Projections- Windows- Etc.
Enrich
Correlate
Outputs- SQL Azure- Azure Blobs- Event Hub- Power BI
AzureStorage
• Temporal Semantics• Guaranteed delivery• Guaranteed up time
Azure Stream Analytics
Reference Data- Azure Blob
Tumbling Windows
SELECT TollId, COUNT(*) FROM EntryStreamGROUP BY TollId, TumblingWindow(minute,5)
How many vehicles entered each toll both every 5 minutes?
Separation of Data & Presentation
Connect live to on-premises dataLive Connectivity to SQL Server Analysis Services
Live Connectivity
Use the Power BI REST API to
push data directly from your
application into a dataset in
Power BI. Your dashboards will
be updated in real-time when
the data changes. No more
waiting or having to press the
Refresh button!
Real-time dashboards
Create a connector (using REST,
OData, ODBC or other APIs) that
allows Power BI users to connect
to your data source and retrieve
data. Your connector can also
provide custom data models,
reports and dashboards for quick
insights.
Connectors for your
data sources
Use the Power BI REST APIs to
create custom datasets, reports
and dashboards from your
application. Integrate rich
analytics into your application by
embedding Power BI
dashboards, tiles and reports.
Rich analytics in your
application
Uncover real-time insights from
devices, sensors and
applications. Process streaming
data and events using Azure
Stream Analytics and monitor
the results using Power BI.
Real time dashboards
with Stream Analytics
Power BI
REST API
Upcoming Data Platform Events
Microsoft Cloud Platform Day• Montreal February 26: link
Microsoft Canada Webcast Series• 12pm to 1pm: English
• 13h30 à 14h30: Français
• February 26: Analytics Platform System
• March 26: SQL Server In-Memory technologies
• April 30: Real-time BI
• May 28: Azure SQL
User Group SQL Saturdays• PASS Ottawa Saturday April 25: link
SQL Server 2005
End-of-Life:
15 Months!
Charles [email protected]@chverdon
谢谢!
Merci!
Vielen Dank!
Спасибо!
Thank you!
!شكرا
¡Gracias!
ありがとう!