Charles Verdon - Samedi SQL - Futur de l'intelligence d'affaire

Post on 30-Jul-2015

188 views 2 download

Tags:

transcript

Le futur de

l’intelligence

d’affaire c’est le

temps réel! Charles Verdon

Technology Solutions Professional

Email: chverdon@microsoft.com

Twitter: @chverdon

Things!

30B30B

Data Analytics

& Insights

Intelligent

Systems

Cloud & Infrastructure

Devices &

Assets

10101010011000110101010111010011010101010100110111011110111001010100001101010101110100110101010111010011101010101011010011010101010101001101100010101111010011101010101011011110100111

10101010011000110101010111010011010101010100110111011110111001010100001101010101110100110101010111010011101010101011010011010101010101001101100010101111010011101010101011011110100111

Redefine

customer

service

Open new

business

opportunities

Build

competitive

edge

Gain insight

and agility

It’s Big

So many devices and so much data…

It’s Noisy

So many opinions…

It’s Confusing

So many possible decisions…

Should we

wait?

How (where)

do we get

started?

Who can

really help

us?

Do we need

to start over?

What

technology

do we need?

B5075212

Microsoft Confidential

The Internet of Things starts with

Your Things.

• Build on the infrastructure you already have.

• Add more devices to the ones you already own.

• Get more from the data that already exists.

Stop just running your business.

Start making it thrive. Start realizing the

potential of the Internet of Your Things.

Microsoft Azure IoT services:

Enable

innovation

Improve

efficiency

Transform

your business

You have data…You have things…

Generate new

insights to

create new

business value

Combine the

data you

already collect

Expand by adding new devices and assets, new services, new data

Utilize services

and the cloud

to jump-start

your efforts

Start by

connecting the

devices and LoB

Assets you

already have

Analytics Platform System

(APS)

Portal

O

p

e

r

a

t

i

o

n

a

l

SAP BW

JDE

BaaN

SAP

etc

Enterprise

Data

Warehouse

(EDW)

D

a

s

h

b

o

a

r

d

s

&

K

P

I

s

Data Mart

Data Mart

Operational

Data Store

(ODS)

E

T

L

E

S

B

E

T

L

E

T

L

Reports

Ad-hoc

Dashboard

Semi-structured

Unstructured

Streaming

OSI Soft, etc

Hadoop

OLAP

OLAP

Where it starts…

Protocol reach to devices and platforms

Windows

Azure Service Bus

• Queues

• Topics

• Event hubs

/azure-sdk-for-python/

/azure-sdk-for-php/

/azure-sdk-for-node/

/azure-sdk-for-java/

/azure-sdk-for-ruby/

HTTP(S)

https://github.com/windowsAzure/AMQP 1.0

Other platforms

AMQP

1.0

Embedded

Quick Excursion: What is AMQP 1.0?• Advanced Message Queueing Protocol v1.0, ISO/IEC 19464:2014

• Bi-Directional, Reliable, Multiplexed Message Transfer

• Common Type System: structure like JSON, richer value types for scientific and business apps,

compact binary encoding

• Credit-based flow control model, delivery settlement

+5

{cursor here}

{cursor here}

{cursor here}

Machine Learning

I believe over the next decade computing will become even more ubiquitous and intelligence will become ambient This will be made possible by an ever-growing network of connected devices, incredible computing capacity from the cloud, insights from big data, and intelligence from machine learning

Satya Nadella, CEO

SQL Server

enables data

mining of

databases

Computers

work on users

behalf, filtering

junk email

Microsoft

Kinect can

watch users

gestures

Microsoft

launches Azure

Machine

Learning,

making years

of innovation

available

Microsoft

search engine

built with

machine

learning

Bing Maps

ships with ML

traffic-

prediction

service

Successful,

real-time,

speech-to-

speech

translation

Microsoft & Machine Learning20 years of realizing innovation

John Platt, Distinguished scientist at

Microsoft Research

1999 201220082004 201420102005

Machine learning is pervasive throughout

Microsoft products.“

Better Decisions with Data

Descriptive Diagnostic PrescriptivePredictive

BI Enablement Advanced Analytics

Enterprise Data Management

What happened? Why did it happen? What will happen? What should I do?

1 1 5 4 3

7 5 3 5 3

5 5 9 0 6

3 5 2 0 0

Generalization is the essence of machine learning

DataAbstraction Generalization

Machine Learning Applications Span

Industries and Scenarios

31

Web app optimization

Smart meter monitoring

Targeted Advertising

Life sciences research

Fraud detection

Healthcare outcomes

Weather forecasting

Natural resource exploration

Social network analysis

Telemetry Data Analysis

Buyer Propensity Models

Predictive Maintenance

Churn Analysis

Network Intrusion Detection

Data Science Process is All About Experimentation

Business Understanding

Data Understanding

Data Preparation

Modeling

Evaluation

Deployment and

Monitoring

Data

Machine Learning

Stream Analytics

Developers uses declarative SQL commands

Some functions take several lines of code versus thousands from other solutions

3 lines of code in Stream Analytics

Thousand lines of code in other solutions

Stream Analytics, End-to-End Overview

Data Source

Collect Process

Consume

Deliver

Event Inputs- Event Hub- Azure Blob

Transform- Temporal joins- Filter- Aggregates- Projections- Windows- Etc.

Enrich

Correlate

Outputs- SQL Azure- Azure Blobs- Event Hub- Power BI

AzureStorage

• Temporal Semantics• Guaranteed delivery• Guaranteed up time

Azure Stream Analytics

Reference Data- Azure Blob

Tumbling Windows

SELECT TollId, COUNT(*) FROM EntryStreamGROUP BY TollId, TumblingWindow(minute,5)

How many vehicles entered each toll both every 5 minutes?

Separation of Data & Presentation

Connect live to on-premises dataLive Connectivity to SQL Server Analysis Services

Live Connectivity

Use the Power BI REST API to

push data directly from your

application into a dataset in

Power BI. Your dashboards will

be updated in real-time when

the data changes. No more

waiting or having to press the

Refresh button!

Real-time dashboards

Create a connector (using REST,

OData, ODBC or other APIs) that

allows Power BI users to connect

to your data source and retrieve

data. Your connector can also

provide custom data models,

reports and dashboards for quick

insights.

Connectors for your

data sources

Use the Power BI REST APIs to

create custom datasets, reports

and dashboards from your

application. Integrate rich

analytics into your application by

embedding Power BI

dashboards, tiles and reports.

Rich analytics in your

application

Uncover real-time insights from

devices, sensors and

applications. Process streaming

data and events using Azure

Stream Analytics and monitor

the results using Power BI.

Real time dashboards

with Stream Analytics

Power BI

REST API

Upcoming Data Platform Events

Microsoft Cloud Platform Day• Montreal February 26: link

Microsoft Canada Webcast Series• 12pm to 1pm: English

• 13h30 à 14h30: Français

• February 26: Analytics Platform System

• March 26: SQL Server In-Memory technologies

• April 30: Real-time BI

• May 28: Azure SQL

User Group SQL Saturdays• PASS Ottawa Saturday April 25: link

SQL Server 2005

End-of-Life:

15 Months!

Charles Verdonchverdon@microsoft.com@chverdon

谢谢!

Merci!

Vielen Dank!

Спасибо!

Thank you!

!شكرا

¡Gracias!

ありがとう!