Data Platform Airlift21 de Outubro \\ Microsoft Lisbon Experience
Real-time Analytics with Azure, DataZen, PowerBI& Stream Analytics
Rui Quintino
Real-Time Analytics & Business Intelligence
•Why?•How?
Real-Time Analytics in Microsoft Data Platform:#Azure#PowerBI#StreamAnalytics#Datazen #SqlServer#SignalR #EventHubs #ServiceBus(note: also very relevant , but not covered : AzureML, APS,Storm, Spark, HDInsight,…)
•Q&A
Information
explosion,
new insights
90%of the world’s data has been created
over the last two years alone1
Shift to cheaper,
faster computing,
on demand
45%of total IT spend will be
cloud-related by 20202
Increasingly
data-savvy
workforce
5XCompanies that use analytics
are 5x more likely to make decisions
faster than competitors3
Transformative opportunity
41. IDC. 2. Josh Waldo Senior Director, Cloud Partner Strategy, Microsoft. 3. Bain & Company, The Value of Big Data: How Analytics Differentiates Winners, 2013.
The ROI of Data
Source: IDC Study: Realizing the Data Dividend, 2014.
The formula
[data + analytics + people ]
@
speed
Key Opportunity
AreasOrganizations can realize
Return on Data in several
key areas…
Productivity
Includes strategic
planning, human
capital management,
IT optimization
Operations
Includes demand
and supply chain
management,
logistics
Return
on Data
$674
billion
Return
on Data
$486
billion
Return
on Data
$158
billion
$235
billion
$1.6 trillionReturn on Data
5
Return
on Data
Customer
Facing
Includes customer
acquisition, retention,
support and pricing
Innovations
Includes service,
research and
development
innovation
What are customers wanting to do?
Who is using Real-Time Analytics
http://tdwi.org/research/2014/09/best-practices-report-real-time-data-bi-and-analytics/asset.aspx?tc=assetpg
Partners / Subscribers
Microsoft Botnet Analytics – Architecture
• Processing 200M+ transactions per day and growing
• 566,773,255 calls a day from over 25 million distinct IP address
• Query results returned in under 2 seconds
[Sinkhole]
SQL Server
Internet with
billions of devices
Microsoft
Analytics
Platform System
Visualizations
& insights
Certs
ISPs
Others
Excel & Power BI
Azure
HDInsight
Azure
Machine LearningInternet with
billions of devices
Real-Time Analytics at Microsoft Microsoft Xbox team enhances game for HALO customers
The situationThe HALO contest promotion
team wanted to use data to
create a better gamer experience
for customers playing the new
HALO 4.
The solutionNon-technical employees
processed & analyzed raw data in
Real-Time to answer their
questions, using familiar and
powerful tools
The benefitsThe team quickly uncovered and
addressed the unexpected
(cheating), while also using
insights to update and improve
gamer experience.
The process
Analyze raw data
Identify trends
Make updates
Improve CSAT
The toolsExcel SQL Server
Windows Azure HD Insight
1-Real-time Analytics with #Azure #Datazen
•Elastic Scale & Load• the *amazing* Azure platform
•Datazen platform• Powerfull /easy to build Dashboards• Public viewer available•Multi platform /device render engine• Licensing
•Challenges• Closed product, no Real-time support, scale
2-#PowerBI real-time dashboards
•#PowerBI-State of art analytics platform
•Rest API enabled
•Near zero-development realtime dashboards
•Low throughput scenarios, •~hundred/rows /sec
•Team/Enterprise-no public sharing (yet)
3-Real-time #PowerBI #Azure #StreamAnalytics
• IoT
•Huge capacity for ingestion: event hubs
•Huge capacity for live stream analytics
•Rapid Development, configure in minutes
•Elastic scale with Azure, Fully managed
•Realtime dashboards with PowerBI
•Realtime dashboards with SignalR/HTML5
Free Azure
Trial
Try SQL Server
2016 CTP2http://aka.ms/trysql2016
http://aka.ms/tryazureUse Power BI for Free
http://powerbi.microsoft.com