64
Why Microsoft for Advanced Analytics
Solutions at cloud speed
Scale Agility Low cost
Extensible Solutions
Why Microsoft for Advanced Analytics
Solutions at cloud speed
Works with what you haveCloud On-premiseHybrid
SQL Server
Why Microsoft for Advanced Analytics
Solutions at cloud speed
Works with what you have
AI driven innovation
Trusted by businesses
85% of Fortune 500 on the Microsoft cloud
Largest cloud compliance footprint
Widest range of enterprise-proven solutions
Industry-leading
investments
$12B in R&D investments annually
Over 10,000 peer-reviewed publications
Open source innovation & contribution
Users spend more time looking for data,
than they do analyzing it
Data is sitting in multiple sources,
but no insight into which data sits where
Need data consumption in multiple different tools, but no
common way of enabling discovery and access to data sources across them
Many different data ecosystems across the
enterprise, but no way to share data artifacts across them
Users are busy re-producing data assets that already exist
No way of tracking usage of our BI and Analytics assets
Do You Recognize Any of These Challenges?
DATA SOURCES INGEST PREPARE ANALYZE PUBLISH CONSUME
Cortana Intelligence Solutions: End To End Flow
Cortana Intelligence Solutions: End To End FlowDATA SOURCES INGEST PREPARE ANALYZE PUBLISH CONSUME
👆
👆 👆 👆👆 👆
👆
👆
👆 👆 👆
👆
👆
👆
The Team Data Science Process
Planning, Environment, Ingest Business Understanding
Explore and Visualize Data Understanding
Generate Features Data Preparation
Create Models Modeling
Train Models Evaluating
ConsumeDeploying
Cross Industry
Standard Process for
Data Mining
What is Azure Data Catalog?
An enterprise-wide catalog in Azure that enables self-service discovery of data from any source
A metadata repository that allow users to register, annotate, discover, understand, and consume data sources
A platform with open REST APIs that allow developers to integrate data discovery capabilities into their applications and processes
• Search
• Browse
• Filter
Discover
• Metadata
• Experts
• Context
Understand• Your data
• Your tools
• Your way
Consume
• Tag
• Document
• Publish
Contribute
How is Azure Data Catalog Different?
Annotation and enrichment
powered by crowdsourcing
Empowering any user to capture and share
their knowledge about data sources and
their usage
Data source discovery
One-stop shop for all enterprise data sources
No data movement or heavy up-front investment
Time to value in minutes
Consumption through any tool
Enabling publishing, discovery and consumption
of data sources through your tool of choice
Data from any source
Cloud and on-premises data sources
Structured and unstructured data sources
Microsoft and non-Microsoft data sources
Flexible Infrastructure support for analytics
Rich data sources to enrich predictions
Best of MS Research & open source
Most comprehensive Data Science capabilities
Easy to consume Artificial Intelligence
Extensible Applications
Easily build, deploy, and share predictive analytics solutions
• Simple, scalable, cutting edge. A fully managed cloud service that enables you to easily build, deploy, and share predictive analytics solutions.
• Deploy in minutes. Azure Machine Learning means business. You can deploy your model into production as a web service that can be called from any device, anywhere and that can use any data source.
• Publish, share, monetize. Share your solution with the world in the Gallery or on the Azure Marketplace.
Machine Learning
and Analytics
HDInsight
(Hadoop and
Spark)
Stream Analytics
Data Lake
Analytics
Machine
Learning
Azure Analysis
Services
Azure ML & ML Studio
Fully managed cloud service for building
Predictive Analytics solutions
Reduces the intricacies of Machine Learning process
Azure ML Studio is a powerful canvas for the
✓Composition of machine learning experiments
✓Subsequent operationalization
✓Consumption as machine learning web services
Azure Machine Learning: New CapabilitiesBuild, Deploy, Manage and Monitor models at any scale
Model ManagementDeploy, Version, Manage &
Monitor Models
WorkbenchWrangle Data, Build
models, Deploy & Manage
ExperimentationBoost productivity with Spark,
GPUs and agile development.
Disambiguator
Search
Algorithm
Less Cleaning, More Exploring with
AI based Program Synthesis
Intent
Programs
Top-Ranked
Program
Program Synthesis
powered by AI
More productive in - getting data, shaping it, and preparing it
Microsoft Research on program synthesis (PROSE) and data cleaning
Inclusion of a simple set of libraries for handling data sources
Scale out transparently across our cloud compute engines
Building your data transformations by example
Easy to inject custom python code or libraries to filter or transform the data
Complete history of how your model evolves over time
every project backed by a Git repository
simple command line tool for managing experimentation and training
runs
Flexibility of tools
leverage any Python tools and frameworks that you want to use
experiments can run locally, inside of a Docker container locally or
remotely, or scaling out on top of Spark
Docker as the vehicle to provide control and flexibility for model hosting
repeatable and consistent environment for hosting your models
Models are exposed via web services written in Python
Deployed models can be monitored through Application Insights
Versions tracked with deployed models
No downtime – Support for managing upgrades, rollback to a version
Retraining for continuous improvement (based on new data)
Governance and Lineage of deployed models
Visibility into any decision and tracing it back if required
Debugging and Diagnostics story across the end to end
lifecycle of a model.
• Easily ingest images from HDFS into Spark Data Frame
• Pre-process image data using transforms from OpenCV
• Featurize images using pre-trained deep neural nets using the Microsoft
Cognitive Toolkit
• Use pre-trained bidirectional LSTMs from Keras for medical entity extraction
• Train DNN-based image classification models on N-Series GPU VMs on Azure
• Featurize free-form text data using convenient APIs on top of primitives in
SparkML via a single transformer
• Train classification and regression models easily via implicit featurization of
data
• Compute a rich set of evaluation metrics including per-instance metrics
Exploring new business
opportunities with
data-driven services
Improving visibility
and making accurate
predictions with
remote monitoring
Getting the right
products to the right
places with inventory
management
Offering customers
exactly what they want,
when they want it, with
personalization
Fixing problems
proactively before they
start with predictive
maintenance
Cutting costs up to 90 percent
with predictive maintenance
Rockwell Automation
“We can take analytics to an entirely new level—the level of predictive,
actionable analysis—with Azure Machine Learning.“
Juan Asenjo
Lead Architect for Remote Monitoring at Rockwell Automation
The challengeLike other major companies worldwide,
Rockwell Automation needed better,
faster, and cheaper ways to manage and
analyze ever-increasing amounts of data.
They wanted to integrate predictive
maintenance and calculate optimal
efficiency of automated parts.
Machine Learning in action• Reduced maintenance costs by up to 90% through
full pipeline visibility
• Identified potential for millions of dollars in savings
by increasing water pump efficiency by 1%
• Cut development time by 80% when rolling out a
new system on Hadoop
Operational
Efficiency
Personalizes banking experiences in
real time based on customer sentiment
Tangerine
“I can see us…creating predictive, context-aware financial services applications
that give information based on the time and where the customer is.”
Billy Lo
Head of Enterprise Architecture at Tangerine
The challengeTangerine needed a new business
approach in order to stand out in the
crowded world of online banking. They
lacked the ability to capture and draw
insights from their expanding database
of customer information and
differentiate themselves from their
competitors.
Machine Learning in action• Modeled impact and effectiveness of offers and
adjusted product rollouts and advertising campaigns
based on real-time customer reactions
• Used predictive, context-aware targeted marketing
to serve up personalized customer offers
• Integrated a predictive analysis solution that
anticipates the likelihood of customer churn
Personalization
Using eye movement patterns for
early detection of dyslexia in children
Optolexia
“The flexibility and ease of use of the Azure Machine Learning analytics platform
makes it a perfect foundation for expanding our existing solution into new areas.“
Fredrik Wetterhall
Chief Executive Officer at Optolexia
The challengeOptolexia wanted the ability to iterate
and scale their dyslexia detection model
in order to accommodate expansion into
schools, new environments, and enable
additional condition screenings.
Machine Learning in action• Visualized models, scoring, and results without
writing new code to refine the testing tool
• Screened over 1K students and identified signs of
dyslexia earlier than ever before, leading to
improved student care, education, and self-esteem
• Created a scalable model enabling experimentation
and testing with new languages and conditions
Watch video
Anomaly
Detection
Predicting what customers want
before they order
JJ Food Service
“With Azure Machine Learning, the wow factor is huge. Customers are
amazed that we can predict so accurately what they need.“
Mushtaque Ahmed
COO at JJ Food Service
The challengeJJ Food Service wanted to offer
customers a faster and more reliable way
to check off items on their shopping list.
They wanted a way to optimize
availability for items customers want,
anticipate additional items they may
need, and deliver them faster for optimal
freshness.
Machine Learning in action• Increased cart size by over 5% through auto-
populating, predictive shopping lists
• Improved relevance of cross-sell and upsell product
recommendations by training a model to identify
customer behavior and serve up personalized offers
• Optimized inventory distribution and truck routing
to ensure orders arrive fresh every time
Watch video
Personalization
TrustedProductive IntelligentHybrid
Trusted
Hybrid
Intelligent
Productive
Unparalleled developer productivity
Unified management100+ servicesIntegrated tooling
Trusted
Hybrid
Intelligent
ProductiveSecure
Monitor
Govern
ProtectConfigure
Secure and well-managed for IT
Management portal
AzureData Services
SQL Server
Azure Security& Management
On-premisesInfrastructure
AzureServices
Azure Stack
Data Platform
Security & Management
Unified Cloud Platform
Common Identity
Azure ActiveDirectory
ActiveDirectory
Hybrid
Trusted
Intelligent
Productive
Providing the only consistent, hybrid cloud
At the edge and
disconnected
Cloud application
model on-premises
Meet every regulatory
requirement
Hybrid
Trusted
Intelligent
Productive
Consistent application development
Azure services available on-premises
Integrated delivery experience
Azure Stack promise
DMZ between Azure and your on-premises datacenter
Implementing a highly available hybrid network architecture
Power BI: experience your data
Key benefits and differentiators of Power BI
Pre-built dashboards and reports for popular SaaS
solutions
Live, real-time dashboard updates
Secure, live connection to your data sources,
on-premises and in the cloud
Auto insights and intuitive data exploration using
natural language query
Integrated with familiar Microsoft products, utilizing
commitment for scale & availability in Azure
Fast deployment, hybrid configuration, secure and
integrated with existing IT systems
Quickly find and view your Power BI data using Cortana for Power BI
• Use Cortana across your Windows 10 devices to get instant answers to your important business questions
• Cortana can find rich data-driven answers from Power BI reports (that contain a special type of report page called a Cortana answer card) and from Power BI dashboards
• If Cortana finds a match, it displays the name of the dashboard or report page right there in your Cortana screen. The dashboard or report page can be opened in Power BI.
• Report pages can also be explored right in Cortana - they're interactive
• At the current time, only English is supported
Integration of Azure Active Directory with Power BI
Create an Azure
Active Directory
tenant
Create some
users in your
Azure Active
Directory Tenant
Sign up for
Power BI with
your user
account
• In order to integrate Power BI into your custom application, you need to define an application within Azure AD.
• At least 2 users: Global Admin, User
• Now that you have an Azure AD tenant, you can use this tenant to test items within Power BI, and/or you can move forward to embed Power BI dashboards and reports in your application.
Keep a pulse on your business with live, interactive dashboards
Event Hubs
Stream Analytics
Machine Learning
Storage
SQL DatabaseHDInsight
Power BI
• Analytics for everyone, even non-data experts
• Your whole business on one dashboard
• Create stunning, interactive reports
• Drive consistent analysis across your organization
• Embed visuals in your applications
• Get real-time alerts when things change
Dashboards &
Visualizations
Power BI
Build intelligent applications that understand people
• Faces, images, emotion recognition and video intelligence
• Spoken language processing, speaker recognition, custom speech recognition
• Natural language processing, sentiment and topics analysis, spelling errors
• Complex tasks processing, knowledge exploration, intelligent recommendations
• Bing engine capabilities for Web, Autosuggest, Image, Video and News
Intelligence
Cortana
Bot
Service
Cognitive
Services
Azure Bot ServiceBuild, Connect, Deploy and Manage intelligent bots
• Start quickly with built-in templates
• Reach your customers on multiple channels
• Boost the power of bots with Azure services
Intelligence
Cortana
Bot
Service
Cognitive
Services
• No server management or patching needed
• Scale out automatically
• Pay only for what you use
Accelerate development cycles Enrich your bots Boost operational efficiencies
Develop
your way
Built in
code editor
Quick start
templates
Integrated
chat window
Channel
support
Cognitive
Services
Direct
Line support
Embedded
web chat
Powered by
Azure Functions
Continuous
deployment
Scale
on demand
Reduced
dev ops
Get started with solutions for your function
Demand Forecasting
Personalized Offers
Quality Assurance
solution templates?
Explore Cortana Intelligence today
1. Learn more
Keep up on the latest cloud-based
analytics news on our blog ▶
3. Find a partner2. Get trained
Participate in Data Science and
Machine Learning Essentials
course through edX ▶
Watch the Cortana Intelligence
Workshop ▶
Connect with a partner who
can help tailor Cortana
Intelligence to your needs ▶
Visit the Cortana Intelligence page ▶
https://docs.microsoft.com/en-us/azure/active-directory/develop/active-directory-howto-tenant
https://powerbi.microsoft.com/en-us/report-server/
https://azure.microsoft.com/en-ca/services/data-catalog/
https://azure.microsoft.com/en-ca/blog/diving-deep-into-what-s-new-with-azure-machine-learning/
https://gallery.cortanaintelligence.com/
https://azure.microsoft.com/en-us/services/cognitive-services/
https://www.microsoft.com/en-us/cognitive-toolkit/features/model-gallery/?filter=Tutorial
https://github.com/Microsoft/CNTK
https://docs.microsoft.com/en-us/cognitive-toolkit/reasons-to-switch-from-tensorflow-to-cntk
