Fitting Microsoft Hadoop Into Your Enterprise BI Strategy

Cindy Gross | @SQLCindy | SQLCAT PMhttp://blogs.msdn.com/cindygross

What Big Data Is and Isn’t

Microsoft Hadoop

Data, Insights,Visualization

Big Agenda

SQL, NoSQL, Hive

Unstructured NoSQL

Structured SQL

SQL Server

I don’t need no NoSQL…. Do I?

Hadoop

Fulfill Different Needs

HiveQL TSQL

How do I leverage my #SQLAwesomeness?

SELECT deviceplatform, state, countryFROM hivesampletableLIMIT 200;

Hive

SFTPAmazon S3

Azure Data Market

Azure Blob Store

All your data are belong to us

Sqoop to/from relational

Hive ODBC Driver

MapReduce

HDFS

Big Data is what again?

HadoopMassivel

y Parallel Processing

Streaming

Machine Learning

Unstructured

Hadoop Ecosystem SnapshotETL Tools BI Reporting RDBMS

External Stores (S3, Azure Blobs,

Azure Data Market, etc)

Telemetry Management• Clickstream and

Application Log Analysis

• Sensor Data

IT Management• SLA Monitoring• Cyber Security• Forensic Analysis

When is big data a big fit?

Online Commerce• Sentiment Analysis• Recommendation

Engines• Search Indexing /

Quality

Financial Services• Risk Modeling• Threat Analysis• Fraud Detection• Credit Scoring

Replacement for relational - NO

Simply a VLDB - NO

Big data is not the only tool

Fast for subsets & filtered data - NO

The answer to everything - NO

Variability – Multiple interpretations

Velocity – Need decisions fast

VVVVroom

Variety – Many formats

Volume – beyond what environment can handle

Hive ODBC Driver

Sqoop

What does Microsoft bring to the table?

JavaScript

Hadoop On Azure - CTP

OpenSource Apache Hadoop

Elasticity

Familiar, reusable skills

Why is Microsoft Hadoop a fit for my Enterprise?

Ease of data movement

Interactivity

Visualization

Self Service

Those Seeking Insights

Information Workers

Who uses Big Data?

Anyone who uses BI now

Data Scientists / Data Teams

Hive ODBC Driver + Excel Add In

PowerPivot

How do we visualize the results?

Power View

Custom Tools

Take Action

Insights to Action

Discover Insights

Rinse and Repeat

What Big Data Is and Isn’t

Microsoft Hadoop

Data, Insights,Visualization

Big Summary

SQL, NoSQL, Hive

Big Data References

Hadoop: The Definitive Guide by Tom WhiteSQL Server Sqoop http://bit.ly/rulsjX JavaScript http://bit.ly/wdaTv6Twitter https://twitter.com/#!/search/%23bigdata Hive http://hive.apache.orgExcel to Hadoop via Hive ODBC http://tinyurl.com/7c4qjjjHadoop On Azure Videos http://tinyurl.com/6munnx2Klout http://tinyurl.com/6qu9php Microsoft Big Data http://microsoft.com/bigdataDenny Lee http://dennyglee.com/category/bigdata/ Carl Nolan http://tinyurl.com/6wbfxy9 Cindy Gross http://tinyurl.com/SmallBitesBigData

Thank You to our Sponsors

Fitting Microsoft Hadoop Into Your Enterprise BI Strategy

Cindy Gross | @SQLCindy | SQLCAT PMhttp://blogs.msdn.com/cindygross