2006 2016

My Hadoop Journey

1 ° ° °

° ° ° N

HDFS

MapReduce

YARN.NEXT 2010

YARN1 ° ° ° °

° ° ° ° N

HDFS (redundant, reliable storage)

OthersISV Engines

MapReduceV2

SQLHive

NoSQLHBase

AccumuloPhoenix

StreamStorm

In-memory

Spark

2011

What is the Destiny of Data?

4ZBDATA

MOBILE DEVICES

HUMANCONTENT

INTERNET OF

THINGS

44ZBDATA

Page 5 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Data Trends

Data Trends

Internet of Anything

Aggregate any and all IoAT data from sensors, machines, geolocation, clicks, files, social

Mediate secure point-to-point and bi-directional data flows

7

Data Trends

It is cheap to create, collect and curate all data

8

Data Trends

ContainerizationVirtualization

9

Data TrendsModern Applications Are Data Applications

Ease of consume & Operate

Secure Repeatable

The Menu of a Data First Application

YARN.NEXT

Assemble

Select Engines & Services

Wire Secure & OperateApp Data

Service

Engine

Engine Data

Security Admin

Service

The Future of Hadoop

YARN.next

DATA ACCESS APPS

Docker Docker Docker

SQLHive

NoSQLHBase

AccumuloPhoenix

StreamStorm

In-memory

Spark

OthersISV Engines

MapReduce

V2

MySQL Tomcat Other

10 Years of Hadoop!

2006 20162011

Thank You!Arun Murthy @acmurthy