Big Data Platform

Post on 08-Apr-2022

9 views 0 download

transcript

Big Data Platform

Assoc. Prof. Dr. Thanachart NumnondaExecutive Director, IMC InstituteAj. Araya FlorenceLecturer - Ubon Ratchathani University11 September 2015

2

Technology

Analytics

Data Sources

3

“B ัy 2015, 20% of Global 1000 organizationsWill have established a strategic focus on

information infrastructure ”

Gartner

4

The Need for new technology

Size of data is too big

RDBMS are the square peg for all roundholes

Not all data requires ACID

Many data are unstructure

5

Big Data Technology !!

6

Big Data Technology

Storage Analytics

7

A scalable fault-tolerant distributed system for data storage and processing

Completely written in javaOpen source & distributed under Apache license

What is Hadoop?

8

Hadoop Environment

Source: Hadoop in Practice; Alex Holmes

9

Hadoop 2

10

Hadoop Distribution

Microsoft Azure

11

Big Data Future Architecture

Sscial Media Images e-mails Crawlers ERP CRM LOB APPs

Unstructured and Structured Data

Data Warehouse / NewSQL

Hadoop OnCloud

Hadoop OnPrivateServer

Connectors

SSRS

BI Platform

Familiar End User ToolsSpreadsheet Predictive Analytics

Data Market Place

NoSQL

Petabytes of Data(Unstructured)

Hundreds of TB of Data(structured)

12

13

Hadoop Led the Way

14

Big Data Platform: Demo

15

Hadoop Cluster

16

Storage: HDFS

17

Hadoop: Analytics

18

19Source: http://www.datadansandler.com/

20

www.facebook.com/imcinstitute

21

Thank you

thanachart@imcinstitute.comwww.facebook.com/imcinstitutewww.slideshare.net/imcinstitutewww.thanachart.org