+ All Categories
Home > Documents > 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang...

2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang...

Date post: 18-Jan-2018
Category:
Upload: maude-cummings
View: 213 times
Download: 0 times
Share this document with a friend
Description:
Analyzes the Hadoop architecture and MapReduce Working principle How to write Mapper and Reducer classes, and how to use the object 3
9
2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang The Application of MapReduce in the Cloud Computing Speaker : Kun-Hsiang, Chang 1
Transcript
Page 1: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.

2011 International Symposium on Intelligence Information Processing and Trusted ComputingHuanggang Normal University Hubei, ChinaGaizhen Yang

The Application of MapReduce in the Cloud Computing

Speaker : Kun-Hsiang, Chang

1

Page 2: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.

• Abstract• Hadoop• MapReduce• MapReduce Programmed To Perform Task

2

Outline

Page 3: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.

Analyzes the Hadoop architecture and MapReduce Working principle

How to write Mapper and Reducer classes, and how to use the object

3

Abstract

Page 4: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.

NameNode

DataNode

Client

4

Hadoop-HDFS

Page 5: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.

5

Hadoop-MapReduce

Page 6: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.

6

MapReduce

Page 7: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.

MapReduce programs can be run in three modes:

Standalone Mode

Pseudo-distributed Mode

Fully-distributed Mode

7

MapReduce

Page 8: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.

Inputs division and dispatch

task configuration

task executive

Create customized Mapper and Reducer

8

MapReduce Programmed To Perform Task

Page 9: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.

Speaker : Kun-Hsiang, Chang

End…

9


Recommended