Download - Enterprise data science - What it takes to build?

Enterprise data science learning solution

A practical approach to big data learning

CloneSkills, Inc.(916)-296-0228

Learn to lead big data - Enterprise data science a practical approach

CloneSkills, Inc.

http://www.CloneSkills.com

Architect : Karthik Rajamanickam


CloneSkills, Inc.



Objective

� Educate various key components that’s are typically used to deliver enterprise data sciences

� Demonstrate the steps to move data between Oracle 12C and HADOOP using Sqoop

� Review data flow between SAP HANA and HADOOP using smart data access


Our Enterprise Data Science Platform

HADOOP Distribution

SAP HANA Oracle 12C

Social | Forum | Blog | Web

File | Text

Analytics

What’s involved in building enterprise data science?


CloneSkills, Inc.




Our enterprise data science platform components - Our lab(CSLAB)


CloneSkills, Inc.



� SAP HANA

� SAP BOBJ

� Oracle 12C

� Oracle ODI

Enterprise Components

� HDFS

� HBase

� Hive

� Impala

� Pig

� Search

� Shell

� Mapreduce

� Sqoop

� OOIZE

� ZOOKEEPER

� Hue

� Dashboard

� Editor

HADOOP Components


Our (CSLAB) On demand Lab Infrastructure

__________________________________

� SAP HANA� SAP BOBJ� Oracle 12C� Oracle ODI� HADOOP


CloneSkills, Inc.



Node 1

Node 2

Node 3

Node 4

Node 5

Node 6

Our enterprise data science platform technical components


Our three (3) node

HADOOP cluster


CloneSkills, Inc.



Our enterprise data science platform - HADOOP infrastructure


Our HADOOP core

components

________________� Hive� Impala� Pig� Search� Hbase� Shell� Mapreduce� Sqoop� Hue� HDFS� OOIZE� ZOOKEEPER


CloneSkills, Inc.



Our enterprise data science platform - HADOOP components


Our HADOOP core

components

________________

� Hive

� Impala

� Pig

� Search

� Hbase

� Shell


CloneSkills, Inc.



Our enterprise data science platform - Hue components


Our Oracle 12 C

Infrastructure


CloneSkills, Inc.



Our enterprise data science platform - Oracle


Our Oracle 12 C

Infrastructure


CloneSkills, Inc.



Our enterprise data science platform - Oracle


Our Oracle ODI (

Oracle Data

Integrator)

Infrastructure


CloneSkills, Inc.



Our enterprise data science platform - Oracle data integrator (ODI)



CloneSkills, Inc.



SAP HANA

_______________

Smart Data Access

Connects SAP HANA

and HADOOP

Our enterprise data science platform – SAP HANA



CloneSkills, Inc.



SAP HANA

_______________

Smart Data Access

Connects SAP HANA

and HADOOP

Our enterprise data science platform - SAP HANA and HADOOP integration



CloneSkills, Inc.



HADOOP Distribution

Oracle 12C Sqoop

Import

Export

Steps to move data between Oracle and HADOOP using Sqoop



CloneSkills, Inc.



Oracle table and it’s

data

Review Oracle table – EMPLOYEE_JP



CloneSkills, Inc.



Sqoop Job

Sqoop job creation


CloneSkills, Inc.



Sqoop Job

____________

Create connection to

Oracle

Sqoop job creation - Create connection to Oracle



CloneSkills, Inc.



Sqoop Job

____________

Oracle source table

details

Sqoop job creation - Configure source table



CloneSkills, Inc.



Sqoop Job

____________

Oracle source table

and column details

Sqoop job creation - Configure source table and the primary key of the table



CloneSkills, Inc.



Sqoop Job

____________

Destination in

HADOOP ( HDFS

output files)

Sqoop job creation - Configure data target , HDFS files (output files)



CloneSkills, Inc.



Sqoop Job

____________

Job extraction log

Run Sqoop job - review job log



CloneSkills, Inc.



Sqoop Job

____________

HDFS destination

files

Sqoop job output - HDFS output file, destination files



CloneSkills, Inc.



Sqoop Job

____________

Oracle data in

HADOOP - preview

Sqoop job output - Oracle data in HADOOP HDFS files



CloneSkills, Inc.



Sqoop Job

____________

Data has been

imported from Oracle

to HADOOP

Sqoop Job

____________

We can also export

data from HADOOP

and then load them

into Oracle

Sqoop job output - Data has been moved from Oracle to HADOOP



CloneSkills, Inc.



Our enterprise data

sciences use case



CloneSkills, Inc.



Stay tuned, more to come Thank You !
