+ All Categories
Home > Documents > DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The...

DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The...

Date post: 28-May-2020
Category:
Upload: others
View: 1 times
Download: 0 times
Share this document with a friend
61
DATA SCIENCE
Transcript
Page 1: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

DATA

SCIENCE

Page 2: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

PROCESS

MODEL

Page 3: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 3

Florian Dohmann Data Scientist @ *um

Page 4: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 4

*um The unbelievable Machine Company GmbH

Page 5: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 5

C L O U D S E R V I C E S

INTERNET APPLICATIONS

B I G D A T A

S P E C I A L I S T F O R

F R O M B E R L I N

Page 6: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 6

We create data

solutions.

Page 7: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 7

From idea

to cable.

Page 8: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 8

BORN

2008

Page 9: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 9

DATA SCIENCE

2011

Page 10: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 10

2013

Page 11: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 11

2015

Page 12: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 12

~100 Employees in Berlin & Vienna

Page 13: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 13

Data Science

Page 14: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 14

Custom Big

Data Analytics,

Machine

Learning & Co.

Page 15: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 15

Workshops

& Trainings

Support in creating

own Data Science

Teams

Page 16: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 16

= Full-

Service

Page 17: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 17

„We need a perfect

interplay of human &

machine intelligence“

Page 18: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 18

Process?

Page 19: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 19

http://en.wikipedia.org/wiki/Software_development_process#mediaviewer/

File:Three_software_development_patterns_mashed_together.svg

Page 20: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 20

Data Science Process Model: Stages

Page 21: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 21

Data Science Process Model

“What is needed to provide our customers a perfect search result?”

“Why does my conversion rate raise/fall?”

“How can we analyze 100GB+ of user data in a few hours for our recommender system?”

“How can we automatically tag our content to optimize targeting, advertising & search?”

“How can we segment customers based on interests?”

“In which context do customers talk about my products online?”

Page 22: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 22

Data Science Process Model

“Why does my conversion rate raise/fall?”

Page 23: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 23

Data Science Process Model: Stages & Lanes

Ideation / StorylineData Pool Creation

Explorative Analysis

Automated Analysis

Delivery & Storytelling

Production /Data Product

Bu

sin

ess

La

ne

Da

ta S

cie

nce

La

ne

Te

ch

no

log

y

La

ne

Page 24: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 24

Ideation / StorylineData Pool Creation

Explorative Analysis

Automated Analysis

Delivery & Storytelling

Production /Data Product

Business Owner

DataScientist

Machine Intelligence

Bu

sin

ess

La

ne

Da

ta S

cie

nce

La

ne

System Engineer

Infrastructure/Cloud

Te

ch

no

log

y

La

ne

Human-Machine Interplay

Data Science Process Model

created 2013 by *um - The unbelievable Machine Company GmbH

Page 25: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 25

Ideation / StorylineData Pool Creation

Explorative Analysis

Automated Analysis

Delivery & Storytelling

Production /Data Product

Business Owner

DataScientist

Machine Intelligence

Bu

sin

ess

La

ne

Da

ta S

cie

nce

La

ne

System Engineer

Infrastructure/Cloud

Te

ch

no

log

y

La

ne

Human-Machine Interplay

Data Science Process Model

created 2013 by *um - The unbelievable Machine Company GmbH

Page 26: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 26

log files

~ 100 GB

~ 2 Monate

Sample: 200 K

Page 27: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 27

Ideation / StorylineData Pool Creation

Explorative Analysis

Automated Analysis

Delivery & Storytelling

Production /Data Product

Business Owner

DataScientist

Machine Intelligence

Bu

sin

ess

La

ne

Da

ta S

cie

nce

La

ne

System Engineer

Infrastructure/Cloud

Te

ch

no

log

y

La

ne

Human-Machine Interplay

Data Science Process Model

created 2013 by *um - The unbelievable Machine Company GmbH

Page 28: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log
Page 29: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 29

80.18xxxx - - [19/Nov/2014:15:55:21 +0100] "GET /hd_de/checkout/onepage/success/ HTTP/1.1" 200 10341 "https://adomain/hd_de/checkout/onepage/"

"Mozilla/5.0 (iPad; CPU OS 7_0_4 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11B554a Safari/9537.53" 1635552

https

Conversion Rate Based On ..

Page 30: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 30

Exploration

Page 31: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 31

Exploration

Pattern: 0000000000000000001000000000000

Pattern: 0000000000010

Pattern: 00000000011

1

01

1000

11

010

100000

001

10

111

0001

0000001

0100

100

Page 32: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 32

Exploration

Page 33: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 33

Ideation / StorylineData Pool Creation

Explorative Analysis

Automated Analysis

Delivery & Storytelling

Production /Data Product

Business Owner

DataScientist

Machine Intelligence

Bu

sin

ess

La

ne

Da

ta S

cie

nce

La

ne

System Engineer

Infrastructure/Cloud

Te

ch

no

log

y

La

ne

Human-Machine Interplay

Data Science Process Model

created 2013 by *um - The unbelievable Machine Company GmbH

Page 34: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 34

*umDataMonitor Data Data

Automation

Page 35: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 35

Ideation / StorylineData Pool Creation

Explorative Analysis

Automated Analysis

Delivery & Storytelling

Production /Data Product

Business Owner

DataScientist

Machine Intelligence

Bu

sin

ess

La

ne

Da

ta S

cie

nce

La

ne

System Engineer

Infrastructure/Cloud

Te

ch

no

log

y

La

ne

Human-Machine Interplay

Data Science Process Model

created 2013 by *um - The unbelievable Machine Company GmbH

Page 36: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 36

Page 37: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 37

Page 38: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 38

Page 39: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 39

Ideation / StorylineData Pool Creation

Explorative Analysis

Automated Analysis

Delivery & Storytelling

Production /Data Product

Business Owner

DataScientist

Machine Intelligence

Bu

sin

ess

La

ne

Da

ta S

cie

nce

La

ne

System Engineer

Infrastructure/Cloud

Te

ch

no

log

y

La

ne

Human-Machine Interplay

Data Science Process Model

created 2013 by *um - The unbelievable Machine Company GmbH

Page 40: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 40

Development

Page 41: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 41

Thanks!

Page 42: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 42

The unbelievable Machine Company GmbH Grolmanstr. 40

10623 Berlin

Contact:

Florian Dohmann

[email protected]

Tel. +49-30-889 26 56 – 36

Mobile +49-173 75 22 140

Page 43: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 43

What we also

need ..

Page 44: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 44

A Great Team

Page 45: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 45

Page 46: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 46

+ Algorithms

Page 47: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 47

Machine Learning

Magic?

Page 48: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 48

Machine Learning & Co.

Page 49: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 49

+ Programming

Page 50: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 50

created 2013 by *um - The unbelievable Machine Company GmbH

Python & Co.

Page 51: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 51

e.g. PYTHON

created 2013 by *um - The unbelievable Machine Company GmbH

Page 52: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 52

Hadoop

created 2013 by *um - The unbelievable Machine Company GmbH

Hadoop & Co.

Page 53: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 53

+ Stream

processing

Page 54: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 54

Storm & Co.

Page 55: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 55

Page 56: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 56

+ Infrastructure

Page 57: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 57

Dedicated

Page 58: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 58

Cloud

Page 59: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 59

Data visualisation

Visuals /

Interfaces

Page 60: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 60

Thanks 2!

Page 61: DATA SCIENCE - Fachhochschule Salzburg · Data Science Process Model created 2013 by *um - The unbelievable Machine Company GmbH. 20.11.14 The unbelievable Machine Company 26 log

20.11.14 The unbelievable Machine Company 61

The unbelievable Machine Company GmbH Grolmanstr. 40

10623 Berlin

Contact:

Florian Dohmann

[email protected]

Tel. +49-30-889 26 56 – 36

Mobile +49-173 75 22 140


Recommended