+ All Categories
Home > Documents > Flightcaster_HUG

Flightcaster_HUG

Date post: 17-Jan-2015
Category:
Upload: guest3537ac
View: 319 times
Download: 0 times
Share this document with a friend
Description:
Flightcaster and HadoopHadoop Bay Area User Group, March 24
Popular Tags:
15
Transcript
Page 1: Flightcaster_HUG
Page 2: Flightcaster_HUG
Page 3: Flightcaster_HUG

75% of major delays     

less than 30 min. before departure

Page 4: Flightcaster_HUG
Page 5: Flightcaster_HUG
Page 6: Flightcaster_HUG

hadoopcascading     ->  clojure

infer cascading-clojurecrane

Open Source

Page 7: Flightcaster_HUG
Page 8: Flightcaster_HUG
Page 9: Flightcaster_HUG

Discrete Event Simulation?

Fuzzy Join with funky predicate?

Page 10: Flightcaster_HUG

group-by with secondary sort.

accumulator to simulate a discrete event simultor.

Page 11: Flightcaster_HUG
Page 12: Flightcaster_HUG

cascading-clojure: motivation

FP

dev

deploy

Page 13: Flightcaster_HUG

cascading-clojure: lessons learned

planner

serialization

data structures for wide data

Page 14: Flightcaster_HUG

cascading-clojure: future direction

functions + data structures

abstractions for planner and M/R

Page 15: Flightcaster_HUG