Converging Big Data and Application Infrastructure by Steven Poutsy

Post on 16-Apr-2017

154 views 1 download

transcript

Converging Big Data and Application InfrastructureSteven PoustyOpenShift/Red Hat@TheSteve0 on Twitter, IRC, SmugMug, Github,Ingress, Instagram, Skype, and

Goals

1. Brief introduction to how things have evolved

2. Talk about what we have now

3. Demo of this in practice

4. Have fun!

Assumptions

1. You have written a web app at some point in your life

2. You know some basics of Spark and such

Where are we coming from

What about Apps?

This page intentionally left blank

Next Era

Welcome to Paradise

We have had some great developments1. People figured out how to make commodity hardware do great things

2. Distributed software has gotten better

3. Programming languages have gotten easier

4. CS has put effort into statistical libraries

5. The browser has grown up

Example framework

Docker Containers

Kubernetes (via OpenShift)

Node.JS and Python

Spark (via Oshinko)

WINNING!

See it in Action

Wrap up

We are luckyWe can still do analysis on our desktop if we want

But now we can easily integrate

1. Data or APIs

2. Statistics and Machine Learning

3. Interactive Web Applications

To Do this on your own:1. To run your own OpenShift either:

https://www.openshift.org/vm/Or

oc cluster up (get oc here - https://github.com/openshift/origin/releases )

2. To get Oshinko:https://github.com/radanalyticsio then you need oshinko-rest and oshinko-console

3. For the word analysis app get it here: https://github.com/ophicleide

We LOVE pull requests

Fin!