KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES

Alessio Comisso

2 16/10/15

KEEDIO is a joint business initiative of Santander Group with the Alfonso X el Sabio University, specialized in Big Data & Cloud Computing technologies.

WHO IS KEEDIO? “Solve real-world problems related to data processing, based on talent, and the use of disruptive and innovative technologies”

KEEDIO actively participate in the community contributing with patches to existing third party open-source projects in the Big Data and Cloud ecosystem.

We have developed several open source projects in order to facilitate the building. Those projects are, among others:

3

KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES KEEDIO OPEN SOURCE

You are welcome to contribute to them J

http://github.com/keedio

BUILDOOP Hadoop Ecosystem Builder.

KEEDIO STACK Big Data Ecosystem tools integrated together with Apache Ambari.

Apache Flume plugins Several sources, interceptors and sinks to ingest any kind of data to your data lake.

Kafka-HUE & Storm-Hue HUE apps for Apache Kafka and Apache Storm.

KEEDIO OpenStack Sahara plugin Big Data as a Service.

@keedio #BDS15

At KEEDIO we have defined our own technology STACK, based on the most widely used tools of the Big Data ecosystem, along with our custom-developed plugins and add-ons. We use technologies like VAGRANT and APACHE AMBARI to streamline provisioning, deployment, and process monitoring. In our software stack, these tools rely on the availability of packaged architectures produced by BUILDOOP. This way, defining and deploying Big Data software stacks is easier than ever!

Thanks to the integration effort between APACHE AMBARI and the different Big Data tools, our users can enjoy their own Big Data customized distributions, specifically tailored to their needs.

Junio 15

KEEDIO STACK

4

KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES

@keedio #BDS15

KEEDIO STACK

5

KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES

DEVELOPER

§  Near zero time configuration

§  Fully reproducible

§  Simplify deployment

§  Quick configuration

§  Pre-Tested integration

SYSADMIN DATA SCIENTIST

§  Turn-key solution

§  Point and click §  Simplified tuning

@keedio #BDS15

“Vagrant provides easy to configure, reproducible, and portable work environments built on top of

industry-standard technology and controlled by a single consistent workflow…”

KEEDIO-VAGRANT

6

KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES

@keedio #BDS15

With Puppet, you define the state of your IT infrastructure, and Puppet automatically enforces the desired state. Puppet automates every step of the software delivery process, from

provisioning of physical and virtual machines to orchestration and reporting

PUPPET PROVISIONER

7

KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES

@keedio #BDS15

We will deploy our stack on a Openstack based private cloud (Juno). We will use the

vagrant-openstack-provider project to leverage vagrant on this infrastructure.

OPENSTACK PRIVATE CLOUD

8

KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES

@keedio #BDS15

9

KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES ARCHITECTURES

@keedio #BDS15

10

DEMO TIME

We are going to deploy a cluster with Security enabled

in minutes

Let’s get started!

11

KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES DEMO

@keedio #BDS15

12

KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES DEMO

@keedio #BDS15

13

KEEDIO STACK: BDaaS DEPLOYMENT FOR DUMMIES

@keedio #BDS15

You are invited to our next workshop in the following weeks. Sign up to our newsletter to stay tuned:

http://www.keedio.com

Download and try yourself the KEEDIO-Vagrant demo at:

http://www.keedio.org/demo

@keedio

Thanks!