Introducing Cloudera DirectorJuly 28, 2015 @ Big Data Bash!

Andrei Savu, asavu@cloudera.com

Tech Lead, Cloudera Director

© 2014 Cloudera, Inc. All rights reserved.

Agenda

IntroductionProduct DemoWhat’s next?Questions

Journey to the Cloud

© 2014 Cloudera, Inc. All rights reserved.

DeploymentEasy deployment; no post-setup configurations

AWS Quick Start

Cloning clusters

Support for elasticity of compute and storage

Enterprise Deep security integration: Kerberos & Sentry

Cloudera Navigator : Audit / Lineage / Workflow

High Availability and resilient services

Manageability Manage clusters across multiple environments – on-premises and cloud

One dashboard to view all deployed clusters

Templates for saved workloads

IntegrationOpen console API for simple scripting and automation for scheduled actions

Open API plugin for cloud vendor of choice

Flexible Integration for controlled deployment in the cloud

© 2014 Cloudera, Inc. All rights reserved.

Object Storage (AWS S3, WASB, Swift, Google Cloud Storage)

Short running clustersElastic workloadNo local storage

Long-running clusters Sized to demandSome local storage

Fixed clusters Periodic syncLocal storage

App delivery - HBaseBI / Analysis – Impala, Search

ETL / Modeling– MR, Spark

Source Data DR/BackupSeed data

© 2014 Cloudera, Inc. All rights reserved.

Cloudera Director

Cloudera Navigator

Cloudera Manager CDH

Cluster

Cloudera Navigator

CLOUDERA ENTERPRISE

CDH Cluster

CDH

Cluster

Cloudera Navigator

Cloudera Manager CDH

Cluster

Cloudera Navigator

CLOUDERA ENTERPRISE

CDH Cluster

CDH

Cluster

Product Demo

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

© 2014 Cloudera, Inc. All rights reserved.

What’s next?

© 2014 Cloudera, Inc. All rights reserved.

Extensibility

AWS us-east-1Web UI

API console

SDKs

Orchestration EngineAPI SPI

Your Cloud

Cloudera Director

Cloudera Manager

© 2014 Cloudera, Inc. All rights reserved.

Improved User Interface

© 2014 Cloudera, Inc. All rights reserved.

Objectives for the cloud

Best performing Hadoop on any cloud environment – public or on-premises

Optimized software for new cloud deployment models

Deep integration with object stores for storage management

Cloud specific capabilities: elasticity, shared data across clusters, DevOps development model, flexible usage models

© 2014 Cloudera, Inc. All rights reserved.

Open questions. Got answers? Join us!

• How can 10s of minutes of configuration be reduced to a single digit?

• How can the size of the cluster be determined by usage?

• Do we need to expose clusters at all? Or just service endpoints?

• How can we create self-managing systems? And enable higher level ops?

• How can we scale to 10s of clusters with 100s of instances?

• What are the best ways to leverage cloud platform services?

Thanks! Join us! asavu@cloudera.com