Redapt @ splunk .conf 2013 splunk in the hyperscale private cloud

transcript

Mark WilliamsSVP Technology Solutions

Splunk> in the Hyperscale Private

CloudOctober 1, 2013

The Plan

Background

Setting the Stage… What is Hyperscale?

Setting the Stage… What is Private Cloud?

Architecting & Deploying Splunk> @ HyperscaleSplunk Use Cases and Impacts

Redapt can help at any scale

Background

SVP, Technology Solutions2013-Present

VP, Technical Support, Hosting, IT 1999-2008

VP Infrastructure Operations & Engineering (zCloud)2008-2012

Setting the Stage…Defining Hyperscale

Size: In four years…My “Day

1”+ 4 Years Reference

Infrastructure

~70 Servers

Tens of Thousands bit.ly/15wBfMp

DAU ~100,000 72,000,000 www.consulgamer.com/tag/zynga/

Servers/Game

1 - 20 50 to > 1,000 bit.ly/ahVaYI

Employees ~40 2,916 investor.zynga.com/faq.cfm

Biz Analytics 0 24.5T rows @ 1.4 PB bit.ly/L58opy

Splunk> N/A 10TB+ / 50B events

bit.ly/17f4kj2Daily Dynamics: Multiple Releases Daily per Game, Zynga Platform & Facebook Dependencies

Setting the Stage…Private Cloud

Evolution of zCloud Infrastructure and Operations

Traditional Infrastructure

Variety of Server Types in Retail DCOrder/Rack/Stack

Puppet Config Management

Public Cloud

Amazon EC2 + RightScaleScaling EverythingSRE/NOC

Private: “zCloud”

CloudStack + RightScale = AutoScaleCMDB3 Server SKUs

Centralized Services

Architecting Splunk> @ Hyperscale

Physical Layer - Indexers

• Data Center SKU

• High Density Storage – 2xSSD, 24xSATA

• 16 cores; 72-96 GB RAM

• Amazon EC2 SKU

• cc2.8xl – 32 Cores; 60GB RAM

• 4 x EBS volumes in RAID-0Physical Layer – Search Heads

• RightScale based: m2.4xl or zCloud “m72”

Architecting Splunk> @ Hyperscale

Logically

• Split Clusters of Indexers

• Dedicated Search Heads for Large Customers

• Shared/Multi-Tenant Search Heads for Others

Indexing Cluster

FV CV ZP MW Ops $ HC EA WWFCustSVC

SWF DS DZ CWF

Customers>

SH SH SH SH SH SH SH SH SH SH SH SHSearch Heads>

Deploying Splunk> @ Hyperscale

P1: Get all of our data into it. Puppet!

Engage early adopters and build useful dashboards and correlations.

Evolve from unstructured data to tagging, key-value pairs, and ultimately to structured logging

Culture: Demonstrate value early, Transparency, K.I.S.S., Iterate, Data-Driven

Alerting necessary, but not sufficient• Nagios + Splunk

Hyperscale Use Cases for Splunk>

Security: Bad actors, DDOS sources, eCrime forensics, PCI Dashboards

Customer Support: Ticket volumes, keywords, validate granted goods

Governance: Audit of privilege use; Mitigate game developer deployment access control concerns

Mission Critical: Release Monitoring!

SOX Controls: auditability of effective puppet changes & absence of changes outside of puppet

Splunk> Impacts @ Hyperscale

Improved Release Quality: Faster MTTR• Developers Can Go Home!

Improved Game Uptime• Any detectable downtime (~1-2 min) will affect 1M active

players• Downtime = Frustrated Players + Frustrated CFO

Governance: Mitigate game developer deployment access control concerns

Accommodate greater complexity in Platform + Game design dependencies for Increased “Social”.

Rapid Fault Isolation: Reduced Departmental Thrash

Redapt Overview

Redapt is a fast-growing infrastructure and solutions provider.Recognized leader identifying and driving adoption of innovative and disruptive technologies.

Most of our recommended partners are listed as ‘leaders’ in the Gartner Magic Quadrant.

Over 16 years of market experience across multiple technology platforms

What does Redapt do?

We deliver tightly integrated IT solutions using the best technologies available.

Each solution fits the business need–and delivers the highest possible value.

Solutions

Integration CenterRapid data center infrastructure deployment. Simplify your build out. Let our team of engineers deploy a complete cost-effective solution that includes compute, data, power and management options.

Solutions

Global CapabilitiesGlobal delivery to the destination of your choice, in days not weeks. Redapt offers a turnkey supply chain and materials management system, providing you one point of contact from procurement to delivery.

Solutions

CloudCustomized Private and Hybrid Cloud Infrastructure from Start to Finish.

Solutions

Redapt ServicesOur portfolio of services including IT Services, IT Consulting, and Cloud Consulting offered by Redapt.

Solutions

Integration and Cloud Services

Cloud Service

Cloud Workshop• Identify Workloads•Design/Architect Compute, Storage, Network

•Tailor Service/Support Needs

•SOW

Installation@Redapt•Network•Storage•Compute•Hypervisors•Orchestration

Validation•Customer Remote Tour/Test•Shipment to Customer Prem•Onsite Training

Application Migration•Rearchitect Legacy Applications into “aaS” architectures

•Migrate applications from Public to Private or Hybrid Clouds

Project Management

Integration Services• Procurement• Integrated

Racks ready to go.

Mark WilliamsSVP Technology SolutionsT. 425.605.7129E. Markw@redapt.comJosh Lindenbaum

VP, Business & Corporate Development

T. 425.605.7124E. Joshl@redapt.com

Contact Information

Thank you!