+ All Categories
Home > Technology > Redapt @ splunk .conf 2013 splunk in the hyperscale private cloud

Redapt @ splunk .conf 2013 splunk in the hyperscale private cloud

Date post: 01-Dec-2014
Category:
Upload: redapt-inc
View: 512 times
Download: 2 times
Share this document with a friend
Description:
Splunk on a hyperscale private cloud by Mark Williams of Redapt, Inc.
21
Mark Williams SVP Technology Solutions Splunk> in the Hyperscale Private Cloud October 1, 2013
Transcript
Page 1: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Mark WilliamsSVP Technology Solutions

Splunk> in the Hyperscale Private

CloudOctober 1, 2013

Page 2: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

The Plan

Background

Setting the Stage… What is Hyperscale?

Setting the Stage… What is Private Cloud?

Architecting & Deploying Splunk> @ HyperscaleSplunk Use Cases and Impacts

Redapt can help at any scale

Page 3: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Background

SVP, Technology Solutions2013-Present

VP, Technical Support, Hosting, IT 1999-2008

VP Infrastructure Operations & Engineering (zCloud)2008-2012

Page 4: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Setting the Stage…Defining Hyperscale

Size: In four years…My “Day

1”+ 4 Years Reference

Infrastructure

~70 Servers

Tens of Thousands bit.ly/15wBfMp

DAU ~100,000 72,000,000 www.consulgamer.com/tag/zynga/

Servers/Game

1 - 20 50 to > 1,000 bit.ly/ahVaYI

Employees ~40 2,916 investor.zynga.com/faq.cfm

Biz Analytics 0 24.5T rows @ 1.4 PB bit.ly/L58opy

Splunk> N/A 10TB+ / 50B events

bit.ly/17f4kj2Daily Dynamics: Multiple Releases Daily per Game, Zynga Platform & Facebook Dependencies

Page 5: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Setting the Stage…Private Cloud

Evolution of zCloud Infrastructure and Operations

Traditional Infrastructure

Variety of Server Types in Retail DCOrder/Rack/Stack

Puppet Config Management

Public Cloud

Amazon EC2 + RightScaleScaling EverythingSRE/NOC

Private: “zCloud”

CloudStack + RightScale = AutoScaleCMDB3 Server SKUs

Centralized Services

Page 6: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Architecting Splunk> @ Hyperscale

Physical Layer - Indexers

• Data Center SKU

• High Density Storage – 2xSSD, 24xSATA

• 16 cores; 72-96 GB RAM

• Amazon EC2 SKU

• cc2.8xl – 32 Cores; 60GB RAM

• 4 x EBS volumes in RAID-0Physical Layer – Search Heads

• RightScale based: m2.4xl or zCloud “m72”

Page 7: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Architecting Splunk> @ Hyperscale

Logically

• Split Clusters of Indexers

• Dedicated Search Heads for Large Customers

• Shared/Multi-Tenant Search Heads for Others

Indexing Cluster

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Indexing Cluster

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Indexing Cluster

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

Idx

FV CV ZP MW Ops $ HC EA WWFCustSVC

SWF DS DZ CWF

SWF

HWF

Customers>

SH SH SH SH SH SH SH SH SH SH SH SHSearch Heads>

Page 8: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Deploying Splunk> @ Hyperscale

P1: Get all of our data into it. Puppet!

Engage early adopters and build useful dashboards and correlations.

Evolve from unstructured data to tagging, key-value pairs, and ultimately to structured logging

Culture: Demonstrate value early, Transparency, K.I.S.S., Iterate, Data-Driven

Alerting necessary, but not sufficient• Nagios + Splunk

Page 9: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Hyperscale Use Cases for Splunk>

Security: Bad actors, DDOS sources, eCrime forensics, PCI Dashboards

Customer Support: Ticket volumes, keywords, validate granted goods

Governance: Audit of privilege use; Mitigate game developer deployment access control concerns

Mission Critical: Release Monitoring!

SOX Controls: auditability of effective puppet changes & absence of changes outside of puppet

Page 10: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Splunk> Impacts @ Hyperscale

Improved Release Quality: Faster MTTR• Developers Can Go Home!

Improved Game Uptime• Any detectable downtime (~1-2 min) will affect 1M active

players• Downtime = Frustrated Players + Frustrated CFO

Governance: Mitigate game developer deployment access control concerns

Accommodate greater complexity in Platform + Game design dependencies for Increased “Social”.

Rapid Fault Isolation: Reduced Departmental Thrash

Page 11: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Redapt Overview

Redapt is a fast-growing infrastructure and solutions provider.Recognized leader identifying and driving adoption of innovative and disruptive technologies.

Most of our recommended partners are listed as ‘leaders’ in the Gartner Magic Quadrant.

Over 16 years of market experience across multiple technology platforms

Page 12: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

What does Redapt do?

We deliver tightly integrated IT solutions using the best technologies available.

Each solution fits the business need–and delivers the highest possible value.

Page 13: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Solutions

Page 14: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Solutions

Integration CenterRapid data center infrastructure deployment. Simplify your build out. Let our team of engineers deploy a complete cost-effective solution that includes compute, data, power and management options.

Page 15: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Solutions

Global CapabilitiesGlobal delivery to the destination of your choice, in days not weeks. Redapt offers a turnkey supply chain and materials management system, providing you one point of contact from procurement to delivery.

Page 16: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Solutions

CloudCustomized Private and Hybrid Cloud Infrastructure from Start to Finish.

Page 17: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Solutions

Redapt ServicesOur portfolio of services including IT Services, IT Consulting, and Cloud Consulting offered by Redapt.

Page 18: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Solutions

Page 19: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Integration and Cloud Services

Cloud Service

s

Cloud Workshop• Identify Workloads•Design/Architect Compute, Storage, Network

•Tailor Service/Support Needs

•SOW

Installation@Redapt•Network•Storage•Compute•Hypervisors•Orchestration

Validation•Customer Remote Tour/Test•Shipment to Customer Prem•Onsite Training

Application Migration•Rearchitect Legacy Applications into “aaS” architectures

•Migrate applications from Public to Private or Hybrid Clouds

Project Management

Integration Services• Procurement• Integrated

Racks ready to go.

Page 20: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Mark WilliamsSVP Technology SolutionsT. 425.605.7129E. [email protected] Lindenbaum

VP, Business & Corporate Development

T. 425.605.7124E. [email protected]

Contact Information

Page 21: Redapt @ splunk .conf 2013   splunk in the hyperscale private cloud

Thank you!


Recommended