Date post: | 01-Dec-2014 |
Category: |
Technology |
Upload: | redapt-inc |
View: | 512 times |
Download: | 2 times |
Mark WilliamsSVP Technology Solutions
Splunk> in the Hyperscale Private
CloudOctober 1, 2013
The Plan
Background
Setting the Stage… What is Hyperscale?
Setting the Stage… What is Private Cloud?
Architecting & Deploying Splunk> @ HyperscaleSplunk Use Cases and Impacts
Redapt can help at any scale
Background
SVP, Technology Solutions2013-Present
VP, Technical Support, Hosting, IT 1999-2008
VP Infrastructure Operations & Engineering (zCloud)2008-2012
Setting the Stage…Defining Hyperscale
Size: In four years…My “Day
1”+ 4 Years Reference
Infrastructure
~70 Servers
Tens of Thousands bit.ly/15wBfMp
DAU ~100,000 72,000,000 www.consulgamer.com/tag/zynga/
Servers/Game
1 - 20 50 to > 1,000 bit.ly/ahVaYI
Employees ~40 2,916 investor.zynga.com/faq.cfm
Biz Analytics 0 24.5T rows @ 1.4 PB bit.ly/L58opy
Splunk> N/A 10TB+ / 50B events
bit.ly/17f4kj2Daily Dynamics: Multiple Releases Daily per Game, Zynga Platform & Facebook Dependencies
Setting the Stage…Private Cloud
Evolution of zCloud Infrastructure and Operations
Traditional Infrastructure
Variety of Server Types in Retail DCOrder/Rack/Stack
Puppet Config Management
Public Cloud
Amazon EC2 + RightScaleScaling EverythingSRE/NOC
Private: “zCloud”
CloudStack + RightScale = AutoScaleCMDB3 Server SKUs
Centralized Services
Architecting Splunk> @ Hyperscale
Physical Layer - Indexers
• Data Center SKU
• High Density Storage – 2xSSD, 24xSATA
• 16 cores; 72-96 GB RAM
• Amazon EC2 SKU
• cc2.8xl – 32 Cores; 60GB RAM
• 4 x EBS volumes in RAID-0Physical Layer – Search Heads
• RightScale based: m2.4xl or zCloud “m72”
Architecting Splunk> @ Hyperscale
Logically
• Split Clusters of Indexers
• Dedicated Search Heads for Large Customers
• Shared/Multi-Tenant Search Heads for Others
Indexing Cluster
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Indexing Cluster
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Indexing Cluster
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
Idx
FV CV ZP MW Ops $ HC EA WWFCustSVC
SWF DS DZ CWF
SWF
HWF
Customers>
SH SH SH SH SH SH SH SH SH SH SH SHSearch Heads>
Deploying Splunk> @ Hyperscale
P1: Get all of our data into it. Puppet!
Engage early adopters and build useful dashboards and correlations.
Evolve from unstructured data to tagging, key-value pairs, and ultimately to structured logging
Culture: Demonstrate value early, Transparency, K.I.S.S., Iterate, Data-Driven
Alerting necessary, but not sufficient• Nagios + Splunk
Hyperscale Use Cases for Splunk>
Security: Bad actors, DDOS sources, eCrime forensics, PCI Dashboards
Customer Support: Ticket volumes, keywords, validate granted goods
Governance: Audit of privilege use; Mitigate game developer deployment access control concerns
Mission Critical: Release Monitoring!
SOX Controls: auditability of effective puppet changes & absence of changes outside of puppet
Splunk> Impacts @ Hyperscale
Improved Release Quality: Faster MTTR• Developers Can Go Home!
Improved Game Uptime• Any detectable downtime (~1-2 min) will affect 1M active
players• Downtime = Frustrated Players + Frustrated CFO
Governance: Mitigate game developer deployment access control concerns
Accommodate greater complexity in Platform + Game design dependencies for Increased “Social”.
Rapid Fault Isolation: Reduced Departmental Thrash
Redapt Overview
Redapt is a fast-growing infrastructure and solutions provider.Recognized leader identifying and driving adoption of innovative and disruptive technologies.
Most of our recommended partners are listed as ‘leaders’ in the Gartner Magic Quadrant.
Over 16 years of market experience across multiple technology platforms
What does Redapt do?
We deliver tightly integrated IT solutions using the best technologies available.
Each solution fits the business need–and delivers the highest possible value.
Solutions
Solutions
Integration CenterRapid data center infrastructure deployment. Simplify your build out. Let our team of engineers deploy a complete cost-effective solution that includes compute, data, power and management options.
Solutions
Global CapabilitiesGlobal delivery to the destination of your choice, in days not weeks. Redapt offers a turnkey supply chain and materials management system, providing you one point of contact from procurement to delivery.
Solutions
CloudCustomized Private and Hybrid Cloud Infrastructure from Start to Finish.
Solutions
Redapt ServicesOur portfolio of services including IT Services, IT Consulting, and Cloud Consulting offered by Redapt.
Solutions
Integration and Cloud Services
Cloud Service
s
Cloud Workshop• Identify Workloads•Design/Architect Compute, Storage, Network
•Tailor Service/Support Needs
•SOW
Installation@Redapt•Network•Storage•Compute•Hypervisors•Orchestration
Validation•Customer Remote Tour/Test•Shipment to Customer Prem•Onsite Training
Application Migration•Rearchitect Legacy Applications into “aaS” architectures
•Migrate applications from Public to Private or Hybrid Clouds
Project Management
Integration Services• Procurement• Integrated
Racks ready to go.
Mark WilliamsSVP Technology SolutionsT. 425.605.7129E. [email protected] Lindenbaum
VP, Business & Corporate Development
T. 425.605.7124E. [email protected]
Contact Information
Thank you!