© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Three’s a Cloud: Three Important Use Cases for an On-Premise Cloud
Paul Weiss
Senior Cloud Engineer
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Agenda
• Eucalyptus Overview
• High Performance Computing (HPC) in the Cloud
• Scalable Web Services
• Dev / Test in the Cloud
2
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Eucalyptus Overview
Most widely-deployed software platform for on-premise IaaS clouds
25,000+ cloud starts to date and growing
AWS-compatible, enterprise-deployed
Deep cloud partner and AWS ecosystem
Open source developed
Gartner-recognized as major IaaS provider
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL © 2011 Eucalyptus Systems, Inc.
Eucalyptus IaaS
• An enterprise open source, on-premise cloud Infrastructure-as-a-Service (IaaS) software platform
• The most widely deployed software platform for on-premise Infrastructure as a Service Clouds
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Eucalyptus IaaS
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Who Uses Eucalyptus?
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Eucalyptus Use Cases
7
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Eucalyptus & HPC in the Cloud
8
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Why HPC in the Cloud?
HPC in the Cloud HPC Clusters
HW Configuration Flexible Fixed
SW Configuration Configurable by user Managed by a System
Administrator
Access Root privileges User privileges
Maintenance Overhead User does system
configuration / maintenance
Done by a System
Administrator
Performance Resources shared with
other cloud instances on the
same server
Bare metal performance
Nominal Cost Per Core Lower Higher
9
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
FutureGrid
• High performance test bed for scientists
• Distributed
• NSF funded
• 5000 cores
10
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
FutureGrid
11
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
FutureGrid Architecture
12
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Red Cloud – Cornell University
• Launched Oct 27, 2011
• Developed by Cornell – Center for Advanced Computing
• Flexible computing and data analysis resource for Cornell University researchers
• 96 cores
• 384 GB RAM
13
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Red Cloud Configuration
14
• Configuration
• Total
– 96 cores, 384GB RAM in 8 servers
• 8 Servers
– 2.7 GHz Xeon E5620 CPU’s (2 x 6 cores)
– 48GB of RAM (4GB/core)
– Maximum virtual server size:
• 12 coresm 48GB RAM
• 10 Gigabit Ethernet interconnect
• Storage
– 7.5TB
– Accessible by virtual servers via 10Gb iSCSI
• Software
– Eucalyptus 2.0.3 (Open Source)
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Red Cloud – Subscription Based
Cornell Users $500/core year*
Other Academic Institutions $750/core year*
15
• A core year is equal to 8585 hours
• Each subscription account includes 50GB of storage
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Why Red Cloud? • Predictable, Reproducible, Reliable Performance
– Published hardware specifications (CPU, RAM, network) and no oversubscription
• No Hidden Costs
– No cost for network traffic in or out of cloud
• Fast Access to Your Data
– Fast data transfers via 10Gb Ethernet in or out of the cloud – Free!
• Expert Help Available
– System, application and programming consulting are available
• Easy Budgeting with Subscriptions.
– No billing surprises!
• Amazon API Compatible
– Migrate when your requirements outgrow Red Cloud
16
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Eucalyptus & Scalable Web Services
17
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Puma.com
• All puma.com hosted from Eucalyptus
• 3.5 million page views per month
– 500 hits per second
• Multiple zones for redundancy
– Critical applications have multiple instances in multiple zones
• ~3 minutes to start new instance
– From start to fully configured
18
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
How they do it! • Total
– 80 cores, 320GB RAM in 10 servers
• 10 NC machines
– 2.13 Ghz L5360 CPU’s
– 32 GB RAM
• 2 Eucalyptus Zones
– Each Zone has 5 node controllers
• KVM
• Running in Managed mode
• Small images 5 or 6 GB
– Software installed on the fly
• Merlin
• Puppet
19
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Applications
• Moving to Ruby on Rails
• Site is Ruby on Rails CMS
• Redis for Ruby cache
• Legacy Java, Tomcat and PHP
20
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Management Tools
• Merlin – Ruby on Rails WebUI
• Munin – network resource monitoring
• Icinga – fork of Nagios
• Puppet – automation
• Syslog - logging
21
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Why Dev / Test in the Cloud?
22
Disconnected tools, servers, people
Slow build and release cycles
Multiple build and test systems across locations
Home-built systems are brittle, error-prone, and don’t scale
Difficult to manage build and test data, recreate after the fact
Difficult to audit processes, predict schedules
Time, money wasted on broken builds
Dedicated build/test servers not fully utilized
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Eucalyptus & Dev / Test
23
Dev
Dev QA Release Ops
Automate & accelerate dev-test-deploy process
IT
IT
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Dev / Test Cloud
24 24
IT
IT
Dev
Dev QA Release Ops
Development Cloud Automate any process on any resource
Dev Process
IT Resources
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL
Process and Control Issues
25
Dev Process Dev
Siloed, slow, manual – high chance of errors
No end to end visibility
Process per team with no best practices
No closed loop analysis & reporting
Dev QA Release Ops
© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL 26