Post on 19-Jun-2015
transcript
© 2014 IBM Corporation
Cloud Foundry on OpenStackAutomated Lifecycle Management Animesh Singh @AnimeshSingh
IBM Cloud Architect
2 © 2014 IBM Corporation
Cloud Foundry on OpenStack!
Apps
3 © 2014 IBM Corporation
Cloud Foundry & OpenStack - Top Two Open Source Technologies!
http://analystpov.com/cloud-computing/top-15-open-source-cloud-computing-technologies-2014-24727
4 © 2014 IBM Corporation
Meets Developer’s NeedsFocus on app development, not provisioning VMs, databases, messaging servers, etcAgile development modelDeploy and scale in seconds
Open Cloud PlatformThere is an increasing appetite for cloud-based mobile, social and analytics applications from line-of-business executives - drives the need for a more open cloud development platform
Compelling Community Cloud Foundry has a compelling community and emerging ecosystem as well as a mature set of capabilities and robustness
Platinum Founding Sponsors1.3k 739k
LINES OF CODETOTAL CONTRIBUTORS
Cloud Foundry Overview
5 © 2014 IBM Corporation
Eclipse IDE
CLI
Browser
cf push
http
Cloud Foundry Developer Experience
6 © 2014 IBM Corporation
Eclipse IDE
CLI
Browser
cf push
http
Cloud Controller(API)
Router
DEA Pool DEA Pool Droplet Execution
Agent (DEA) VM Pool
HealthManager
NATS(Message bus)
Cloud Foundry Architecture
7 © 2014 IBM Corporation
IBM BlueMix (powered by Cloud Foundry)http://bluemix.net
IBM initiative to develop a Platform as a Services offering
IBM and partner cloud services
Integrated DevOps with both Browser and Eclipse-based tools
Services
Lifecycle Management
(JazzHub)
ApplicationRuntime
Runtimes &Frameworks
Middleware Application Operational Mobile ExternalData
node java ruby WorklightWebSphereLiberty
Web IDE(Eclipse Orion)
Eclipse IDEApplication
CompositionEnvironment
Create & Manage Services
Test/Run Test/Run
ExploreServices
ExploreServices
IBM Bluemix ™Check In Code Check In Code
8 © 2014 IBM Corporation
IBM Bluemix (http://bluemix.net)
9 © 2014 IBM Corporation
OpenStack Swift Object Storage Service Available in Bluemix!
10 © 2014 IBM Corporation
Integrate !
11 © 2014 IBM Corporation
PaaS
Cloud
Integration
IaaS
UAA
Router
DEA Pool Apps
Service Connector
Health Manager
Messaging
Cloud Controller
Build Packs
Service Nodes
BOSHCloud Provider Interface
Cloud Foundry , OpenStack Integration
• Static / floating ips• Persistent disks• Custom VM
Configurations• Specialized Security
groups
12 © 2014 IBM Corporation
BOSH deployment process
Deployment Manifest• Release name/version• # VMs, job params• Stemcells to use
Stemcell• Base OS• BOSH agent
Release• Name• Software packages• Config templates• Scripts
BOSH
DeployedCloud Foundry
Virtual Machine• Configuration• Software Packages
Virtual Machine• Configuration• Software Packages
Virtual Machine• Configuration• Software Packages
Virtual Machine• Configuration• Software packages
13 © 2014 IBM Corporation
Automate the Lifecycle (Leverage the power of community) !
14 © 2014 IBM Corporation
Leverage the power of Open Source Community• Open technologies give us a tremendous amount of power and flexibility to integrate them together
seamlessly• Lets see some of the examples of what we can do with the power of Open technologies to go from bare metal hardware to a deployed Cloud Foundry ready to push apps
Open Source for Cloud Foundry and OpenStack Automation!
15 © 2014 IBM Corporation
OpenStack Installation:• Leverage the open source Chef Cloud infrastructure Automation framework• Requires information about hardware, network environment and software repositories.• Automate OpenStack installation in approximately 15 minutes!
Chef for OpenStack Install Automation
Setup Compute
Setup Network
Setup Controller
Setup Storage
16 © 2014 IBM Corporation
OpenStack Discovery:• Leverage the open source Fog gem to discover OpenStack artifacts in an automated manner • Require OpenStack credentials and discover OpenStack compute and network information.
Fog for OpenStack Discovery Automation
Discover VM Configuration Sizes
Discover NetworkSubnets
Discover Network Security Rules
Discover DHCP , DNS Gateway and floating IPs
Discover Security Credentials
17 © 2014 IBM Corporation
Fog for OpenStack Setup Automation
Cloud Foundry Pre-req setup on OpenStack:• Leverage the open source Fog gem to setup Cloud Foundry requirements in an automated manner • Setup according to best practices and guidelines – still giving users the flexibility to change if desired
Create Security Credentials
Create VM configs for Router, DEAs, Cloud Controller, Service Nodes
Create network Security Rules
Setup tenant quota
18 © 2014 IBM Corporation
BOSH and Ruby for Cloud Foundry Deployment AutomationCloud Foundry Deployment Automation
• Automate base OS image creation or modification • Automate Cloud Foundry deployment manifest file genration using Ruby ERB• Automate upload of Cloud Foundry core release, services and runtime frameworks, followed by Cloud
Foundry deployment
Stemcell Creation and Upload
Generate BOSH and Cloud Foundry Manifest
Upload Cloud Foundry core, Services and runtime
Deploy Cloud Foundry
Deploy Microbosh
RUBY BOSH
19 © 2014 IBM Corporation
Automate end to end deployments in under an hour !• Previous example signify the power of Open source community• Leveraging tools like Chef, Fog, BOSH, Ruby ERB from the community can help create powerful
automation which can be repeatedly and consistently replicated in under an hour!
Open way is the only way!
BOSH
RUBY
20 © 2014 IBM Corporation
Automate the Update/Upgrade!
21 © 2014 IBM Corporation
Automate the update/upgrade lifecycle operations• Updates can be automated using code from the initial automated deployment (e.g. bosh deploy)• Follow te same workflow – do OpenStack discovery operation, and then leverage BOSH for
update/upgrade/• To ensure application availability throughout the update, use tools like JMeter to test application responsiveness
Updates/Upgrades Automation!
22 © 2014 IBM Corporation
Application Uptime during Updates/Upgrades Automation!
23 © 2014 IBM Corporation
Scale!
24 © 2014 IBM Corporation
Scaling OpenStackOptimize Internal Communication
• Configure OpenStack for scaled concurrency
Optimize Performance• Configure OpenStack scheduler to evenly distribute load
Setup Highly Available Architecture for PaaS workloads
Load Balancer Nodes
DataNodes
3x
Compute Nodes
15xStorage
Nodes
2x
Controller Nodes
2x 6x
25 © 2014 IBM Corporation
Scaling Cloud Foundry / BOSHOptimize Internal Communication
• Configure messaging bus for VM communication
Optimized routing and bandwidth allocation• Isolate Cloud Foundry components using multiple networks
Maintain Cloud Foundry’s Highly Available Architecture
Service Gateways
10xRouters
3x
Service Nodes15x
DEAs20x
Cloud Controllers
2x
26 © 2014 IBM Corporation
Why Cloud Foundry and OpenStack are a great fit ?
• 100% Open PaaS and IaaS solutions – No vendor lock-ins • Strong and growing community of contributors and sponsors on both sides
• Power of Open Source community can be leveraged to automate the deployment and lifecycle management of Cloud Foundry on OpenStack
• OpenStack meets Cloud Foundry integration requirements, and is totally configurable and adaptable to handle the scale of a PaaS solution like Cloud Foundry
• Bottom Line: They are a great fit!
27 © 2014 IBM Corporation
What next? Join us at our Silicon Valley Meetups
http://www.meetup.com/BlueMix/
http://www.meetup.com/CloudFoundry/
For more technical details, refer to the slides and video herehttp://www.slideshare.net/AnimeshSingh/optimizing-cloud-foundry-and-openstack-for-large-scale-deploymentshttps://www.openstack.org/assets/presentation-media/A-Practical-Approach-to-HA-Final.pdfhttps://www.youtube.com/watch?v=jCwtV9n_ak4https://www.youtube.com/watch?v=FsrCGkBo4Vg
28 © 2014 IBM Corporation
IBM Sponsored Sessions on Wednesday, November 5th 9:50 in Room 243
Step on the Gas: See how Open Technologies are driving the future of the enterpriseTodd Moore, Director, Open Technologies and PartnershipsDavid Lindquist, Chief Technology Officer / Vice President Strategy and Architecture
11:50 Room 212/213
IBM and OpenStack: Collaborations beyond the code Manuel Silveyra, Daniel Krook
13:50 Room 212/213
A Use Case Driven view of IBM’s OpenStack based Offerings Moe Abdula, Vice President of Cloud Strategy
14:40 Room 212/213
IBM OpenStack Offerings in Action Moe Abdula, Vice President of Cloud Strategy
29 © 2014 IBM Corporation
IBM Technical Sessions IBM Sessions on Monday, November 3rd 15:20
R.251When Disaster Strikes the Cloud: Who, What, When, Where and How to recover Ronen Kat, Michael Factor, and Red Hat
11:40A.Blue
IPv6 Features in OpenStack Juno Xu Han Peng, Comcast, and Cisco
15:20R252
Why is my Volume in 'ERROR' State!?! An Introduction to Troubleshooting Your Cinder Configuration Jay Bryant
16:20A.Blue
Group Based Policy Extension for NetworkingMohammad Banikazemi, Cisco, Midokura, and One Convergence
IBM Sessions on Tuesday. November 4th 11:15
R252 The perfect match: Apache Spark meets Swift. Gil Vernik, Michael Factor, and Databricks
15:40R242
Docker Meets Swift: A Broadcaster's ExperienceEran Rom, and RAI
16:40Maillot
User Group Panel: India, Japan, China Ying Chun Guo, Guang Ya Liu, Qiang Guo Tong
14:50Passe
A Practical Approach to Dockerizing OpenStack High Availability Manuel Silveyra, Shaun Murakami, Kalonji Bankole, Daniel Krook
IBM Sessions on Wednesday, November 5th 09:00
R241Monasca DeepDive: Monitoring at scale Tong Li , Rob Basham, HP and Rackspace
09:00R242
Beyond 86: Managing multi-platform environments with OpenStack Shaun Murakami, Philip Estes
09:50 R253
Troubleshooting Problems in Heat DeploymentsFabio Oliveira,Ton Ngo,Priya Nagpurkar, Winnie Tsang
11:50 R251
Keystone to Keystone Federation Enhancements for Hybrid Cloud EnablementSteve Martinelli, Brad Topol, CERN, and Rackspace
17:50 R253
Practical advice on deployment and management of enterprise workloads Jarek Miszczyk, Venkata Jagana
30 © 2014 IBM Corporation
Learn more at these IBM sponsored sessions on Wednesday: 9:50 Room 243 Step on the Gas: See how Open Technologies are driving the
future of the enterprise11:50 Room 212/213 IBM and OpenStack: Collaborations beyond the code 1:50 Room 212/213 A Use Case Driven view of IBM’s OpenStack based Offerings 2:40 Room 212/213 IBM OpenStack Offerings in Action
Stop by the IBM Booth (B4)Demos, games and FREE tee
shirt.
31 © 2014 IBM Corporation
BLUE 1R131 G209 B245
BLUE 3R0 G178 B239
BLUE 6R0 G63 B105
RED 1R240 G78 B55
Primary Colors
Fonts: Arial for Headings and TextMay use Rockwell for accents
Potentially Useful Graphics
Private Hybrid Hosted Private Public
32 © 2014 IBM Corporation
33 © 2014 IBM Corporation
Color Palette
Status Colors
PrimaryPalette
AccentPalette
IBM Blue 5R0 G100 B157*Title Text
IBM Orange 2R221 G115 B28
IBM Olive 1R165 G162 B21
IBM Teal 2R0 G118 B112
IBM Purple 3R59 G28 B125
IBM Blue 6R0 G63 B105
IBM Red 3R168 G16 B36
IBM Yellow 3R253 G184 B19
IBM Green 3R0 G138 B82
IBM Blue 1R131 G209 B245
IBM Blue 4R0 G138 B191
34 © 2014 IBM Corporation
Legal Disclaimer
• © IBM Corporation 2011. All Rights Reserved.• The information contained in this publication is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained in this publication, it is
provided AS IS without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.
• References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.
• If the text contains performance statistics or references to benchmarks, insert the following language; otherwise delete:Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.
• If the text includes any customer examples, please confirm we have prior written approval from such customer and insert the following language; otherwise delete:All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.
• Please review text for proper trademark attribution of IBM products. At first use, each product name must be the full name and include appropriate trademark symbols (e.g., IBM Lotus® Sametime® Unyte™). Subsequent references can drop “IBM” but should include the proper branding (e.g., Lotus Sametime Gateway, or WebSphere Application Server). Please refer to http://www.ibm.com/legal/copytrade.shtml for guidance on which trademarks require the ® or ™ symbol. Do not use abbreviations for IBM product names in your presentation. All product names must be used as adjectives rather than nouns. Please list all of the trademarks that you use in your presentation as follows; delete any not included in your presentation. IBM, the IBM logo, Lotus, Lotus Notes, Notes, Domino, Quickr, Sametime, WebSphere, UC2, PartnerWorld and Lotusphere are trademarks of International Business Machines Corporation in the United States, other countries, or both. Unyte is a trademark of WebDialogs, Inc., in the United States, other countries, or both.
• If you reference Adobe® in the text, please mark the first use and include the following; otherwise delete:Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
• If you reference Java™ in the text, please mark the first use and include the following; otherwise delete:Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
• If you reference Microsoft® and/or Windows® in the text, please mark the first use and include the following, as applicable; otherwise delete:Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both.
• If you reference Intel® and/or any of the following Intel products in the text, please mark the first use and include those that you use as follows; otherwise delete:Intel, Intel Centrino, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
• If you reference UNIX® in the text, please mark the first use and include the following; otherwise delete:UNIX is a registered trademark of The Open Group in the United States and other countries.
• If you reference Linux® in your presentation, please mark the first use and include the following; otherwise delete:Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.
• If the text/graphics include screenshots, no actual IBM employee names may be used (even your own), if your screenshots include fictitious company names (e.g., Renovations, Zeta Bank, Acme) please update and insert the following; otherwise delete: All references to [insert fictitious company name] refer to a fictitious company and are used for illustration purposes only.