Post on 13-Jul-2015
transcript
© Copyright 2014 Pivotal. All rights reserved.
The image cannot be displayed. Your computer may not have enough memory to open the image, or the image
© Copyright 2014 Pivotal. All rights reserved.
Development on Cloud, PaaS and SDDC
Kim Min Seok Sr, Field Engineer Pivotal Korea 2014.12.18
© Copyright 2014 Pivotal. All rights reserved.
Agenda
Pivotal’s Vision on SDDC
DevOps and PaaS
PaaS characteristics
Conclusion
© Copyright 2014 Pivotal. All rights reserved.
정책 기반 관리 & 자동화!클라우드 자동화 ! 클라우드 운영! 클라우드 비즈니스!
소프트웨어 정의 데이터센터(Software-Defined Data Center)!
프라이빗 클라우드 !
퍼블릭 클라우드 !
하이브리드 클라우드!
VMware 및vCloud Data Center 파트너"
가상화 인프라 !추상화 & 풀링!
!
컴퓨팅 추상화 = "서버 가상화"
네트워크 추상화 = 가상 네트워킹 "
스토리지 추상화 =" 소프트웨어 정의 스토리지"
애플리케이션!
최종 사용자 컴퓨팅! 데스크톱 ! 모바일!
가상 작업공간!
현대적! SaaS!전통적! Pivotal
PaaS on SDDC
3
© Copyright 2014 Pivotal. All rights reserved.
New platform for the new era
Linux for the cloud
“We'll see the development and open-source community essentially come up with Linux for the cloud”
http://www.informationweek.com/cloud/infrastructure-as-a-service/pivotal-ceo-maritz-teases-linux-for-the-cloud/d/d-id/1111474?
© Copyright 2014 Pivotal. All rights reserved.
Pivotal’s Vision
App Fabric!
Language & Framework
Services Analy7cs
Data Fabric!
Ingest & Query: in-‐memory
Scale-‐out storage: HDFS
Cloud Fabric!
Automa7on: App provisioning & life-‐cycle
Service Registry Cloud Abstrac7on
...ETC"SDDC"
Warehouse scale computer"
The New Cloud OS
The New Middleware The New Database
APPS
ANALYTICS DATA
Speed"
New user experiences New business models New business value
5
© Copyright 2014 Pivotal. All rights reserved.
New OS and Middleware for cloud
• Cloud Orchestration
• Container orchestration
• Cross-cloud Portability
– Write once, run everywhere
• Scale-out architecture
– cluster app development
– Scaling/healthcheck
• Governance App Development
• Multiple language support
– Nodejs, PHP, ruby, python, java, go
Pivotal
On-Premise Data Centers
Public Clouds
Software Defined Data Centers
Applications
6
© Copyright 2014 Pivotal. All rights reserved.
Agenda
Pivotal’s Vision on SDDC
DevOps and PaaS PaaS characteristics:
- Orchestration
- Cross-Cloud Portability
- Cluster application
- True Agile Development
Conclusion
© Copyright 2014 Pivotal. All rights reserved. 8
Organizations expect to have to deliver up to 20% more application in 2014.
IT Reality
http://go.xebialabs.com/Automation-Trends-Report-2014.html#.U2DtDPldWf8
© Copyright 2014 Pivotal. All rights reserved.
**Source: Xebia Labs Survey Report
DevOps"Continuous Delivery" Agile"
Enterprise initiatives in 2014**"
Changing development and release disciplines
CONTINUOUS DELIVERY! AGILE! DEVOPS!
9
© Copyright 2014 Pivotal. All rights reserved.
Removing Developer and Operator Constrains
BUILD APPLICATION!
PUSH FIRST RELEASE!
MAINTAIN APPLICATION!
UPDATE APPLICATIONS!
RETIRE APPLICATIONS!
• service deploy • routing
• Elastic scale • Integrated HA • scaling and APM • Log aggregation • Policy and Auth
• A/B versioning • Live upgrades
• service removal
11
© Copyright 2014 Pivotal. All rights reserved. 13
Cloud Foundry Project
Open Source
Private Clouds
Public Clouds
CUSTOM SERVICES
http://www.cloudfoundry.org
© Copyright 2014 Pivotal. All rights reserved.
Pivotal CF Architecture
Ops Manager UI
Ops Manager Director
Operations Manager
Service
Service Broker
Service Nodes
Service Broker
Service Nodes
Service
App Log Aggregator
Login Server
Dynamic Router
Cloud Controller
UAA
Health Manager
DEA Pool
Messaging (NATS)
Apps
Metrics Collec7on
Apps
HA Proxy LB
Elastic Runtime
14
© Copyright 2014 Pivotal. All rights reserved.
Agenda
Pivotal’s Vision on SDDC
DevOps and PaaS
PaaS characteristics: - Orchestration - Cross-Cloud Portability
- Cluster application
- True Agile Development
Conclusion
© Copyright 2014 Pivotal. All rights reserved.
Puppet Automates
tool for automating system administration
doesn’t enforce cloud native architecture
16
© Copyright 2014 Pivotal. All rights reserved.
Cloud timeline
2004 Puppet
2006 AWS 2009
DevOps
2010 Cloud Foundry
2010 OpenStack
2008 Chef
2010 Continuous
Delivery
2012
Timeline
2007 Heroku
2008 App Engine
2014 Foundation
17
© Copyright 2014 Pivotal. All rights reserved.
Agenda
Pivotal’s Vision on SDDC
DevOps and PaaS
PaaS characteristics: - Orchestration
- Cross-Cloud Portability - Cluster application
- True Agile Development
Conclusion
© Copyright 2014 Pivotal. All rights reserved.
Write Once, Run Everywhere
http://www.devmanuals.com/images/images1/6java-cod.gif
http://i.imgur.com/lU30MCv.jpg 21
© Copyright 2014 Pivotal. All rights reserved.
Write Once, Run Every CLOUD
http://blog.cloudfoundry.com/wp-content/uploads/2012/01/PreviousVsNextGen.png 22
© Copyright 2014 Pivotal. All rights reserved.
Cross-cloud portability
Deploy App
Open Cloud Platform!
AWS" SP X"Service Provider
XYZ"
On-Premise Data Centers Public Clouds
OpenStack" VMWare"“Bare
Metal” +"Containers"
Software Defined Data Centers
Applications
Cloud Provider Interface"Cross-Cloud Portability
• Single codebase
• No configuration change
• Cloud agnostic
– Private/public
– dev/stage/production
23
© Copyright 2014 Pivotal. All rights reserved.
Agenda
Pivotal’s Vision on SDDC
DevOps and PaaS
PaaS characteristics: - Orchestration
- Cross-Cloud Portability
- Cluster application - True Agile Development
Conclusion
© Copyright 2014 Pivotal. All rights reserved.
Needs to consider
Traditional Cluster Application
http://mibuso.com/blogs/mandyk/2009/06/11/how-to-configure-ssl-for-biztalk-https-receive-port-adapter/
• Configuration synchronization • Health check • Load balancing • Scaling • Monitoring
25
© Copyright 2014 Pivotal. All rights reserved. 26
Pivotal CF supports
IaaS
Install the platform
Handle live upgrades and updates
Scale and plan capacity
Install and manage services
Target multiple clouds
Security
© Copyright 2014 Pivotal. All rights reserved.
Architecture for Cluster application
Cloud Controller Health Manager
Messaging (NATS)
Software Defined Data Centers
Service
Pivotal HD
Service
Jenkins
Service
MySql
DEA app app
app
DEA app app
app
DEA app app
app app
DEA app
app app
DEA app
app
… …
DEA Pool clusters
Cloud Foundry BOSH
Service clusters
Routers
27
© Copyright 2014 Pivotal. All rights reserved.
Built-in Fast App Scaling
VM
10 minutes Linux container
0.02 seconds
http://blog.pivotal.io/cloud-foundry-pivotal/case-studies-2/platform-wind-tunnel-part-i-heroku
28
© Copyright 2014 Pivotal. All rights reserved.
Load Balancing
29
Load Balancer
DEA! DEA! DEA!
Router
Access App"
Pivotal CF Elas7c Run7me (PaaS)
Router Router
DNS!
Load Balancer
myapp.<mycfdomain.com>
Resolve app and system domain names to LB IP
© Copyright 2014 Pivotal. All rights reserved.
Built-in 4 Level HA
PCF
A" B" C"
B"
3. Resurrector restarts failed VMs
PCF
A" B" C"
Process"
PCF
A" B" C"
VM1 VM2
OS,"Mware"
VM3
OS,"Mware"
OS,"Mware"VM1 VM2
App Fail" Process Fail" VM Fail" Rack Fail"
Zone 1 Zone 2
Zone 3
30
© Copyright 2014 Pivotal. All rights reserved. 31
Platform Monitoring"
How do I know when to scale DEAs? How many requests each Router is servicing?
What is the current load of my Cloud Controllers?
© Copyright 2014 Pivotal. All rights reserved. 32
Platform Monitoring"
Collector
JMX Provider
JMX Monitoring
Tool
© Copyright 2014 Pivotal. All rights reserved.
Log Aggregation and Ops Metrics
One source for all platform logs and metrics. Single view console that makes system and application monitoring visible & actionable
� Aggregated Logging
HTTP Events, Counters, Gauges, Errors
� Application Metrics
IT Operator health gauges
� Snap-in best of breed application monitors
AppDynamics, New Relic, Splunk
Image credit: http://imgarcade.com/1/fire-hose-spraying-fire/
33
© Copyright 2014 Pivotal. All rights reserved.
Agenda
Pivotal’s Vision on SDDC
DevOps and PaaS
PaaS characteristics: - Orchestration
- Cross-Cloud Portability
- Cluster application
- True Agile Development Conclusion
© Copyright 2014 Pivotal. All rights reserved. 35
10x Increase in Speed"Deploy App
Cloud Controller
Health Manager
NATS (message
bus)
Router
App Deployed
Application Zone
© Copyright 2014 Pivotal. All rights reserved.
mod proxy
1. The platform takes care of all the steps on the left automatically
50 Configuration Touches
1. Register Hostname with DNS (1) 2. Configure F5 Load Balancing Group (2) 3. Configure Apache HTTPd Worker Pool (4) 4. Configure mod_proxy Connector Routing (4) 5. Configure Tomcat Connector Pool (40)
1 Configuration Touch
1 2 4 4 40 1
Pivotal CF: From 50 touch points to 1
36
© Copyright 2014 Pivotal. All rights reserved.
app dev in large organizations has a tendency to be all over the place; PaaS enables you to enforce the same app dev policies and procedures across languages and frameworks
Governance App Development Framework
Your application
App Server
Runtime
Operating System
Libraries
Buildpack
IAAS!
App Servers Frameworks
JREs
Java Buildpack http://intelmicrosite.idg.co.uk/cmsdata/features/3401344/Internet_istock_thumb300.jpg
37
© Copyright 2014 Pivotal. All rights reserved. 38
Large Buildpack Community
https://github.com/cloudfoundry-community/cf-docs-contrib/wiki/Buildpacks
Built-in Community
6"Third party
Jetty Virgo
Clojure Haskell Mono Jboss
Websphere Erlang nginx
24" 37"C
Lisp Dart Elixir
Emacs Erlang Factor Fakesu
Lua .NET Null Perl R
Sphinx PhantoJS
© Copyright 2014 Pivotal. All rights reserved.
Cloud Foundry Plugin
Cloud Contro
ller
Health Manage
r
NATS (message
bus)
Router
Pivotal CF
Developer support
40
© Copyright 2014 Pivotal. All rights reserved.
Operators manage and offer a variety of growing native and external enterprise-grade services to developers. Future proof and extend your environment.
Pivotal CF Services: Data, Mobile & Platform
build on Pivotal Technologies
offered on 3rd Party Technologies
…"
My custom service"
offered via connection to your custom-built services
Pivotal HD
HAWQ
Redis
Greenplum
GemFire XD Data Sync
API Gateway
Push Notifications
RabbitMQ
Spring XD
41
© Copyright 2014 Pivotal. All rights reserved. 42
Simple & Fast Service creation"
Cloud Controller
Health Manager
NATS (message
bus)
Router
Service Zone
Application Zone
$ cf create-service p-mysql .. mydb $ cf bind-service myapp mydb $ cf restage myapp
© Copyright 2014 Pivotal. All rights reserved.
requires separate Clusters for each Build and test
Agile Development requires Lots of VMs
http://www.infoq.com/news/2012/04/Branching-Guide
Staging (shared)
Dev team1
Dev team2,3 (shared)
Release debug
Release build
Release debug
44
© Copyright 2014 Pivotal. All rights reserved.
Turns Agile development into true Parallel activity
True Parallel Development
http://www.infoq.com/news/2012/04/Branching-Guide
DEA Pool clusters
Service clusters
Dev
DEA Pool clusters
Service clusters
Stage
45
© Copyright 2014 Pivotal. All rights reserved.
Decomposing by functionality Micro Services increase/support
Application patterns are changing
• Availability • Polyglot: Multiple language • Parallel development • Easy to understand services • Easy to maintain services
http://microservices.io/patterns/microservices.html 46
© Copyright 2014 Pivotal. All rights reserved.
Decomposing by functionality PaaS supports deployment complexity of services
Micro Services
Monolithic/Layered Micro services
47
© Copyright 2014 Pivotal. All rights reserved.
Agenda
Pivotal’s Vision on SDDC
DevOps and PaaS
PaaS characteristics:
- Orchestration
- Cross-Cloud Portability
- Cluster application
- True Agile Development
Conclusion
© Copyright 2014 Pivotal. All rights reserved.
How to Get There With Cloud+ PaaS
Better SLAs Flexibility Speed Availability
Faster Time To Market Mobile + Data Services Agile and Iterative Leverage OSS
Continuous Delivery No Downtime Instant scaling Consistency & Automation
PaaS Dev PaaS Ops Cloud
49
© Copyright 2014 Pivotal. All rights reserved.
Savings From Cloud and Pivotal CF
""
"" PaaS Dev PaaS Ops Cloud
50
© Copyright 2014 Pivotal. All rights reserved.
Agile Enterprise with Pivotal CF
DevOps Continuous Delivery
The New Cloud OS Pivotal
Cluster enabled Application
...ETC"SDDC"
Warehouse scale computer"
APPS
ANALYTICS DATA
Speed"
New user experiences New business models New business value
51