Date post: | 12-Jul-2015 |
Category: |
Technology |
Upload: | cloudbees |
View: | 619 times |
Download: | 4 times |
Analyze This!CloudBees Jenkins Cluster Operations and Analytics
Ryan CampbellCyrille Le Clerc
Today’s Presenters
Cyrille Le ClercDirector, Product Management
[email protected]@cyrilleleclerc
Ryan CampbellEngineer
[email protected]@recampbell
Using WebEx
Questions?Submit via the Q&A window at any time during the presentation.
We will cover Q&A at the end of the presentation.
Session is being recorded.
Q&A Window
Agenda
● Problem statement● Jenkins Reference Architecture● CloudBees Analytics● Cluster Operations● Conclusion● Q&As
Problem Statement
Problem Statement
How to onboard more and more teams on a Jenkins Continuous Delivery Platform
How to scale Jenkins in an organization
The top down “structured” and “lets grow vertically” approach
5 projects0 slaves
25 projects5 slaves
100 projects25 slaves
300 projects50 slaves
600 projects200 slaves
Vertical Scaling Issue
When is the next failure ?
One size fits all?Single point of failure
The “organic” agile growth – “let each group do what they want to” approach
Horizontally … Virally
Horizontal Issues: I Would Like to…
master-a
master-b master-c
Share slaves between masters
Horizontal Issues: I Would Like to…
master-a
master-b master-c
Share security
Horizontal Issues: I Would Like to…
master-a
master-b master-c
Manage the Jenkins masters “globally”
plugin
core
upgrade / restart
backup
script
Horizontal Issues: I Would Like to…
master-a
master-b master-c
Monitor the Jenkins masters “globally”
Jenkins Operations Center by CloudBees
master-a
master-b master-c
Jenkins Operations Center
plugin
core
upgrade / restart
backup
script
Jenkins Reference Architecture
Reference Architecture
LB master-a
LB master-n
***
slaves
LB
Jenkins Operations Center
shared slaves
Role Based Access Control
Update Center
SSO
LB master-test
Update Center Jenkins TestEnvironment
master-a
master-b master-c
Jenkins Operations Center
JOC features
plugin
core
upgrade / restart
backup
CloudBees Analytics
Cluster Operations
CloudBees Analytics
CloudBees Analytics
master-a
master-b master-c
Monitor the Jenkins masters “globally”
Drivers for Analytics
● Easily understand the performance and behavior of hundreds of Jenkins nodes
● Consistent interface allowing for easy comparisons over time and between nodes
● Key questions:○ What is the user experience?○ Why is Jenkins slow?○ How is Jenkins being used?○ How are resources being used? → capacity
CloudBees Analytics
masterJenkins Operations Center
Data Collection
Scalable compute and storage backend
Rich visualization interface
Embedded Architecture
Jenkins Operations Center
Embedded Elasticsearch
Embedded Kibana
Horizontally Scaled Architecture
Jenkins Operations Center
Embedded Kibana
Multiple Remote Elasticsearch Instances
Analytics Demo
JOC Dashboard
Analytics Demo
Build Analytics
Analytics Demo
Performance Analytics
Analytics Demo
Dashboard Creator
Cluster Operations
Cluster Operations
master-a
master-b master-c
Manage the Jenkins masters “globally”
plugin
core
upgrade / restart
backup
script
Cluster Operations Agenda
● Update all plugins on all masters and restart● Deploy new plugin on masters● Cluster Operations Ref Card
Update Plugins on All Masters and Safely Restart
Demo time!
Cluster Operations
Standard Jenkins Style: New Item “Clustered Operations”
Cluster Ops > Master Operation
Standard Jenkins Style: Add Operation “Masters”
Master Operation > Select Targets
Select the Client Masters on which you perform the operation
Master Operation > Define Operations
Define the sequence of operations to apply on the Client Masters
Deploy Plugin on Mastersvia a Custom Update Center
Deploy New PluginUpdate Center master-test
Upload Plugin
Refresh Update Center Metadata
Install Plugin
Demo time!
Deploy Plugin on Masters
Parameterized build: File Parameter
Deploy Plugin on Masters
Target Update Center
Deploy Plugin on Masters
Upload Plugin on Custom Update Center
Deploy Plugin on Masters
Target Masters
Deploy Plugin on Masters
Quick Cluster Operations
Demo time!
Quick Cluster Operations
Quick Cluster Operations
Cluster Operations Ref Card
Master Operation > Ref Card
● Backup master● Disable plugin● Execute Groovy Script on Master● Install plugin● Prepare Master for shutdown● Refresh update center metadata
Master Operation > Ref Card
● Reindex for Analytics● Restart Now● Safe restart● Upgrade Jenkins● Upgrade all plugins
Update Center Operations > Ref Card
● Delete core● Delete plugin● Promote core● Pull Everything● Pull new versions● Refresh upstream sources
Update Center Operations > Ref Card
● Track latest core● Track latest plugin● Upload core● Upload plugin
Conclusion
master-a
master-b master-c
Jenkins Operations Center
Jenkins Operations Center
plugin
core
upgrade / restart
backup
CloudBees Analytics
Cluster Operations
CloudBees Analytics
master-a
master-b master-c
Monitor the Jenkins masters “globally”
Cluster Operations
master-a
master-b master-c
Manage the Jenkins masters “globally”
plugin
core
upgrade / restart
backup
script
Resources
http://www.slideshare.net/cloudbees/analyze-this-jenkins-cluster-operations-and-analytics
Questions
Appendix
Webinar InvitationMore and more organizations are jumping on the Continuous Delivery bandwagon to remain competitive. As they do so, they use Jenkins to on-board teams and to orchestrate their continuous delivery pipelines.
Jenkins Operations Center by CloudBees is the tool that helps organizations run their CI infrastructure at scale.
In this webinar, you will learn about:
● Reference architecture to build resilient Jenkins that onboard teams quickly● Cluster Operations - helps to manage multiple Jenkins instances simultaneously. ● Want to install a new plugin on a 4 Jenkins masters ? We got that covered!● CloudBees Analytics - offers insight into build and performance analytics. ● Want to know the number of jobs failing across 4 masters - we've got that covered too!