Post on 08-Sep-2019
transcript
Evolution of OPNFV CI system:
what already exists and what can be introduced
Jun Li (matthew.lijun@huawei.com)
San Francisco 09/11/2015
2
The Continuous Integration (CI) infra used today
Reference http://artifacts.opnfv.org/octopus/docs/opnfv-ci-infrastructure.html
3
Jenkins, the CI engine
Jenkins runs tests and automates some parts of project operations
Jenkins focuses on building/testing software projects continuously and monitoring
executions of externally-run jobs
Jenkins supports plugins, which allows to be extended to meet specific requirements
The Jenkins jobs are defined by Jenkins Job builder(JJB) in human readable YAML format
4
The number of patch commit and author is growing fast
With 10 labs(include LF lab), while no efficient job scheduler(some labs are not connected stable)
Do we need a log tool?
And more …
Some problems occur
5
Which tools can be introduced?
6
Zuul scheduler, the main component of Zuul, it receives
events related to proposed changes, triggers tests based on
those events, and reports back
Zuul merger, set temporary Git repositories and branches up
in order to ease the preparation of jobs environments.
Jenkins slave 1
Jenkins slave 2
Zuul (gating) and Gearman (job scheduling)
7
Reference http://status.openstack.org/zuul/
Zuul pipeline(check, gate, post, etc)
Zuul solves,
1) Testing in parallel
2) Cross projects dependencies
One use case, Zuul used in OpenStack
8
ElasticSearch ELK stack: gather/store/visualize syslogs
9
how should be the evolution of the CI infra??
10
Evolution of CI system
Github Mirror
Remote Git Repository
Gerrit
Developers
Pipy repository Ubuntu, Centos,
etc, mirrors
Repository of Steady version
openstack/opendaylight, etc
…
… …
Jenkin masters
Jenkin slaves & plugins for test
… Log servers & log searcher
Zuul Gearman
Gating, work scheduler
Scripts to get the mirrors & test depended packages for Build, use nodepool for image management.
Puppet/Hiera manages the servers
OPNFV Mirror
11
Demo links
https://www.youtube.com/watch?v=fOYdsNdkCuw
12
Any Questions ?
Copyright©2015 Huawei Technologies Co., Ltd. All Rights Reserved.
The information in this document may contain predictive statements including, without limitation,
statements regarding the future financial and operating results, future product portfolio, new technology,
etc. There are a number of factors that could cause actual results and developments to differ materially
from those expressed or implied in the predictive statements. Therefore, such information is provided
for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the
information at any time without notice.