Evolution of OPNFV CI system:

what already exists and what can be introduced

Jun Li (matthew.lijun@huawei.com)

San Francisco 09/11/2015

2

The Continuous Integration (CI) infra used today

Reference http://artifacts.opnfv.org/octopus/docs/opnfv-ci-infrastructure.html

3

Jenkins, the CI engine

Jenkins runs tests and automates some parts of project operations

Jenkins focuses on building/testing software projects continuously and monitoring

executions of externally-run jobs

Jenkins supports plugins, which allows to be extended to meet specific requirements

The Jenkins jobs are defined by Jenkins Job builder(JJB) in human readable YAML format

4

The number of patch commit and author is growing fast

With 10 labs(include LF lab), while no efficient job scheduler(some labs are not connected stable)

Do we need a log tool?

And more …

Some problems occur

5

Which tools can be introduced?

6

Zuul scheduler, the main component of Zuul, it receives

events related to proposed changes, triggers tests based on

those events, and reports back

Zuul merger, set temporary Git repositories and branches up

in order to ease the preparation of jobs environments.

Jenkins slave 1

Jenkins slave 2

Zuul (gating) and Gearman (job scheduling)

7

Reference http://status.openstack.org/zuul/

Zuul pipeline(check, gate, post, etc)

Zuul solves,

1) Testing in parallel

2) Cross projects dependencies

One use case, Zuul used in OpenStack

8

ElasticSearch ELK stack: gather/store/visualize syslogs

9

how should be the evolution of the CI infra??

10

Evolution of CI system

Github Mirror

Remote Git Repository

Gerrit

Developers

Pipy repository Ubuntu, Centos,

etc, mirrors

Repository of Steady version

openstack/opendaylight, etc

…

… …

Jenkin masters

Jenkin slaves & plugins for test

… Log servers & log searcher

Zuul Gearman

Gating, work scheduler

Scripts to get the mirrors & test depended packages for Build, use nodepool for image management.

Puppet/Hiera manages the servers

OPNFV Mirror

11

Demo links

https://www.youtube.com/watch?v=fOYdsNdkCuw

12

Any Questions ?

Copyright©2015 Huawei Technologies Co., Ltd. All Rights Reserved.

The information in this document may contain predictive statements including, without limitation,

statements regarding the future financial and operating results, future product portfolio, new technology,

etc. There are a number of factors that could cause actual results and developments to differ materially

from those expressed or implied in the predictive statements. Therefore, such information is provided

for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the

information at any time without notice.