A Development Analytics Dashboard For Apache CloudStack

Post on 29-Dec-2016

241 views 4 download

transcript

A Development Analytics Dashboard For ApacheCloudStack

Jesus M. Gonzalez-Barahona

jgb@bitergia.com Twitter: @jgbarahBitergia

http://bit.ly/cloudstack-dashboard

ApacheCon Europe 2014Budapest (Hungary), November 17th 2014

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 1 / 34

Structure of the presentation

1 Why a software development dashboard?

2 The CloudStack Development Dashboard

3 Browsing the data

4 Browsing the data: git

5 Browsing the data: Jira

6 Browsing the data: other

7 Bonus track

8 Final remarks

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 2 / 34

Why a software developmentdashboard?

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 3 / 34

From open development to open development analytics

Information about code, community, development

for open development projects

can be retrieved, organized, analyzed

Let’s publish analytics results & data

Open Development Analytics:A new standard for transparency

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 4 / 34

Who makes a project successful?

Persons (and organizations) with

different interests

common goals

Need for coordination, common decision making

Availability of data as a tool:

Transparency to the community (fairness)

Transparency to third parties (trust)

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 5 / 34

Assessing transparency

Development communities: companies and developersworking together

Policies, procedures, tools, source code...and development data

Do they really provide enough data to enableassessment?

Analysis of all repositories (data sources)...

...and associated information (eg: affiliation)

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 6 / 34

Examples of areas of interest

Performance (understanding activity)

Company participation (beyond copyright

notices)

Transparency (available information)

Auditing (certify participation, experience, etc.)

Profiling (key people, companies)

Neutrality (fair treatment)

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 7 / 34

The CloudStack DevelopmentDashboard

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 8 / 34

A Grimoire Dashboard for CloudStack

http://projects.bitergia.com/apache-cloudstack/

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 9 / 34

Tools: Grimoire system

MetricsGrimoire:Free software for retrieving data from repositories

vizGrimoire (GrimoireLib, vizGrimoireJS):Free software for analyzing, visualizing data

Grimoire Dashboard:Many panels, different views of the project(charts, summaries, statistic analysis)

Commercially supported by Bitergia

http://metricsgrimoire.github.com

http://vizgrimoire.github.com

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 10 / 34

Tools: Grimoire system

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 11 / 34

Browsing the data

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 12 / 34

Dashboard: main menu

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 13 / 34

Dashboard: summary information

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 14 / 34

Dashboard: trend charts

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 15 / 34

Browsing the data: git

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 16 / 34

Dashboard: commits

http://projects.bitergia.com/apache-cloudstack/browser/scm.html

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 17 / 34

Dashboard: who is contributing

[CloudStack top authors in git (November 2014)]Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 18 / 34

Dashboard: commits by git repository

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 19 / 34

Browsing the data: Jira

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 20 / 34

Dashboard: tickets

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 21 / 34

Dashboard: ticket backlogs over time

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 22 / 34

Dashboard: age of current tickets by state

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 23 / 34

Browsing the data: other

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 24 / 34

Dashboard: mailing lists

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 25 / 34

Dashboard: Attraction / retention (git authors)

http://projects.bitergia.com/apache-cloudstack/browser/

demographics.html

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 26 / 34

Dashboard: Attraction / retention

http://radar.oreilly.com/2014/10/

measure-your-open-source-communitys-age-to-keep-it-healthy.html

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 27 / 34

Dashboard: Profiling of contributors

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 28 / 34

Bonus track

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 29 / 34

Time zone analysis (1)

15 10 5 0 5 10 15

tz

0

50

100

150

200

auth

ors

15 10 5 0 5 10 15

tz

0

50

100

150

200

250

300

350

400

450

auth

ors

[Posters in mailing lists per time zone (2012, 2014)]

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 30 / 34

Time zone analysis (2)

15 10 5 0 5 10 15

tz

0

5

10

15

20

25

30

auth

ors

15 10 5 0 5 10 15

tz

0

10

20

30

40

50

60

auth

ors

[Authors in git repos per time zone (2010, 2014)]

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 31 / 34

Final remarks

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 32 / 34

Do you want to play a bit?

Do you want your own instance of the dashboard?

git clone https://github.com/Bitergia/apache-cloudstack-dashboard.git

Do you want the database dumps?

http://projects.bitergia.com/apache-cloudstack/browser/

data/db/

Schemas available from MetricsGrimoire tools wikis at GitHub

Do you want the JSON files?

http://projects.bitergia.com/apache-cloudstack/browser/

data/json/

Simple API, easy to get specific parameters

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 33 / 34

Polishing the final version

Still (and continuously)

fixing bugs,

adding new functionality

improving performance

Your feedback is welcome!!!

https://github.com/Bitergia/apache-cloudstack-dashboard/issues

Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 34 / 34