Location : PUNE
Date : 10-Sep-2015
Name of the Speaker : Vijay Roy , Manish Bhandekar
Company Name : BMC Software
DevOps Summit 2015
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Is a dev/QA a superman?!
With DevOps, Dev or QA need not be a Superman!
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Agenda
DevOps – Before and After
CDMM
Implementation
Visible Gains
Org Structure
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Application TeamApplication Team A…
Operations Team
Release/Project
ManagerQA Dev SysAdmin DBA NOCApp Ops
Dev Ops
BEFORE
Org Structure
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Application TeamApplication Team A…
Operations Team
Release/Project
ManagerQA Dev SysAdmin DBA NOCApp Ops
Dev Ops
Challenges:1. Big Ops team needed2. Configuration Failures3. Delayed Implementation4. Loss of Revenue
BEFORE
Org Structure
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Application TeamApplication Team A…
Operations Team
Release/Project
ManagerQA Dev SysAdmin DBA NOCApp Ops
Dev Ops
ARA Team/ Tools
AFTER
Org Structure
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Application TeamApplication Team A…
Operations Team
Release/Project
ManagerQA Dev SysAdmin DBA NOCApp Ops
Dev Ops
ARA Team / Tools
Gains:1. Faster Release2. Predictable3. Flat Ops4. Save Time5. Save Money
AFTER
Challenges for Enterprise
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Timely Release
Deployment failures
Lack of Budget
Continuous Delivery
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Mission : Empower DevelopmentGoal : Bake Quality, Create Time
CDMM – 5 Vectors
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Culture & Organization
Design & Architecture
Build & Deploy Test & VerificationInformation &
Reporting
Implementation - CI/CD Pipeline
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Development Source Code Shelve
Smart Build Infra Selection
Automated Build & UT
Successful Build ?
Continuous Integration
Source Code Commit
Provision Test Infrastructure
Automated Tests
Report and intelligent
action on Build Results
Provision Test Infrastructure
Automated Contextual
Testing
Successful Tests ?
De-provision Test
Infrastructure
Successful Tests ?
De-provision Test
Infrastructure
Report and action on Test
Results
Continuous Delivery
Successful test results ?
Provision Staging
Infrastructure
Acceptance Tests
PRE-
PROD / SOL QA
Code Collaboration
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
BEFORE AFTER
Birds-eye view of CI CD Process
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Automated BAT, Result reporting, issues uncovered
Continuous Deployment
PRE-PROD / Sol QA test
Every daySanitized build from main gets merged to Release branch on demand
Release Branch
Main Branch
Main Branch
Main Branch
CI Server
CI Server
CI Server
Nightly Build
CI server polls every 1 hr
Notification to Automation
Dev Code
Dev Code
Dev Code
http://goto/clmatclm
CLM@CLMInstances
Co
ntext Sp
ecific In
tegratio
n Te
st Ru
n
Merge th
e shelved
check-in
s to M
ain O
NLY
if UT an
d IT h
as passe
d
CI ServerCI Server
CI Server
Back out
If IT test failed, notification back to Developer to fix
If compilation or UT failed, notification back to developer to fix
CI Factory pushes the built artefacts to integration server for further test
Feed to CLM@CLM
Pre Commit
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Dev Code
Main Branch
Main Branch
Main Branch
http://goto/clmatclm
Dev Code
Dev Code
CI Server
CI Server
CI Server
CLM@CLMInstances
Co
ntext Sp
ecific In
tegratio
n Te
st Ru
n
If IT test failed, notification back to Developer to fix
If compilation or UT failed, notification back to developer to fix
On successful CI build and UT run, auto deploy of artifacts to integration env (clm@clm instance) and IT tests run –automated or manual --- in context of the change
Me
rge th
e sh
elve
d ch
eck-in
s to M
ain O
NLY
if UT an
d IT h
as p
assed
Developers keep the check-ins in perforce Shelved and CI server picks the Shelved ones
CLM@CLM
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Post Commit
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Main Branch
Main Branch
Main Branch
CI Server
CI Server
CI Server
Nightly Build
a. CI Coordinator gets in action
b. check-out of offending CL, if possible and needed
CI server polls every 1 hr
Once Shelved CL passes UT and IT run, checks-in/merges the change list to MAIN
Post-Commit CD
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Automated BAT, Result reporting, issues uncovered
PRE-PROD / Sol QA test
Every day
Continuous deployment to be used for Integration tests
Sanitized build from main gets merged to Release branch on demand
Release Branch
Successful Nightly Build notification to Automated BAT
Birds-eye view of CI CD Process
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Automated BAT, Result reporting, issues uncovered
Continuous Deployment
PRE-PROD / Sol QA test
Every daySanitized build from main gets merged to Release branch on demand
Release Branch
Main Branch
Main Branch
Main Branch
CI Server
CI Server
CI Server
Nightly Build
CI server polls every 1 hr
Notification to Automation
Dev Code
Dev Code
Dev Code
http://goto/clmatclm
CLM@CLMInstances
Co
ntext Sp
ecific In
tegratio
n Te
st Ru
n
Merge th
e shelved
check-in
s to M
ain O
NLY
if UT an
d IT h
as passe
d
CI ServerCI Server
CI Server
Back out
If IT test failed, notification back to Developer to fix
If compilation or UT failed, notification back to developer to fix
CI Factory pushes the built artefacts to integration server for further test
Feed to CLM@CLM
PRE COMMIT POST COMMIT POST COMMIT CD
CI Factory
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Develop code and Submit to CI Factory
Like automated shopfloor, the code artifact moves through the DevOps pipeline
Automated governance, visible dashboards, enhanced reporting
Release to Solution QA is akin to Production, in case of CLM
Mission : Empower DevelopmentGoal : Bake Quality, Create Time
Demo
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
What’s in it for me?
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga D
evel
op
ers CLM@CLM
Tons of unit tests
Tons of mock frameworks
On demand build and automated tests before check-in.
Feat
ure
Tea
ms CLM@CLM
Automated mechanism to sanity test changes using Integration Tests
Robust mechanism to achieve quality deliverables without wasting time in infrastructure items
Solu
tio
n Q
A CLM@CLM
Working builds that refresh every night
Reduced installation and configuration time
More time for testing scenarios and automating advanced test cases instead of spending time on basic functionality failures
Man
agem
en
t Quarterly releases
Enhanced team productivity
Enhanced productivity … and lot more coffee!
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
Visible Gains ……DevOps For Enterprise - A Success Saga
Resources
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
About DevOps… https://cloudmatters.wordpress.com/2015/05/10/cloud-lifecycle-management-for-cicd-
devops-part-i/ https://cloudmatters.wordpress.com/2015/06/05/cloud-lifecycle-management-for-cicd-
devops-part-ii/ http://youtu.be/Oj4vXMRenFo - Delete your code! http://continuousdelivery.com/
About BMC… https://www.youtube.com/watch?v=-ggm3Oe_EGc – Bring IT to Life with BMC http://engage.bmc.com/ - BMC Engage 2015 – do visit us to know more! http://www.bmcsoftware.in/it-solutions/cloud-lifecycle-management.html http://www.bmcsoftware.in/it-solutions/devops.html
DevOps For Enterprise - A Success Saga
DevOps Summit 2015
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
DevOps For Enterprise - A Success Saga
Speaker Name: Vijay Roy, Manish Bhandekar
Email ID: [email protected] ;
Organized byUNICOM Trainings & Seminars Pvt. [email protected]
DevOps Summit 2015
http://www.devops-summit.org/pune/2015/DevOps_Summit_Conference
BMC’s CLM teams save time in all phases of the development cycle using CLM
and other open source toolsHighlights:
Faster builds: 70% faster than last release; > 1000 hours of developer time saving overall
Unit test coverage up by 30% higher previous release
Sanitized builds available 91% of the time; 50% higher previous release
Builds quality up by 50% ; 80% less hotfixes to QA compared to a previous release
QA hardening cycles efficiency: velocity improved ; Over the release ~100 person weeks saved
No manual product install/setup needed: With Continuous Deployment (CD) around ~160 person week time saved and this time went in real QA testing
CLM@CLM is ‘drinking your own champagne’ and a live testimony to ‘Continuous Deployment’ and Live customer showcase lab:
• We use our product to test our products – it has to be production grade all the time
• Pre commit checks: compilation, static code analysis, UT, ITs • CI Builds: More than 5000 automated builds over the release• Automated deployment and testing: nightly, weekly, solution
drops• Automated test cases: 110 sanity P1 tests run every night to
sanitize main• Service Offerings: nightly, weekly, solution builds, customer
environments, previous releases• Users: ~168 SOIs: ~190 Throughput: 30
provisioning/decommissioning per day• Content: All service Offerings available with without pre baked
content