Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Microservices and Containers
Taco Bakker
DevOps: Continuous Delivery
ING
Continuous Delivery Specialist
DO4T18S
#CAWorld
2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
INTRODUCTION
THE AGILE JOURNEY OF ING
CONTINUOUS DELIVERY PIPELINE ANALYTICS
CONTINUOUS DELIVERY PIPELINE WITH APIS, MICROSERVICES, AND CONTAINERS
SUMMARY
1
2
3
4
5
3 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
About Me
Certified Scrum master
Continuous Delivery specialist
Lean Six Sigma Black Belt
CD tooling geek
Chairman Release Automation user groupTACO BAKKER
5 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
About ING
ING IS A GLOBAL FINANCIAL INSTITUTIONWITH A STRONG EUROPEAN BASE
THE PURPOSE OF ING BANK IS TO EMPOWER PEOPLE TO STAY A STEP AHEAD IN LIFE AND IN BUSINESS
Customers Countries Employees
more than
33Mprivate, corporate and institutional customers
more than
40in Europe, North America, Latin America and Australia
more than
52,000
6 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
ING’s Continuous Delivery Journey
SEP2014
MAY2013
NOV2011
MAY2011
OCT2010
OCT2009
MAY2010
Google IO
The will to change
New IT mgt team
1st Scrum team and start agile development
Start of mobile app development
Clear demarcation responsibilities infra and app
Discussion – who runs production
Need full automationinfra & scalable systems
Build private cloud
Engineers hunger totake responsibility
Full reorganization (180 full DevOps teams)
Continuous delivery pipeline – Jez Humble
Start full automationof IT processes
Engineering culture
Start of our ownJava community
COMMON GOALS Higher quality Higher productivity Frequent releases
7 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
We Have Achieved Continuous Delivery
PRACTICES AND PEOPLE:
Agile scrum or kanban for all our changes
Continuous delivery for all our releases
DevOps and skilled IT engineers for our complete organization
AUTOMATE EVERYTHING:
Provisioning ofvirtual machines
Builds
Code quality checks
Security checks
TOTAL NUMBER OF RELEASES
THE RESULTS SO FAR ARE GREAT:
Faster time to market (<6wks cycle time)
Lower number of incidents (>50% reduction)
Higher frequency of releases (>12,000 releases per month)
Deployments
Tests
Acceptance criteria
Metrics & analysis
Monitoring
8 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
TEAM MATURITY TOOL STANDARDS INSIGHTS RESILIENCY
But How Can We Get to the Next Level?
10 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Our Continuous Delivery Pipeline Collects Metrics from All Parts of the Process
CA Release Automation
GitLab ArtifactoryJenkins Test tooling
METRICS TOOLS
EVENTBUS
SOURCE BUILD REPOSITORY DEPLOYMENT TESTING DTAP
11 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
The Collected Data Is Used to Determine Release Maturity and Team Maturity
BEFORE A RELEASE CAN BE DEPLOYED INTO PRODUCTION IT NEEDS TO COMPLY TO ALLTHE ACCEPTANCE CRITERIA.
WE COLLECT DATA IN A DATABASE SYSTEM AND MAKE COMPARISON WITH OTHER TEAMS POSSIBLE, TO HELP TEAMS TO IMPROVE!
App 1
App 1 App 2
12 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
THIS MEANS THE CD PIPELINE BECOMES TOO IMPORTANT TO FAIL!
The CD Pipeline Is Becoming the Single Point of Control for the IT Landscape
Build new releases
Get feedback on the quality of the release
Deploy releases
Ensure built in quality of releases
Insight in the maturity of DevOps teams
Insight in the quality and costs of systems
What can be released to the customers
ENGINEERS MANAGERS
14 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
USER PORTAL
We Improve Resilience with Microservices andDocker Containers
CA Release Automation
GitLab ArtifactoryJenkins Test tooling
METRICS TOOLS
EVENTBUS
SOURCE BUILD REPOSITORY DEPLOYMENT TESTING DTAP
APIs
Container Platform (Mesos, Marathon, Chronos, Zookeeper)
Run Microservices ina Docker container
Run tools ina Docker container
15 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
New Techniques Maximize the Resilience of the CD Pipeline
PRINCIPLES OFMAXIMIZING RESILIENCY
MICROSERVICESOF CD PIPELINE
CONTAINERSFORMICROSERVICESAND TOOLS
DATA OUTSIDE CONTAINERS
REDUNDANTSERVICES
CONTINUOUS IMPROVEMENT
16 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Summary
The last 6 years ING has been transforming itselfto an Agile organization.
A Continuous Delivery Pipeline has been developedfor IT engineers to improve their software delivery.
Now we have to roll this out globally within INGto enable collaboration.
To make this pipeline more resilient, we run a lot ofsolutions in containers.
We split our custom build software in microservices,and run them in a High Availability mode.
We use APIs to connect standard tooling to portals,to enhance user experience.
1
2
3
4
5
6
17 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Recommended Sessions
SESSION # TITLE DATE/TIME
DO4T31TTech Talk: Harness the Power of Innovations Like Microservice Architecture and Containers
11/18/2015 at 3:45 pm
DO4T152S
Tech Primer: Exploit New Levels of Insight, Orchestration and Governance for Complex Application Releases, End-to-End, with New Continuous Delivery Solution
11/18/2015 at 4:30 pm
DO4X213LHands-On Lab: Complement CA Release Automation with a New Continuous Delivery Solution Offering A Visual Approach for Complex Application Releases
11/19/2015 at 2:00 pm
18 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Must See Demos
CA Release AutomationCA Release Automation
Theater 4
Cloud & SaaS DeploymentsCA Release Automation
Theater 4
CA RA Rapid Dev. Kit, SDKCA Release Automation
Theater 4
Integrations
CA Release Automation
Theater 4
19 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Follow On Conversations At…
Smart Bar
CA Release Automation
Theater 4
Tech Talks
CA Release Automation
Theater 4
21 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For Informational Purposes Only
© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type
of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
Terms of this Presentation
22 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For More Information
To learn more, please visit:
http://cainc.to/Nv2VOe
CA World ’15