Engineering the Bankimages.engage.redhat.com/Web/RedHat/{03342036-0619-4e0b-82f3 … · Continuous...

transcript

Engineering the Bank Designing,deliveringandmaintaininganOperationalPlatformfor

ClydesdaleBank,YorkshireBank&B.

RedhatForum–London2018

StevenO’DayTechnologyConsultantPlatformEngineering

PhillipOllenbuttelTechnicalSpecialistPlatformEngineering

09/10/2018 CYBG-EngineeringTheBank-RedhatForumLondon2018 2

What will we cover?

• WhoareCYBG?• Wherewestarted?• Whatdidwedo?• Whatdidwelearn?• Howdidweusethoselessonslearned?•  EvolutionofthePlatformEngineeringTeam• Currentchallengesandfutureplans

Who are CYBG?

•  AnindependentUKbankinggroup•  ListedontheLSEandASX•  Servingcustomerssince1838•  Over160branchesandanetworkof

businessandprivatebankingcentre•  2.7mcustomers

2014 2015 2016 2017 2018

MobileonLegacyWebonLegacy

Where we started

DYB Project

ArchitectureandMethodologies Microservices

2014 2015 2016 2017 2018

MobileoniB

What did we do?

ArchitectureandMethodologies Microservices

Project

What did we learn?

•  ModernArchitecture•  Smalldeployablecomponents

•  Scalabilityatacomponentlevel

•  Componentstartuptimes

•  Separationoffunctions

•  Teamscanworkondifferentpartsoftheplatformwithoutgettingineachothersway

•  Dependencymanagementbetweencomponentswashard

•  Configurationmanagementbetweenthedifferentcomponentsgotmessy

•  Versioningwastheperfectmixtureofartandsciencethatwasnotalwayswellunderstood

•  RequiredDeploymentStrategies(i.estillmonolithic)

•  Lotsofefforttomanagedeployments

•  Timetakentoget2ndand3rdlinesupportreadyforeachrelease

•  Lotsofefforttomitigatethebad

TheUgly

2014 2015 2016 2017 2018

MobileoniB

WeboniB

What did we do?

ArchitectureandMethodologies MicroserviceswithContinuousDeliveryandOperationalPlatform

Project

What is the Operational Platform?

APlatformisacomponentwhichdoesnotprovideanybusinessfunctionalitybutallowsapplicationstoberunonit

Standard Interface for Self Service

Development Structures

PaaS IaaSVirtualised

Physical

Testing

Platform

On Site Private Public (If needed)

ties Continuous Integration

Continuous Delivery

Purpose Builder Operations Management

Secure by Design Asetofcapabilitiesdesignedtoprovideendtoendmanagementofsoftwareinareliable,efficientandsecuremanner.

Composer

Other*nixOS’s

Microservices API Gateway

Microservices Microservices

Containerized Applications

TraditionalApps

ApplicationFramework

TraditionalApps

TraditionalAppsTraditional

AppsTraditional

ElementsContainerizedApplications

Other*nixOS’s

AppsTraditional

ContainerizedApplications

at the Core

Primary*nixoperatingsystemontheplatformisRedhatEnterpriseLinuxOpenShiftisourKubernetesimplementationofchoice.•  Implementedprimarilyforitsoperationalfeatures

•  Scaling•  Geographicalloadbalancing•  Healthmonitoring•  Templates

SatelliteandCloudformsusedforprovisioningandmanagementofourestate.

Composer

Other*nixOS’s

TraditionalApps

AppsTraditional

CommonQuestionsWhataboutalltheother“ConfigurationManagers”,Chef,Ansible,Puppet,SaltStacketc?WhataboutalltheCMDBproviders?

WhatisChieftain?Systemofrecordforstoringcomponentconfigurationwhichcanbeprovidedinastandardformat.UseofJSONtoreturninformationinastructuredformat.Autopopulationofdependencyinformationwithouthavingtoknowallthedetailsaboutdependencies.

Composer

Whatiscomposer?Environmentbuilder,deployorchestrator.ComponentDependencyResolver

Whatareelements?LibraryofscriptsusedbyComposertobuildanddeploytoanyenvironmentorplatform.

Composer

Other*nixOS’s

TraditionalApps

AppsTraditional

CIBuilds–BuildPR’sandReleaseCandidatesEverybuildgetsitsownfullfunctioningenvironmenttorunDeveloperwrittenIntegrationTests

Storageofartifactsaswellasopensourcevulnerabilityscanning

CodeQualityChecks

CD-Routetolivepipelinesonapercomponentbasis

Continuous Integration and Delivery with Composer

Continuous Delivery Pipelines

Other*nixOS’s

Microservices Microservices Microservices

AppsTraditional

Elements

API Gateway

ContainerizedApplications

API Gateway and Application Frameworks

APIGateway

•  BuiltonOpenSourcetechnologyfromSpring

•  TookinspirationfromFabric8forintegratingwithOpenShifttogetservicelocation

•  DynamicallyregistersMicroservicesastheystarttakingeventfromKubernetestheninterrogatingmicroservicefordetailsaboutitself

ApplicationFrameworks

•  BasedonOpenSourcetechnology•  Java•  PythonandJS

•  IntegratestightlywithKubernetestoprovideoperationalimperatives•  Restarts,liveliness,health,metrics

•  IntegrateswithAPIGateway•  Monitoringbundledinaspartofbuild

•  Componentdependencymanagementoutofthebox

•  Standardrepostructure

What does all this mean for delivery?

52 Builds 89 UAT Releases

36 Production Releases

Delivery of a Prototype in 2017

3 Months

94 Builds - (99 Integration Deploys) 74 UAT Releases

0 Production Releases

Delivery of a Prototype in 2018

1 Month Latency during deployments is now measured in minutes J

Evolution of the Team

• Howcouldwemakeadifferencetobuildanddeploytime?

• 20peoplefromacrossDevandOps

Feburary20165DaysHackathon

• Howdoweimplementcontinuousdelivery?

• 15PeoplefromacrossDevandOps

June20162WeekHackathon • ProjectTeamtotake

concepttoMVP•  ImplementOpenShiftandCDPlatforms

November2016BusinessCaseforCD

• Widefullstackteam• LookaftertheOperationalPlatformasaProduct

May2018BAUTeam

How Redhat helped us

•  ProfessionalServices•  Architecture–Helpedusgetthedesignright,thenvalidatedonceitwasimplemented•  Engineering–Onsiteengineeratvariousdifferenttimes,helpedwithautomationbutalsohelpedout

acrosstheprojectasneeded–reallyboughtintoourselfmanagedteam•  Ongoingsupportthroughtheusualsupportchannels

•  Continuallyprovidinguswithnewideasaboutdifferenttechnologies•  Throughblogsandpublications•  AttendingRedhatconferences•  Ongoingandregularrelationshipdiscussions

•  Encouragedustotakepartinopensource•  Showingtheartofthepossible

•  InspiringuswiththeiruseofOpenOrganization

What Next?

Thank you for your time. Questions?

Engineering the Bankimages.engage.redhat.com/Web/RedHat/{03342036-0619-4e0b-82f3 … · Continuous...

Documents