Opportunities & Challenges in Adopting Microservice Architecture ...

transcript

Opportunities&ChallengesinAdoptingMicroserviceArchitectureforEnterpriseWorkloads

ShriramRajagopalan,PriyaNagpurkar,TamarEilam,

andHaniJamjoomEtaiLev-Ran,andVitaBortnikov

IBMWatson Research IBMResearch,Haifa

FrankBudinsky

Contact:shriram@us.ibm.com

• Emergenceofmicroservices&DevOps

• Challenges&Opportunities

• AdoptingaSDNperspectiveofmicroservices

• Version/Content-awarerouting

• Systematicresiliencetesting

FromMonolithstoMicroservices

MonolithicServiceinstances

Microserviceinstances

• Eachserviceservesasinglepurpose (functionality)

• Manyloosely-coupledmicroservicescommunicateoverthenetwork

Well-definedAPI

• Asingleserviceservesmultiplepurposes

• Tight-coupling acrossservices

FromWaterfalltoDevOps

Plan Develop Test Deploy

monthstoyears

Features,performance improvements,bugfixes,etc.,areperiodically deliveredasonebigupdate

hourstodays

Continuousdeliveryofincrementalupdates

P T DD P T DD P T DD P T DD P T DD

Plan Develop Test Deploy

Culture+Automation +Instrumentation

Emphasizesconstantexperimentation&feedback-drivendevelopment

Microservices+DevOps

• Polyglotapplicationswithloosely-coupledmicroservices

• Small“twopizza”teamspermicroservice– Autonomy&accountability– Owntheroadmapforthe

feature/service– Independent launchschedules

• Develop,deploy, scale– “Youbuildit,yourunit”

• 10sto100sofdeploymentsadayacrosstheapplication– E.g.,Orbitz,GrubHub,HubSpot

• Multipleversionsco-existsimultaneously

MicroserviceA

D D’

Application

MessageBus

CloudPlatformServices

3rdpartyInternet Services

SocialMedia

MobilePushNotification

Node.js

Go Java

“Traditional”EnterprisesaremovingorhavemovedtoMicroservices+DevOps

Opportunities

• Enterprisesare– Re-architecting legacyapplicationstomicroservicearchitecture– Developingin-houseplatforms tohostsensitiveappsonpremise

• E.g.Fidelity’sMako

– Stillexperimentingwithdifferentdesignalternatives– Heavilyleveragingopen-sourcetechnologies

• Opportunityfortheresearchcommunitytoengage– Influenceinfrastructure&applicationdesign– Integrateideasintoopen-sourceplatformsandsolutions

Challenges

• 10sto100sofdeploymentsadayacrosstheapplication

• Multipleversionsco-existsimultaneously

• Complexityshiftedtothenetworkandorchestrationacrossservices

• Cascading failuresdespitethemicroservicesbeingdesignedforfailure

MicroserviceA

D D’

Application

MessageBus

CloudPlatformServices

3rdpartyInternet Services

Facebook

MobilePushNotification

Node.js

Ad-hocDesigns&Implementations

• TwoOptions:

• Adoptopen-sourceframeworksfromlargescaleinternetapplications(e.g.,NetflixOSS)• Theseframeworksarepointsolutions thatfittheneeds&environment of

thecompaniesthatoperatetheseapplications(e.g.,Javaonlysupport)

• Shoehorntheservice-orientedwebapplicationintoclusteringframeworkslikeKubernetes,Marathon,etc.,andwritead-hoctoolsontoptocontrolthemicroservices

MicroserviceApplicationRequirements

• Integration– Serviceregistration&discovery– Loadbalancingofrequestsacrossmicroservice instances

• Version&content-awarerouting– Hypothesisdriven-development (i.e.A/Btesting)– Canarydeployments (featurereleaseto%ofusers)– Red/Blackdeployments (gradual rollout toallusers)– Etc.

• Operationaltestinginproduction– E.g.,doesfailurerecoveryworkasexpected?

IntroducingAmalgam8

• Observation:– Microservices interactonlyoverthenetwork predominantly usingHTTP(s)– Existingsolutions lacktheabilitytodynamicallycontroltheroutingof

requestsbetweentwomicroservices

• Insight:– Thinkofrequestsaspacketsandmicroservicesasswitches– ALayer-7SDNwillsimplify integrationandrouting

• Design:– Sidecar:Aprogrammable layer-7proxyprocess attachedtoeachmicroservice– Controller:TheequivalentofanSDNcontroller,exceptatLayer-7

RequestsA'

B’DataPlanew/TenantApps

Controller,ServiceRegistry

Multi-tenantControlPlane

SimplifyingIntegration

15Kubernetes,Marathon,Swarm,VMs,BareMetal

Sidecar

Tenant1

Tenant2

Tenant3

RequestsA'

Controller,Registry

upgradefromBtoB’

VersionRouting

Send35%ofiphonetraffictoA’and65%toA

17Kubernetes,Marathon,Swarm,VMs,BareMetal

Sidecar

Analytics

Canarydeployments

Red/Blackdeploy…

ActiveDeploy

Tenant1

Tenant2

Tenant3

Auto-rollbackifB’farespoorlycomparedtoB,withagivenconfidencemeasureRef.toCanaryAdvisor,ISSTA2015

ResilienceTesting

• Microservicesdesignedbut“seldom”testedforfailures

• Randomizedfaultinjection(e.g.,NetflixChaosMonkey)isinsufficient– Manualefforttovalidatewhetherapplicationrecoveredproperlyornot

• Gremlin– systematicresiliencetesting– Scriptfailurescenariosandexpectations– Faultsinjected fromthenetwork– Runassertionson thelogstovalidateexpectations– Exposesfaultyrecoverybehavior, conflicting failurehandlingpoliciesacross

services,etc.

RequestsA'

Controller,Registry

VersionRouting

Overload(C)Assert (A’respondsin10ms)

FaultInjection

Kubernetes,Marathon,Swarm,VMs,BareMetal

Sidecar

GremlinResilienceTesting

Tenant1

Tenant2

Tenant3

Ref.toGremlin,ICDCS2016

Failuresareemulatedbymanipulatingnetworkinteractionsbetweenservices

(e.g.,delays,HTTP500s,etc.)

Assertionsarevalidatedagainstrequestlogstoidentifyfaultyrecoverybehavior

ThankYou

• https://amalgam8.io

• https://github.com/amalgam8/examples

Backup

ResearchChallengesintheFaceofContinuousChange

• Managingstatefulservicesanddatastores

• Problemdeterminationgainsmanydimensions– Theproblemmaynotjustbeinyourcode– Manydimensions changesimultaneously suchasinfrastructure, runtime, etc.– Canwepinpoint theissuedowntotheGit commitbycorrelatingruntime logs

anddevelopmenthistory?

• Toomuchdata,toolittleinsights– Logsemittedbyalllayersofthesoftwarestack,byautomatedbuild tools,etc.– Yet,wearenowhereclosetopinpointing theproblemandfixingitwhen

thingsgowrong!

OpportunitiestoFixIssuesBeforeTheyOccur

• Softwarebuild,testanddeploymentphasesarecompletelyautomated

• Providesauniqueopportunitytocatchsecurityvulnerabilities,buggyimplementations,etc.,evenbeforesoftwareisdeployed

• However,existingtoolsandtechniquesdonotscaletotheextremecodechurn(100sofdeployments)

Opportunities & Challenges in Adopting Microservice Architecture ...

Documents