+ All Categories
Home > Documents > Increasing Engineering Producbvity in Microservices World

Increasing Engineering Producbvity in Microservices World

Date post: 14-Feb-2017
Category:
Upload: nguyenliem
View: 218 times
Download: 2 times
Share this document with a friend
48
Copyright © 2016 Splunk Inc. Sumit Nagal Principal Engineer in Quality, Intuit Increasing Engineering ProducBvity in Microservices World
Transcript
Page 1: Increasing Engineering Producbvity in Microservices World

Copyright©2016SplunkInc.

SumitNagalPrincipalEngineerinQuality,Intuit

IncreasingEngineeringProducBvityinMicroservicesWorld

Page 2: Increasing Engineering Producbvity in Microservices World

Disclaimer

2

DuringthecourseofthispresentaBon,wemaymakeforwardlookingstatementsregardingfutureeventsortheexpectedperformanceofthecompany.WecauBonyouthatsuchstatementsreflectourcurrentexpectaBonsandesBmatesbasedonfactorscurrentlyknowntousandthatactualeventsorresultscoulddiffermaterially.Forimportantfactorsthatmaycauseactualresultstodifferfromthosecontainedinourforward-lookingstatements,pleasereviewourfilingswiththeSEC.Theforward-lookingstatementsmadeinthethispresentaBonarebeingmadeasoftheBmeanddateofitslivepresentaBon.IfreviewedaQeritslivepresentaBon,thispresentaBonmaynotcontaincurrentor

accurateinformaBon.WedonotassumeanyobligaBontoupdateanyforwardlookingstatementswemaymake.InaddiBon,anyinformaBonaboutourroadmapoutlinesourgeneralproductdirecBonandis

subjecttochangeatanyBmewithoutnoBce.ItisforinformaBonalpurposesonlyandshallnot,beincorporatedintoanycontractorothercommitment.SplunkundertakesnoobligaBoneithertodevelopthefeaturesorfuncBonalitydescribedortoincludeanysuchfeatureorfuncBonalityinafuturerelease.

Page 3: Increasing Engineering Producbvity in Microservices World

AboutMyCompany

3

Page 4: Increasing Engineering Producbvity in Microservices World

AboutMe

4

Work

Play

SumitNagalPrincipalEngineerinQuality,Intuit

Page 5: Increasing Engineering Producbvity in Microservices World

AgendaMicroservicesOverviewOpportunityJourneyLineOpBmizaBonHelpingEngineeringProducBvityBestPracBcesandLessonsLearnedQ&A

5

Page 6: Increasing Engineering Producbvity in Microservices World

MicroservicesOverview (FinancialData

Pla_orm)

Page 7: Increasing Engineering Producbvity in Microservices World

7

Page 8: Increasing Engineering Producbvity in Microservices World

Overview

8

Page 9: Increasing Engineering Producbvity in Microservices World

Opportunity

Page 10: Increasing Engineering Producbvity in Microservices World

Challenges–Microservices

10

Produc8vity

Compliance

Testability

Global

InternalServices

ExternalServices

Supportability

Page 11: Increasing Engineering Producbvity in Microservices World

Challenges-Engineering

11

Dev-Engineer Ops-Engineer Quality-Engineer Support-Engineer ProductManager Management

Ineedearlyintegra8onenvironment.Iwanttoquicklyiden8fyandfixintegra8onissues.

Ineedvisibilityoftheinfrastructure.Ineedtheinforma8onondependentservices.

Ineedtotesteveryserviceinisola8on.Ineedvisibilityofmydependentservicetes8nganditsimpactonmyservice.

HowwillIiden8fyissueinserviceforcustomerflow?HowwillIhelpcustomerandexternalservicestoiden8fyserviceproblem?

Whatfeaturesarewidelyusedbyinternalteam?Howtopivotservicesquicklybasedonexternalrequirements?

HowcanIgetvisibilityreleasesacrossservices?Whatarepoten8alboKlenecksforservicerelease?

Page 12: Increasing Engineering Producbvity in Microservices World

JourneyLine

Page 13: Increasing Engineering Producbvity in Microservices World

Splunk6.1Traceability

Splunk6.2+

SupportabilityTestability

2015-Apr2015-Jan

2016

2014-Aug2014-Oct

•  E2ETesBng•  SplunkSDLC•  ConBnuous

Delivery

•  Loggingstandard•  MockingService•  TxnTracing

•  InternalServices•  FuncBonalFlow•  AlerBng

•  AdvanceCharBng•  VersionControl•  BestPracBces•  Visibility

•  .conf2014•  DataModelling•  Pivot•  Dashboards

JourneyLine

Developer

Quality

Ops

SupportManagement

ProductManager

Page 14: Increasing Engineering Producbvity in Microservices World

OpBmizaBon

Page 15: Increasing Engineering Producbvity in Microservices World

SplunkAgilityandStandard

LinkingTestswithSplunk

AdvanceFeatureImplementaBon

SplunkAppandDataModeling

AlerBngandTroubleshooBng

SoQware&Hardwareupgrade

ConBnuousDeliveryAdopBon

OpBmizaBoninSplunk

Page 16: Increasing Engineering Producbvity in Microservices World

HelpingEngineeringProducBvity

• HelpingEngineeringProducBvity

Page 17: Increasing Engineering Producbvity in Microservices World

ProcessImplementaBon-IncreaseEngineeringProducBvity

17

•  ConBnuousDelivery•  Standards(Logging/TesBng/E2E/CerBficaBon)•  Traceability•  AdopBon•  Agility

ForReference

Page 18: Increasing Engineering Producbvity in Microservices World

ConBnuousDelivery

18

ForReference

Page 19: Increasing Engineering Producbvity in Microservices World

Standards-ProcessAdopBonLogging-  LogFormafng/Standard/Library

TesBng-  FDPServices/SingleService/Environment

WorkflowCerBficaBon

19

Page 20: Increasing Engineering Producbvity in Microservices World

Standards-Logging

20

ForReference

Page 21: Increasing Engineering Producbvity in Microservices World

Standards-TesBng

21

ForReference

Page 22: Increasing Engineering Producbvity in Microservices World

Standards-Workflow

22

ForReference

Page 23: Increasing Engineering Producbvity in Microservices World

Standards-CerBficaBon

23

ForReference

Page 24: Increasing Engineering Producbvity in Microservices World

Traceability-VisibilitytoIdenBfyPotenBalIssue

24

•  WorkflowStrategy(End-to-End)•  SingleService•  SingleTest

Page 25: Increasing Engineering Producbvity in Microservices World

Traceability–Workflow–Tax

25

ForReference

Page 26: Increasing Engineering Producbvity in Microservices World

Traceability–SingleService-AS

26

ForReference

Page 27: Increasing Engineering Producbvity in Microservices World

Traceability–SingleTest–AS

27

ForReference

Page 28: Increasing Engineering Producbvity in Microservices World

Traceability–SingleTest–DAS

28

ForReference

Page 29: Increasing Engineering Producbvity in Microservices World

AdopBon-ImprovingEngineeringProducBvity

29

•  Workflow•  InternalServices•  ExternalServices•  SingleService

Page 30: Increasing Engineering Producbvity in Microservices World

AdopBon–Workflow-Tax

30

ForReference

Page 31: Increasing Engineering Producbvity in Microservices World

AdopBon–Workflow-Banking

31

ForReference

Page 32: Increasing Engineering Producbvity in Microservices World

AdopBon–Tax–InternalServices

32

ForReference

Page 33: Increasing Engineering Producbvity in Microservices World

AdopBon–Tax–FDPServices

33

ForReference

Page 34: Increasing Engineering Producbvity in Microservices World

AdopBon–Tax–ExternalService

34

ForReference

Page 35: Increasing Engineering Producbvity in Microservices World

AdopBon–Tax–SingleService-AS

35

ForReference

Page 36: Increasing Engineering Producbvity in Microservices World

Agility-IncreasingProducBvitywithSplunk

36

•  Rightindexingacrossenvironment–holisBcview•  PivotcreaBon-standard•  DashboardcreaBon-standard•  ExtractedFields-standard•  TransacBonID-standard•  Versioncontrol–maintainingandmanagingofSplunkassets•  PromoBon–SimplifymonitoringandalerBnginproducBon•  Traversing–Acrossmicroservices•  tstatsuBlizaBoninplaceofpivot–performanceboost•  Summaries–AcceleraBontechnologywithsummaryindexing

Page 37: Increasing Engineering Producbvity in Microservices World

Agility–IncreasingProducBvitywithSplunk

37

ForReference

Page 38: Increasing Engineering Producbvity in Microservices World

BestPracBces/LessonsLearned/What’sNext

Page 39: Increasing Engineering Producbvity in Microservices World

BestPracBces

39

Microservicesaredifferentthanmonolith–handlewithcare

Loggingstandard–mustbeinmicroservices

End-to-endtesBng–strategydefine

Datamodelling–perservice

ConBnuousdelivery-adopBon

SplunkSDLC-alerBng/supportability/accountability

Page 40: Increasing Engineering Producbvity in Microservices World

LessonsLearned

40

Performanceissues

Numberofqueriesperuser

Dashboarddebuggingwithdatamodel

DatamodelmigraBon

ModificaBonindatamodel(enhance/updaBon)

Processaccountability

Datamodel–supportabilityspecialchar“|”

Jsonparsingwithdatamodelischallenging

CalculaBonfieldsupportismissingindatamodel

Diskspace

Page 41: Increasing Engineering Producbvity in Microservices World

What’sNext

41

AtlassianJiraintegraBon

PagerDuty

SplunkRESTAPI

AtlassianHipChat

CloudBeesJenkins

SplunkannotaBonintesBng

InteracBonandlinkinginmulBpledashboards

HolisBcdatamodelanddashboard-anyservice

Page 42: Increasing Engineering Producbvity in Microservices World

Q&A

• HelpingEngineeringProducBvity

Page 43: Increasing Engineering Producbvity in Microservices World

THANKYOU

43

Page 44: Increasing Engineering Producbvity in Microservices World

Appendix

• HelpingEngineeringProducBvity

Page 45: Increasing Engineering Producbvity in Microservices World

Splunk–DataModel

45

ForReference

Page 46: Increasing Engineering Producbvity in Microservices World

Splunk–DataModel-Fields

46

ForReference

Page 47: Increasing Engineering Producbvity in Microservices World

Splunk–DataModel–Eval/Regex/lookup

47

ForReference

Page 48: Increasing Engineering Producbvity in Microservices World

LifecycleforLogchangeinSplunk

48

•  NewchangeinLogs• ModifyDataModel•  AutoExtract•  CustomExtract• ModificaBoninMainSearch• ModificaBoninPanel•  DownloadDataModel•  DownloadDashboard•  DataModel-MovetoProd• ModificaBoninProdDashboard

ForReference


Recommended