Date post: | 05-Jan-2017 |
Category: |
Technology |
Upload: | ca-technologies |
View: | 97 times |
Download: | 5 times |
World®’16
What'sNewinCAAgileRequirementsDesigner?Huw Price– VP,ApplicationDelivery,andProductManagerCAARD- CATechnologies
DO5X27S
DEVOPS
2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ForInformationalPurposesOnlyTermsofthisPresentation
©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.Thepresentationprovided atCAWorld2016isintendedforinformationpurposesonlyanddoesnotformanytypeofwarranty.Someofthespecificslideswith customerreferencesrelatetocustomer'sspecificuseandexperienceofCAproductsandsolutionssoactualresultsmayvary.
CertaininformationinthispresentationmayoutlineCA’sgeneralproductdirection.Thispresentationshallnotserveto(i)affecttherightsand/orobligationsofCAoritslicenseesunderanyexistingorfuturelicenseagreementorservicesagreementrelatingtoanyCAsoftwareproduct;or(ii)amendanyproductdocumentationorspecificationsforanyCAsoftwareproduct.Thispresentationisbasedon currentinformationandresourceallocationsasofNovember1,2016,andissubjecttochangeorwithdrawalbyCAatanytimewithout notice.Thedevelopment,releaseandtimingofanyfeaturesorfunctionalitydescribedinthispresentationremainatCA’ssolediscretion.
Notwithstandinganythinginthispresentationtothecontrary,uponthegeneralavailabilityofanyfutureCAproductrelease referencedinthispresentation,CAmaymakesuchreleaseavailabletonewlicenseesintheformofaregularlyscheduledmajorproductrelease.SuchreleasemaybemadeavailabletolicenseesoftheproductwhoareactivesubscriberstoCAmaintenanceandsupport,onawhen andif-availablebasis.Theinformationinthispresentationisnotdeemedtobeincorporatedintoanycontract.
3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Abstract
ThissessionwillprovideanoverviewofthenewfunctionalityinCAAgileRequirementsDesignerandhoworganizationsareusingittorealizevalue.Putsimply,alothaschangedsinceCAWorld2015,andourvisionforsoftwaredevelopmenthaschangedwithit.
Joinustofindoutabout:• Anextendedrangeofintegrationscoveringprojectmanagementtools,versioncontrol
systems,testautomationframeworksandmore.We’verecognizedthatmanuallyinterveningtomoveassetsbetweentoolsandformatsistooslow,introducesdefectsandstandsinthewayofthefullyautomatedpipelinewhichisDevOps,andwe’veworkedtoresolvethispressingissue.
• Aninnovativeapproachtotestautomation,whichenablestestscripts,testdataandvirtualendpointstobegeneratedautomaticallyforpotentiallyanyscriptorkeyword-drivenframework.
• Moreaboutrisk-basedtesting,wheretheprobabilitythatcertainpartsofthesystemwillbeexercisedbyausercanbereverse-engineeredfromlivesystemdataandusedtogenerateoptimizedpaths.
HuwPriceCATechnologiesVP,ApplicationDelivery,andProductManager,CAAgileRequirementsDesigner
4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Agenda
CREATINGAUTOMATIONSCRIPTS,DATAANDVIRTUALDATAALLATONCE
RISK-BASEDTESTING
INTEGRATIONS,THENEWMACVERSIONANDWIREFRAMING
EXTENDEDINTEGRATIONS:JIRA,CAAGILECENTRAL,HPEALM
DATABUILDER ANDETL
CAAGILEREQUIREMENTSDESIGNERSEVER– BIGDATACLOUDSTORAGE
1
2
3
4
5
6
New
in2015-16
Ontheroadm
ap
COGNITIVEADAPTIVETESTING7
5 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
What’sNew2015-16
6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CreatingAutomationScripts,DataandVirtualDataAllatOnce
7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
UsingCAARDasanAcceleratortoTestAutomation
Therequirementsortestcasesstoredasan“active”flowchart
Anautomationengineer/testercreatesaconfigurationfileand
overlayscodesnippets
Nomoremanual,linearscripting,andallthebenefitsoftheoptimizer:§ Systematicallyandautomaticallyderiveoptimizedtests§ Maximumtestcoveragewithnoover-testing§ “Oneinput,manyoutputs”– createandmaintaintestdata,virtualendpointsandexpectedresultsasa
partofautomation§ Reacttochange– auto-updatethetestsandcreateare-usablelibraryoftestcomponents
Theoptimizercompilesthescripts,completewithdata
Thetestscanbecreatedforanyscript-drivenframework
Changesmadetothemodelareautomaticallyreflectedinthetests
8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAAgileRequirementsDesigner– AutomationLayers
§ CAAgileRequirementsDesignercannowgenerateautomationScriptsdirectly.Youcan:– CreateCodeSnippetLibraries– LinktheSnippetstoVariables– MaptheSnippetstofunctionallogicinflows
§ GeneratemultipletypesofautomationscriptsbasedonoptimizedTestCases
§ RegenerateAutomationScriptswheneverthelogicchanges§ CreateRequest-ResponsePairsatthesametimeasscripts
9 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Risk-BasedTesting
10 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
WhatIsRiskBasedTesting
Risk-basedtesting(RBT)isatypeofsoftwaretestingthatfunctionsasanorganizationalprincipleusedtoprioritizethetestsoffeaturesandfunctionsinsoftware,basedontheriskoffailure,thefunctionoftheirimportanceandlikelihoodorimpactoffailure.Intheory,thereareaninfinitenumberofpossibletests.
Wikipedia
RiskAssessmentProductRisk
11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DigitalRisk
Focusattentiononaparticularaspectofthebehaviourofthesystem.Thesemightbecriticalorriskyfeatures,technicalaspectsoruseroperationsofinterest,orparticularaspectsoftheconstructionorarchitectureofthesystem.
Pocketbook
ChiefDigitalOfficer ChiefRiskOfficerDigitalAssurance
12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DigitalAssurance
DigitalAssuranceenabledsolutionsmodelcomplexecosystemsofecosystemstovisualizestheapplicationsecologyandleveragesconnectedintelligencetechnologytooverlaybusinessdata,riskandbehavioursofsystems(systemicandepistemic).
Pocketbook
ArD
DesignOpsAppEcology
13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAAgileRequirementsDesigner
Requirements
DigitalManagement
DigitalRisk
DigitalTesting
14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DigitalTesting
Atthemostfundamentallevel,thepurposeoftestingistogatherinformationtolearnaboutsomeaspectofasystemandpotentiallymakeadecisionbasedontheoutcomeofoneormoretests.
Pocketbook
ShiftRightShiftLeft ConnectedIntelligence
15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ExtendedIntegrations:JIRA,CAAgileCentral,HPEALM
16 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ManyGoodProjectManagementToolsDeliverImmenseValuetoTestandDevelopmentTeamsPMTools:
1. Supportdecisionmaking:bothproductandprojectdecisions
2. Provideacentralizedstoreforassetswithanorderlyfilestructure
3. Allocatetaskstoavailableteamsorteammembers
4. Visibilityandtraceabilitybetweenteams’tasks
5. Helpwithproductroadmapping andmoreinformeddecisionmaking
6. Offerdashboards,forecasts,monitoring
7. Includetime,costorcomplexityestimates
17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Visibility InformeddecisionmakingTrackability
Communication Traceability
TrackabilityCollaborationCross-functionalteams Cross-functionalteams
Tests
Defects Stories
Epics
Manageriallevel
18 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Communication Traceability
TrackabilityCollaboration
Tests
Defects Stories
Epics
HastheRequirementsorTestDesignProcessFundamentallyChanged?
Visibility InformeddecisionmakingTrackability
19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Tocreateperfecttest
cases
Designandprovisiontestdata
Tomanagechangeintestcases
Tocreateautomation
scripts
Fromoneinput
Createmultipleoutputs
=
Fewerlanguagehops
Fewerproducthops
Toestimatecomplexity
Populatestoryboardsandbacklogs
WhereDoesCAAgileRequirementsDesignerFitinWithPMTools?
Tobuildbetterrequirements
Toimprovemyexistingtestcases
DesignandprovisionSV
Impactanddifferences
20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Systemundertest
TestScript
CAAgileCentralCAARD
Flow Testassets
CAAgileCentralObjects
Defects
Environments/Opsteam
AutomationLibraryTestData
AutomatedTest,
LinkedtoTestData
VirtualEndpoints
Optimizedtestcasesareexportedbackoutandlinkedtoexpectedresults.Thesemighthavevirtualendpointsandresolvedtestdataattached.
11
3
4
5
6
2
Changerequest
7
1
ExampleInfrastructure:CAAgileCentral
21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
OntheRoadmap
22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DataBuilder
23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAAgileRequirementsDesigner- DataBuilder
DataBuilder – anewsetoffeaturesinsideArD tohelpdesignandmanufacturecomplexdatausingtheTDMDataGenerationengine.
Itcreatesscriptstocreatethedata,whichcanbemovedontoCImanagedimages– DockerimageincludetheDatabuilder scriptstofindandmakethedataappropriatefortheautomatedtests.
Thetargetschemai.e.wherethedatawillbecreatedhasasetofCAmetatables.Thesetablescontrollocaltestmatchingi.e.finding(notestmartisrequired).
YoucanalsodoafindandIFNOTfounddoamake.
Wealsotrackkeysforcheckingactualvsexpectedresults.
Thepublishissplitintothreeparts:§ Buildthekeys§ Dothepublish§ Doanypostactions,SUM,AVGetc.
ThetimeittakestocreatecomplexpublishescomparedtousingoldCATestDataManagerhasgonefromhourstominutes.Itwillgotoseconds.EventuallywewillhopetoparseSQLandautobuildthedataneededtotestit.
Anintegratedtooltocreaterequirements,automation,testdataandvirtualization.
24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAAgileRequirementsDesigner- DataBuilder
DataBuilder hasmanyapplications:
§ ETLTesting
§ BigDatatesting
§ MigrationTesting
§ BusinessIntelligenceTesting
§ ComplexEDIFileCreation
§ Plusgeneraldatacreationtosupportdevelopment,testingandautomation
§ Couldalsobedeployedasadocker applianceonAWS,etc.
25 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAAgileRequirementsDesignerSever–BigDataCloudStorage
26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
RunResults
TypicalBuildProcess
ExecutionEngine
BuildEngineDevelopment/
Code
DifferentvisualrepresentationsofPass/Failresults.
TrafficLights Dashboarding Email(Jenkins)
27 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CurrentWorldOrder– Bottlenecks– NoIntelligence/Dependencies
Testing– Grayarea
28 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Stage1– RunResultFeedbackLoop(CloudStorageforResults)
ExecutionEngine
BuildEngine
Development/Code
Model
Runresults
29 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Step2– MoveAllArtefactsIntoCloudStorage->BigDataStorageforFlowsTestresultsbounddirectlytotheirroutesthroughthesystem.
30 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Step3– PinPointTesting/DetectFaultAfterafailurethemodelcanbeusedtogeneratememoretest
casesbypinpointtesting– testcasesfocusedondiscoveringmoreknowledgeaboutthefailure.
31 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Step4– RiskAnalysis/DependencyMappingUsemeta-deta assignedtothemodeltoperformriskanalysis.Aretheeffectedroutesthroughthesystemaboveasetthreshold?
=63%ofUserActivity
Can’tRelease
32 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Step5– DependencyMappingofCodeWe’vefoundtheprocess(es)responsible– nowwecantracebacktotheresponsibleteams!
DevelopmentPinpointedFailure
Defectcreated
33 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Stepx,y,z– RunninginParallel
§ Onlineoptimisationinthecloud
§ Predictiveanalysis
§ Dashboards
§ Reports
§ Insight
34 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Integrations,theNewMACVersionandWireframing
35 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
IntegrationWithSV
§ CreationofRRPairsinARD
§ AbilitytopostdirectlytoSVandcreatevirtualserviceon-the-fly
§ EmbedappropriatelinkstoserviceinAutomationscripts
Scripts
VirtualService
36 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
IntegrationWithRA
37 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
IntegrationWithRA
§ GoingtouseRAtobuild,deploy,test,andreleaseARDwithinourowneco-systemindevelopment
§ Allowustodevelopacomprehensivesetofdemo’sofhowwetestARDwhichcanbeusedtodemonstrateARD.
§ We’llmakethisavailableviaanimagedVMeveryrelease-Realdata,realscenarios,realtests.
38 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
EggPlantIntegration– KeywordDrivenAnexampleusecase:1. OpenyoureggplantsuitefromAgileDesigner:allimages
areavailableinalistonapane.2. Whenmodifyingablockdescription/oranycode
completion-enabledfield,thoseeggplantimagesareavailableasentriesforcodecompletion.
3. Youchooseaanactionfromthecodecompletion,andwhenenteringthevariablenames,haveeggplantimagesavailableinyourcodecompletion– buildingautomationfornontechnicalteams
39 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MACVersion– ARD– AvailableforBeta
40 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Telerik– ReportingandAutomation
§ Reportingtool§ Create
automationscripts§ FullAPILayer
41 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Wireframing - DevelopRapidPrototypesFromRequirements
Transformmodelbasedrequirementsintoarealscenarios– earlyrealizationofrequirements
• Mapuserinputactionstoprocesses• Addconditionsforoutputstooccur• Applytestdatafunctionswhichareresolved
persteptogooffandhuntdatabasedontheexecution
• Fullintegrateddebuggingenvironmenttovisualizetheflowandcorrespondingdataduringexecution
42 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CognitiveAdaptivetesting
43 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Questions?
44 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
RecommendedSessions
SESSION# TITLE DATE/TIME
DO5X29SModel-BasedTestingforAchievingMaximumCDPipelineAcceleration
11/17/2016at3:00PM
DO5X40S CaseStudy:WhyRabobankWasInspired 11/17/2016at3:45PM
DO5X42STechVision:TestDataonDemand:DeliveringtheRightData,totheRightPlace,attheRightTime
11/17/2016at4:30PM
45 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MustSeeDemos
UseModelBasedTesting
CAAgileRequirementsDesigner- 515-DevOpsTheatre5
DevOps5Theatre
AchieveMaxTestCoverage
CAAgileRequirementsDesigner- 516DevOpsTheatre5Theatre
ImproveDataCompliance
CATestDataManager512- DevOpsTheatre5
DevOps5Theatre
DeliverTestDataFaster
CATestDataManager511- DevOpsTheatre5
46 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Thankyou.
Stayconnectedatcommunities.ca.com
47 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DevOps– ContinuousDelivery
FormoreinformationonDevOps– ContinuousDelivery,pleasevisit:http://cainc.to/PiTFpu