1 |
Stuart FeaseyIBM Hybrid Cloud - Test and Virtualization Specialist
Market Leading Continuous Testing and Service Virtualization Capability for WebSphere
2 |
Whatdoesanenterpriseenvironmentmeantoyou?
3 |
Today’sRealityforTesters
28%ofTestersarenottesting50% (ormore) ofthetime!
40%ofTestersarenottestingatleast1dayper
week!
4 |
MiddlewareChanges
4 InternalSoftwareUpgrades
§ Standardsbodyupdates
4 NewInitiatives
§ Regulatorychanges
4 VendorChanges
§ Stackupgrades/EOLdates
§ Fromonevendortoanother
4 Consolidation
§ CorporateM&A
5 |
Today’sRealityforTesters
TesterswanttospendMORE time
TesterswanttospendLESS time
6 |
TheRoleofTestingintheContextofDevOps
Top15challengesidentifiedafteranalysisofaround20IBMDevOpsworkshopreports:
• FlexibleenvironmentprovisioningrequiredbyDevOpsteams(67%)• ThereisalackofcollaborationbetweenBus,DevandOps(58%)• Thereisnocoordinationofthedeliveryenvironmentelements(e.g.aDevOpsCoE)(58%)• GovernancewhenapplyingDevOps(50%)• Deploymentsarelargelymanual(anderrorprone)(50%)• TherearenoorlimitedDevOps-specificmetricsinplace(50%)• Insufficientandinconsistenttestautomation(42%)• Testdatamanagement(42%)• Testingisnotperformedearlyusingcapabilitiessuchasservicevirtualisation (33%)• Thereisnointegratedtoolsarchitectureinplace(42%)• NoDevOpsvocabularyisinplace(33%)• NoDevOpsvisionorstrategyhasbeendefined(33%)• Missingorinconsistentmechanismsforgettingfeedback(33%)• ApplyingDevOpsinaregulatedenvironment(33%)
7 |
Presentation layer
Integrations, data and business logic
Traditional UI testing:
Automated Integration Testing and Service Virtualization:
The majority of risk in modern systems is seldom tested as it is unseen.
8 |
Shiftingleft;Testingsmarter
UNIT SERVICE UI
Automated Integration Testing
Service Virtualization
Traditional UI Tools
Development Testing Staging Production
9 |
10 |
Gartner - Magic Quadrant for Software Test AutomationPublished: 15 November 2016
IBM STRENGTHS•IBM's test automation tools can give many enterprises a jump-start in their continuous testing efforts. They are strongest as an integrated solution, delivering a combination of products and services.•IBM provides automated testing support for many technologies and applications, including legacy systems, client/server applications, packaged applications, and Web and mobile applications. It offers integration across the development and delivery life cycle.•IBM is well-positioned for cloud-based testing and advanced cognitive analysis to aid in adaptive testing and decision making.IBM CAUTIONS•IBM's portfolio is comprehensive and can be perceived as too complex, especially in the early stages of investing in test automation or for simpler testing needs.•While IBM provides a powerful portfolio, it is not optimized for nontechnical users and may require additional services to set up and implement.•IBM supports packaged application testing, but relies on partners for business process analysis and validation.
HTTP(S)Web Services / RESTJSON / SwaggerXML (XSD, WSDL)SOAP
JDBC
WASMQ
z/OS SI BUS
IIB
RR
HTTP(S)WebSphere MQJMS (multiple)RESTS/MIMEJava RMI (virtualization)JVM (virtualiazation)SAP IDOC, BAPI, RFC, XI 3.0Software AG’s IB & ISTCP/(S), IP, UDPCICS TGCICS IPICCICS DPLIMS ConnectTIBCO Rendezvous, Smart Sockets & EMSActive MQEmail (SMTP, IMAP)FilesFTP/S
Websphere Application ServerIBM Integration Bus (WSMB)Websphere MQWebsphere SI BusWebsphere RRUDDIWeb Services / RESTWSDL / WADL / SwaggerSystem z (CICS and IMS)Software AG IS, BrokerOracle FusionTIBCO ActiveMatrixDatabasesLog FilesCentraSiteSCA Domain
XML (XSD, WSDL, WADL)SOAPJSON / SwaggerCOBOL CopybookPL/1ASC X12UN/EDIFACTDFDLISO8583ISO20022Fixed WidthJava ObjectsAS2Software AG Broker Docs.Net ObjectsBytesSWIFTCHIPSFedWireFIXTIBCO ActiveEnterpriseCustom
13 |
IBMDevOpsSolutionforContinuousTesting
Presentationlayer
Middleware,Data, Services
Systems of Recordcomponents
Functional Tester
Web UI Tester
Rational Test Workbench
Integration Tester
Rational Performance Test Server
Performance TesterRational Test
Virtualization Server
RPTonCloud
RPTVTPacks
14 |
MiddlewareTestingChallenges
4 Whatisitthatneedstesting
§ Unknownsystemcomponents
§ Wherearethesystemendpoints
§ Variationfromdocuments
4 Whatmessagesarebeingexchanged
§ Goodsourceofdata
§ Mirrorrealliferatherthanhistory
4 Identifyingchanges
§ Helptargettesting
§ Optimizecreationofnewtestassets
15 |
ContinuousTesting
Execute test assets in headless mode§ Regression test new code quickly§ Continuous test cycles§ Build / Deploy / Test / Virtialize / Report�
Integrate into new or existing process§ Urban Code Plugin§ ANT task integration with Jenkins, CruiseControl, Bamboo, etc§ Command line execution§ Native integrations RTC, RQM, HP QC etc
Integration Tester reports served through a web browser (via Control Panel)
15
16 |
TopologyDiscovery
Clients
Web Services
Database
Mainframe
HTTP Proxy
JDBC Driver
CICS TG Exit
17 |
Synchronization
18 |
Buildingasystemmodelfromrecordedevents
Queue.A.Reply
Queue.A
Application servers
Clients Queue.B.Reply
Queue.B
Queue.C.Reply
Queue.C
19 |
WebSphere
4 RationalIntegrationTestercansynchronizewith:
§ IBMIntegrationBus
§ WebSphereApplicationServer
§ WebSphereRegistryandRepository
4 Discover:
§ HTTPEndpoints,MQconnections,JMSproviders,WSDLs,Databases,CICSandIMSconnections
4 Import
§ DFDLschemas
§ WSDL,WADL,XSD,Swagger
§ Copybooks,ProtocolBufferDefinitions
§ FromAPIConnect,Z/os ConnectEnterpriseEdition
20 |
SiftandpassthroughwithMQ
MQQueueManager
Queue
RealTestSystem
MQExit
Clientthatinitiatestransaction(orRIT)
MQExitisinstalledontheMQQueueManager.Directsinboundandoutboundtrafficforexecutionpurposes.
Stub
MQExitInterceptsmessagebeforeithitstheinboundqueue.
Ifstubisdown,thenMQExitdirectsmessagetoLivesystem.
Passthroughroute.
21 |
TypicalScenariosEncountered
22 |
BUSINESSWORKS
SAPPI
CICS
DATABASE
APP SERVER
SWIFT/MQ
HL7/TCP
X12/SOAP
JSON/REST
MostOrchestrationEngineshavetheirownproprietaryruntime(unlikeJ2E)whichmeansmigrationbetweenvendorsisariskpropositionasdevelopmentisrequired.Testenvironmentsareexpensiveanditisextremelydifficulttofault-findinanenvironmentwithmanymovingparts
Scenario1:AMigrationChallenge
23 |
IntegrationTestingandServiceVirtualizationcansignificantlyde-riskthemigrationandreducethetimerequired.
Development/testteamscanbuildagainstvirtualservicesandtestearlyandtestcontinuouslyusingmessagescapturedfromtherealsystems.Exception/edgecasetestingismucheasiertodo.
RITunderstandsawiderangeoftechnologiesandmessagingprotocols(includingDFDL)makingitwell-alignedtoIIBusers
Scenario1:FromTIBCOtoIIB
IBMINTEGRATIONBUS
SAPPI
CICS
DATABASE
APP SERVER
SWIFT/MQ
HL7/TCP
X12/SOAP
JSON/REST
24 |
Step1– Recordrealmessages(usingRITAgents)
Step2– Createtestsandvirtualservices
Step3– Enhancetestsandvirtualservicestoincludeedge/errorcases
Step4– Migrationteamusetests/servicestobuildIIBsolutionandgainconfidence
Step5– Swapvirtualservicesforrealtestenvironmentsoneatatimeandre-runtests
Step6– Endtoendtest(confidentoflessriskofexpensiveerrorsatthisstage)
Scenario1:Details
IBMINTEGRATIONBUS
SAPPI
CICS
DATABASE
APP SERVER
SWIFT/MQ
HL7/TCP
X12/SOAP
JSON/REST
25 |
Scenario2:IncreasingBuild/DeliveryVelocity
4 FinancialServicesCompany
§ AModernEnterprise
4 Complexity
§ Business
§ Technology
§ Organization
4 Getnextversionofweb/mobileofferingstomarketASAP
4 Maintainqualitywhilstprogressingtowardscontinuousdelivery
26 |
Scenario2:MeetthatChallengewithDevops Capabilities
4 Understandtheissuesandfindopportunitiestoimprove
4 Automate andsimplify toenablecontinuousintegration
§ Openinterfacestotesttools
• ANTscripting
• Comand line
• RESTinterface
• UrbanCode plugins
4 LeadingtoasmoothpathtoContinuousTestingandultimatelyContinuousDelivery
27 |
Scenario2a:CICSRegionunavailable
4 AppdevelopmentandtestteamuseUItestinginRationalTestWorkbench
4 AccessesrecorddataandservicesthroughCICSviaTransactionGateway
4 Resourceconstraints- won’tbeavailablefor2weeks
4 DevelopmentteamuseServiceVirtualizationtosimplify
§ PrototypetheservicewithRationalTestVirtualizationServer
CICSTransactionGateway
TestAutomation
VirtualService
New
28 |
Scenario2b:DependentProgramNotAvailable
4 Exposedfunctionalityinvokesprogramcross-LPARoverDPL
4 DevelopandunittestinisolationusingRationalDevelopmentandTestEnvironmentforSystemz
4 UseRationalTestWorkbench toautomatefunctional/regressiontests
4 BeforelinkedprogramavailableuseServiceVirtualizationtosandboxonmainframe
RationalDevelopment&Test(RD&T)
VirtualService
29 |
Adoption
30 |
Thejourney– continuousintegration
Successivepracticesbuildoneachother,witheachpracticeaddinggreaterandgreaterbusinessvalueandhavinggreaterscopeoverthesoftwaredevelopmentprocess.
• Instant feedback to developers on quality issues• Supports Agile development• Unit test automation & more• Pre-cursor to Continuous Delivery and DevOps
31 |
Multiple technologySome Open Source
Provide Virtual
Services
TESTER
Continuous deployment to
test environments
OPS
API TestingPerformance Testing
UI Automation
TESTER
Design & Build
DEVELOPER
Shippingcodefasterwithouttestingmeansthatbadcodecanbeshippedfaster.TestingisanintegralpartofDevOps.
Usingservicevirtualizationincreasestheabilitytotestearly,whiletestautomationprovidesrapidfeedbackonthequalityofthesoftwarebeingshipped.
WithoutContinuousTesting,thereisnoDevOps
32 |
Resources
ContinuousTestingondeveloperWorks athttps://developer.ibm.com/testing/ContinuousTesting:AnIBMpointofview:http://www.ibm.com/developerworks/library/d-continuous-testing-shift-left-trs/index.htmlDevOpsROI:https://developer.ibm.com/urbancode/docs/devops-managers-organization-leaders-making-roi-case-executives/TheForresterWaveModernApplicationFunctionalTestAutomationTools,Q42016:https://reprints.forrester.com/#/assets/2/581/'RES123866'/reportsGartnerMagicQuadrantforSoftwareTestAutomation:https://www.gartner.com/doc/reprints?id=1-3NWQQJB&ct=161214&st=sgGartnerMagicQuadrantforApplicationReleaseAutomation:https://www.gartner.com/doc/reprints?id=1-3FNG0BR&ct=160822&st=sg
33 |
ThankYou