of 13
8/14/2019 Testing Visibly
1/13
8/14/2019 Testing Visibly
2/13
Topics/OutlineTheInterrogatives
WhatisTestingVisibly?
Whyisitimportant?
WhenshouldthetechniquesforTestingVisiblybeemployed?
WhoisresponsibleforensuringthatweTestVisibly?
Where(organizationally)shouldthistechniquebeappliedand
wherearetherelationshipswithotherSoftware/Systems
EngineeringTeams? Howdoesitwork?Howdoyoudoit?
Wheredowegofromhere?
8/14/2019 Testing Visibly
3/13
What is Testing Visibly?
Determinethesuccesscriteria,metrics,andresult
datatobeprovidedbytestingatthestartofthe
process,delivertheseresultsconstantlyandreview
frequently
8/14/2019 Testing Visibly
4/13
What is Testing Visibly?MakeanearlyappearanceintheSoftwareDevelopmentLifeCycle(SDLC)
TestEarlyandOften
Reduceoverallcostofdefects
ShareTestingOperationsProcessandPolicywiththeOrganization
Empowersotherstounderstandhowweworkandtosetexpectations
Providesabaselineforchangeearlyon;ifneeded
Keepinganopendoorpolicy Donotremaincloakedinsecrecy
Inviteotherteamstostatusandreportingmeetingswhileintest
8/14/2019 Testing Visibly
5/13
Why is it important to test visibly?Testingisthemicroscopeinto
viewinganorganizationsabilityto
buildqualitysoftware.
Ittellsusmorethanwhetherornot
softwaresatisfiesaspecified
requirement,itisthecatalystfor
illustratinghoweffectivethe
organizationworks.
ValueAddedContribution
TestEarlyandOften
Reduceoverallcostofdefects
CommoditizationofITandtherelevanceto
BusinessGoals
Remainingrelevantandavaluedcontributorre
enforcesrequirementfortest
VisibilitymakesthecomponentsoftheTriangleof
Qualityunambiguousandeasytounderstandthe
impactofeachcomponent
8/14/2019 Testing Visibly
6/13
When should the techniques of Testing Visibly be employed?
EarlyandoftenSoundfamiliar?
Plantodeliverresults
Asearlyaspossibleandfrequently;keep
youraudienceengagedandinformed
Knowwhentoreportandtowhom
Seekouttheirparticipation
Oftentimesotherteamshavemoved
ontothenextrelease
8/14/2019 Testing Visibly
7/13
Who is responsible for Testing Visibly?
Everyone
Alllayersofthetestingorganizationhavesomecontributiontotesting
visibly.
TestLeadership
Defineanddrivethevision
Takeownershipofthestateoftherelationships
TestEngineers
Collectdataforreportingpurposes
Communicateandcollaboratewithcounterparts
Allowingaprojectteaminsightintotestingoperationsdoesnotdiscountthe
credibilityofthetest,nordoesitdisintegratethenatureofbeingunbiased.
8/14/2019 Testing Visibly
8/13
Relationships and Touch Points
Environment
Arch
DEV TM 1
TM 2PM
TM 4
TM 3
!"#$%&'()*"+,-".,/+'Quality
ManagerOffshore
Core Teams
Functional Unit 1
Test Lead
Test Analysts
Testers
Functional Unit 2
Test Lead
Test Analysts
Testers
Functional Unit N
Test Lead
Test Analysts
Testers
Engineering
UAT Team
Sponsors
Test Managers
!!0&.),12'!!(3%,*".,/+'./'!456'!!7&8&1.'7"."'!!921"%".,/+'
8/14/2019 Testing Visibly
9/13
How does it work?
WeneedtosharewiththeOrganizationhowweworkandhowweexpecttowork
withothers.
ThisismosteffectivelyconveyedviaaUserManual
TheUsersManualisaguideforteamstouseinitsinteractionwiththetestingteam.Itdescribesthefollowing:
Theenvironmentandsystemsportfoliothatthetestingteamwillsupport
Theorganizationofthetestingteam
Howtorequestandreceiveservicesfromthetestingteam
Supportingdefiningdocumentsthatprescribehowthetestingteamwillwork
8/14/2019 Testing Visibly
10/13
The User Manual
RequestProcess
RequestPrioritization
Howtocheckrequeststatus
Howtoescalaterequests
Theunderlyingprinciplessupportingtestingservicesinclude:
Aconsistent,repeatable,flexible,andenterpriseorientedframework
Insertingtestingintoallphasesofthesoftwaredevelopmentlifecycle
Establishingqualityaspartofthetaskfromitsinception
Identificationofrisksearly,andappliestaskandqualityresourcesasneededtomitigate
thoserisks
Aggressiveuseofmetrics,trendanalysis,andlessonslearnedtoevaluateperformance
QualityAssurance
RiskManagement
IssueManagement
StaffRotation/Replacement
ChangeControl
AcceptanceManagement
StatusMeasuringandReporting
PerformanceMeasurementandReporting
8/14/2019 Testing Visibly
11/13
Orchestrating
the Defining
Documents
TheUserManualisestablishedasahubormapintotheotherdefiningdocumentsthatdrive
howthetestingteamsoperate.
!"#"$%&
'()(*"+")%&
,-()&
./"0&
'()1(-&
'"%02$/&
'()(*"+")%&
,-()&
3"/%&4%0(%"*5&
6"-"(/"&
'()(*"+")%&
,-()&
78()*"&
'()(*"+")%&
62/9&
'()(*"+")%&
,-()&
:);20
8/14/2019 Testing Visibly
12/13
Where we go from hereWemustmaintainrelevanceintheSDLCdespite
organizationalandbudgetcutbacks
AlignwiththeBusiness
EnterpriseWideTestingStrategy
ASISmodeling FutureStateDefinition Roadmap
.
RoadmapisacodifiedartifactthatillustrateshowTestingwillcontinuetogrowandremain
relevanttotheBusinessgoals.
Aroadmapisbuiltonprinciples;TestingVisiblyisoneofthem
8/14/2019 Testing Visibly
13/13
Thank You
DavidKapfhammer
GlobalDirector