One  Day  of  QualitySpeaker  Sargis  Sargsyan

Main  Topics

4Regression  Test    Cycle 5 Defect    

Management 6Customer  Reported    Defect

7 Internally    Reported  Defects 8Defects  Reported    

During  Itera>on 9Q  &  A

1Quality  Assurance  Life  Cycle 2 Story  Readiness 3Sprint

2

Where  is  the  QA?Quality  Assurance  is  a  part  of  the  Technical  Group

Product Group

Product Management

User Experience

Development Quality Assurance

Product Group

Product Management

Technical Groups

4Quality  Assurance  Life  CycleQuality  Assurance  ac>vi>es  in  the  SDLC

Sprint Regression  Test  CycleReadiness

READINESS

Product Management User Experience Development Quality Assurance

5Readiness

Requirements / UX Assets Ambiguity Review

Test Map / Auto Tech ApproachTech Approach

Test Map Review / Approval

Sprint

Product Management Development Quality Assurance Automation

Quality Assurance Manual

6Sprint

Functional Testing

Manual Test Execution

Requirements Validated

Implementation

Test Map

Automated Test Suite

Test Map Review

Manual Test Complete / Passed

Automation Complete / PassedCode Complete

Regression Test Cycle

Quality Assurance Automation

Quality Assurance Manual

7Regression  Test  Cycle

Test Map [Refactor] Review

Archived Test Suite

Release Test Suite

Test Suite

Automated Test Suite

Include in CI

Regression Dashboard

Regression Test Results

Manual Test Execution

Time Box

8Test  Suite

Refactoring

Root Cause Analysis

Story Implementation

Test Suite

9Test  Case  Review  By  Automa>on  QA

One  Time  Verifica>on

To  Automated

Manual

10Test  PyramidTradi>onal  Agile  Test  Pyramid

UI  Tests

Integra>on  Tests

JUnit  Test

11Defect  Management

Customer  Reported

Reported  During  Sprint

Customer  reported  defects  is  a  cri>cal  need  to  ensure  granular  visibility  and  traceability,  in  case  of  internally  reported  defects  these  controls  are  more  relaxed.

Customer  Reported  DefectThe  workflow  of  internally  reported  defects  has  many  

differences  from  that  of  customer  reported  defects,  whereas  the  

former  is  significantly  simplified.  

Internally  Reported  Defect

Teams  are  generally  encouraged  to  adopt  any  workflow  that  would  

be\er  fit  the  team's  goals  and  work  pa\erns.

Reported  During  Sprint

Internally  Reported

12Defects  Reported  During  Sprint

Sprint

8

⚒In  Development

Awai>ng  QA  Verifica>on

Closed

w

13Internally  Reported  Defects

Complete  /  Deployed

Awai>ng  QA  Verifica>on

Defects  are  logged  in    Technical  Backlog  project

Star>ng  status  for  these    Defects  is  In  Development

w

z

8

Customer Reported Defects

14Customer  Reported  Defects

Submitted to Development In Development Awaiting MergeAwaiting

Development

Awaiting Deployment

Awaiting QA Verification

Deployed!

Feature Team Incomplete information to reproduce

Manual QA Reproduce the issue, provide

Issue fails customer verification

DuplicateSupport

Won’t FixProduct Mgmt

Awaiting FeedbackSupport / PM

Customer Support

Technical Group

Production Release

15What  we  get  from  this  Process

Number  of  Customer    issues  was  decreased  from    2012-­‐2014 35%

Number  of  CriGcal    issues  was  decreased 700%

Story  Readiness  Gme    was  decreased   46%

Regression  cycle  reduced    from  2  weeks  to  4  days 60%

Test  suite  is  automated 94%

CI  running  Gme    reduced  by 17%

Thank  you  for  your  a\en>on!

Sargis  Sargsyan  |  Automa>on  QA  Engineer  |  sargis.sargsyan@workfront.com  |            @mrsargsyan  !