Trends in Agile Testing by Lisa Crispin

1

Trends in Agile Testing

Code Chef Talks 2009

Lisa CrispinWith Material from Janet Gregory

Copyright 2009: Lisa Crispin

2

Introduction • Tester on agile teams since 2000• My teams:

• Delight customers• Deliver production-ready value every 2

weeks• Drive development with tests, examples• 100% regression test automation


3

Your Agile Experience

How about you? How many on agile teams? How many in transition? How many planning a transition? How many on more traditional teams?

Agile testing works on those, too. Managers, testers, developers...?


4

Takeaways

Transitions in testing How testing works on agile teams Agile testing tools and techniques What it means for us


5

Traditional vs. Agile SDLC

Phased or gated – ex. Waterfall

It 1 It 2 It 3

A B A B A BC C

D

Time

Agile: iterative and incremental- Each story is expanded, coded and tested- Possible release after each iteration

Requirements

Specifications

Code

Testing

Release

5Copyright 2009 Lisa Crispin and Janet Gregory


6

Testing as a Phase

Code, then test Separate, siloed teams Heavyweight process

Requirements, design documents Test plans “Traceability” Change review boards

Testing “bottleneck” at end


7

Automation - After Coding

Vendor tools Record/Playback Done by testers or automation team If developers automate unit tests – it’s after

coding Expensive


8

Exploratory Testing – “agile”

Simultaneous learning, test design, test execution [source: James Bach]

Aka “Context-Driven” Critical thinking, no requirements doc needed Diverse ideas Rich resources

Tools, data, people [source: Jon Hagar]


9

How Agile Changes Things

Whole Team Approach Coding and Testing are One Process Feedback, collaboration key TDD/ATDD practices Test-infected developers


Copyright 2007: Lisa Crispin and Janet Gregory

10

Test Approach - The Agile Way

Project Initiation

Get an understanding of the project

Participate in estimating stories

Create Test Plan

Release Planning

Each Iteration 1 …. X

Write and execute story testsWrite and execute new functional test

casesPair test with other testers,

developersAutomate new functional test casesRun automated regression test cases

Perform Load TestComplete Regression Test

Perform UATPerform Mock Deploy

Participate in Release Readiness

System Test / End Game

Participate in Release to ProdParticipate in Retrospectives

Release to Prod/ Support

Copyright 2009: Lisa Crispin Copyright 2007: Lisa Crispin and Janet Gregory

11

Team Organization - Traditional vs. Agile

Agile: works as one teamTester

ProgrammerDomain Expert

Traditional: independent functional groups

Dev

BAs Tester


12

The Whole Team Approach

Team commitment to quality Team responsible for testing Testers get support, training Anyone can do any task Testers transfer testing knowledge Get the right people Collaboration


13

Testing is Not a Phase

Development = testing + coding Write test, write code, test

Unit and Acceptance Test levels Automated tests

Free time for exploratory testing


14

Agile Testing Quadrants


15

Test Automation Pyramid


16

Feedback Guides Development Team uses feedback to improve Testers are expert feedback providers Feedback lets team make course

corrections


17

Feedback Examples Big Visible Charts Retrospectives CI process sends results in emails Short iterations facilitate improvement Discoveries during exploratory testing Collaboration with users, customers


18

Core Practices for Success Continuous integration

Frequent and fast feedback Coding and testing one process Test environments Manage technical debt Work incrementally Synergy


19

Where Is It Taking Us? Lines between roles blurred More focus on tests to drive coding Examples as requirements Find ways to control technical debt Tests pushed to lower levels

Less end-to-end automation


20

Current Trends in Testing/Development Pomodoro technique for teams

www.pomodorotechnique.com More exploratory testing

As automated regression tests free timecontext-driven-testing.com

Lean approaches Kanban, scrumban Poppendiecks’ books


21

More Current Trends Continuous Integration is a given Mix and match frameworks/drivers More low-tech early prototyping More early collaboration Behavior-Driven Development (BDD)


22

BDD/Narrative/Scenario Example

Given that the FitNesse wiki is a WikiGiven that the FitNesse User is a Web UserGiven that the FitNesse wiki was able to start for

the first timeWhen the FitNesse User attempts to go to the

Home PageThen the content of the Home Page for the

FitNesse User should be Welcome to the Wonderful World of FitNesse!

From: Antony Marcano, Andy Palmer, testingreflections.com, pairwith.us


23

Test Tools

Open source, agile frameworks/drivers Vendor tools getting lighter weight FitNesse/Slim/Fit ubiquitous

Framework for many other tools BDD tools

Cucumber, easyb, nbehave GUI test drivers

Watir, Selenium


Testing Tool Spectrum

Agile2009 - 24

© ASERT 2006-2009

Database Drivers

DbUnit DataSets SqlUnit

groovy.sql JPAJDO

BigTable JDBC

Database Drivers

DbUnit DataSets SqlUnit

groovy.sql JPAJDO

BigTable JDBC

SOAP / REST

Drivers

GroovyWS XML-RPC

CXFAxis2

JAX-WS JAX-RS

SOAP / REST

Drivers

GroovyWS XML-RPC

CXFAxis2

JAX-WS JAX-RS

Utilities

All Pairs CombinationsPolyglot languagesLogic programmingThreads, Parallel

concurrency librariesData-driven librariesNetworking libraries

XML ProcessingRead/write files,

Excel / Word / CSV,Reporting, Logging

Utilities

All Pairs CombinationsPolyglot languagesLogic programmingThreads, Parallel

concurrency librariesData-driven librariesNetworking libraries

XML ProcessingRead/write files,

Excel / Word / CSV,Reporting, Logging

Other Drivers

FESTEmailFTP

AntUnitTelnetSSHExec

Other Drivers

FESTEmailFTP

AntUnitTelnetSSHExec

ToolsiTest2, SoapUI, Twist,

IDEs, JMeter, Text editors, Recorders,

Build Tools, CI

ToolsiTest2, SoapUI, Twist,

IDEs, JMeter, Text editors, Recorders,

Build Tools, CI

WebDrivers

WebTest WebDriver JWebUnit Tellurium Selenium HtmlUnit

Watij HttpBuilder Cyberneko

WebDrivers

WebTest WebDriver JWebUnit Tellurium Selenium HtmlUnit

Watij HttpBuilder Cyberneko

Runners

Native Groovy, JUnit, TestNG, Spock, EasyB,JBehave, Cucumber, Robot Framework, Slim

Runners

Native Groovy, JUnit, TestNG, Spock, EasyB,JBehave, Cucumber, Robot Framework, Slim


25

Testing Techniques

Team writes acceptance tests together Programmers and testers pair to automate

tests ROI guides automation Testers do exploratory testing Customers participate

Pair with customers for ET Frequent demos


26

Trends in Test Automation

Record/Playback as “trainer”, debugger Test architecture/design critical Planning and tracking tools – online and low-

tech Open source, agile tools explosion

Plenty of good browser test drivers Other problems now being solved

Scenario, Narrative style


27

What Does It Mean for Us?

More integration with development teams More collaboration with customers Helping programmers with testing We probably need to be more technical More creative thinking, problem-solving


28

Do Your Best Work

Whole Team approach Collaborate with customers, developers

Business examples, turned into tests Agile Testing Quadrants Test Automation Pyramid Exploratory testing


29

The Future is What You Make It

Get out of your chair – go talk to programmers and customers

Learn a new test framework or scripting language today - build your skills

Lots of free resources, just takes time Bring testing problems to the whole team

Benefit from multiple skill sets How can your expertise help the team?


30

Questions?


31

Some Agile Testing Resourceslisacrispin.comjanetgregory.caexampler.comagile-testing@yahoogroups.comtestobsessed.comAntonymarcano.com

Copyright 2009: Lisa Crispin Copyright 2008 Janet Gregory, DragonFire

32

Bridging the Communication Gap

Specification By Example and Acceptance Testing

Gojko Adzic

Copyright 2009: Lisa Crispin 33

Now Available

Agile Testing: A Practical Guide for Testers and Agile Teams

By Lisa Crispin and Janet Gregory

www.agiletester.ca

Date post:	12-May-2015
Category:	Technology
Upload:	directi-group
View:	7,342 times
Download:	0 times

Trends in Agile Testing by Lisa Crispin

Technology