Black and white: Software testing for scientists...

transcript

Commercial in Confidence | Assurity Consulting Limited 2013

Black and white: Software testing for scientists

Let’s Test Oz 2014

Katrina Clokie @katrina_tester

Introduction Visualising

Strategy

Visual

Modelling

Session Based

Management

Context

• Test consultant embedded in a scrum team for three days a week

• Create cross-skilled resources by training the existing team of

developers, business analysts and subject matter experts in testing

• Specialist financial domain

• Team was University educated

> Economics & Finance

> Mathematics

> Computer Science

100% Automation

Testing 101 Workshop

Strategy

Visual

Modelling

Session Based

Management

Testing 101 Workshop

IDEA PRODUCTION

In our test strategy and we’re doing it

In our test strategy and we’re not doing it

Not in our test strategy, but should be

Disaster

Recovery Unit

Testing

Exploratory

Testing

Component

Testing

Integration

Testing

System

Testing

Automated

Testing

Regression

Testing

Specification

Workshops

Interaction

SpecFlow

Testing

Manual

Testing

Mind Maps

Package

Testing

End-to-End

Testing

Acceptance

Testing

Manual

Testing

Security

Testing

Availability

Operations

Performance

Testing

Usability

Release

Testing

Parallel

Testing

Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro

Starting Together

Strategy

Visual

Modelling

Session Based

Management

Think Talk Act

What do you think this does?

Does everyone agree that’s all?

How are you going to test this?

Are you happy that this testing will mean the story is done?

Test Ideas

• That the acceptance criteria are met

• That each function does what it is supposed to do (positive testing)

• The problems that each function could have (negative testing)

• Input data for typical, boundary and invalid cases

• Output data for typical, boundary and invalid cases

• A flow through the system, with functions in different orders

Reference: Bach, James (2013). Heuristic Test Strategy Model

What should we automate?

• What matters most?

• Are there any problems with high impact?

• Are there any problems with high probability?

Reference: Marick, Brian (1998). When should a test be automated?

The greatest enemy of knowledge is not ignorance, but the illusion of knowledge

Stephen Hawking

Strategy

Visual

Modelling

Session Based

Management

Manual Testing Tasks

Session Based Test Management

Peer Review

What happened?

• Multiple manual testing tasks for a story

• Focused investigation with consistent reporting

• Review improved testing by creating competition

• Increased SME confidence in testing by the team

• Reduced duplication

Conclusion

Disaster

Recovery Unit

Testing

Exploratory

Testing

Component

Testing

Integration

Testing

System

Testing

Automated

Testing

Regression

Testing

Specification

Workshops

Interaction

SpecFlow

Testing

Manual

Testing

Mind Maps

Package

Testing

End-to-End

Testing

Acceptance

Testing

Manual

Testing

Security

Testing

Availability

Operations

Performance

Testing

Usability

Release

Testing

Parallel

Testing

Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro

Session Based Test Management

Let’s Test Oz 2014

Black and white: Software testing for scientists...

Documents