Shift left-devoxx-pl

transcript

#DevoxxPL#DevoxxPL @wakaleo

SHIFT-LEFTThe role of the tester in a DevOps World

@wakaleo

www.johnfergusonsmart.com

Change is not constant

Change is accelerating

Don’t work in silos

Modern test teams…

Prevent more bugs than they find

Engage early

Master automation

Play with production

How can testers stay at the top of their game?

440x faster lead time

5x lower change failure rate

DevOps is…

96x faster mean time to recover

But deploying a broken product faster does not make it any less broken

But deploying a useless product faster does not make it any more useful

ReliableRelevant

Quick to deploy, quick to test

Verified by automated testing at multiple levels

Driven by a deep understanding of business needs

DevOps is…

Shift-LeftRequirements

Discovery Stretch rightProduction Monitoring and testing

Lift upBetter, faster automation

Exploratory testing

Traditional testing

Exploratory testing

Traditional testing

The $600,000 Tester

Left-Shifting

Embracing uncertainty earlier rather than later

Business

Developers

As a corporate frequent flyer I want to earn points on my business flights So that I can get discounts on my holiday flights

Scenario: First class earns double points Given I fly from London to Paris When I am in First Class Then I should earn twice as many points …

Testers

TEST SCRIPT… … …

Business

Developers

Scenario: First class earns double points Given I fly from London to Paris When I am in First Class Then I should earn twice as many points …

Testers

TEST SCRIPT… … …

rework

misinterpretation

missed opportunities

source: - 44% - “Out of Control - Why Control Systems Go Wrong and How to Prevent Failure” - 56% - “An Information Systems Manifesto” - 80% - “Requirements: A quick and inexpensive way to improve testing”

44-80%of all defects are caused by unclear, ambiguous or incorrect requirements

Business

Developers

Testers

Examples

Acceptance Criteria

SHARED UNDERSTANDING

Executable Specifications

Scenario: First class earns double points Given I fly from London to Paris When I am in First Class Then I should earn twice as many points

Development and exploratory testing

The Advocate

The Sceptic

The Cross-Examiner

Advocate

Sceptic Cross-Examiner

What should it do?

How can it work?What can go wrong? How can we prove it works?

Exploratory testing

Traditional testing

If you don’t master automation

You become a slave to automation

Are wary of vendor hype

Successful DevOps teams

Treat their test automation code like their production code

Make their application testable

Use layers of abstraction well

Obsess over feedback

Good DevOps tests are FAST

FastActionable

FastActionableScalable

FastActionable

TrustworthyScalable

Exploratory testing

Traditional testing

FAKE NEWS!

Practice Continuous Testing

Unleash the Monkeys of Chaos

"The best defence against major unexpected failures is to fail often. By frequently causing failures, we force our services to be built in a

way that is more resilient”

- Netflix engineer Cory Bennett and executive Ariel Tseitlin

Exploratory testing

Traditional testing

SCARLETCRIMSON

REDRED

Test automation should serve the team

Not the other way round.

The six stages of QA DevOps Maturity

Name Focus Benefits

Siloed

Name Focus Benefits

Colocated Breaking down the silos Reduce delivery bottlenecks

Siloed

Name Focus Benefits

Engaged Improving collaboration Prevent bugs and deliver the right product

Siloed

Name Focus Benefits

Mechanised Effective automation Deliver the right product faster

Siloed

Name Focus Benefits

Pioneering Leverage Delight the customer

Siloed

Name Focus Benefits

Projecting Experimentation Deliver value faster, and learning from it

Pioneering Leverage Delight the customer

Siloed

Would you like to know more?

Subscribe to the newsletter

https://www.johnfergusonsmart.com

Read the book!

QUESTIONS?

www.johnfergusonsmart.com

@wakaleo

Shift left-devoxx-pl

Internet