Ewald Roodenrijs

Worldwide Testing: Join the Crowd

Program

— What is crowdtesting?— What are the benefits of crowdtesting?— What can crowdtesting do?— Options for service providers— How to implement for crowdtesting?

Remarkable things

Technology changed the world— Borders have disappeared— Everyone is connected to one other— Interaction takes place in different ways

The world has changed with internet, but software testing hasn’t changed that much...

Now problems with the testing of— Multiple devices— Third party updates— Getting specialists— Languages

Crowdsourcing + testing = Crowdtesting

What is crowdtesting?

— Use of crowdsourcing on testing— New phenomenon— Substitute to traditional testing— Focus on acceptance

The use of an (un)known crowd of people and knowledge when testing software applications or systems

‘’

Key benefits

Build a crowd

Knowledge/Performance— Specialty (security, usability, ...)— Beginner vs. Expert— Novice vs. User

Background

Language

Independent blood

Mirror real world

The crowd can help us

— Crowdtesting can complement in-house resources at a practical, tactical level

— Crowdtesting enables to tap into the creativity and diversity of a global community of skilled professionals

Reasons for crowdtesting

Applications

Lots of feedback

No sensitive data or functionality

Multi-platform software

Large end-to-end systems

Games

Beta software

Load & performance testing

Mobile software

Control the crowd

Costs control

No long term contracts— Add or reduce resources when needed— No initial investment

What makes test service providers special

— Companies have their own test methodologies— Companies know their clients and the requirements they have for

testing— Companies have test experts that know everything about the right

test strategy and test coverage— Companies have years of experience

Opportunities service provider

Shopping list

A crowd

Crowd build-up— Experts— Novice— Specialists— (Potential) users

Portion software

Questionairre

Testing environment

Examples

Conclusion