Crowdsourcing for improving

Business Process

October, 2012 - Optimized for 1280x960 - © Amazon Web Services

amazon web services

2

Before we start ] [ 2

_ Presented by

John Hoskins, hoskins @ amazon.com

Mechanical Turk, Amazon

3 3

Detail

High Level

What is MTurk?

How does it

work Crowdsourcing

How is it used

Questions

Our plan for today ] [

Examples

4

What is Crowdsourcing? ] [

4

5

Crowd Labor Trends [ ]

5

6 6

1. Crowdsourcing

7

] [

7

Crowdsourcing: Key Advantages

8

1. Elastic Capacity ] [

8

9

On and Off Fast Growth

Variable peaks Predictable peaks

Staffing Usage Patterns

] [

9

10

On and Off Fast Growth

Predictable peaks

Missed Opportunity

WASTE

Staffing Usage Patterns ] [

10

Variable peaks

11

Fast Growth

Predictable peaks

On and Off

Usage Patterns: Crowdsourcing ] [

11

Variable peaks

12

2. On Demand Availability ] [

12

13

[ ]

13

3. Pay as you go, for what you use

14

Business Benefits of Crowdsourcing ] [

Improve productivity

Lower costs

$ Capital efficiency

$

14

Focus on your business

15 15

2. What is MTurk?

16

Marketplace for Work _ Access to global workforce, on demand

_ Quality controls and workflow “building blocks”

_ Pay as you go, only when satisfied with results

_ Programmatic Access (API)

] [

16

What is Mechanical Turk?

17

Global Workforce ] [

17 (as of Apr 19th, 2012)

_ 500,000 Workers

_ 190+ Countries

18 18

3. How it works

19

How it works [ ]

19

20

Mturk Workforce [ ]

MASTERS

Highest Performing

Average

Unknown

20

21

Custom Workforce [ ]

MASTERS

Highest Performing

Average

Unknown

21

Your Custom Workforce

22

[ ]

22

Balances & Levers

Accuracy

Price

Speed

23 23

4. How is it used?

24

Common Use Cases [ ]

24

Data Management _ Verification

_ Entry & Collection

_ De-dupe

_ Algorithm Training

Annotation _ Tagging

_ Classification

Content Management _ Moderation (Photos, Content)

_ Transcription

_ Localization/Translation

Analysis/Research _ Sentiment

_ Relevance

_ Online Research

25 25

[ ] Examples

How can we assess relevance of tweets in real-time?

How can we research and categorize merchants in our database?

How can we verify accuracy of low confidence OCR scans?

How do we build a dictionary to categorize ads on the internet?

26 26

[ ] Examples

Categorization

Web Research

Transcription

Categorization and DeDupe

27

http://www.mturk.com

27

John Hoskins, Mechanical Turk

hoskins@amazon.com

amazon web services