The Average Laboratory Samples a Population of 7,300 Amazon Mechanical Turk Workers

Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 mont...

Full description

Saved in:
Bibliographic Details
Published in:Judgment and Decision Making Vol. 10; no. 5; pp. 479 - 491
Main Authors: Stewart, Neil, Ungemach, Christoph, Harris, Adam J. L., Bartels, Daniel M., Newell, Ben R., Paolacci, Gabriele, Chandler, Jesse
Format: Journal Article
Language:English
Published: Tallahassee Society for Judgment and Decision Making 01.09.2015
Cambridge University Press
Subjects:
Amazon Mechanical Turk
capture-recapture
Compensation and benefits
Computer services industry
Decision making
Estimates
Experiments
Grants
Human resource management
Laboratories
MTurk
Population
Population density
population size.NAKeywords
Workers
United States
capture-recapture
MTurk
Amazon Mechanical Turk
population size
ISSN:1930-2975, 1930-2975
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 months. Each laboratory has its own population pool which overlaps, often extensively, with the hundreds of other laboratories using MTurk. Our estimate is based on a sample of 114,460 completed sessions from 33,408 unique participants and 689 sessions across seven laboratories in the US, Europe, and Australia from January 2012 to March 2015.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1930-2975
1930-2975
DOI:10.1017/s1930297500005611