Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants

Participant attentiveness is a concern for many researchers using Amazon’s Mechanical Turk (MTurk). Although studies comparing the attentiveness of participants on MTurk versus traditional subject pool samples have provided mixed support for this concern, attention check questions and other methods...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Behavior research methods Ročník 48; číslo 1; s. 400 - 407
Hlavní autoři: Hauser, David J., Schwarz, Norbert
Médium: Journal Article
Jazyk:angličtina
Vydáno: New York Springer US 01.03.2016
Springer Nature B.V
Témata:
Attention
Behavioral Science and Psychology
Cognitive Psychology
College students
Comparative analysis
Data Collection - methods
Female
Humans
Instructions
Internet
Learning
Male
Manipulation
Psychology
Researcher subject relations
Social research
Social Sciences
Surveys and Questionnaires
Participant attentiveness
MTurk
Instructional manipulation checks
College students
ISSN:1554-3528, 1554-3528
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Participant attentiveness is a concern for many researchers using Amazon’s Mechanical Turk (MTurk). Although studies comparing the attentiveness of participants on MTurk versus traditional subject pool samples have provided mixed support for this concern, attention check questions and other methods of ensuring participant attention have become prolific in MTurk studies. Because MTurk is a population that learns , we hypothesized that MTurkers would be more attentive to instructions than are traditional subject pool samples. In three online studies, participants from MTurk and collegiate populations participated in a task that included a measure of attentiveness to instructions (an instructional manipulation check: IMC). In all studies, MTurkers were more attentive to the instructions than were college students, even on novel IMCs (Studies 2 and 3), and MTurkers showed larger effects in response to a minute text manipulation. These results have implications for the sustainable use of MTurk samples for social science research and for the conclusions drawn from research with MTurk and college subject pool samples.
Bibliografie:SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ObjectType-Article-2
content type line 23
ISSN:1554-3528
1554-3528
DOI:10.3758/s13428-015-0578-z