View in EDS

New Tools, New Rules: A Practical Guide to Effective and Responsible Generative AI Use for Surveys and Experiments in Research.

Saved in:
Bibliographic Details
Title: New Tools, New Rules: A Practical Guide to Effective and Responsible Generative AI Use for Surveys and Experiments in Research.
Authors: Blanchard, Simon J., Duani, Nofar, Garvey, Aaron M., Netzer, Oded, Oh, Travis Tae
Source: Journal of Marketing; Nov2025, Vol. 89 Issue 6, p119-139, 21p
Subject Terms: GENERATIVE artificial intelligence, SURVEYS, EXPERIMENTS, RESEARCH methodology, SOFTWARE architecture, BEST practices, ARTIFICIAL intelligence & ethics, LANGUAGE models
Abstract: Generative artificial intelligence (GenAI) tools based on large language models are quickly reshaping how researchers conduct surveys and experiments. From reviewing the literature and designing instruments to administering studies, coding data, and interpreting results, these tools offer substantial opportunities to improve research productivity and advance methodology. Yet with this potential comes a critical challenge: Researchers often use these systems without fully understanding how they work. This article aims to provide a practical guide for effective and responsible GenAI use in primary research. The authors begin by explaining how GenAI systems operate, highlighting the gap between their intuitive interfaces and the underlying model architectures. They then examine different use cases throughout the research process, noting both the opportunities and associated risks at each stage. Throughout this review, the authors provide flexible tips for best practice and rules for effective and responsible GenAI use, particularly in areas pertaining to ensuring the validity of GenAI-coding of unstructured data (i.e., open-ended responses). The hope is that these guidelines will help researchers integrate GenAI into their workflows in a transparent, rigorous, and ethically sound manner. An accompanying website (https://questionableresearch.ai) provides supporting materials, including reproducible coding templates in R and SPSS and sample preregistrations. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Marketing is the property of American Marketing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Complementary Index
Description
Abstract:Generative artificial intelligence (GenAI) tools based on large language models are quickly reshaping how researchers conduct surveys and experiments. From reviewing the literature and designing instruments to administering studies, coding data, and interpreting results, these tools offer substantial opportunities to improve research productivity and advance methodology. Yet with this potential comes a critical challenge: Researchers often use these systems without fully understanding how they work. This article aims to provide a practical guide for effective and responsible GenAI use in primary research. The authors begin by explaining how GenAI systems operate, highlighting the gap between their intuitive interfaces and the underlying model architectures. They then examine different use cases throughout the research process, noting both the opportunities and associated risks at each stage. Throughout this review, the authors provide flexible tips for best practice and rules for effective and responsible GenAI use, particularly in areas pertaining to ensuring the validity of GenAI-coding of unstructured data (i.e., open-ended responses). The hope is that these guidelines will help researchers integrate GenAI into their workflows in a transparent, rigorous, and ethically sound manner. An accompanying website (https://questionableresearch.ai) provides supporting materials, including reproducible coding templates in R and SPSS and sample preregistrations. [ABSTRACT FROM AUTHOR]
ISSN:00222429
DOI:10.1177/00222429251349882