The influence of GenAI on the effectiveness of argumentative writing in higher education: evidence from a quasi-experimental study in China

The revolutionary development of generative artificial intelligence, especially large language model (LLM) chatbots like ChatGPT, has brought disruptive changes to society, especially in the field of higher education, particularly in the domain of writing. Prior studies have primarily examined the o...

Full description

Saved in:
Bibliographic Details
Published in:Journal of Asian public policy Vol. 18; no. 2; pp. 405 - 430
Main Authors: Li, Hanlin, Wang, Yu, Luo, Siqi, Huang, Cui
Format: Journal Article
Language:English
Published: Routledge 04.05.2025
Subjects:
argumentative writing
Chatbot
Generative AI
higher education
teaching/learning strategies
ISSN:1751-6234, 1751-6242
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The revolutionary development of generative artificial intelligence, especially large language model (LLM) chatbots like ChatGPT, has brought disruptive changes to society, especially in the field of higher education, particularly in the domain of writing. Prior studies have primarily examined the opportunities and challenges that LLM Chatbots bring to higher education writing from a theoretical perspective. However, empirical studies on how to effectively and responsibly integrate LLM Chatbots into writing learning and evaluate their effectiveness are still limited. To address this gap, the present study introduces a learning approach termed LLM-powered Chatbot-assisted argumentative writing (LCAW) to support the cultivation of university students' writing abilities. A total of 61 Chinese university students from two classes were invited to participate in a quasi-experimental study with different learning methods as intervention measures, and student perceptions were gathered through interviews. The results show that the proposed LCAW method significantly improves students' writing performance in terms of content quality and language expression, and positively impacts in providing personalized feedback and enhancing writing motivation. This study contributes by proposing an effective method for integrating generative AI into higher education writing instruction and by offering insights for curriculum design policies to enhance higher writing education through GenAI.
ISSN:1751-6234
1751-6242
DOI:10.1080/17516234.2024.2363128