The effects of GenAI on learning performance: A meta-analysis study

Artificial Intelligence (AI) has become increasingly prevalent in education, and Generative AI (GenAI) has emerged as a new concept in AI technology. Educators continue to debate the advantages and disadvantages of GenAI in education. To guide these discussions, further analysis is needed to determi...

Full description

Saved in:
Bibliographic Details
Published in:Educational Technology ＆ Society Vol. 28; no. 3; pp. 263 - 280
Main Authors: Gokoglu, Seyfullah, Erdogdu, Fatih
Format: Journal Article
Language:English
Published: International Forum of Educational Technology ＆ Society 01.07.2025
International Forum of Educational Technology & Society, National Taiwan Normal University, Taiwan
International Forum of Educational Technology & Society
Subjects:
Analysis
Computational linguistics
Education
Educational evaluation
effect size
genai
Generative artificial intelligence in education: Theories, technologies, and applications
Language processing
learning performance
meta-analysis
Methods
Natural language interfaces
GenAI
Learning performance
Effect size
Meta-analysis
ISSN:1176-3647, 1436-4522, 1436-4522
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Artificial Intelligence (AI) has become increasingly prevalent in education, and Generative AI (GenAI) has emerged as a new concept in AI technology. Educators continue to debate the advantages and disadvantages of GenAI in education. To guide these discussions, further analysis is needed to determine the impact of GenAI on educational outcomes. This study aims to investigate the effect of GenAI on learning performance using the meta-analysis method. This meta-analysis study synthesized the results of 31 articles involving 2646 participants. The results show that GenAI has a moderately positive effect on learning performance (g = .689). There is no publication bias in determining the validity of the effect. The analysis included the effect sizes of seven moderator variables: sample level, sample size, research design, learning domain, research setting, intervention duration, GenAI tool, and testing format. Only intervention duration, GenAI tool, and testing format significantly moderated the effectiveness of GenAI on learning performance.
ISSN:1176-3647
1436-4522
1436-4522
DOI:10.30191/ETS.202507_28(3).TP04