ChatGPT’s impact on ESP writing proficiency and learner autonomy: An experimental study

This study investigates ChatGPT's efficacy in fostering autonomous ESP writing development across different proficiency levels, while identifying its strengths and limitations in enhancing specific writing competencies. A quasi-experimental pretest-posttest design was employed with 176 Saudi un...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Technology in Language Teaching & Learning Ročník 7; číslo 3; s. 102964
Hlavní autoři: Mohamed, Amr M., Ali El Deen, Abdul Aziz Mohamed Mohamed, Abukhait, Reema O., Dahleb, Fatma, Khan, Yasmine B., Jmaiel, Hassen A.
Médium: Journal Article
Jazyk:angličtina
Vydáno: Castledown Publishers 02.11.2025
Témata:
ISSN:2652-1687, 2652-1687
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract This study investigates ChatGPT's efficacy in fostering autonomous ESP writing development across different proficiency levels, while identifying its strengths and limitations in enhancing specific writing competencies. A quasi-experimental pretest-posttest design was employed with 176 Saudi university students (A1-B1 proficiency) over 8 weeks. Standardized email-writing assessments measured progress in Content, Format/Structure, Grammar/Punctuation, and Clarity/Cohesion, with ANOVA and effect size analyses determining significant changes. Results showed significant improvements (p<.001) in rule-based skills: Content (A1: d=2.68; A2: d=1.56; B1: d=2.06) and Format/Structure (A1: d=2.59; A2: d=1.10; B1: d=1.18). Grammar improved for A1 (d=0.74) and A2 (d=0.58) but not B1 (p=.210). Clarity/Cohesion showed no significant gains (p>.05). The model explained 57-74% of variance (R²), with strongest effects for A1 learners. This study provides the first empirical evidence of ChatGPT's proficiency-dependent effectiveness in ESP writing, establishing (1) clear thresholds for AI's optimal utility across skill levels, (2) critical limitations in developing higher-order writing skills, and (3) a foundation for blended AI-human writing pedagogy in ESP contexts.
AbstractList This study investigates ChatGPT's efficacy in fostering autonomous ESP writing development across different proficiency levels, while identifying its strengths and limitations in enhancing specific writing competencies. A quasi-experimental pretest-posttest design was employed with 176 Saudi university students (A1-B1 proficiency) over 8 weeks. Standardized email-writing assessments measured progress in Content, Format/Structure, Grammar/Punctuation, and Clarity/Cohesion, with ANOVA and effect size analyses determining significant changes. Results showed significant improvements (p<.001) in rule-based skills: Content (A1: d=2.68; A2: d=1.56; B1: d=2.06) and Format/Structure (A1: d=2.59; A2: d=1.10; B1: d=1.18). Grammar improved for A1 (d=0.74) and A2 (d=0.58) but not B1 (p=.210). Clarity/Cohesion showed no significant gains (p>.05). The model explained 57-74% of variance (R²), with strongest effects for A1 learners. This study provides the first empirical evidence of ChatGPT's proficiency-dependent effectiveness in ESP writing, establishing (1) clear thresholds for AI's optimal utility across skill levels, (2) critical limitations in developing higher-order writing skills, and (3) a foundation for blended AI-human writing pedagogy in ESP contexts.
Author Jmaiel, Hassen A.
Dahleb, Fatma
Ali El Deen, Abdul Aziz Mohamed Mohamed
Mohamed, Amr M.
Khan, Yasmine B.
Abukhait, Reema O.
Author_xml – sequence: 1
  givenname: Amr M.
  orcidid: 0000-0003-3891-963X
  surname: Mohamed
  fullname: Mohamed, Amr M.
– sequence: 2
  givenname: Abdul Aziz Mohamed Mohamed
  surname: Ali El Deen
  fullname: Ali El Deen, Abdul Aziz Mohamed Mohamed
– sequence: 3
  givenname: Reema O.
  surname: Abukhait
  fullname: Abukhait, Reema O.
– sequence: 4
  givenname: Fatma
  surname: Dahleb
  fullname: Dahleb, Fatma
– sequence: 5
  givenname: Yasmine B.
  surname: Khan
  fullname: Khan, Yasmine B.
– sequence: 6
  givenname: Hassen A.
  surname: Jmaiel
  fullname: Jmaiel, Hassen A.
BookMark eNpNkMtOAjEUhhuDiYg8gLu-ANjrTOuOEEQSEk3Ehavm0OngkKElnaLOztfw9XwSuRjj5pyTs_jy_98l6vjgHULXlAyZpoLcpDrVw7fc8yElTGfiDHVZJtmAZirv_LsvUL9p1oQQzinPGe-il_ErpOnj4vvzq8HVZgs24eDx5OkRv8cqVX6FtzGUla2cty0GX-DaQfQuYtil4MOmvcUjj93H1sVq43yCGjdpV7RX6LyEunH9391Dz3eTxfh-MH-Yzsaj-cBSScVACCZKVkgFuQBHNejMZtRqKaWWZMmXYKlTpNwXy4QUhV5SVWQkL-l-cqC8h2YnbhFgbbb7EBBbE6Ayx0eIKwMxVbZ2RimtrLOSW84EyFwpyRjLCidymVOl9yx6YtkYmia68o9HiTmqNgfV5qDanFTzH_p8dG8
ContentType Journal Article
DBID AAYXX
CITATION
DOA
DOI 10.29140/tltl.v7n3.102964
DatabaseName CrossRef
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
DatabaseTitleList CrossRef

Database_xml – sequence: 1
  dbid: DOA
  name: Directory of Open Access Journals (DOAJ)
  url: https://www.doaj.org/
  sourceTypes: Open Website
DeliveryMethod fulltext_linktorsrc
EISSN 2652-1687
ExternalDocumentID oai_doaj_org_article_8898cec53c324a578852226de4757189
10_29140_tltl_v7n3_102964
GroupedDBID AAHSB
AAYXX
ALMA_UNASSIGNED_HOLDINGS
CITATION
GROUPED_DOAJ
ID FETCH-LOGICAL-c1514-4424f2d58a74ae19a96c61c9555950b3bac1e80f1026454d9b18d607f1d603a13
IEDL.DBID DOA
ISSN 2652-1687
IngestDate Mon Nov 03 22:08:28 EST 2025
Wed Nov 05 20:56:26 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 3
Language English
License https://creativecommons.org/licenses/by-nc/4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c1514-4424f2d58a74ae19a96c61c9555950b3bac1e80f1026454d9b18d607f1d603a13
ORCID 0000-0003-3891-963X
OpenAccessLink https://doaj.org/article/8898cec53c324a578852226de4757189
ParticipantIDs doaj_primary_oai_doaj_org_article_8898cec53c324a578852226de4757189
crossref_primary_10_29140_tltl_v7n3_102964
PublicationCentury 2000
PublicationDate 2025-11-02
PublicationDateYYYYMMDD 2025-11-02
PublicationDate_xml – month: 11
  year: 2025
  text: 2025-11-02
  day: 02
PublicationDecade 2020
PublicationTitle Technology in Language Teaching & Learning
PublicationYear 2025
Publisher Castledown Publishers
Publisher_xml – name: Castledown Publishers
SSID ssj0003313723
Score 2.3080494
Snippet This study investigates ChatGPT's efficacy in fostering autonomous ESP writing development across different proficiency levels, while identifying its strengths...
SourceID doaj
crossref
SourceType Open Website
Index Database
StartPage 102964
SubjectTerms AI in education
Autonomous Language Learning
ChatGPT
Educational technology
ESP
Title ChatGPT’s impact on ESP writing proficiency and learner autonomy: An experimental study
URI https://doaj.org/article/8898cec53c324a578852226de4757189
Volume 7
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: Directory of Open Access Journals (DOAJ)
  customDbUrl:
  eissn: 2652-1687
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0003313723
  issn: 2652-1687
  databaseCode: DOA
  dateStart: 20190101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1NS8MwGA4yPHgRRcX5RQ6ehLrmq0m8zbHpQcbACfNU8lUVRpWtm3jzb_j3_CUm6ZR68uKlh1JK-rzJ-5H0fR4ATrEqYhhKtM9XE8q5TXQRNnGUVdgRJaiKqiU3fDgUk4kcNaS-wj9hNT1wDVxHCCmMM4wYH_qVn1_CZww4s45y5v1qbN1LuWwUU8EHE4IIx6Q-xsTSVxGdalpNz5e8JIGtQGb0VyBq8PXHwDLYApurjBB265FsgzVX7oD73qOqrkbjz_ePOaw7GeFzCfu3I_gaaIjKBxjVtuPKfIOqtDDqP7gZVIsqNipcwG4JmwT-MFLJ7oK7QX_cu05WKgiJ8dGYJpRiWmDLhOJUOSSVzEyGjGS-FmCpJloZ5ERa-K8K7FxWaiRslvIC-StRiOyBVvlcun0Akc8OjUBcM-68g9TCWoVQpllKLVNIt8HZNyT5S012kfsiIeKXB_zygF9e49cGlwG0nwcDT3W84a2Xr6yX_2W9g_94ySHYwEGVN2z24iPQqmYLdwzWzbJ6ms9O4sT4AnNlu90
linkProvider Directory of Open Access Journals
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=ChatGPT%E2%80%99s+impact+on+ESP+writing+proficiency+and+learner+autonomy%3A+An+experimental+study&rft.jtitle=Technology+in+Language+Teaching+%26+Learning&rft.au=Amr+M.+Mohamed&rft.au=Abdul+Aziz+Mohamed+Mohamed+Ali+El+Deen&rft.au=Reema+O.+Abukhait&rft.au=Fatma+Dahleb&rft.date=2025-11-02&rft.pub=Castledown+Publishers&rft.eissn=2652-1687&rft.volume=7&rft.issue=3&rft_id=info:doi/10.29140%2Ftltl.v7n3.102964&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_8898cec53c324a578852226de4757189
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2652-1687&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2652-1687&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2652-1687&client=summon