Automatic Grammar Error Correction Model Based on Encoder-decoder Structure for English Texts

The role of information transmission in social life is irreplaceable, and language is a very important information carrier. Among all kinds of languages, English always occupies an important position. In the process of English learning, grammar error has become a difficult problem for most learners....

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:EAI endorsed transactions on scalable information systems Jg. 10; H. 1; S. e4
Hauptverfasser: Wang, Jiahao, Huang, Guimin, Wang, Yabing
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Ghent European Alliance for Innovation (EAI) 12.09.2022
Schlagworte:
Encoders-Decoders
English language
Error correction
Error correction & detection
Grammar
Information retrieval
Search algorithms
Sentences
ISSN:2032-9407, 2032-9407
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract The role of information transmission in social life is irreplaceable, and language is a very important information carrier. Among all kinds of languages, English always occupies an important position. In the process of English learning, grammar error has become a difficult problem for most learners. In this paper, we propose an automatic grammar error correction model based on encoder-decoder structure. Different from traditional encoders, we design a dual-encoder structure to capture the information of source sentence and context sentence separately. The decoder is designed with a gated structure, it can effectively integrate output information of encoders. At the same time, the self-attention mechanism is combined to better solve the problem of long-distance information extraction. In addition, we propose a dynamic beam search algorithm to improve the accuracy of the word prediction process, and achieve dynamic extraction of the decoder output by combining kernel sampling techniques. We add a penalty factor to reduce the probability of generating repeated words, while suppressing the model's preference for generating shorter sentences. Finally, the proposed method is validated on the official English grammar error correction dataset. Experiments show that the dual encoder model in this paper has a good performance.
AbstractList The role of information transmission in social life is irreplaceable, and language is a very important information carrier. Among all kinds of languages, English always occupies an important position. In the process of English learning, grammar error has become a difficult problem for most learners. In this paper, we propose an automatic grammar error correction model based on encoder-decoder structure. Different from traditional encoders, we design a dual-encoder structure to capture the information of source sentence and context sentence separately. The decoder is designed with a gated structure, it can effectively integrate output information of encoders. At the same time, the self-attention mechanism is combined to better solve the problem of long-distance information extraction. In addition, we propose a dynamic beam search algorithm to improve the accuracy of the word prediction process, and achieve dynamic extraction of the decoder output by combining kernel sampling techniques. We add a penalty factor to reduce the probability of generating repeated words, while suppressing the model's preference for generating shorter sentences. Finally, the proposed method is validated on the official English grammar error correction dataset. Experiments show that the dual encoder model in this paper has a good performance.
Author Wang, Yabing
Huang, Guimin
Wang, Jiahao
Author_xml – sequence: 1
  givenname: Jiahao
  surname: Wang
  fullname: Wang, Jiahao
– sequence: 2
  givenname: Guimin
  surname: Huang
  fullname: Huang, Guimin
– sequence: 3
  givenname: Yabing
  surname: Wang
  fullname: Wang, Yabing
BookMark eNp1kL1PwzAQxS0EEqV0Z7TEnOKv2MlYqlKQihgoI7JcxwFXaVzODoL_noQyICSmd3d67073O0PHbWgdQheUTAUlxZVzKfo4fS99PmWE0iM0YoSzrBREHf-qT9Ekxi0hhKqcCyZG6HnWpbAzyVu8BLPbGcALgAB4HgCcTT60-D5UrsHXJroK9-2itf0Assp9K35M0NnUgcN1n1u0L42Pr3jtPlI8Rye1aaKb_OgYPd0s1vPbbPWwvJvPVpnllKesrAvLVekYNUIYqxQvhCC2sqrclKaQgtWMm80ml67khSxcznNS09pyo6TMBR-jy8PePYS3zsWkt6GDtj-pOVO5lIpz1bvIwWUhxAiu1nvw_cefmhI9cNQHjnrgqAeOfUT-iVifzEAlgfHN_8Ev5LR8dw
CitedBy_id crossref_primary_10_1016_j_procs_2023_12_031
Cites_doi 10.1109/TCYB.2020.3008280
10.1109/ACAIT53529.2021.9731256
10.1609/aaai.v32i1.12069
10.18653/v1/N19-1406
10.1109/TETCI.2022.3186180
10.1155/2022/2709255
10.18653/v1/N18-1057
10.1007/s00521-020-05591-2
10.18653/v1/P17-1070
10.18653/v1/W19-4427
10.18653/v1/2022.acl-long.266
10.1109/TNSRE.2020.3022715
10.1109/TCYB.2020.3027962
10.1558/cj.v26i3.491-511
10.1016/j.engappai.2019.05.003
10.1007/s00778-021-00718-w
10.1109/TSMC.2021.3096013
10.18653/v1/N19-1014
10.1155/2021/6687337
ContentType Journal Article
Copyright 2022. This work is published under https://creativecommons.org/licenses/by-nc-sa/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml – notice: 2022. This work is published under https://creativecommons.org/licenses/by-nc-sa/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID AAYXX
CITATION
8FE
8FG
ABUWG
AFKRA
ARAPS
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
HCIFZ
P5Z
P62
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
DOI 10.4108/eetsis.v9i5.2011
DatabaseName CrossRef
ProQuest SciTech Collection
ProQuest Technology Collection
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
Advanced Technologies & Computer Science Collection
ProQuest Central Essentials - QC
ProQuest Central
Technology Collection
ProQuest One
ProQuest Central
SciTech Premium Collection
Advanced Technologies & Aerospace Database (ProQuest)
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Premium
ProQuest One Academic
Publicly Available Content Database (ProQuest)
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
One Applied & Life Sciences
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
ProQuest Central China
DatabaseTitle CrossRef
Publicly Available Content Database
Advanced Technologies & Aerospace Collection
Technology Collection
ProQuest One Academic Middle East (New)
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Technology Collection
ProQuest SciTech Collection
ProQuest Central China
ProQuest Central
Advanced Technologies & Aerospace Database
ProQuest One Applied & Life Sciences
ProQuest One Academic UKI Edition
ProQuest Central Korea
ProQuest Central (New)
ProQuest One Academic
ProQuest One Academic (New)
DatabaseTitleList Publicly Available Content Database
CrossRef
Database_xml – sequence: 1
  dbid: PIMPY
  name: Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISSN 2032-9407
ExternalDocumentID 10_4108_eetsis_v9i5_2011
GroupedDBID 5VS
8FE
8FG
AAFWJ
AAYXX
ADBBV
AFKRA
AFPKN
ALMA_UNASSIGNED_HOLDINGS
ARAPS
BCNDV
BENPR
BGLVJ
CITATION
GROUPED_DOAJ
HCIFZ
KQ8
M~E
OK1
P62
PIMPY
TH9
ABUWG
AZQEC
CCPQU
DWQXO
PHGZM
PHGZT
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
ID FETCH-LOGICAL-c313t-9f8c379e21a44ac7738440cdc79b9a8642f23abb56e93868e5350f1fc3a766543
IEDL.DBID P5Z
ISICitedReferencesCount 0
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000884811000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2032-9407
IngestDate Thu Nov 27 08:51:15 EST 2025
Tue Nov 18 21:23:52 EST 2025
Sat Nov 29 04:13:30 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
License https://creativecommons.org/licenses/by-nc-sa/4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c313t-9f8c379e21a44ac7738440cdc79b9a8642f23abb56e93868e5350f1fc3a766543
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
OpenAccessLink https://www.proquest.com/docview/3275667337?pq-origsite=%requestingapplication%
PQID 3275667337
PQPubID 4477225
ParticipantIDs proquest_journals_3275667337
crossref_primary_10_4108_eetsis_v9i5_2011
crossref_citationtrail_10_4108_eetsis_v9i5_2011
PublicationCentury 2000
PublicationDate 2022-09-12
PublicationDateYYYYMMDD 2022-09-12
PublicationDate_xml – month: 09
  year: 2022
  text: 2022-09-12
  day: 12
PublicationDecade 2020
PublicationPlace Ghent
PublicationPlace_xml – name: Ghent
PublicationTitle EAI endorsed transactions on scalable information systems
PublicationYear 2022
Publisher European Alliance for Innovation (EAI)
Publisher_xml – name: European Alliance for Innovation (EAI)
References 9388
9389
9400
9386
9387
9403
9404
9401
9402
9381
9384
9385
9382
9383
9399
9397
9398
9391
9392
9390
9395
9396
9393
9394
9407
9408
9405
9406
References_xml – ident: 9388
– ident: 9400
  doi: 10.1109/TCYB.2020.3008280
– ident: 9394
– ident: 9384
– ident: 9390
  doi: 10.1109/ACAIT53529.2021.9731256
– ident: 9391
  doi: 10.1609/aaai.v32i1.12069
– ident: 9407
  doi: 10.18653/v1/N19-1406
– ident: 9401
  doi: 10.1109/TETCI.2022.3186180
– ident: 9382
– ident: 9395
  doi: 10.1155/2022/2709255
– ident: 9405
– ident: 9392
  doi: 10.18653/v1/N18-1057
– ident: 9387
  doi: 10.1007/s00521-020-05591-2
– ident: 9406
  doi: 10.18653/v1/P17-1070
– ident: 9408
  doi: 10.18653/v1/W19-4427
– ident: 9397
  doi: 10.18653/v1/2022.acl-long.266
– ident: 9402
  doi: 10.1109/TNSRE.2020.3022715
– ident: 9399
  doi: 10.1109/TCYB.2020.3027962
– ident: 9383
– ident: 9385
  doi: 10.1558/cj.v26i3.491-511
– ident: 9389
  doi: 10.1007/s00521-020-05591-2
– ident: 9386
  doi: 10.1016/j.engappai.2019.05.003
– ident: 9381
– ident: 9398
  doi: 10.1007/s00778-021-00718-w
– ident: 9403
  doi: 10.1109/TSMC.2021.3096013
– ident: 9393
  doi: 10.18653/v1/N19-1014
– ident: 9404
– ident: 9396
  doi: 10.1155/2021/6687337
SSID ssj0001753424
Score 2.248835
Snippet The role of information transmission in social life is irreplaceable, and language is a very important information carrier. Among all kinds of languages,...
SourceID proquest
crossref
SourceType Aggregation Database
Enrichment Source
Index Database
StartPage e4
SubjectTerms Encoders-Decoders
English language
Error correction
Error correction & detection
Grammar
Information retrieval
Search algorithms
Sentences
Title Automatic Grammar Error Correction Model Based on Encoder-decoder Structure for English Texts
URI https://www.proquest.com/docview/3275667337
Volume 10
WOSCitedRecordID wos000884811000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 2032-9407
  dateEnd: 20221231
  omitProxy: false
  ssIdentifier: ssj0001753424
  issn: 2032-9407
  databaseCode: DOA
  dateStart: 20140101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2032-9407
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001753424
  issn: 2032-9407
  databaseCode: M~E
  dateStart: 20100101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
– providerCode: PRVPQU
  databaseName: ProQuest advanced technologies & aerospace journals
  customDbUrl:
  eissn: 2032-9407
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001753424
  issn: 2032-9407
  databaseCode: P5Z
  dateStart: 20220101
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/hightechjournals
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest Central
  customDbUrl:
  eissn: 2032-9407
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001753424
  issn: 2032-9407
  databaseCode: BENPR
  dateStart: 20220101
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Publicly Available Content Database
  customDbUrl:
  eissn: 2032-9407
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001753424
  issn: 2032-9407
  databaseCode: PIMPY
  dateStart: 20220101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/publiccontent
  providerName: ProQuest
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV07T8MwELagZWChPMWz8sDCEGhyTpxMqKDwGFpFPCRgCY5jS5VQCknpyG_H57qgLiwsiSLbUuTz3fnOvu8j5FhHWpZMl55KYizJCYQnQIAnGZeFr3mPB4Ulm-DDYfz0lGQu4da4a5Vzm2gNdTmWmCM_A8QpjzgAP3__8JA1Ck9XHYXGMmkjSgIqZha-_OZYzF6cBWx2OsmQ8EapSTNqTqfJKLTwnYveaNEYWw9z1fnvv62TNbe3pP3ZYtggS6raJJ05bwN1arxFXvsV7X9OxhatlV7XAuvXaFrX45peIluHrXWgSJP2Ri-Mmyup-UwrLH-vvVLZN723yLOftaJm30tdOTB9MMa-2SaPV-nD5Y3nmBY8CT5MvETHEniiAl8wJiTnEDPWk6XkSZGI2MQoOgBRFGGkEoijWIUQ9rSvJQiO9MWwQ1rVuFK7hHLwi0ihWSjMsLDEeEWZHrLUoEGJPXI2n_FcOhhyZMN4y004gjLKZzLKUUY5ymiPnPyMeJ9BcPzR93AuodwpY5P_imf_7-YDshpgdYNliDgkLTOP6oisyOlk1NRd0r5Ih9ld14bt5jn4Srt2vZmW7HaQPX8DyanhLQ
linkProvider ProQuest
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1NT9wwEB3xUYlegFIQUCg-wKGHlE3GiZMDQgtdCgJWSN1KiEvWcWxpJZSlye5W_VP9jXicBMSFGwdOURQ7UuyX-bD95gHsm8ionJvc00lMlJxAehIleooLlflGdESQObEJ0e_Ht7fJzRz8b7kwdKyytYnOUOdjRWvkh0h1yiOBKI4f_nikGkW7q62ERg2LS_3vr03ZqqOLH3Z-D4LgrDc4PfcaVQFPoY8TLzGxQpHowJecSyUExpx3VK5EkiUytvG4CVBmWRjpBOMo1iGGHeMbhVKQVC_a987DIuc2WbL_z01497ymY2N_HvB6N5STwI7Wk2pUfZ8lo9CVC33p_V4af-fRzlbe21iswnITO7NuDfZPMKeLNVhpdSlYY6Y-w7BbsO50MnbVaNnPUhI_j_XKclyyU1IjcVwORjJw9-zEuvGc2dteQfT-0su1u7JfrrLutNTMxvWsoTuzgXVm1Tr8fpPv3ICFYlzoTWAC_SzSZPYy2y3MKR_TtoXKDRrUcgsO2xlOVVNmndQ-7lObbhEm0hoTKWEiJUxswbenHg91iZFX2u60iEgbY1Olz3DYfv3xHiydD66v0quL_uUX-BgQk8OpYezAgh1TvQsf1GwyqsqvDtcMhm8Nnkd8wTb5
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+Automatic+Grammar+Error+Correction+Model+Based+on+Encoder-decoder+Structure+for+English+Texts&rft.jtitle=EAI+endorsed+transactions+on+scalable+information+systems&rft.au=Wang%2C+Jiahao&rft.au=Huang%2C+Guimin&rft.au=Wang%2C+Yabing&rft.date=2022-09-12&rft.pub=European+Alliance+for+Innovation+%28EAI%29&rft.eissn=2032-9407&rft.volume=10&rft.issue=1&rft.spage=e10&rft_id=info:doi/10.4108%2Feetsis.v9i5.2011
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2032-9407&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2032-9407&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2032-9407&client=summon