The Effects of Explanations in Automated Essay Scoring Systems on Student Trust and Motivation

Ethical considerations, including transparency, play an important role when using artificial intelligence (AI) in education. Explainable AI has been coined as a solution to provide more insight into the inner workings of AI algorithms. However, carefully designed user studies on how to design explan...

Full description

Saved in:
Bibliographic Details
Published in:Journal of Learning Analytics Vol. 10; no. 1; pp. 37 - 53
Main Authors: Conijn, Rianne, Kahr, Patricia, Snijders, Chris
Format: Journal Article
Language:English
Published: 12.03.2023
ISSN:1929-7750, 1929-7750
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Ethical considerations, including transparency, play an important role when using artificial intelligence (AI) in education. Explainable AI has been coined as a solution to provide more insight into the inner workings of AI algorithms. However, carefully designed user studies on how to design explanations for AI in education are still limited. The current study aimed to identify the effect of explanations of an automated essay scoring system on students’ trust and motivation. The explanations were designed using a needs-elicitation study with students in combination with guidelines and frameworks of explainable AI. Two types of explanations were tested: full-text global explanations and an accuracy statement. The results showed that both explanations did not have an effect on student trust or motivation compared to no explanations. Interestingly, the grade provided by the system, and especially the difference between the student’s self-estimated grade and the system grade, showed a large influence. Hence, it is important to consider the effects of the outcome of the system (here: grade) when considering the effect of explanations of AI in education.
AbstractList Ethical considerations, including transparency, play an important role when using artificial intelligence (AI) in education. Explainable AI has been coined as a solution to provide more insight into the inner workings of AI algorithms. However, carefully designed user studies on how to design explanations for AI in education are still limited. The current study aimed to identify the effect of explanations of an automated essay scoring system on students’ trust and motivation. The explanations were designed using a needs-elicitation study with students in combination with guidelines and frameworks of explainable AI. Two types of explanations were tested: full-text global explanations and an accuracy statement. The results showed that both explanations did not have an effect on student trust or motivation compared to no explanations. Interestingly, the grade provided by the system, and especially the difference between the student’s self-estimated grade and the system grade, showed a large influence. Hence, it is important to consider the effects of the outcome of the system (here: grade) when considering the effect of explanations of AI in education.
Author Conijn, Rianne
Kahr, Patricia
Snijders, Chris
Author_xml – sequence: 1
  givenname: Rianne
  orcidid: 0000-0002-6316-4892
  surname: Conijn
  fullname: Conijn, Rianne
– sequence: 2
  givenname: Patricia
  surname: Kahr
  fullname: Kahr, Patricia
– sequence: 3
  givenname: Chris
  surname: Snijders
  fullname: Snijders, Chris
BookMark eNp1kEtLAzEYRYMoWGu3rvMHZvySOJNkWcr4gIqLztoh5KEp06Qkqdh_b1tdiODq3s25XM4VOg8xWIRuCNREtCBu16OqKVBWcwHkDE2IpLLivIHzX_0SzXJeAwCjhDEJE_Tav1vcOWd1yTg63H1uRxVU8TFk7AOe70rcqGIN7nJWe7zSMfnwhlf7XOzmgAS8KjtjQ8F92uWCVTD4ORb_cdq4RhdOjdnOfnKK-vuuXzxWy5eHp8V8WWnKZal0K7QBploJhjYNSEE4U42BxpjWccIsJY2UwhnuCNeWAxdECwOtaq1SbIruvmd1ijkn6wbty-lAScqPA4HhZGk4WBqOloajpQNW_8G2yW9U2v8HfAG1uWyF
CitedBy_id crossref_primary_10_1007_s43621_024_00774_6
crossref_primary_10_1111_bjet_13596
crossref_primary_10_1109_ACCESS_2025_3530272
crossref_primary_10_3390_electronics12122594
crossref_primary_10_2139_ssrn_5086778
crossref_primary_10_1007_s40593_025_00486_6
crossref_primary_10_1007_s40593_025_00487_5
crossref_primary_10_1007_s44163_024_00147_y
crossref_primary_10_56579_rei_v7i4_2374
crossref_primary_10_3389_feduc_2023_1272229
crossref_primary_10_3389_frai_2024_1408817
crossref_primary_10_70838_pemj_450705
crossref_primary_10_1109_ACCESS_2024_3440660
crossref_primary_10_1002_berj_4069
crossref_primary_10_3389_feduc_2024_1461362
crossref_primary_10_1038_s41598_024_80305_5
crossref_primary_10_3390_educsci14121386
crossref_primary_10_3390_make6010017
crossref_primary_10_1177_07356331241310915
crossref_primary_10_3390_educsci13070692
crossref_primary_10_1016_j_caeai_2025_100414
crossref_primary_10_3389_frai_2024_1456486
crossref_primary_10_3390_educsci14050531
crossref_primary_10_3390_math12213416
crossref_primary_10_51137_wrp_ijarbm_2025_mmaa_45846
crossref_primary_10_14686_buefad_1416087
ContentType Journal Article
DBID AAYXX
CITATION
DOI 10.18608/jla.2023.7801
DatabaseName CrossRef
DatabaseTitle CrossRef
DatabaseTitleList CrossRef
DeliveryMethod fulltext_linktorsrc
EISSN 1929-7750
EndPage 53
ExternalDocumentID 10_18608_jla_2023_7801
GroupedDBID AAYXX
ABOPQ
ALMA_UNASSIGNED_HOLDINGS
CITATION
FRS
M~E
OK1
ID FETCH-LOGICAL-c279t-c68cd03a690d255098173a5d05dd6f713e215998fd7f17ce70781c8d06a6eaa3
ISICitedReferencesCount 32
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000950072900002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1929-7750
IngestDate Sat Nov 29 02:59:07 EST 2025
Tue Nov 18 22:43:08 EST 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
License http://creativecommons.org/licenses/by-nc-nd/4.0
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c279t-c68cd03a690d255098173a5d05dd6f713e215998fd7f17ce70781c8d06a6eaa3
ORCID 0000-0002-6316-4892
OpenAccessLink https://learning-analytics.info/index.php/JLA/article/download/7801/7701
PageCount 17
ParticipantIDs crossref_citationtrail_10_18608_jla_2023_7801
crossref_primary_10_18608_jla_2023_7801
PublicationCentury 2000
PublicationDate 2023-03-12
PublicationDateYYYYMMDD 2023-03-12
PublicationDate_xml – month: 03
  year: 2023
  text: 2023-03-12
  day: 12
PublicationDecade 2020
PublicationTitle Journal of Learning Analytics
PublicationYear 2023
SSID ssj0003213390
Score 2.4151638
Snippet Ethical considerations, including transparency, play an important role when using artificial intelligence (AI) in education. Explainable AI has been coined as...
SourceID crossref
SourceType Enrichment Source
Index Database
StartPage 37
Title The Effects of Explanations in Automated Essay Scoring Systems on Student Trust and Motivation
Volume 10
WOSCitedRecordID wos000950072900002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 1929-7750
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0003213390
  issn: 1929-7750
  databaseCode: M~E
  dateStart: 20140101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LTxsxELYC9MClKqIVj7byoRIHtNT7iO09IpSqEi2qRA6cWPkpgiIHJQvi1F_Aj2a8dnaXlwQHLqvIsq0k36fxeHbmG4R-SCWKjFiTWDiNk0IXPJFWpkmmjBVCUJWZ0GyCnZzws7Py32Bwt6yFuZky5_jtbXn1rlDDGIDtS2ffAHe7KQzAZwAdngA7PF8N_KjL0vBJdsJ1KeOH1_UMvFTwM0eLhQDLoUIKXpQu9y8PToPe5f7Y12OETIy2C9oLzuyfNsLiRU7qXgr9ERiNy1jDL1z3Ev9YXMyDC-t7BEza0-EUpuvYuK1RPujHJbLcJ2alvVAluI4l-O5BVvbAPDO2tL_kCc-CMQ1qMPFYDpLCTww-p00Vw-XUa0hl-QHjMTbyQFn70YnX5iH6G5DfoYL1lV9f-fUraC1jw9LbyL__u4hdnsF9vgnatT8jqoD6LX4--Ao9L6fnrow_oY8RGnwY-LGBBsZtonPgBo7cwDOL-9zAE4dbbuCGGzhyA0du4JnDkRu44QYGbuCOG5_R-NdofPQ7iQ02EpWxsk4U5UqTXNCSaLhakpKnLBdDTYZaU8vS3IBDCPdxq5lNmTKNMpTimlBBjRD5F7TqZs5sIcxkoYgupWKcFpYLSY0ccm0Vl4WURGyjZPl_VCqKz_seKNPqeQi20V47_yrIrrwwc-fVM3fResfTr2i1nl-bb-iDuqkni_n3But7xxd8qw
linkProvider ISSN International Centre
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Effects+of+Explanations+in+Automated+Essay+Scoring+Systems+on+Student+Trust+and+Motivation&rft.jtitle=Journal+of+Learning+Analytics&rft.au=Conijn%2C+Rianne&rft.au=Kahr%2C+Patricia&rft.au=Snijders%2C+Chris&rft.date=2023-03-12&rft.issn=1929-7750&rft.eissn=1929-7750&rft.volume=10&rft.issue=1&rft.spage=37&rft.epage=53&rft_id=info:doi/10.18608%2Fjla.2023.7801&rft.externalDBID=n%2Fa&rft.externalDocID=10_18608_jla_2023_7801
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1929-7750&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1929-7750&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1929-7750&client=summon