SOBO: A Feedback Bot to Nudge Code Quality in Programming Courses

This paper presents SOBO, a bot we designed to automatically provide feedback on code quality to undergraduate students. SOBO has been deployed in a course at the KTH Royal Institute of Technology in Sweden with more than 130 students.

Saved in:
Bibliographic Details
Published in:IEEE software Vol. 41; no. 2; pp. 68 - 76
Main Authors: Bobadilla, Sofia, Glassey, Richard, Bergel, Alexandre, Monperrus, Martin
Format: Journal Article
Language:English
Published: Los Alamitos IEEE 01.03.2024
IEEE Computer Society
Subjects:
Chatbots
Codes
Education
Feedback
Programming profession
Software development management
Software engineering
Students
Task analysis
Undergraduate study
ISSN:0740-7459, 1937-4194, 1937-4194
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract This paper presents SOBO, a bot we designed to automatically provide feedback on code quality to undergraduate students. SOBO has been deployed in a course at the KTH Royal Institute of Technology in Sweden with more than 130 students.
AbstractList This paper presents SOBO, a bot we designed to automatically provide feedback on code quality to undergraduate students. SOBO has been deployed in a course at the KTH Royal Institute of Technology in Sweden with more than 130 students.
Author Monperrus, Martin
Bobadilla, Sofia
Glassey, Richard
Bergel, Alexandre
Author_xml – sequence: 1
  givenname: Sofia
  orcidid: 0000-0003-3116-3278
  surname: Bobadilla
  fullname: Bobadilla, Sofia
  email: sofbob@kth.se
  organization: KTH Royal Institute of Technology, Stockholm, Sweden
– sequence: 2
  givenname: Richard
  orcidid: 0000-0002-8996-0221
  surname: Glassey
  fullname: Glassey, Richard
  email: glassey@kth.se
  organization: KTH Royal Institute of Technology, Stockholm, Sweden
– sequence: 3
  givenname: Alexandre
  orcidid: 0000-0001-8087-1903
  surname: Bergel
  fullname: Bergel, Alexandre
  email: alexandre.bergel@me.com
  organization: Computer scientist, RelationalAI, Bern, Switzerland
– sequence: 4
  givenname: Martin
  orcidid: 0000-0003-3505-3383
  surname: Monperrus
  fullname: Monperrus, Martin
  email: monperrus@kth.se
  organization: Software Rechnology, KTH Royal Institute of Technology, Stockholm, Sweden
BackLink https://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-345010$$DView record from Swedish Publication Index (Kungliga Tekniska Högskolan)
BookMark eNp9kDtPwzAURi0EEuUxszBYYk7xM6nZQqGAVCiowGrZjhsMbVxsR6j_nlStEGJgusM957tX3wHYbXxjATjBqI8xEuf30z5BhPYpEYOCiB3Qw4IWGcOC7YIeKhjKCsbFPjiI8R0hxDFFPVBOJ5eTC1jCkbWVVuYDXvoEk4cPbVVbOPSVhU-tmru0gq6Bj8HXQS0Wrqm7XRuijUdgb6bm0R5v5yF4GV0_D2-z8eTmbliOM0NzkTItcqqJVgoPbCGorQpuBpoxhVCOTCVyQ2czrLAmpKJK8YJXPNeWcJNrQzv5EGSb3Phll62Wy-AWKqykV05euddS-lDLj_QmKeMIo44_2_DL4D9bG5N87x5uuhclEZTwnDCGO-p8Q5ngYwx29pOLkVz3Ku-nct2r3PbaGfyPYVxSyfkmBeXm_3inG89Za39dwYILxOg3CFaEpw
CODEN IESOEG
CitedBy_id crossref_primary_10_1186_s41239_024_00494_x
crossref_primary_10_1145_3749996
Cites_doi 10.1109/ase51524.2021.9678837
10.1145/3551349.3560425
10.1109/tdsc.2022.3167316
10.1145/3513140
10.1016/j.econedurev.2018.03.008
10.1109/ms.2022.3224813
10.1007/978-3-031-18304-1_4
10.1145/3159450.3159602
10.1145/3534857
ContentType Journal Article
Copyright Copyright IEEE Computer Society 2024
Copyright_xml – notice: Copyright IEEE Computer Society 2024
DBID 97E
ESBDL
RIA
RIE
AAYXX
CITATION
JQ2
ADTPV
AFDQA
AOWAS
D8T
D8V
ZZAVC
DOI 10.1109/MS.2023.3298729
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE Xplore Open Access Journals
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
ProQuest Computer Science Collection
SwePub
SWEPUB Kungliga Tekniska Högskolan full text
SwePub Articles
SWEPUB Freely available online
SWEPUB Kungliga Tekniska Högskolan
SwePub Articles full text
DatabaseTitle CrossRef
ProQuest Computer Science Collection
DatabaseTitleList
ProQuest Computer Science Collection
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Education
Computer Science
EISSN 1937-4194
EndPage 76
ExternalDocumentID oai_DiVA_org_kth_345010
10_1109_MS_2023_3298729
10195904
Genre orig-research
GroupedDBID -DZ
-~X
.4S
.DC
0R~
29I
3EH
4.4
5GY
5VS
6IK
7WY
85S
88I
8FE
8FG
8FL
8G5
8R4
8R5
97E
9M8
AAJGR
AARMG
AASAJ
AAVXG
AAWTH
ABAZT
ABJCF
ABQJQ
ABUWG
ABVLG
ACGFO
ACGOD
ACIWK
AENEX
AETIX
AFKRA
AFOGA
AGCDD
AGQYO
AGSQL
AHBIQ
AI.
AIBXA
AKJIK
AKQYR
ALLEH
ALMA_UNASSIGNED_HOLDINGS
ARAPS
ARCSS
ASUFR
ATWAV
AZLTO
AZQEC
BEFXN
BENPR
BEZIV
BFFAM
BGLVJ
BGNUA
BKEBE
BKOMP
BPEOZ
BPHCQ
CCPQU
CS3
DU5
DWQXO
EBS
EDO
EJD
ESBDL
FRNLG
GNUQQ
GUQSH
HCIFZ
HZ~
H~9
I-F
IBMZZ
ICLAB
IEDLZ
IFIPE
IFJZH
IPLJI
ITG
ITH
JAVBF
K60
K6V
K6~
K7-
L6V
LAI
M0C
M1Q
M2O
M2P
M43
M7S
MS~
O9-
OCL
OHT
P2P
P62
PHGZM
PHGZT
PQBIZ
PQBZA
PQGLB
PQQKQ
PROAC
PTHSS
PUEGO
Q2X
RIA
RIE
RNI
RNS
RXW
RZB
TAE
TN5
UHB
UKR
UQL
VH1
WH7
YZZ
ZCG
AAYXX
AFFHD
CITATION
JQ2
ADTPV
AFDQA
AOWAS
D8T
D8V
ZZAVC
ID FETCH-LOGICAL-c369t-b963b2baa18e793ed75c8b44a0060cd96c3ff1a1b22d3aa575d56be25c6bc3963
IEDL.DBID RIE
ISICitedReferencesCount 3
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001179020800007&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 0740-7459
1937-4194
IngestDate Tue Nov 04 17:23:51 EST 2025
Wed Aug 13 08:46:53 EDT 2025
Sat Nov 29 01:42:33 EST 2025
Tue Nov 18 21:09:54 EST 2025
Wed Aug 27 02:17:10 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
License https://creativecommons.org/licenses/by/4.0/legalcode
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c369t-b963b2baa18e793ed75c8b44a0060cd96c3ff1a1b22d3aa575d56be25c6bc3963
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-3505-3383
0000-0001-8087-1903
0000-0003-3116-3278
0000-0002-8996-0221
OpenAccessLink https://ieeexplore.ieee.org/document/10195904
PQID 2932562441
PQPubID 37787
PageCount 9
ParticipantIDs ieee_primary_10195904
crossref_primary_10_1109_MS_2023_3298729
swepub_primary_oai_DiVA_org_kth_345010
crossref_citationtrail_10_1109_MS_2023_3298729
proquest_journals_2932562441
PublicationCentury 2000
PublicationDate 2024-03-01
PublicationDateYYYYMMDD 2024-03-01
PublicationDate_xml – month: 03
  year: 2024
  text: 2024-03-01
  day: 01
PublicationDecade 2020
PublicationPlace Los Alamitos
PublicationPlace_xml – name: Los Alamitos
PublicationTitle IEEE software
PublicationTitleAbbrev S-M
PublicationYear 2024
Publisher IEEE
IEEE Computer Society
Publisher_xml – name: IEEE
– name: IEEE Computer Society
References ref13
Jansen (ref1) 2017; 210
ref12
ref11
Thaler (ref3) 2009
Wicklund (ref2) 2023
ref8
ref7
(ref10) 2022
ref9
ref4
ref6
ref5
References_xml – ident: ref9
  doi: 10.1109/ase51524.2021.9678837
– volume: 210
  issue: 4
  year: 2017
  ident: ref1
  article-title: The impact of automated code quality feedback in programming education
  publication-title: Proc.-Post 10th Seminar Adv. Techn. Tools Softw. Evol. (SATToSE)
– volume-title: Java code quality and code security
  year: 2022
  ident: ref10
– start-page: 792
  volume-title: Proc. 54th ACM Tech. Symp. Comput. Sci. Educ. (SIGCSE)
  year: 2023
  ident: ref2
  article-title: It is never too early to learn about code quality: Analyzing code quality of first-year programming students and the difference between TA groups
– ident: ref8
  doi: 10.1145/3551349.3560425
– ident: ref12
  doi: 10.1109/tdsc.2022.3167316
– ident: ref5
  doi: 10.1145/3513140
– ident: ref4
  doi: 10.1016/j.econedurev.2018.03.008
– ident: ref7
  doi: 10.1109/ms.2022.3224813
– volume-title: Nudge: Improving Decisions About Health, Wealth, and Happiness
  year: 2009
  ident: ref3
– ident: ref6
  doi: 10.1007/978-3-031-18304-1_4
– ident: ref13
  doi: 10.1145/3159450.3159602
– ident: ref11
  doi: 10.1145/3534857
SSID ssj0005130
Score 2.4197237
Snippet This paper presents SOBO, a bot we designed to automatically provide feedback on code quality to undergraduate students. SOBO has been deployed in a course at...
SourceID swepub
proquest
crossref
ieee
SourceType Open Access Repository
Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 68
SubjectTerms Chatbots
Codes
Education
Feedback
Programming profession
Software development management
Software engineering
Students
Task analysis
Undergraduate study
Title SOBO: A Feedback Bot to Nudge Code Quality in Programming Courses
URI https://ieeexplore.ieee.org/document/10195904
https://www.proquest.com/docview/2932562441
https://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-345010
Volume 41
WOSCitedRecordID wos001179020800007&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 1937-4194
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0005130
  issn: 1937-4194
  databaseCode: RIE
  dateStart: 19840101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV05T8MwFLYAMbBwFBDlkgeEWFISx7nYylGx9JA4xGb5eIWq0CCaIvHveXZcjoGBLYNtWX5--T4nz99HyNEwTCSijgkQulnAc1UEKgUeMGMyZZiBcBg6s4ms18sfHoqBv6zu7sIAgCs-g5Z9dP_yTaln9lMZZriVQrHqn4tZltaXtb7rOSJnLIKQGAYZTwqv4xOFxWn3pmVdwlsxwxO2I5PfEOQ8VX7Ty5-SoQ5mOmv_nOA6WfV8krbrDbBBFmDSIGtzrwbqU7dh3Zl9Jccmvkr75_0z2qYdhC4l9ZielxWtStqbmUegF6UBWmtrfNDRhA7qEq4XBDlqLe6mMN0id52r24vrwFspBDpOiypQmGeKKSmjHDAjwWSJzhXn0uqxaFOkOh4OIxkpxkwsJXI4k6QKWKJTpWPsvE2WJuUEdgiVUmaxVQULc-BamzwHFirOFMRJnhrWJK356grtdcat3cWzcOeNsBDdG2HDIXw4muTkq8NrLbHxd9Mtu-g_mtXr3ST78_gJn4NTgUQG-RzSl6hJjuuYfnW0otqXo_u2wPCJcfUkYp7gyXT3j_H3yApOg9e1Z_tkqXqbwQFZ1u_VaPp26PbhJ6WH2G0
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3LThsxFLUqQKIbKI-KQFq8QFU3k3o8nld3CW1EBQlIQMXO8uOmjQIZRCZI_D3XHofHggW7WdiW5es753jm-hxCDkYsVYg6NkLo5pEodBnpDETErc215RbYiHmziXw4LK6uyrNwWd3fhQEAX3wGHffo_-XbyszdpzLMcCeF4tQ_l1MhOGuuaz1XdMTeWgRBkUW5SMug5BOz8sfgvON8wjsJxzO2p5PPIORdVV4TzJeioR5o-uvvnOInshYYJe02W2CDfIDpJllfuDXQkLybzp851HJs4cv0tHf6k3ZpH8FLKzOhvaqmdUWHc_sP6GFlgTbqGg90PKVnTRHXDcIcdSZ3M5htk8v-74vDoyiYKUQmyco60phpmmul4gIwJ8HmqSm0EMopshhbZiYZjWIVa85tohSyOJtmGnhqMm0S7PyZLE2rKewQqpTKE6cLxgoQxtiiAM604BqStMgsb5HOYnWlCUrjzvDiWvoTByvl4Fy6cMgQjhb5_tThthHZeLvptlv0F82a9W6R9iJ-MmThTCKVQUaHBCZukW9NTJ86OlntX-O_XYnhk5P6v0xEimfT3TfG3yerRxeDE3nyZ3i8Rz7ilERTidYmS_XdHL6QFXNfj2d3X_2efAQRs9u0
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=SOBO%3A+A+Feedback+Bot+to+Nudge+Code+Quality+in+Programming+Courses&rft.jtitle=IEEE+software&rft.au=Bobadilla%2C+Sofia&rft.au=Glassey%2C+Richard&rft.au=Bergel%2C+Alexandre&rft.au=Monperrus%2C+Martin&rft.date=2024-03-01&rft.issn=0740-7459&rft.eissn=1937-4194&rft.volume=41&rft.issue=2&rft.spage=68&rft.epage=76&rft_id=info:doi/10.1109%2FMS.2023.3298729&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_MS_2023_3298729
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0740-7459&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0740-7459&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0740-7459&client=summon