PyDex: Repairing Bugs in Introductory Python Assignments using LLMs
Students often make mistakes in their introductory programming assignments as part of their learning process. Unfortunately, providing custom repairs for these mistakes can require a substantial amount of time and effort from class instructors. Automated program repair (APR) techniques can be used t...
Uloženo v:
| Vydáno v: | Proceedings of ACM on programming languages Ročník 8; číslo OOPSLA1; s. 1100 - 1124 |
|---|---|
| Hlavní autoři: | , , , , , , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
New York, NY, USA
ACM
29.04.2024
|
| Témata: | |
| ISSN: | 2475-1421, 2475-1421 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Students often make mistakes in their introductory programming assignments as part of their learning process. Unfortunately, providing custom repairs for these mistakes can require a substantial amount of time and effort from class instructors. Automated program repair (APR) techniques can be used to synthesize such fixes. Prior work has explored the use of symbolic and neural techniques for APR in the education domain. Both types of approaches require either substantial engineering efforts or large amounts of data and training. We propose to use a large language model trained on code, such as Codex (a version of GPT), to build an APR system – PyDex – for introductory Python programming assignments. Our system can fix both syntactic and semantic mistakes by combining multi-modal prompts, iterative querying, test-case-based selection of few-shots, and program chunking. We evaluate PyDex on 286 real student programs and compare to three baselines, including one that combines a state-of-the-art Python syntax repair engine, BIFI, and a state-of-the-art Python semantic repair engine for student assignments, Refactory. We find that PyDex can fix more programs and produce smaller patches on average. |
|---|---|
| AbstractList | Students often make mistakes in their introductory programming assignments as part of their learning process. Unfortunately, providing custom repairs for these mistakes can require a substantial amount of time and effort from class instructors. Automated program repair (APR) techniques can be used to synthesize such fixes. Prior work has explored the use of symbolic and neural techniques for APR in the education domain. Both types of approaches require either substantial engineering efforts or large amounts of data and training. We propose to use a large language model trained on code, such as Codex (a version of GPT), to build an APR system -- PyDex -- for introductory Python programming assignments. Our system can fix both syntactic and semantic mistakes by combining multi-modal prompts, iterative querying, test-case-based selection of few-shots, and program chunking. We evaluate PyDex on 286 real student programs and compare to three baselines, including one that combines a state-of-the-art Python syntax repair engine, BIFI, and a state-of-the-art Python semantic repair engine for student assignments, Refactory. We find that PyDex can fix more programs and produce smaller patches on average. |
| ArticleNumber | 133 |
| Author | Soares, Gustavo Cambronero, José Pablo Le, Vu Zhang, Jialu Piskac, Ruzica Verbruggen, Gust Gulwani, Sumit |
| Author_xml | – sequence: 1 givenname: Jialu orcidid: 0009-0003-8193-0719 surname: Zhang fullname: Zhang, Jialu email: jialu.zhang@uwaterloo.ca organization: University of Waterloo, Waterloo, Canada – sequence: 2 givenname: José Pablo orcidid: 0000-0002-0713-6141 surname: Cambronero fullname: Cambronero, José Pablo email: josepablocam@gmail.com organization: Microsoft, Washington DC, USA – sequence: 3 givenname: Sumit orcidid: 0000-0002-9226-9634 surname: Gulwani fullname: Gulwani, Sumit email: sumitg@microsoft.com organization: Microsoft, Redmond, USA – sequence: 4 givenname: Vu orcidid: 0000-0003-3727-3291 surname: Le fullname: Le, Vu email: levu@microsoft.com organization: Microsoft, Redmond, USA – sequence: 5 givenname: Ruzica orcidid: 0000-0002-3267-0776 surname: Piskac fullname: Piskac, Ruzica email: ruzica.piskac@yale.edu organization: Yale University, New Haven, USA – sequence: 6 givenname: Gustavo orcidid: 0000-0002-8061-9000 surname: Soares fullname: Soares, Gustavo email: gsoares@microsoft.com organization: Microsoft, Redmond, USA – sequence: 7 givenname: Gust orcidid: 0000-0001-9182-597X surname: Verbruggen fullname: Verbruggen, Gust email: gverbruggen@microsoft.com organization: Microsoft, Keerbergen, Belgium |
| BookMark | eNpt0M9LwzAUB_AgE5xzePeUm6dq0qRN4212_hhUHKLnkqZJjazpSFKw_70dmyLiu7wH78Pj8T0FE9tZBcA5RlcY0-SapJRnCToC05iyJMI0xpNf8wmYe_-BEMKc0IzwKcjXw1J93sAXtRXGGdvA277x0Fi4ssF1dS9D5wa4HsJ7Z-HCe9PYVtngYe93uiie_Bk41mLj1fzQZ-Dt_u41f4yK54dVvigiETMWorpiNMMCEVmLrCJKCSIZIqmUVKVSxLXCGmuuasb4WAypBMW6ShBnLE51SmYg2t-VrvPeKV1KE0Qw3fipMJsSo3IXQnkIYfSXf_zWmVa44R95sZdCtj_oe_kFq2Nk6Q |
| CitedBy_id | crossref_primary_10_1145_3735129 crossref_primary_10_1186_s41239_024_00494_x crossref_primary_10_1109_TSE_2024_3519159 crossref_primary_10_1109_ACCESS_2025_3584060 crossref_primary_10_1145_3689728 crossref_primary_10_1007_s10115_025_02383_9 |
| Cites_doi | 10.1109/ICSE48619.2023.00128 10.1007/978-3030-52237-7_9 10.1145/2786805.2786811 10.1145/3485477 10.1109/TSE.2011.104 10.1145/2491956.2462195 10.1145/3511861.3511863 10.1145/3180155.3180219 10.1145/3593856.3595910 10.1126/science.abq1158 10.1145/3560815 10.1145/3180155.3180247 10.1109/ASE.2019.00044 10.5281/zenodo.8115652 10.1145/3192366.3192384 10.1145/3468264.3468600 10.1109/ICSE.2017.44 10.1145/3106237.3106253 10.1145/3183377.3183383 10.1109/ASE.2017.8115676 10.1145/3468264.3468598 10.1145/3510418 10.1145/3551349.3560425 10.1109/SANER53432.2022.00118 10.1145/3510003.3510141 10.1145/3472749.3474740 10.1145/3485535 10.1145/3314221.3314629 10.1145/3318162 10.48550/ARXIV.2310.09690 10.1145/3485517 10.1145/2984043.2989222 10.1145/3578527.3578535 10.1609/aaai.v37i4.25642 10.1145/3626111.3628189 10.1145/3540250.3549101 10.1109/TSE.2016.2560811 10.1145/2568225.2568254 10.1145/3611643.3616306 10.1109/ICSE.2013.6606626 10.1145/2899415.2899422 10.1109/TSE.2022.3153522 10.1145/2837614.2837617 10.1145/2884781.2884807 10.1002/j.1538-7305.1950.tb00463.x 10.1145/3192366.3192387 10.1109/ASE.2015.60 10.1145/3106237.3106262 10.1145/3453483.3454051 10.1145/3533767.3534396 10.1007/978-3-030-52237-7_9 |
| ContentType | Journal Article |
| Copyright | Owner/Author |
| Copyright_xml | – notice: Owner/Author |
| DBID | AAYXX CITATION |
| DOI | 10.1145/3649850 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | CrossRef |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 2475-1421 |
| EndPage | 1124 |
| ExternalDocumentID | 10_1145_3649850 3649850 |
| GrantInformation_xml | – fundername: NSF (National Science Foundation) grantid: CCF-2106845, CCF-2131476 funderid: https:\/\/doi.org\/10.13039\/100000001 |
| GroupedDBID | AAKMM AAYFX ACM AEFXT AEJOY AIKLT AKRVB ALMA_UNASSIGNED_HOLDINGS GUFHI LHSKQ M~E OK1 ROL AAYXX CITATION |
| ID | FETCH-LOGICAL-a277t-db7481a03cda8b3eea3c7036cc4e6ca2de1f1f9ed77999970e502fb5097726f63 |
| ISICitedReferencesCount | 15 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001209927600040&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 2475-1421 |
| IngestDate | Tue Nov 18 20:44:38 EST 2025 Sat Nov 29 07:54:36 EST 2025 Mon Jul 07 16:40:28 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | OOPSLA1 |
| Keywords | automated program repair AI for programming education large language models |
| Language | English |
| License | This work is licensed under a Creative Commons Attribution International 4.0 License. |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-a277t-db7481a03cda8b3eea3c7036cc4e6ca2de1f1f9ed77999970e502fb5097726f63 |
| ORCID | 0000-0003-3727-3291 0000-0002-9226-9634 0009-0003-8193-0719 0000-0002-3267-0776 0000-0002-0713-6141 0000-0002-8061-9000 0000-0001-9182-597X |
| OpenAccessLink | https://dl.acm.org/doi/10.1145/3649850 |
| PageCount | 25 |
| ParticipantIDs | crossref_citationtrail_10_1145_3649850 crossref_primary_10_1145_3649850 acm_primary_3649850 |
| PublicationCentury | 2000 |
| PublicationDate | 2024-04-29 |
| PublicationDateYYYYMMDD | 2024-04-29 |
| PublicationDate_xml | – month: 04 year: 2024 text: 2024-04-29 day: 29 |
| PublicationDecade | 2020 |
| PublicationPlace | New York, NY, USA |
| PublicationPlace_xml | – name: New York, NY, USA |
| PublicationTitle | Proceedings of ACM on programming languages |
| PublicationTitleAbbrev | ACM PACMPL |
| PublicationYear | 2024 |
| Publisher | ACM |
| Publisher_xml | – name: ACM |
| References | (bib6) 2018 (bib43) 2016 (bib23) 2013 (bib45) 2021; 5 (bib14) 2022 (bib33) 2016 (bib57) 2022 (bib47) 2022 (bib67) 2022 (bib40) 2019 (bib34) 2021 (bib41) 2023 (bib11) 2020 (bib3) 2022; 31 (bib50) 2013 (bib51) 2021 (bib38) 2023 (bib7) 2020; 33 (bib66) 2023 (bib18) 2021 (bib63) 2021 (bib55) 2018b (bib32) 2015 (bib36) 2018 (bib20) 2023 (bib19) 2019 (bib21) 2015 (bib58) 2023a (bib60) 2023 (bib64) 2017 (bib44) 2014 (bib35) 2023 (bib28) 2022a; 378 (bib52) 2023 (bib42) 2022 (bib15) 2018 (bib30) 2023; 55 (bib62) 2017; 43 (bib12) 2022 (bib61) 2017 (bib4) 2018 (bib5) 2022 (bib8) 2021 (bib25) 2012; 38 (bib1) 2024 (bib16) 2023 (bib53) 2021; 5 (bib68) 2021; 5 (bib69) 2020 (bib39) 2022 (bib29) 2023 (bib27) 2022b (bib48) 2021 (bib13) 2023 (bib49) 2019 (bib56) 2021 bib24 (bib54) 2018a (bib22) 2016 (bib46) 2017 (bib9) 2024 (bib10) 2020 (bib59) 2023b (bib31) 2017 (bib37) 2016 (bib65) 2023 (bib2) 2021 (bib17) 1950; 29 (bib26) 2019; 62 e_1_2_1_60_1 e_1_2_1_20_1 e_1_2_1_41_1 e_1_2_1_66_1 Zhang Jialu (e_1_2_1_69_1) 2020 e_1_2_1_68_1 e_1_2_1_24_1 e_1_2_1_45_1 e_1_2_1_62_1 e_1_2_1_22_1 e_1_2_1_43_1 e_1_2_1_64_1 e_1_2_1_28_1 e_1_2_1_49_1 e_1_2_1_26_1 e_1_2_1_47_1 Wang Ke (e_1_2_1_54_1) 2018 e_1_2_1_31_1 e_1_2_1_8_1 e_1_2_1_56_1 e_1_2_1_6_1 e_1_2_1_12_1 e_1_2_1_35_1 e_1_2_1_50_1 e_1_2_1_4_1 e_1_2_1_10_1 e_1_2_1_33_1 e_1_2_1_52_1 e_1_2_1_16_1 e_1_2_1_39_1 e_1_2_1_14_1 e_1_2_1_37_1 e_1_2_1_58_1 e_1_2_1_18_1 Poesia Gabriel (e_1_2_1_42_1) 2022 Ahmed Toufique (e_1_2_1_2_1) 2021 Dinella Elizabeth (e_1_2_1_11_1) 2020 e_1_2_1_40_1 e_1_2_1_67_1 e_1_2_1_23_1 e_1_2_1_46_1 e_1_2_1_61_1 e_1_2_1_21_1 e_1_2_1_44_1 e_1_2_1_27_1 e_1_2_1_25_1 e_1_2_1_48_1 Zeller Andreas (e_1_2_1_65_1) e_1_2_1_29_1 Yasunaga Michihiro (e_1_2_1_63_1) 2021; 11952 Lu Yunlong (e_1_2_1_34_1) 2021 Chen Xinyun (e_1_2_1_9_1) 2024 Nijkamp Erik (e_1_2_1_38_1) 2023 e_1_2_1_30_1 e_1_2_1_55_1 e_1_2_1_5_1 e_1_2_1_57_1 e_1_2_1_3_1 Brown Tom (e_1_2_1_7_1) 1877 e_1_2_1_13_1 e_1_2_1_51_1 e_1_2_1_1_1 e_1_2_1_32_1 e_1_2_1_53_1 e_1_2_1_17_1 e_1_2_1_15_1 e_1_2_1_36_1 e_1_2_1_59_1 e_1_2_1_19_1 |
| References_xml | – start-page: 1469 year: 2023 end-page: 1481 ident: bib13 publication-title: 45th IEEE/ACM International Conference on Software Engineering, ICSE 2023, Melbourne, Australia, May 14-20, 2023 doi: 10.1109/ICSE48619.2023.00128 – start-page: 106 year: 2020 end-page: 117 ident: bib10 publication-title: Artificial Intelligence in Education: 21st International Conference, AIED 2020, Ifrane, Morocco, July 6–10, 2020, Proceedings, Part I (Ifrane, Morocco) doi: 10.1007/978-3030-52237-7_9 – year: 2023b ident: bib59 publication-title: Keep the Conversation Going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT – start-page: 166 year: 2015 end-page: 178 ident: bib32 publication-title: Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering (Bergamo, Italy) (ESEC/FSE 2015) doi: 10.1145/2786805.2786811 – year: 2019 ident: bib49 article-title: The Hard Part of Computer Science? Getting Into Class publication-title: The New York Times – volume: 5 start-page: 1 year: 2021 end-page: 25 ident: bib53 article-title: Semantic programming by example with pre-trained models publication-title: Proc. ACM Program. Lang doi: 10.1145/3485477 – year: 2024 ident: bib9 publication-title: The Twelfth International Conference on Learning Representations – volume: 38 start-page: 54 issue: 1 year: 2012 end-page: 72 ident: bib25 article-title: GenProg: A Generic Method for Automatic Software Repair publication-title: IEEE Transactions on Software Engineering doi: 10.1109/TSE.2011.104 – start-page: 15 year: 2013 end-page: 26 ident: bib50 publication-title: Proceedings of the 34th ACM SIGPLAN Conference on Programming Language Design and Implementation (Seattle, Washington, USA) (PLDI 13) doi: 10.1145/2491956.2462195 – start-page: 10 year: 2022 end-page: 19 ident: bib14 publication-title: Australasian Computing Education Conference (Virtual Event, Australia) (ACE ’22) doi: 10.1145/3511861.3511863 – start-page: 60 year: 2018 end-page: 70 ident: bib6 publication-title: Proceedings of the 40th International Conference on Software Engineering (Gothenburg, Sweden) (ICSE ’18) doi: 10.1145/3180155.3180219 – year: 2018a ident: bib54 publication-title: 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings – start-page: 87 year: 2023 end-page: 93 ident: bib52 publication-title: Proceedings of the 19th Workshop on Hot Topics in Operating Systems (Providence, RI, USA) (HOTOS ’23) doi: 10.1145/3593856.3595910 – volume: 378 start-page: 1092 issue: 6624 year: 2022a end-page: 1097 ident: bib28 article-title: Competition-level code generation with AlphaCode publication-title: Science doi: 10.1126/science.abq1158 – volume: 55 start-page: 35 issue: 9 year: 2023 ident: bib30 article-title: Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing publication-title: ACM Comput. Surv doi: 10.1145/3560815 – start-page: 129 year: 2018 end-page: 139 ident: bib36 publication-title: Proceedings of the 40th International Conference on Software Engineering, ICSE 2018, Gothenburg, Sweden, May 27 - June 03, 2018 doi: 10.1145/3180155.3180247 – start-page: 388 year: 2019 end-page: 398 ident: bib19 publication-title: 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) doi: 10.1109/ASE.2019.00044 – year: 2023 ident: bib41 publication-title: Proceedings of the 16th International Conference on Educational Data Mining, EDM 2023, Bengaluru, India, July 11-14, 2023 doi: 10.5281/zenodo.8115652 – start-page: 481 year: 2018b end-page: 495 ident: bib55 publication-title: Search, Align, and Repair: Data-Driven Feedback Generation for Introductory Programming Exercises (PLDI 2018) doi: 10.1145/3192366.3192384 – start-page: 354 year: 2021 end-page: 366 ident: bib56 publication-title: ESEC/FSE ’21: 29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering doi: 10.1145/3468264.3468600 – volume: 33 start-page: 1877 year: 2020 end-page: 1901 ident: bib7 publication-title: Advances in Neural Information Processing Systems – year: 2017 ident: bib46 publication-title: ICSE 2017 doi: 10.1109/ICSE.2017.44 – start-page: 727 year: 2017 end-page: 739 ident: bib31 publication-title: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering (Paderborn, Germany) (ESEC/FSE 2017) doi: 10.1145/3106237.3106253 – start-page: 78 year: 2018 end-page: 87 ident: bib4 publication-title: Proceedings of the 40th International Conference on Software Engineering: Software Engineering Education and Training doi: 10.1145/3183377.3183383 – start-page: 660 year: 2017 end-page: 670 ident: bib61 publication-title: Proceedings of the 32nd IEEE/ACM International Conference on Automated Software Engineering (Urbana-Champaign, IL, USA) (ASE 2017) doi: 10.1109/ASE.2017.8115676 – start-page: 328 year: 2021 end-page: 340 ident: bib51 publication-title: Context-Aware and Data-Driven Feedback Generation for Programming Assignments doi: 10.1145/3468264.3468598 – volume: 31 start-page: 31 issue: 4 year: 2022 ident: bib3 article-title: Verifix: Verified Repair of Programming Assignments publication-title: ACM Trans. Softw. Eng. Methodol doi: 10.1145/3510418 – start-page: 13 year: 2023 ident: bib66 publication-title: Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering (Rochester, MI, USA) (ASE ’22) doi: 10.1145/3551349.3560425 – year: 2024 ident: bib1 publication-title: Microsoft Copilot – start-page: 1006 year: 2022 end-page: 1017 ident: bib47 publication-title: IEEE International Conference on Software Analysis, Evolution and Reengineering, SANER 2022, Honolulu, HI, USA, March 15-18, 2022 doi: 10.1109/SANER53432.2022.00118 – year: 2023 ident: bib38 publication-title: The Eleventh International Conference on Learning Representations – start-page: 2130 year: 2022 end-page: 2141 ident: bib12 publication-title: 44th IEEE/ACM 44th International Conference on Software Engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022 doi: 10.1145/3510003.3510141 – year: 2021 ident: bib34 article-title: FAPR: Fast and Accurate Program Repair for Introductory Programming Courses publication-title: CoRR – start-page: 134 year: 2021 end-page: 148 ident: bib18 publication-title: The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21) doi: 10.1145/3472749.3474740 – volume: 5 start-page: 1 year: 2021 end-page: 29 ident: bib45 article-title: Multi-modal program inference: a marriage of pre-trained language models and component-based synthesis publication-title: Proc. ACM Program. Lang doi: 10.1145/3485535 – start-page: 860 year: 2019 end-page: 873 ident: bib40 publication-title: Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation (Phoenix, AZ, USA) (PLDI 2019) doi: 10.1145/3314221.3314629 – volume: 62 start-page: 56 issue: 12 year: 2019 end-page: 65 ident: bib26 article-title: Automated Program Repair publication-title: Commun. ACM doi: 10.1145/3318162 – year: 2023 ident: bib29 article-title: Configuration Validation with Large Language Models publication-title: CoRR doi: 10.48550/ARXIV.2310.09690 – volume: 5 start-page: 30 year: 2021 ident: bib68 article-title: Static Detection of Silent Misconfigurations with Deep Interaction Analysis publication-title: Proc. ACM Program. Lang doi: 10.1145/3485517 – start-page: 39 year: 2016 end-page: 40 ident: bib43 publication-title: Companion Proceedings of the 2016 ACM SIGPLAN International Conference on Systems, Programming, Languages and Applications: Software for Humanity (Amsterdam, Netherlands) (SPLASH Companion 2016) doi: 10.1145/2984043.2989222 – start-page: 11 year: 2023 ident: bib16 publication-title: Proceedings of the 16th Innovations in Software Engineering Conference (ISEC ’23) doi: 10.1145/3578527.3578535 – start-page: 10 year: 2023 ident: bib20 publication-title: Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence doi: 10.1609/aaai.v37i4.25642 – year: 2022 ident: bib42 publication-title: The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022 – year: 2020 ident: bib11 publication-title: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020 – start-page: 56 year: 2023 end-page: 62 ident: bib60 publication-title: Proceedings of the 22nd ACM Workshop on Hot Topics in Networks, HotNets 2023, Cambridge, MA, USA, November 28-29, 2023 doi: 10.1145/3626111.3628189 – start-page: 959 year: 2022 end-page: 971 ident: bib57 publication-title: Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (, Singapore, Singapore,) (ESEC/FSE 2022) doi: 10.1145/3540250.3549101 – year: 2021 ident: bib8 article-title: Evaluating Large Language Models Trained on Code publication-title: CoRR – volume: 43 start-page: 34 issue: 1 year: 2017 end-page: 55 ident: bib62 article-title: Nopol: Automatic Repair of Conditional Statement Bugs in Java Programs publication-title: IEEE Transactions on Software Engineering doi: 10.1109/TSE.2016.2560811 – year: 2020 ident: bib69 article-title: Succinct Explanations With Cascading Decision Trees publication-title: CoRR – start-page: 254 year: 2014 end-page: 265 ident: bib44 publication-title: 36th International Conference on Software Engineering, ICSE ’14, Hyderabad, India - May 31 - June 07, 2014 doi: 10.1145/2568225.2568254 – start-page: 363 year: 2023 end-page: 374 ident: bib35 publication-title: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (, San Francisco, CA, USA,) (ESEC/FSE 2023) doi: 10.1145/3611643.3616306 – start-page: 802 year: 2013 end-page: 811 ident: bib23 publication-title: Proceedings of the 2013 International Conference on Software Engineering (San Francisco, CA, USA) (ICSE ’13) doi: 10.1109/ICSE.2013.6606626 – ident: bib24 publication-title: The BigScience Corpus A 1.6 TB Composite Multilingual Dataset – year: 2022 ident: bib5 publication-title: Coping with Copilot – start-page: 41 year: 2016 end-page: 46 ident: bib22 publication-title: Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education, ITiCSE 2016, Arequipa, Peru, July 9-13, 2016 doi: 10.1145/2899415.2899422 – start-page: 1 year: 2022b end-page: 1 ident: bib27 article-title: Generating Concise Patches for Newly Released Programming Assignments publication-title: IEEE Transactions on Software Engineering doi: 10.1109/TSE.2022.3153522 – year: 2023 ident: bib65 publication-title: The Debugging Book. CISPA Helmholtz Center for Information Security – start-page: 11941 year: 2021 end-page: 11952 ident: bib63 publication-title: Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event (Proceedings of Machine Learning Research, Vol. 139) – year: 2021 ident: bib2 article-title: SYNFIX: Automatically Fixing Syntax Errors using Compiler Diagnostics publication-title: CoRR – start-page: 298 year: 2016 end-page: 312 ident: bib33 publication-title: Proceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (St. Petersburg, FL, USA) (POPL ’16) doi: 10.1145/2837614.2837617 – start-page: 691 year: 2016 end-page: 701 ident: bib37 publication-title: 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE) doi: 10.1145/2884781.2884807 – year: 2023a ident: bib58 publication-title: Conversational Automated Program Repair – volume: 29 start-page: 147 issue: 2 year: 1950 end-page: 160 ident: bib17 article-title: Error detecting and error correcting codes publication-title: The Bell System Technical Journal doi: 10.1002/j.1538-7305.1950.tb00463.x – start-page: 465 year: 2018 end-page: 480 ident: bib15 publication-title: Proceedings of the 39th ACM SIGPLAN Conference on Programming Language Design and Implementation (Philadelphia, PA, USA) (PLDI 2018) doi: 10.1145/3192366.3192387 – start-page: 295 year: 2015 end-page: 306 ident: bib21 publication-title: 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) doi: 10.1109/ASE.2015.60 – start-page: 740 year: 2017 end-page: 751 ident: bib64 publication-title: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering (Paderborn, Germany) (ESEC/FSE 2017) doi: 10.1145/3106237.3106262 – start-page: 390 year: 2021 end-page: 405 ident: bib48 publication-title: Proceedings of the 42nd ACM SIGPLAN International Conference on Programming Language Design and Implementation (Virtual, Canada) (PLDI 2021) doi: 10.1145/3453483.3454051 – start-page: 77 year: 2022 end-page: 88 ident: bib67 publication-title: Proceedings of the 31st ACM SIGSOFT International Symposium on Software Testing and Analysis (Virtual, South Korea) (ISSTA 2022) doi: 10.1145/3533767.3534396 – year: 2022 ident: bib39 publication-title: New GPT-3 Capabilities: Edit & Insert – ident: e_1_2_1_6_1 doi: 10.1145/3180155.3180219 – ident: e_1_2_1_49_1 – ident: e_1_2_1_44_1 doi: 10.1145/2568225.2568254 – ident: e_1_2_1_14_1 doi: 10.1145/3511861.3511863 – ident: e_1_2_1_50_1 doi: 10.1145/2491956.2462195 – volume-title: CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis. In The Eleventh International Conference on Learning Representations. https://openreview.net/forum?id=iaYcJKpY2B_ year: 2023 ident: e_1_2_1_38_1 – volume-title: 8th International Conference on Learning Representations, ICLR 2020 year: 2020 ident: e_1_2_1_11_1 – ident: e_1_2_1_57_1 doi: 10.1145/3540250.3549101 – ident: e_1_2_1_60_1 doi: 10.1145/3626111.3628189 – volume-title: The Debugging Book ident: e_1_2_1_65_1 – ident: e_1_2_1_36_1 doi: 10.1145/3180155.3180247 – ident: e_1_2_1_33_1 doi: 10.1145/2837614.2837617 – ident: e_1_2_1_53_1 doi: 10.1145/3485477 – ident: e_1_2_1_19_1 doi: 10.1109/ASE.2019.00044 – ident: e_1_2_1_23_1 doi: 10.1109/ICSE.2013.6606626 – ident: e_1_2_1_59_1 – ident: e_1_2_1_51_1 doi: 10.1145/3468264.3468598 – ident: e_1_2_1_46_1 doi: 10.1109/ICSE.2017.44 – ident: e_1_2_1_52_1 doi: 10.1145/3593856.3595910 – ident: e_1_2_1_68_1 doi: 10.1145/3485517 – ident: e_1_2_1_43_1 doi: 10.1145/2984043.2989222 – ident: e_1_2_1_55_1 doi: 10.1145/3192366.3192384 – ident: e_1_2_1_56_1 doi: 10.1145/3468264.3468600 – ident: e_1_2_1_21_1 doi: 10.1109/ASE.2015.60 – ident: e_1_2_1_35_1 doi: 10.1145/3611643.3616306 – ident: e_1_2_1_8_1 – ident: e_1_2_1_15_1 doi: 10.1145/3192366.3192387 – ident: e_1_2_1_5_1 – ident: e_1_2_1_12_1 doi: 10.1145/3510003.3510141 – volume-title: The Tenth International Conference on Learning Representations, ICLR 2022 year: 2022 ident: e_1_2_1_42_1 – ident: e_1_2_1_17_1 doi: 10.1002/j.1538-7305.1950.tb00463.x – ident: e_1_2_1_26_1 doi: 10.1145/3318162 – ident: e_1_2_1_10_1 doi: 10.1007/978-3-030-52237-7_9 – ident: e_1_2_1_29_1 doi: 10.48550/ARXIV.2310.09690 – ident: e_1_2_1_47_1 doi: 10.1109/SANER53432.2022.00118 – ident: e_1_2_1_27_1 doi: 10.1109/TSE.2022.3153522 – ident: e_1_2_1_16_1 doi: 10.1145/3578527.3578535 – volume-title: Noah Rose Ledesma, and Premkumar T. Devanbu year: 2021 ident: e_1_2_1_2_1 – volume-title: 6th International Conference on Learning Representations, ICLR year: 2018 ident: e_1_2_1_54_1 – ident: e_1_2_1_24_1 – ident: e_1_2_1_28_1 doi: 10.1126/science.abq1158 – volume-title: FAPR: Fast and Accurate Program Repair for Introductory Programming Courses. CoRR, abs/2107.06550 year: 2021 ident: e_1_2_1_34_1 – ident: e_1_2_1_40_1 doi: 10.1145/3314221.3314629 – ident: e_1_2_1_32_1 doi: 10.1145/2786805.2786811 – ident: e_1_2_1_66_1 doi: 10.1145/3551349.3560425 – ident: e_1_2_1_67_1 doi: 10.1145/3533767.3534396 – ident: e_1_2_1_41_1 doi: 10.5281/zenodo.8115652 – volume-title: Succinct Explanations With Cascading Decision Trees. CoRR, abs/2010.06631 year: 2020 ident: e_1_2_1_69_1 – ident: e_1_2_1_22_1 doi: 10.1145/2899415.2899422 – ident: e_1_2_1_13_1 doi: 10.1109/ICSE48619.2023.00128 – ident: e_1_2_1_25_1 doi: 10.1109/TSE.2011.104 – ident: e_1_2_1_1_1 – volume: 11952 volume-title: Proceedings of the 38th International Conference on Machine Learning, ICML 2021 year: 2021 ident: e_1_2_1_63_1 – ident: e_1_2_1_30_1 doi: 10.1145/3560815 – ident: e_1_2_1_61_1 doi: 10.1109/ASE.2017.8115676 – ident: e_1_2_1_62_1 doi: 10.1109/TSE.2016.2560811 – ident: e_1_2_1_18_1 doi: 10.1145/3472749.3474740 – volume-title: The Twelfth International Conference on Learning Representations. https://openreview.net/forum?id=KuPixIqPiq year: 2024 ident: e_1_2_1_9_1 – ident: e_1_2_1_64_1 doi: 10.1145/3106237.3106262 – ident: e_1_2_1_3_1 doi: 10.1145/3510418 – volume-title: Advances in Neural Information Processing Systems year: 1877 ident: e_1_2_1_7_1 – ident: e_1_2_1_48_1 doi: 10.1145/3453483.3454051 – ident: e_1_2_1_4_1 doi: 10.1145/3183377.3183383 – ident: e_1_2_1_58_1 – ident: e_1_2_1_31_1 doi: 10.1145/3106237.3106253 – ident: e_1_2_1_39_1 – ident: e_1_2_1_20_1 doi: 10.1609/aaai.v37i4.25642 – ident: e_1_2_1_37_1 doi: 10.1145/2884781.2884807 – ident: e_1_2_1_45_1 doi: 10.1145/3485535 |
| SSID | ssj0001934839 |
| Score | 2.427202 |
| Snippet | Students often make mistakes in their introductory programming assignments as part of their learning process. Unfortunately, providing custom repairs for these... |
| SourceID | crossref acm |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 1100 |
| SubjectTerms | Artificial intelligence Computer science education Computing methodologies Social and professional topics |
| SubjectTermsDisplay | Computing methodologies -- Artificial intelligence Social and professional topics -- Computer science education |
| Title | PyDex: Repairing Bugs in Introductory Python Assignments using LLMs |
| URI | https://dl.acm.org/doi/10.1145/3649850 |
| Volume | 8 |
| WOSCitedRecordID | wos001209927600040&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 2475-1421 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001934839 issn: 2475-1421 databaseCode: M~E dateStart: 20170101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LbxMxELZC4cCFRwE1vOQD4rawu_au7d5CAAFK2pUoUm-R7XWqlZJtlGbb9MLP4Pfi17pWVAk4cFlFlr3Ser6MxzPfzADwJlOMmzLmSYkwT3CNRcLqHCcIi0LVhf6rS2qbTZCjI3p6yqrB4FefC3O5IG1Lt1u2-q-i1mNa2CZ19h_EHV6qB_RvLXT91GLXz78SfHX9UW0dz23FG0uv-9CdWdrrV0NLNwVeTWC9ujZlA4x8mjOf6NZZx8FkMr2IbdYqnHGW9jEaT02EwRO7lmZF7_QM9nlwQ3_T39tFcQ6xNoWRzn3swUXptRUrFueBCNQtrlyfKa3Ulk1g5UwcJbeL3RS5Zbd4X4bVZjkmRZJhlw79Tt0y5tUxjVB3fFx9n4yySMGaCnfRYa2tRXz7QYBNzQxUYkaL9Oas6-P7O0dgICa6NO1i5hfeAXdzfaEyLUGmPyPfHUOY2iZ14QtcPrZZ-96vNeaOXEbmTmS3nDwCD_yFA44cUB6DgWr3wcO-mQf0uv0JGFvcHMKAGmhQA5sWxqiBDjUwQg20qIEGNU_Bj8-fTsZfEt9hI-E5IZukFgTTjKdI1pwKpBRH0lRkkxKrUvK8Vtk8mzNVE6IvEoykqkjzudBGpr6UlfMSPQN7rcbNAYCICcJKjhRPKRZKCVQIldWSoFwiLugQ7OvtmK1cDZV-g4fgbb89M-mL0pveKIvZjiSGAIaJ_Tt2pjz_85QX4P4NNl-Cvc26U6_APXm5aS7Wr62QfwOhcHg2 |
| linkProvider | ISSN International Centre |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=PyDex%3A+Repairing+Bugs+in+Introductory+Python+Assignments+using+LLMs&rft.jtitle=Proceedings+of+ACM+on+programming+languages&rft.au=Zhang%2C+Jialu&rft.au=Cambronero%2C+Jos%C3%A9+Pablo&rft.au=Gulwani%2C+Sumit&rft.au=Le%2C+Vu&rft.date=2024-04-29&rft.issn=2475-1421&rft.eissn=2475-1421&rft.volume=8&rft.issue=OOPSLA1&rft.spage=1100&rft.epage=1124&rft_id=info:doi/10.1145%2F3649850&rft.externalDBID=n%2Fa&rft.externalDocID=10_1145_3649850 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2475-1421&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2475-1421&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2475-1421&client=summon |