Do comments and expertise still matter? An experiment on programmers’ adoption of AI-generated JavaScript code
This paper investigates the factors influencing programmers’ adoption of AI-generated JavaScript code recommendations within the context of lightweight, function-level programming tasks. It extends prior research by (1) utilizing objective (as opposed to the typically self-reported) measurements for...
Saved in:
| Published in: | The Journal of systems and software Vol. 231; p. 112634 |
|---|---|
| Main Authors: | , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
Elsevier Inc
01.01.2026
|
| Subjects: | |
| ISSN: | 0164-1212 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | This paper investigates the factors influencing programmers’ adoption of AI-generated JavaScript code recommendations within the context of lightweight, function-level programming tasks. It extends prior research by (1) utilizing objective (as opposed to the typically self-reported) measurements for programmers’ adoption of AI-generated code and (2) examining whether AI-generated comments added to code recommendations and development expertise drive AI-generated code adoption. We tested these potential drivers in an online experiment with 173 programmers. Participants were asked to answer some questions to demonstrate their level of development expertise. Then, they were asked to solve a LeetCode problem without AI support. After attempting to solve the problem on their own, they received an AI-generated solution to assist them in refining their solutions. The solutions provided were manipulated to include or exclude AI-generated comments (a between-subjects factor). Programmers’ adoption of AI-generated code was gauged by code similarity between AI-generated solutions and participants’ submitted solutions, providing a behavioral measurement of code adoption behaviors. Our findings revealed that, within the context of function-level programming tasks, the presence of comments significantly influences programmers’ adoption of AI-generated code regardless of the participants’ development expertise.
•Comments in AI-generated code significantly boost adoption among programmers, regardless of development expertise. Both novice and expert programmers were more likely to integrate AI-generated code when comments were present.•Development expertise does not significantly affect the adoption of AI-generated code, suggesting that supportive code features matter more than expertise alone.•We developed a novel objective measure of AI code adoption by applying PCA to four code similarity metrics. |
|---|---|
| AbstractList | This paper investigates the factors influencing programmers’ adoption of AI-generated JavaScript code recommendations within the context of lightweight, function-level programming tasks. It extends prior research by (1) utilizing objective (as opposed to the typically self-reported) measurements for programmers’ adoption of AI-generated code and (2) examining whether AI-generated comments added to code recommendations and development expertise drive AI-generated code adoption. We tested these potential drivers in an online experiment with 173 programmers. Participants were asked to answer some questions to demonstrate their level of development expertise. Then, they were asked to solve a LeetCode problem without AI support. After attempting to solve the problem on their own, they received an AI-generated solution to assist them in refining their solutions. The solutions provided were manipulated to include or exclude AI-generated comments (a between-subjects factor). Programmers’ adoption of AI-generated code was gauged by code similarity between AI-generated solutions and participants’ submitted solutions, providing a behavioral measurement of code adoption behaviors. Our findings revealed that, within the context of function-level programming tasks, the presence of comments significantly influences programmers’ adoption of AI-generated code regardless of the participants’ development expertise.
•Comments in AI-generated code significantly boost adoption among programmers, regardless of development expertise. Both novice and expert programmers were more likely to integrate AI-generated code when comments were present.•Development expertise does not significantly affect the adoption of AI-generated code, suggesting that supportive code features matter more than expertise alone.•We developed a novel objective measure of AI code adoption by applying PCA to four code similarity metrics. |
| ArticleNumber | 112634 |
| Author | Treude, Christoph Turel, Ofir Li, Changwen |
| Author_xml | – sequence: 1 givenname: Changwen orcidid: 0009-0008-5216-5495 surname: Li fullname: Li, Changwen email: changwenl@student.unimelb.edu.au organization: The University of Melbourne, Grattan Street, Melbourne, 3010, Victoria, Australia – sequence: 2 givenname: Christoph orcidid: 0000-0002-6919-2149 surname: Treude fullname: Treude, Christoph email: ctreude@smu.edu.sg organization: Singapore Management University, 81 Victoria Street, Singapore, 188065, Singapore – sequence: 3 givenname: Ofir orcidid: 0000-0002-6374-6382 surname: Turel fullname: Turel, Ofir email: oturel@unimelb.edu.au organization: The University of Melbourne, Grattan Street, Melbourne, 3010, Victoria, Australia |
| BookMark | eNp9kE1OwzAQhb0oEm3hAOx8gQQ7ceJGLFBV_ooqsQDWlmNPKketHdlWBTuuwfU4CY7CmtVIb96befoWaGadBYSuKMkpofV1n_ch5AUpqpzSoi7ZDM2TzjJa0OIcLULoCSE8GeZouHNYueMRbAxYWo3hYwAfTQAcojkc8FHGCP4Wr-20MqMVO4sH7_ZepqQPP1_fWGo3RJN01-H1NtuDBS8jaPwsT_JVeTPE9EjDBTrr5CHA5d9coveH-7fNU7Z7edxu1rtMFQ2LWQVVo0rOaFfrVnLFWVNLXivelStaVi3lUrKikc2KglZdzUrFWKvqtmWcVAzKJaLTXeVdCB46MaTu0n8KSsSISfQiYRIjJjFhSpmbKQOp2MmAF0EZsAq08aCi0M78k_4Fav52lQ |
| Cites_doi | 10.1145/3487569 10.61187/ita.v1i1.19 10.1109/COMPSAC57700.2023.00117 10.1016/j.jbef.2017.12.004 10.1109/MS.2021.3061664 10.1007/s10664-007-9040-x 10.1023/A:1019637632584 10.1145/362566.362568 10.1037/0003-066X.44.9.1175 10.1109/TSE.2020.3003413 10.1111/apps.12117 10.5116/ijme.4dfb.8dfd 10.2307/30036540 10.1207/s15327906mbr0102_10 10.1145/3586030 10.1007/s13218-020-00689-0 10.1016/j.obhdp.2018.12.005 10.1080/10408340500526766 10.1007/978-3-319-00539-3_9 10.1002/bdm.2195 10.1177/001316445901900314 10.1109/TSE.2016.2527791 10.1016/j.clinph.2004.11.025 10.1017/S1930297500001248 10.1007/s10209-014-0348-1 10.1080/08993400412331363843 10.1145/3652154 10.1126/science.abq1158 10.1145/3287324.3293714 10.1007/s11121-008-0109-6 10.1007/BF02291575 10.1207/s15327906mbr0403_8 10.1016/j.jebo.2023.05.008 |
| ContentType | Journal Article |
| Copyright | 2025 |
| Copyright_xml | – notice: 2025 |
| DBID | 6I. AAFTH AAYXX CITATION |
| DOI | 10.1016/j.jss.2025.112634 |
| DatabaseName | ScienceDirect Open Access Titles Elsevier:ScienceDirect:Open Access CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| ExternalDocumentID | 10_1016_j_jss_2025_112634 S0164121225003036 |
| GroupedDBID | --K --M -~X .DC .~1 0R~ 1B1 1~. 1~5 29L 4.4 457 4G. 5GY 5VS 6I. 7-5 71M 8P~ 9DU 9JN 9M8 AABNK AAEDT AAEDW AAFTH AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AATTM AAXKI AAXUO AAYFN AAYWO ABBOA ABDPE ABEFU ABFNM ABFRF ABFSI ABJNI ABMAC ABWVN ABXDB ACDAQ ACGFO ACGFS ACGOD ACLOT ACNNM ACRLP ACRPL ACVFH ACZNC ADBBV ADCNI ADEZE ADHUB ADJOM ADMUD ADNMO AEBSH AEFWE AEIPS AEKER AENEX AEUPX AFJKZ AFPUW AFTJW AGHFR AGQPQ AGUBO AGYEJ AHHHB AHZHX AI. AIALX AIEXJ AIGII AIIUN AIKHN AITUG AKBMS AKRWK AKYEP ALMA_UNASSIGNED_HOLDINGS AMRAJ ANKPU AOUOD APXCP ASPBG AVWKF AXJTR AZFZN BKOJK BKOMP BLXMC CS3 DU5 E.L EBS EFJIC EFKBS EFLBG EJD EO8 EO9 EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FYGXN G-Q GBLVA GBOLZ HLZ HVGLF HZ~ IHE J1W KOM LG9 M41 MO0 MS~ N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PQQKQ Q38 R2- RNS ROL RPZ RXW SBC SDF SDG SDP SES SEW SPC SPCBC SSV SSZ T5K TAE TN5 TWZ UHS UNMZH VH1 WUQ XPP ZMT ZY4 ~G- ~HD AAYXX CITATION |
| ID | FETCH-LOGICAL-c294t-5e59c3741f6dba7c7496a76c7f38135b17aa429a981edcf643c44bc6bb47054e3 |
| ISICitedReferencesCount | 0 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001586689500001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0164-1212 |
| IngestDate | Sat Nov 29 07:03:17 EST 2025 Sat Nov 22 16:51:27 EST 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Technology adoption Empirical software engineering AI programming assistant Human–computer interaction |
| Language | English |
| License | This is an open access article under the CC BY license. |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c294t-5e59c3741f6dba7c7496a76c7f38135b17aa429a981edcf643c44bc6bb47054e3 |
| ORCID | 0009-0008-5216-5495 0000-0002-6374-6382 0000-0002-6919-2149 |
| OpenAccessLink | https://dx.doi.org/10.1016/j.jss.2025.112634 |
| ParticipantIDs | crossref_primary_10_1016_j_jss_2025_112634 elsevier_sciencedirect_doi_10_1016_j_jss_2025_112634 |
| PublicationCentury | 2000 |
| PublicationDate | January 2026 2026-01-00 |
| PublicationDateYYYYMMDD | 2026-01-01 |
| PublicationDate_xml | – month: 01 year: 2026 text: January 2026 |
| PublicationDecade | 2020 |
| PublicationTitle | The Journal of systems and software |
| PublicationYear | 2026 |
| Publisher | Elsevier Inc |
| Publisher_xml | – name: Elsevier Inc |
| References | Bader, Seohyun Kim, Sifei Luan, Chandra, Meijer (b3) 2021; 38 Logg, Minson, Moore (b30) 2019; 151 Microsoft (b34) 2024 Tavakol, Dennick (b53) 2011; 2 Amoozadeh, Daniels, Nam, Kumar, Chen, Hilton, Srinivasa Ragavan, Alipour (b1) 2024 Asuero, González (b2) 2006; 36 Lawrie, Morrell, Feild, Binkley (b27) 2006 Takang, Grubb, Macredie (b51) 1996; 4 García-Avilés (b20) 2020 Kolodziej, S., 2019. Empirical Assessment of Software Documentation Strategies: A Randomized Controlled Trial. In: Proceedings of the 50th ACM Technical Symposium on Computer Science Education. pp. 1296–1295. Russo, Stol (b46) 2020; 48 Börstler, Paech (b7) 2016; 42 Kaiser (b23) 1959; 19 Pearce, Ahmad, Tan, Dolan-Gavitt, Karri (b42) 2022 Liang, Yang, Myers (b29) 2024 Li, Choi, Chung, Kushman, Schrittwieser, Leblond, Eccles, Keeling, Gimeno, Lago, Hubert, Choy, de Masson d’Autume, Babuschkin, Chen, Huang, Welbl, Gowal, Cherepanov, Molloy, Mankowitz, Robson, Kohli, de Freitas, Kavukcuoglu, Vinyals (b28) 2022; 378 Sreejesh, Mohapatra, Anusree, Sreejesh, Mohapatra, Anusree (b50) 2014 Chan (b10) 2010 Manna, Waldinger (b31) 1971; 14 Lancaster, Culwin (b26) 2004; 14 Czarnitzki, Fernández, Rammer (b13) 2023; 211 Xu, Vasilescu, Neubig (b59) 2022; 31 Ge, Wu (b21) 2023; 1 Venkatesh, Morris, Davis, Davis (b57) 2003 Feng, Y., Vanam, S., Cherukupally, M., Zheng, W., Qiu, M., Chen, H., 2023. Investigating Code Generation Performance of Chat-GPT with Crowdsourcing Social Data. In: Proceedings of the 47th IEEE Computer Software and Applications Conference. pp. 1–10. Nguyen, Nadi (b39) 2022 Schild, Lilleholt, Zettler (b47) 2021; 34 Mooi, Sarstedt, Mooi-Reci (b36) 2018 Prechelt, Malpohl, Philippsen (b43) 2002; 8 Harper (b22) 2023 Nascimento, Alencar, Cowan (b37) 2023 Marangunić, Granić (b32) 2015; 14 Mohagheghi, Conradi (b35) 2007; 12 Van de Mortel (b56) 2008; 25 Del Sole, Sole (b14) 2019 Fairchild, MacKinnon (b18) 2009; 10 Nurvitadhi, Leung, Cook (b40) 2003; vol. 1 Cunningham, Ghahramani (b12) 2015; 16 Schleimer, Wilkerson, Aiken (b48) 2003 Nguyen, Nadi (b38) 2022 Donaldson, Grant-Vallone (b17) 2002; 17 Baltes, Diehl (b4) 2018 Sindermann, Sha, Zhou, Wernicke, Schmitt, Li, Sariyska, Stavrou, Becker, Montag (b49) 2021; 35 DeSimone, DeSimone, Harms, Wood (b15) 2018; 67 Kaiser (b24) 1974; 39 Russo (b44) 2024; 33 Cattell (b9) 1966; 1 Dien, Beal, Berg (b16) 2005; 116 Tobias, Carlson (b54) 1969; 4 Vaithilingam, Zhang, Glassman (b55) 2022 Wagner, Wyrich (b58) 2022; 48 Brase (b8) 2009; 4 Tan (b52) 2015 Chen, Tworek, Jun, Yuan, de Oliveira Pinto, Kaplan, Edwards, Burda, Joseph, Brockman, Ray, Puri, Krueger, Petrov, Khlaaf, Sastry, Mishkin, Chan, Gray, Ryder, Pavlov, Power, Kaiser, Bavarian, Winter, Tillet, Such, Cummings, Plappert, Chantzis, Barnes, Herbert-Voss, Guss, Nichol, Paino, Tezak, Tang, Babuschkin, Balaji, Jain, Saunders, Hesse, Carr, Leike, Achiam, Misra, Morikawa, Radford, Knight, Brundage, Murati, Mayer, Welinder, McGrew, Amodei, McCandlish, Sutskever, Zaremba (b11) 2021 Martin (b33) 2009 Russo, Hanel, Altnickel, Van Berkel (b45) 2021 Bandura (b5) 1989; 44 Barke, James, Polikarpova (b6) 2023; 7 Palan, Schitter (b41) 2018; 17 Li (10.1016/j.jss.2025.112634_b28) 2022; 378 Liang (10.1016/j.jss.2025.112634_b29) 2024 Baltes (10.1016/j.jss.2025.112634_b4) 2018 Schleimer (10.1016/j.jss.2025.112634_b48) 2003 Fairchild (10.1016/j.jss.2025.112634_b18) 2009; 10 Tan (10.1016/j.jss.2025.112634_b52) 2015 Cunningham (10.1016/j.jss.2025.112634_b12) 2015; 16 Dien (10.1016/j.jss.2025.112634_b16) 2005; 116 Amoozadeh (10.1016/j.jss.2025.112634_b1) 2024 Nguyen (10.1016/j.jss.2025.112634_b38) 2022 Bader (10.1016/j.jss.2025.112634_b3) 2021; 38 Prechelt (10.1016/j.jss.2025.112634_b43) 2002; 8 Van de Mortel (10.1016/j.jss.2025.112634_b56) 2008; 25 Mooi (10.1016/j.jss.2025.112634_b36) 2018 Logg (10.1016/j.jss.2025.112634_b30) 2019; 151 Schild (10.1016/j.jss.2025.112634_b47) 2021; 34 Kaiser (10.1016/j.jss.2025.112634_b23) 1959; 19 Russo (10.1016/j.jss.2025.112634_b44) 2024; 33 Manna (10.1016/j.jss.2025.112634_b31) 1971; 14 Lancaster (10.1016/j.jss.2025.112634_b26) 2004; 14 Czarnitzki (10.1016/j.jss.2025.112634_b13) 2023; 211 Donaldson (10.1016/j.jss.2025.112634_b17) 2002; 17 Asuero (10.1016/j.jss.2025.112634_b2) 2006; 36 Pearce (10.1016/j.jss.2025.112634_b42) 2022 Barke (10.1016/j.jss.2025.112634_b6) 2023; 7 Ge (10.1016/j.jss.2025.112634_b21) 2023; 1 Russo (10.1016/j.jss.2025.112634_b45) 2021 Takang (10.1016/j.jss.2025.112634_b51) 1996; 4 Börstler (10.1016/j.jss.2025.112634_b7) 2016; 42 10.1016/j.jss.2025.112634_b25 Xu (10.1016/j.jss.2025.112634_b59) 2022; 31 Chan (10.1016/j.jss.2025.112634_b10) 2010 Venkatesh (10.1016/j.jss.2025.112634_b57) 2003 Vaithilingam (10.1016/j.jss.2025.112634_b55) 2022 Nascimento (10.1016/j.jss.2025.112634_b37) 2023 García-Avilés (10.1016/j.jss.2025.112634_b20) 2020 Microsoft (10.1016/j.jss.2025.112634_b34) 2024 Sindermann (10.1016/j.jss.2025.112634_b49) 2021; 35 Tobias (10.1016/j.jss.2025.112634_b54) 1969; 4 Chen (10.1016/j.jss.2025.112634_b11) 2021 Harper (10.1016/j.jss.2025.112634_b22) 2023 Marangunić (10.1016/j.jss.2025.112634_b32) 2015; 14 Tavakol (10.1016/j.jss.2025.112634_b53) 2011; 2 Nurvitadhi (10.1016/j.jss.2025.112634_b40) 2003; vol. 1 Kaiser (10.1016/j.jss.2025.112634_b24) 1974; 39 10.1016/j.jss.2025.112634_b19 Del Sole (10.1016/j.jss.2025.112634_b14) 2019 Brase (10.1016/j.jss.2025.112634_b8) 2009; 4 Nguyen (10.1016/j.jss.2025.112634_b39) 2022 Lawrie (10.1016/j.jss.2025.112634_b27) 2006 Sreejesh (10.1016/j.jss.2025.112634_b50) 2014 Palan (10.1016/j.jss.2025.112634_b41) 2018; 17 DeSimone (10.1016/j.jss.2025.112634_b15) 2018; 67 Martin (10.1016/j.jss.2025.112634_b33) 2009 Mohagheghi (10.1016/j.jss.2025.112634_b35) 2007; 12 Bandura (10.1016/j.jss.2025.112634_b5) 1989; 44 Cattell (10.1016/j.jss.2025.112634_b9) 1966; 1 Wagner (10.1016/j.jss.2025.112634_b58) 2022; 48 Russo (10.1016/j.jss.2025.112634_b46) 2020; 48 |
| References_xml | – volume: 1 start-page: 21 year: 2023 end-page: 29 ident: b21 article-title: An empirical study of adoption of ChatGPT for bug fixing among professional developers publication-title: Innov. Technol. Adv. – volume: 39 start-page: 31 year: 1974 end-page: 36 ident: b24 article-title: An index of factorial simplicity publication-title: Psychometrika – volume: 14 start-page: 101 year: 2004 end-page: 112 ident: b26 article-title: A comparison of source code plagiarism detection engines publication-title: Comput. Sci. Educ. – volume: 19 start-page: 413 year: 1959 end-page: 420 ident: b23 article-title: Computer program for varimax rotation in factor analysis publication-title: Educ. Psychol. Meas. – start-page: 187 year: 2018 end-page: 200 ident: b4 article-title: Towards a theory of software development expertise publication-title: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering – start-page: 265 year: 2018 end-page: 311 ident: b36 article-title: Principal component and factor analysis publication-title: Market Research: The Process, Data, and Methods using Stata – volume: 2 start-page: 53 year: 2011 ident: b53 article-title: Making sense of Cronbach’s alpha publication-title: Int. J. Med. Educ. – year: 2024 ident: b34 article-title: Monaco - the editor of the web – start-page: 329 year: 2010 end-page: 356 ident: b10 article-title: So why ask me? Are self-report data really that bad? publication-title: Statistical and Methodological Myths and Urban Legends – volume: 378 start-page: 1092 year: 2022 end-page: 1097 ident: b28 article-title: Competition-level code generation with AlphaCode publication-title: Science – volume: 16 start-page: 2859 year: 2015 end-page: 2900 ident: b12 article-title: Linear dimensionality reduction: Survey, insights, and generalizations publication-title: J. Mach. Learn. Res. – start-page: 425 year: 2003 end-page: 478 ident: b57 article-title: User acceptance of information technology: Toward a unified view publication-title: MIS Q. – volume: 48 start-page: 819 year: 2020 end-page: 834 ident: b46 article-title: Gender differences in personality traits of software engineers publication-title: IEEE Trans. Softw. Eng. – start-page: 364 year: 2021 end-page: 373 ident: b45 article-title: The daily life of software engineers during the covid-19 pandemic publication-title: 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice – year: 2021 ident: b11 article-title: Evaluating large language models trained on code – volume: 42 start-page: 886 year: 2016 end-page: 898 ident: b7 article-title: The role of method chains and comments in software readability and comprehension—an experiment publication-title: IEEE Trans. Softw. Eng. – volume: 33 year: 2024 ident: b44 article-title: Navigating the complexity of generative ai adoption in software engineering publication-title: ACM Trans. Softw. Eng. Methodol. – start-page: 76 year: 2003 end-page: 85 ident: b48 article-title: Winnowing: local algorithms for document fingerprinting publication-title: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data – volume: 34 start-page: 157 year: 2021 end-page: 166 ident: b47 article-title: Behavior in cheating paradigms is linked to overall approval rates of crowdworkers publication-title: J. Behav. Decis. Mak. – volume: 14 start-page: 81 year: 2015 end-page: 95 ident: b32 article-title: Technology acceptance model: a literature review from 1986 to 2013 publication-title: Univers. Access inf. Soc. – volume: 4 start-page: 375 year: 1969 end-page: 377 ident: b54 article-title: Brief report: Bartlett’s test of sphericity and chance findings in factor analysis publication-title: Multivar. Behav. Res. – volume: 44 start-page: 1175 year: 1989 ident: b5 article-title: Human agency in social cognitive theory publication-title: Am. Psychol. – year: 2022 ident: b55 article-title: Expectation vs. Experience: Evaluating the usability of code generation tools powered by large language models publication-title: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems – reference: Feng, Y., Vanam, S., Cherukupally, M., Zheng, W., Qiu, M., Chen, H., 2023. Investigating Code Generation Performance of Chat-GPT with Crowdsourcing Social Data. In: Proceedings of the 47th IEEE Computer Software and Applications Conference. pp. 1–10. – volume: 151 start-page: 90 year: 2019 end-page: 103 ident: b30 article-title: Algorithm appreciation: People prefer algorithmic to human judgment publication-title: Organ. Behav. Hum. Decis. Process. – start-page: 207 year: 2014 end-page: 228 ident: b50 article-title: Exploratory factor and principal component analysis publication-title: Bus. Res. Methods: Appl. Orientat. – start-page: 24 year: 2023 end-page: 33 ident: b37 article-title: Artificial intelligence vs. Software engineers: An empirical study on performance and efficiency using ChatGPT publication-title: Proceedings of the 33rd Annual International Conference on Computer Science and Software Engineering – volume: 4 start-page: 143 year: 1996 end-page: 167 ident: b51 article-title: The effects of comments and identifier names on program comprehensibility: an experimental investigation publication-title: J. Prog. Lang. – volume: 4 start-page: 419 year: 2009 end-page: 428 ident: b8 article-title: How different types of participant payments alter task performance publication-title: Judgm. Decis. Mak. – volume: 10 start-page: 87 year: 2009 end-page: 99 ident: b18 article-title: A general model for testing mediation and moderation effects publication-title: Prev. Sci. – start-page: 1 year: 2022 end-page: 5 ident: b39 article-title: An empirical evaluation of GitHub copilot’s code suggestions publication-title: Proceedings of the 19th International Conference on Mining Software Repositories – volume: 35 start-page: 109 year: 2021 end-page: 118 ident: b49 article-title: Assessing the attitude towards artificial intelligence: Introduction of a short measure in german, Chinese, and english language publication-title: KI-Künstliche Intell. – start-page: 1 year: 2020 end-page: 8 ident: b20 article-title: Diffusion of innovation publication-title: Int. Encycl. Media Psychol. – volume: 17 start-page: 22 year: 2018 end-page: 27 ident: b41 article-title: Prolific. ac—A subject pool for online experiments publication-title: J. Behav. Exp. Financ. – start-page: 493 year: 2015 end-page: 517 ident: b52 article-title: Code comment analysis for improving software quality publication-title: The Art and Science of Analyzing Software Data – start-page: 3 year: 2006 end-page: 12 ident: b27 article-title: What’s in a name? A study of identifiers publication-title: 14th IEEE International Conference on Program Comprehension – volume: 67 start-page: 309 year: 2018 end-page: 338 ident: b15 article-title: The differential impacts of two forms of insufficient effort responding publication-title: Appl. Psychol. – volume: vol. 1 year: 2003 ident: b40 article-title: Do class comments aid java program understanding? publication-title: 33rd Annual Frontiers in Education, 2003 – start-page: IX, 63 year: 2023 ident: b22 article-title: A Software Engineer’s Guide to Seniority: A Guide to Technical Leadership – volume: 48 start-page: 4789 year: 2022 end-page: 4801 ident: b58 article-title: Code comprehension confounders: A study of intelligence and personality publication-title: IEEE Trans. Softw. Eng. – start-page: 67 year: 2024 end-page: 73 ident: b1 article-title: Trust in generative AI among students: An exploratory study publication-title: Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1 – reference: Kolodziej, S., 2019. Empirical Assessment of Software Documentation Strategies: A Randomized Controlled Trial. In: Proceedings of the 50th ACM Technical Symposium on Computer Science Education. pp. 1296–1295. – volume: 7 year: 2023 ident: b6 article-title: Grounded copilot: How programmers interact with code-generating models publication-title: Proc. ACM Program. Lang. – year: 2009 ident: b33 article-title: CLean Code: a Handbook of Agile Software Craftsmanship – volume: 211 start-page: 188 year: 2023 end-page: 205 ident: b13 article-title: Artificial intelligence and firm-level productivity publication-title: J. Econ. Behav. Organ. – volume: 31 year: 2022 ident: b59 article-title: In-IDE code generation from natural language: Promise and challenges publication-title: ACM Trans. Softw. Eng. Methodol. – year: 2024 ident: b29 article-title: A large-scale survey on the usability of AI programming assistants: Successes and challenges publication-title: Proceedings of the IEEE/ACM 46th International Conference on Software Engineering – start-page: 1 year: 2022 end-page: 5 ident: b38 article-title: An empirical evaluation of GitHub copilot’s code suggestions publication-title: Proceedings of the 19th International Conference on Mining Software Repositories – year: 2019 ident: b14 article-title: Visual Studio Code Distilled – volume: 12 start-page: 471 year: 2007 end-page: 516 ident: b35 article-title: Quality, productivity and economic benefits of software reuse: a review of industrial studies publication-title: Empir. Softw. Eng. – volume: 8 start-page: 1016 year: 2002 ident: b43 article-title: Finding plagiarisms among a set of programs with JPlag publication-title: J. Univers. Comput. Sci. – volume: 14 start-page: 151 year: 1971 end-page: 165 ident: b31 article-title: Toward automatic program synthesis publication-title: Commun. ACM – volume: 17 start-page: 245 year: 2002 end-page: 260 ident: b17 article-title: Understanding self-report bias in organizational behavior research publication-title: J. Bus. Psychol. – volume: 1 start-page: 245 year: 1966 end-page: 276 ident: b9 article-title: The scree test for the number of factors publication-title: Multivar. Behav. Res. – volume: 36 start-page: 41 year: 2006 end-page: 59 ident: b2 article-title: The correlation coefficient: An overview publication-title: Crit. Rev. Anal. Chem. – start-page: 754 year: 2022 end-page: 768 ident: b42 article-title: Asleep at the keyboard? assessing the security of github copilot’s code contributions publication-title: 2022 IEEE Symposium on Security and Privacy – volume: 116 start-page: 1808 year: 2005 end-page: 1825 ident: b16 article-title: Optimizing principal components analysis of event-related potentials: matrix type, factor loading weighting, extraction, and rotations publication-title: Clin. Neurophysiol. – volume: 25 start-page: 40 year: 2008 end-page: 48 ident: b56 article-title: Faking it: social desirability response bias in self-report research publication-title: Aust. J. Adv. Nurs. – volume: 38 start-page: 52 year: 2021 end-page: 61 ident: b3 article-title: AI in software engineering at facebook publication-title: IEEE Softw. – volume: 31 issue: 2 year: 2022 ident: 10.1016/j.jss.2025.112634_b59 article-title: In-IDE code generation from natural language: Promise and challenges publication-title: ACM Trans. Softw. Eng. Methodol. doi: 10.1145/3487569 – start-page: 1 year: 2022 ident: 10.1016/j.jss.2025.112634_b39 article-title: An empirical evaluation of GitHub copilot’s code suggestions – volume: 16 start-page: 2859 issue: 1 year: 2015 ident: 10.1016/j.jss.2025.112634_b12 article-title: Linear dimensionality reduction: Survey, insights, and generalizations publication-title: J. Mach. Learn. Res. – volume: 1 start-page: 21 issue: 1 year: 2023 ident: 10.1016/j.jss.2025.112634_b21 article-title: An empirical study of adoption of ChatGPT for bug fixing among professional developers publication-title: Innov. Technol. Adv. doi: 10.61187/ita.v1i1.19 – start-page: 329 year: 2010 ident: 10.1016/j.jss.2025.112634_b10 article-title: So why ask me? Are self-report data really that bad? – year: 2019 ident: 10.1016/j.jss.2025.112634_b14 – ident: 10.1016/j.jss.2025.112634_b19 doi: 10.1109/COMPSAC57700.2023.00117 – volume: 17 start-page: 22 year: 2018 ident: 10.1016/j.jss.2025.112634_b41 article-title: Prolific. ac—A subject pool for online experiments publication-title: J. Behav. Exp. Financ. doi: 10.1016/j.jbef.2017.12.004 – volume: 38 start-page: 52 issue: 4 year: 2021 ident: 10.1016/j.jss.2025.112634_b3 article-title: AI in software engineering at facebook publication-title: IEEE Softw. doi: 10.1109/MS.2021.3061664 – volume: 12 start-page: 471 year: 2007 ident: 10.1016/j.jss.2025.112634_b35 article-title: Quality, productivity and economic benefits of software reuse: a review of industrial studies publication-title: Empir. Softw. Eng. doi: 10.1007/s10664-007-9040-x – volume: 4 start-page: 143 issue: 3 year: 1996 ident: 10.1016/j.jss.2025.112634_b51 article-title: The effects of comments and identifier names on program comprehensibility: an experimental investigation publication-title: J. Prog. Lang. – volume: 25 start-page: 40 issue: 4 year: 2008 ident: 10.1016/j.jss.2025.112634_b56 article-title: Faking it: social desirability response bias in self-report research publication-title: Aust. J. Adv. Nurs. – year: 2024 ident: 10.1016/j.jss.2025.112634_b29 article-title: A large-scale survey on the usability of AI programming assistants: Successes and challenges – volume: 17 start-page: 245 year: 2002 ident: 10.1016/j.jss.2025.112634_b17 article-title: Understanding self-report bias in organizational behavior research publication-title: J. Bus. Psychol. doi: 10.1023/A:1019637632584 – volume: 14 start-page: 151 issue: 3 year: 1971 ident: 10.1016/j.jss.2025.112634_b31 article-title: Toward automatic program synthesis publication-title: Commun. ACM doi: 10.1145/362566.362568 – volume: 44 start-page: 1175 issue: 9 year: 1989 ident: 10.1016/j.jss.2025.112634_b5 article-title: Human agency in social cognitive theory publication-title: Am. Psychol. doi: 10.1037/0003-066X.44.9.1175 – start-page: 187 year: 2018 ident: 10.1016/j.jss.2025.112634_b4 article-title: Towards a theory of software development expertise – start-page: 1 year: 2022 ident: 10.1016/j.jss.2025.112634_b38 article-title: An empirical evaluation of GitHub copilot’s code suggestions – volume: 8 start-page: 1016 issue: 11 year: 2002 ident: 10.1016/j.jss.2025.112634_b43 article-title: Finding plagiarisms among a set of programs with JPlag publication-title: J. Univers. Comput. Sci. – year: 2024 ident: 10.1016/j.jss.2025.112634_b34 – volume: 48 start-page: 819 issue: 3 year: 2020 ident: 10.1016/j.jss.2025.112634_b46 article-title: Gender differences in personality traits of software engineers publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2020.3003413 – start-page: 265 year: 2018 ident: 10.1016/j.jss.2025.112634_b36 article-title: Principal component and factor analysis – volume: 67 start-page: 309 issue: 2 year: 2018 ident: 10.1016/j.jss.2025.112634_b15 article-title: The differential impacts of two forms of insufficient effort responding publication-title: Appl. Psychol. doi: 10.1111/apps.12117 – start-page: 3 year: 2006 ident: 10.1016/j.jss.2025.112634_b27 article-title: What’s in a name? A study of identifiers – volume: 2 start-page: 53 year: 2011 ident: 10.1016/j.jss.2025.112634_b53 article-title: Making sense of Cronbach’s alpha publication-title: Int. J. Med. Educ. doi: 10.5116/ijme.4dfb.8dfd – start-page: 493 year: 2015 ident: 10.1016/j.jss.2025.112634_b52 article-title: Code comment analysis for improving software quality – start-page: 425 year: 2003 ident: 10.1016/j.jss.2025.112634_b57 article-title: User acceptance of information technology: Toward a unified view publication-title: MIS Q. doi: 10.2307/30036540 – volume: 1 start-page: 245 issue: 2 year: 1966 ident: 10.1016/j.jss.2025.112634_b9 article-title: The scree test for the number of factors publication-title: Multivar. Behav. Res. doi: 10.1207/s15327906mbr0102_10 – volume: 7 issue: OOPSLA1 year: 2023 ident: 10.1016/j.jss.2025.112634_b6 article-title: Grounded copilot: How programmers interact with code-generating models publication-title: Proc. ACM Program. Lang. doi: 10.1145/3586030 – start-page: 364 year: 2021 ident: 10.1016/j.jss.2025.112634_b45 article-title: The daily life of software engineers during the covid-19 pandemic – year: 2021 ident: 10.1016/j.jss.2025.112634_b11 – volume: 35 start-page: 109 year: 2021 ident: 10.1016/j.jss.2025.112634_b49 article-title: Assessing the attitude towards artificial intelligence: Introduction of a short measure in german, Chinese, and english language publication-title: KI-Künstliche Intell. doi: 10.1007/s13218-020-00689-0 – start-page: 24 year: 2023 ident: 10.1016/j.jss.2025.112634_b37 article-title: Artificial intelligence vs. Software engineers: An empirical study on performance and efficiency using ChatGPT – year: 2022 ident: 10.1016/j.jss.2025.112634_b55 article-title: Expectation vs. Experience: Evaluating the usability of code generation tools powered by large language models – volume: 151 start-page: 90 year: 2019 ident: 10.1016/j.jss.2025.112634_b30 article-title: Algorithm appreciation: People prefer algorithmic to human judgment publication-title: Organ. Behav. Hum. Decis. Process. doi: 10.1016/j.obhdp.2018.12.005 – volume: 36 start-page: 41 issue: 1 year: 2006 ident: 10.1016/j.jss.2025.112634_b2 article-title: The correlation coefficient: An overview publication-title: Crit. Rev. Anal. Chem. doi: 10.1080/10408340500526766 – start-page: 207 year: 2014 ident: 10.1016/j.jss.2025.112634_b50 article-title: Exploratory factor and principal component analysis publication-title: Bus. Res. Methods: Appl. Orientat. doi: 10.1007/978-3-319-00539-3_9 – start-page: 754 year: 2022 ident: 10.1016/j.jss.2025.112634_b42 article-title: Asleep at the keyboard? assessing the security of github copilot’s code contributions – volume: 34 start-page: 157 issue: 2 year: 2021 ident: 10.1016/j.jss.2025.112634_b47 article-title: Behavior in cheating paradigms is linked to overall approval rates of crowdworkers publication-title: J. Behav. Decis. Mak. doi: 10.1002/bdm.2195 – volume: 19 start-page: 413 issue: 3 year: 1959 ident: 10.1016/j.jss.2025.112634_b23 article-title: Computer program for varimax rotation in factor analysis publication-title: Educ. Psychol. Meas. doi: 10.1177/001316445901900314 – volume: 42 start-page: 886 issue: 9 year: 2016 ident: 10.1016/j.jss.2025.112634_b7 article-title: The role of method chains and comments in software readability and comprehension—an experiment publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2016.2527791 – volume: 116 start-page: 1808 issue: 8 year: 2005 ident: 10.1016/j.jss.2025.112634_b16 article-title: Optimizing principal components analysis of event-related potentials: matrix type, factor loading weighting, extraction, and rotations publication-title: Clin. Neurophysiol. doi: 10.1016/j.clinph.2004.11.025 – start-page: 76 year: 2003 ident: 10.1016/j.jss.2025.112634_b48 article-title: Winnowing: local algorithms for document fingerprinting – volume: 4 start-page: 419 issue: 5 year: 2009 ident: 10.1016/j.jss.2025.112634_b8 article-title: How different types of participant payments alter task performance publication-title: Judgm. Decis. Mak. doi: 10.1017/S1930297500001248 – volume: vol. 1 year: 2003 ident: 10.1016/j.jss.2025.112634_b40 article-title: Do class comments aid java program understanding? – volume: 14 start-page: 81 year: 2015 ident: 10.1016/j.jss.2025.112634_b32 article-title: Technology acceptance model: a literature review from 1986 to 2013 publication-title: Univers. Access inf. Soc. doi: 10.1007/s10209-014-0348-1 – volume: 14 start-page: 101 issue: 2 year: 2004 ident: 10.1016/j.jss.2025.112634_b26 article-title: A comparison of source code plagiarism detection engines publication-title: Comput. Sci. Educ. doi: 10.1080/08993400412331363843 – volume: 33 issue: 5 year: 2024 ident: 10.1016/j.jss.2025.112634_b44 article-title: Navigating the complexity of generative ai adoption in software engineering publication-title: ACM Trans. Softw. Eng. Methodol. doi: 10.1145/3652154 – start-page: IX, 63 year: 2023 ident: 10.1016/j.jss.2025.112634_b22 – volume: 378 start-page: 1092 issue: 6624 year: 2022 ident: 10.1016/j.jss.2025.112634_b28 article-title: Competition-level code generation with AlphaCode publication-title: Science doi: 10.1126/science.abq1158 – year: 2009 ident: 10.1016/j.jss.2025.112634_b33 – ident: 10.1016/j.jss.2025.112634_b25 doi: 10.1145/3287324.3293714 – start-page: 67 year: 2024 ident: 10.1016/j.jss.2025.112634_b1 article-title: Trust in generative AI among students: An exploratory study – volume: 10 start-page: 87 year: 2009 ident: 10.1016/j.jss.2025.112634_b18 article-title: A general model for testing mediation and moderation effects publication-title: Prev. Sci. doi: 10.1007/s11121-008-0109-6 – volume: 48 start-page: 4789 issue: 12 year: 2022 ident: 10.1016/j.jss.2025.112634_b58 article-title: Code comprehension confounders: A study of intelligence and personality publication-title: IEEE Trans. Softw. Eng. – volume: 39 start-page: 31 issue: 1 year: 1974 ident: 10.1016/j.jss.2025.112634_b24 article-title: An index of factorial simplicity publication-title: Psychometrika doi: 10.1007/BF02291575 – volume: 4 start-page: 375 issue: 3 year: 1969 ident: 10.1016/j.jss.2025.112634_b54 article-title: Brief report: Bartlett’s test of sphericity and chance findings in factor analysis publication-title: Multivar. Behav. Res. doi: 10.1207/s15327906mbr0403_8 – volume: 211 start-page: 188 year: 2023 ident: 10.1016/j.jss.2025.112634_b13 article-title: Artificial intelligence and firm-level productivity publication-title: J. Econ. Behav. Organ. doi: 10.1016/j.jebo.2023.05.008 – start-page: 1 year: 2020 ident: 10.1016/j.jss.2025.112634_b20 article-title: Diffusion of innovation publication-title: Int. Encycl. Media Psychol. |
| SSID | ssj0007202 |
| Score | 2.4506233 |
| Snippet | This paper investigates the factors influencing programmers’ adoption of AI-generated JavaScript code recommendations within the context of lightweight,... |
| SourceID | crossref elsevier |
| SourceType | Index Database Publisher |
| StartPage | 112634 |
| SubjectTerms | AI programming assistant Empirical software engineering Human–computer interaction Technology adoption |
| Title | Do comments and expertise still matter? An experiment on programmers’ adoption of AI-generated JavaScript code |
| URI | https://dx.doi.org/10.1016/j.jss.2025.112634 |
| Volume | 231 |
| WOSCitedRecordID | wos001586689500001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 issn: 0164-1212 databaseCode: AIEXJ dateStart: 19950101 customDbUrl: isFulltext: true dateEnd: 99991231 titleUrlDefault: https://www.sciencedirect.com omitProxy: false ssIdentifier: ssj0007202 providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9QwELag5cAFyksUaOUDXFgZkTiJ4xNa9SFaoYLURdpbZHudqquSrLJ9Hfkb_D1-CTN2nGQLSIDEJVpFijea-TL-NJ75hpCXPOIz2OUEQ6EQliiVsTxJOSt5rnIzK0tr_bAJcXSUT6fyU1tWtHTjBERV5dfXcvFfXQ33wNnYOvsX7u4WhRvwG5wOV3A7XP_I8bs11on7zjXMijsNfxy5PIKv-exs9MUpar7i-5gQ7AX-8dSgLdbCVHYogpCo-bQItHJ8wE6cTjXy1EN1qY5d0BlhY_yQ5vYNZ47qerlo_zpLiPtXqi-5_XDanvpXJ1d9W9qksRdeELhTP-grQRpfWfCxPG2GSYv4ZtKi66ZZKfZEtS8WxdFKdI79JvFTpPdJh_mb-RJF1-PU9UK1edFVAe1jXBeXBbb3Fnfs22Q9FqmEGLg-PtibHnY7t4hdjWr3HuEU3NUD3vijX_OYATeZbJB7raXp2IPhAbllq4fkfhjYQdv4_YgsdmsasEHBGbTDBnXYoB4b7-i4oj0yaF3RATK-f_1GAyZoXdIhJmiPCYqYeEw-7-9Ndt6zduQGM7FMzllqU2k4sMwym2kljEhkpkRmBHy7EU91JJQCBqNkHtmZKYHOmiTRJtM6EUD-LX9C1qq6sk8JjfFEj2cazM4TnkkttVFAp4VOU22jaJO8DgYsFl5ZpQglh_MCrF2gtQtv7U2SBBMXLTX0lK8APPz-sWf_9thzcrcH7Quydt5c2C1yx1yCQ5rtFjU_ANGxihs |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Do+comments+and+expertise+still+matter%3F+An+experiment+on+programmers%E2%80%99+adoption+of+AI-generated+JavaScript+code&rft.jtitle=The+Journal+of+systems+and+software&rft.au=Li%2C+Changwen&rft.au=Treude%2C+Christoph&rft.au=Turel%2C+Ofir&rft.date=2026-01-01&rft.pub=Elsevier+Inc&rft.issn=0164-1212&rft.volume=231&rft_id=info:doi/10.1016%2Fj.jss.2025.112634&rft.externalDocID=S0164121225003036 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0164-1212&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0164-1212&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0164-1212&client=summon |