Code-quality evaluation scheme for assessment of student contributions to programming projects
Project-based learning is the most common approach to software engineering education, due to its emphasis on the teamwork skills essential to real-world collaborations. This study developed an automated programming assessment system (APAS) featuring a code-quality evaluation scheme to overcome diffi...
Uložené v:
| Vydané v: | The Journal of systems and software Ročník 188; s. 111273 |
|---|---|
| Hlavní autori: | , , |
| Médium: | Journal Article |
| Jazyk: | English |
| Vydavateľské údaje: |
Elsevier Inc
01.06.2022
|
| Predmet: | |
| ISSN: | 0164-1212, 1873-1228 |
| On-line prístup: | Získať plný text |
| Tagy: |
Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
|
| Abstract | Project-based learning is the most common approach to software engineering education, due to its emphasis on the teamwork skills essential to real-world collaborations. This study developed an automated programming assessment system (APAS) featuring a code-quality evaluation scheme to overcome difficulties in assessing the contribution of individual team members. Team participation is visualized on a weekly basis to provide insights pertaining to team dynamics, and metrics based on code quality allow the segmentation of students by level of contribution. Insights provided by the proposed system were also shown to facilitate interventions aimed at improving code quality. Empirical analysis based on submission data from 146 students (41 teams) demonstrated the feasibility of the proposed system in monitoring group-based learning projects at the university level, particularly in detecting free-riders.
•A code-quality aware automated programming assessment system to monitor team programming projects.•A code-quality based evaluation scheme for assessment of student contributions in team programming projects.•A learning analytics workflow to explore teams’ collaboration in programming projects.•Code-quality improvement metrics to evaluate individual contributions in programming projects.•Free-rider detection using code-quality improvement metrics. |
|---|---|
| AbstractList | Project-based learning is the most common approach to software engineering education, due to its emphasis on the teamwork skills essential to real-world collaborations. This study developed an automated programming assessment system (APAS) featuring a code-quality evaluation scheme to overcome difficulties in assessing the contribution of individual team members. Team participation is visualized on a weekly basis to provide insights pertaining to team dynamics, and metrics based on code quality allow the segmentation of students by level of contribution. Insights provided by the proposed system were also shown to facilitate interventions aimed at improving code quality. Empirical analysis based on submission data from 146 students (41 teams) demonstrated the feasibility of the proposed system in monitoring group-based learning projects at the university level, particularly in detecting free-riders.
•A code-quality aware automated programming assessment system to monitor team programming projects.•A code-quality based evaluation scheme for assessment of student contributions in team programming projects.•A learning analytics workflow to explore teams’ collaboration in programming projects.•Code-quality improvement metrics to evaluate individual contributions in programming projects.•Free-rider detection using code-quality improvement metrics. |
| ArticleNumber | 111273 |
| Author | Dow, Chyi-Ren Nguyen, Bao-An Chen, Hsi-Min |
| Author_xml | – sequence: 1 givenname: Hsi-Min surname: Chen fullname: Chen, Hsi-Min email: hmchen@mail.fcu.edu.tw organization: Department of Information Engineering and Computer Science, Feng Chia University, Taichung, Taiwan – sequence: 2 givenname: Bao-An orcidid: 0000-0001-5162-0179 surname: Nguyen fullname: Nguyen, Bao-An email: annb@tvu.edu.vn organization: Department of Information Technology, Tra Vinh University, Tra Vinh, Viet Nam – sequence: 3 givenname: Chyi-Ren surname: Dow fullname: Dow, Chyi-Ren email: crdow@mail.fcu.edu.tw organization: Department of Information Engineering and Computer Science, Feng Chia University, Taichung, Taiwan |
| BookMark | eNp9kL1OwzAUhS1UJNrCA7D5BRJsJ40TMaGKP6kSS2csx7kujpq4-DqV-vYklImh0z3D-a50vgWZ9b4HQu45SznjxUObtoipYEKknHMhsysy56XMEi5EOSPzsZOPmYsbskBsGWNyLM_J59o3kHwPeu_iicJR7wcdne8pmi_ogFofqEYExA76SL2lGIdmisb3Mbh6mNpIo6eH4HdBd53rd1NuwUS8JddW7xHu_u6SbF-et-u3ZPPx-r5-2iRGVDImesVqIavSlpk00owXalvVWV41WaFzlttVVZRFLmHFG1vXBdO5sAXLQGvBymxJ5PmtCR4xgFXGxd8dMWi3V5ypyZJq1WhJTZbU2dJI8n_kIbhOh9NF5vHMwLjo6CAoNA56A40L42jVeHeB_gExdYRZ |
| CitedBy_id | crossref_primary_10_18267_j_aip_283 crossref_primary_10_1109_ACCESS_2025_3532595 crossref_primary_10_1109_ACCESS_2024_3426299 crossref_primary_10_1016_j_jss_2023_111839 |
| Cites_doi | 10.1080/13562517.2010.493346 10.1016/j.jss.2020.110736 10.1177/0273475304273459 10.1145/157710.157715 10.1016/0149-7189(79)90048-X 10.1016/j.jss.2020.110613 10.1109/ICS51289.2020.00099 10.1016/j.jss.2012.12.052 10.1038/s41598-020-65163-1 10.1109/TSE.2014.2342227 10.1002/smr.1918 10.1002/cae.21606 10.1016/j.jpdc.2016.12.028 10.1016/j.jss.2018.07.011 10.1080/0260293042000227272 10.1007/s40593-016-0116-x 10.1177/0013164406292085 10.1111/bjet.13066 10.1080/01621459.1963.10500845 10.1016/j.jss.2018.07.010 10.1016/j.compedu.2006.11.006 10.1080/02602930903429302 10.1109/TE.2010.2098442 |
| ContentType | Journal Article |
| Copyright | 2022 |
| Copyright_xml | – notice: 2022 |
| DBID | AAYXX CITATION |
| DOI | 10.1016/j.jss.2022.111273 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 1873-1228 |
| ExternalDocumentID | 10_1016_j_jss_2022_111273 S0164121222000358 |
| GroupedDBID | --K --M -~X .DC .~1 0R~ 1B1 1~. 1~5 29L 4.4 457 4G. 5GY 5VS 7-5 71M 8P~ 9JN 9M8 AABNK AACTN AAEDT AAEDW AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO AAYFN AAYOK ABBOA ABEFU ABFNM ABFRF ABFSI ABJNI ABMAC ABTAH ABXDB ABYKQ ACDAQ ACGFO ACGFS ACGOD ACNNM ACRLP ACZNC ADBBV ADEZE ADHUB ADJOM ADMUD AEBSH AEFWE AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHZHX AI. AIALX AIEXJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD ASPBG AVWKF AXJTR AZFZN BKOJK BKOMP BLXMC CS3 DU5 E.L EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FYGXN G-Q G8K GBLVA GBOLZ HLZ HVGLF HZ~ IHE J1W KOM LG9 M41 MO0 MS~ N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PQQKQ Q38 R2- RIG RNS ROL RPZ RXW SBC SDF SDG SDP SES SEW SPC SPCBC SSV SSZ T5K TAE TN5 TWZ UHS UNMZH VH1 WUQ XPP ZMT ZY4 ~G- 9DU AATTM AAXKI AAYWO AAYXX ABDPE ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD |
| ID | FETCH-LOGICAL-c297t-a50b2798f837c7c8f8ebf9b349d36a404f5968647e51dfbb60a42f603eaa2083 |
| ISICitedReferencesCount | 7 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000783133900004&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0164-1212 |
| IngestDate | Tue Nov 18 21:28:24 EST 2025 Sat Nov 29 07:25:24 EST 2025 Fri Feb 23 02:38:53 EST 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Cooperative/collaborative learning Programming education Automated programming assessment system Quality Project-based learning |
| Language | English |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c297t-a50b2798f837c7c8f8ebf9b349d36a404f5968647e51dfbb60a42f603eaa2083 |
| ORCID | 0000-0001-5162-0179 |
| ParticipantIDs | crossref_citationtrail_10_1016_j_jss_2022_111273 crossref_primary_10_1016_j_jss_2022_111273 elsevier_sciencedirect_doi_10_1016_j_jss_2022_111273 |
| PublicationCentury | 2000 |
| PublicationDate | June 2022 2022-06-00 |
| PublicationDateYYYYMMDD | 2022-06-01 |
| PublicationDate_xml | – month: 06 year: 2022 text: June 2022 |
| PublicationDecade | 2020 |
| PublicationTitle | The Journal of systems and software |
| PublicationYear | 2022 |
| Publisher | Elsevier Inc |
| Publisher_xml | – name: Elsevier Inc |
| References | Breuker, Derriks, Brunekreef (b5) 2011 Ward (b52) 1963; 58 Zagalsky, Feliciano, Storey, Zhao, Wang (b54) 2015 Fowler (b21) 2006 Maiden, Perry (b38) 2011; 36 Robinson, Carroll (b49) 2017 Patton, McGill (b44) 2006; 21 Campbell (b8) 1979; 2 Cico, Jaccheri, Nguyen-Duc, Zhang (b13) 2021; 172 Raibulet, Arcelli Fontana (b48) 2018; 144 Rodríguez-del Pino, J.C., Rubio Royo, E., Hernández Figueroa, Z., 2012. A virtual programming lab for moodle with automatic assessment and anti-plagiarism features. In: Proceedings of the 2012 International Conference on E-Learning, e-Business, Enterprise Information Systems, & e-Government. Las Vegas, USA. pp. 80–85. Jolliffe (b29) 1986 Fellenz (b18) 2006; 30 Haaranen, Lehtinen (b25) 2015 Nguyen, B.-A., Ho, K.-Y., Chen, H.-M., 2020. Measure Students’ Contribution in Web Programming Projects by Exploring Source Code Repository. In: International Computer Symposium. Tainan, Taiwan. Chen, Nguyen, Yan, Dow (b11) 2020 Chua, Rajalingam, Tan, Dauwels (b12) 2019; 1011 Guo, Seaman (b24) 2011 Lu, Mao, Li, Zhang, Wang, Yin (b37) 2018; 30 Buffardi (b7) 2020 Li, Li, Zhang, Xin (b35) 2021; 52 Pieterse, Thompson (b46) 2010; 15 Black, Boca, Bowen, Gorman, Hinchey (b3) 2009; 42 Neyem, Benedetto, Chacon (b41) 2014 Chen, Chen, Lee (b10) 2018; 34 Barr, Dixon, Gassenheimer (b2) 2005; 27 Blumenstein, Green, Fogelman, Nguyen, Muthukkumarasamy (b4) 2008; 50 Hundt, Schlarb, Schmidt (b27) 2017; 105 Parizi, Spoletini, Singh (b43) 2019 Loughry, Ohland, DeWayne Moore (b36) 2007; 67 Kelleher (b31) 2014 Ferguson, Shichman, Tan (b19) 2020; 10 Masood, Hoda, Blincoe (b40) 2018; 144 Cunningham (b14) 1992; 4 Gary, Xavier (b22) 2015 Tom, Aurum, Vidgen (b51) 2013; 86 Keuning, Jeuring, Heeren (b32) 2018 Siemens, Baker (b50) 2012 Heckman, King (b26) 2018 Johnston, Miles (b28) 2004; 29 Athanasiou, Nugroho, Visser, Zaidman (b1) 2014; 40 Eraslan, Kopec-Harding, Jay, Embury, Haines, Cortés Ríos, Crowther (b17) 2020; 167 Grivokostopoulou, Perikos, Hatzilygeroudis (b23) 2017; 27 Fernández, Luis (b20) 2011; 54 Kaya, Özel (b30) 2015; 23 Cardell-Oliver, R., 2011. How can software metrics help novice programmers? In: Proceedings of the Thirteenth Australasian Computing Education Conference-Vol. 114. pp. 55–62. Wilkins, Lawhead (b53) 2000 Brown, Cai, Guo, Kazman, Kim, Kruchten, Lim, MacCormack, Nord, Ozkaya, Sangwan, Seaman, Sullivan, Zazworka (b6) 2010 De Bassi, Puppi, Banali, Paraiso (b15) 2018 Martin (b39) 2009 Pettit, Prather (b45) 2017; 32 Layton, R., Ohland, M., Pomeranz, H., 2007. Software for student team formation and peer evaluation: CATME incorporates Team-Maker. In: Proceedings of the American Society for Engineering Education Annual Conference & Exposition. Honolulu. Edwards, Kandru, Rajagopal (b16) 2017 Kirk, Crow, Luxton-Reilly, Tempero (b33) 2020 Masood (10.1016/j.jss.2022.111273_b40) 2018; 144 Grivokostopoulou (10.1016/j.jss.2022.111273_b23) 2017; 27 10.1016/j.jss.2022.111273_b9 Ferguson (10.1016/j.jss.2022.111273_b19) 2020; 10 Keuning (10.1016/j.jss.2022.111273_b32) 2018 Campbell (10.1016/j.jss.2022.111273_b8) 1979; 2 Haaranen (10.1016/j.jss.2022.111273_b25) 2015 Robinson (10.1016/j.jss.2022.111273_b49) 2017 De Bassi (10.1016/j.jss.2022.111273_b15) 2018 Lu (10.1016/j.jss.2022.111273_b37) 2018; 30 Cunningham (10.1016/j.jss.2022.111273_b14) 1992; 4 Parizi (10.1016/j.jss.2022.111273_b43) 2019 Breuker (10.1016/j.jss.2022.111273_b5) 2011 Tom (10.1016/j.jss.2022.111273_b51) 2013; 86 Blumenstein (10.1016/j.jss.2022.111273_b4) 2008; 50 Pieterse (10.1016/j.jss.2022.111273_b46) 2010; 15 Buffardi (10.1016/j.jss.2022.111273_b7) 2020 Li (10.1016/j.jss.2022.111273_b35) 2021; 52 Neyem (10.1016/j.jss.2022.111273_b41) 2014 Wilkins (10.1016/j.jss.2022.111273_b53) 2000 Jolliffe (10.1016/j.jss.2022.111273_b29) 1986 Black (10.1016/j.jss.2022.111273_b3) 2009; 42 Barr (10.1016/j.jss.2022.111273_b2) 2005; 27 Edwards (10.1016/j.jss.2022.111273_b16) 2017 Gary (10.1016/j.jss.2022.111273_b22) 2015 Raibulet (10.1016/j.jss.2022.111273_b48) 2018; 144 Kelleher (10.1016/j.jss.2022.111273_b31) 2014 10.1016/j.jss.2022.111273_b42 Patton (10.1016/j.jss.2022.111273_b44) 2006; 21 10.1016/j.jss.2022.111273_b47 Eraslan (10.1016/j.jss.2022.111273_b17) 2020; 167 Hundt (10.1016/j.jss.2022.111273_b27) 2017; 105 Heckman (10.1016/j.jss.2022.111273_b26) 2018 Ward (10.1016/j.jss.2022.111273_b52) 1963; 58 Fellenz (10.1016/j.jss.2022.111273_b18) 2006; 30 Fowler (10.1016/j.jss.2022.111273_b21) 2006 Maiden (10.1016/j.jss.2022.111273_b38) 2011; 36 Zagalsky (10.1016/j.jss.2022.111273_b54) 2015 Cico (10.1016/j.jss.2022.111273_b13) 2021; 172 Brown (10.1016/j.jss.2022.111273_b6) 2010 Chen (10.1016/j.jss.2022.111273_b11) 2020 Kaya (10.1016/j.jss.2022.111273_b30) 2015; 23 10.1016/j.jss.2022.111273_b34 Siemens (10.1016/j.jss.2022.111273_b50) 2012 Chen (10.1016/j.jss.2022.111273_b10) 2018; 34 Loughry (10.1016/j.jss.2022.111273_b36) 2007; 67 Martin (10.1016/j.jss.2022.111273_b39) 2009 Johnston (10.1016/j.jss.2022.111273_b28) 2004; 29 Kirk (10.1016/j.jss.2022.111273_b33) 2020 Pettit (10.1016/j.jss.2022.111273_b45) 2017; 32 Chua (10.1016/j.jss.2022.111273_b12) 2019; 1011 Fernández (10.1016/j.jss.2022.111273_b20) 2011; 54 Guo (10.1016/j.jss.2022.111273_b24) 2011 Athanasiou (10.1016/j.jss.2022.111273_b1) 2014; 40 |
| References_xml | – start-page: 13 year: 2011 end-page: 17 ident: b5 article-title: Measuring static quality of student code publication-title: ITiCSE’11 - Proceedings of the 16th Annual Conference on Innovation and Technology in Computer Science – volume: 4 start-page: 29 year: 1992 end-page: 30 ident: b14 article-title: The WyCash portfolio management system publication-title: ACM SIGPLAN OOPS Messenger – reference: Rodríguez-del Pino, J.C., Rubio Royo, E., Hernández Figueroa, Z., 2012. A virtual programming lab for moodle with automatic assessment and anti-plagiarism features. In: Proceedings of the 2012 International Conference on E-Learning, e-Business, Enterprise Information Systems, & e-Government. Las Vegas, USA. pp. 80–85. – start-page: 8 year: 2020 ident: b11 article-title: Analysis of learning behavior in an automated programming assessment environment: A code quality perspective publication-title: IEEE Access – volume: 23 start-page: 363 year: 2015 end-page: 373 ident: b30 article-title: Integrating an online compiler and a plagiarism detection tool into the moodle distance education system for easy assessment of programming assignments publication-title: Comput. Appl. Eng. Educ. – start-page: 252 year: 2012 end-page: 254 ident: b50 article-title: Learning analytics and educational data mining: Towards communication and collaboration publication-title: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, LAK ’12 – year: 2009 ident: b39 article-title: Clean Code: A Handbook of Agile Software Craftsmanship – volume: 34 start-page: 1203 year: 2018 end-page: 1221 ident: b10 article-title: An automated assessment system for analysis of coding convention violations in Java programming assignments publication-title: J. Inf. Sci. Eng. – volume: 30 start-page: 570 year: 2006 end-page: 591 ident: b18 article-title: Toward fairness in assessing student groupwork: A protocol for peer evaluation of individual contributions publication-title: J. Manage. Educ. – start-page: 1 year: 2014 end-page: 4 ident: b31 article-title: Employing git in the classroom publication-title: 2014 World Congress on Computer Applications and Information Systems (WCCAIS) – volume: 15 start-page: 355 year: 2010 end-page: 367 ident: b46 article-title: Academic alignment to reduce the presence of social loafers and diligent isolates in student teams publication-title: Teach. High. Educ. – volume: 10 start-page: 1 year: 2020 end-page: 12 ident: b19 article-title: When lone wolf defectors undermine the power of the opt-out default publication-title: Sci. Rep. – volume: 172 year: 2021 ident: b13 article-title: Exploring the intersection between software industry and software engineering education - A systematic mapping of software engineering trends publication-title: J. Syst. Softw. – volume: 36 start-page: 451 year: 2011 end-page: 464 ident: b38 article-title: Dealing with free-riders in assessed group work: Results from a study at a UK university publication-title: Assess. Eval. High. Educ. – start-page: 1906 year: 2015 end-page: 1917 ident: b54 article-title: The emergence of GitHub as a collaborative platform for education publication-title: Proceedings of the 2015 ACM International Conference on Computer-Supported Cooperative Work and Social Computing – start-page: 31 year: 2011 end-page: 34 ident: b24 article-title: A portfolio approach to technical debt management publication-title: Proceedings - International Conference on Software Engineering – year: 2020 ident: b7 article-title: Assessing individual contributions to software engineering projects with git logs and user stories publication-title: Proceedings of the 51st ACM Technical Symposium on Computer Science Education – start-page: 115 year: 1986 end-page: 128 ident: b29 article-title: Principal component analysis and factor analysis publication-title: Principal Component Analysis – volume: 27 start-page: 207 year: 2017 end-page: 240 ident: b23 article-title: An educational system for learning search algorithms and automatically assessing student performance publication-title: Int. J. Artif. Intell. Educ. – volume: 21 start-page: 42 year: 2006 end-page: 48 ident: b44 article-title: Student portfolios and software quality metrics in computer science education publication-title: J. Comput. Sci. Coll. – volume: 144 start-page: 409 year: 2018 end-page: 422 ident: b48 article-title: Collaborative and teamwork software development in an undergraduate software engineering course publication-title: J. Syst. Softw. – start-page: 547 year: 2017 end-page: 556 ident: b49 article-title: An online learning platform for teaching, learning, and assessment of programming publication-title: IEEE Global Engineering Education Conference, EDUCON – start-page: 47 year: 2010 end-page: 51 ident: b6 article-title: Managing technical debt in software-reliant systems publication-title: Proceedings of the FSE/SDP Workshop on the Future of Software Engineering Research, FoSER 2010 – volume: 2 start-page: 67 year: 1979 end-page: 90 ident: b8 article-title: Assessing the impact of planned social change publication-title: Eval. Program Plan. – start-page: 172 year: 2000 end-page: 175 ident: b53 article-title: Evaluating individuals in team projects publication-title: SIGCSE Bulletin (Association for Computing Machinery, Special Interest Group on Computer Science Education) – volume: 42 start-page: 37 year: 2009 end-page: 45 ident: b3 article-title: Formal versus agile: Survival of the fittest publication-title: Computer (Long. Beach. Calif) – start-page: 869 year: 2018 end-page: 871 ident: b15 article-title: Measuring developers’ contribution in source code using quality metrics publication-title: Proceedings of the 2018 IEEE 22nd International Conference on Computer Supported Cooperative Work in Design, CSCWD 2018 – volume: 86 start-page: 1498 year: 2013 end-page: 1516 ident: b51 article-title: An exploration of technical debt publication-title: J. Syst. Softw. – reference: Nguyen, B.-A., Ho, K.-Y., Chen, H.-M., 2020. Measure Students’ Contribution in Web Programming Projects by Exploring Source Code Repository. In: International Computer Symposium. Tainan, Taiwan. – volume: 1011 start-page: 125 year: 2019 end-page: 138 ident: b12 article-title: EduBrowser: A multimodal automated monitoring system for co-located collaborative learning publication-title: Commun. Comput. Inf. Sci. – start-page: 794 year: 2018 end-page: 799 ident: b26 article-title: Developing software engineering skills using real tools for automated grading publication-title: SIGCSE 2018 - Proc. 49th ACM Tech. Symp. Comput. Sci. Educ. 2018-Janua – volume: 167 year: 2020 ident: b17 article-title: Integrating GitLab metrics into coursework consultation sessions in a software engineering course publication-title: J. Syst. Softw. – year: 2015 ident: b22 article-title: Agile learning through continuous assessment publication-title: Proceedings - Frontiers in Education Conference, FIE – start-page: 87 year: 2015 end-page: 92 ident: b25 article-title: Teaching git on the side - version control system as a course platform publication-title: Annu. Conf. Innov. Technol. Comput. Sci. Educ. ITiCSE 2015-June – volume: 67 start-page: 505 year: 2007 end-page: 524 ident: b36 article-title: Development of a theory-based assessment of team member effectiveness publication-title: Educ. Psychol. Meas. – volume: 144 start-page: 501 year: 2018 end-page: 510 ident: b40 article-title: Adapting agile practices in university contexts publication-title: J. Syst. Softw. – volume: 30 year: 2018 ident: b37 article-title: Internal quality assurance for external contributions in GitHub: An empirical investigation publication-title: J. Softw. Evol. Process. – start-page: 391 year: 2014 end-page: 396 ident: b41 article-title: Improving software engineering education through an empirical approach: Lessons learned from capstone teaching experiences publication-title: SIGCSE 2014 - Proceedings of the 45th ACM Technical Symposium on Computer Science Education – volume: 32 start-page: 113 year: 2017 end-page: 121 ident: b45 article-title: Automated assessment tools: Too many cooks, not enough collaboration publication-title: J. Comput. Sci. Coll. – year: 2006 ident: b21 article-title: Continuous integration [WWW Document] – start-page: 86 year: 2020 end-page: 94 ident: b33 article-title: On assuring learning about code quality publication-title: ACE 2020 - Proceedings of the 22nd Australasian Computing Education Conference, Held in Conjunction with Australasian Computer Science Week – volume: 40 start-page: 1100 year: 2014 end-page: 1125 ident: b1 article-title: Test code quality and its relation to issue handling performance publication-title: IEEE Trans. Softw. Eng. – reference: Layton, R., Ohland, M., Pomeranz, H., 2007. Software for student team formation and peer evaluation: CATME incorporates Team-Maker. In: Proceedings of the American Society for Engineering Education Annual Conference & Exposition. Honolulu. – start-page: 65 year: 2017 end-page: 73 ident: b16 article-title: Investigating static analysis errors in student Java programs publication-title: ICER 2017 - Proceedings of the 2017 ACM Conference on International Computing Education Research – volume: 58 start-page: 236 year: 1963 end-page: 244 ident: b52 article-title: Hierarchical grouping to optimize an objective function publication-title: J. Am. Stat. Assoc. – reference: Cardell-Oliver, R., 2011. How can software metrics help novice programmers? In: Proceedings of the Thirteenth Australasian Computing Education Conference-Vol. 114. pp. 55–62. – year: 2019 ident: b43 article-title: Measuring team members’ contributions in software engineering projects using git-driven technology publication-title: Proceedings - Frontiers in Education Conference, FIE – volume: 27 start-page: 81 year: 2005 end-page: 90 ident: b2 article-title: Exploring the Lone wolf phenomenon in student teams publication-title: J. Mark. Educ. – volume: 105 start-page: 163 year: 2017 end-page: 173 ident: b27 article-title: SAUCE: A web application for interactive teaching and learning of parallel programming publication-title: J. Parallel Distrib. Comput. – volume: 29 start-page: 751 year: 2004 end-page: 768 ident: b28 article-title: Assessing contributions to group assignments publication-title: Assess. Eval. High. Educ. – start-page: 19 year: 2018 ident: b32 article-title: A systematic literature review of automated feedback generation for programming exercises publication-title: ACM Trans. Comput. Educ. – volume: 52 start-page: 1178 year: 2021 end-page: 1196 ident: b35 article-title: The effects of a group awareness tool on knowledge construction in computer-supported collaborative learning publication-title: Br. J. Educ. Technol. – volume: 54 start-page: 576 year: 2011 end-page: 581 ident: b20 article-title: Automated assessment in a programming tools course publication-title: IEEE Trans. Educ. – volume: 50 start-page: 1203 year: 2008 end-page: 1216 ident: b4 article-title: Performance analysis of GAME: A generic automated marking environment publication-title: Comput. Educ. – ident: 10.1016/j.jss.2022.111273_b34 – volume: 15 start-page: 355 year: 2010 ident: 10.1016/j.jss.2022.111273_b46 article-title: Academic alignment to reduce the presence of social loafers and diligent isolates in student teams publication-title: Teach. High. Educ. doi: 10.1080/13562517.2010.493346 – start-page: 8 year: 2020 ident: 10.1016/j.jss.2022.111273_b11 article-title: Analysis of learning behavior in an automated programming assessment environment: A code quality perspective publication-title: IEEE Access – start-page: 391 year: 2014 ident: 10.1016/j.jss.2022.111273_b41 article-title: Improving software engineering education through an empirical approach: Lessons learned from capstone teaching experiences – volume: 172 year: 2021 ident: 10.1016/j.jss.2022.111273_b13 article-title: Exploring the intersection between software industry and software engineering education - A systematic mapping of software engineering trends publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2020.110736 – volume: 27 start-page: 81 year: 2005 ident: 10.1016/j.jss.2022.111273_b2 article-title: Exploring the Lone wolf phenomenon in student teams publication-title: J. Mark. Educ. doi: 10.1177/0273475304273459 – volume: 4 start-page: 29 year: 1992 ident: 10.1016/j.jss.2022.111273_b14 article-title: The WyCash portfolio management system publication-title: ACM SIGPLAN OOPS Messenger doi: 10.1145/157710.157715 – year: 2009 ident: 10.1016/j.jss.2022.111273_b39 – volume: 2 start-page: 67 year: 1979 ident: 10.1016/j.jss.2022.111273_b8 article-title: Assessing the impact of planned social change publication-title: Eval. Program Plan. doi: 10.1016/0149-7189(79)90048-X – start-page: 65 year: 2017 ident: 10.1016/j.jss.2022.111273_b16 article-title: Investigating static analysis errors in student Java programs – volume: 167 year: 2020 ident: 10.1016/j.jss.2022.111273_b17 article-title: Integrating GitLab metrics into coursework consultation sessions in a software engineering course publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2020.110613 – ident: 10.1016/j.jss.2022.111273_b42 doi: 10.1109/ICS51289.2020.00099 – year: 2006 ident: 10.1016/j.jss.2022.111273_b21 – start-page: 31 year: 2011 ident: 10.1016/j.jss.2022.111273_b24 article-title: A portfolio approach to technical debt management – start-page: 547 year: 2017 ident: 10.1016/j.jss.2022.111273_b49 article-title: An online learning platform for teaching, learning, and assessment of programming – volume: 86 start-page: 1498 year: 2013 ident: 10.1016/j.jss.2022.111273_b51 article-title: An exploration of technical debt publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2012.12.052 – start-page: 47 year: 2010 ident: 10.1016/j.jss.2022.111273_b6 article-title: Managing technical debt in software-reliant systems – start-page: 86 year: 2020 ident: 10.1016/j.jss.2022.111273_b33 article-title: On assuring learning about code quality – ident: 10.1016/j.jss.2022.111273_b9 – volume: 1011 start-page: 125 year: 2019 ident: 10.1016/j.jss.2022.111273_b12 article-title: EduBrowser: A multimodal automated monitoring system for co-located collaborative learning publication-title: Commun. Comput. Inf. Sci. – volume: 10 start-page: 1 year: 2020 ident: 10.1016/j.jss.2022.111273_b19 article-title: When lone wolf defectors undermine the power of the opt-out default publication-title: Sci. Rep. doi: 10.1038/s41598-020-65163-1 – start-page: 252 year: 2012 ident: 10.1016/j.jss.2022.111273_b50 article-title: Learning analytics and educational data mining: Towards communication and collaboration – volume: 40 start-page: 1100 year: 2014 ident: 10.1016/j.jss.2022.111273_b1 article-title: Test code quality and its relation to issue handling performance publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2014.2342227 – start-page: 87 year: 2015 ident: 10.1016/j.jss.2022.111273_b25 article-title: Teaching git on the side - version control system as a course platform – volume: 30 year: 2018 ident: 10.1016/j.jss.2022.111273_b37 article-title: Internal quality assurance for external contributions in GitHub: An empirical investigation publication-title: J. Softw. Evol. Process. doi: 10.1002/smr.1918 – volume: 23 start-page: 363 year: 2015 ident: 10.1016/j.jss.2022.111273_b30 article-title: Integrating an online compiler and a plagiarism detection tool into the moodle distance education system for easy assessment of programming assignments publication-title: Comput. Appl. Eng. Educ. doi: 10.1002/cae.21606 – start-page: 19 year: 2018 ident: 10.1016/j.jss.2022.111273_b32 article-title: A systematic literature review of automated feedback generation for programming exercises publication-title: ACM Trans. Comput. Educ. – start-page: 13 year: 2011 ident: 10.1016/j.jss.2022.111273_b5 article-title: Measuring static quality of student code – volume: 34 start-page: 1203 year: 2018 ident: 10.1016/j.jss.2022.111273_b10 article-title: An automated assessment system for analysis of coding convention violations in Java programming assignments publication-title: J. Inf. Sci. Eng. – start-page: 869 year: 2018 ident: 10.1016/j.jss.2022.111273_b15 article-title: Measuring developers’ contribution in source code using quality metrics – ident: 10.1016/j.jss.2022.111273_b47 – volume: 42 start-page: 37 year: 2009 ident: 10.1016/j.jss.2022.111273_b3 article-title: Formal versus agile: Survival of the fittest publication-title: Computer (Long. Beach. Calif) – start-page: 1906 year: 2015 ident: 10.1016/j.jss.2022.111273_b54 article-title: The emergence of GitHub as a collaborative platform for education – volume: 105 start-page: 163 year: 2017 ident: 10.1016/j.jss.2022.111273_b27 article-title: SAUCE: A web application for interactive teaching and learning of parallel programming publication-title: J. Parallel Distrib. Comput. doi: 10.1016/j.jpdc.2016.12.028 – year: 2020 ident: 10.1016/j.jss.2022.111273_b7 article-title: Assessing individual contributions to software engineering projects with git logs and user stories – start-page: 115 year: 1986 ident: 10.1016/j.jss.2022.111273_b29 article-title: Principal component analysis and factor analysis – volume: 144 start-page: 501 year: 2018 ident: 10.1016/j.jss.2022.111273_b40 article-title: Adapting agile practices in university contexts publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2018.07.011 – start-page: 794 year: 2018 ident: 10.1016/j.jss.2022.111273_b26 article-title: Developing software engineering skills using real tools for automated grading – volume: 29 start-page: 751 year: 2004 ident: 10.1016/j.jss.2022.111273_b28 article-title: Assessing contributions to group assignments publication-title: Assess. Eval. High. Educ. doi: 10.1080/0260293042000227272 – volume: 21 start-page: 42 year: 2006 ident: 10.1016/j.jss.2022.111273_b44 article-title: Student portfolios and software quality metrics in computer science education publication-title: J. Comput. Sci. Coll. – volume: 27 start-page: 207 year: 2017 ident: 10.1016/j.jss.2022.111273_b23 article-title: An educational system for learning search algorithms and automatically assessing student performance publication-title: Int. J. Artif. Intell. Educ. doi: 10.1007/s40593-016-0116-x – volume: 32 start-page: 113 year: 2017 ident: 10.1016/j.jss.2022.111273_b45 article-title: Automated assessment tools: Too many cooks, not enough collaboration publication-title: J. Comput. Sci. Coll. – volume: 67 start-page: 505 year: 2007 ident: 10.1016/j.jss.2022.111273_b36 article-title: Development of a theory-based assessment of team member effectiveness publication-title: Educ. Psychol. Meas. doi: 10.1177/0013164406292085 – volume: 30 start-page: 570 year: 2006 ident: 10.1016/j.jss.2022.111273_b18 article-title: Toward fairness in assessing student groupwork: A protocol for peer evaluation of individual contributions publication-title: J. Manage. Educ. – volume: 52 start-page: 1178 year: 2021 ident: 10.1016/j.jss.2022.111273_b35 article-title: The effects of a group awareness tool on knowledge construction in computer-supported collaborative learning publication-title: Br. J. Educ. Technol. doi: 10.1111/bjet.13066 – volume: 58 start-page: 236 year: 1963 ident: 10.1016/j.jss.2022.111273_b52 article-title: Hierarchical grouping to optimize an objective function publication-title: J. Am. Stat. Assoc. doi: 10.1080/01621459.1963.10500845 – start-page: 1 year: 2014 ident: 10.1016/j.jss.2022.111273_b31 article-title: Employing git in the classroom – volume: 144 start-page: 409 year: 2018 ident: 10.1016/j.jss.2022.111273_b48 article-title: Collaborative and teamwork software development in an undergraduate software engineering course publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2018.07.010 – volume: 50 start-page: 1203 year: 2008 ident: 10.1016/j.jss.2022.111273_b4 article-title: Performance analysis of GAME: A generic automated marking environment publication-title: Comput. Educ. doi: 10.1016/j.compedu.2006.11.006 – year: 2019 ident: 10.1016/j.jss.2022.111273_b43 article-title: Measuring team members’ contributions in software engineering projects using git-driven technology – start-page: 172 year: 2000 ident: 10.1016/j.jss.2022.111273_b53 article-title: Evaluating individuals in team projects – volume: 36 start-page: 451 year: 2011 ident: 10.1016/j.jss.2022.111273_b38 article-title: Dealing with free-riders in assessed group work: Results from a study at a UK university publication-title: Assess. Eval. High. Educ. doi: 10.1080/02602930903429302 – volume: 54 start-page: 576 year: 2011 ident: 10.1016/j.jss.2022.111273_b20 article-title: Automated assessment in a programming tools course publication-title: IEEE Trans. Educ. doi: 10.1109/TE.2010.2098442 – year: 2015 ident: 10.1016/j.jss.2022.111273_b22 article-title: Agile learning through continuous assessment |
| SSID | ssj0007202 |
| Score | 2.381118 |
| Snippet | Project-based learning is the most common approach to software engineering education, due to its emphasis on the teamwork skills essential to real-world... |
| SourceID | crossref elsevier |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 111273 |
| SubjectTerms | Automated programming assessment system Cooperative/collaborative learning Programming education Project-based learning Quality |
| Title | Code-quality evaluation scheme for assessment of student contributions to programming projects |
| URI | https://dx.doi.org/10.1016/j.jss.2022.111273 |
| Volume | 188 |
| WOSCitedRecordID | wos000783133900004&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1873-1228 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0007202 issn: 0164-1212 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3db9MwELfKxgMvG59iGyA_8AQySmzHdh67MjQQVAgq1CciJ3FGqy2Zlu6j_z3n2PnYNBAg8ZJGbh1Xdz9dzue73yH0UoHXadIoI5GUgnARaRLzTBCmMxt0E7lomJi-fZTTqZrP48-jUdHWwlwcy7JUV1fx6X9VNYyBsm3p7F-ou3soDMA9KB2uoHa4_pHiJ1VuiKuVXA_IvF_DNtacOIpv3dFxWl-xdvSWLmvdt79qeB987taJK1hvIjb10Jnty8oah9aRQjvO5xqs-6XuE2snvgjksF6QT4sOkNOj87X7Yl9XZNyNv3UnTpMf6wX54ovVfGgCdrVdCpWLl7U1M9dSOi2nFwmpT542zuwqyWDMl4l3dlndauNduGH5ZllbunVKrdWnrh_KDersr3YtuxSlzZGpuoM2qYxisH6b4_cH8w_dO1vSJju1-2_t-XeTCXhjods9mIFXMruPtrz08djB4AEamfIh2m5bdWBvuR-h70NU4B4V2KECAypwjwpcFdijAl9DBV5VeIAK3KLiMZq9O5hNDolvrUEyGssV0VGQUhmrQjGZyQw-TVrEKeNxzoTmAS-iWCjBpYnCvEhTEWhOCxEwozUFr_0J2iir0jxFOJA6pznLQiYpFzTUWuaKMVZwKQoT8h0UtNJKMk87b7ufHCdtfuEyAQEnVsCJE_AOetVNOXWcK7_7MW9VkHin0TmDCeDl19N2_23aHrrXA_0Z2lidnZvn6G52sVrUZy88qn4CfPGSiA |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Code-quality+evaluation+scheme+for+assessment+of+student+contributions+to+programming+projects&rft.jtitle=The+Journal+of+systems+and+software&rft.au=Chen%2C+Hsi-Min&rft.au=Nguyen%2C+Bao-An&rft.au=Dow%2C+Chyi-Ren&rft.date=2022-06-01&rft.pub=Elsevier+Inc&rft.issn=0164-1212&rft.eissn=1873-1228&rft.volume=188&rft_id=info:doi/10.1016%2Fj.jss.2022.111273&rft.externalDocID=S0164121222000358 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0164-1212&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0164-1212&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0164-1212&client=summon |