Improving the accuracy of the code complexity calculation for automatically generated tasks with programming codes
Teaching programming is an activity that becomes more and more popular. Assessment of students that attend introductory courses in programming can partly be done by presenting simple source code fragments. Students should be able to provide answer to the question: "What is the output of the giv...
Uloženo v:
| Vydáno v: | IEEE Global Engineering Education Conference s. 686 - 692 |
|---|---|
| Hlavní autoři: | , , , |
| Médium: | Konferenční příspěvek Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
IEEE
01.04.2016
|
| Témata: | |
| ISSN: | 2165-9567 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Teaching programming is an activity that becomes more and more popular. Assessment of students that attend introductory courses in programming can partly be done by presenting simple source code fragments. Students should be able to provide answer to the question: "What is the output of the given code?" When preparing the code segments, teachers should be aware of the complexity ('weight') of the code. Especially, when preparing many versions of the same test (to assess a huge number of students), they should try to provide same or similar complexity tasks for all students. A possible solution to this problem is to provide automatic generation of questions containing source code segments. In order to achieve complexity consistency in the process of automatic production of questions for programming courses, there must be a way to automatically measure the complexity of source codes. In our previous work, we have defined a source code metric that considers the source code complexity from a perspective of the student's effort required for manual calculation of the program output, if the input is known. The metric measures the complexity using user-specified weight values assigned to each of the operators and branch statements in the code. In this paper we present a new tool that will help improve the accuracy of the code complexity calculation for automatically generated tasks containing source codes. We also describe our preliminary findings from the research that we have conducted using this tool in order to determine appropriate weight values, and provide remarks for the future experiments on the subject. |
|---|---|
| AbstractList | Teaching programming is an activity that becomes more and more popular. Assessment of students that attend introductory courses in programming can partly be done by presenting simple source code fragments. Students should be able to provide answer to the question: "What is the output of the given code?" When preparing the code segments, teachers should be aware of the complexity ('weight') of the code. Especially, when preparing many versions of the same test (to assess a huge number of students), they should try to provide same or similar complexity tasks for all students. A possible solution to this problem is to provide automatic generation of questions containing source code segments. In order to achieve complexity consistency in the process of automatic production of questions for programming courses, there must be a way to automatically measure the complexity of source codes. In our previous work, we have defined a source code metric that considers the source code complexity from a perspective of the student's effort required for manual calculation of the program output, if the input is known. The metric measures the complexity using user-specified weight values assigned to each of the operators and branch statements in the code. In this paper we present a new tool that will help improve the accuracy of the code complexity calculation for automatically generated tasks containing source codes. We also describe our preliminary findings from the research that we have conducted using this tool in order to determine appropriate weight values, and provide remarks for the future experiments on the subject. |
| Author | Andonov, Jovan Bogdanova, Ana Madevska Jovanov, Mile Stankov, Emil |
| Author_xml | – sequence: 1 givenname: Emil surname: Stankov fullname: Stankov, Emil email: emil.stankov@finki.ukim.mk organization: Fac. of Comput. Sci. & Eng., Ss. Cyril & Methodius Univ., Skopje, Macedonia – sequence: 2 givenname: Mile surname: Jovanov fullname: Jovanov, Mile email: mile.jovanov@finki.ukim.mk organization: Fac. of Comput. Sci. & Eng., Ss. Cyril & Methodius Univ., Skopje, Macedonia – sequence: 3 givenname: Jovan surname: Andonov fullname: Andonov, Jovan email: andonov92@gmail.com organization: Fac. of Comput. Sci. & Eng., Ss. Cyril & Methodius Univ., Skopje, Macedonia – sequence: 4 givenname: Ana Madevska surname: Bogdanova fullname: Bogdanova, Ana Madevska email: ana.madevska.bogdanova@finki.ukim.mk organization: Fac. of Comput. Sci. & Eng., Ss. Cyril & Methodius Univ., Skopje, Macedonia |
| BookMark | eNotkMtOwzAQRQ0Cibb0C7rxkk2LX7GTJSqvShXdlHU0cSZtII9iO0D-npR2FjO6o6tzRzMmV03bICEzzhacs-T-6fF9uXlbCMb1wiijtFAXZMyVNjLWUopLMhJcR_Mk0uaGTL3_YEMZkyjBRsSt6oNrv8tmR8MeKVjbObA9bYt_bdv82OpDhb9l6KmFynYVhLJtaNE6Cl1o60EO-6qnO2zQQcCcBvCfnv6UYU8H_M5BXR8jjjh_S64LqDxOz3NCts9P2-XrfL15WS0f1vNSsDjMrWURRjJXMrJZpqNcccEFCIQYcowTzFVmuBW2gNwkElBkIKQsOOdokckJuTthhwO-OvQhrUtvsaqgwbbzKY-5ZjyKlRmss5O1RMT04MoaXJ-enyn_ANeLbhI |
| ContentType | Conference Proceeding Journal Article |
| DBID | 6IE 6IL CBEJK RIE RIL 7SC 7SP 7TB 7U5 8FD FR3 JQ2 KR7 L7M L~C L~D |
| DOI | 10.1109/EDUCON.2016.7474624 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Xplore POP ALL IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP All) 1998-Present Computer and Information Systems Abstracts Electronics & Communications Abstracts Mechanical & Transportation Engineering Abstracts Solid State and Superconductivity Abstracts Technology Research Database Engineering Research Database ProQuest Computer Science Collection Civil Engineering Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
| DatabaseTitle | Civil Engineering Abstracts Technology Research Database Computer and Information Systems Abstracts – Academic Mechanical & Transportation Engineering Abstracts Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Solid State and Superconductivity Abstracts Engineering Research Database Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Civil Engineering Abstracts |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISBN | 1467386332 9781467386333 |
| EISSN | 2165-9567 |
| EndPage | 692 |
| ExternalDocumentID | 7474624 |
| Genre | orig-research |
| GroupedDBID | 6IE 6IL 6IN AAWTH ABLEC ACGFS ADZIZ ALMA_UNASSIGNED_HOLDINGS BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO IEGSK M43 OCL RIE RIL 7SC 7SP 7TB 7U5 8FD FR3 JQ2 KR7 L7M L~C L~D |
| ID | FETCH-LOGICAL-i208t-cc05e53d435cbb65d41212a2ea8ade89ed4b71c2cfad793ae2ba233f111ece03 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 1 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000386529800104&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Thu Jul 10 20:44:40 EDT 2025 Wed Aug 27 02:08:48 EDT 2025 |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-i208t-cc05e53d435cbb65d41212a2ea8ade89ed4b71c2cfad793ae2ba233f111ece03 |
| Notes | ObjectType-Article-2 SourceType-Scholarly Journals-1 ObjectType-Conference-1 ObjectType-Feature-3 content type line 23 SourceType-Conference Papers & Proceedings-2 |
| PQID | 1816015847 |
| PQPubID | 23500 |
| PageCount | 7 |
| ParticipantIDs | proquest_miscellaneous_1816015847 ieee_primary_7474624 |
| PublicationCentury | 2000 |
| PublicationDate | 20160401 |
| PublicationDateYYYYMMDD | 2016-04-01 |
| PublicationDate_xml | – month: 04 year: 2016 text: 20160401 day: 01 |
| PublicationDecade | 2010 |
| PublicationTitle | IEEE Global Engineering Education Conference |
| PublicationTitleAbbrev | EDUCON |
| PublicationYear | 2016 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| SSID | ssj0000779420 |
| Score | 1.5949136 |
| Snippet | Teaching programming is an activity that becomes more and more popular. Assessment of students that attend introductory courses in programming can partly be... |
| SourceID | proquest ieee |
| SourceType | Aggregation Database Publisher |
| StartPage | 686 |
| SubjectTerms | automatic generation of tasks containing source codes Automation Complexity Complexity theory Mathematical analysis Measurement Production Programming Programming profession Segments Source code source code complexity calculation Students Tasks Testing |
| Title | Improving the accuracy of the code complexity calculation for automatically generated tasks with programming codes |
| URI | https://ieeexplore.ieee.org/document/7474624 https://www.proquest.com/docview/1816015847 |
| WOSCitedRecordID | wos000386529800104&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwELbaigEWHi2ivGQkRtImrpvHjEAMqHTo0C262BdUURKUB6L_nrMbAhIsbMlgJ7q7-L7c62PsGqUk1K7QSTENHZkAOqEE6UyiFNxQJ4EHlrXkMZjNwuUymnfYTdsLg4i2-AxH5tLm8nWuahMqGxP0lb6QXdYNAn_bq9XGU9yALEu4zWAhz43GhrrmaWaqt_xRs7KhUPl17lpncr__v9c4YIPvrjw-b_3NIetgdsT2fgwU7LOijRFwAnYclKoLUBuep_be9K9zW0SOH4S-OelHNfRdnMArh7rK7QhXWK83_NlOpCZEyisoX0puQra8qed6NY8w25UDtri_W9w-OA2rgrMSblg5SrlTnE404SSVJP5US4_cFwiEEDSGEWpJGlJCpaDp4wUUCYjJJKVDEQ252DHrZXmGJ4yj5ws38USQThNSeBJqQA2eJsypZBSIIesb4cVv27kZcSO3Ibv6kn5MtmwSFJBhXpcxoQ36PzSJ29O_l56xXaPObeXMOetVRY0XbEe9V6uyuLQG8Qkisbu_ |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LT4NAEJ7UR6JefFTj2zXxKArbbYGzsamxVg89eCPD7mCMtZgCxv57Z7dYTfTiDQ67kJlh52NeH8AZKcWoXZOXURZ5KkXyIoXKa8UZ-pFJwwAda0k_HAyix8f4oQHn814YInLFZ3RhL10u3-S6sqGyS4a-qiPVAixZ5qy6W2seUfFDti3p16OFAj--tOQ19wNbv9W5qNfWJCq_Tl7nTrrr_3uRDdj-7ssTD3OPswkNGm_B2o-Rgk2YzKMEgqGdQK2rCeqpyDN3bzvYhSsjpw_G34I1pGsCL8HwVWBV5m6IK45GU_HkZlIzJhUlFi-FsEFbUVd0vdpH2O2KbRh2r4dXPa_mVfCepR-VntZ-m9otw0hJp2mnbVTADgwlYYSGopiMYh1pqTM0_PkiyRRlq5XxsUiWXmwHFsf5mHZBUNCRfhrIMGunrPI0MkgGA8OoU6s4lHvQtMJL3maTM5Jabntw-iX9hK3ZpihwTHlVJIw3-A_Rpm73_156Aiu94V0_6d8Mbg9g1ap2VkdzCIvlpKIjWNbv5XMxOXbG8QkQA78I |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=IEEE+Global+Engineering+Education+Conference&rft.atitle=Improving+the+accuracy+of+the+code+complexity+calculation+for+automatically+generated+tasks+with+programming+codes&rft.au=Stankov%2C+Emil&rft.au=Jovanov%2C+Mile&rft.au=Andonov%2C+Jovan&rft.au=Bogdanova%2C+Ana+Madevska&rft.date=2016-04-01&rft.pub=IEEE&rft.eissn=2165-9567&rft.spage=686&rft.epage=692&rft_id=info:doi/10.1109%2FEDUCON.2016.7474624&rft.externalDocID=7474624 |