Improving the accuracy of the code complexity calculation for automatically generated tasks with programming codes

Teaching programming is an activity that becomes more and more popular. Assessment of students that attend introductory courses in programming can partly be done by presenting simple source code fragments. Students should be able to provide answer to the question: "What is the output of the giv...

Full description

Saved in:
Bibliographic Details
Published in:IEEE Global Engineering Education Conference pp. 686 - 692
Main Authors: Stankov, Emil, Jovanov, Mile, Andonov, Jovan, Bogdanova, Ana Madevska
Format: Conference Proceeding Journal Article
Language:English
Published: IEEE 01.04.2016
Subjects:
automatic generation of tasks containing source codes
Automation
Complexity
Complexity theory
Mathematical analysis
Measurement
Production
Programming
Programming profession
Segments
Source code
source code complexity calculation
Students
Tasks
Testing
ISSN:2165-9567
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Teaching programming is an activity that becomes more and more popular. Assessment of students that attend introductory courses in programming can partly be done by presenting simple source code fragments. Students should be able to provide answer to the question: "What is the output of the given code?" When preparing the code segments, teachers should be aware of the complexity ('weight') of the code. Especially, when preparing many versions of the same test (to assess a huge number of students), they should try to provide same or similar complexity tasks for all students. A possible solution to this problem is to provide automatic generation of questions containing source code segments. In order to achieve complexity consistency in the process of automatic production of questions for programming courses, there must be a way to automatically measure the complexity of source codes. In our previous work, we have defined a source code metric that considers the source code complexity from a perspective of the student's effort required for manual calculation of the program output, if the input is known. The metric measures the complexity using user-specified weight values assigned to each of the operators and branch statements in the code. In this paper we present a new tool that will help improve the accuracy of the code complexity calculation for automatically generated tasks containing source codes. We also describe our preliminary findings from the research that we have conducted using this tool in order to determine appropriate weight values, and provide remarks for the future experiments on the subject.
Bibliography:ObjectType-Article-2
SourceType-Scholarly Journals-1
ObjectType-Conference-1
ObjectType-Feature-3
content type line 23
SourceType-Conference Papers & Proceedings-2
ISSN:2165-9567
DOI:10.1109/EDUCON.2016.7474624