Creating and Visualizing Test Data from Programming Exercises
Automatic assessment of programming exercises is typically based on testing approach. Most automatic assessment frameworks execute tests and evaluate test results automatically, but the test data generation is not automated. No matter that automatic test data generation techniques and tools are avai...
Saved in:
| Published in: | Informatics in education Vol. 6; no. 1; pp. 81 - 102 |
|---|---|
| Main Author: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
Vilnius
Vilniaus Universiteto Leidykla
01.01.2007
Vilnius University Press Institute of Mathematics and Informatics Vilnius University |
| Subjects: | |
| ISSN: | 1648-5831, 2335-8971 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | Automatic assessment of programming exercises is typically based on testing approach. Most automatic assessment frameworks execute tests and evaluate test results automatically, but the test data generation is not automated. No matter that automatic test data generation techniques and tools are available. We have researched how the Java PathFinder software model checker can be adopted to the specific needs of test data generation in automatic assessment. Practical problems considered are: how to derive test data directly from students’ programs (i.e., without annotation) and how to visualize and how to abstract test data automatically for students? Interesting outcomes of our research are that with minor refinements generalized symbolic execution with lazy initialization (a test data generation algorithm implemented in PathFinder) can be used to construct test data directly from students’ programs without annotation, and that intermediate results of the same algorithm can be used to provide novel visualizations of the test data. |
|---|---|
| AbstractList | automatic assessment, programming exercises, testing, test-data, software visualiza-\allowbreak tion, computer science education --- PDFTo preview full article text in PDF format click here Get Free ReaderYou could obtain free Acrobat Reader from Adobe --- Automatic assessment of programming exercises is typically based on testing approach. Most automatic assessment frameworks execute tests and evaluate test results automatically, but the test data generation is not automated. No matter that automatic test data generation techniques and tools are available. We have researched how the Java PathFinder software model checker can be adopted to the specific needs of test data generation in automatic assessment. Practical problems considered are: how to derive test data directly from students’ programs (i.e., without annotation) and how to visualize and how to abstract test data automatically for students? Interesting outcomes of our research are that with minor refinements generalized symbolic execution with lazy initialization (a test data generation algorithm implemented in PathFinder) can be used to construct test data directly from students’ programs without annotation, and that intermediate results of the same algorithm can be used to provide novel visualizations of the test data. |
| Author | Ihantola, Petri |
| Author_xml | – sequence: 1 fullname: Ihantola, Petri |
| BackLink | http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=18736923$$DView record in Pascal Francis |
| BookMark | eNp9kcFrFDEUxoNUcLt69uJhEMTTbJNJMkkOHmRttVDQQ_Ua3mReliwzk5rMQPWvb7a7WOjBU0jy-z6-975zcjbFCQl5y-iGSa71RZg89sumoVRtaPuCrBrOZa2NYmdkxVqha6k5e0XOc95TKqiSzYp82iaEOUy7Cqa--hXyAkP4e7jfYp6rLzBD5VMcqx8p7hKM4-Hr8h6TCxnza_LSw5Dxzelck59Xl7fbb_XN96_X2883tRNSzzVAC7ozXvWcg6BNb7CTvqR2hnqljeFt571jDAxq0fU9gsbGQCOdZG0HfE2uj759hL29S2GE9MdGCPbxIaadhTQHN6ClXZnMI4gOhGDFr1cUHFLnOgYIpnh9PHrdpfh7KUPaMWSHwwATxiVbLWWrVZEW8v0zch-XNJVBrRJln5JKWaAPJwiyg8EnmMpq_mVkWvHWlCbW5OLIuRRzTuifEGofC7THAu2hQEvbopDPFC7Mpas4zQnC8B_du5MOMQ5PmY1oZcP4Aw20rKk |
| CitedBy_id | crossref_primary_10_1016_j_infsof_2012_12_005 |
| ContentType | Journal Article |
| Copyright | 2007 INIST-CNRS Copyright Institute of Mathematics and Informatics 2007 |
| Copyright_xml | – notice: 2007 INIST-CNRS – notice: Copyright Institute of Mathematics and Informatics 2007 |
| DBID | AE2 BIXPP REL AAYXX CITATION IQODW 0-V 3V. 7SC 7XB 88B 8AL 8FD 8FE 8FG 8FK 8G5 ABUWG AFKRA AHOVV ALSLI ARAPS AZQEC BENPR BGLVJ BYOGL CCPQU CJNVE CNYFK DWQXO GNUQQ GUQSH HCIFZ JQ2 K7- L7M L~C L~D M0N M0P M1O M2O MBDVC P5Z P62 PADUT PHGZM PHGZT PKEHL PQEDU PQEST PQGLB PQQKQ PQUKI PRINS PRQQA Q9U DOA |
| DOI | 10.15388/infedu.2007.06 |
| DatabaseName | Central and Eastern European Online Library (C.E.E.O.L.) (DFG Nationallizenzen) CEEOL: Open Access Central and Eastern European Online Library - CEEOL Journals CrossRef Pascal-Francis ProQuest Social Sciences Premium Collection ProQuest Central (Corporate) Computer and Information Systems Abstracts ProQuest Central (purchase pre-March 2016) Education Database (Alumni Edition) Computing Database (Alumni Edition) Technology Research Database ProQuest SciTech Collection ProQuest Technology Collection ProQuest Central (Alumni) (purchase pre-March 2016) Research Library (Alumni) ProQuest Central (Alumni) ProQuest Central UK/Ireland Education Research Index Social Science Premium Collection Advanced Technologies & Computer Science Collection ProQuest Central Essentials ProQuest Central ProQuest Technology Collection East Europe, Central Europe Database ProQuest One Education Collection Library & Information Science Collection ProQuest Central Korea ProQuest Central Student ProQuest Research Library SciTech Collection (ProQuest) ProQuest Computer Science Collection Computer Science Database Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional Computing Database Education Database Library Science Database (ProQuest) Research Library (ProQuest) Research Library (Corporate) Advanced Technologies & Aerospace Database ProQuest Advanced Technologies & Aerospace Collection Research Library China ProQuest Central Premium ProQuest One Academic (New) ProQuest One Academic Middle East (New) ProQuest One Education ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China ProQuest One Social Sciences ProQuest Central Basic DOAJ Directory of Open Access Journals |
| DatabaseTitle | CrossRef ProQuest One Education Research Library Prep Computer Science Database ProQuest Central Student Technology Collection Technology Research Database Computer and Information Systems Abstracts – Academic ProQuest One Academic Middle East (New) ProQuest Advanced Technologies & Aerospace Collection ProQuest Central Essentials ProQuest Computer Science Collection Computer and Information Systems Abstracts ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College Research Library (Alumni Edition) ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences ProQuest Library Science ProQuest Central Korea Library & Information Science Collection ProQuest Research Library Research Library China ProQuest Central (New) Advanced Technologies Database with Aerospace Advanced Technologies & Aerospace Collection Social Science Premium Collection ProQuest Computing Education Collection ProQuest One Social Sciences ProQuest Central Basic ProQuest Education Journals ProQuest Computing (Alumni Edition) ProQuest One Academic Eastern Edition East Europe, Central Europe Database ProQuest Technology Collection ProQuest SciTech Collection Computer and Information Systems Abstracts Professional Advanced Technologies & Aerospace Database ProQuest Social Sciences Premium Collection ProQuest One Academic UKI Edition ProQuest One Academic ProQuest Education Journals (Alumni Edition) ProQuest One Academic (New) ProQuest Central (Alumni) |
| DatabaseTitleList | ProQuest One Education Computer and Information Systems Abstracts |
| Database_xml | – sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: BYOGL name: East Europe, Central Europe Database url: https://search.proquest.com/eastcentraleurope sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Education Applied Sciences Computer Science |
| DocumentTitleAlternate | Creating and Visualizing Test Data from Programming Exercises |
| EISSN | 2335-8971 |
| EndPage | 102 |
| ExternalDocumentID | oai_doaj_org_article_0b407fea4ba4419e8d70ace0ccb1aea9 2117489811 18736923 10_15388_infedu_2007_06 946521 |
| Genre | General Information |
| GroupedDBID | -W8 .GO 0-V 8FE 8FG 8G5 8R4 8R5 AAHSB AAKPC ABOPQ ABUWG ADBBV ADMLS AE2 AFFHD AFKRA ALMA_UNASSIGNED_HOLDINGS ALSLI ARALO ARAPS AZQEC BCNDV BENPR BGLVJ BIXPP BPHCQ BYOGL C1A CCPQU CJNVE CNYFK DWQXO EDJ EN8 EOJEC GNUQQ GROUPED_DOAJ GUQSH HCIFZ K6V K7- KQ8 M0P M1O M2O MK~ OBODZ OK1 P2P P62 PADUT PHGZM PHGZT PQEDU PQGLB PQQKQ PROAC PRQQA Q2X RDL REL RNS AAYXX CITATION IQODW 3V. 7SC 7XB 8AL 8FD 8FK AHOVV JQ2 L7M L~C L~D M0N MBDVC PKEHL PQEST PQUKI PRINS Q9U |
| ID | FETCH-LOGICAL-c458t-aa6a8b9f7d33a402d9eb5f153c90f789936bffc11a9e84bddea8e29a25c516ba3 |
| IEDL.DBID | M1O |
| ISICitedReferencesCount | 5 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000210162900006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1648-5831 |
| IngestDate | Mon Nov 10 04:31:21 EST 2025 Sun Nov 09 09:54:40 EST 2025 Tue Nov 18 00:11:16 EST 2025 Mon Jul 21 09:16:11 EDT 2025 Sat Nov 29 05:59:34 EST 2025 Tue Nov 18 22:41:47 EST 2025 Tue Oct 28 18:53:27 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Keywords | computer science education programming exercises software visualization automatic assessment testing testdata Initialization Automatic programming JAVA language Refinement method test-data testing Automatic test Annotation Teaching Test generation Education Data visualization Model checking Automatic test generation |
| Language | English |
| License | CC BY 4.0 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c458t-aa6a8b9f7d33a402d9eb5f153c90f789936bffc11a9e84bddea8e29a25c516ba3 |
| Notes | SourceType-Scholarly Journals-1 ObjectType-General Information-1 content type line 14 ObjectType-Article-2 ObjectType-Feature-1 content type line 23 |
| OpenAccessLink | https://doaj.org/article/0b407fea4ba4419e8d70ace0ccb1aea9 |
| PQID | 746485055 |
| PQPubID | 106037 |
| PageCount | 22 |
| ParticipantIDs | proquest_miscellaneous_855687419 proquest_journals_746485055 crossref_primary_10_15388_infedu_2007_06 doaj_primary_oai_doaj_org_article_0b407fea4ba4419e8d70ace0ccb1aea9 pascalfrancis_primary_18736923 ceeol_journals_946521 crossref_citationtrail_10_15388_infedu_2007_06 |
| PublicationCentury | 2000 |
| PublicationDate | 2007-01-01 |
| PublicationDateYYYYMMDD | 2007-01-01 |
| PublicationDate_xml | – month: 01 year: 2007 text: 2007-01-01 day: 01 |
| PublicationDecade | 2000 |
| PublicationPlace | Vilnius |
| PublicationPlace_xml | – name: Vilnius |
| PublicationSubtitle | Informatics in Education - An International Journal |
| PublicationTitle | Informatics in education |
| PublicationTitleAlternate | Informatics in Education An International Journal |
| PublicationYear | 2007 |
| Publisher | Vilniaus Universiteto Leidykla Vilnius University Press Institute of Mathematics and Informatics Vilnius University |
| Publisher_xml | – name: Vilniaus Universiteto Leidykla – name: Vilnius University Press – name: Institute of Mathematics and Informatics – name: Vilnius University |
| SSID | ssj0040752 |
| Score | 1.6820796 |
| Snippet | Automatic assessment of programming exercises is typically based on testing approach. Most automatic assessment frameworks execute tests and evaluate test... automatic assessment, programming exercises, testing, test-data, software visualiza-\allowbreak tion, computer science education --- PDFTo preview full article... |
| SourceID | doaj proquest pascalfrancis crossref ceeol |
| SourceType | Open Website Aggregation Database Index Database Enrichment Source Publisher |
| StartPage | 81 |
| SubjectTerms | Applied sciences Assessments automatic assessment Computer programs Computer science computer science education Computer science; control theory; systems Computer systems and distributed systems. User interface Education Exact sciences and technology Format General aspects Higher Education ICT Information and Communications Technologies Methodology and research technology Occupational training. Personnel. Work management Programming programming exercises Readers Software Software engineering software visualization test-data testing Tests Texts Titanium dioxide |
| SummonAdditionalLinks | – databaseName: DOAJ Directory of Open Access Journals dbid: DOA link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV07b9RAEB6hiIIG8QjCBCIXFDQmXj_2UVBASEQVpQgo3Wp2vYsiBR-K7yj49czs7l2IEKKh9Nv-drwzY898H8Brh0Ig81S6TpmGIuKhMV52jYgqSOOjEyMmsQl1dqYvL835b1JfXBOW6YEzcEeto5QjBhwckuc2QU-qRR9a753AgKl1r1Vmm0zlOZgOSVo7lAukviJRSH3o7dZHXOU0bQp7IbdQk59YXd_xS4m-n8skcSGkYpa4-GO2Ti7o9BE8LLFj_T7f82O4F-YnLLtcSjSewrvjFALOX2ucp_rL1cIdkz95-YJOV3_ENdbcT1Kf56qsb7zppIguLfvw-fTk4vhTU_QRGj-Met0gStTORDX1PVIeOJngxkgP6U0bFSVSvXQxehoMgm1wNJGhDp3BbvSjkA77Z7A3r-bwHOqpC5SeykBJqhgIcfRDFFNw2KlIYIcK9hNKtlj4Ys0gyfNX8HaLmvWFVJy1La4tJxcMt81ws9ylsq2s4M3ugO-ZT-Pvu37gYdjtxkTYaQWZhy3mYf9lHhUc3hnE24tq1UuKbis42I7q7cMRFIOm2HCsoN5tpfeOf6bgHFabxWqmbqNwzLz4H7d5AA_yR2P-tvMS9tY3m_AK7vsf66vl5jDZ9i8xigAF priority: 102 providerName: Directory of Open Access Journals |
| Title | Creating and Visualizing Test Data from Programming Exercises |
| URI | https://www.ceeol.com//search/article-detail?id=946521 https://www.proquest.com/docview/746485055 https://www.proquest.com/docview/855687419 https://doaj.org/article/0b407fea4ba4419e8d70ace0ccb1aea9 |
| Volume | 6 |
| WOSCitedRecordID | wos000210162900006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 2335-8971 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0040752 issn: 1648-5831 databaseCode: DOA dateStart: 20030101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVPQU databaseName: Advanced Technologies & Aerospace Database customDbUrl: eissn: 2335-8971 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0040752 issn: 1648-5831 databaseCode: P5Z dateStart: 20030101 isFulltext: true titleUrlDefault: https://search.proquest.com/hightechjournals providerName: ProQuest – providerCode: PRVPQU databaseName: Computer Science Database customDbUrl: eissn: 2335-8971 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0040752 issn: 1648-5831 databaseCode: K7- dateStart: 20030101 isFulltext: true titleUrlDefault: http://search.proquest.com/compscijour providerName: ProQuest – providerCode: PRVPQU databaseName: East Europe, Central Europe Database customDbUrl: eissn: 2335-8971 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0040752 issn: 1648-5831 databaseCode: BYOGL dateStart: 20030101 isFulltext: true titleUrlDefault: https://search.proquest.com/eastcentraleurope providerName: ProQuest – providerCode: PRVPQU databaseName: Education Database customDbUrl: eissn: 2335-8971 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0040752 issn: 1648-5831 databaseCode: M0P dateStart: 20030101 isFulltext: true titleUrlDefault: https://search.proquest.com/education providerName: ProQuest – providerCode: PRVPQU databaseName: Library Science Database (ProQuest) customDbUrl: eissn: 2335-8971 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0040752 issn: 1648-5831 databaseCode: M1O dateStart: 20030101 isFulltext: true titleUrlDefault: https://search.proquest.com/libraryscience providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 2335-8971 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0040752 issn: 1648-5831 databaseCode: BENPR dateStart: 20030101 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: Research Library (ProQuest) customDbUrl: eissn: 2335-8971 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0040752 issn: 1648-5831 databaseCode: M2O dateStart: 20030101 isFulltext: true titleUrlDefault: https://search.proquest.com/pqrl providerName: ProQuest |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1Lb9QwELag5cCFQikiLaxy4MAlNA_Hjg8I0bIVEuoSoYIqLtHYsatKJSmb3R749cw4zlYVggsXS3k69njGM874-xh7pSHLgHAqdS5Vgh4xT5QReZI5aYUyTmcleLIJuVhU5-eqDrk5Q0irnGyiN9Rtb2iN_FBywSucrst31z8TIo2in6uBQeM-2ybEScroO80-T4YYQxVPuIMBgd9clAVkH1Tx6pBSndp1gDCkfdQ4WfRXdyYnj-FPuZIwYHe5kefiD5Pt56GTnf9swWP2KDig8ftxxDxh92y3y3Ymcoc46Pou0TmH1I-n7O2xdy27ixi6Nv52OdBOzF90fIbVxx9gBTHtU4nrMdvrB12aBzKnYY99PZmfHX9MAu9CYnhZrRIAAZVWTrZFARhftsrq0mG_GZU6iQFaIbRzBoWsbMU1GkiobK4gL02ZCQ3FM7bV9Z19zuI2txj2CovBb8Y1T8Fwl7VWQy6dsamN2J7v-CZoztAoLtCjiNibSRCNCWDlxJlx1VDQQhJsRgkSjaZsUhGx15sHrkecjr_fekSS3dxGANv-RL-8aIK-Nil-rHQWuAZ0GLGdrcSPt6kxOgMLKmKzO-PittJKFgK95ogdTKPgtnGbIRCxeHMV9Zl-0kBn-_XQVAQJh26e2v_nCw7Yw3GVmRaDXrCt1XJtX7IH5mZ1OSxnbPtovqi_zPwKA5afZILlaVrPvIZQmVNZl99_A8UEGD4 |
| linkProvider | ProQuest |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9NAEB6VggQXCqUIUyg-gMTF1I-113uoEPShVilRDwH1ZmbXu1Wl4pQ4AcF_4j8ys7ZTVQhuPXBM7Dge77y-9cx8AC81JgnynEqdShVRRiwiZYo0Spy0hTJOJzl6sgk5Hpenp-pkBX4NvTBcVjn4RO-o66nhPfJtKQpRUrjO315-jZg0il-uDgwanVaM7I_vhNjanaM9Wt5XaXqwP9k9jHpSgciIvJxHiAWWWjlZZxkSeKqV1bkjuzcqdpLQR1Zo5wxJoGwpNFk_ljZVmOYmTwqNGV33FtwWWSnZrEYyGhw_QSNP8EMAxDczJf0kIXIp5TaXVtWLfmQi921TcJpeXAuGnjOAazOxpeVxHa_GHyHCx72Dtf_siT2A-32CHb7rLOIhrNhmHdYG8oqw92XrTFfdl7Y8gp1dnzo3ZyE2dfjpvOVO05_8eULihns4x5D7cMKTrprtCx_a78mq2g34eCMCPYbVZtrYJxDWqSVYX1gC94nQIkYjXFJbjal0xsY2gA2_0FXvGdpKiYIypgDeDAtfmX4YO3OCXFQMylhjqk5jmCZUVnERwOvlDy67OSR_P_U9a9LyNB4g7r-Yzs6q3h9VMd2sdBaFRkqISc5a0s3b2BidoEUVwNY1Pbz6U9L7glBBAJuD1l0Jt1S5AMLlUfJX_BIKGztdtFXJI-8ojVVP_3mBF3D3cPLhuDo-Go824V63o84bX89gdT5b2Odwx3ybn7ezLW-DIXy-aRX-DSBJcV8 |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Creating+and+Visualizing+Test+Data+from+Programming+Exercises&rft.jtitle=Informatics+in+education&rft.au=Ihantola%2C+Petri&rft.date=2007-01-01&rft.issn=1648-5831&rft.volume=6&rft.issue=1&rft.spage=81&rft.epage=81&rft_id=info:doi/10.15388%2Finfedu.2007.06&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_s | http://cvtisr.summon.serialssolutions.com/2.0.0/image/custom?url=https%3A%2F%2Fwww.ceeol.com%2F%2Fapi%2Fimage%2Fgetissuecoverimage%3Fid%3Dpicture_2007_60285.jpg |