Perceptual Learning Modules (PLM) in CS1: a Negative Result and a Methodological Warning

Perceptual Learning Modules (PLMs) is a variation of Perceptual Learning based on multiple-choice questionnaires. There exists successful research of the use of PLMs in math and flight training. The possibility of designing and adopting PLMs in Introductory Programming Courses (CS1) is still an open...

Full description

Saved in:
Bibliographic Details
Published in:J.UCS (Annual print and CD-ROM archive ed.) Vol. 29; no. 9; pp. 988 - 1009
Main Authors: Caceffo, Ricardo, Wainer, Jacques, Gama, Guilherme, Garcia, Islene, Azevedo, Rodolfo
Format: Journal Article
Language:English
Published: Bristol Pensoft Publishers 01.01.2023
Graz University of Technology
Subjects:
ISSN:0948-695X, 0948-6968
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Perceptual Learning Modules (PLMs) is a variation of Perceptual Learning based on multiple-choice questionnaires. There exists successful research of the use of PLMs in math and flight training. The possibility of designing and adopting PLMs in Introductory Programming Courses (CS1) is still an open area of study. The goal of this study is to test whether students that received a PLM training on recognising segments of programs will perform better at writing programs. Two PLM interventions were administered to students. The first intervention was a nonrandom controlled experiment, in which students opted to answer the PLM questionnaire (N=40), while the control group consisted of students that did not answer it (N=629). The second intervention was a randomized controlled experiment with a placebo, in which students were randomly assigned to perform either the PLM questionnaire (N=51) or another a placebo activity (N=51). The different forms of analysis of the first experiment results yielded Cohen's d ranging from 0.23 to 0.34 in favor of the PLM intervention. For the second experiment, the effect size was d = -0.11 against the PLM intervention, but the two results were significant. We believe that the cautious conclusion is that there is a null effect in using a PLM activity as part of a CS1 course. The paper is also of interest because of the methodological decisions and techniques used.
AbstractList Perceptual Learning Modules (PLMs) is a variation of Perceptual Learning based on multiple-choice questionnaires. There exists successful research of the use of PLMs in math and flight training. The possibility of designing and adopting PLMs in Introductory Programming Courses (CS1) is still an open area of study. The goal of this study is to test whether students that received a PLM training on recognising segments of programs will perform better at writing programs. Two PLM interventions were administered to students. The first intervention was a nonrandom controlled experiment, in which students opted to answer the PLM questionnaire (N=40), while the control group consisted of students that did not answer it (N=629). The second intervention was a randomized controlled experiment with a placebo, in which students were randomly assigned to perform either the PLM questionnaire (N=51) or another a placebo activity (N=51). The different forms of analysis of the first experiment results yielded Cohen's d ranging from 0.23 to 0.34 in favor of the PLM intervention. For the second experiment, the effect size was d = -0.11 against the PLM intervention, but the two results were significant. We believe that the cautious conclusion is that there is a null effect in using a PLM activity as part of a CS1 course. The paper is also of interest because of the methodological decisions and techniques used.
Perceptual Learning Modules (PLMs) is a variation of Perceptual Learning based on multiple-choice questionnaires. There exists successful research of the use of PLMs in math and flight training. The possibility of designing and adopting PLMs in Introductory Programming Courses (CS1) is still an open area of study. The goal of this study is to test whether students that received a PLM training on recognising segments of programs will perform better at writing programs. Two PLM interventions were administered to students. The first intervention was a nonrandom controlled experiment, in which students opted to answer the PLM questionnaire (N=40), while the control group consisted of students that did not answer it (N=629). The second intervention was a randomized controlled experiment with a placebo, in which students were randomly assigned to perform either the PLM questionnaire (N=51) or another a placebo activity (N=51). The different forms of analysis of the first experiment results yielded Cohen’s d ranging from 0.23 to 0.34 in favor of the PLM intervention. For the second experiment, the effect size was d = -0.11 against the PLM intervention, but the two results were significant. We believe that the cautious conclusion is that there is a null effect in using a PLM activity as part of a CS1 course. The paper is also of interest because of the methodological decisions and techniques used.
Audience Academic
Author Azevedo, Rodolfo
Gama, Guilherme
Caceffo, Ricardo
Wainer, Jacques
Garcia, Islene
Author_xml – sequence: 1
  givenname: Ricardo
  orcidid: 0000-0001-9152-0658
  surname: Caceffo
  fullname: Caceffo, Ricardo
– sequence: 2
  givenname: Jacques
  orcidid: 0000-0001-5201-1244
  surname: Wainer
  fullname: Wainer, Jacques
– sequence: 3
  givenname: Guilherme
  surname: Gama
  fullname: Gama, Guilherme
– sequence: 4
  givenname: Islene
  orcidid: 0000-0002-6023-5982
  surname: Garcia
  fullname: Garcia, Islene
– sequence: 5
  givenname: Rodolfo
  orcidid: 0000-0002-8803-0401
  surname: Azevedo
  fullname: Azevedo, Rodolfo
BookMark eNo9kVtr3DAQhUVJoLn0pb9A0Je2sFvLuvctLE0a2G1DLzRvYiRLrhbH2kh2IP--SlzCPMxwmPk4zDlFR2MaPUJvSbOmSstP-9mVtRaUyVfopNFMrYQW6uhl5rev0Wkp-6ZphdDqBN3e-Oz8YZphwFsPeYxjj3epmwdf8Pub7e4DjiPe_CSfMeBvvocpPnj8w5d5mDCMXVV3fvqbujSkPrpK-bNAztFxgKH4N__7Gfp9-eXX5utq-_3qenOxXTnK9bRi1JFWCasFAGuDBMKCY6QNjVPBQksC6ZTlTirVMuubIG0nQGinNAvCWXqGrhdul2BvDjneQX40CaJ5FlLuDeQpusEbRhSHzirHg2aMW-04pTYE1nqQKnSV9W5hHXK6n32ZzD7Neaz2TfVY38o5aevWetnqoULjGNKUwdXq_F10NY8Qq34hpRSS0IbXg4_LgcuplOzDi03SmKfYzFNs5jk2-g8e6Yuc
ContentType Journal Article
Copyright COPYRIGHT 2023 Pensoft Publishers
2023. This work is licensed under https://creativecommons.org/licenses/by-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and conditions, you may use this content in accordance with the terms of the License.
Copyright_xml – notice: COPYRIGHT 2023 Pensoft Publishers
– notice: 2023. This work is licensed under https://creativecommons.org/licenses/by-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and conditions, you may use this content in accordance with the terms of the License.
DBID AAYXX
CITATION
8FE
8FG
ABUWG
AFKRA
ARAPS
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
GNUQQ
HCIFZ
JQ2
K7-
P62
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
DOA
DOI 10.3897/jucs.96347
DatabaseName CrossRef
ProQuest SciTech Collection
ProQuest Technology Collection
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
Advanced Technologies & Computer Science Collection
ProQuest Central Essentials - QC
ProQuest Central
ProQuest Technology Collection
ProQuest One
ProQuest Central Korea
ProQuest Central Student
SciTech Premium Collection
ProQuest Computer Science Collection
Computer Science Database
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Premium
ProQuest One Academic (New)
ProQuest Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
ProQuest Central China
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
Publicly Available Content Database
Advanced Technologies & Aerospace Collection
Computer Science Database
ProQuest Central Student
Technology Collection
ProQuest One Academic Middle East (New)
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Essentials
ProQuest Computer Science Collection
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Technology Collection
ProQuest SciTech Collection
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
ProQuest One Academic UKI Edition
ProQuest Central Korea
ProQuest Central (New)
ProQuest One Academic
ProQuest One Academic (New)
DatabaseTitleList CrossRef
Publicly Available Content Database


Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: PIMPY
  name: ProQuest Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISSN 0948-6968
EndPage 1009
ExternalDocumentID oai_doaj_org_article_4185adb8c5f9445b9c533bff42ea78fd
A777671305
10_3897_jucs_96347
GroupedDBID 29L
2WC
5GY
AAYXX
ACGFO
ALMA_UNASSIGNED_HOLDINGS
CITATION
EBS
EJD
FRP
OVT
RNS
SJN
29J
AAKPC
AENEX
AFFHD
AFKRA
ARAPS
BENPR
BGLVJ
CCPQU
GROUPED_DOAJ
H13
HCIFZ
IAO
ICD
ISE
ITC
IVC
K7-
OK1
P2P
PHGZM
PHGZT
PIMPY
PQGLB
TR2
8FE
8FG
ABUWG
AZQEC
DWQXO
GNUQQ
JQ2
P62
PKEHL
PQEST
PQQKQ
PQUKI
PRINS
ID FETCH-LOGICAL-c359t-43c1286b96aa42f7a14fc412f0c8fba21f1d8b5c78824be0f7bd6a69c894f6cb3
IEDL.DBID K7-
ISICitedReferencesCount 0
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001089496300003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 0948-695X
IngestDate Fri Oct 03 12:50:32 EDT 2025
Sat Nov 01 15:01:27 EDT 2025
Tue Nov 04 18:36:51 EST 2025
Sat Nov 29 04:59:37 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 9
Language English
License https://creativecommons.org/licenses/by-nd/4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c359t-43c1286b96aa42f7a14fc412f0c8fba21f1d8b5c78824be0f7bd6a69c894f6cb3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-8803-0401
0000-0002-6023-5982
0000-0001-5201-1244
0000-0001-9152-0658
OpenAccessLink https://www.proquest.com/docview/2869635512?pq-origsite=%requestingapplication%
PQID 2869635512
PQPubID 6474026
PageCount 22
ParticipantIDs doaj_primary_oai_doaj_org_article_4185adb8c5f9445b9c533bff42ea78fd
proquest_journals_2869635512
gale_infotracacademiconefile_A777671305
crossref_primary_10_3897_jucs_96347
PublicationCentury 2000
PublicationDate 2023-01-01
PublicationDateYYYYMMDD 2023-01-01
PublicationDate_xml – month: 01
  year: 2023
  text: 2023-01-01
  day: 01
PublicationDecade 2020
PublicationPlace Bristol
PublicationPlace_xml – name: Bristol
PublicationTitle J.UCS (Annual print and CD-ROM archive ed.)
PublicationYear 2023
Publisher Pensoft Publishers
Graz University of Technology
Publisher_xml – name: Pensoft Publishers
– name: Graz University of Technology
SSID ssj0026698
ssj0028598
Score 2.3028924
Snippet Perceptual Learning Modules (PLMs) is a variation of Perceptual Learning based on multiple-choice questionnaires. There exists successful research of the use...
SourceID doaj
proquest
gale
crossref
SourceType Open Website
Aggregation Database
Index Database
StartPage 988
SubjectTerms Analysis
Computer Science Education
CS1
Experiments
Flight training
Intervention
Learning
Modules
Multiple choice
Perceptual Learni
Perceptual learning
Questionnaires
Students
SummonAdditionalLinks – databaseName: DOAJ Directory of Open Access Journals
  dbid: DOA
  link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1JaxsxFBbF9NBL06YtcZIWQQtNDxPPorW31NT0YBuTbr6Jp804mHHwzOT3V5ql-FJ6yVWI4fE9vU1ovg-hD5Br4lymE5BWJ4RSm0jHWUKYt6AzDUV7mfNrzpdLsV7L1ZHUV3wT1tEDd8BNIrkKWC0M9ZIQqqUJDYr2nuQOuPA2Zt-Uy2GY6kctQaXoyEhDQeaTu8ZU1-GoRRGVo_LTsvT_Kxe3BWb2Aj3vO0N801n0Ej1x5Sk6GVQXcB-Er9B61b1FacLmnh11gxd72-xcha9W88UnvC3x9Hv2GQNeuk3L7I1vXdXsagylDauLVjZ6SHv4d_eR1-jn7OuP6bek10dITEFlnZDChOrCtGQAJPccMuINyXKfGuE15JnPrNDUhCk3J9qlnmvLgEkjJPHM6OINGpX70p0hXBAhmYx3_ZoQI7jmEAYZCp47w1wKY_R-gE3ddzQYKowPEVwVwVUtuGP0JSL6d0ekrm4XgkNV71D1P4eO0cfoDxUDrD6Agf4_gWBopKpSNzwSEIXSS8focnCZ6iOvUgEQGZuoLD9_DGsu0LMoMN9dulyiUX1o3Fv01DzU2-rwrj10fwCN8N4C
  priority: 102
  providerName: Directory of Open Access Journals
Title Perceptual Learning Modules (PLM) in CS1: a Negative Result and a Methodological Warning
URI https://www.proquest.com/docview/2869635512
https://doaj.org/article/4185adb8c5f9445b9c533bff42ea78fd
Volume 29
WOSCitedRecordID wos001089496300003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 0948-6968
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0026698
  issn: 0948-695X
  databaseCode: DOA
  dateStart: 20200101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVPQU
  databaseName: Computer Science Database
  customDbUrl:
  eissn: 0948-6968
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0026698
  issn: 0948-695X
  databaseCode: K7-
  dateStart: 20220101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/compscijour
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest Central
  customDbUrl:
  eissn: 0948-6968
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0026698
  issn: 0948-695X
  databaseCode: BENPR
  dateStart: 20220101
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest Publicly Available Content Database
  customDbUrl:
  eissn: 0948-6968
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0026698
  issn: 0948-695X
  databaseCode: PIMPY
  dateStart: 20220101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/publiccontent
  providerName: ProQuest
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1Lb9QwELag5cCF8hRLy8oSSMDBdJ04fnBBbdUKpO4qKq_lZPm5Kqqy7Sbh92M7zsIFLlydyLLyeWY8M873AfBSFZo4hzVSwmpEqsoi4RhFhHqrNNaqTMWcr-dsseDLpahzwa3N1ypHn5gctV2bWCM_LDgVMTji4v31DYqqUbG7miU0boNdXAQnHJuyDG0TLkrFtqUQidqSWxaEIyqq5cBVGuI1O_zRm_ZtmD1qrPwRnRKJ_99cdYo_Z3v_u_L74F4-ecKjYas8ALdc8xDsjaoOMBv5I7Csh7sufXg5s6-u4Hxt-yvXwtf1-fwNvGzgySf8Diq4cKvEHA4vXNtfdVA1NozOkyz16Fbht2GSx-DL2ennkw8o6y8gU1aiQ6Q0IXpRLahSpPBMYeINwYWfGe61KrDHluvKhCy6INrNPNOWKioMF8RTo8snYKdZN-4pgCXhgorYS9CEGM40UyFRqpRnzlA3UxPwYvzu8nqg2ZAhPYnoyIiOTOhMwHGEZPtGpMZOA-vNSmZLk5GNR1nNTeUFIZUWJpxotfekcIpxbyfgVQRURgPuNsqo_B9CWGikwpJHLBIchdBeTcDBCKjMlt3K32g--_fjfXA3StMP5ZoDsNNtevcc3DE_u8t2MwW7x6eL-mKaagDTtG3DWP1xXn__BQJM8_o
linkProvider ProQuest
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V3LbtQwFLVKQYIN5SkGClgCBCxMJ47jBxJCpVC1modG0MLsjJ-joipTJgmIn-IbsZ1kYAO7Ltg6lmXHx-fe68e5ADxWWBPnMo2UsBqRorBIOEYRod4qnWmVp82cj2M2nfL5XMw2wM_-LUy8VtlzYiJquzRxj3wHcyqicczw67OvKGaNiqerfQqNFhYj9-N7CNmqV4dvw_w-wXj_3dHeAeqyCiCTF6JGJDeBk6kWVCmCPVMZ8YZk2A8N91rhzGeW68KE2BAT7YaeaUsVFYYL4qnReWj3ArhIcs7iuhoxtA7wKBXrI4woDJfMgCAcUVHMW23U4B-wnS-NqV6E0cScLn9Yw5Q04G-mIdm7_a3_7U9dA1c7zxrutkvhOthw5Q2w1WetgB2J3QTzWXuXpwmVO3XZBZwsbXPqKvhsNp48hycl3PuQvYQKTt0iKaPD965qTmuoShtKJyntdm824Ke2kVvg-FzGdxtslsvS3QEwJ1xQEc9KNCGGM81UCAQL5Zkz1A3VADzq51metTIiMoRfEQ0yokEmNAzAmwiBdY0o_Z0KlquF7JhERrUhZTU3hReEFFqY4LFr7wl2inFvB-BpBJCMBFWvlFHdO4vQ0Sj1JXdZFHAKrksxANs9gGTHXJX8jZ67__78EFw-OJqM5fhwOroHruDg_LVbU9tgs1417j64ZL7VJ9XqQVokEHw-b6z9AougTjc
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Perceptual+Learning+Modules+%28PLM%29+in+CS1%3A+a+Negative+Result+and+a+Methodological+Warning&rft.jtitle=Journal+of+Universal+Computer+Science&rft.au=Caceffo%2C+Ricardo&rft.au=Wainer%2C+Jacques&rft.au=Gama%2C+Guilherme&rft.au=Garcia%2C+Islene&rft.date=2023-01-01&rft.pub=Pensoft+Publishers&rft.issn=0948-695X&rft.eissn=0948-6968&rft.volume=29&rft.issue=9&rft.spage=988&rft_id=info:doi/10.3897%2Fjucs.96347
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0948-695X&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0948-695X&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0948-695X&client=summon