Assessing implicit computational thinking in Zoombinis puzzle gameplay

There has been growing interest in assessing computational thinking (CT) across diverse learners beyond the traditional forms of tests and assignments. Learning games offer the potential for innovative, stealth assessments of students' implicit learning from gameplay behaviors. This paper repor...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computers in human behavior Jg. 120; S. 106707
Hauptverfasser: Rowe, Elizabeth, Almeda, Ma Victoria, Asbell-Clarke, Jodi, Scruggs, Richard, Baker, Ryan, Bardar, Erin, Gasca, Santiago
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Elmsford Elsevier Ltd 01.07.2021
Elsevier Science Ltd
Schlagworte:
ISSN:0747-5632, 1873-7692
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract There has been growing interest in assessing computational thinking (CT) across diverse learners beyond the traditional forms of tests and assignments. Learning games offer the potential for innovative, stealth assessments of students' implicit learning from gameplay behaviors. This paper reports on the measurement of implicit CT practices demonstrated by upper elementary- and middle-school students as they play the CT learning game Zoombinis. The process of using the gameplay log data to build valid automated detectors of students' implicit CT practices is discussed. Findings from this study provide implications for analyzing gameplay behaviors at scale, leading to the development of models for the assessment of implicit STEM learning. •Described an emergent approach to the development of game-based learning assessments.•Used data-mining methods to create detectors of students' implicit computational thinking based on gameplay behaviors.•Results showed in-game measures were significantly related to external measures of computational thinking.•Applications of in-game measures as formative computational thinking assessments of teachers and designers.
AbstractList There has been growing interest in assessing computational thinking (CT) across diverse learners beyond the traditional forms of tests and assignments. Learning games offer the potential for innovative, stealth assessments of students' implicit learning from gameplay behaviors. This paper reports on the measurement of implicit CT practices demonstrated by upper elementary- and middle-school students as they play the CT learning game Zoombinis. The process of using the gameplay log data to build valid automated detectors of students' implicit CT practices is discussed. Findings from this study provide implications for analyzing gameplay behaviors at scale, leading to the development of models for the assessment of implicit STEM learning.
There has been growing interest in assessing computational thinking (CT) across diverse learners beyond the traditional forms of tests and assignments. Learning games offer the potential for innovative, stealth assessments of students' implicit learning from gameplay behaviors. This paper reports on the measurement of implicit CT practices demonstrated by upper elementary- and middle-school students as they play the CT learning game Zoombinis. The process of using the gameplay log data to build valid automated detectors of students' implicit CT practices is discussed. Findings from this study provide implications for analyzing gameplay behaviors at scale, leading to the development of models for the assessment of implicit STEM learning. •Described an emergent approach to the development of game-based learning assessments.•Used data-mining methods to create detectors of students' implicit computational thinking based on gameplay behaviors.•Results showed in-game measures were significantly related to external measures of computational thinking.•Applications of in-game measures as formative computational thinking assessments of teachers and designers.
ArticleNumber 106707
Author Rowe, Elizabeth
Baker, Ryan
Gasca, Santiago
Asbell-Clarke, Jodi
Almeda, Ma Victoria
Scruggs, Richard
Bardar, Erin
Author_xml – sequence: 1
  givenname: Elizabeth
  surname: Rowe
  fullname: Rowe, Elizabeth
  email: elizabeth_rowe@terc.edu
  organization: Educational Gaming Environments Group (EdGE), TERC, USA
– sequence: 2
  givenname: Ma Victoria
  surname: Almeda
  fullname: Almeda, Ma Victoria
  email: mia_almeda@terc.edu
  organization: Educational Gaming Environments Group (EdGE), TERC, USA
– sequence: 3
  givenname: Jodi
  surname: Asbell-Clarke
  fullname: Asbell-Clarke, Jodi
  email: jodi_asbell-clarke@terc.edu
  organization: Educational Gaming Environments Group (EdGE), TERC, USA
– sequence: 4
  givenname: Richard
  surname: Scruggs
  fullname: Scruggs, Richard
  email: rscr@gse.upenn.edu
  organization: University of Pennsylvania, USA
– sequence: 5
  givenname: Ryan
  surname: Baker
  fullname: Baker, Ryan
  email: ryanshaunbaker@gmail.com
  organization: University of Pennsylvania, USA
– sequence: 6
  givenname: Erin
  surname: Bardar
  fullname: Bardar, Erin
  email: erin_bardar@terc.edu
  organization: Educational Gaming Environments Group (EdGE), TERC, USA
– sequence: 7
  givenname: Santiago
  surname: Gasca
  fullname: Gasca, Santiago
  email: santiago_gasca@terc.edu
  organization: Educational Gaming Environments Group (EdGE), TERC, USA
BookMark eNp9kDFPwzAQhS1UJNrCD2CLxJzic2K7EVNVUUCqxAILi-U4TuuQxMFOkNpfj9swMTCdTve-03tvhiatbTVCt4AXgIHdVwu1zxcEEwg745hfoCkseRJzlpEJmmKe8piyhFyhmfcVxphSzKZos_Jee2_aXWSarjbK9JGyTTf0sje2lXXU7037eb630Ye1TW5a46NuOB5rHe1ko7taHq7RZSlrr29-5xy9bx7f1s_x9vXpZb3axiohtI-pKjCQLGHLlOngBvIMiOQ5pMGlBlAZaExlmpQFFAySlKlELktFU5xDCTqZo7vxb-fs16B9Lyo7uGDTC0LD21MBJKj4qFLOeu90KUKsc57eSVMLwOJUmqhEKE2cGDGWFkj4Q3bONNId_mUeRkaH4N9GO-GV0a3ShXFa9aKw5h_6B2b1hcs
CitedBy_id crossref_primary_10_2196_40306
crossref_primary_10_1007_s40692_023_00284_w
crossref_primary_10_3389_fcomm_2023_1155840
crossref_primary_10_3390_computers10050068
crossref_primary_10_3390_math10203857
crossref_primary_10_37251_jee_v6i3_1754
crossref_primary_10_1016_j_tsc_2025_101955
crossref_primary_10_1007_s40593_023_00382_x
crossref_primary_10_1080_2331186X_2023_2191751
crossref_primary_10_1177_07356331211055379
crossref_primary_10_1145_3486598
crossref_primary_10_1007_s10639_023_11974_4
crossref_primary_10_3917_enf2_224_0479
crossref_primary_10_3390_su141710672
crossref_primary_10_1080_08993408_2023_2245687
crossref_primary_10_1016_j_compedu_2023_104794
crossref_primary_10_1016_j_compedu_2025_105245
crossref_primary_10_1145_3578269
crossref_primary_10_1002_cae_70073
crossref_primary_10_1111_bjet_13443
crossref_primary_10_1002_tea_21899
crossref_primary_10_1007_s10639_023_12265_8
crossref_primary_10_1109_ACCESS_2024_3513544
crossref_primary_10_1002_acp_4029
crossref_primary_10_1007_s11251_024_09679_3
crossref_primary_10_1007_s10758_025_09833_x
crossref_primary_10_3390_educsci12060380
crossref_primary_10_1007_s10639_024_12553_x
crossref_primary_10_1177_07356331241242435
crossref_primary_10_3389_fpsyg_2022_1082659
crossref_primary_10_1016_j_compedu_2022_104462
crossref_primary_10_1016_j_ijhcs_2025_103508
crossref_primary_10_1111_bjet_13281
crossref_primary_10_1111_bjet_13463
crossref_primary_10_1111_bjet_13263
crossref_primary_10_1111_bjet_13285
crossref_primary_10_1016_j_chb_2022_107304
Cites_doi 10.1111/j.1467-9280.2007.01954.x
10.15388/infedu.2017.03
10.1016/j.chb.2016.05.023
10.1111/j.1745-3992.2004.tb00149.x
10.1093/jac/dkt041
10.3102/0013189X12463051
10.1037/0096-3445.118.3.219
10.1007/s10639-012-9240-x
10.1145/1118178.1118215
10.1145/3105910
10.1016/j.chb.2016.05.047
10.1148/radiology.143.1.7063747
10.1007/s11528-013-0655-z
10.1007/s10956-008-9120-8
10.1016/j.compedu.2014.08.013
10.1177/2372732218790017
10.1007/s10956-015-9581-5
10.1017/S0031819100066110
10.1016/j.compedu.2011.05.007
10.1177/001316446002000104
10.1111/j.2517-6161.1995.tb02031.x
10.1080/10508406.2015.1078244
10.1007/BF02310555
10.1002/1097-4679(199103)47:2<277::AID-JCLP2270470215>3.0.CO;2-I
10.1145/1929887.1929905
10.1037/0096-3445.115.3.255
10.1080/14697017.2013.851953
10.1111/bjet.12625
10.1016/j.chb.2017.03.043
10.15388/infedu.2018.08
10.1098/rstb.2008.0337
10.1016/j.edurev.2017.09.003
ContentType Journal Article
Copyright 2021 Elsevier Ltd
Copyright Elsevier Science Ltd. Jul 2021
Copyright_xml – notice: 2021 Elsevier Ltd
– notice: Copyright Elsevier Science Ltd. Jul 2021
DBID AAYXX
CITATION
7SC
8FD
JQ2
L7M
L~C
L~D
DOI 10.1016/j.chb.2021.106707
DatabaseName CrossRef
Computer and Information Systems Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Computer and Information Systems Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Advanced Technologies Database with Aerospace
ProQuest Computer Science Collection
Computer and Information Systems Abstracts Professional
DatabaseTitleList Computer and Information Systems Abstracts

DeliveryMethod fulltext_linktorsrc
Discipline Psychology
Computer Science
EISSN 1873-7692
ExternalDocumentID 10_1016_j_chb_2021_106707
S0747563221000297
GroupedDBID --K
--M
-~X
.DC
.~1
0R~
186
1B1
1RT
1~.
1~5
29F
4.4
457
4G.
53G
5GY
5VS
6J9
7-5
71M
8P~
9JN
9JO
AABNK
AACTN
AADFP
AAEDT
AAEDW
AAFJI
AAGJA
AAGUQ
AAIAV
AAIKJ
AAKOC
AALRI
AAOAW
AAQFI
AAQXK
AAXUO
AAYFN
ABBOA
ABFNM
ABFRF
ABIVO
ABJNI
ABMAC
ABMMH
ABOYX
ABXDB
ABYKQ
ACDAQ
ACGFO
ACGFS
ACHQT
ACNNM
ACRLP
ACXNI
ACZNC
ADBBV
ADEZE
ADHUB
ADJOM
ADMUD
AEBSH
AEFWE
AEKER
AFFNX
AFKWA
AFTJW
AFYLN
AGHFR
AGUBO
AGYEJ
AHHHB
AHZHX
AIALX
AIEXJ
AIKHN
AITUG
AJBFU
AJOXV
AKYCK
ALMA_UNASSIGNED_HOLDINGS
AMFUW
AMRAJ
AOMHK
AOUOD
ASPBG
AVARZ
AVWKF
AXJTR
AZFZN
BKOJK
BLXMC
CS3
DU5
EBS
EFJIC
EFLBG
EJD
EO8
EO9
EP2
EP3
F5P
FA8
FDB
FEDTE
FGOYB
FIRID
FNPLU
FYGXN
G-2
G-Q
GBLVA
GBOLZ
HF~
HLZ
HMW
HVGLF
HZ~
H~9
IHE
J1W
KOM
LG9
LPU
M3V
M41
MO0
N9A
NHB
O-L
O9-
OAUVE
OKEIE
OZT
P-8
P-9
P2P
PC.
PRBVW
Q38
R2-
RIG
ROL
RPZ
RXW
SBC
SCC
SDF
SDG
SDP
SES
SEW
SPC
SPCBC
SPS
SSB
SSO
SSV
SSY
SSZ
T5K
TAE
UMD
UNMZH
WUQ
XPP
XSW
ZCA
~G-
9DU
AATTM
AAXKI
AAYWO
AAYXX
ABWVN
ACLOT
ACRPL
ACVFH
ADCNI
ADNMO
AEIPS
AEUPX
AFJKZ
AFPUW
AGQPQ
AIGII
AIIUN
AKBMS
AKRWK
AKYEP
ANKPU
APXCP
CITATION
EFKBS
~HD
7SC
8FD
AGCQF
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c325t-5cd012936846e5631b912a7b14692e11c91e05a43fd1d61346c3a8fc540b1f1e3
ISICitedReferencesCount 52
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000641330900003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 0747-5632
IngestDate Wed Aug 13 09:30:17 EDT 2025
Sat Nov 29 07:17:32 EST 2025
Tue Nov 18 20:27:37 EST 2025
Fri Feb 23 02:44:12 EST 2024
IsPeerReviewed true
IsScholarly true
Keywords Computational thinking
Implicit learning
Classification algorithms
Learning games
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c325t-5cd012936846e5631b912a7b14692e11c91e05a43fd1d61346c3a8fc540b1f1e3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
PQID 2536820212
PQPubID 2038346
ParticipantIDs proquest_journals_2536820212
crossref_citationtrail_10_1016_j_chb_2021_106707
crossref_primary_10_1016_j_chb_2021_106707
elsevier_sciencedirect_doi_10_1016_j_chb_2021_106707
PublicationCentury 2000
PublicationDate July 2021
2021-07-00
20210701
PublicationDateYYYYMMDD 2021-07-01
PublicationDate_xml – month: 07
  year: 2021
  text: July 2021
PublicationDecade 2020
PublicationPlace Elmsford
PublicationPlace_xml – name: Elmsford
PublicationTitle Computers in human behavior
PublicationYear 2021
Publisher Elsevier Ltd
Elsevier Science Ltd
Publisher_xml – name: Elsevier Ltd
– name: Elsevier Science Ltd
References Allan, Coulter, Denner, Erickson, Lee, Malyn-Smith (bib1) 2010
Hanley, McNeil (bib37) 1982; 143
Shute, Sun, Asbell-Clarke (bib9) 2017; 22
Dawson, Soulières, Ann Gernsbacher, Mottron (bib27) 2007; 18
González (bib29) 2015
Cohen (bib22) 1960; 20
Benjamini, Hochberg (bib18) 1995; 57
(bib5) 7 August 2015
(bib23) 2017
Grover, Cooper, Pea (bib33) 2014
Hicks, Eagle, Rowe, Asbell-Clarke, Edwards, Barnes (bib38) 2016
Ritchhart, Church, Morrison (bib65) 2011
Weintrop, Beheshti, Horn, Orton, Jona, Trouille (bib80) 2016; 25
(bib53) 2010
(bib73) 2013
Wang (bib78) 2014; 27
Raven (bib62) 1981
Barr, Stephenson (bib17) 2011; 2
Dagienė, Futschek (bib25) 2008
Mislevy, Haertel (bib50) 2006
Baker (bib13) 2015
Wing (bib85) 2011; 20–23
Plass, Mayer, Homer (bib59) 2020
Dagienė, Stupurienė, Vinikienė (bib26) 2016
Shute (bib68) 2011; 55
Weintrop, Killen, Munzar, Franke (bib81) 2019
Kim, Rosenheck (bib41) 2018
Li, Gobert, Graesser, Dickler (bib46) 2018; 5
Rowe, Asbell-Clarke, Gasca, Cunningham (bib6) 2017, August
Wing (bib84) 2006; 49
Almeda, Rowe, Asbell-Clarke, Baker, Scruggs, Bardar, Gasca (bib11) 2019
Squire (bib72) 2011
Li, Gobert, Dickler (bib45) 2017
Mislevy, Steinberg, Almond (bib51) 2003; 1
Tissenbaum, Sheldon, Sherman, Abelson, Weintrop, Jona (bib76) 2018; ume 2
Izu, Mirolo, Settle, Mannila, Stupurienė (bib39) 2017; 16
Reber (bib63) 1989; 118
Clark, Nelson, Chang, D'Angelo, Slack, Martinez-Garza (bib21) 2011; 57
von Wangenheim, Hauck, Demetrio, Pelle, da Cruz Alves, Barbosa (bib79) 2018; 17
Nguyen, Gardner, Sheridan (bib54) 2018; 49
Grover, Basu, Bienkowski, Eagle, Diana, Stamper (bib32) 2017; 17
Lee (bib44) 2016
Baker, Clarke-Midura (bib14) 2013
Martinuzzi, Krumay (bib48) 2013; 13
Rowe, Asbell-Clarke, Almeda, Bardar, Baker, Scruggs (bib12) 2019
Brennan, Resnick (bib19) 2012; Vol. 1
Martin, Petrick Smith, Forsgren, Aghababyan, Janisiewicz, Baker (bib47) 2015; 24
Pardos, Baker, San Pedro, Gowda, Gowda (bib58) 2013
Sternberg (bib75) 1996
Lave, Murtaugh, de la Roche (bib43) 1984
Rowe, Asbell-Clarke, Gasca, Cunningham (bib7) 2017, October
Polyani (bib60) 1966; 41
Grover (bib30) 2017
Halverson, Wills, Owen (bib36) 2012
Qian, Clark (bib61) 2016; 63
Mishra, Yadav (bib49) 2013; 57
Koh, Basawapatna, Nickerson, Repenning (bib42) 2014
Grover, Basu (bib31) 2017
Shute, Masduki, Donmez, Dennen, Kim, Jeong (bib69) 2010
Wiebe, London, Aksit, Mott, Boyer, Lester (bib83) 2019
Shute, Ventura, Ke (bib70) 2015; 80
Ginsburg, Lee, Boyd (bib28) 2008; Volume 22
Grover, Pea (bib34) 2013; 42
Vygotsky (bib77) 1978
Rowe, Asbell-Clarke, Baker, Gasca, Bardar, Scruggs (bib10) 2018, April
Ceci, Liker (bib20) 1986; 115
Moreno-León, Robles (bib52) 2015
Rowe, Asbell-Clarke, Baker (bib4) 2015
Revell, Wang, Wood, Morrow, Tempelman, Hamers, DeWolf (bib64) 2013; 68
Barendsen, Mannila, Demo, Grgurina, Izu, Mirolo, Stupurienė (bib15) 2015
Steinkuehler, Duncan (bib74) 2008; 17
O'Leary, Rusch, Guastello (bib57) 1991; 47
Cronbach (bib24) 1951; 16
Werner, Denner, Campe, Kawamoto (bib82) 2012
Ota, Morimoto, Kato (bib56) 2016
Asbell-Clarke, Rowe, Almeda, Gasca, Edwards, Bardar, Shute, Ventura (bib3) 2021
Shute, Wang, Greiff, Zhao, Moore (bib71) 2016; 63
Haladyna, Downing (bib35) 2004; 23
Sengupta, Kinnebrew, Basu, Biswas, Clark (bib67) 2013; 18
Baron-Cohen, Ashwin, Ashwin, Tavassoli, Chakrabarti (bib16) 2009; 364
Nunes, Schliemann, Carraher (bib55) 1993
San Pedro, Baker, Bowers, Heffernan (bib66) 2013
Arena, Schwartz (bib2) 2013
Rowe, Asbell-Clarke, Baker, Eagle, Hicks, Barnes, Brown, Edwards (bib8) 2017; 76
Ritchhart (10.1016/j.chb.2021.106707_bib65) 2011
Ceci (10.1016/j.chb.2021.106707_bib20) 1986; 115
Almeda (10.1016/j.chb.2021.106707_bib11) 2019
Baker (10.1016/j.chb.2021.106707_bib13) 2015
Revell (10.1016/j.chb.2021.106707_bib64) 2013; 68
Dagienė (10.1016/j.chb.2021.106707_bib26) 2016
Izu (10.1016/j.chb.2021.106707_bib39) 2017; 16
Sengupta (10.1016/j.chb.2021.106707_bib67) 2013; 18
Wiebe (10.1016/j.chb.2021.106707_bib83) 2019
Squire (10.1016/j.chb.2021.106707_bib72) 2011
Grover (10.1016/j.chb.2021.106707_bib30) 2017
Shute (10.1016/j.chb.2021.106707_bib70) 2015; 80
Martin (10.1016/j.chb.2021.106707_bib47) 2015; 24
Ginsburg (10.1016/j.chb.2021.106707_bib28) 2008; Volume 22
Kim (10.1016/j.chb.2021.106707_bib41) 2018
Barr (10.1016/j.chb.2021.106707_bib17) 2011; 2
Reber (10.1016/j.chb.2021.106707_bib63) 1989; 118
Asbell-Clarke (10.1016/j.chb.2021.106707_bib3) 2021
Martinuzzi (10.1016/j.chb.2021.106707_bib48) 2013; 13
Wang (10.1016/j.chb.2021.106707_bib78) 2014; 27
Rowe (10.1016/j.chb.2021.106707_bib8) 2017; 76
Mislevy (10.1016/j.chb.2021.106707_bib51) 2003; 1
Baron-Cohen (10.1016/j.chb.2021.106707_bib16) 2009; 364
Sternberg (10.1016/j.chb.2021.106707_bib75) 1996
Shute (10.1016/j.chb.2021.106707_bib9) 2017; 22
Lave (10.1016/j.chb.2021.106707_bib43) 1984
Mislevy (10.1016/j.chb.2021.106707_bib50) 2006
Allan (10.1016/j.chb.2021.106707_bib1) 2010
Nguyen (10.1016/j.chb.2021.106707_bib54) 2018; 49
Halverson (10.1016/j.chb.2021.106707_bib36) 2012
Werner (10.1016/j.chb.2021.106707_bib82) 2012
Moreno-León (10.1016/j.chb.2021.106707_bib52) 2015
Qian (10.1016/j.chb.2021.106707_bib61) 2016; 63
Barendsen (10.1016/j.chb.2021.106707_bib15) 2015
Shute (10.1016/j.chb.2021.106707_bib69) 2010
González (10.1016/j.chb.2021.106707_bib29) 2015
Rowe (10.1016/j.chb.2021.106707_bib10) 2018
Grover (10.1016/j.chb.2021.106707_bib31) 2017
Wing (10.1016/j.chb.2021.106707_bib85) 2011; 20–23
(10.1016/j.chb.2021.106707_bib5) 2015
Plass (10.1016/j.chb.2021.106707_bib59) 2020
Polyani (10.1016/j.chb.2021.106707_bib60) 1966; 41
Dawson (10.1016/j.chb.2021.106707_bib27) 2007; 18
Koh (10.1016/j.chb.2021.106707_bib42) 2014
Li (10.1016/j.chb.2021.106707_bib46) 2018; 5
von Wangenheim (10.1016/j.chb.2021.106707_bib79) 2018; 17
Haladyna (10.1016/j.chb.2021.106707_bib35) 2004; 23
Shute (10.1016/j.chb.2021.106707_bib71) 2016; 63
Nunes (10.1016/j.chb.2021.106707_bib55) 1993
Steinkuehler (10.1016/j.chb.2021.106707_bib74) 2008; 17
Rowe (10.1016/j.chb.2021.106707_bib6) 2017
Arena (10.1016/j.chb.2021.106707_bib2) 2013
Hanley (10.1016/j.chb.2021.106707_bib37) 1982; 143
Vygotsky (10.1016/j.chb.2021.106707_bib77) 1978
Wing (10.1016/j.chb.2021.106707_bib84) 2006; 49
Cohen (10.1016/j.chb.2021.106707_bib22) 1960; 20
(10.1016/j.chb.2021.106707_bib23) 2017
(10.1016/j.chb.2021.106707_bib73) 2013
(10.1016/j.chb.2021.106707_bib53) 2010
Shute (10.1016/j.chb.2021.106707_bib68) 2011; 55
Baker (10.1016/j.chb.2021.106707_bib14) 2013
Grover (10.1016/j.chb.2021.106707_bib34) 2013; 42
O'Leary (10.1016/j.chb.2021.106707_bib57) 1991; 47
Weintrop (10.1016/j.chb.2021.106707_bib80) 2016; 25
Clark (10.1016/j.chb.2021.106707_bib21) 2011; 57
Grover (10.1016/j.chb.2021.106707_bib33) 2014
Weintrop (10.1016/j.chb.2021.106707_bib81) 2019
Lee (10.1016/j.chb.2021.106707_bib44) 2016
Tissenbaum (10.1016/j.chb.2021.106707_bib76) 2018; ume 2
Brennan (10.1016/j.chb.2021.106707_bib19) 2012; Vol. 1
Rowe (10.1016/j.chb.2021.106707_bib12) 2019
Ota (10.1016/j.chb.2021.106707_bib56) 2016
Li (10.1016/j.chb.2021.106707_bib45) 2017
Rowe (10.1016/j.chb.2021.106707_bib4) 2015
Benjamini (10.1016/j.chb.2021.106707_bib18) 1995; 57
Dagienė (10.1016/j.chb.2021.106707_bib25) 2008
Grover (10.1016/j.chb.2021.106707_bib32) 2017; 17
Hicks (10.1016/j.chb.2021.106707_bib38) 2016
San Pedro (10.1016/j.chb.2021.106707_bib66) 2013
Raven (10.1016/j.chb.2021.106707_bib62) 1981
Cronbach (10.1016/j.chb.2021.106707_bib24) 1951; 16
Mishra (10.1016/j.chb.2021.106707_bib49) 2013; 57
Pardos (10.1016/j.chb.2021.106707_bib58) 2013
Rowe (10.1016/j.chb.2021.106707_bib7) 2017
References_xml – year: 2015
  ident: bib52
  article-title: Dr. Scratch: A web tool to automatically evaluate scratch projects
  publication-title: WiPSCE
– year: 2010
  ident: bib53
  article-title: Report of a workshop on the scope and nature of computational thinking
– volume: 17
  start-page: 14
  year: 2017
  ident: bib32
  article-title: A framework for using hypothesis-driven approaches to support data-driven learning analytics in measuring computational thinking in block-based programming environments
  publication-title: ACM Transactions on Computing Education
– volume: 115
  start-page: 255
  year: 1986
  end-page: 266
  ident: bib20
  article-title: A day at the races: A study of IQ, expertise, and cognitive complexity
  publication-title: Journal of Experimental Psychology
– start-page: 1
  year: 2013
  end-page: 11
  ident: bib2
  article-title: Experience and explanation: Using videogames to prepare students for formal instruction in statistics
  publication-title: Journal of Science Education and Technology
– volume: 25
  start-page: 127
  year: 2016
  end-page: 147
  ident: bib80
  article-title: Defining computational thinking for mathematics and science classrooms
  publication-title: Journal of Science Education and Technology
– year: 2012
  ident: bib36
  article-title: CyberSTEM: Game-based learning telemetry model for assessment
– volume: 13
  start-page: 424
  year: 2013
  end-page: 443
  ident: bib48
  article-title: The good, the bad, and the successful–how corporate social responsibility leads to competitive advantage and organizational transformation
  publication-title: Journal of Change Management
– start-page: 343
  year: 2015
  end-page: 360
  ident: bib4
  article-title: Serious game analytics to measure implicit science learning
  publication-title: Ifenthaler Serious Game Analytics: Methodologies for Performance Measurement, Assessment, and Improvement
– year: 2017
  ident: bib30
  article-title: Assessing algorithmic and computational thinking in K-12: Lessons from a middle school classroom
  publication-title: Emerging research, practice, and policy on computational thinking
– year: 2017, October
  ident: bib7
  article-title: Assessing implicit computational thinking in Zoombinis gameplay: Pizza Pass, Fleens, and Bubblewonder Abyss. Work-in-progress presented at the ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, Amsterdam
– volume: 57
  start-page: 2178
  year: 2011
  end-page: 2195
  ident: bib21
  article-title: Exploring Newtonian mechanics in a conceptually-integrated digital game: Comparison of learning and affective outcomes for students in Taiwan and the United States
  publication-title: Computers & Education
– volume: 20
  start-page: 37
  year: 1960
  end-page: 46
  ident: bib22
  article-title: A coefficient of agreement for nominal scales
  publication-title: Educational and Psychological Measurement
– year: 2017, August
  ident: bib6
  article-title: Assessing implicit computational thinking in Zoombinis gameplay. Poster presented at the International Conference on the Foundations of Digital Games in Hyannis, MA
– year: 2015
  ident: bib13
  article-title: Big data and education
– volume: 41
  start-page: 1
  year: 1966
  end-page: 18
  ident: bib60
  article-title: The logic of tacit inference
  publication-title: Philosophy
– volume: 118
  start-page: 219
  year: 1989
  ident: bib63
  article-title: Implicit learning and tacit knowledge
  publication-title: Journal of Experimental Psychology: General
– year: 2015
  ident: bib15
  article-title: July). Concepts in K-9 computer science education
  publication-title: Proceedings of the 2015 ITiCSE on working group reports
– volume: 80
  start-page: 58
  year: 2015
  end-page: 67
  ident: bib70
  article-title: The power of play: The effects of Portal 2 and Lumosity on cognitive and noncognitive skills
  publication-title: Computers & Education
– volume: 57
  start-page: 10
  year: 2013
  end-page: 14
  ident: bib49
  article-title: Rethinking technology & creativity in the 21st century
  publication-title: TechTrends
– volume: 68
  start-page: 1406
  year: 2013
  end-page: 1414
  ident: bib64
  article-title: Computational models can predict response to HIV therapy without a genotype and may reduce treatment failure in different resource-limited settings
  publication-title: Journal of Antimicrobial Chemotherapy
– start-page: 99
  year: 2019
  end-page: 123
  ident: bib12
  article-title: Advancing Research in Game-Based Learning Assessment: Tools and Methods for Measuring Implicit Learning
  publication-title: Advancing Educational Research with Emerging Technology. IGI Global.
– volume: 17
  start-page: 117
  year: 2018
  end-page: 150
  ident: bib79
  article-title: CodeMaster--Automatic assessment and grading of App inventor and Snap! Programs
  publication-title: Informatics in Education
– year: 7 August 2015
  ident: bib5
  article-title: Game (Android, iOS, MacOS, Windows, Web)
– year: 2014
  ident: bib42
  article-title: July). Real time assessment of computational thinking
  publication-title: IEEE symposium on visual languages and human-centric computing
– volume: 20–23
  year: 2011
  ident: bib85
  article-title: Research notebook: Computational thinking—what and why
– year: 2021
  ident: bib3
  article-title: Interactive assessments of CT (IACT): digital interactive logic puzzles to assess computational thinking in grades 3–8
– year: 2018, April
  ident: bib10
  article-title: Labeling implicit computational thinking in pizza pass gameplay. Late-breaking work presented at the ACM SIGCHI conference on human factors in computing systems (CHI 18)
– start-page: 76
  year: 1984
  end-page: 94
  ident: bib43
  article-title: The dialectic of arithmetic in grocery shopping
  publication-title: Everyday Cognition: Its development in social context
– volume: ume 2
  year: 2018
  ident: bib76
  article-title: The state of the field in computational thinking assessment
  publication-title: Rethinking learning in the digital age: Making the learning sciences count, 13th international conference of the learning sciences (ICLS) 2018
– year: 2006
  ident: bib50
  article-title: Implications of evidence-centered design for educational testing
– volume: 18
  start-page: 351
  year: 2013
  end-page: 380
  ident: bib67
  article-title: Integrating computational thinking with K-12 science education using agent-based computation: A theoretical framework
  publication-title: Education and Information Technologies
– volume: 2
  start-page: 48
  year: 2011
  end-page: 54
  ident: bib17
  article-title: Bringing computational thinking to K-12: What is involved and what is the role of the computer science education community?
  publication-title: Inroads
– year: 2018
  ident: bib41
  article-title: A playful assessment approach to research instrument development
  publication-title: Paper presented at the thirteenth International Conference of the Learning Sciences (ICLS), London, UK
– start-page: 177
  year: 2013
  end-page: 184
  ident: bib66
  article-title: Predicting college enrollment from student interaction with an intelligent tutoring system in middle school
  publication-title: Proceedings of the 6th International Conference on Educational Data Mining
– start-page: 407
  year: 2016
  end-page: 414
  ident: bib26
  article-title: June). Promoting inclusive informatics education through the Bebras challenge to all K-12 students
  publication-title: Proceedings of the 17th international conference on computer systems and technologies 2016
– start-page: 57
  year: 2014
  end-page: 62
  ident: bib33
  article-title: June). Assessing computational learning in K-12
  publication-title: Proceedings of the 2014 conference on Innovation & technology in computer science education
– volume: 24
  start-page: 593
  year: 2015
  end-page: 637
  ident: bib47
  article-title: Learning fractions by splitting: Using learning analytics to illuminate the development of mathematical understanding
  publication-title: The Journal of the Learning Sciences
– volume: 16
  start-page: 39
  year: 2017
  end-page: 59
  ident: bib39
  article-title: Exploring Bebras tasks content and performance: A multinational study
  publication-title: Informatics in Education
– year: 2013
  ident: bib73
  article-title: Exploring CS curricular mapping
– volume: Vol. 1
  start-page: 25
  year: 2012
  ident: bib19
  article-title: New frameworks for studying and assessing the development of computational thinking
  publication-title: Proceedings of the 2012 annual meeting of the American educational research association, vancouver, Canada
– start-page: 238
  year: 2016
  end-page: 239
  ident: bib56
  article-title: Ninja code village for scratch: Function samples/function analyser and automatic assessment of computational thinking concepts
  publication-title: 2016 IEEE symposium on visual languages and human-centric computing (VL/HCC)
– volume: 49
  start-page: 33
  year: 2006
  end-page: 35
  ident: bib84
  article-title: Computational thinking
  publication-title: Communications of the ACM
– start-page: 440
  year: 2016
  end-page: 448
  ident: bib38
  article-title: April). Using game analytics to evaluate puzzle design and level progression in a serious game
  publication-title: Proceedings of the sixth international conference on learning analytics & knowledge
– year: 1996
  ident: bib75
  article-title: Successful intelligence: How practical and creative intelligence determine success in life
– year: 2011
  ident: bib72
  article-title: Video games and learning.
– year: 2016
  ident: bib44
  article-title: Effects of representation format in problem representation on qualitative understanding and quantitative proficiency in a learning game context
– year: 2011
  ident: bib65
  article-title: Making thinking routines visible: How to promote engagement, understanding, and independence for all learners
– volume: 55
  start-page: 503
  year: 2011
  end-page: 524
  ident: bib68
  article-title: Stealth assessment in computer-based games to support learning
  publication-title: Computer games and instruction
– volume: 27
  year: 2014
  ident: bib78
  article-title: How autism can help you land a job
  publication-title: , March
– volume: Volume 22
  year: 2008
  ident: bib28
  article-title: Mathematics education for young children: What it is and how to promote it. Social policy report
– year: 1981
  ident: bib62
  article-title: Manual for Raven's progressive matrices and vocabulary scales
  publication-title: Research supplement No.1: The 1979 british standardisation of the standard progressive Matrices and mill hill vocabulary scales, together with comparative data from earlier studies in the UK, US, Canada, Germany and Ireland
– year: 2019
  ident: bib83
  article-title: February). Development of a lean computational thinking abilities assessment for middle grades students
  publication-title: Proceedings of the 50th ACM technical symposium on computer science education
– year: 2017
  ident: bib23
  article-title: CSTA K-12 computer science standards
– start-page: 1218
  year: 2019
  end-page: 1224
  ident: bib81
  article-title: February). Block-based comprehension: Exploring and explaining student outcomes from a read-only block-based exam
  publication-title: Proceedings of the 50th ACM technical symposium on computer science education
– year: 1978
  ident: bib77
  article-title: Mind in society
– start-page: 117
  year: 2013
  end-page: 124
  ident: bib58
  article-title: April). Affective states and state tests: Investigating how affect throughout the school year predicts end of year learning outcomes
  publication-title: Proceedings of the third international conference on learning analytics and knowledge
– year: 2017
  ident: bib45
  article-title: Automated assessment for scientific explanations in on-line science inquiry
  publication-title: Proceedings of the international conference on educational data mining
– volume: 5
  start-page: 171
  year: 2018
  end-page: 178
  ident: bib46
  article-title: Advanced educational technology for science inquiry assessment
  publication-title: Policy Insights from the Behavioral and Brain Sciences
– volume: 49
  start-page: 673
  year: 2018
  end-page: 689
  ident: bib54
  article-title: A framework for applying learning analytics in serious games for people with intellectual disabilities
  publication-title: British Journal of Educational Technology
– volume: 76
  start-page: 617
  year: 2017
  end-page: 630
  ident: bib8
  article-title: Assessing implicit science learning in digital games
  publication-title: Computers in Human Behavior
– volume: 63
  start-page: 106
  year: 2016
  end-page: 117
  ident: bib71
  article-title: Measuring problem solving skills via stealth assessment in an engaging video game
  publication-title: Computers in Human Behavior
– volume: 42
  start-page: 38
  year: 2013
  end-page: 43
  ident: bib34
  article-title: Computational thinking in K–12 A review of the state of the field
  publication-title: Educational Researcher
– year: 1993
  ident: bib55
  article-title: Mathematics in the streets and in schools
– year: 2019
  ident: bib11
  article-title: Modeling Implicit Computational Thinking in Zoombini’s Mudball Wall Gameplay
  publication-title: Paper presented at the Technology, Mind, and Society conference, October, Washington D.C
– start-page: 203
  year: 2013
  end-page: 214
  ident: bib14
  article-title: Predicting successful inquiry learning in a virtual performance assessment for science
  publication-title: International conference on user modeling, adaptation, and personalization
– start-page: 2436
  year: 2015
  end-page: 2444
  ident: bib29
  article-title: Computational thinking test: Design guidelines and content validation
  publication-title: Proceedings of EDULEARN15 conference
– volume: 18
  start-page: 657
  year: 2007
  end-page: 662
  ident: bib27
  article-title: The level and nature of autistic intelligence
  publication-title: Psychological Science
– volume: 23
  start-page: 17
  year: 2004
  end-page: 27
  ident: bib35
  article-title: Construct‐irrelevant variance in high‐stakes testing
  publication-title: Educational Measurement: Issues and Practice
– start-page: 267
  year: 2017
  end-page: 272
  ident: bib31
  article-title: March). Measuring student learning in introductory block-based programming: Examining misconceptions of loops, variables, and Boolean logic
  publication-title: Proceedings of the 2017 ACM SIGCSE technical symposium on computer science education
– volume: 364
  start-page: 1377
  year: 2009
  end-page: 1383
  ident: bib16
  article-title: Talent in autism: Hyper-systemizing, hyper-attention to detail and sensory hypersensitivity
  publication-title: Philosophical Transactions of the Royal Society B: Biological Sciences
– volume: 16
  start-page: 297
  year: 1951
  end-page: 334
  ident: bib24
  article-title: Coefficient alpha and the internal structure of tests
  publication-title: Psychometrika
– year: 2010
  ident: bib69
  article-title: Modeling, assessing, and supporting key competencies within game environments
  publication-title: Computer-based diagnostics and systematic analysis of knowledge
– volume: 63
  start-page: 50
  year: 2016
  end-page: 58
  ident: bib61
  article-title: Game-based learning and 21st century skills: A review of recent research
  publication-title: Computers in Human Behavior
– volume: 1
  start-page: 3
  year: 2003
  end-page: 62
  ident: bib51
  article-title: On the structure of educational assessment
  publication-title: Measurement: Interdisciplinary Research and Perspective
– volume: 17
  start-page: 530
  year: 2008
  end-page: 543
  ident: bib74
  article-title: Scientific habits of mind in virtual worlds
  publication-title: Journal of Science Education and Technology
– volume: 143
  start-page: 29
  year: 1982
  end-page: 36
  ident: bib37
  article-title: The meaning and use of the area under a receiver operating characteristic (ROC) curve
  publication-title: Radiology
– start-page: 19
  year: 2008
  end-page: 30
  ident: bib25
  article-title: July). Bebras international contest on informatics and computer literacy: Criteria for good tasks
  publication-title: International conference on informatics in secondary schools-evolution and perspectives
– year: 2020
  ident: bib59
  article-title: Handbook of game-based learning
– start-page: 215
  year: 2012
  end-page: 220
  ident: bib82
  article-title: February). The fairy performance assessment: Measuring computational thinking in middle school
  publication-title: Proceedings of the 43rd ACM technical symposium on computer science education
– volume: 22
  start-page: 142
  year: 2017
  end-page: 158
  ident: bib9
  article-title: Demystifying computational thinking
  publication-title: Educational Research Review
– volume: 47
  start-page: 277
  year: 1991
  end-page: 284
  ident: bib57
  article-title: Estimating age‐stratified WAIS‐R IQS from scores on the Raven's standard progressive matrices
  publication-title: Journal of Clinical Psychology
– year: 2010
  ident: bib1
  article-title: Computational thinking for youth. ITEST small working group on computational thinking
– volume: 57
  start-page: 289
  year: 1995
  end-page: 300
  ident: bib18
  article-title: Controlling the false discovery rate: A practical and powerful approach to multiple testing
  publication-title: Journal of the Royal Statistical Society: Series B (Methodological)
– year: 2020
  ident: 10.1016/j.chb.2021.106707_bib59
– year: 2013
  ident: 10.1016/j.chb.2021.106707_bib73
– volume: 18
  start-page: 657
  issue: 8
  year: 2007
  ident: 10.1016/j.chb.2021.106707_bib27
  article-title: The level and nature of autistic intelligence
  publication-title: Psychological Science
  doi: 10.1111/j.1467-9280.2007.01954.x
– volume: 16
  start-page: 39
  issue: 1
  year: 2017
  ident: 10.1016/j.chb.2021.106707_bib39
  article-title: Exploring Bebras tasks content and performance: A multinational study
  publication-title: Informatics in Education
  doi: 10.15388/infedu.2017.03
– start-page: 99
  year: 2019
  ident: 10.1016/j.chb.2021.106707_bib12
  article-title: Advancing Research in Game-Based Learning Assessment: Tools and Methods for Measuring Implicit Learning
– volume: 63
  start-page: 50
  year: 2016
  ident: 10.1016/j.chb.2021.106707_bib61
  article-title: Game-based learning and 21st century skills: A review of recent research
  publication-title: Computers in Human Behavior
  doi: 10.1016/j.chb.2016.05.023
– start-page: 215
  year: 2012
  ident: 10.1016/j.chb.2021.106707_bib82
  article-title: February). The fairy performance assessment: Measuring computational thinking in middle school
– year: 1996
  ident: 10.1016/j.chb.2021.106707_bib75
– year: 2018
  ident: 10.1016/j.chb.2021.106707_bib41
  article-title: A playful assessment approach to research instrument development
– year: 2016
  ident: 10.1016/j.chb.2021.106707_bib44
– volume: 23
  start-page: 17
  issue: 1
  year: 2004
  ident: 10.1016/j.chb.2021.106707_bib35
  article-title: Construct‐irrelevant variance in high‐stakes testing
  publication-title: Educational Measurement: Issues and Practice
  doi: 10.1111/j.1745-3992.2004.tb00149.x
– volume: 68
  start-page: 1406
  issue: 6
  year: 2013
  ident: 10.1016/j.chb.2021.106707_bib64
  article-title: Computational models can predict response to HIV therapy without a genotype and may reduce treatment failure in different resource-limited settings
  publication-title: Journal of Antimicrobial Chemotherapy
  doi: 10.1093/jac/dkt041
– volume: 42
  start-page: 38
  issue: 1
  year: 2013
  ident: 10.1016/j.chb.2021.106707_bib34
  article-title: Computational thinking in K–12 A review of the state of the field
  publication-title: Educational Researcher
  doi: 10.3102/0013189X12463051
– year: 2011
  ident: 10.1016/j.chb.2021.106707_bib72
– volume: 118
  start-page: 219
  issue: 3
  year: 1989
  ident: 10.1016/j.chb.2021.106707_bib63
  article-title: Implicit learning and tacit knowledge
  publication-title: Journal of Experimental Psychology: General
  doi: 10.1037/0096-3445.118.3.219
– year: 2019
  ident: 10.1016/j.chb.2021.106707_bib11
  article-title: Modeling Implicit Computational Thinking in Zoombini’s Mudball Wall Gameplay
– year: 2017
  ident: 10.1016/j.chb.2021.106707_bib30
  article-title: Assessing algorithmic and computational thinking in K-12: Lessons from a middle school classroom
– year: 2017
  ident: 10.1016/j.chb.2021.106707_bib45
  article-title: Automated assessment for scientific explanations in on-line science inquiry
– year: 2011
  ident: 10.1016/j.chb.2021.106707_bib65
– volume: 18
  start-page: 351
  issue: 2
  year: 2013
  ident: 10.1016/j.chb.2021.106707_bib67
  article-title: Integrating computational thinking with K-12 science education using agent-based computation: A theoretical framework
  publication-title: Education and Information Technologies
  doi: 10.1007/s10639-012-9240-x
– start-page: 343
  year: 2015
  ident: 10.1016/j.chb.2021.106707_bib4
  article-title: Serious game analytics to measure implicit science learning
– year: 2017
  ident: 10.1016/j.chb.2021.106707_bib6
– volume: 49
  start-page: 33
  issue: 3
  year: 2006
  ident: 10.1016/j.chb.2021.106707_bib84
  article-title: Computational thinking
  publication-title: Communications of the ACM
  doi: 10.1145/1118178.1118215
– volume: 17
  start-page: 14
  issue: 3
  year: 2017
  ident: 10.1016/j.chb.2021.106707_bib32
  article-title: A framework for using hypothesis-driven approaches to support data-driven learning analytics in measuring computational thinking in block-based programming environments
  publication-title: ACM Transactions on Computing Education
  doi: 10.1145/3105910
– year: 2012
  ident: 10.1016/j.chb.2021.106707_bib36
– year: 2015
  ident: 10.1016/j.chb.2021.106707_bib13
– start-page: 203
  year: 2013
  ident: 10.1016/j.chb.2021.106707_bib14
  article-title: Predicting successful inquiry learning in a virtual performance assessment for science
– year: 2018
  ident: 10.1016/j.chb.2021.106707_bib10
– volume: 63
  start-page: 106
  year: 2016
  ident: 10.1016/j.chb.2021.106707_bib71
  article-title: Measuring problem solving skills via stealth assessment in an engaging video game
  publication-title: Computers in Human Behavior
  doi: 10.1016/j.chb.2016.05.047
– volume: 143
  start-page: 29
  issue: 1
  year: 1982
  ident: 10.1016/j.chb.2021.106707_bib37
  article-title: The meaning and use of the area under a receiver operating characteristic (ROC) curve
  publication-title: Radiology
  doi: 10.1148/radiology.143.1.7063747
– start-page: 177
  year: 2013
  ident: 10.1016/j.chb.2021.106707_bib66
  article-title: Predicting college enrollment from student interaction with an intelligent tutoring system in middle school
  publication-title: Proceedings of the 6th International Conference on Educational Data Mining
– volume: 57
  start-page: 10
  issue: 3
  year: 2013
  ident: 10.1016/j.chb.2021.106707_bib49
  article-title: Rethinking technology & creativity in the 21st century
  publication-title: TechTrends
  doi: 10.1007/s11528-013-0655-z
– volume: 55
  start-page: 503
  issue: 2
  year: 2011
  ident: 10.1016/j.chb.2021.106707_bib68
  article-title: Stealth assessment in computer-based games to support learning
  publication-title: Computer games and instruction
– start-page: 2436
  year: 2015
  ident: 10.1016/j.chb.2021.106707_bib29
  article-title: Computational thinking test: Design guidelines and content validation
– start-page: 117
  year: 2013
  ident: 10.1016/j.chb.2021.106707_bib58
  article-title: April). Affective states and state tests: Investigating how affect throughout the school year predicts end of year learning outcomes
– start-page: 407
  year: 2016
  ident: 10.1016/j.chb.2021.106707_bib26
  article-title: June). Promoting inclusive informatics education through the Bebras challenge to all K-12 students
– volume: 17
  start-page: 530
  issue: 6
  year: 2008
  ident: 10.1016/j.chb.2021.106707_bib74
  article-title: Scientific habits of mind in virtual worlds
  publication-title: Journal of Science Education and Technology
  doi: 10.1007/s10956-008-9120-8
– start-page: 19
  year: 2008
  ident: 10.1016/j.chb.2021.106707_bib25
  article-title: July). Bebras international contest on informatics and computer literacy: Criteria for good tasks
– volume: 80
  start-page: 58
  year: 2015
  ident: 10.1016/j.chb.2021.106707_bib70
  article-title: The power of play: The effects of Portal 2 and Lumosity on cognitive and noncognitive skills
  publication-title: Computers & Education
  doi: 10.1016/j.compedu.2014.08.013
– volume: Vol. 1
  start-page: 25
  year: 2012
  ident: 10.1016/j.chb.2021.106707_bib19
  article-title: New frameworks for studying and assessing the development of computational thinking
– volume: 5
  start-page: 171
  issue: 2
  year: 2018
  ident: 10.1016/j.chb.2021.106707_bib46
  article-title: Advanced educational technology for science inquiry assessment
  publication-title: Policy Insights from the Behavioral and Brain Sciences
  doi: 10.1177/2372732218790017
– volume: 25
  start-page: 127
  issue: 1
  year: 2016
  ident: 10.1016/j.chb.2021.106707_bib80
  article-title: Defining computational thinking for mathematics and science classrooms
  publication-title: Journal of Science Education and Technology
  doi: 10.1007/s10956-015-9581-5
– year: 2015
  ident: 10.1016/j.chb.2021.106707_bib52
  article-title: Dr. Scratch: A web tool to automatically evaluate scratch projects
– volume: 41
  start-page: 1
  year: 1966
  ident: 10.1016/j.chb.2021.106707_bib60
  article-title: The logic of tacit inference
  publication-title: Philosophy
  doi: 10.1017/S0031819100066110
– start-page: 1
  year: 2013
  ident: 10.1016/j.chb.2021.106707_bib2
  article-title: Experience and explanation: Using videogames to prepare students for formal instruction in statistics
  publication-title: Journal of Science Education and Technology
– volume: 57
  start-page: 2178
  issue: 3
  year: 2011
  ident: 10.1016/j.chb.2021.106707_bib21
  article-title: Exploring Newtonian mechanics in a conceptually-integrated digital game: Comparison of learning and affective outcomes for students in Taiwan and the United States
  publication-title: Computers & Education
  doi: 10.1016/j.compedu.2011.05.007
– year: 1993
  ident: 10.1016/j.chb.2021.106707_bib55
– volume: 20
  start-page: 37
  issue: 1
  year: 1960
  ident: 10.1016/j.chb.2021.106707_bib22
  article-title: A coefficient of agreement for nominal scales
  publication-title: Educational and Psychological Measurement
  doi: 10.1177/001316446002000104
– year: 2017
  ident: 10.1016/j.chb.2021.106707_bib7
– year: 2010
  ident: 10.1016/j.chb.2021.106707_bib53
– year: 1978
  ident: 10.1016/j.chb.2021.106707_bib77
– volume: 57
  start-page: 289
  issue: 1
  year: 1995
  ident: 10.1016/j.chb.2021.106707_bib18
  article-title: Controlling the false discovery rate: A practical and powerful approach to multiple testing
  publication-title: Journal of the Royal Statistical Society: Series B (Methodological)
  doi: 10.1111/j.2517-6161.1995.tb02031.x
– year: 2006
  ident: 10.1016/j.chb.2021.106707_bib50
– year: 2017
  ident: 10.1016/j.chb.2021.106707_bib23
– start-page: 57
  year: 2014
  ident: 10.1016/j.chb.2021.106707_bib33
  article-title: June). Assessing computational learning in K-12
– volume: ume 2
  year: 2018
  ident: 10.1016/j.chb.2021.106707_bib76
  article-title: The state of the field in computational thinking assessment
– volume: 24
  start-page: 593
  issue: 4
  year: 2015
  ident: 10.1016/j.chb.2021.106707_bib47
  article-title: Learning fractions by splitting: Using learning analytics to illuminate the development of mathematical understanding
  publication-title: The Journal of the Learning Sciences
  doi: 10.1080/10508406.2015.1078244
– volume: 16
  start-page: 297
  issue: 3
  year: 1951
  ident: 10.1016/j.chb.2021.106707_bib24
  article-title: Coefficient alpha and the internal structure of tests
  publication-title: Psychometrika
  doi: 10.1007/BF02310555
– volume: 27
  year: 2014
  ident: 10.1016/j.chb.2021.106707_bib78
  article-title: How autism can help you land a job
  publication-title: The Wall Street Journal, March
– volume: 20–23
  year: 2011
  ident: 10.1016/j.chb.2021.106707_bib85
– volume: 47
  start-page: 277
  issue: 2
  year: 1991
  ident: 10.1016/j.chb.2021.106707_bib57
  article-title: Estimating age‐stratified WAIS‐R IQS from scores on the Raven's standard progressive matrices
  publication-title: Journal of Clinical Psychology
  doi: 10.1002/1097-4679(199103)47:2<277::AID-JCLP2270470215>3.0.CO;2-I
– volume: 2
  start-page: 48
  issue: 1
  year: 2011
  ident: 10.1016/j.chb.2021.106707_bib17
  article-title: Bringing computational thinking to K-12: What is involved and what is the role of the computer science education community?
  publication-title: Inroads
  doi: 10.1145/1929887.1929905
– year: 1981
  ident: 10.1016/j.chb.2021.106707_bib62
  article-title: Manual for Raven's progressive matrices and vocabulary scales
– volume: 1
  start-page: 3
  issue: 1
  year: 2003
  ident: 10.1016/j.chb.2021.106707_bib51
  article-title: On the structure of educational assessment
  publication-title: Measurement: Interdisciplinary Research and Perspective
– year: 2010
  ident: 10.1016/j.chb.2021.106707_bib69
  article-title: Modeling, assessing, and supporting key competencies within game environments
– start-page: 76
  year: 1984
  ident: 10.1016/j.chb.2021.106707_bib43
  article-title: The dialectic of arithmetic in grocery shopping
– volume: 115
  start-page: 255
  issue: 3
  year: 1986
  ident: 10.1016/j.chb.2021.106707_bib20
  article-title: A day at the races: A study of IQ, expertise, and cognitive complexity
  publication-title: Journal of Experimental Psychology
  doi: 10.1037/0096-3445.115.3.255
– year: 2015
  ident: 10.1016/j.chb.2021.106707_bib15
  article-title: July). Concepts in K-9 computer science education
– start-page: 238
  year: 2016
  ident: 10.1016/j.chb.2021.106707_bib56
  article-title: Ninja code village for scratch: Function samples/function analyser and automatic assessment of computational thinking concepts
– volume: 13
  start-page: 424
  issue: 4
  year: 2013
  ident: 10.1016/j.chb.2021.106707_bib48
  article-title: The good, the bad, and the successful–how corporate social responsibility leads to competitive advantage and organizational transformation
  publication-title: Journal of Change Management
  doi: 10.1080/14697017.2013.851953
– year: 2021
  ident: 10.1016/j.chb.2021.106707_bib3
– year: 2010
  ident: 10.1016/j.chb.2021.106707_bib1
– volume: Volume 22
  year: 2008
  ident: 10.1016/j.chb.2021.106707_bib28
– volume: 49
  start-page: 673
  issue: 4
  year: 2018
  ident: 10.1016/j.chb.2021.106707_bib54
  article-title: A framework for applying learning analytics in serious games for people with intellectual disabilities
  publication-title: British Journal of Educational Technology
  doi: 10.1111/bjet.12625
– start-page: 1218
  year: 2019
  ident: 10.1016/j.chb.2021.106707_bib81
  article-title: February). Block-based comprehension: Exploring and explaining student outcomes from a read-only block-based exam
– volume: 76
  start-page: 617
  year: 2017
  ident: 10.1016/j.chb.2021.106707_bib8
  article-title: Assessing implicit science learning in digital games
  publication-title: Computers in Human Behavior
  doi: 10.1016/j.chb.2017.03.043
– year: 2015
  ident: 10.1016/j.chb.2021.106707_bib5
– volume: 17
  start-page: 117
  issue: 1
  year: 2018
  ident: 10.1016/j.chb.2021.106707_bib79
  article-title: CodeMaster--Automatic assessment and grading of App inventor and Snap! Programs
  publication-title: Informatics in Education
  doi: 10.15388/infedu.2018.08
– start-page: 440
  year: 2016
  ident: 10.1016/j.chb.2021.106707_bib38
  article-title: April). Using game analytics to evaluate puzzle design and level progression in a serious game
– volume: 364
  start-page: 1377
  issue: 1522
  year: 2009
  ident: 10.1016/j.chb.2021.106707_bib16
  article-title: Talent in autism: Hyper-systemizing, hyper-attention to detail and sensory hypersensitivity
  publication-title: Philosophical Transactions of the Royal Society B: Biological Sciences
  doi: 10.1098/rstb.2008.0337
– start-page: 267
  year: 2017
  ident: 10.1016/j.chb.2021.106707_bib31
  article-title: March). Measuring student learning in introductory block-based programming: Examining misconceptions of loops, variables, and Boolean logic
– volume: 22
  start-page: 142
  year: 2017
  ident: 10.1016/j.chb.2021.106707_bib9
  article-title: Demystifying computational thinking
  publication-title: Educational Research Review
  doi: 10.1016/j.edurev.2017.09.003
– year: 2019
  ident: 10.1016/j.chb.2021.106707_bib83
  article-title: February). Development of a lean computational thinking abilities assessment for middle grades students
– year: 2014
  ident: 10.1016/j.chb.2021.106707_bib42
  article-title: July). Real time assessment of computational thinking
SSID ssj0005506
Score 2.5515666
Snippet There has been growing interest in assessing computational thinking (CT) across diverse learners beyond the traditional forms of tests and assignments....
SourceID proquest
crossref
elsevier
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 106707
SubjectTerms Classification algorithms
Computational thinking
Implicit learning
Learning
Learning games
Students
Technical education
Title Assessing implicit computational thinking in Zoombinis puzzle gameplay
URI https://dx.doi.org/10.1016/j.chb.2021.106707
https://www.proquest.com/docview/2536820212
Volume 120
WOSCitedRecordID wos000641330900003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVESC
  databaseName: Elsevier SD Freedom Collection Journals 2021
  customDbUrl:
  eissn: 1873-7692
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0005506
  issn: 0747-5632
  databaseCode: AIEXJ
  dateStart: 19941201
  isFulltext: true
  titleUrlDefault: https://www.sciencedirect.com
  providerName: Elsevier
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9QwELag5dALjwKipSAfOLHKau081j6uUCvooeJQ0IqLFTs2TbVNV7tZaPvrGdux013Uih64RFFkW47n88x4ZjyD0IcqJbQspD2pGpNkpdEJY1maMC0VZ0aaolKu2MT45IRNp_xrZ9NdunIC46ZhV1d8_l9JDd-A2Pbq7APIHQeFD_AORIcnkB2e_0R478Z1V1VctHjdurjxVRvMfu2Zr5dgTR0_QG-WNrvIYL66uZnpwc_yQs9n5ZqzN1R-cKGzvqhfuN3f-2t-680oMQ-kGYjb0t8KGnyvrYugjpJgsrRuj6SPETq-rOreNbRYdYb7W7f_g4WCkhjNGhgZHFmSvEjXuS4d3eKbNpGdr377F0v31oXzoTqTQzv6sG-7nj57Q6zFYMMQx3YuYAhhhxB-iMdom45zDrxwe_LlcHrchwblriZrnHfwhru4wI153KXPbEh2p66cPkdPu3MGnnh8vECPdLOLngVK4o6l76KdKAGvX6KjiB0csIPXsIMDdnDd4Igd7LGDA3ZeoW9Hh6efPiddoY1EpTRvk1xV1h6ZFqCMavhhIjns4LEEKcqpJkRxokd5maWmIhXof1mh0pIZBdq-JIbo9DXaai4b_QZh2NslqYAvGMIyyUZSG-gGb7zQlMtqD43CcgnVZaG3xVBm4k4y7aGPscvcp2C5r3EWaCA6HdLrhgLwdF-3g0Av0e3lpaA5rIhtRPcfMoW3aKffBQdoq12s9Dv0RP1q6-XifYe1P9tanZ4
linkProvider Elsevier
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Assessing+implicit+computational+thinking+in+Zoombinis+puzzle+gameplay&rft.jtitle=Computers+in+human+behavior&rft.au=Rowe%2C+Elizabeth&rft.au=Almeda%2C+Ma+Victoria&rft.au=Asbell-Clarke%2C+Jodi&rft.au=Scruggs%2C+Richard&rft.date=2021-07-01&rft.issn=0747-5632&rft.volume=120&rft.spage=106707&rft_id=info:doi/10.1016%2Fj.chb.2021.106707&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_chb_2021_106707
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0747-5632&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0747-5632&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0747-5632&client=summon