Exploring Gender Bias In Remote Pair Programming Among Software Engineering Students: The twincode Original Study And First External Replication

Context Women have historically been underrepresented in Software Engineering, due in part to the stereotyped assumption that women are less technically competent than men. Pair programming is both widely used in industry and has been shown to increase student interest in Software Engineering, parti...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	Empirical software engineering : an international journal Jg. 29; H. 2; S. 40
Hauptverfasser:	Durán Toro, Amador, Fernández, Pablo, Bernárdez, Beatriz, Weinman, Nathaniel, Akalın, Aslıhan, Fox, Armando
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	New York Springer US 01.03.2024 Springer Nature B.V
Schlagworte:	Avatars Collaboration Colleges & universities Compilers Computer Science Dependent variables Engineering education Gender Human bias Interpreters Programming Programming Languages Registered Reports Remote observing Replication Software engineering Software Engineering/Programming and Operating Systems Source code Students Women Experiment replication Distributed pair programming Gender bias Remote pair programming Software Engineering education Pair programming
ISSN:	1382-3256, 1573-7616
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	Context Women have historically been underrepresented in Software Engineering, due in part to the stereotyped assumption that women are less technically competent than men. Pair programming is both widely used in industry and has been shown to increase student interest in Software Engineering, particularly among women; but if those same gender biases are also present in pair programming, its potential for attracting women to the field could be thwarted. Objective We aim to explore the effects of gender bias in pair programming. Specifically, in a remote setting in which students cannot directly observe the gender of their peers, we study whether the perception of the partner, the behavior during programming, or the style of communication of Software Engineering students differ depending on the perceived gender of their remote partner. To our knowledge, this is the first study specifically focusing on the impact of gender stereotypes and bias within pairs in pair programming. Method We have developed an online pair-programming platform (twincode) that provides a collaborative editing window and a chat pane, both of which are heavily instrumented. Students in the control group had no information about their partner’s gender, whereas students in the treatment group could see a gendered avatar representing the other participant as a man or as a woman. The gender of the avatar was swapped between programming tasks to analyze 45 variables related to the collaborative coding behavior, chat utterances, and questionnaire responses of 46 pairs in the original study at the University of Seville, and 23 pairs in the external replication at the University of California, Berkeley. Results We did not observe any statistically significant effect of the gender bias treatment, nor any interaction between the perceived partner’s gender and subject’s gender, in any of the 45 response variables measured in the original study. In the external replication, we observed statistically significant effects with moderate to large sizes in four dependent variables within the experimental group, comparing how subjects acted when their partners were represented as a man or a woman. Conclusions The results in the original study do not show any clear effect of the treatment in remote pair programming among current Software Engineering students. In the external replication, it seems that students delete more source code characters when they have a woman partner, and communicate using more informal utterances, reflections and yes/no questions when they have a man partner, although these results must be considered inconclusive because of the small number of subjects in the replication, and because when multiple test corrections are applied, only the result about informal utterances remains significant. In any case, more mixed methods replications are needed in order to confirm or refute the results in the same and other Software Engineering students populations.
AbstractList	Context Women have historically been underrepresented in Software Engineering, due in part to the stereotyped assumption that women are less technically competent than men. Pair programming is both widely used in industry and has been shown to increase student interest in Software Engineering, particularly among women; but if those same gender biases are also present in pair programming, its potential for attracting women to the field could be thwarted. Objective We aim to explore the effects of gender bias in pair programming. Specifically, in a remote setting in which students cannot directly observe the gender of their peers, we study whether the perception of the partner, the behavior during programming, or the style of communication of Software Engineering students differ depending on the perceived gender of their remote partner. To our knowledge, this is the first study specifically focusing on the impact of gender stereotypes and bias within pairs in pair programming. Method We have developed an online pair-programming platform (twincode) that provides a collaborative editing window and a chat pane, both of which are heavily instrumented. Students in the control group had no information about their partner’s gender, whereas students in the treatment group could see a gendered avatar representing the other participant as a man or as a woman. The gender of the avatar was swapped between programming tasks to analyze 45 variables related to the collaborative coding behavior, chat utterances, and questionnaire responses of 46 pairs in the original study at the University of Seville, and 23 pairs in the external replication at the University of California, Berkeley. Results We did not observe any statistically significant effect of the gender bias treatment, nor any interaction between the perceived partner’s gender and subject’s gender, in any of the 45 response variables measured in the original study. In the external replication, we observed statistically significant effects with moderate to large sizes in four dependent variables within the experimental group, comparing how subjects acted when their partners were represented as a man or a woman. Conclusions The results in the original study do not show any clear effect of the treatment in remote pair programming among current Software Engineering students. In the external replication, it seems that students delete more source code characters when they have a woman partner, and communicate using more informal utterances, reflections and yes/no questions when they have a man partner, although these results must be considered inconclusive because of the small number of subjects in the replication, and because when multiple test corrections are applied, only the result about informal utterances remains significant. In any case, more mixed methods replications are needed in order to confirm or refute the results in the same and other Software Engineering students populations. ContextWomen have historically been underrepresented in Software Engineering, due in part to the stereotyped assumption that women are less technically competent than men. Pair programming is both widely used in industry and has been shown to increase student interest in Software Engineering, particularly among women; but if those same gender biases are also present in pair programming, its potential for attracting women to the field could be thwarted.ObjectiveWe aim to explore the effects of gender bias in pair programming. Specifically, in a remote setting in which students cannot directly observe the gender of their peers, we study whether the perception of the partner, the behavior during programming, or the style of communication of Software Engineering students differ depending on the perceived gender of their remote partner. To our knowledge, this is the first study specifically focusing on the impact of gender stereotypes and bias within pairs in pair programming.MethodWe have developed an online pair-programming platform (twincode) that provides a collaborative editing window and a chat pane, both of which are heavily instrumented. Students in the control group had no information about their partner’s gender, whereas students in the treatment group could see a gendered avatar representing the other participant as a man or as a woman. The gender of the avatar was swapped between programming tasks to analyze 45 variables related to the collaborative coding behavior, chat utterances, and questionnaire responses of 46 pairs in the original study at the University of Seville, and 23 pairs in the external replication at the University of California, Berkeley.ResultsWe did not observe any statistically significant effect of the gender bias treatment, nor any interaction between the perceived partner’s gender and subject’s gender, in any of the 45 response variables measured in the original study. In the external replication, we observed statistically significant effects with moderate to large sizes in four dependent variables within the experimental group, comparing how subjects acted when their partners were represented as a man or a woman.ConclusionsThe results in the original study do not show any clear effect of the treatment in remote pair programming among current Software Engineering students. In the external replication, it seems that students delete more source code characters when they have a woman partner, and communicate using more informal utterances, reflections and yes/no questions when they have a man partner, although these results must be considered inconclusive because of the small number of subjects in the replication, and because when multiple test corrections are applied, only the result about informal utterances remains significant. In any case, more mixed methods replications are needed in order to confirm or refute the results in the same and other Software Engineering students populations.
ArticleNumber	40
Author	Durán Toro, Amador Akalın, Aslıhan Weinman, Nathaniel Fernández, Pablo Fox, Armando Bernárdez, Beatriz
Author_xml	– sequence: 1 givenname: Amador orcidid: 0000-0003-3630-5511 surname: Durán Toro fullname: Durán Toro, Amador email: amador@us.es organization: I3US Institute, Universidad de Sevilla, SCORE Lab, Universidad de Sevilla – sequence: 2 givenname: Pablo orcidid: 0000-0002-8763-0819 surname: Fernández fullname: Fernández, Pablo organization: I3US Institute, Universidad de Sevilla, SCORE Lab, Universidad de Sevilla – sequence: 3 givenname: Beatriz orcidid: 0000-0002-9390-3772 surname: Bernárdez fullname: Bernárdez, Beatriz organization: I3US Institute, Universidad de Sevilla, SCORE Lab, Universidad de Sevilla – sequence: 4 givenname: Nathaniel surname: Weinman fullname: Weinman, Nathaniel organization: Computer Science Division, University of California – sequence: 5 givenname: Aslıhan surname: Akalın fullname: Akalın, Aslıhan organization: Computer Science Division, University of California – sequence: 6 givenname: Armando orcidid: 0000-0002-6096-4931 surname: Fox fullname: Fox, Armando organization: Computer Science Division, University of California
BookMark	eNp9kE1P4zAQhq0VKy0f-wf2ZIlzwI4_kuytoBaQkKhK75ZrT7pGiR1sV8C_4CeTtCshceAyHmneZzR-TtCRDx4Q-kPJBSWkukyUSMkLUrKCEk5lIX-gYyoqVlSSyqOxZ3VZsFLIX-gkpSdCSFNxcYze569DF6LzW3wD3kLEV04nfOfxCvqQAS-1i3gZwzbqvp9isz6M9TG0-UVHwHO_dR5gv-Ex7yz4nP7i9T_A-cV5Eyzgh-jGjO728zc88xYvXEwZz18zxGmwgqFzRmcX_Bn62eouwe__7ylaL-br69vi_uHm7np2XxgmWS4st0QKAqLmTIIFutENNcYKI8TGNmzT8E1NJTSsbS2pWjCa1SA4o8xq27JTdH5YO8TwvIOU1VPYTbckVTYlLRvCOR9T5SFlYkgpQquG6Hod3xQlahKvDuLVKF7txSs5QvUXyLi8_1uO2nXfo-yApmESCvHzqm-oD3JgnGc
CitedBy_id	crossref_primary_10_3390_software4030018
Cites_doi	10.1007/s10664-008-9093-5 10.1201/9781003168393-13 10.1007/978-3-319-39483-1_53 10.1007/s42330-022-00193-7 10.4018/jicte.2005010105 10.1109/TSE.2009.41 10.1109/TSE.2010.59 10.1109/ICSE.2005.1553618 10.1145/3446871.3469790 10.1007/s10664-012-9238-4 10.1145/792548.612007 10.1145/3017680.3017748 10.1007/s10664-017-9523-3 10.1073/pnas.1511201113 10.1177/2167696815587648 10.1109/RESPECT51740.2021.9620659 10.1002/jeab.763 10.1159/000501812 10.1145/3304221.3319782 10.1016/j.infsof.2015.02.011 10.1007/s00607-022-01133-x 10.1145/3545947.3573239 10.1109/VL/HCC53370.2022.9833146 10.1177/1609406919899220 10.1109/HICSS.2013.209 10.1109/TSE.2002.1027796 10.1109/32.799939 10.1007/978-3-540-45122-8_15 10.2196/15018 10.1037/0003-066X.51.2.157 10.1016/j.jss.2019.07.002 10.1177/20499361211026717 10.1145/1852786.1852816 10.1080/09500693.2015.1114190 10.1145/3017680.3017794 10.1109/EDUCON.2017.7943050 10.1080/08993408.2011.579808 10.1145/3432952 10.1007/978-3-642-29044-2 10.1109/FIE49875.2021.9637186 10.1126/science.103.2684.677 10.1080/0144929X.2014.937460 10.7717/peerj-cs.111 10.1145/1060071.1060075 10.1145/3478431.3499324 10.1080/08993408.2022.2039504 10.3758/BF03193146 10.1109/VLHCC.2019.8818790
ContentType	Journal Article
Copyright	The Author(s) 2023 The Author(s) 2023. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml	– notice: The Author(s) 2023 – notice: The Author(s) 2023. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID	C6C AAYXX CITATION 7SC 8FD 8FE 8FG ABJCF AFKRA ARAPS BENPR BGLVJ CCPQU DWQXO HCIFZ JQ2 L6V L7M L~C L~D M7S P5Z P62 PHGZM PHGZT PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS S0W
DOI	10.1007/s10664-023-10416-6
DatabaseName	Springer Nature OA Free Journals CrossRef Computer and Information Systems Abstracts Technology Research Database ProQuest SciTech Collection ProQuest Technology Collection ProQuest Materials Science & Engineering ProQuest Central Advanced Technologies & Computer Science Collection ProQuest Central Technology collection ProQuest One Community College ProQuest Central SciTech Premium Collection ProQuest Computer Science Collection ProQuest Engineering Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional Engineering Database Advanced Technologies & Aerospace Database ProQuest Advanced Technologies & Aerospace Collection ProQuest Central Premium ProQuest One Academic ProQuest One Academic Middle East (New) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection DELNET Engineering & Technology Collection
DatabaseTitle	CrossRef Technology Collection Technology Research Database Computer and Information Systems Abstracts – Academic ProQuest One Academic Middle East (New) ProQuest Advanced Technologies & Aerospace Collection ProQuest Computer Science Collection Computer and Information Systems Abstracts SciTech Premium Collection ProQuest One Community College ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences ProQuest Engineering Collection ProQuest Central Korea ProQuest Central (New) Advanced Technologies Database with Aerospace Engineering Collection Advanced Technologies & Aerospace Collection Engineering Database ProQuest One Academic Eastern Edition ProQuest Technology Collection ProQuest SciTech Collection Computer and Information Systems Abstracts Professional Advanced Technologies & Aerospace Database ProQuest One Academic UKI Edition ProQuest DELNET Engineering and Technology Collection Materials Science & Engineering Collection ProQuest One Academic ProQuest One Academic (New)
DatabaseTitleList	Technology Collection
Database_xml	– sequence: 1 dbid: BENPR name: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Computer Science
EISSN	1573-7616
ExternalDocumentID	10_1007_s10664_023_10416_6
GrantInformation_xml	– fundername: Ministerio de Ciencia, Innovación y Universidades grantid: OPHELIA (RTI2018-101204-B-C22); HORATIO (RTI2018-101204-B-C21) funderid: http://dx.doi.org/10.13039/100014440 – fundername: Consejería de Economía, Innovación, Ciencia y Empleo, Junta de Andalucía grantid: EKIPMENT-PLUS (P18-FR-2895); MEMENTO (US-1381595)
GroupedDBID	-4Z -59 -5G -BR -EM -Y2 -~C .86 .DC .VR 06D 0R~ 0VY 199 1N0 1SB 2.D 203 28- 29G 2J2 2JN 2JY 2KG 2LR 2P1 2VQ 2~H 30V 4.4 406 408 409 40D 40E 5GY 5QI 5VS 67Z 6NX 78A 8FE 8FG 8TC 8UJ 95- 95. 95~ 96X AABHQ AACDK AAHNG AAIAL AAJBT AAJKR AANZL AAOBN AARHV AARTL AASML AATNV AATVU AAUYE AAWCG AAYIU AAYOK AAYQN AAYTO AAYZH ABAKF ABBBX ABBXA ABDZT ABECU ABFTD ABFTV ABHLI ABHQN ABJCF ABJNI ABJOX ABKCH ABKTR ABMNI ABMQK ABNWP ABQBU ABQSL ABSXP ABTEG ABTHY ABTKH ABTMW ABULA ABWNU ABXPI ACAOD ACBXY ACDTI ACGFS ACHSB ACHXU ACIWK ACKNC ACMDZ ACMLO ACOKC ACOMO ACPIV ACSNA ACZOJ ADHHG ADHIR ADIMF ADINQ ADKNI ADKPE ADRFC ADTPH ADURQ ADYFF ADZKW AEBTG AEFIE AEFQL AEGAL AEGNC AEJHL AEJRE AEKMD AEMSY AENEX AEOHA AEPYU AESKC AETLH AEVLU AEXYK AFBBN AFEXP AFGCZ AFKRA AFLOW AFQWF AFWTZ AFZKB AGAYW AGDGC AGGDS AGJBK AGMZJ AGQEE AGQMX AGRTI AGWIL AGWZB AGYKE AHAVH AHBYD AHKAY AHSBF AHYZX AIAKS AIGIU AIIXL AILAN AITGF AJBLW AJRNO AJZVZ ALMA_UNASSIGNED_HOLDINGS ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARAPS ARMRJ ASPBG AVWKF AXYYD AYJHY AZFZN B-. BA0 BBWZM BDATZ BENPR BGLVJ BGNMA BSONS C6C CAG CCPQU COF CS3 CSCUP DDRTE DL5 DNIVK DPUIP DU5 EBLON EBS EIOEI EJD ESBYG FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRRFC FSGXE FWDCC GGCAI GGRSB GJIRD GNWQR GQ6 GQ7 GQ8 GXS H13 HCIFZ HF~ HG5 HG6 HMJXF HQYDN HRMNR HVGLF HZ~ I09 IHE IJ- IKXTQ ITM IWAJR IXC IZIGR IZQ I~X I~Z J-C J0Z JBSCW JCJTX JZLTJ KDC KOV KOW L6V LAK LLZTM M4Y M7S MA- N2Q NB0 NDZJH NPVJJ NQJWS NU0 O9- O93 O9G O9I O9J OAM P19 P62 P9O PF0 PT4 PT5 PTHSS Q2X QOK QOS R4E R89 R9I RHV RNI RNS ROL RPX RSV RZC RZE RZK S0W S16 S1Z S26 S27 S28 S3B SAP SCJ SCLPG SCO SDH SDM SHX SISQX SJYHP SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW STPWE SZN T13 T16 TSG TSK TSV TUC U2A UG4 UOJIU UTJUX UZXMN VC2 VFIZW W23 W48 WK8 YLTOR Z45 Z7R Z7S Z7V Z7X Z7Z Z81 Z83 Z86 Z88 Z8M Z8N Z8P Z8R Z8T Z8U Z8W Z92 ZMTXR ~EX AAPKM AAYXX ABBRH ABDBE ABFSG ABRTQ ACSTC ADHKG AEZWR AFDZB AFFHD AFHIU AFOHR AGQPQ AHPBZ AHWEU AIXLP ATHPR AYFIA CITATION PHGZM PHGZT PQGLB 7SC 8FD DWQXO JQ2 L7M L~C L~D PKEHL PQEST PQQKQ PQUKI PRINS
ID	FETCH-LOGICAL-c363t-d4d0650e58436ede1ba91ccd5c55bd93b94b816e93ffd07feca38e54313dadf3
IEDL.DBID	RSV
ISICitedReferencesCount	3
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001153768000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1382-3256
IngestDate	Tue Dec 02 15:58:33 EST 2025 Sat Nov 29 05:37:47 EST 2025 Tue Nov 18 21:58:10 EST 2025 Fri Feb 21 02:38:45 EST 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Issue	2
Keywords	Experiment replication Distributed pair programming Gender bias Remote pair programming Software Engineering education Pair programming
Language	English
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c363t-d4d0650e58436ede1ba91ccd5c55bd93b94b816e93ffd07feca38e54313dadf3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14
ORCID	0000-0002-8763-0819 0000-0003-3630-5511 0000-0002-9390-3772 0000-0002-6096-4931
OpenAccessLink	https://link.springer.com/10.1007/s10664-023-10416-6
PQID	2921290444
PQPubID	326341
ParticipantIDs	proquest_journals_2921290444 crossref_primary_10_1007_s10664_023_10416_6 crossref_citationtrail_10_1007_s10664_023_10416_6 springer_journals_10_1007_s10664_023_10416_6
PublicationCentury	2000
PublicationDate	2024-03-01
PublicationDateYYYYMMDD	2024-03-01
PublicationDate_xml	– month: 03 year: 2024 text: 2024-03-01 day: 01
PublicationDecade	2020
PublicationPlace	New York
PublicationPlace_xml	– name: New York – name: Dordrecht
PublicationSubtitle	An International Journal
PublicationTitle	Empirical software engineering : an international journal
PublicationTitleAbbrev	Empir Software Eng
PublicationYear	2024
Publisher	Springer US Springer Nature B.V
Publisher_xml	– name: Springer US – name: Springer Nature B.V
References	SallehNMendesEGrundyJInvestigating the effects of personality traits on pair programming in a higher education setting through a family of experimentsEmpirical Soft Eng201419371475210.1007/s10664-012-9238-4 KitchenhamBAPfleegerSLHoaglinDCEmamKERosenbergJPreliminary Guidelines for Empirical Research in Software EngineeringIEEE Trans Softw Eng200228872173410.1109/TSE.2002.1027796 Hawlitschek A, Berndt S, Schulz S (2022) Empirical research on pair programming in higher education: a literature review. Computer science education, p 1–29 Choi KS (2013) Evaluating gender significance within a pair programming context. In Proceedings of the hawaii international conference on system sciences, p 4817–4825 Denzin NK (2006) Sociological Methods: A Sourcebook. 5th ed. Aldine Transaction HartsellTWho’s talking online? a descriptive analysis of gender & online communicationInt J Inf Commun Technol Educ200511425410.4018/jicte.2005010105 Collins E, Ghahramani Z (2021) LaMDA: our breakthrough conversation technology. Google Research. https://blog.google/technology/ai/lamda Gómez O, Solari M, Calvache C, Ledezma-Carrizalez A (2017) A controlled experiment on productivity of pair programming gender combinations: Preliminary results. In Proceedings of the XX Ibero–American conference on software engineering, p 197–210 YingKMRodríguezFJDibbleALBoyerKEUnderstanding women’s remote collaborative programming experiences: The relationship between dialogue features and reported perceptionsProc ACM Hum -Comput Interact20214CSCW312910.1145/3432952 Galdo AC, Celepkolu M, Lytle N, Boyer KE (2022) Pair programming in a pandemic: Understanding middle school students’ remote collaboration experiences. In Proceedings of the 53rd ACM technical symposium on computer science education V. 1, p 335–341 Devlin J, Chang M-W, Lee K, Toutanova K (2019) BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 conference of the north american chapter of the association for computational linguistics: human language technologies, Volume 1 (Long and Short Papers), p 4171–4186 Kaur Kuttal S, Gerstner K, Bejarano A (2019) Remote pair programming in online cs education: Investigating through a gender lens. In 2019 IEEE symposium on visual languages and human-centric computing (VL/HCC), p 75–85. https://doi.org/10.1109/VLHCC.2019.8818790 Samara O, Monzon A (2021) Zoom burnout amidst a pandemic: Perspective from a medical student and learner. Therapeutic Advances in Infectious Disease, 8 HanksBFitzgeraldSMcCauleyRMurphyLZanderCPair programming in education: A literature reviewComput Sci Educ201121213517310.1080/08993408.2011.579808 HoferSIStudying gender bias in physics grading: The role of teaching experience and countryInt J Sci Educ201537172879290510.1080/09500693.2015.1114190 da Silva EstácioBJPrikladnickiRDistributed pair programming: A systematic literature reviewInf Softw Technol20156311010.1016/j.infsof.2015.02.011 Stotts D, Williams L, Nagappan N, Baheti P, Jen D, Jackson A (2003) Virtual teaming: Experiments and experiences with distributed pair programming. In: Conference on extreme programming and agile methods, p 129–141 GraphPad (2023) What is the difference between ordinal, interval and ratio variables? Why should I care?. https://t.ly/rxCW EcklesDKizilcecRBakshyEEstimating peer effects in networks with peer encouragement designsProc Natl Acad Sci2016113277316732210.1073/pnas.1511201113 BendigEErbBSchulze-ThuesingLBaumeisterHHThe next generation: Chatbots in clinical psychology and psychotherapy to foster mental health - a scoping reviewVerhaltenstherapie201910.1159/000501812 Katira N, Williams L, Osborne J (2005) Towards increasing the compatibility of student pair programmers. In: International conference on software engineering, p 625–626. https://doi.org/10.1109/ICSE.2005.1553618 FaulFErdfelderELangA-GBuchnerAG*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciencesBehav Res Methods20073917519110.3758/BF03193146 Newser (2023) This university has the most stressed-out students. https://www.newser.com/story/330315/10-most-least-stressed-college-towns.html UCLA: Statistical Consulting Group (2022) What does cronbach’s alpha mean?. Accessed 29-June-2022. https://stats.oarc.ucla.edu/spss/faq/what-does-cronbachs-alpha-mean de Oliveira NetoFGTorkarRFeldtRGrenLFuriaCAHuangZEvolution of statistical analysis in empirical software engineering research: Current state and steps forwardJ Syst Softw201915624626710.1016/j.jss.2019.07.002 StevensSSOn the theory of scales of measurementScience1946103268467768010.1126/science.103.2684.677 ChoiKSA comparative analysis of different gender pair combinations in pair programmingBehav Inf Technol201534882583710.1080/0144929X.2014.937460 Saini M, Chahal KK, Kaur A (2021) Empirical studies on using pair programming as a pedagogical tool in higher education courses: A systematic literature review. Auerbach Publications PorterAAVottaLGBasiliVRBuilding Knowledge through Families of ExperimentsIEEE Trans Softw Eng199925445647310.1109/32.799939 Gravetter FJ, Wallnau LB (2004) Statistics for the Behavioural Sciences. 6 edn. Wadsworth/Thompson Learning Greer S, Ramo D, Chang Y-J, Fu M, Moskowitz J, Haritatos J (2019) Use of the chatbot “vivibot” to deliver positive psychology skills and promote well-being among young people after cancer treatment: Randomized controlled feasibility trial. JMIR Mhealth Uhealth, 7(10) AAUW (2002) The STEM gap: Women and girls in science, technology, engineering and mathematics. American Association of University Women. https://www.aauw.org/resources/research/the-stem-gap Medel P, Pournaghshband V (2017) Eliminating gender bias in computer science education materials. In Proceedings of the 2017 ACM SIGCSE technical symposium on computer science education, p 411–416 Thomas L, Ratcliffe M, Robertson A (2003) Code warriors and code-a-phobes: A study in attitude and pair programming. In Proceedings of SIGCSE, p 363–367 Allaire-DuquetteGChastenayPBouffardTBélangerSAHernandezOMahhouMAGirouxPMcMullinSDesjarlaisEGender differences in self-efficacy for programming narrowed after a 2-h science museum workshopCan J Sci Math Techn Educ2022228710010.1007/s42330-022-00193-7 Korber P, Motschnig R (2021) The effects of pair-programming in introductory programming courses with visual and text-based languages. In IEEE frontiers in education conference, p 1-9 Durán A, Fernández P, Bernárdez B, Weinman N, Akalın A, Fox A (2021) Gender bias in remote pair programming among software engineering students: The twincode exploratory study. In Proceedings of ESEM 2021 – registered report track. arXiv:2110.01962 O’ConnorCJoffeHIntercoder reliability in qualitative research: Debates and practical guidelinesInt J Qual Methods20201911310.1177/1609406919899220 Xinogalos S, Satratzemi M, Chatzigeorgiou A, Tsompanoudi D (2017) Student perceptions on the benefits and shortcomings of distributed pair progr4amming assignments. 2017 IEEE global engineering education conference (EDUCON), p 1513–152 SallehNMendesEGrundyJEmpirical studies of pair programming for cs/se teaching in higher education: A systematic literature reviewIEEE Trans Software Eng20113750952510.1109/TSE.2010.59 Al-Jarrah A, Pontelli E (2016) On the effectiveness of a collaborative virtual pair-programming environment. In: International conference on learning and collaboration technologies, p 583–595 Jarratt L, Bowman NA, Culver KC, Segre AM (2019) A large-scale experimental study of gender and pair composition in pair programming. In Proceedings of the ACM conference on innovation and technology in computer science education, p 176–181 MartellRFLaneDMEmrichCMale-female differences: A computer simulationAm Psychol199651215715810.1037/0003-066X.51.2.157 HannayJEArisholmEEngvikHSjobergDIKEffects of personality on pair programmingIEEE Trans Softw Eng2010361618010.1109/TSE.2009.41 FisherMCoxAGender and programming contests: Mitigating exclusionary practicesInf Educ2006514762 SyedMNelsonSCGuidelines for establishing reliability when coding narrative dataEmerging Adulthood20153637538710.1177/2167696815587648 SfetsosPStamelosIAngelisLDeligiannisIAn experimental investigation of personality types impact on pair effectiveness in pair programmingEmpirical Softw Eng200914218722610.1007/s10664-008-9093-5 University of Seville (2021) Statistical yearbook 2020–2021. https://servicio.us.es/splanestu/WS/Anuario2021/AESY20-21.html. English version starts at page 400 CohenLManionLMorrisonKResearch Methods in Education20188Routledge Hopper J (2014) How to label your 10-point scale. Versta Research. https://verstaresearch.com/blog/how-to-label-your-10-point-scale STEM Women (2021) Percentages of women in STEM statistics. STEM Women. https://www.stemwomen.com/women-in-stem-percentages-of-women-in-stem-statistics WohlinCRunesonPHöstMOhlssonMCRegnellBWesslénAExperimentation in Software Engineering: an Introduction2012Springer10.1007/978-3-642-29044-2 Werner LL, Hanks B, McDowell C (2004) Pair-programming helps female computer science students. J Educ Resour Comput, 4(1) Chaparro EA, Yuksel A, Romero P, Bryant S (2005) Factors affecting the perceived effectiveness of pair programming in higher education. In: Proceedings of the 17th workshop of the psychology of programming interest group RDocumentation (2023) p.adjust: Adjust p-values for multiple comparisons. https://www.rdocumentation.org/packages/stats/versions/3.6.2/topics/p.adjust Akalın A, Weinman N, Stasaski K, Fox A (2021) Exploring the impact of gender bias on pair programming. In: Proceedings of the 17th ACM conference on international computing education research, p 435–437 Ying KM, Martin AC, Rodríguez FJ, Boyer KE (2021a) Cs1 students’ perspectives on the computer science gender gap: Achieving equity requires awareness. In 2021 Conference on research in equitable and sustained participation in engineering, computing, and technology (RESPECT), p 1–9. IEEE Terrell J, Kofink A, Middleton 10416_CR64 10416_CR65 10416_CR63 10416_CR24 10416_CR68 10416_CR25 P Sfetsos (10416_CR57) 2009; 14 10416_CR66 10416_CR23 10416_CR67 10416_CR26 F Faul (10416_CR21) 2007; 39 10416_CR27 L Cohen (10416_CR9) 2018 RF Martell (10416_CR41) 1996; 51 M Syed (10416_CR62) 2015; 3 10416_CR6 10416_CR7 10416_CR60 10416_CR61 10416_CR10 JE Hannay (10416_CR29) 2010; 36 KS Choi (10416_CR8) 2015; 34 10416_CR51 10416_CR52 10416_CR14 10416_CR58 10416_CR55 10416_CR56 10416_CR17 BJ da Silva Estácio (10416_CR12) 2015; 63 10416_CR15 10416_CR16 AA Porter (10416_CR49) 1999; 25 10416_CR19 FG de Oliveira Neto (10416_CR13) 2019; 156 F Oda (10416_CR47) 2022; 118 M Cruz (10416_CR11) 2023; 105 C O’Connor (10416_CR46) 2020; 19 D Falessi (10416_CR20) 2018; 23 10416_CR50 10416_CR42 E Bendig (10416_CR5) 2019 10416_CR43 10416_CR40 BA Kitchenham (10416_CR38) 2002; 28 10416_CR44 10416_CR45 10416_CR48 KM Ying (10416_CR72) 2021; 4 D Eckles (10416_CR18) 2016; 113 SI Hofer (10416_CR32) 2015; 37 SS Stevens (10416_CR59) 1946; 103 N Salleh (10416_CR53) 2011; 37 T Hartsell (10416_CR30) 2005; 1 10416_CR31 10416_CR35 10416_CR1 10416_CR36 10416_CR2 10416_CR33 10416_CR3 10416_CR34 10416_CR39 10416_CR37 B Hanks (10416_CR28) 2011; 21 N Salleh (10416_CR54) 2014; 19 M Fisher (10416_CR22) 2006; 5 10416_CR71 G Allaire-Duquette (10416_CR4) 2022; 22 C Wohlin (10416_CR69) 2012 10416_CR70
References_xml	– reference: StevensSSOn the theory of scales of measurementScience1946103268467768010.1126/science.103.2684.677 – reference: CohenLManionLMorrisonKResearch Methods in Education20188Routledge – reference: CruzMBernárdezBDuránAGuevara-VegaCRuiz-CortésAA model-based approach for specifying changes in replications of empirical studies in computer scienceComputing202310511891213458689010.1007/s00607-022-01133-x – reference: Denzin NK (2006) Sociological Methods: A Sourcebook. 5th ed. Aldine Transaction – reference: Kaur Chahal K, Kaur A, Saini M (2021) Research and evidence in software engineering: from empirical studies to open source artifacts, chapter empirical studies on using pair programming as a pedagogical tool in higher education courses: A systematic literature review, p 251–287. Taylor & Francis Group – reference: YingKMRodríguezFJDibbleALBoyerKEUnderstanding women’s remote collaborative programming experiences: The relationship between dialogue features and reported perceptionsProc ACM Hum -Comput Interact20214CSCW312910.1145/3432952 – reference: Choi KS (2013) Evaluating gender significance within a pair programming context. In Proceedings of the hawaii international conference on system sciences, p 4817–4825 – reference: Stotts D, Williams L, Nagappan N, Baheti P, Jen D, Jackson A (2003) Virtual teaming: Experiments and experiences with distributed pair programming. In: Conference on extreme programming and agile methods, p 129–141 – reference: El-Refai K, Kwon D, Brincau D, Akalın A, Fox A, Fernández P, Durán A (2023) Twincode: An instrumented platform for pair programming research. In Proceedings of the 54th ACM technical symposium on computer science education v. 2, p 1264 – reference: Salleh N, Mendes E, Grundy J, Burch G (2010) The effects of neuroticism on pair programming: an empirical study in the higher education context. In Proceedings of the 2010 ACM-IEEE international symposium on empirical software engineering and measurement, p 1–10 – reference: Akalın A, Weinman N, Stasaski K, Fox A (2021) Exploring the impact of gender bias on pair programming. In: Proceedings of the 17th ACM conference on international computing education research, p 435–437 – reference: Lim R, Wu M, Miller L (2021) Customizing GPT-3 for your application. OpenAI. https://openai.com/blog/customized-gpt-3/ – reference: Newser (2023) This university has the most stressed-out students. https://www.newser.com/story/330315/10-most-least-stressed-college-towns.html – reference: O’ConnorCJoffeHIntercoder reliability in qualitative research: Debates and practical guidelinesInt J Qual Methods20201911310.1177/1609406919899220 – reference: Al-Jarrah A, Pontelli E (2016) On the effectiveness of a collaborative virtual pair-programming environment. In: International conference on learning and collaboration technologies, p 583–595 – reference: Medel P, Pournaghshband V (2017) Eliminating gender bias in computer science education materials. In Proceedings of the 2017 ACM SIGCSE technical symposium on computer science education, p 411–416 – reference: OdaFLechagoSAda SilvaBEHuntJCAn experimental analysis of gender-biased verbal behavior and self-editing using an online chat analogJ Exp Anal Behav20221181244510.1002/jeab.763 – reference: University of California, Berkeley (2021) Demographic information (restricted access). https://calanswers.berkeley.edu/home – reference: Chaparro EA, Yuksel A, Romero P, Bryant S (2005) Factors affecting the perceived effectiveness of pair programming in higher education. In: Proceedings of the 17th workshop of the psychology of programming interest group – reference: SfetsosPStamelosIAngelisLDeligiannisIAn experimental investigation of personality types impact on pair effectiveness in pair programmingEmpirical Softw Eng200914218722610.1007/s10664-008-9093-5 – reference: SyedMNelsonSCGuidelines for establishing reliability when coding narrative dataEmerging Adulthood20153637538710.1177/2167696815587648 – reference: Thomas L, Ratcliffe M, Robertson A (2003) Code warriors and code-a-phobes: A study in attitude and pair programming. In Proceedings of SIGCSE, p 363–367 – reference: HartsellTWho’s talking online? a descriptive analysis of gender & online communicationInt J Inf Commun Technol Educ200511425410.4018/jicte.2005010105 – reference: de Oliveira NetoFGTorkarRFeldtRGrenLFuriaCAHuangZEvolution of statistical analysis in empirical software engineering research: Current state and steps forwardJ Syst Softw201915624626710.1016/j.jss.2019.07.002 – reference: Samara O, Monzon A (2021) Zoom burnout amidst a pandemic: Perspective from a medical student and learner. Therapeutic Advances in Infectious Disease, 8 – reference: McAuliffe A, Hart J, Kuttal SK (2022) Evaluating gender bias in pair programming conversations with an agent. In 2022 IEEE symposium on visual languages and human-centric computing (VL/HCC), p 1–4. https://doi.org/10.1109/VL/HCC53370.2022.9833146 – reference: RDocumentation (2023) p.adjust: Adjust p-values for multiple comparisons. https://www.rdocumentation.org/packages/stats/versions/3.6.2/topics/p.adjust – reference: SallehNMendesEGrundyJEmpirical studies of pair programming for cs/se teaching in higher education: A systematic literature reviewIEEE Trans Software Eng20113750952510.1109/TSE.2010.59 – reference: University of Seville (2021) Statistical yearbook 2020–2021. https://servicio.us.es/splanestu/WS/Anuario2021/AESY20-21.html. English version starts at page 400 – reference: Allaire-DuquetteGChastenayPBouffardTBélangerSAHernandezOMahhouMAGirouxPMcMullinSDesjarlaisEGender differences in self-efficacy for programming narrowed after a 2-h science museum workshopCan J Sci Math Techn Educ2022228710010.1007/s42330-022-00193-7 – reference: UCLA: Statistical Consulting Group (2022) What does cronbach’s alpha mean?. Accessed 29-June-2022. https://stats.oarc.ucla.edu/spss/faq/what-does-cronbachs-alpha-mean/ – reference: WohlinCRunesonPHöstMOhlssonMCRegnellBWesslénAExperimentation in Software Engineering: an Introduction2012Springer10.1007/978-3-642-29044-2 – reference: Gómez O, Solari M, Calvache C, Ledezma-Carrizalez A (2017) A controlled experiment on productivity of pair programming gender combinations: Preliminary results. In Proceedings of the XX Ibero–American conference on software engineering, p 197–210 – reference: Per Runeson (2003) Using students as experiment subjects - an analysis on graduate and freshmen student data. In Proceedings 7th International conference on empirical assessment & evaluation in software engineering, p 95–102 – reference: Korber P, Motschnig R (2021) The effects of pair-programming in introductory programming courses with visual and text-based languages. In IEEE frontiers in education conference, p 1-9 – reference: Saini M, Chahal KK, Kaur A (2021) Empirical studies on using pair programming as a pedagogical tool in higher education courses: A systematic literature review. Auerbach Publications – reference: Hawlitschek A, Berndt S, Schulz S (2022) Empirical research on pair programming in higher education: a literature review. Computer science education, p 1–29 – reference: Werner LL, Hanks B, McDowell C (2004) Pair-programming helps female computer science students. J Educ Resour Comput, 4(1) – reference: Dimock M (2019) Defining generations: Where millennials end and generation z begins. https://pewrsr.ch/2szqtJz – reference: Ying KM, Martin AC, Rodríguez FJ, Boyer KE (2021a) Cs1 students’ perspectives on the computer science gender gap: Achieving equity requires awareness. In 2021 Conference on research in equitable and sustained participation in engineering, computing, and technology (RESPECT), p 1–9. IEEE – reference: Hopper J (2014) How to label your 10-point scale. Versta Research. https://verstaresearch.com/blog/how-to-label-your-10-point-scale/ – reference: PorterAAVottaLGBasiliVRBuilding Knowledge through Families of ExperimentsIEEE Trans Softw Eng199925445647310.1109/32.799939 – reference: MartellRFLaneDMEmrichCMale-female differences: A computer simulationAm Psychol199651215715810.1037/0003-066X.51.2.157 – reference: KitchenhamBAPfleegerSLHoaglinDCEmamKERosenbergJPreliminary Guidelines for Empirical Research in Software EngineeringIEEE Trans Softw Eng200228872173410.1109/TSE.2002.1027796 – reference: ChoiKSA comparative analysis of different gender pair combinations in pair programmingBehav Inf Technol201534882583710.1080/0144929X.2014.937460 – reference: Galdo AC, Celepkolu M, Lytle N, Boyer KE (2022) Pair programming in a pandemic: Understanding middle school students’ remote collaboration experiences. In Proceedings of the 53rd ACM technical symposium on computer science education V. 1, p 335–341 – reference: Collins E, Ghahramani Z (2021) LaMDA: our breakthrough conversation technology. Google Research. https://blog.google/technology/ai/lamda/ – reference: Kaur Kuttal S, Gerstner K, Bejarano A (2019) Remote pair programming in online cs education: Investigating through a gender lens. In 2019 IEEE symposium on visual languages and human-centric computing (VL/HCC), p 75–85. https://doi.org/10.1109/VLHCC.2019.8818790 – reference: Study International (2016) Students at these U.S. universities are under the most stress. https://www.studyinternational.com/news/students-mental-health-us-universities-stress/ – reference: HanksBFitzgeraldSMcCauleyRMurphyLZanderCPair programming in education: A literature reviewComput Sci Educ201121213517310.1080/08993408.2011.579808 – reference: FaulFErdfelderELangA-GBuchnerAG*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciencesBehav Res Methods20073917519110.3758/BF03193146 – reference: HoferSIStudying gender bias in physics grading: The role of teaching experience and countryInt J Sci Educ201537172879290510.1080/09500693.2015.1114190 – reference: Jarratt L, Bowman NA, Culver KC, Segre AM (2019) A large-scale experimental study of gender and pair composition in pair programming. In Proceedings of the ACM conference on innovation and technology in computer science education, p 176–181 – reference: Katira N, Williams L, Osborne J (2005) Towards increasing the compatibility of student pair programmers. In: International conference on software engineering, p 625–626. https://doi.org/10.1109/ICSE.2005.1553618 – reference: Durán A, Fernández P, Bernárdez B, Weinman N, Akalın A, Fox A (2021) Gender bias in remote pair programming among software engineering students: The twincode exploratory study. In Proceedings of ESEM 2021 – registered report track. arXiv:2110.01962 – reference: HannayJEArisholmEEngvikHSjobergDIKEffects of personality on pair programmingIEEE Trans Softw Eng2010361618010.1109/TSE.2009.41 – reference: STEM Women (2021) Percentages of women in STEM statistics. STEM Women. https://www.stemwomen.com/women-in-stem-percentages-of-women-in-stem-statistics – reference: Navarro D (2018) Learning statistics with R: A tutorial for psychology students and other beginners (version 0.6).https://learningstatisticswithr.com/ – reference: GraphPad (2023) What is the difference between ordinal, interval and ratio variables? Why should I care?. https://t.ly/rxCW – reference: AAUW (2002) The STEM gap: Women and girls in science, technology, engineering and mathematics. American Association of University Women. https://www.aauw.org/resources/research/the-stem-gap/ – reference: FalessiDJuristoNWohlinCTurhanBMünchJJedlitschkaAOivoMEmpirical software engineering experts on the use of students and professionals in experimentsEmpirical Softw Eng201823145248910.1007/s10664-017-9523-3 – reference: Gravetter FJ, Wallnau LB (2004) Statistics for the Behavioural Sciences. 6 edn. Wadsworth/Thompson Learning – reference: Xinogalos S, Satratzemi M, Chatzigeorgiou A, Tsompanoudi D (2017) Student perceptions on the benefits and shortcomings of distributed pair progr4amming assignments. 2017 IEEE global engineering education conference (EDUCON), p 1513–152 – reference: Rodríguez FJ, Price KM, Boyer KE (2017) Exploring the pair programming process: Characteristics of effective collaboration. In Proceedings of the 2017 ACM SIGCSE technical symposium on computer science education, p 507–512 – reference: SallehNMendesEGrundyJInvestigating the effects of personality traits on pair programming in a higher education setting through a family of experimentsEmpirical Soft Eng201419371475210.1007/s10664-012-9238-4 – reference: Greer S, Ramo D, Chang Y-J, Fu M, Moskowitz J, Haritatos J (2019) Use of the chatbot “vivibot” to deliver positive psychology skills and promote well-being among young people after cancer treatment: Randomized controlled feasibility trial. JMIR Mhealth Uhealth, 7(10) – reference: Devlin J, Chang M-W, Lee K, Toutanova K (2019) BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 conference of the north american chapter of the association for computational linguistics: human language technologies, Volume 1 (Long and Short Papers), p 4171–4186 – reference: FisherMCoxAGender and programming contests: Mitigating exclusionary practicesInf Educ2006514762 – reference: da Silva EstácioBJPrikladnickiRDistributed pair programming: A systematic literature reviewInf Softw Technol20156311010.1016/j.infsof.2015.02.011 – reference: BendigEErbBSchulze-ThuesingLBaumeisterHHThe next generation: Chatbots in clinical psychology and psychotherapy to foster mental health - a scoping reviewVerhaltenstherapie201910.1159/000501812 – reference: EcklesDKizilcecRBakshyEEstimating peer effects in networks with peer encouragement designsProc Natl Acad Sci2016113277316732210.1073/pnas.1511201113 – reference: Terrell J, Kofink A, Middleton J, Rainear C, Murphy-Hill E, Parnin C, Stallings J (2017) Gender differences and bias in open source: pull request acceptance of women versus men. PeerJ Computer Science, 3(e111) – ident: 10416_CR58 – volume: 14 start-page: 187 issue: 2 year: 2009 ident: 10416_CR57 publication-title: Empirical Softw Eng doi: 10.1007/s10664-008-9093-5 – ident: 10416_CR36 doi: 10.1201/9781003168393-13 – ident: 10416_CR3 doi: 10.1007/978-3-319-39483-1_53 – ident: 10416_CR16 – volume: 22 start-page: 87 year: 2022 ident: 10416_CR4 publication-title: Can J Sci Math Techn Educ doi: 10.1007/s42330-022-00193-7 – volume: 1 start-page: 42 issue: 1 year: 2005 ident: 10416_CR30 publication-title: Int J Inf Commun Technol Educ doi: 10.4018/jicte.2005010105 – ident: 10416_CR50 – volume: 36 start-page: 61 issue: 1 year: 2010 ident: 10416_CR29 publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2009.41 – volume: 37 start-page: 509 year: 2011 ident: 10416_CR53 publication-title: IEEE Trans Software Eng doi: 10.1109/TSE.2010.59 – ident: 10416_CR40 – ident: 10416_CR35 doi: 10.1109/ICSE.2005.1553618 – ident: 10416_CR2 doi: 10.1145/3446871.3469790 – volume: 19 start-page: 714 issue: 3 year: 2014 ident: 10416_CR54 publication-title: Empirical Soft Eng doi: 10.1007/s10664-012-9238-4 – ident: 10416_CR64 doi: 10.1145/792548.612007 – ident: 10416_CR51 doi: 10.1145/3017680.3017748 – ident: 10416_CR67 – ident: 10416_CR25 – ident: 10416_CR48 – ident: 10416_CR44 – volume: 23 start-page: 452 issue: 1 year: 2018 ident: 10416_CR20 publication-title: Empirical Softw Eng doi: 10.1007/s10664-017-9523-3 – volume: 113 start-page: 7316 issue: 27 year: 2016 ident: 10416_CR18 publication-title: Proc Natl Acad Sci doi: 10.1073/pnas.1511201113 – ident: 10416_CR52 doi: 10.1201/9781003168393-13 – volume: 3 start-page: 375 issue: 6 year: 2015 ident: 10416_CR62 publication-title: Emerging Adulthood doi: 10.1177/2167696815587648 – ident: 10416_CR71 doi: 10.1109/RESPECT51740.2021.9620659 – ident: 10416_CR17 – volume: 5 start-page: 47 issue: 1 year: 2006 ident: 10416_CR22 publication-title: Inf Educ – volume: 118 start-page: 24 issue: 1 year: 2022 ident: 10416_CR47 publication-title: J Exp Anal Behav doi: 10.1002/jeab.763 – year: 2019 ident: 10416_CR5 publication-title: Verhaltenstherapie doi: 10.1159/000501812 – volume-title: Research Methods in Education year: 2018 ident: 10416_CR9 – ident: 10416_CR66 – ident: 10416_CR34 doi: 10.1145/3304221.3319782 – ident: 10416_CR24 – ident: 10416_CR6 – ident: 10416_CR45 – ident: 10416_CR10 – volume: 63 start-page: 1 year: 2015 ident: 10416_CR12 publication-title: Inf Softw Technol doi: 10.1016/j.infsof.2015.02.011 – ident: 10416_CR33 – volume: 105 start-page: 1189 year: 2023 ident: 10416_CR11 publication-title: Computing doi: 10.1007/s00607-022-01133-x – ident: 10416_CR19 doi: 10.1145/3545947.3573239 – ident: 10416_CR42 doi: 10.1109/VL/HCC53370.2022.9833146 – volume: 19 start-page: 1 year: 2020 ident: 10416_CR46 publication-title: Int J Qual Methods doi: 10.1177/1609406919899220 – ident: 10416_CR7 doi: 10.1109/HICSS.2013.209 – volume: 28 start-page: 721 issue: 8 year: 2002 ident: 10416_CR38 publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2002.1027796 – ident: 10416_CR14 – ident: 10416_CR1 – volume: 25 start-page: 456 issue: 4 year: 1999 ident: 10416_CR49 publication-title: IEEE Trans Softw Eng doi: 10.1109/32.799939 – ident: 10416_CR60 doi: 10.1007/978-3-540-45122-8_15 – ident: 10416_CR27 doi: 10.2196/15018 – ident: 10416_CR65 – volume: 51 start-page: 157 issue: 2 year: 1996 ident: 10416_CR41 publication-title: Am Psychol doi: 10.1037/0003-066X.51.2.157 – volume: 156 start-page: 246 year: 2019 ident: 10416_CR13 publication-title: J Syst Softw doi: 10.1016/j.jss.2019.07.002 – ident: 10416_CR56 doi: 10.1177/20499361211026717 – ident: 10416_CR61 – ident: 10416_CR55 doi: 10.1145/1852786.1852816 – volume: 37 start-page: 2879 issue: 17 year: 2015 ident: 10416_CR32 publication-title: Int J Sci Educ doi: 10.1080/09500693.2015.1114190 – ident: 10416_CR15 – ident: 10416_CR43 doi: 10.1145/3017680.3017794 – ident: 10416_CR70 doi: 10.1109/EDUCON.2017.7943050 – volume: 21 start-page: 135 issue: 2 year: 2011 ident: 10416_CR28 publication-title: Comput Sci Educ doi: 10.1080/08993408.2011.579808 – volume: 4 start-page: 1 issue: CSCW3 year: 2021 ident: 10416_CR72 publication-title: Proc ACM Hum -Comput Interact doi: 10.1145/3432952 – volume-title: Experimentation in Software Engineering: an Introduction year: 2012 ident: 10416_CR69 doi: 10.1007/978-3-642-29044-2 – ident: 10416_CR39 doi: 10.1109/FIE49875.2021.9637186 – volume: 103 start-page: 677 issue: 2684 year: 1946 ident: 10416_CR59 publication-title: Science doi: 10.1126/science.103.2684.677 – volume: 34 start-page: 825 issue: 8 year: 2015 ident: 10416_CR8 publication-title: Behav Inf Technol doi: 10.1080/0144929X.2014.937460 – ident: 10416_CR63 doi: 10.7717/peerj-cs.111 – ident: 10416_CR68 doi: 10.1145/1060071.1060075 – ident: 10416_CR23 doi: 10.1145/3478431.3499324 – ident: 10416_CR31 doi: 10.1080/08993408.2022.2039504 – volume: 39 start-page: 175 year: 2007 ident: 10416_CR21 publication-title: Behav Res Methods doi: 10.3758/BF03193146 – ident: 10416_CR26 – ident: 10416_CR37 doi: 10.1109/VLHCC.2019.8818790
SSID	ssj0009745
Score	2.3723507
Snippet	Context Women have historically been underrepresented in Software Engineering, due in part to the stereotyped assumption that women are less technically... ContextWomen have historically been underrepresented in Software Engineering, due in part to the stereotyped assumption that women are less technically...
SourceID	proquest crossref springer
SourceType	Aggregation Database Enrichment Source Index Database Publisher
StartPage	40
SubjectTerms	Avatars Collaboration Colleges & universities Compilers Computer Science Dependent variables Engineering education Gender Human bias Interpreters Programming Programming Languages Registered Reports Remote observing Replication Software engineering Software Engineering/Programming and Operating Systems Source code Students Women
SummonAdditionalLinks	– databaseName: ProQuest Central dbid: BENPR link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1NT9tAEB2VwIFLafkQoSmaQ290Bc6u13YvKEGJWqkKEURVbpa9u5YigZPGAcS_4Ccza69jilQunHe9tvRmZ5734z2AbzwJjJdmXWZCGTLi_xlLpaAf14y4iR-opPIG_PM7GI3C6TQauwW3wh2rrHNimaj1XNk18tNu1LVLJkKI88VfZl2j7O6qs9DYgE2rVCZasNkfjMZXjexuUNoUW6E9xqm6u2sz7vKclIJRzaJURLSEyX9LU8M3X22RlpVnuPPeb_4EHx3nxF4VJJ_hg8l3Yaf2c0A3vffgaX0gDyuHOezPkgJ_5XhlCFGD42S2xHF1ouvWdutZqyK8plT-kCwNvhA3xOtKNLP4gRSJuHqwKhDa4KUz4irbH7GXaxzOiIHiwMlR07vWW-r7MBkOJhc_mXNsYIpLvmJaaEv5DLEaLo2mKCCsldK-8v1URzyNRBp60kQ8y_RZkBmV8NDY6_hcJzrjB9DK57k5BKRElIU-9dTcE0aepYKKeaJ9T_NIpdxrg1djFSunZm5NNW7iRofZ4hsTvnGJbyzbcLJ-ZlFpebzZu1ODGrt5XcQNom34XodF0_z_0Y7eHu0LbHeJLVWH2zrQWi3vzFfYUverWbE8dlH9DJqt_to priority: 102 providerName: ProQuest
Title	Exploring Gender Bias In Remote Pair Programming Among Software Engineering Students: The twincode Original Study And First External Replication
URI	https://link.springer.com/article/10.1007/s10664-023-10416-6 https://www.proquest.com/docview/2921290444
Volume	29
WOSCitedRecordID	wos001153768000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAVX databaseName: SpringerLINK Contemporary 1997-Present customDbUrl: eissn: 1573-7616 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0009745 issn: 1382-3256 databaseCode: RSV dateStart: 19970101 isFulltext: true titleUrlDefault: https://link.springer.com/search?facet-content-type=%22Journal%22 providerName: Springer Nature
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3PT9swFH4alAMXYPzQCqx6B25gidSOk3ArqBWTpi5qq6raJUpsR6rEsqkpIP4L_mSeE6dliE3aLrnYcSI_-70v8XvfB3DG08B4Wd5lJpQhI_yfs0wK-nDNCZv4gUprbcDp12A4DGezKHZFYWWT7d4cSVae-lWxm5SCUYwh10EwgskNaFG4C-12HI2na6rdoJImtuR6jFNEd6Uy74_xezhaY8w3x6JVtBns_t977sGOQ5fYq5fDR_hgin3YbZQb0G3kA3hepd5hrSWH1_O0xC8FjgzZzmCczhcY17lbP2y3nhUlwjE57cd0YfAVjSGOa3rM8gppzeHy0fI9aIPfnORW1f6EvULjYE5YE_uOeJqetTo8P4TJoD-5uWVOm4EpLvmSaaEtuDOEX7g0muxNVlVK-8r3Mx3xLBJZ6EkT8TzXl0FuVMpDYwvvuU51zo9gs_hZmE-A5HLy0KeemnvCyMtMUNhOte9pHqmMe23wGgslyvGWW_mMu2TNuGxnPKEZT6oZT2Qbzlf3_KpZO_7a-7QxfOJ2cJl0o679RSeEaMNFY-h1859HO_637iew3SWcVKe1ncLmcnFvPsOWeljOy0UHWtf9YTzq2JTUMV1j_3unWu0vDSr3Gw
linkProvider	Springer Nature
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1db9MwFL0aA4m9MD5FYcB9gCewWGLHSZAQ6saqVSulohXam5XYjlRpy7amUO1f8Ef4j1wnTgNI7G0PPMdxrOT43uP4-hyAlzyLbZAXIbOJTBjx_4LlUtDCtSBuEsU6a7wBv47i8Tg5Pk4nG_CzPQvjyirbmFgHanOm3T_yt2Eaul8mQogP5xfMuUa53dXWQqOBxZG9XNGSrXo__Ejf91UYDg5m-4fMuwowzSVfMiOMoyWWMi-X1tBIaTxam0hHUW5SnqciTwJpU14UZjcurM54Yt2RcW4yU3Dq9gbcFC7415WC007jN649kZ2qH-NEJfwZHX9ST0rBKEFS3CMOxOSfebAjt3_tx9ZpbrD9n72gu3DH82nsNxPgHmzY8j5st14V6EPXA_ixLjbExj0P9-ZZhcMSv1hCq8VJNl_gpKlWO3XN-s6GCaeUplbZwuJvwo04bQRBq3dIswyXK6dwYSx-9iZj9fVL7JcGB3Ni13jgpbbpWetygYcwu47X8gg2y7PSPgakIFskEbU0PBBW7uaCiEpmosDwVOc86EHQQkNpr9TuDENOVKcx7eCkCE6qhpOSPXi9vue80Sm5svVOiyHlY1alOgD14E2Lwu7yv3t7cnVvL-D24ezTSI2G46OnsBUSK2yK-HZgc7n4Zp_BLf19Oa8Wz-vphKCuGZ2_AK-BXHk
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Nb9QwEB2VghAXylfF0gJzgBNYbWLHSZAQWmhXrFotEa1QxcVKbEdaqU3LZumq_4K_03_XceJsAIneeuAcx7GS55nnePwewCuexzYoypDZRCaM-H_JCilo4VoSN4linbfegN_248kkOTpKsxW47M7CuLLKLiY2gdqcavePfCtMQ_fLRAixVfqyiGxn9OHsB3MOUm6ntbPTaCGyZy8WtHyr34936Fu_DsPR7uGnz8w7DDDNJZ8zI4yjKJayMJfW0KhpbFqbSEdRYVJepKJIAmlTXpZmOy6tznli3fFxbnJTcur2FtyOaYnpJlcWfe_1fuPGH9kp_DFOtMKf1_Gn9qQUjJIlxUDiQ0z-mRN7ovvX3myT8kZr__HLegD3Pc_GYTsxHsKKrR7BWudhgT6kPYZfyyJEbF318OM0r3Fc4VdLKLaY5dMZZm0V24lrNnT2THhA6WuRzyz-JuiIB61QaP0OafbhfOGUL4zFL958rLl-gcPK4GhKrBt3vQQ3PWtZRvAEDm_itazDanVa2aeAFHzLJKKWhgfCyu1CEIHJTRQYnuqCBwMIOpgo7RXcnZHIseq1px20FEFLNdBScgBvlvectfol17be7PCkfCyrVQ-mAbztENlf_ndvz67v7SXcJVCq_fFkbwPuhUQW29q-TVidz37a53BHn8-n9exFM7MQ1A2D8wr4NWVb
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Exploring+Gender+Bias+In+Remote+Pair+Programming+Among+Software+Engineering+Students%3A+The+twincode+Original+Study+And+First+External+Replication&rft.jtitle=Empirical+software+engineering+%3A+an+international+journal&rft.au=Dur%C3%A1n%C2%A0Toro%2C+Amador&rft.au=Fern%C3%A1ndez%2C+Pablo&rft.au=Bern%C3%A1rdez%2C+Beatriz&rft.au=Weinman%2C+Nathaniel&rft.date=2024-03-01&rft.pub=Springer+US&rft.issn=1382-3256&rft.eissn=1573-7616&rft.volume=29&rft.issue=2&rft_id=info:doi/10.1007%2Fs10664-023-10416-6&rft.externalDocID=10_1007_s10664_023_10416_6
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1382-3256&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1382-3256&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1382-3256&client=summon