Under the Bridge: Trolling and the Challenges of Recruiting Software Developers for Empirical Research Studies

Much of software engineering research focuses on tools, algorithms, and optimization of software. Recently, we, as a community, have come to acknowledge that there is a gap in meta-research and addressing the human-factors in software engineering research. Through meta research, we aim to deepen our...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Technologies Results (Online) S. 55 - 59
Hauptverfasser: Kokinda, Ella, Moster, Makayla, Dominic, James, Rodeghero, Paige
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.05.2023
Schlagworte:
meta-research
research methods
software development
software engineering research
ISSN:2832-7632
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract Much of software engineering research focuses on tools, algorithms, and optimization of software. Recently, we, as a community, have come to acknowledge that there is a gap in meta-research and addressing the human-factors in software engineering research. Through meta research, we aim to deepen our understanding of online participant recruitment and human-subjects software engineering research. In this paper we motivate the need to consider the unique challenges that human studies pose in software engineering research. We present several challenges faced by our research team in several distinct research studies, how they affected research, and motivate how, as researchers, we can address these challenges. We present results from a pilot study and categorize issues faced into three broad categories including participant recruitment, community engagement, and data poisoning. We further discuss how we can address these challenges and outline the benefits a full-study could provide to the software engineering research community.
AbstractList Much of software engineering research focuses on tools, algorithms, and optimization of software. Recently, we, as a community, have come to acknowledge that there is a gap in meta-research and addressing the human-factors in software engineering research. Through meta research, we aim to deepen our understanding of online participant recruitment and human-subjects software engineering research. In this paper we motivate the need to consider the unique challenges that human studies pose in software engineering research. We present several challenges faced by our research team in several distinct research studies, how they affected research, and motivate how, as researchers, we can address these challenges. We present results from a pilot study and categorize issues faced into three broad categories including participant recruitment, community engagement, and data poisoning. We further discuss how we can address these challenges and outline the benefits a full-study could provide to the software engineering research community.
Author Moster, Makayla
Dominic, James
Kokinda, Ella
Rodeghero, Paige
Author_xml – sequence: 1
  givenname: Ella
  surname: Kokinda
  fullname: Kokinda, Ella
  email: ekokind@clemson.edu
  organization: Clemson University,School of Computing,Clemson,United States
– sequence: 2
  givenname: Makayla
  surname: Moster
  fullname: Moster, Makayla
  email: mmoster@clemson.edu
  organization: Clemson University,School of Computing,Clemson,United States
– sequence: 3
  givenname: James
  surname: Dominic
  fullname: Dominic, James
  email: domini44@clemson.edu
  organization: Clemson University,School of Computing,Clemson,United States
– sequence: 4
  givenname: Paige
  surname: Rodeghero
  fullname: Rodeghero, Paige
  email: prodegh@clemson.edu
  organization: Clemson University,School of Computing,Clemson,United States
BookMark eNotkMtOwzAURA0CiVL6ByzMB6Rc-yZ2wg5CgEoVSH2sKye-aY1Sp3JSEH9PeKxmMefMYi7ZmW89MXYjYCoEZLezfFlEr7NikaQq1VMJEqcAINQJm2Q6SzEBBMAMTtlIpigjrVBesEnXvQ8YSiG0SEfMr72lwPsd8Yfg7Jbu-Cq0TeP8lhtvf4t8Z5qG_JY63tZ8QVU4uv4HWLZ1_2kC8Uf6oKY9UOh43QZe7A8uuMo0A9yRCdWOL_ujddRdsfPaNB1N_nPM1k_FKn-J5m_Ps_x-HhmZqT7ShEobqxG0AjRlZRNBEiqsYyljVWuwsiorjSLVgDFikpRZbVMYxNiWAsfs-m_XEdHmENzehK-NAKGHRxC_ATMzXeU
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/ICSE-NIER58687.2023.00016
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE/IET Electronic Library (IEL) (UW System Shared)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9798350300390
EISSN 2832-7632
EndPage 59
ExternalDocumentID 10173903
Genre orig-research
GroupedDBID 6IE
6IL
6IN
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
OCL
RIE
RIL
ID FETCH-LOGICAL-a296t-7e367ad7307603abcd51e20c3f42246f70d2cbc731870343355b9fd807e34db13
IEDL.DBID RIE
ISICitedReferencesCount 5
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001032816400010&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:22:08 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a296t-7e367ad7307603abcd51e20c3f42246f70d2cbc731870343355b9fd807e34db13
PageCount 5
ParticipantIDs ieee_primary_10173903
PublicationCentury 2000
PublicationDate 2023-May
PublicationDateYYYYMMDD 2023-05-01
PublicationDate_xml – month: 05
  year: 2023
  text: 2023-May
PublicationDecade 2020
PublicationTitle IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Technologies Results (Online)
PublicationTitleAbbrev ICSE-NIER
PublicationYear 2023
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0003211718
ssib052587720
Score 2.266763
Snippet Much of software engineering research focuses on tools, algorithms, and optimization of software. Recently, we, as a community, have come to acknowledge that...
SourceID ieee
SourceType Publisher
StartPage 55
SubjectTerms meta-research
research methods
software development
software engineering research
Title Under the Bridge: Trolling and the Challenges of Recruiting Software Developers for Empirical Research Studies
URI https://ieeexplore.ieee.org/document/10173903
WOSCitedRecordID wos001032816400010&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PS8MwGA06RDypOPE3EbxmS5OlaTw6OhzIGG7KbqP5UdjBbnSb_vt-SduJBw_eSksgJPm-vKTvew-hB-41q7QSJILgIT0VM6LjTBAqDFWQDQ0LLhHvL3I0SmYzNa6L1UMtjHMukM9cxz-Gf_l2abb-qqzrlw-c0fk-2pdSVsVazeIRTCSAFOnugoXD0QYS7yG6r3U1u8P-JCWjYfoqkjiRHW8c3gmY55ezSthYBsf_7NIJav-U6OHxbvM5RXuuOENFcDHCgOnwUyjEesTTslLdxllhw4d-456yxssce9S4XXjqM55AQv7KSodrHhHgQgyIFqcfq0XQEcENSw_X5MM2ehuk0_4zqQ0VSMZUvCHS8VhmFoJaxpRn2lgROUYNz3teVy6X1DKjjYQ4h0TQ44BFtMptQqFhz-qIn6NWsSzcBcJMK2VtRHUCm7xxcaJcZGNoYYRlTttL1PaDNV9VmhnzZpyu_nh_jY78fFRUwhvU2pRbd4sOzOdmsS7vwkx_A2WMp5A
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PS8MwGA06RT2pOPG3EbxmpmnTNh4dGxvOMtyU3Ubzo7CD3eg2_ff9krYTDx68lZZASPJ9eUnf9x5C977VrJKCEw-ChwQiZESGKSeUKyogGyrmXCLeB1GSxJOJGFbF6q4WxhjjyGemZR_dv3w9V2t7VfZglw-c0f1ttMODgHlluVa9fDjjMWBFurli8eFwA6l3D91VypoP_faoQ5J-55XHYRy1rHV4y6GeX94qbmvpHv6zU0eo-VOkh4eb7ecYbZn8BOXOxwgDqsNPrhTrEY-LUncbp7l2H9q1f8oSzzNsceN6ZsnPeAQp-SstDK6YRIAMMWBa3PlYzJySCK55eriiHzbRW7czbvdIZalAUibCFYmMH0aphrCOQuqnUmnuGUaVnwVWWS6LqGZKqggiHVJB4AMakSLTMYWGgZaef4oa-Tw3ZwgzKYTWHpUxbPPKhLEwng6hheKaGanPUdMO1nRRqmZM63G6-OP9LdrvjV8G00E_eb5EB3ZuSmLhFWqsirW5RrvqczVbFjdu1r8BS-eq1w
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=IEEE%2FACM+International+Conference+on+Software+Engineering%3A+New+Ideas+and+Emerging+Technologies+Results+%28Online%29&rft.atitle=Under+the+Bridge%3A+Trolling+and+the+Challenges+of+Recruiting+Software+Developers+for+Empirical+Research+Studies&rft.au=Kokinda%2C+Ella&rft.au=Moster%2C+Makayla&rft.au=Dominic%2C+James&rft.au=Rodeghero%2C+Paige&rft.date=2023-05-01&rft.pub=IEEE&rft.eissn=2832-7632&rft.spage=55&rft.epage=59&rft_id=info:doi/10.1109%2FICSE-NIER58687.2023.00016&rft.externalDocID=10173903