On the Relevance of Paper-Type Information in Systematic Mapping Studies in Software Engineering
Systematic Mapping Studies (SMSs) are valuable in evidence-based software engineering research. SMSs aim to provide an overview of research, identify gaps and trends, and assess the feasibility of conducting a more focused systematic literature review. In current guidelines for conducting SMSs, a qu...
Uloženo v:
| Vydáno v: | 2025 IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering (WSESE) s. 44 - 47 |
|---|---|
| Hlavní autoři: | , |
| Médium: | Konferenční příspěvek |
| Jazyk: | angličtina |
| Vydáno: |
IEEE
03.05.2025
|
| Témata: | |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Systematic Mapping Studies (SMSs) are valuable in evidence-based software engineering research. SMSs aim to provide an overview of research, identify gaps and trends, and assess the feasibility of conducting a more focused systematic literature review. In current guidelines for conducting SMSs, a quality assessment of the included papers is suggested only when the research questions explicitly require such a quality assessment. We agree with the recommendation that quality assessment is generally non-mandatory. However, SMSs deal with papers ranging from opinion papers to papers reporting highly rigorous empirical studies. Therefore, in this paper, we argue that analyzing the type of papers is essential for almost every intended purpose of an SMS. Otherwise, without distinguishing papers based on their types, we risk deriving a less informative or incomplete overview or, at worst, a misleading overview of research. Petersen et al. 'encourage' the classification of papers into six paper types as proposed by Wieringa et al.: evaluation research, solution proposal, validation research, philosophical papers, opinion papers, and personal experience papers. Given the lenient guidelines on assessing the quality of included studies, we recommend a stronger focus on classifying papers by type. |
|---|---|
| AbstractList | Systematic Mapping Studies (SMSs) are valuable in evidence-based software engineering research. SMSs aim to provide an overview of research, identify gaps and trends, and assess the feasibility of conducting a more focused systematic literature review. In current guidelines for conducting SMSs, a quality assessment of the included papers is suggested only when the research questions explicitly require such a quality assessment. We agree with the recommendation that quality assessment is generally non-mandatory. However, SMSs deal with papers ranging from opinion papers to papers reporting highly rigorous empirical studies. Therefore, in this paper, we argue that analyzing the type of papers is essential for almost every intended purpose of an SMS. Otherwise, without distinguishing papers based on their types, we risk deriving a less informative or incomplete overview or, at worst, a misleading overview of research. Petersen et al. 'encourage' the classification of papers into six paper types as proposed by Wieringa et al.: evaluation research, solution proposal, validation research, philosophical papers, opinion papers, and personal experience papers. Given the lenient guidelines on assessing the quality of included studies, we recommend a stronger focus on classifying papers by type. |
| Author | Bin Ali, Nauman Borstler, Jurgen |
| Author_xml | – sequence: 1 givenname: Nauman surname: Bin Ali fullname: Bin Ali, Nauman email: nauman.ali@bth.se organization: Blekinge Institute of Technology,Sweden – sequence: 2 givenname: Jurgen surname: Borstler fullname: Borstler, Jurgen email: jurgen.borstler@bth.se organization: Blekinge Institute of Technology,Sweden |
| BookMark | eNotkN1Kw0AUhFfQC619A4V9gdSzf9nmUkrUQqViKl7WY_ZsXWg3YROVvH3jz8XMMHwwF3PBTmMTibFrATMhoLh5rcqqzPMc5EyCNDMAEPqETQtbzJUSBqQ0-Tl7W0fefxB_pj19YayJN54_YUsp2wwt8WX0TTpgH5rIQ-TV0PX0U2v-iG0b4o5X_acL1P3SxvffmIiXcRciURr5JTvzuO9o-p8T9nJXbhYP2Wp9v1zcrjKURdFn6JW1VoEpBNUKtVFOGO30ey2g1uRGQwcmH4XoSUitJM4tqFqiBefVhF397QYi2rYpHDAN2_EKK7TK1REnwFM0 |
| CODEN | IEEPAD |
| ContentType | Conference Proceeding |
| DBID | 6IE 6IL CBEJK RIE RIL |
| DOI | 10.1109/WSESE66602.2025.00014 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP All) 1998-Present |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| EISBN | 9798331502256 |
| EndPage | 47 |
| ExternalDocumentID | 11071436 |
| Genre | orig-research |
| GroupedDBID | 6IE 6IL CBEJK RIE RIL |
| ID | FETCH-LOGICAL-a299t-af377730591ec3a453d154d4bc10c4ed0c4ad056d05aafe12432a8703c2a70df3 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 0 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001544608900008&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Wed Jul 16 07:53:49 EDT 2025 |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-a299t-af377730591ec3a453d154d4bc10c4ed0c4ad056d05aafe12432a8703c2a70df3 |
| PageCount | 4 |
| ParticipantIDs | ieee_primary_11071436 |
| PublicationCentury | 2000 |
| PublicationDate | 2025-May-3 |
| PublicationDateYYYYMMDD | 2025-05-03 |
| PublicationDate_xml | – month: 05 year: 2025 text: 2025-May-3 day: 03 |
| PublicationDecade | 2020 |
| PublicationTitle | 2025 IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering (WSESE) |
| PublicationTitleAbbrev | WSESE |
| PublicationYear | 2025 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| Score | 1.9071809 |
| Snippet | Systematic Mapping Studies (SMSs) are valuable in evidence-based software engineering research. SMSs aim to provide an overview of research, identify gaps and... |
| SourceID | ieee |
| SourceType | Publisher |
| StartPage | 44 |
| SubjectTerms | Distance measurement Guidelines Knowledge transfer mapping study Proposals Quality assessment scoping review scoping study Secondary study Shape Software engineering Systematic literature review systematic map Systematics |
| Title | On the Relevance of Paper-Type Information in Systematic Mapping Studies in Software Engineering |
| URI | https://ieeexplore.ieee.org/document/11071436 |
| WOSCitedRecordID | wos001544608900008&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09T8MwELVoxcAEiCK-5YE1NImTOJlRKwYoFZ_dysU-oy5pFVL4-9y5oXRhYEgUOUOkO9nvnXPvWYjLvIhDC84EEDsqULIcghyjJOBWRmIUiUOv8H651aNRPpkU41as7rUwiOibz_CKH_2_fDs3S94q63OtQviedURH62wl1mpVOVFY9F9pBRoQHfcCq5j3SkIW52ycmuJBY7j7z8_tid6v_E6O18CyL7awOhBv95UksiYfWBDOqZJzJ8ewwDrgWlK2uiKOs5xV8nHt0CzvgD0Y3mXbMujf0uL7BTXKDTvCnngeDp6ub4L2eASKa1E0ATilNU3QtIjQKEhSZYkP2aQ0UWgStHQDS_yGLgCHBOQqBpqeysSgQ-vUoehW8wqPhMSSrc1AKZM4QquwdJHGjKiZcTpClR6LHodnulg5YEx_InPyx_ip2OEM-MZAdSa6Tb3Ec7FtPpvZR33h8_YN45abHA |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09T8MwED1BQYIJEEV844E11ImdJplRqyLaUkGBbsW1z6hLUoUW_j5nN5QuDAyJImeIdCf7vXPuPQNcp1nEjbI6UJGlAqWZqiDFUAaulZEYhbToFd4v3aTfT0ejbFCJ1b0WBhF98xneuEf_L98UeuG2yhquViF8b27CVixlxJdyrUqXE_Ks8UprUIsIuZdYRW63hDt5ztq5KR422nv__OA-1H8FeGywgpYD2MD8EN4eckZ0jT06SbhLFissG6gZloGrJlmlLHKRZtOcPa08mllPOReGd1Y1Dfq3tPx-qRLZmiFhHZ7breFtJ6gOSKDIZtk8UFYkCU3ROAtRCyVjYYgRGTnRIdcSDd2UIYZDl1IWCcpFpGiCCh2phBsrjqCWFzkeA8OJMzdTQmhpCa_4xIYJNomcaZuEKOITqLvwjGdLD4zxT2RO_xi_gp3OsNcdd-_692ew67Lh2wTFOdTm5QIvYFt_zqcf5aXP4Tci855j |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2025+IEEE%2FACM+International+Workshop+on+Methodological+Issues+with+Empirical+Studies+in+Software+Engineering+%28WSESE%29&rft.atitle=On+the+Relevance+of+Paper-Type+Information+in+Systematic+Mapping+Studies+in+Software+Engineering&rft.au=Bin+Ali%2C+Nauman&rft.au=Borstler%2C+Jurgen&rft.date=2025-05-03&rft.pub=IEEE&rft.spage=44&rft.epage=47&rft_id=info:doi/10.1109%2FWSESE66602.2025.00014&rft.externalDocID=11071436 |