Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment
Gespeichert in:
| Titel: | Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment |
|---|---|
| Autoren: | Frattini, Julian, 1995, Fucci, Davide, Torkar, Richard, 1971, Montgomery, Lloyd, Unterkalmsteiner, Michael, Fischbach, Jannik, Mendez, Daniel |
| Quelle: | Empirical Software Engineering. 30(1) |
| Schlagwörter: | Replication, Requirements quality, Experiment, Requirements engineering, Bayesian data analysis |
| Beschreibung: | It is commonly accepted that the quality of requirements specifications impacts subsequent software engineering activities. However, we still lack empirical evidence to support organizations in deciding whether their requirements are good enough or impede subsequent activities. We aim to contribute empirical evidence to the effect that requirements quality defects have on a software engineering activity that depends on this requirement. We conduct a controlled experiment in which 25 participants from industry and university generate domain models from four natural language requirements containing different quality defects. We evaluate the resulting models using both frequentist and Bayesian data analysis. Contrary to our expectations, our results show that the use of passive voice only has a minor impact on the resulting domain models. The use of ambiguous pronouns, however, shows a strong effect on various properties of the resulting domain models. Most notably, ambiguous pronouns lead to incorrect associations in domain models. Despite being equally advised against by literature and frequentist methods, the Bayesian data analysis shows that the two investigated quality defects have vastly different impacts on software engineering activities and, hence, deserve different levels of attention. Our employed method can be further utilized by researchers to improve reliable, detailed empirical evidence on requirements quality. |
| Dateibeschreibung: | electronic |
| Zugangs-URL: | https://research.chalmers.se/publication/544022 https://research.chalmers.se/publication/544018 https://research.chalmers.se/publication/544022/file/544022_Fulltext.pdf |
| Datenbank: | SwePub |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://research.chalmers.se/publication/544022# Name: EDS - SwePub (s4221598) Category: fullText Text: View record in SwePub – Url: https://resolver.ebscohost.com/openurl?sid=EBSCO:edsswe&genre=article&issn=15737616&ISBN=&volume=30&issue=1&date=20250101&spage=&pages=&title=Empirical Software Engineering&atitle=Applying%20bayesian%20data%20analysis%20for%20causal%20inference%20about%20requirements%20quality%3A%20a%20controlled%20experiment&aulast=Frattini%2C%20Julian&id=DOI:10.1007/s10664-024-10582-1 Name: Full Text Finder Category: fullText Text: Full Text Finder Icon: https://imageserver.ebscohost.com/branding/images/FTF.gif MouseOverText: Full Text Finder – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Frattini%20J Name: ISI Category: fullText Text: Nájsť tento článok vo Web of Science Icon: https://imagesrvr.epnet.com/ls/20docs.gif MouseOverText: Nájsť tento článok vo Web of Science |
|---|---|
| Header | DbId: edsswe DbLabel: SwePub An: edsswe.oai.research.chalmers.se.9ded799e.422a.4322.95c4.6b2bb1ac81aa RelevancyScore: 1065 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 1064.736328125 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Frattini%2C+Julian%22">Frattini, Julian</searchLink>, 1995<br /><searchLink fieldCode="AR" term="%22Fucci%2C+Davide%22">Fucci, Davide</searchLink><br /><searchLink fieldCode="AR" term="%22Torkar%2C+Richard%22">Torkar, Richard</searchLink>, 1971<br /><searchLink fieldCode="AR" term="%22Montgomery%2C+Lloyd%22">Montgomery, Lloyd</searchLink><br /><searchLink fieldCode="AR" term="%22Unterkalmsteiner%2C+Michael%22">Unterkalmsteiner, Michael</searchLink><br /><searchLink fieldCode="AR" term="%22Fischbach%2C+Jannik%22">Fischbach, Jannik</searchLink><br /><searchLink fieldCode="AR" term="%22Mendez%2C+Daniel%22">Mendez, Daniel</searchLink> – Name: TitleSource Label: Source Group: Src Data: <i>Empirical Software Engineering</i>. 30(1) – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Replication%22">Replication</searchLink><br /><searchLink fieldCode="DE" term="%22Requirements+quality%22">Requirements quality</searchLink><br /><searchLink fieldCode="DE" term="%22Experiment%22">Experiment</searchLink><br /><searchLink fieldCode="DE" term="%22Requirements+engineering%22">Requirements engineering</searchLink><br /><searchLink fieldCode="DE" term="%22Bayesian+data+analysis%22">Bayesian data analysis</searchLink> – Name: Abstract Label: Description Group: Ab Data: It is commonly accepted that the quality of requirements specifications impacts subsequent software engineering activities. However, we still lack empirical evidence to support organizations in deciding whether their requirements are good enough or impede subsequent activities. We aim to contribute empirical evidence to the effect that requirements quality defects have on a software engineering activity that depends on this requirement. We conduct a controlled experiment in which 25 participants from industry and university generate domain models from four natural language requirements containing different quality defects. We evaluate the resulting models using both frequentist and Bayesian data analysis. Contrary to our expectations, our results show that the use of passive voice only has a minor impact on the resulting domain models. The use of ambiguous pronouns, however, shows a strong effect on various properties of the resulting domain models. Most notably, ambiguous pronouns lead to incorrect associations in domain models. Despite being equally advised against by literature and frequentist methods, the Bayesian data analysis shows that the two investigated quality defects have vastly different impacts on software engineering activities and, hence, deserve different levels of attention. Our employed method can be further utilized by researchers to improve reliable, detailed empirical evidence on requirements quality. – Name: Format Label: File Description Group: SrcInfo Data: electronic – Name: URL Label: Access URL Group: URL Data: <link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/544022" linkWindow="_blank">https://research.chalmers.se/publication/544022</link><br /><link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/544018" linkWindow="_blank">https://research.chalmers.se/publication/544018</link><br /><link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/544022/file/544022_Fulltext.pdf" linkWindow="_blank">https://research.chalmers.se/publication/544022/file/544022_Fulltext.pdf</link> |
| PLink | https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsswe&AN=edsswe.oai.research.chalmers.se.9ded799e.422a.4322.95c4.6b2bb1ac81aa |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s10664-024-10582-1 Languages: – Text: English Subjects: – SubjectFull: Replication Type: general – SubjectFull: Requirements quality Type: general – SubjectFull: Experiment Type: general – SubjectFull: Requirements engineering Type: general – SubjectFull: Bayesian data analysis Type: general Titles: – TitleFull: Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Frattini, Julian – PersonEntity: Name: NameFull: Fucci, Davide – PersonEntity: Name: NameFull: Torkar, Richard – PersonEntity: Name: NameFull: Montgomery, Lloyd – PersonEntity: Name: NameFull: Unterkalmsteiner, Michael – PersonEntity: Name: NameFull: Fischbach, Jannik – PersonEntity: Name: NameFull: Mendez, Daniel IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 15737616 – Type: issn-print Value: 13823256 – Type: issn-locals Value: SWEPUB_FREE – Type: issn-locals Value: CTH_SWEPUB Numbering: – Type: volume Value: 30 – Type: issue Value: 1 Titles: – TitleFull: Empirical Software Engineering Type: main |
| ResultId | 1 |
Full Text Finder
Nájsť tento článok vo Web of Science