View in EDS

Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment

Saved in:
Bibliographic Details
Title: Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment
Authors: Frattini, Julian, 1995, Fucci, Davide, Torkar, Richard, 1971, Montgomery, Lloyd, Unterkalmsteiner, Michael, Fischbach, Jannik, Mendez, Daniel
Source: Empirical Software Engineering. 30(1)
Subject Terms: Replication, Requirements quality, Experiment, Requirements engineering, Bayesian data analysis
Description: It is commonly accepted that the quality of requirements specifications impacts subsequent software engineering activities. However, we still lack empirical evidence to support organizations in deciding whether their requirements are good enough or impede subsequent activities. We aim to contribute empirical evidence to the effect that requirements quality defects have on a software engineering activity that depends on this requirement. We conduct a controlled experiment in which 25 participants from industry and university generate domain models from four natural language requirements containing different quality defects. We evaluate the resulting models using both frequentist and Bayesian data analysis. Contrary to our expectations, our results show that the use of passive voice only has a minor impact on the resulting domain models. The use of ambiguous pronouns, however, shows a strong effect on various properties of the resulting domain models. Most notably, ambiguous pronouns lead to incorrect associations in domain models. Despite being equally advised against by literature and frequentist methods, the Bayesian data analysis shows that the two investigated quality defects have vastly different impacts on software engineering activities and, hence, deserve different levels of attention. Our employed method can be further utilized by researchers to improve reliable, detailed empirical evidence on requirements quality.
File Description: electronic
Access URL: https://research.chalmers.se/publication/544022
https://research.chalmers.se/publication/544018
https://research.chalmers.se/publication/544022/file/544022_Fulltext.pdf
Database: SwePub
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://research.chalmers.se/publication/544022#
    Name: EDS - SwePub (s4221598)
    Category: fullText
    Text: View record in SwePub
  – Url: https://resolver.ebscohost.com/openurl?sid=EBSCO:edsswe&genre=article&issn=15737616&ISBN=&volume=30&issue=1&date=20250101&spage=&pages=&title=Empirical Software Engineering&atitle=Applying%20bayesian%20data%20analysis%20for%20causal%20inference%20about%20requirements%20quality%3A%20a%20controlled%20experiment&aulast=Frattini%2C%20Julian&id=DOI:10.1007/s10664-024-10582-1
    Name: Full Text Finder
    Category: fullText
    Text: Full Text Finder
    Icon: https://imageserver.ebscohost.com/branding/images/FTF.gif
    MouseOverText: Full Text Finder
  – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Frattini%20J
    Name: ISI
    Category: fullText
    Text: Nájsť tento článok vo Web of Science
    Icon: https://imagesrvr.epnet.com/ls/20docs.gif
    MouseOverText: Nájsť tento článok vo Web of Science
Header DbId: edsswe
DbLabel: SwePub
An: edsswe.oai.research.chalmers.se.9ded799e.422a.4322.95c4.6b2bb1ac81aa
RelevancyScore: 1065
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 1064.736328125
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Frattini%2C+Julian%22">Frattini, Julian</searchLink>, 1995<br /><searchLink fieldCode="AR" term="%22Fucci%2C+Davide%22">Fucci, Davide</searchLink><br /><searchLink fieldCode="AR" term="%22Torkar%2C+Richard%22">Torkar, Richard</searchLink>, 1971<br /><searchLink fieldCode="AR" term="%22Montgomery%2C+Lloyd%22">Montgomery, Lloyd</searchLink><br /><searchLink fieldCode="AR" term="%22Unterkalmsteiner%2C+Michael%22">Unterkalmsteiner, Michael</searchLink><br /><searchLink fieldCode="AR" term="%22Fischbach%2C+Jannik%22">Fischbach, Jannik</searchLink><br /><searchLink fieldCode="AR" term="%22Mendez%2C+Daniel%22">Mendez, Daniel</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <i>Empirical Software Engineering</i>. 30(1)
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Replication%22">Replication</searchLink><br /><searchLink fieldCode="DE" term="%22Requirements+quality%22">Requirements quality</searchLink><br /><searchLink fieldCode="DE" term="%22Experiment%22">Experiment</searchLink><br /><searchLink fieldCode="DE" term="%22Requirements+engineering%22">Requirements engineering</searchLink><br /><searchLink fieldCode="DE" term="%22Bayesian+data+analysis%22">Bayesian data analysis</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: It is commonly accepted that the quality of requirements specifications impacts subsequent software engineering activities. However, we still lack empirical evidence to support organizations in deciding whether their requirements are good enough or impede subsequent activities. We aim to contribute empirical evidence to the effect that requirements quality defects have on a software engineering activity that depends on this requirement. We conduct a controlled experiment in which 25 participants from industry and university generate domain models from four natural language requirements containing different quality defects. We evaluate the resulting models using both frequentist and Bayesian data analysis. Contrary to our expectations, our results show that the use of passive voice only has a minor impact on the resulting domain models. The use of ambiguous pronouns, however, shows a strong effect on various properties of the resulting domain models. Most notably, ambiguous pronouns lead to incorrect associations in domain models. Despite being equally advised against by literature and frequentist methods, the Bayesian data analysis shows that the two investigated quality defects have vastly different impacts on software engineering activities and, hence, deserve different levels of attention. Our employed method can be further utilized by researchers to improve reliable, detailed empirical evidence on requirements quality.
– Name: Format
  Label: File Description
  Group: SrcInfo
  Data: electronic
– Name: URL
  Label: Access URL
  Group: URL
  Data: <link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/544022" linkWindow="_blank">https://research.chalmers.se/publication/544022</link><br /><link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/544018" linkWindow="_blank">https://research.chalmers.se/publication/544018</link><br /><link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/544022/file/544022_Fulltext.pdf" linkWindow="_blank">https://research.chalmers.se/publication/544022/file/544022_Fulltext.pdf</link>
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsswe&AN=edsswe.oai.research.chalmers.se.9ded799e.422a.4322.95c4.6b2bb1ac81aa
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s10664-024-10582-1
    Languages:
      – Text: English
    Subjects:
      – SubjectFull: Replication
        Type: general
      – SubjectFull: Requirements quality
        Type: general
      – SubjectFull: Experiment
        Type: general
      – SubjectFull: Requirements engineering
        Type: general
      – SubjectFull: Bayesian data analysis
        Type: general
    Titles:
      – TitleFull: Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Frattini, Julian
      – PersonEntity:
          Name:
            NameFull: Fucci, Davide
      – PersonEntity:
          Name:
            NameFull: Torkar, Richard
      – PersonEntity:
          Name:
            NameFull: Montgomery, Lloyd
      – PersonEntity:
          Name:
            NameFull: Unterkalmsteiner, Michael
      – PersonEntity:
          Name:
            NameFull: Fischbach, Jannik
      – PersonEntity:
          Name:
            NameFull: Mendez, Daniel
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 15737616
            – Type: issn-print
              Value: 13823256
            – Type: issn-locals
              Value: SWEPUB_FREE
            – Type: issn-locals
              Value: CTH_SWEPUB
          Numbering:
            – Type: volume
              Value: 30
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Empirical Software Engineering
              Type: main
ResultId 1