A Conceptual Framework for Explainability Requirements in Software-Intensive Systems

Software-intensive systems include enterprise systems, IoT systems, cyber-physical systems, and industrial control systems where software plays a vital role. In such systems, the software is increasingly responsible for autonomous decision-making. However, trust can be hindered by the black-box natu...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE International Requirements Engineering Conference Workshops (Online) S. 309 - 315
Hauptverfasser: Bersani, Marcello M., Camilli, Matteo, Lestingi, Livia, Mirandola, Raffaela, Rossi, Matteo, Scandurra, Patrizia
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.09.2023
Schlagworte:
Decision making
Explainability
explainability requirements
explainable software systems
Human-machine systems
Industrial control
Measurement
Production
Service robots
Shape
ISSN:2770-6834
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract Software-intensive systems include enterprise systems, IoT systems, cyber-physical systems, and industrial control systems where software plays a vital role. In such systems, the software is increasingly responsible for autonomous decision-making. However, trust can be hindered by the black-box nature of these systems, whose autonomous decisions may be confusing or even dangerous for humans. Thus, explainability emerges as a crucial non-functional property to achieve transparency and increase the understanding of the systems' behavior, fostering their acceptance in our society. This paper introduces a conceptual framework for eliciting explainability requirements at different granularity levels. Each level is associated with a set of meta-requirements and means for instantiating the framework within a system to make it capable of producing explanations in a given application domain. We illustrate our conceptual framework using a running example from the robotics domain.
AbstractList Software-intensive systems include enterprise systems, IoT systems, cyber-physical systems, and industrial control systems where software plays a vital role. In such systems, the software is increasingly responsible for autonomous decision-making. However, trust can be hindered by the black-box nature of these systems, whose autonomous decisions may be confusing or even dangerous for humans. Thus, explainability emerges as a crucial non-functional property to achieve transparency and increase the understanding of the systems' behavior, fostering their acceptance in our society. This paper introduces a conceptual framework for eliciting explainability requirements at different granularity levels. Each level is associated with a set of meta-requirements and means for instantiating the framework within a system to make it capable of producing explanations in a given application domain. We illustrate our conceptual framework using a running example from the robotics domain.
Author Bersani, Marcello M.
Lestingi, Livia
Mirandola, Raffaela
Camilli, Matteo
Scandurra, Patrizia
Rossi, Matteo
Author_xml – sequence: 1
  givenname: Marcello M.
  surname: Bersani
  fullname: Bersani, Marcello M.
  email: marcellom.bersani@polimi.it
  organization: Politecnico di Milano,Department of Electronics, Information and Bioengineering (DEIB),Italy
– sequence: 2
  givenname: Matteo
  surname: Camilli
  fullname: Camilli, Matteo
  email: matteo.camilli@polimi.it
  organization: Politecnico di Milano,Department of Electronics, Information and Bioengineering (DEIB),Italy
– sequence: 3
  givenname: Livia
  surname: Lestingi
  fullname: Lestingi, Livia
  email: livia.lestingi@polimi.it
  organization: Politecnico di Milano,Department of Electronics, Information and Bioengineering (DEIB),Italy
– sequence: 4
  givenname: Raffaela
  surname: Mirandola
  fullname: Mirandola, Raffaela
  email: raffaela.mirandola@polimi.it
  organization: Politecnico di Milano,Department of Electronics, Information and Bioengineering (DEIB),Italy
– sequence: 5
  givenname: Matteo
  surname: Rossi
  fullname: Rossi, Matteo
  email: matteo.rossi@polimi.it
  organization: Politecnico di Milano,Department of Mechanical Engineering (DMec),Italy
– sequence: 6
  givenname: Patrizia
  surname: Scandurra
  fullname: Scandurra, Patrizia
  email: patrizia.scandurra@unibg.it
  organization: University of Bergamo,Department of Management, Information, and Production Engineering (DIGIP),Italy
BookMark eNotzNFKwzAUgOEoCs65J9CLvEDnOUmaJpdjbDoYCNvEy5G2pxBt09lkzr29gl79Nx__LbsKfSDG7hGmiGAfN4u3vDBgpwKEnAJAbi_YxBbWyByk0BbNJRuJooBMG6lu2CTG918mBShUdsR2Mz7vQ0WHdHQtXw6uo1M_fPCmH_ji-9A6H1zpW5_OfEOfRz9QRyFF7gPf9k06uYGyVUgUov8ivj3HRF28Y9eNayNN_jtmr8vFbv6crV-eVvPZOvNC2ZRprKyzAnNXYlGj0gWVQEClwqoqywaVrKmStkbKda2VkNoYZ10tjEUnajlmD39fT0T7w-A7N5z3CEKDASN_AOXEVMo
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/REW57809.2023.00059
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9798350326918
EISSN 2770-6834
EndPage 315
ExternalDocumentID 10260808
Genre orig-research
GroupedDBID 6IE
6IF
6IL
6IN
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
OCL
RIE
RIL
ID FETCH-LOGICAL-i249t-61c9a9215ab17d1467eb0e0eb41ccbbf143dec39d1e56d6423688a9ad2891a2d3
IEDL.DBID RIE
ISICitedReferencesCount 6
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001085223300054&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:50:45 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i249t-61c9a9215ab17d1467eb0e0eb41ccbbf143dec39d1e56d6423688a9ad2891a2d3
OpenAccessLink https://hdl.handle.net/11311/1251661
PageCount 7
ParticipantIDs ieee_primary_10260808
PublicationCentury 2000
PublicationDate 2023-Sept.
PublicationDateYYYYMMDD 2023-09-01
PublicationDate_xml – month: 09
  year: 2023
  text: 2023-Sept.
PublicationDecade 2020
PublicationTitle IEEE International Requirements Engineering Conference Workshops (Online)
PublicationTitleAbbrev REW
PublicationYear 2023
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0003204149
Score 1.8866006
Snippet Software-intensive systems include enterprise systems, IoT systems, cyber-physical systems, and industrial control systems where software plays a vital role....
SourceID ieee
SourceType Publisher
StartPage 309
SubjectTerms Decision making
Explainability
explainability requirements
explainable software systems
Human-machine systems
Industrial control
Measurement
Production
Service robots
Shape
Title A Conceptual Framework for Explainability Requirements in Software-Intensive Systems
URI https://ieeexplore.ieee.org/document/10260808
WOSCitedRecordID wos001085223300054&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09T8MwELWgYmACRBHf8sAasJOQxCOqWjGgqioFulVn-yJVQinqBxX_njsnLSwMbFEUxdI58b07v_csxI0u0SiAMsIk9lEKGUS2ZNPPFMoEHSX0oIV5fcr7_WI8NoNGrB60MIgYyGd4y5dhL9_P3IpbZfSHE_ouWNq7m-dZLdbaNlSSWKUE9xtnIa3M3bD7Rt-jYjlKzD6mwZD01xkqIYX0Dv45-KFo_4jx5GCbZo7EDlbHYvQgO7XgcAXvsrdhWEmCoJJpdUETxbTXLzlEJvuGLuBCTiv5TAvvGuYYbdnrsrEtb4uXXnfUeYyaAxKiKVVNSyr7nAFDSRuszj2veWgVKrSpds7akrCQR5cYr_E-81RpJFlRgAFPVZaG2CcnolXNKjwV0uucsJqit9FzqfUAhWevO0tD2DxLz0SbQzL5qD0wJptonP9x_0Lsc9RrNtalaC3nK7wSe-5zOV3Mr8PMfQMnTJu9
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NS8NAEF2kCnpSseK3e_Aa3U1iPo5SWirWUmrV3srs7gQKkko_FP-9M9u0evHgLYSQhd3NzpvJe2-EuNIF5gqgCDAKXRBDAoEp2PQzhiJCSwHda2FeOmm3mw2Hea8Sq3stDCJ68hle86X_l-8mdsGlMvrCCX1nLO3d5NZZlVxrXVKJQhUT4K-8hbTKb_rNV9qRigUpITuZekvSX11UfBBp7f5z-D1R_5Hjyd460OyLDSwPxOBONpaSwwW8ydaKYyUJhEom1nlVFBNfv2Qfme7r64AzOS7lEx29nzDFYM1fl5VxeV08t5qDRjuoWiQEY8qb5pT42RxyCttgdOr41EOjUKGJtbXGFISGHNoodxpvE0e5RpRkGeTgKM_SELroUNTKSYlHQjqdElpT9DZ6LjYOIHPsdmdoCJMm8bGo85SM3pcuGKPVbJz8cf9SbLcHj51R5777cCp2eAWW3KwzUZtPF3gutuzHfDybXvhV_AZ0R58G
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=IEEE+International+Requirements+Engineering+Conference+Workshops+%28Online%29&rft.atitle=A+Conceptual+Framework+for+Explainability+Requirements+in+Software-Intensive+Systems&rft.au=Bersani%2C+Marcello+M.&rft.au=Camilli%2C+Matteo&rft.au=Lestingi%2C+Livia&rft.au=Mirandola%2C+Raffaela&rft.date=2023-09-01&rft.pub=IEEE&rft.eissn=2770-6834&rft.spage=309&rft.epage=315&rft_id=info:doi/10.1109%2FREW57809.2023.00059&rft.externalDocID=10260808