Requirements engineering for artificial intelligence systems: A systematic mapping study
In traditional software systems, Requirements Engineering (RE) activities are well-established and researched. However, building Artificial Intelligence (AI) based software with limited or no insight into the system’s inner workings poses significant new challenges to RE. Existing literature has foc...
Uložené v:
| Vydané v: | Information and software technology Ročník 158; s. 107176 |
|---|---|
| Hlavní autori: | , , , , |
| Médium: | Journal Article |
| Jazyk: | English |
| Vydavateľské údaje: |
Elsevier B.V
01.06.2023
|
| Predmet: | |
| ISSN: | 0950-5849, 1873-6025 |
| On-line prístup: | Získať plný text |
| Tagy: |
Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
|
| Abstract | In traditional software systems, Requirements Engineering (RE) activities are well-established and researched. However, building Artificial Intelligence (AI) based software with limited or no insight into the system’s inner workings poses significant new challenges to RE. Existing literature has focused on using AI to manage RE activities, with limited research on RE for AI (RE4AI).
This paper investigates current approaches for specifying requirements for AI systems, identifies available frameworks, methodologies, tools, and techniques used to model requirements, and finds existing challenges and limitations.
We performed a systematic mapping study to find papers on current RE4AI approaches. We identified 43 primary studies and analyzed the existing methodologies, models, tools, and techniques used to specify and model requirements in real-world scenarios.
We found several challenges and limitations of existing RE4AI practices. The findings highlighted that current RE applications were not adequately adaptable for building AI systems and emphasized the need to provide new techniques and tools to support RE4AI.
Our results showed that most of the empirical studies on RE4AI focused on autonomous, self-driving vehicles and managing data requirements, and areas such as ethics, trust, and explainability need further research.
•New requirements are emerging in engineering AI software such as data and ethics.•Requirements Specifications for AI systems presents new issues.•Existing RE tools need to be re-evaluated when building AI Software.•Trade-offs need to be calculated carefully when writing requirements for AI.•There is limited empirical evaluation on ethics, explainability and trust. |
|---|---|
| AbstractList | In traditional software systems, Requirements Engineering (RE) activities are well-established and researched. However, building Artificial Intelligence (AI) based software with limited or no insight into the system’s inner workings poses significant new challenges to RE. Existing literature has focused on using AI to manage RE activities, with limited research on RE for AI (RE4AI).
This paper investigates current approaches for specifying requirements for AI systems, identifies available frameworks, methodologies, tools, and techniques used to model requirements, and finds existing challenges and limitations.
We performed a systematic mapping study to find papers on current RE4AI approaches. We identified 43 primary studies and analyzed the existing methodologies, models, tools, and techniques used to specify and model requirements in real-world scenarios.
We found several challenges and limitations of existing RE4AI practices. The findings highlighted that current RE applications were not adequately adaptable for building AI systems and emphasized the need to provide new techniques and tools to support RE4AI.
Our results showed that most of the empirical studies on RE4AI focused on autonomous, self-driving vehicles and managing data requirements, and areas such as ethics, trust, and explainability need further research.
•New requirements are emerging in engineering AI software such as data and ethics.•Requirements Specifications for AI systems presents new issues.•Existing RE tools need to be re-evaluated when building AI Software.•Trade-offs need to be calculated carefully when writing requirements for AI.•There is limited empirical evaluation on ethics, explainability and trust. |
| ArticleNumber | 107176 |
| Author | Ahmad, Khlood Bano, Muneera Abdelrazek, Mohamed Arora, Chetan Grundy, John |
| Author_xml | – sequence: 1 givenname: Khlood orcidid: 0000-0002-7148-380X surname: Ahmad fullname: Ahmad, Khlood email: ahmadkhl@deakin.edu.au organization: Deakin University, Geelong, VIC, Australia – sequence: 2 givenname: Mohamed surname: Abdelrazek fullname: Abdelrazek, Mohamed email: mohamed.abdelrazek@deakin.edu.au organization: Deakin University, Geelong, VIC, Australia – sequence: 3 givenname: Chetan surname: Arora fullname: Arora, Chetan email: chetan.arora@monash.edu organization: Monash University, Clayton, VIC, Australia – sequence: 4 givenname: Muneera surname: Bano fullname: Bano, Muneera email: muneera.bano@csiro.au organization: CSIRO’s Data61, Clayton, VIC, Australia – sequence: 5 givenname: John surname: Grundy fullname: Grundy, John email: john.grundy@monash.edu organization: Monash University, Clayton, VIC, Australia |
| BookMark | eNqFkMtqwzAQRUVJoUnaP-jCP-B05JfsLAoh9AWBQmmhOyHJ4zDBkVNJKeTva-OsumhXcxk4l5kzYxPbWWTslsOCAy_udguyje-aRQJJ2q8EF8UFm_JSpHEBST5hU6hyiPMyq67YzPsdABeQwpR9vuHXkRzu0QYfod2SRXRkt1HTuUi5QA0ZUm1ENmDb0hatwciffMC9X0arc1SBTLRXh8NA-nCsT9fsslGtx5vznLOPx4f39XO8eX16Wa82sUmhCDFWosxTFAVmCTd5rXQFuoakKHSqNSaYCMg1cqhQgcFM6AqN0GUpsgYbDemcLcde4zrvHTbSUOjP6WxwilrJQQ6O5E6OjuTgSI6Oejj7BR8c7ZU7_Yfdjxj2j30TOukNDWLq3qQJsu7o74IfnFCH6Q |
| CitedBy_id | crossref_primary_10_1016_j_engstruct_2024_119110 crossref_primary_10_1007_s00766_023_00410_1 crossref_primary_10_1109_TSE_2023_3338857 crossref_primary_10_1155_je_1390935 crossref_primary_10_1007_s00766_024_00429_y crossref_primary_10_36680_j_itcon_2025_041 crossref_primary_10_3390_agriculture14071071 crossref_primary_10_3390_s24216814 crossref_primary_10_1016_j_infsof_2025_107718 crossref_primary_10_1109_ACCESS_2023_3294840 crossref_primary_10_1007_s11227_024_06688_4 crossref_primary_10_1080_08839514_2024_2322336 crossref_primary_10_1016_j_infsof_2025_107678 crossref_primary_10_1109_ACCESS_2024_3510056 crossref_primary_10_1016_j_jss_2024_112053 crossref_primary_10_1016_j_websem_2024_100855 crossref_primary_10_1002_spe_70005 crossref_primary_10_1007_s00146_024_01882_7 crossref_primary_10_1016_j_engappai_2025_111860 crossref_primary_10_1108_ECAM_12_2023_1273 crossref_primary_10_1016_j_asoc_2023_110421 crossref_primary_10_1016_j_infsof_2025_107864 crossref_primary_10_1155_je_2296387 crossref_primary_10_3390_app15137165 crossref_primary_10_1016_j_compeleceng_2025_110265 crossref_primary_10_1016_j_infsof_2024_107423 crossref_primary_10_1177_10692509251352461 crossref_primary_10_1109_MS_2023_3302934 crossref_primary_10_3390_a18030151 crossref_primary_10_5753_jserd_2025_4892 |
| Cites_doi | 10.1177/1525822X0101300402 10.1007/s00766-018-0302-5 10.1016/j.simpat.2018.11.005 10.1109/RE51729.2021.00008 10.1145/3085571 10.1109/SURV.2011.060710.00066 10.1007/s10664-020-09864-1 10.1016/j.procir.2017.12.230 10.1109/RE51729.2021.00009 10.1016/j.infsof.2019.03.004 10.1007/s00766-020-00343-z 10.1093/biomet/82.4.669 10.1016/j.datak.2018.04.006 10.1191/1478088706qp063oa 10.1016/j.infsof.2021.106514 10.1145/3378184.3378199 10.1016/j.infsof.2015.03.007 10.1136/svn-2017-000101 10.3390/en12091696 10.1016/j.procir.2021.01.081 10.1007/s00138-015-0726-6 10.1145/336512.336523 10.1145/3364223 10.1145/3290605.3300233 10.1145/2858036.2858529 10.1145/3412841.3442007 10.1097/00001648-199901000-00008 10.1177/2053951719860542 10.1145/2601248.2601268 10.1109/CVPR42600.2020.00271 10.1016/j.jss.2012.04.049 10.1016/j.artint.2018.07.007 10.1057/ejis.1994.12 10.1109/TIV.2019.2955903 10.4304/jsw.6.5.747-768 10.1145/3490099.3511141 10.1109/MS.2018.3571224 10.1126/science.aaa8415 10.1145/3382025.3414950 10.1145/3411764.3445735 10.1109/TSE.2015.2428709 10.1145/3399715.3400873 10.1016/j.ijhcs.2021.102684 10.1006/ijhc.2001.0503 10.1016/j.chb.2014.10.046 10.1007/s00766-016-0258-2 10.1109/REW.2019.00050 10.1145/3290605.3300831 10.1016/j.infsof.2020.106368 10.1007/s00766-017-0278-6 10.1145/3236009 10.1007/s10676-011-9278-2 |
| ContentType | Journal Article |
| Copyright | 2023 Elsevier B.V. |
| Copyright_xml | – notice: 2023 Elsevier B.V. |
| DBID | AAYXX CITATION |
| DOI | 10.1016/j.infsof.2023.107176 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Business |
| EISSN | 1873-6025 |
| ExternalDocumentID | 10_1016_j_infsof_2023_107176 S0950584923000307 |
| GroupedDBID | --K --M -~X .DC .~1 0R~ 1B1 1~. 1~5 29I 4.4 457 4G. 5GY 5VS 7-5 71M 77K 8P~ 9JN AABNK AACTN AAEDT AAEDW AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO AAYFN AAYOK ABBOA ABFNM ABFRF ABJNI ABMAC ABTAH ABXDB ABYKQ ACDAQ ACGFO ACGFS ACGOD ACNNM ACRLP ACZNC ADBBV ADEZE ADJOM ADMUD AEBSH AEFWE AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHZHX AIALX AIEXJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD ASPBG AVWKF AXJTR AZFZN BKOJK BKOMP BLXMC CS3 DU5 EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FYGXN G-Q G8K GBLVA GBOLZ HLZ HVGLF HZ~ IHE J1W KOM LG9 M41 MO0 MS~ N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PQQKQ Q38 R2- RIG ROL RPZ SBC SDF SDG SDP SES SEW SPC SPCBC SSV SSZ T5K TWZ UHS UNMZH WH7 WUQ XFK ZY4 ~G- 77I 9DU AATTM AAXKI AAYWO AAYXX ABDPE ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD |
| ID | FETCH-LOGICAL-c306t-e97853e76e421c5dab90bd0266b3bbe2e2705be109ea0ce47b9ec7b8874fefb03 |
| ISICitedReferencesCount | 55 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000950409600001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0950-5849 |
| IngestDate | Sat Nov 29 07:07:17 EST 2025 Tue Nov 18 21:55:37 EST 2025 Fri Feb 23 02:38:20 EST 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Requirements engineering Artificial intelligence Machine learning Systematic mapping study Software engineering |
| Language | English |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c306t-e97853e76e421c5dab90bd0266b3bbe2e2705be109ea0ce47b9ec7b8874fefb03 |
| ORCID | 0000-0002-7148-380X |
| ParticipantIDs | crossref_citationtrail_10_1016_j_infsof_2023_107176 crossref_primary_10_1016_j_infsof_2023_107176 elsevier_sciencedirect_doi_10_1016_j_infsof_2023_107176 |
| PublicationCentury | 2000 |
| PublicationDate | June 2023 2023-06-00 |
| PublicationDateYYYYMMDD | 2023-06-01 |
| PublicationDate_xml | – month: 06 year: 2023 text: June 2023 |
| PublicationDecade | 2020 |
| PublicationTitle | Information and software technology |
| PublicationYear | 2023 |
| Publisher | Elsevier B.V |
| Publisher_xml | – name: Elsevier B.V |
| References | Google Research (b128) 2019 Camilli, Felderer, Giusti, Matt, Perini, Russo, Susi (b46) 2021 H. Samin, L.H.G. Paucar, N. Bencomo, P. Sawyer, Towards priority-awareness in autonomous intelligent systems, in: Proceedings of the 36th Annual ACM Symposium on Applied Computing, 2021, pp. 1328–1337. Baresi, Pasquale, Spoletini (b115) 2010 Thinyane, Goldkind (b51) 2020 Tellis (b70) 1997; 3 M. Hall, D. Harborne, R. Tomsett, V. Galetic, S. Quintana-Amate, A. Nottle, A. Preece, A systematic method to understand requirements for explainable AI (XAI) systems, in: Proceedings of the IJCAI Workshop on EXplainable Artificial Intelligence (XAI 2019), Macau, China, Vol. 11, 2019. Miller, Pedell, Sterling, Vetere, Howard (b150) 2012; 85 J. DiMatteo, D.M. Berry, K. Czarnecki, Requirements for Monitoring Inattention of the Responsible Human in an Autonomous Vehicle: The Recall and Precision Tradeoff, in: REFSQ Workshops, 2020. Nakamichi, Ohashi, Namba, Yamamoto, Aoyama, Joeckel, Siebert, Heidrich (b87) 2020 Wang, Cheng, Hoang, Arora, Liu (b130) 2021 Berry (b134) 2022 Gruber, Huemer, Zimmermann, Maschotta (b75) 2017 Braun, Clarke (b111) 2006; 3 Arora, Sabetzadeh, Briand, Zimmer (b18) 2015; 41 F. Yu, H. Chen, X. Wang, W. Xian, Y. Chen, F. Liu, V. Madhavan, T. Darrell, Bdd100k: A diverse driving dataset for heterogeneous multitask learning, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 2636–2645. Holmquist (b1) 2017; 24 A. Vogelsang, M. Borg, Requirements Engineering for Machine Learning: Perspectives from Data Scientists, in: IEEE International Requirements Engineering Conference Workshops, 2019. Bano, Zowghi, Ikram (b57) 2014 Clauer, Fottner, Rauch, Prüglmeier (b108) 2021; 96 Lee, Kobsa (b7) 2019; 27 Bruno, Mastrogiovanni, Sgorbissa (b101) 2013 P. Khatamino, M.B. Camli, B. Öztekin, U. Gozumoglu, E. Tortumlu, H.M. Gezer, An NLP-based Chatbot to Facilitate RE Activities: An Experience Paper on Human Resources Application, in: REFSQ Workshops, 2021. Bartocci, Deshmukh, Donzé, Fainekos, Maler, Ničković, Sankaranarayanan (b116) 2018 Hu, Salay, Czarnecki, Rahimi, Selim, Chechik (b32) 2020 Bonfe, Boriero, Dodi, Fiorini, Morandi, Muradore, Pasquale, Sanna, Secchi (b74) 2012 Schroeder, Holzner, Berger, Hoel, Laine, Magnusson (b2) 2015 Pearl (b118) 1995; 82 Kitchenham, Charters (b22) 2007 . Rahimi, Guo, Kokaly, Chechik (b77) 2019 Kaindl, Ferdigg (b44) 2020 Guizzardi, Amaral, Guizzardi, Mylopoulos (b49) 2020 Felzmann, Villaronga, Lutz, Tamò-Larrieux (b53) 2019; 6 Amershi, Begel, Bird, DeLine, Gall, Kamar, Nagappan, Nushi, Zimmermann (b11) 2019 Sirius Eclipse, Modeling Tool. Shneiderman (b147) 2021; 37 Ishikawa, Matsuno (b104) 2020 Amershi, Cakmak, Knox, Kulesza (b143) 2014; 35 Islam, Khan, Islam, Rezwan-A-Rownok, Zaman, Zaman (b95) 2021 Horkoff (b100) 2019 Sculley, Holt, Golovin, Davydov, Phillips, Ebner, Chaudhary, Young, Crespo, Dennison (b8) 2015 Amaral, Guizzardi, Guizzardi, Mylopoulos (b106) 2020 Urquhart (b112) 2012 Hager, Bryant, Horvitz, Mataric, Honavar (b59) 2017 Stone, Brooks, Brynjolfsson, Calo, Etzioni, Hager, Hirschberg, Kalyanakrishnan, Kamar, Kraus (b60) 2016 Jiang, Jiang, Zhi, Dong, Li, Ma, Wang, Dong, Shen, Wang (b3) 2017; 2 Ertel (b17) 2018 Inayat, Salim, Marczak, Daneva, Shamshirband (b31) 2015; 51 Wohlin, Runeson, Höst, Ohlsson, Regnell, Wesslén (b67) 2012 Grundy (b146) 2021 J. Krause, A. Perer, K. Ng, Interacting with predictions: Visual inspection of black-box machine learning models, in: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016, pp. 5686–5697. Lwakatare, Raj, Crnkovic, Bosch, Olsson (b9) 2020; 127 Zamani, Zowghi, Arora (b21) 2021 Kuwajima, Yasuoka, Nakae (b37) 2020 Viyović, Maksimović, Perisić (b123) 2014 Koelsch (b30) 2016 Ambreen, Ikram, Usman, Niazi (b58) 2018; 23 A. Schmidt, Interactive human centered artificial intelligence: a definition and research challenges, in: Proceedings of the International Conference on Advanced Visual Interfaces, 2020, pp. 1–4. Aydemir, Dalpiaz (b64) 2018 Challa, Niu, Johnson (b88) 2020 Rivero, Portela, Boaro, Santos, Rego, Braz Junior, Paiva, Alves, Oliveira, Moraes (b99) 2021 Wang, Liu (b129) 2010; 13 Ntakolia, Dimas, Iakovidis (b93) 2020 Crnkovic, Çürüklü (b50) 2012; 14 M. Mekni, Z. Baani, D. Sulieman, A Smart Virtual Assistant for Students, in: Proceedings of the 3rd International Conference on Applications of Intelligent Systems, 2020, pp. 1–6. M.M. De Graaf, B.F. Malle, How people explain action (and autonomous intelligent systems should too), in: 2017 AAAI Fall Symposium Series, 2017. Petersen, Vakkalanka, Kuzniarz (b23) 2015; 64 Vassev, Hinchey (b124) 2013 Sandkuhl (b76) 2019 Lee, Madotto, Fung (b149) 2019 Weihrauch, Schindler, Sihn (b83) 2018; 67 Meyer (b71) 2001; 13 Bosch, Olsson, Crnkovic (b61) 2018 Fowler (b121) 2010 Dick, Hull, Jackson (b27) 2017 Jordan, Mitchell (b12) 2015; 349 Bosch, Olsson, Crnkovic (b38) 2021 Olmos-Sánchez, Rodas-Osollo (b90) 2020 Van Vliet, Van Vliet, Van Vliet (b10) 2008 Zhou, Jin, Zhang, Li, Huang (b127) 2016 Amyot, Mussbacher, Ghanavati, Kealey (b25) 2011; 766 Johnson (b148) 2022 D. Wang, Q. Yang, A. Abdul, B.Y. Lim, Designing theory-driven user-centric explainable AI, in: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, pp. 1–15. J. Cleland-Huang, A. Agrawal, M.N.A. Islam, E. Tsai, M. Van Speybroeck, M. Vierhauser, Requirements-driven configuration of emergency response missions with small aerial vehicles, in: Proceedings of the 24th ACM Conference on Systems and Software Product Line: Volume a-Volume a, 2020, pp. 1–12. Grundy, Mouzakis, Vasa, Cain, Curumsing, Abdelrazek, Fernando (b154) 2018; 246 Lwakatare, Raj, Bosch, Olsson, Crnkovic (b41) 2019 Chazette (b43) 2019 Abualhaija, Arora, Sabetzadeh, Briand, Traynor (b19) 2020; 25 Cirqueira, Nedbal, Helfert, Bezbradica (b92) 2020 Neace, Roncace, Fomin (b85) 2018; 23 K.M. Habibullah, J. Horkoff, Non-functional Requirements for Machine Learning: Understanding Current Use and Challenges in Industry, in: IEEE 29th International Requirements Engineering Conference, RE, 2021. Blumreiter, Greenyer, Garcia, Klös, Schwammberger, Sommer, Vogelsang, Wortmann (b120) 2019 Miller, Howe, Sonenberg (b140) 2017 Microsoft (b155) 2022 Glymour, Greenland (b117) 2008; 3 F. Houdek, S. Schmerler, Automotive Future and its Impact on Requirements Engineering, in: REFSQ Workshops, 2017. Bach, Langner, Otten, Holzäpfel, Sax (b113) 2017 Lapouchnian (b33) 2005 Duran, Mussbacher (b36) 2019; 110 Vassev, Hinchey (b122) 2014 Nalchigar, Yu (b114) 2018; 117 Maguire (b144) 2001; 55 Fagbola, Thakur (b54) 2019 Cysneiros, do Prado Leite (b135) 2020 S. Amershi, D. Weld, M. Vorvoreanu, A. Fourney, B. Nushi, P. Collisson, J. Suh, S. Iqbal, P.N. Bennett, K. Inkpen, et al., Guidelines for human-AI interaction, in: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, pp. 1–13. Easterbrook, Singer, Storey, Damian (b73) 2008 Tuncali, Fainekos, Prokhorov, Ito, Kapinski (b79) 2019; 5 Nalchigar, Yu, Keshavjee (b65) 2021; 26 Khomh, Adams, Cheng, Fokaefs, Antoniol (b15) 2018; 35 Villamizar, Escovedo, Kalinowski (b56) 2021 Heyn, Knauss, Muhammad, Eriksson, Linder, Subbiah, Pradhan, Tungal (b45) 2021 Gonçalves, de Oliveira, Monteiro, Castro, Araújo (b35) 2019; 24 Theosaksomo, Widyantoro (b6) 2019 Wheatcraft, Ryan (b28) 2018 Q.Z. Chen, T. Schnabel, B. Nushi, S. Amershi, HINT: Integration Testing for AI-based features with Humans in the Loop, in: 27th International Conference on Intelligent User Interfaces, 2022, pp. 549–565. C. Wohlin, Guidelines for snowballing in systematic literature studies and a replication in software engineering, in: Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, 2014, pp. 1–10. B. Nuseibeh, S. Easterbrook, Requirements engineering: a roadmap, in: Proceedings of the Conference on the Future of Software Engineering, 2000, pp. 35–46. Odong, Perini, Susi (b47) 2022 Cysneiros, Raffi, do Prado Leite (b39) 2018 Belani, Vukovic, Car (b16) 2019 J. Lockerbie, N.A. Maiden, Using a Requirements Modelling Language to Co-Design Intelligent Support for People Living with Dementia, in: REFSQ Workshops, 2020. K. Ahmad, M. Bano, M. Abdelrazek, C. Arora, J. Grundy, What’s up with Requirements Engineering for Artificial Intelligence Systems?, in: IEEE 29th International Requirements Engineering Conference, RE, 2021. Glasow (b68) 2005 Schoonderwoerd, Jorritsma, Neerincx, van den Bosch (b94) 2021 Burnett, Peters, Hill, Elarief (b151) 2016 Greenland, Pearl, Robins (b119) 1999 Amyot, Mussbacher (b34) 2011; 6 Agrawal, Cleland-Huang, Steghöfer (b107) 2020 Arpteg, Brinne, Crnkovic-Friis, Bosch (b13) 2018 Ezzini, Abualhaija, Arora, Sabetzadeh, Briand (b20) 2021 Fenn, Mendes, Budden (b84) 2016; 27 Martínez-Fernández, Bogner, Franch, Oriol, Siebert, Trendowicz, Vollmer, Wagner (b55) 2021 Miller (b139) 2019; 267 Wohlin (b72) 2021; 133 J.S. Becker, Partial Consistency for Requirement Engineering with Traffic Sequence Charts, in: Software Engineering (Workshops), 2020. Altarturi, Ng, Ninggal, Nazri, Abd Ghani (b102) 2017 Vorvoreanu, Zhang, Huang, Hilderbrand, Steine-Hanson, Burnett (b152) 2019 Nguyen, Phung, Ly, Truong (b52) 2021 Köhl, Baum, Langer, Oster, Speith, Bohlender (b63) 2019 McIntosh, Du, Wu, Truong, Ly, How, Viswanathan, Kanij (b153) 2021 Shin, Rho, Lee, Rhee (b81) 2019; 12 Dimitrakopoulos, Kavakli, Loucopoulos, Anagnostopoulos, Zographos (b82) 2019; 91 Brugali (b48) 2019 Guidotti, Monreale, Ruggieri, Turini, Giannotti, Pedreschi (b141) 2018; 51 Ries, Guelfi, Jahic (b89) 2021 Kuwajima, Ishikawa (b105) 2019 B. Kostova, S. Gurses, A. Wegmann, On the Interplay between Requirements, Engineering, and Artificial Intelligence, in: REFSQ Workshops, 2020. Jakob, Kugele, Tick (b78) 2017 on Artificial Intelligence (b136) 2019 Ang, Leong, Lee, Yusof (b103) 2011 Agarwal, Goel (b14) 2014 Gable (b69) 1994; 3 M.K. Hong, A. Fourney, D. DeBellis, S. Amershi, Planning for natural language failures with the AI playbook, in: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, pp. 10.1016/j.infsof.2023.107176_b66 10.1016/j.infsof.2023.107176_b125 10.1016/j.infsof.2023.107176_b62 Glasow (10.1016/j.infsof.2023.107176_b68) 2005 Zhou (10.1016/j.infsof.2023.107176_b127) 2016 Amershi (10.1016/j.infsof.2023.107176_b143) 2014; 35 Johnson (10.1016/j.infsof.2023.107176_b148) 2022 Olmos-Sánchez (10.1016/j.infsof.2023.107176_b90) 2020 Dick (10.1016/j.infsof.2023.107176_b27) 2017 Neace (10.1016/j.infsof.2023.107176_b85) 2018; 23 Microsoft (10.1016/j.infsof.2023.107176_b155) 2022 Bach (10.1016/j.infsof.2023.107176_b113) 2017 Köhl (10.1016/j.infsof.2023.107176_b63) 2019 Camilli (10.1016/j.infsof.2023.107176_b46) 2021 Bruno (10.1016/j.infsof.2023.107176_b101) 2013 Nalchigar (10.1016/j.infsof.2023.107176_b114) 2018; 117 Altarturi (10.1016/j.infsof.2023.107176_b102) 2017 Martínez-Fernández (10.1016/j.infsof.2023.107176_b55) 2021 Shneiderman (10.1016/j.infsof.2023.107176_b147) 2021; 37 Greenland (10.1016/j.infsof.2023.107176_b119) 1999 10.1016/j.infsof.2023.107176_b126 Wheatcraft (10.1016/j.infsof.2023.107176_b28) 2018 Koelsch (10.1016/j.infsof.2023.107176_b30) 2016 Weihrauch (10.1016/j.infsof.2023.107176_b83) 2018; 67 10.1016/j.infsof.2023.107176_b132 10.1016/j.infsof.2023.107176_b131 Fenn (10.1016/j.infsof.2023.107176_b84) 2016; 27 Odong (10.1016/j.infsof.2023.107176_b47) 2022 Pearl (10.1016/j.infsof.2023.107176_b118) 1995; 82 10.1016/j.infsof.2023.107176_b133 Brugali (10.1016/j.infsof.2023.107176_b48) 2019 Google Research (10.1016/j.infsof.2023.107176_b128) 2019 Hager (10.1016/j.infsof.2023.107176_b59) 2017 Sculley (10.1016/j.infsof.2023.107176_b8) 2015 Nguyen (10.1016/j.infsof.2023.107176_b52) 2021 10.1016/j.infsof.2023.107176_b80 10.1016/j.infsof.2023.107176_b138 10.1016/j.infsof.2023.107176_b137 Bartocci (10.1016/j.infsof.2023.107176_b116) 2018 Felzmann (10.1016/j.infsof.2023.107176_b53) 2019; 6 Amaral (10.1016/j.infsof.2023.107176_b106) 2020 Kuwajima (10.1016/j.infsof.2023.107176_b37) 2020 Berry (10.1016/j.infsof.2023.107176_b134) 2022 10.1016/j.infsof.2023.107176_b40 10.1016/j.infsof.2023.107176_b42 Horkoff (10.1016/j.infsof.2023.107176_b100) 2019 Grundy (10.1016/j.infsof.2023.107176_b146) 2021 Jiang (10.1016/j.infsof.2023.107176_b3) 2017; 2 Rahimi (10.1016/j.infsof.2023.107176_b77) 2019 Hu (10.1016/j.infsof.2023.107176_b32) 2020 Wang (10.1016/j.infsof.2023.107176_b130) 2021 Amyot (10.1016/j.infsof.2023.107176_b25) 2011; 766 Miller (10.1016/j.infsof.2023.107176_b139) 2019; 267 Lwakatare (10.1016/j.infsof.2023.107176_b9) 2020; 127 Abualhaija (10.1016/j.infsof.2023.107176_b19) 2020; 25 Viyović (10.1016/j.infsof.2023.107176_b123) 2014 Agarwal (10.1016/j.infsof.2023.107176_b14) 2014 Jordan (10.1016/j.infsof.2023.107176_b12) 2015; 349 Gonçalves (10.1016/j.infsof.2023.107176_b35) 2019; 24 10.1016/j.infsof.2023.107176_b109 Ambreen (10.1016/j.infsof.2023.107176_b58) 2018; 23 Cysneiros (10.1016/j.infsof.2023.107176_b135) 2020 Holmquist (10.1016/j.infsof.2023.107176_b1) 2017; 24 Nakamichi (10.1016/j.infsof.2023.107176_b87) 2020 Zamani (10.1016/j.infsof.2023.107176_b21) 2021 Thinyane (10.1016/j.infsof.2023.107176_b51) 2020 Ntakolia (10.1016/j.infsof.2023.107176_b93) 2020 10.1016/j.infsof.2023.107176_b5 Challa (10.1016/j.infsof.2023.107176_b88) 2020 Miller (10.1016/j.infsof.2023.107176_b140) 2017 Easterbrook (10.1016/j.infsof.2023.107176_b73) 2008 Kuwajima (10.1016/j.infsof.2023.107176_b105) 2019 Guizzardi (10.1016/j.infsof.2023.107176_b49) 2020 Villamizar (10.1016/j.infsof.2023.107176_b56) 2021 Fagbola (10.1016/j.infsof.2023.107176_b54) 2019 Blumreiter (10.1016/j.infsof.2023.107176_b120) 2019 Cirqueira (10.1016/j.infsof.2023.107176_b92) 2020 Vassev (10.1016/j.infsof.2023.107176_b124) 2013 McIntosh (10.1016/j.infsof.2023.107176_b153) 2021 Miller (10.1016/j.infsof.2023.107176_b150) 2012; 85 Tuncali (10.1016/j.infsof.2023.107176_b79) 2019; 5 10.1016/j.infsof.2023.107176_b24 Belani (10.1016/j.infsof.2023.107176_b16) 2019 Burnett (10.1016/j.infsof.2023.107176_b151) 2016 Theosaksomo (10.1016/j.infsof.2023.107176_b6) 2019 10.1016/j.infsof.2023.107176_b29 Ishikawa (10.1016/j.infsof.2023.107176_b104) 2020 Ezzini (10.1016/j.infsof.2023.107176_b20) 2021 10.1016/j.infsof.2023.107176_b26 Jakob (10.1016/j.infsof.2023.107176_b78) 2017 Baresi (10.1016/j.infsof.2023.107176_b115) 2010 Schroeder (10.1016/j.infsof.2023.107176_b2) 2015 Aydemir (10.1016/j.infsof.2023.107176_b64) 2018 Vorvoreanu (10.1016/j.infsof.2023.107176_b152) 2019 Van Vliet (10.1016/j.infsof.2023.107176_b10) 2008 Stone (10.1016/j.infsof.2023.107176_b60) 2016 Dimitrakopoulos (10.1016/j.infsof.2023.107176_b82) 2019; 91 Sandkuhl (10.1016/j.infsof.2023.107176_b76) 2019 Wohlin (10.1016/j.infsof.2023.107176_b72) 2021; 133 Gruber (10.1016/j.infsof.2023.107176_b75) 2017 Bonfe (10.1016/j.infsof.2023.107176_b74) 2012 Ertel (10.1016/j.infsof.2023.107176_b17) 2018 Apple Developer (10.1016/j.infsof.2023.107176_b156) 2020 Arpteg (10.1016/j.infsof.2023.107176_b13) 2018 Urquhart (10.1016/j.infsof.2023.107176_b112) 2012 Grundy (10.1016/j.infsof.2023.107176_b154) 2018; 246 Arora (10.1016/j.infsof.2023.107176_b18) 2015; 41 Shin (10.1016/j.infsof.2023.107176_b81) 2019; 12 Vassev (10.1016/j.infsof.2023.107176_b122) 2014 Maguire (10.1016/j.infsof.2023.107176_b144) 2001; 55 Khomh (10.1016/j.infsof.2023.107176_b15) 2018; 35 Kitchenham (10.1016/j.infsof.2023.107176_b22) 2007 Ries (10.1016/j.infsof.2023.107176_b89) 2021 on Artificial Intelligence (10.1016/j.infsof.2023.107176_b136) 2019 Clauer (10.1016/j.infsof.2023.107176_b108) 2021; 96 Duran (10.1016/j.infsof.2023.107176_b36) 2019; 110 Bosch (10.1016/j.infsof.2023.107176_b38) 2021 Wang (10.1016/j.infsof.2023.107176_b129) 2010; 13 Glymour (10.1016/j.infsof.2023.107176_b117) 2008; 3 10.1016/j.infsof.2023.107176_b142 Inayat (10.1016/j.infsof.2023.107176_b31) 2015; 51 Petersen (10.1016/j.infsof.2023.107176_b23) 2015; 64 10.1016/j.infsof.2023.107176_b145 10.1016/j.infsof.2023.107176_b86 Bosch (10.1016/j.infsof.2023.107176_b61) 2018 Agrawal (10.1016/j.infsof.2023.107176_b107) 2020 Lwakatare (10.1016/j.infsof.2023.107176_b41) 2019 Kaindl (10.1016/j.infsof.2023.107176_b44) 2020 Wohlin (10.1016/j.infsof.2023.107176_b67) 2012 Amyot (10.1016/j.infsof.2023.107176_b34) 2011; 6 Lee (10.1016/j.infsof.2023.107176_b149) 2019 Schwammberger (10.1016/j.infsof.2023.107176_b110) 2021 Lapouchnian (10.1016/j.infsof.2023.107176_b33) 2005 Schoonderwoerd (10.1016/j.infsof.2023.107176_b94) 2021 Heyn (10.1016/j.infsof.2023.107176_b45) 2021 Rivero (10.1016/j.infsof.2023.107176_b99) 2021 Guidotti (10.1016/j.infsof.2023.107176_b141) 2018; 51 10.1016/j.infsof.2023.107176_b91 Ang (10.1016/j.infsof.2023.107176_b103) 2011 Crnkovic (10.1016/j.infsof.2023.107176_b50) 2012; 14 Amershi (10.1016/j.infsof.2023.107176_b11) 2019 10.1016/j.infsof.2023.107176_b98 Gable (10.1016/j.infsof.2023.107176_b69) 1994; 3 10.1016/j.infsof.2023.107176_b96 Fowler (10.1016/j.infsof.2023.107176_b121) 2010 10.1016/j.infsof.2023.107176_b97 Meyer (10.1016/j.infsof.2023.107176_b71) 2001; 13 Nalchigar (10.1016/j.infsof.2023.107176_b65) 2021; 26 Chazette (10.1016/j.infsof.2023.107176_b43) 2019 Bano (10.1016/j.infsof.2023.107176_b57) 2014 Lee (10.1016/j.infsof.2023.107176_b7) 2019; 27 Islam (10.1016/j.infsof.2023.107176_b95) 2021 Braun (10.1016/j.infsof.2023.107176_b111) 2006; 3 Cysneiros (10.1016/j.infsof.2023.107176_b39) 2018 Tellis (10.1016/j.infsof.2023.107176_b70) 1997; 3 Li (10.1016/j.infsof.2023.107176_b4) 2017 |
| References_xml | – start-page: 241 year: 2019 end-page: 244 ident: b77 article-title: Toward requirements specification for machine-learned components publication-title: 2019 IEEE 27th International Requirements Engineering Conference Workshops – reference: J.S. Becker, Partial Consistency for Requirement Engineering with Traffic Sequence Charts, in: Software Engineering (Workshops), 2020. – volume: 26 start-page: 237 year: 2021 end-page: 254 ident: b65 article-title: Modeling machine learning requirements from three perspectives: a case report from the healthcare domain publication-title: Requir. Eng. – start-page: 382 year: 2018 end-page: 387 ident: b39 article-title: Software transparency as a key requirement for self-driving cars publication-title: 2018 IEEE 26th International Requirements Engineering Conference – volume: 133 year: 2021 ident: b72 article-title: Case study research in software engineering—It is a case, and it is a study, but is it a case study? publication-title: Inf. Softw. Technol. – start-page: 1 year: 2020 end-page: 10 ident: b107 article-title: Model-driven requirements for humans-on-the-loop multi-UAV missions publication-title: 2020 IEEE Tenth International Model-Driven Requirements Engineering – year: 2020 ident: b156 article-title: Human interface guidelines – volume: 6 start-page: 747 year: 2011 end-page: 768 ident: b34 article-title: User requirements notation: the first ten years, the next ten years publication-title: JSW – start-page: 36 year: 2017 end-page: 42 ident: b140 article-title: Explainable AI: Beware of inmates running the asylum or: How I learnt to stop worrying and love the social and behavioural sciences publication-title: IJCAI 2017 Workshop on Explainable Artificial Intelligence – start-page: 1 year: 2013 end-page: 10 ident: b124 article-title: On the autonomy requirements for space missions publication-title: 16th IEEE International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing – start-page: 188 year: 2021 end-page: 194 ident: b52 article-title: Holistic explainability requirements for end-to-end machine learning in IoT cloud systems publication-title: 2021 IEEE 29th International Requirements Engineering Conference Workshops – start-page: 111 year: 2017 end-page: 117 ident: b102 article-title: A requirement engineering model for big data software publication-title: 2017 IEEE Conference on Big Data and Analytics – year: 2017 ident: b4 article-title: Artificial Intelligence with Uncertainty – start-page: 37 year: 1999 end-page: 48 ident: b119 article-title: Causal diagrams for epidemiologic research publication-title: Epidemiology – start-page: 13 year: 2019 end-page: 18 ident: b105 article-title: Adapting SQuaRE for quality assessment of artificial intelligence systems publication-title: 2019 IEEE International Symposium on Software Reliability Engineering Workshops – start-page: 716 year: 2018 end-page: 732 ident: b28 article-title: Communicating requirements–effectively! publication-title: INCOSE International Symposium, Vol. 28, No. 1 – start-page: 2586 year: 2016 end-page: 2598 ident: b151 article-title: Finding gender-inclusiveness software issues with GenderMag: a field investigation publication-title: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems – volume: 12 start-page: 1696 year: 2019 ident: b81 article-title: Data requirements for applying machine learning to energy disaggregation publication-title: Energies – start-page: 251 year: 2020 end-page: 256 ident: b49 article-title: Ethical requirements for AI systems publication-title: Canadian Conference on Artificial Intelligence – volume: 13 start-page: 329 year: 2001 end-page: 352 ident: b71 article-title: A case in case study methodology publication-title: Field Methods – reference: B. Nuseibeh, S. Easterbrook, Requirements engineering: a roadmap, in: Proceedings of the Conference on the Future of Software Engineering, 2000, pp. 35–46. – start-page: 768 year: 2013 end-page: 773 ident: b101 article-title: Functional requirements and design issues for a socially assistive robot for elderly people with mild cognitive impairments publication-title: 2013 IEEE RO-MAN – reference: B. Kostova, S. Gurses, A. Wegmann, On the Interplay between Requirements, Engineering, and Artificial Intelligence, in: REFSQ Workshops, 2020. – volume: 3 start-page: 77 year: 2006 end-page: 101 ident: b111 article-title: Using thematic analysis in psychology publication-title: Qual. Res. Psychol. – start-page: 33 year: 2020 end-page: 38 ident: b44 article-title: Towards an extended requirements problem formulation for superintelligence safety publication-title: 2020 IEEE Seventh International Workshop on Artificial Intelligence for Requirements Engineering – reference: P. Khatamino, M.B. Camli, B. Öztekin, U. Gozumoglu, E. Tortumlu, H.M. Gezer, An NLP-based Chatbot to Facilitate RE Activities: An Experience Paper on Human Resources Application, in: REFSQ Workshops, 2021. – year: 2016 ident: b30 article-title: Requirements Writing for System Engineering – volume: 3 start-page: 1 year: 1997 end-page: 19 ident: b70 article-title: Application of a case study methodology publication-title: Qual. Rep. – volume: 267 start-page: 1 year: 2019 end-page: 38 ident: b139 article-title: Explanation in artificial intelligence: Insights from the social sciences publication-title: Artificial Intelligence – volume: 25 start-page: 5454 year: 2020 end-page: 5497 ident: b19 article-title: Automated demarcation of requirements in textual specifications: a machine learning-based approach publication-title: Empir. Softw. Eng. – start-page: 470 year: 2019 end-page: 475 ident: b43 article-title: Mitigating challenges in the elicitation and analysis of transparency requirements publication-title: 2019 IEEE 27th International Requirements Engineering Conference – year: 2021 ident: b94 article-title: Human-centered XAI: Developing design patterns for explanations of clinical decision support systems publication-title: Int. J. Hum. Comput. Stud. – year: 2016 ident: b60 article-title: Artificial Intelligence and Life in 2030: the One Hundred Year Study on Artificial Intelligence – reference: M.K. Hong, A. Fourney, D. DeBellis, S. Amershi, Planning for natural language failures with the AI playbook, in: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, pp. 1–11. – volume: 6 year: 2019 ident: b53 article-title: Transparency you can trust: Transparency requirements for artificial intelligence between legal norms and contextual concerns publication-title: Big Data Soc. – reference: M.M. De Graaf, B.F. Malle, How people explain action (and autonomous intelligent systems should too), in: 2017 AAAI Fall Symposium Series, 2017. – start-page: 189 year: 2015 end-page: 198 ident: b2 article-title: Design and evaluation of a customizable multi-domain reference architecture on top of product lines of self-driving heavy vehicles-an industrial case study publication-title: 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering, Vol. 2 – start-page: 233 year: 2014 end-page: 238 ident: b123 article-title: Sirius: A rapid development of DSM graphical editor publication-title: IEEE 18th International Conference on Intelligent Engineering Systems INES 2014 – start-page: 157 year: 2019 end-page: 164 ident: b76 article-title: Putting AI into context-method support for the introduction of artificial intelligence into organizations publication-title: 2019 IEEE 21st Conference on Business Informatics, Vol. 1 – volume: 117 start-page: 359 year: 2018 end-page: 372 ident: b114 article-title: Business-driven data analytics: a conceptual modeling framework publication-title: Data Knowl. Eng. – year: 2005 ident: b68 article-title: Fundamentals of survey research methodology – volume: 51 start-page: 1 year: 2018 end-page: 42 ident: b141 article-title: A survey of methods for explaining black box models publication-title: ACM Comput. Surv. – start-page: 105 year: 2014 end-page: 172 ident: b122 article-title: Autonomy requirements engineering publication-title: Autonomy Requirements Engineering for Space Missions – start-page: 200 year: 2019 end-page: 204 ident: b54 article-title: Towards the development of artificial intelligence-based systems: Human-centered functional requirements and open problems publication-title: 2019 International Conference on Intelligent Informatics and Biomedical Sciences – year: 2019 ident: b128 article-title: The people + AI guidebook – reference: S. Amershi, D. Weld, M. Vorvoreanu, A. Fourney, B. Nushi, P. Collisson, J. Suh, S. Iqbal, P.N. Bennett, K. Inkpen, et al., Guidelines for human-AI interaction, in: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, pp. 1–13. – volume: 82 start-page: 669 year: 1995 end-page: 688 ident: b118 article-title: Causal diagrams for empirical research publication-title: Biometrika – year: 2019 ident: b152 article-title: From gender biases to gender-inclusive design: An empirical investigation publication-title: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems – start-page: 1485 year: 2021 end-page: 1497 ident: b20 article-title: Using domain-specific corpora for improved handling of ambiguity in requirements publication-title: 2021 IEEE/ACM 43rd International Conference on Software Engineering – start-page: 1 year: 2014 end-page: 4 ident: b14 article-title: Expert system and it’s requirement engineering process publication-title: International Conference on Recent Advances and Innovations in Engineering – reference: J. Krause, A. Perer, K. Ng, Interacting with predictions: Visual inspection of black-box machine learning models, in: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016, pp. 5686–5697. – start-page: 177 year: 2018 end-page: 192 ident: b61 article-title: It takes three to tango: Requirement, outcome/data, and AI driven development publication-title: SiBW – start-page: 2503 year: 2015 end-page: 2511 ident: b8 article-title: Hidden technical debt in machine learning systems publication-title: Advances in Neural Information Processing Systems – volume: 349 start-page: 255 year: 2015 end-page: 260 ident: b12 article-title: Machine learning: Trends, perspectives, and prospects publication-title: Science – year: 2018 ident: b17 article-title: Introduction to Artificial Intelligence – start-page: 1 year: 2021 end-page: 19 ident: b38 article-title: Engineering AI systems: A research agenda publication-title: Artificial Intelligence Paradigms for Smart Cyber-Physical Systems – start-page: 346 year: 2020 end-page: 351 ident: b104 article-title: Evidence-driven requirements engineering for uncertainty of machine learning-based systems publication-title: 2020 IEEE 28th International Requirements Engineering Conference – volume: 67 start-page: 386 year: 2018 end-page: 391 ident: b83 article-title: A conceptual model for developing a smart process control system publication-title: Procedia CIRP – start-page: 15 year: 2018 end-page: 21 ident: b64 article-title: A roadmap for ethics-aware software engineering publication-title: 2018 IEEE/ACM International Workshop on Software Fairness – reference: A. Vogelsang, M. Borg, Requirements Engineering for Machine Learning: Perspectives from Data Scientists, in: IEEE International Requirements Engineering Conference Workshops, 2019. – start-page: 61 year: 2020 end-page: 69 ident: b88 article-title: Faulty requirements made valuable: On the role of data quality in deep learning publication-title: 2020 IEEE Seventh International Workshop on Artificial Intelligence for Requirements Engineering – year: 2022 ident: b155 article-title: The HAX toolkit project – start-page: 11 year: 2020 end-page: 18 ident: b51 article-title: A multi-aspectual requirements analysis for artificial intelligence for well-being publication-title: 2020 IEEE First International Workshop on Requirements Engineering for Well-Being, Aging, and Health – reference: F. Yu, H. Chen, X. Wang, W. Xian, Y. Chen, F. Liu, V. Madhavan, T. Darrell, Bdd100k: A diverse driving dataset for heterogeneous multitask learning, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 2636–2645. – volume: 85 start-page: 2160 year: 2012 end-page: 2170 ident: b150 article-title: Understanding socially oriented roles and goals through motivational modelling publication-title: J. Syst. Softw. – start-page: 33 year: 2021 end-page: 42 ident: b95 article-title: A mobile application for mental health care during COVID-19 pandemic: Development and usability evaluation with system usability scale publication-title: International Conference on Computational Intelligence in Information System – year: 2010 ident: b121 article-title: Domain-Specific Languages – volume: 27 start-page: 1 year: 2019 end-page: 39 ident: b7 article-title: Confident privacy decision-making in IoT environments publication-title: ACM Trans. Comput.-Hum. Interact. – volume: 35 start-page: 81 year: 2018 end-page: 84 ident: b15 article-title: Software engineering for machine-learning applications: The road ahead publication-title: IEEE Softw. – volume: 24 start-page: 28 year: 2017 end-page: 33 ident: b1 article-title: Intelligence on tap: artificial intelligence as a new design material publication-title: Interactions – start-page: 195 year: 2021 end-page: 199 ident: b110 article-title: A quest of self-explainability: When causal diagrams meet autonomous urban traffic manoeuvres publication-title: 2021 IEEE 29th International Requirements Engineering Conference Workshops – volume: 766 start-page: 160 year: 2011 end-page: 162 ident: b25 article-title: GRL modeling and analysis with jUCMNav publication-title: IStar – volume: 3 start-page: 183 year: 2008 end-page: 209 ident: b117 article-title: Causal diagrams publication-title: Mod. Epidemiol. – start-page: 27 year: 2017 end-page: 31 ident: b75 article-title: Integrated description of functional and non-functional requirements for automotive systems design using SysML publication-title: 2017 7th IEEE International Conference on System Engineering and Technology – start-page: 252 year: 2019 end-page: 255 ident: b16 article-title: Requirements engineering challenges in building AI-based complex systems publication-title: 2019 IEEE 27th International Requirements Engineering Conference Workshops – start-page: 56 year: 2012 end-page: 61 ident: b74 article-title: Towards automated surgical robotics: A requirements engineering approach publication-title: 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics – volume: 24 start-page: 55 year: 2019 end-page: 84 ident: b35 article-title: Understanding what is important in iStar extension proposals: the viewpoint of researchers publication-title: Requir. Eng. – start-page: 123 year: 2021 end-page: 130 ident: b46 article-title: Risk-driven compliance assurance for collaborative AI systems: A vision paper publication-title: International Working Conference on Requirements Engineering: Foundation for Software Quality – volume: 27 start-page: 77 year: 2016 end-page: 86 ident: b84 article-title: Addressing the non-functional requirements of computer vision systems: a case study publication-title: Mach. Vis. Appl. – start-page: 29 year: 2021 end-page: 36 ident: b56 article-title: Requirements engineering for machine learning: A systematic mapping study publication-title: 2021 47th Euromicro Conference on Software Engineering and Advanced Applications – year: 2012 ident: b67 article-title: Experimentation in Software Engineering – year: 2019 ident: b136 article-title: Ethics Guidelines for Trustworthy AI – reference: M. Hall, D. Harborne, R. Tomsett, V. Galetic, S. Quintana-Amate, A. Nottle, A. Preece, A systematic method to understand requirements for explainable AI (XAI) systems, in: Proceedings of the IJCAI Workshop on EXplainable Artificial Intelligence (XAI 2019), Macau, China, Vol. 11, 2019. – year: 2007 ident: b22 article-title: Guidelines for Performing Systematic Literature Reviews in Software Engineering – start-page: 743 year: 2019 end-page: 748 ident: b48 article-title: Non-functional requirements in robotic systems: Challenges and state of the art publication-title: 2019 IEEE International Conference on Real-Time Computing and Robotics – volume: 37 start-page: 56 year: 2021 end-page: 61 ident: b147 article-title: Human-centered AI publication-title: Issues Sci. Technol. – volume: 64 start-page: 1 year: 2015 end-page: 18 ident: b23 article-title: Guidelines for conducting systematic mapping studies in software engineering: An update publication-title: Inf. Softw. Technol. – start-page: 291 year: 2019 end-page: 300 ident: b11 article-title: Software engineering for machine learning: a case study publication-title: Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice – start-page: 227 year: 2019 end-page: 243 ident: b41 article-title: A taxonomy of software engineering challenges for machine learning systems: An empirical investigation publication-title: International Conference on Agile Software Development – start-page: 342 year: 2020 end-page: 352 ident: b106 article-title: Ontology-based modeling and analysis of trustworthiness requirements: Preliminary results publication-title: International Conference on Conceptual Modeling – year: 2022 ident: b148 article-title: Racial bias in a medical algorithm favors white patients over sicker black patients – start-page: 227 year: 2021 end-page: 243 ident: b99 article-title: Lessons learned from applying requirements and design techniques in the development of a machine learning system for predicting lawsuits against power companies publication-title: International Conference on Human-Computer Interaction – year: 2020 ident: b32 article-title: Towards requirements specification for machine-learned perception based on human performance publication-title: Workshop on Artificial Intelligence for Requirements Engineering – start-page: 50 year: 2018 end-page: 59 ident: b13 article-title: Software engineering challenges of deep learning publication-title: 2018 44th Euromicro Conference on Software Engineering and Advanced Applications – reference: K. Ahmad, M. Bano, M. Abdelrazek, C. Arora, J. Grundy, What’s up with Requirements Engineering for Artificial Intelligence Systems?, in: IEEE 29th International Requirements Engineering Conference, RE, 2021. – start-page: 128 year: 2017 end-page: 133 ident: b78 article-title: Defining camera-based traffic scenarios and use cases for the visually impaired by means of expert interviews publication-title: 2017 IEEE 14th International Scientific Conference on Informatics – reference: H. Samin, L.H.G. Paucar, N. Bencomo, P. Sawyer, Towards priority-awareness in autonomous intelligent systems, in: Proceedings of the 36th Annual ACM Symposium on Applied Computing, 2021, pp. 1328–1337. – start-page: 116 year: 2021 end-page: 125 ident: b21 article-title: Machine learning in requirements engineering: A mapping study publication-title: 2021 IEEE 29th International Requirements Engineering Conference Workshops – start-page: 285 year: 2008 end-page: 311 ident: b73 article-title: Selecting empirical methods for software engineering research publication-title: Guide to Advanced Empirical Software Engineering – reference: M. Mekni, Z. Baani, D. Sulieman, A Smart Virtual Assistant for Students, in: Proceedings of the 3rd International Conference on Applications of Intelligent Systems, 2020, pp. 1–6. – year: 2021 ident: b55 article-title: Software engineering for AI-based systems: A survey – reference: K.M. Habibullah, J. Horkoff, Non-functional Requirements for Machine Learning: Understanding Current Use and Challenges in Industry, in: IEEE 29th International Requirements Engineering Conference, RE, 2021. – start-page: 335 year: 2020 end-page: 342 ident: b135 article-title: Non-functional requirements orienting the development of socially responsible software publication-title: Enterprise, Business-Process and Information Systems Modeling – start-page: 9 year: 2014 end-page: 16 ident: b57 article-title: Systematic reviews in requirements engineering: A tertiary study publication-title: 2014 IEEE 4th International Workshop on Empirical Requirements Engineering – year: 2008 ident: b10 article-title: Software Engineering: Principles and Practice, Vol. 13 – volume: 5 start-page: 265 year: 2019 end-page: 280 ident: b79 article-title: Requirements-driven test generation for autonomous vehicles with machine learning components publication-title: IEEE Trans. Intell. Veh. – start-page: 153 year: 2016 end-page: 160 ident: b127 article-title: A map of threats to validity of systematic literature reviews in software engineering publication-title: 2016 23rd Asia-Pacific Software Engineering Conference – start-page: 9 year: 2021 end-page: 20 ident: b146 article-title: Impact of end user human aspects on software engineering publication-title: ENASE – year: 2005 ident: b33 article-title: Goal-Oriented Requirements Engineering: An Overview of the Current Research, Vol. 32 – start-page: 260 year: 2020 end-page: 270 ident: b87 article-title: Requirements-driven method to determine quality characteristics and measurements for machine learning software and its evaluation publication-title: 2020 IEEE 28th International Requirements Engineering Conference – reference: Q.Z. Chen, T. Schnabel, B. Nushi, S. Amershi, HINT: Integration Testing for AI-based features with Humans in the Loop, in: 27th International Conference on Intelligent User Interfaces, 2022, pp. 549–565. – start-page: 543 year: 2019 end-page: 548 ident: b120 article-title: Towards self-explainable cyber-physical systems publication-title: 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion – reference: J. Cleland-Huang, A. Agrawal, M.N.A. Islam, E. Tsai, M. Van Speybroeck, M. Vierhauser, Requirements-driven configuration of emergency response missions with small aerial vehicles, in: Proceedings of the 24th ACM Conference on Systems and Software Product Line: Volume a-Volume a, 2020, pp. 1–12. – volume: 41 start-page: 944 year: 2015 end-page: 968 ident: b18 article-title: Automated checking of conformance to requirements templates using natural language processing publication-title: IEEE Trans. Softw. Eng. – year: 2017 ident: b27 article-title: Requirements Engineering – start-page: 1 year: 2020 end-page: 10 ident: b90 article-title: Helping organizations manage the innovation process to join the Cognitive era publication-title: 2020 8th International Conference in Software Engineering Research and Innovation – volume: 55 start-page: 587 year: 2001 end-page: 634 ident: b144 article-title: Methods to support human-centred design publication-title: Int. J. Hum. Comput. Stud. – volume: 3 start-page: 112 year: 1994 end-page: 126 ident: b69 article-title: Integrating case study and survey research methods: an example in information systems publication-title: Eur. J. Inf. Syst. – start-page: 19 year: 2022 end-page: 25 ident: b134 article-title: Requirements engineering for artificial intelligence: What is a requirements specification for an artificial intelligence? publication-title: International Working Conference on Requirements Engineering: Foundation for Software Quality – volume: 35 start-page: 105 year: 2014 end-page: 120 ident: b143 article-title: Power to the people: The role of humans in interactive machine learning publication-title: AI Mag. – volume: 96 start-page: 242 year: 2021 end-page: 247 ident: b108 article-title: Usage of autonomous mobile robots outdoors-an axiomatic design approach publication-title: Procedia CIRP – volume: 23 start-page: 63 year: 2018 end-page: 95 ident: b58 article-title: Empirical research in requirements engineering: trends and opportunities publication-title: Requir. Eng. – start-page: 135 year: 2018 end-page: 175 ident: b116 article-title: Specification-based monitoring of cyber-physical systems: a survey on theory, tools and applications publication-title: Lectures on Runtime Verification – volume: 246 start-page: 75 year: 2018 end-page: 90 ident: b154 article-title: Supporting diverse challenges of ageing with digital enhanced living solutions publication-title: Stud. Health Technol. Inf. – start-page: 1 year: 2020 end-page: 26 ident: b93 article-title: User-centered system design for assisted navigation of visually impaired individuals in outdoor cultural environments publication-title: Universal Access in the Information Society – volume: 23 start-page: 509 year: 2018 end-page: 555 ident: b85 article-title: Goal model analysis of autonomy requirements for Unmanned Aircraft Systems publication-title: Requir. Eng. – volume: 110 start-page: 156 year: 2019 end-page: 173 ident: b36 article-title: Reusability in goal modeling: a systematic literature review publication-title: Inf. Softw. Technol. – start-page: 177 year: 2019 end-page: 180 ident: b149 article-title: Exploring social bias in chatbots using stereotype knowledge publication-title: WNLP@ ACL – start-page: 386 year: 2019 end-page: 391 ident: b100 article-title: Non-functional requirements for machine learning: Challenges and new directions publication-title: 2019 IEEE 27th International Requirements Engineering Conference – reference: J. DiMatteo, D.M. Berry, K. Czarnecki, Requirements for Monitoring Inattention of the Responsible Human in an Autonomous Vehicle: The Recall and Precision Tradeoff, in: REFSQ Workshops, 2020. – start-page: 125 year: 2010 end-page: 134 ident: b115 article-title: Fuzzy goals for requirements-driven adaptation publication-title: 2010 18th IEEE International Requirements Engineering Conference – start-page: 154 year: 2019 end-page: 159 ident: b6 article-title: Conversational recommender system chatbot based on functional requirement publication-title: 2019 IEEE 13th International Conference on Telecommunication Systems, Services, and Applications – reference: A. Schmidt, Interactive human centered artificial intelligence: a definition and research challenges, in: Proceedings of the International Conference on Advanced Visual Interfaces, 2020, pp. 1–4. – reference: F. Houdek, S. Schmerler, Automotive Future and its Impact on Requirements Engineering, in: REFSQ Workshops, 2017. – start-page: 41 year: 2021 end-page: 52 ident: b89 article-title: An MDE method for improving deep learning dataset requirements engineering using alloy and UML publication-title: Proceedings of the 9th International Conference on Model-Driven Engineering and Software Development – year: 2012 ident: b112 article-title: Grounded Theory for Qualitative Research: A Practical Guide – start-page: 1 year: 2017 end-page: 6 ident: b113 article-title: Data-driven development, a complementing approach for automotive systems engineering publication-title: 2017 IEEE International Systems Engineering Symposium – start-page: 31 year: 2021 end-page: 40 ident: b153 article-title: Evaluating age bias in E-commerce publication-title: 2021 IEEE/ACM 13th International Conference on Cooperative and Human Aspects of Software Engineering – start-page: 363 year: 2019 end-page: 368 ident: b63 article-title: Explainability as a non-functional requirement publication-title: 2019 IEEE 27th International Requirements Engineering Conference – volume: 2 start-page: 230 year: 2017 end-page: 243 ident: b3 article-title: Artificial intelligence in healthcare: past, present and future publication-title: Stroke Vasc. Neurol. – start-page: 409 year: 2022 end-page: 425 ident: b47 article-title: Requirements engineering for collaborative artificial intelligence systems: A literature survey publication-title: International Conference on Research Challenges in Information Science – volume: 14 start-page: 61 year: 2012 end-page: 71 ident: b50 article-title: Robots: ethical by design publication-title: Ethics Inform. Technol. – volume: 91 start-page: 28 year: 2019 end-page: 47 ident: b82 article-title: A capability-oriented modelling and simulation approach for autonomous vehicle management publication-title: Simul. Model. Pract. Theory – start-page: 1 year: 2020 end-page: 24 ident: b37 article-title: Engineering problems in machine learning systems publication-title: Mach. Learn. – year: 2017 ident: b59 article-title: Advances in artificial intelligence require progress across all of computer science – reference: . Sirius Eclipse, Modeling Tool. – reference: C. Wohlin, Guidelines for snowballing in systematic literature studies and a replication in software engineering, in: Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, 2014, pp. 1–10. – start-page: 640 year: 2011 end-page: 645 ident: b103 article-title: Requirement engineering techniques in developing expert systems publication-title: 2011 IEEE Symposium on Computers & Informatics – start-page: 321 year: 2020 end-page: 341 ident: b92 article-title: Scenario-based requirements elicitation for user-centric explainable AI publication-title: International Cross-Domain Conference for Machine Learning and Knowledge Extraction – volume: 51 start-page: 915 year: 2015 end-page: 929 ident: b31 article-title: A systematic literature review on agile requirements engineering practices and challenges publication-title: Comput. Hum. Behav. – volume: 13 start-page: 673 year: 2010 end-page: 687 ident: b129 article-title: Networked wireless sensor data collection: issues, challenges, and approaches publication-title: IEEE Commun. Surv. Tutor. – reference: J. Lockerbie, N.A. Maiden, Using a Requirements Modelling Language to Co-Design Intelligent Support for People Living with Dementia, in: REFSQ Workshops, 2020. – reference: . – reference: D. Wang, Q. Yang, A. Abdul, B.Y. Lim, Designing theory-driven user-centric explainable AI, in: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, pp. 1–15. – volume: 127 year: 2020 ident: b9 article-title: Large-scale machine learning systems in real-world industrial settings: A review of challenges and solutions publication-title: Inf. Softw. Technol. – start-page: 89 year: 2021 end-page: 96 ident: b45 article-title: Requirement engineering challenges for AI-intense systems development publication-title: 2021 IEEE/ACM 1st Workshop on AI Engineering-Software Engineering for AI – start-page: 159 year: 2021 end-page: 164 ident: b130 article-title: Virtual reality enabled human-centric requirements engineering publication-title: 2021 36th IEEE/ACM International Conference on Automated Software Engineering Workshops – start-page: 1485 year: 2021 ident: 10.1016/j.infsof.2023.107176_b20 article-title: Using domain-specific corpora for improved handling of ambiguity in requirements – volume: 13 start-page: 329 issue: 4 year: 2001 ident: 10.1016/j.infsof.2023.107176_b71 article-title: A case in case study methodology publication-title: Field Methods doi: 10.1177/1525822X0101300402 – start-page: 342 year: 2020 ident: 10.1016/j.infsof.2023.107176_b106 article-title: Ontology-based modeling and analysis of trustworthiness requirements: Preliminary results – volume: 24 start-page: 55 issue: 1 year: 2019 ident: 10.1016/j.infsof.2023.107176_b35 article-title: Understanding what is important in iStar extension proposals: the viewpoint of researchers publication-title: Requir. Eng. doi: 10.1007/s00766-018-0302-5 – start-page: 123 year: 2021 ident: 10.1016/j.infsof.2023.107176_b46 article-title: Risk-driven compliance assurance for collaborative AI systems: A vision paper – ident: 10.1016/j.infsof.2023.107176_b40 – start-page: 227 year: 2019 ident: 10.1016/j.infsof.2023.107176_b41 article-title: A taxonomy of software engineering challenges for machine learning systems: An empirical investigation – start-page: 321 year: 2020 ident: 10.1016/j.infsof.2023.107176_b92 article-title: Scenario-based requirements elicitation for user-centric explainable AI – year: 2018 ident: 10.1016/j.infsof.2023.107176_b17 – volume: 91 start-page: 28 year: 2019 ident: 10.1016/j.infsof.2023.107176_b82 article-title: A capability-oriented modelling and simulation approach for autonomous vehicle management publication-title: Simul. Model. Pract. Theory doi: 10.1016/j.simpat.2018.11.005 – ident: 10.1016/j.infsof.2023.107176_b86 – start-page: 640 year: 2011 ident: 10.1016/j.infsof.2023.107176_b103 article-title: Requirement engineering techniques in developing expert systems – start-page: 154 year: 2019 ident: 10.1016/j.infsof.2023.107176_b6 article-title: Conversational recommender system chatbot based on functional requirement – ident: 10.1016/j.infsof.2023.107176_b24 doi: 10.1109/RE51729.2021.00008 – start-page: 1 year: 2020 ident: 10.1016/j.infsof.2023.107176_b107 article-title: Model-driven requirements for humans-on-the-loop multi-UAV missions – start-page: 177 year: 2019 ident: 10.1016/j.infsof.2023.107176_b149 article-title: Exploring social bias in chatbots using stereotype knowledge – volume: 24 start-page: 28 issue: 4 year: 2017 ident: 10.1016/j.infsof.2023.107176_b1 article-title: Intelligence on tap: artificial intelligence as a new design material publication-title: Interactions doi: 10.1145/3085571 – volume: 13 start-page: 673 issue: 4 year: 2010 ident: 10.1016/j.infsof.2023.107176_b129 article-title: Networked wireless sensor data collection: issues, challenges, and approaches publication-title: IEEE Commun. Surv. Tutor. doi: 10.1109/SURV.2011.060710.00066 – start-page: 291 year: 2019 ident: 10.1016/j.infsof.2023.107176_b11 article-title: Software engineering for machine learning: a case study – volume: 25 start-page: 5454 issue: 6 year: 2020 ident: 10.1016/j.infsof.2023.107176_b19 article-title: Automated demarcation of requirements in textual specifications: a machine learning-based approach publication-title: Empir. Softw. Eng. doi: 10.1007/s10664-020-09864-1 – start-page: 56 year: 2012 ident: 10.1016/j.infsof.2023.107176_b74 article-title: Towards automated surgical robotics: A requirements engineering approach – volume: 67 start-page: 386 year: 2018 ident: 10.1016/j.infsof.2023.107176_b83 article-title: A conceptual model for developing a smart process control system publication-title: Procedia CIRP doi: 10.1016/j.procir.2017.12.230 – volume: 3 start-page: 1 issue: 3 year: 1997 ident: 10.1016/j.infsof.2023.107176_b70 article-title: Application of a case study methodology publication-title: Qual. Rep. – ident: 10.1016/j.infsof.2023.107176_b98 doi: 10.1109/RE51729.2021.00009 – year: 2020 ident: 10.1016/j.infsof.2023.107176_b32 article-title: Towards requirements specification for machine-learned perception based on human performance – start-page: 743 year: 2019 ident: 10.1016/j.infsof.2023.107176_b48 article-title: Non-functional requirements in robotic systems: Challenges and state of the art – start-page: 251 year: 2020 ident: 10.1016/j.infsof.2023.107176_b49 article-title: Ethical requirements for AI systems – start-page: 135 year: 2018 ident: 10.1016/j.infsof.2023.107176_b116 article-title: Specification-based monitoring of cyber-physical systems: a survey on theory, tools and applications – start-page: 41 year: 2021 ident: 10.1016/j.infsof.2023.107176_b89 article-title: An MDE method for improving deep learning dataset requirements engineering using alloy and UML – volume: 110 start-page: 156 year: 2019 ident: 10.1016/j.infsof.2023.107176_b36 article-title: Reusability in goal modeling: a systematic literature review publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2019.03.004 – volume: 26 start-page: 237 issue: 2 year: 2021 ident: 10.1016/j.infsof.2023.107176_b65 article-title: Modeling machine learning requirements from three perspectives: a case report from the healthcare domain publication-title: Requir. Eng. doi: 10.1007/s00766-020-00343-z – volume: 82 start-page: 669 issue: 4 year: 1995 ident: 10.1016/j.infsof.2023.107176_b118 article-title: Causal diagrams for empirical research publication-title: Biometrika doi: 10.1093/biomet/82.4.669 – start-page: 1 year: 2020 ident: 10.1016/j.infsof.2023.107176_b37 article-title: Engineering problems in machine learning systems publication-title: Mach. Learn. – start-page: 89 year: 2021 ident: 10.1016/j.infsof.2023.107176_b45 article-title: Requirement engineering challenges for AI-intense systems development – year: 2007 ident: 10.1016/j.infsof.2023.107176_b22 – volume: 117 start-page: 359 year: 2018 ident: 10.1016/j.infsof.2023.107176_b114 article-title: Business-driven data analytics: a conceptual modeling framework publication-title: Data Knowl. Eng. doi: 10.1016/j.datak.2018.04.006 – start-page: 1 year: 2021 ident: 10.1016/j.infsof.2023.107176_b38 article-title: Engineering AI systems: A research agenda – year: 2021 ident: 10.1016/j.infsof.2023.107176_b55 – volume: 3 start-page: 77 issue: 2 year: 2006 ident: 10.1016/j.infsof.2023.107176_b111 article-title: Using thematic analysis in psychology publication-title: Qual. Res. Psychol. doi: 10.1191/1478088706qp063oa – volume: 133 year: 2021 ident: 10.1016/j.infsof.2023.107176_b72 article-title: Case study research in software engineering—It is a case, and it is a study, but is it a case study? publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2021.106514 – ident: 10.1016/j.infsof.2023.107176_b5 doi: 10.1145/3378184.3378199 – start-page: 1 year: 2020 ident: 10.1016/j.infsof.2023.107176_b93 article-title: User-centered system design for assisted navigation of visually impaired individuals in outdoor cultural environments – volume: 64 start-page: 1 year: 2015 ident: 10.1016/j.infsof.2023.107176_b23 article-title: Guidelines for conducting systematic mapping studies in software engineering: An update publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2015.03.007 – start-page: 9 year: 2021 ident: 10.1016/j.infsof.2023.107176_b146 article-title: Impact of end user human aspects on software engineering – year: 2005 ident: 10.1016/j.infsof.2023.107176_b68 – start-page: 1 year: 2020 ident: 10.1016/j.infsof.2023.107176_b90 article-title: Helping organizations manage the innovation process to join the Cognitive era – ident: 10.1016/j.infsof.2023.107176_b80 – year: 2017 ident: 10.1016/j.infsof.2023.107176_b4 – start-page: 50 year: 2018 ident: 10.1016/j.infsof.2023.107176_b13 article-title: Software engineering challenges of deep learning – start-page: 116 year: 2021 ident: 10.1016/j.infsof.2023.107176_b21 article-title: Machine learning in requirements engineering: A mapping study – volume: 2 start-page: 230 issue: 4 year: 2017 ident: 10.1016/j.infsof.2023.107176_b3 article-title: Artificial intelligence in healthcare: past, present and future publication-title: Stroke Vasc. Neurol. doi: 10.1136/svn-2017-000101 – year: 2017 ident: 10.1016/j.infsof.2023.107176_b27 – volume: 12 start-page: 1696 issue: 9 year: 2019 ident: 10.1016/j.infsof.2023.107176_b81 article-title: Data requirements for applying machine learning to energy disaggregation publication-title: Energies doi: 10.3390/en12091696 – volume: 96 start-page: 242 year: 2021 ident: 10.1016/j.infsof.2023.107176_b108 article-title: Usage of autonomous mobile robots outdoors-an axiomatic design approach publication-title: Procedia CIRP doi: 10.1016/j.procir.2021.01.081 – volume: 27 start-page: 77 issue: 1 year: 2016 ident: 10.1016/j.infsof.2023.107176_b84 article-title: Addressing the non-functional requirements of computer vision systems: a case study publication-title: Mach. Vis. Appl. doi: 10.1007/s00138-015-0726-6 – ident: 10.1016/j.infsof.2023.107176_b29 doi: 10.1145/336512.336523 – volume: 27 start-page: 1 issue: 1 year: 2019 ident: 10.1016/j.infsof.2023.107176_b7 article-title: Confident privacy decision-making in IoT environments publication-title: ACM Trans. Comput.-Hum. Interact. doi: 10.1145/3364223 – ident: 10.1016/j.infsof.2023.107176_b138 doi: 10.1145/3290605.3300233 – ident: 10.1016/j.infsof.2023.107176_b133 doi: 10.1145/2858036.2858529 – start-page: 1 year: 2014 ident: 10.1016/j.infsof.2023.107176_b14 article-title: Expert system and it’s requirement engineering process – start-page: 470 year: 2019 ident: 10.1016/j.infsof.2023.107176_b43 article-title: Mitigating challenges in the elicitation and analysis of transparency requirements – ident: 10.1016/j.infsof.2023.107176_b91 doi: 10.1145/3412841.3442007 – start-page: 37 year: 1999 ident: 10.1016/j.infsof.2023.107176_b119 article-title: Causal diagrams for epidemiologic research publication-title: Epidemiology doi: 10.1097/00001648-199901000-00008 – year: 2019 ident: 10.1016/j.infsof.2023.107176_b128 – start-page: 128 year: 2017 ident: 10.1016/j.infsof.2023.107176_b78 article-title: Defining camera-based traffic scenarios and use cases for the visually impaired by means of expert interviews – start-page: 386 year: 2019 ident: 10.1016/j.infsof.2023.107176_b100 article-title: Non-functional requirements for machine learning: Challenges and new directions – year: 2022 ident: 10.1016/j.infsof.2023.107176_b148 – start-page: 363 year: 2019 ident: 10.1016/j.infsof.2023.107176_b63 article-title: Explainability as a non-functional requirement – start-page: 33 year: 2021 ident: 10.1016/j.infsof.2023.107176_b95 article-title: A mobile application for mental health care during COVID-19 pandemic: Development and usability evaluation with system usability scale – ident: 10.1016/j.infsof.2023.107176_b97 – start-page: 252 year: 2019 ident: 10.1016/j.infsof.2023.107176_b16 article-title: Requirements engineering challenges in building AI-based complex systems – start-page: 382 year: 2018 ident: 10.1016/j.infsof.2023.107176_b39 article-title: Software transparency as a key requirement for self-driving cars – start-page: 177 year: 2018 ident: 10.1016/j.infsof.2023.107176_b61 article-title: It takes three to tango: Requirement, outcome/data, and AI driven development – volume: 6 issue: 1 year: 2019 ident: 10.1016/j.infsof.2023.107176_b53 article-title: Transparency you can trust: Transparency requirements for artificial intelligence between legal norms and contextual concerns publication-title: Big Data Soc. doi: 10.1177/2053951719860542 – ident: 10.1016/j.infsof.2023.107176_b62 doi: 10.1145/2601248.2601268 – start-page: 13 year: 2019 ident: 10.1016/j.infsof.2023.107176_b105 article-title: Adapting SQuaRE for quality assessment of artificial intelligence systems – start-page: 233 year: 2014 ident: 10.1016/j.infsof.2023.107176_b123 article-title: Sirius: A rapid development of DSM graphical editor – start-page: 33 year: 2020 ident: 10.1016/j.infsof.2023.107176_b44 article-title: Towards an extended requirements problem formulation for superintelligence safety – start-page: 153 year: 2016 ident: 10.1016/j.infsof.2023.107176_b127 article-title: A map of threats to validity of systematic literature reviews in software engineering – start-page: 409 year: 2022 ident: 10.1016/j.infsof.2023.107176_b47 article-title: Requirements engineering for collaborative artificial intelligence systems: A literature survey – start-page: 9 year: 2014 ident: 10.1016/j.infsof.2023.107176_b57 article-title: Systematic reviews in requirements engineering: A tertiary study – ident: 10.1016/j.infsof.2023.107176_b126 – ident: 10.1016/j.infsof.2023.107176_b125 doi: 10.1109/CVPR42600.2020.00271 – volume: 85 start-page: 2160 issue: 9 year: 2012 ident: 10.1016/j.infsof.2023.107176_b150 article-title: Understanding socially oriented roles and goals through motivational modelling publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2012.04.049 – start-page: 285 year: 2008 ident: 10.1016/j.infsof.2023.107176_b73 article-title: Selecting empirical methods for software engineering research – volume: 267 start-page: 1 year: 2019 ident: 10.1016/j.infsof.2023.107176_b139 article-title: Explanation in artificial intelligence: Insights from the social sciences publication-title: Artificial Intelligence doi: 10.1016/j.artint.2018.07.007 – start-page: 260 year: 2020 ident: 10.1016/j.infsof.2023.107176_b87 article-title: Requirements-driven method to determine quality characteristics and measurements for machine learning software and its evaluation – year: 2012 ident: 10.1016/j.infsof.2023.107176_b67 – volume: 3 start-page: 112 issue: 2 year: 1994 ident: 10.1016/j.infsof.2023.107176_b69 article-title: Integrating case study and survey research methods: an example in information systems publication-title: Eur. J. Inf. Syst. doi: 10.1057/ejis.1994.12 – volume: 37 start-page: 56 issue: 2 year: 2021 ident: 10.1016/j.infsof.2023.107176_b147 article-title: Human-centered AI publication-title: Issues Sci. Technol. – volume: 5 start-page: 265 issue: 2 year: 2019 ident: 10.1016/j.infsof.2023.107176_b79 article-title: Requirements-driven test generation for autonomous vehicles with machine learning components publication-title: IEEE Trans. Intell. Veh. doi: 10.1109/TIV.2019.2955903 – start-page: 200 year: 2019 ident: 10.1016/j.infsof.2023.107176_b54 article-title: Towards the development of artificial intelligence-based systems: Human-centered functional requirements and open problems – year: 2008 ident: 10.1016/j.infsof.2023.107176_b10 – volume: 766 start-page: 160 year: 2011 ident: 10.1016/j.infsof.2023.107176_b25 article-title: GRL modeling and analysis with jUCMNav publication-title: IStar – volume: 6 start-page: 747 issue: 5 year: 2011 ident: 10.1016/j.infsof.2023.107176_b34 article-title: User requirements notation: the first ten years, the next ten years publication-title: JSW doi: 10.4304/jsw.6.5.747-768 – volume: 3 start-page: 183 year: 2008 ident: 10.1016/j.infsof.2023.107176_b117 article-title: Causal diagrams publication-title: Mod. Epidemiol. – start-page: 15 year: 2018 ident: 10.1016/j.infsof.2023.107176_b64 article-title: A roadmap for ethics-aware software engineering – start-page: 157 year: 2019 ident: 10.1016/j.infsof.2023.107176_b76 article-title: Putting AI into context-method support for the introduction of artificial intelligence into organizations – start-page: 335 year: 2020 ident: 10.1016/j.infsof.2023.107176_b135 article-title: Non-functional requirements orienting the development of socially responsible software – start-page: 11 year: 2020 ident: 10.1016/j.infsof.2023.107176_b51 article-title: A multi-aspectual requirements analysis for artificial intelligence for well-being – ident: 10.1016/j.infsof.2023.107176_b132 doi: 10.1145/3490099.3511141 – volume: 35 start-page: 81 issue: 5 year: 2018 ident: 10.1016/j.infsof.2023.107176_b15 article-title: Software engineering for machine-learning applications: The road ahead publication-title: IEEE Softw. doi: 10.1109/MS.2018.3571224 – start-page: 346 year: 2020 ident: 10.1016/j.infsof.2023.107176_b104 article-title: Evidence-driven requirements engineering for uncertainty of machine learning-based systems – start-page: 105 year: 2014 ident: 10.1016/j.infsof.2023.107176_b122 article-title: Autonomy requirements engineering – start-page: 195 year: 2021 ident: 10.1016/j.infsof.2023.107176_b110 article-title: A quest of self-explainability: When causal diagrams meet autonomous urban traffic manoeuvres – start-page: 1 year: 2017 ident: 10.1016/j.infsof.2023.107176_b113 article-title: Data-driven development, a complementing approach for automotive systems engineering – start-page: 1 year: 2013 ident: 10.1016/j.infsof.2023.107176_b124 article-title: On the autonomy requirements for space missions – start-page: 27 year: 2017 ident: 10.1016/j.infsof.2023.107176_b75 article-title: Integrated description of functional and non-functional requirements for automotive systems design using SysML – start-page: 159 year: 2021 ident: 10.1016/j.infsof.2023.107176_b130 article-title: Virtual reality enabled human-centric requirements engineering – year: 2022 ident: 10.1016/j.infsof.2023.107176_b155 – ident: 10.1016/j.infsof.2023.107176_b26 – start-page: 36 year: 2017 ident: 10.1016/j.infsof.2023.107176_b140 article-title: Explainable AI: Beware of inmates running the asylum or: How I learnt to stop worrying and love the social and behavioural sciences – volume: 349 start-page: 255 issue: 6245 year: 2015 ident: 10.1016/j.infsof.2023.107176_b12 article-title: Machine learning: Trends, perspectives, and prospects publication-title: Science doi: 10.1126/science.aaa8415 – volume: 35 start-page: 105 issue: 4 year: 2014 ident: 10.1016/j.infsof.2023.107176_b143 article-title: Power to the people: The role of humans in interactive machine learning publication-title: AI Mag. – year: 2019 ident: 10.1016/j.infsof.2023.107176_b152 article-title: From gender biases to gender-inclusive design: An empirical investigation – start-page: 31 year: 2021 ident: 10.1016/j.infsof.2023.107176_b153 article-title: Evaluating age bias in E-commerce – ident: 10.1016/j.infsof.2023.107176_b96 doi: 10.1145/3382025.3414950 – start-page: 125 year: 2010 ident: 10.1016/j.infsof.2023.107176_b115 article-title: Fuzzy goals for requirements-driven adaptation – ident: 10.1016/j.infsof.2023.107176_b137 – start-page: 2586 year: 2016 ident: 10.1016/j.infsof.2023.107176_b151 article-title: Finding gender-inclusiveness software issues with GenderMag: a field investigation – year: 2016 ident: 10.1016/j.infsof.2023.107176_b60 – ident: 10.1016/j.infsof.2023.107176_b131 doi: 10.1145/3411764.3445735 – start-page: 111 year: 2017 ident: 10.1016/j.infsof.2023.107176_b102 article-title: A requirement engineering model for big data software – volume: 41 start-page: 944 issue: 10 year: 2015 ident: 10.1016/j.infsof.2023.107176_b18 article-title: Automated checking of conformance to requirements templates using natural language processing publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2015.2428709 – start-page: 188 year: 2021 ident: 10.1016/j.infsof.2023.107176_b52 article-title: Holistic explainability requirements for end-to-end machine learning in IoT cloud systems – ident: 10.1016/j.infsof.2023.107176_b42 – year: 2005 ident: 10.1016/j.infsof.2023.107176_b33 – ident: 10.1016/j.infsof.2023.107176_b145 doi: 10.1145/3399715.3400873 – start-page: 2503 year: 2015 ident: 10.1016/j.infsof.2023.107176_b8 article-title: Hidden technical debt in machine learning systems – ident: 10.1016/j.infsof.2023.107176_b109 – start-page: 189 year: 2015 ident: 10.1016/j.infsof.2023.107176_b2 article-title: Design and evaluation of a customizable multi-domain reference architecture on top of product lines of self-driving heavy vehicles-an industrial case study – year: 2021 ident: 10.1016/j.infsof.2023.107176_b94 article-title: Human-centered XAI: Developing design patterns for explanations of clinical decision support systems publication-title: Int. J. Hum. Comput. Stud. doi: 10.1016/j.ijhcs.2021.102684 – start-page: 543 year: 2019 ident: 10.1016/j.infsof.2023.107176_b120 article-title: Towards self-explainable cyber-physical systems – volume: 55 start-page: 587 issue: 4 year: 2001 ident: 10.1016/j.infsof.2023.107176_b144 article-title: Methods to support human-centred design publication-title: Int. J. Hum. Comput. Stud. doi: 10.1006/ijhc.2001.0503 – start-page: 61 year: 2020 ident: 10.1016/j.infsof.2023.107176_b88 article-title: Faulty requirements made valuable: On the role of data quality in deep learning – start-page: 29 year: 2021 ident: 10.1016/j.infsof.2023.107176_b56 article-title: Requirements engineering for machine learning: A systematic mapping study – start-page: 19 year: 2022 ident: 10.1016/j.infsof.2023.107176_b134 article-title: Requirements engineering for artificial intelligence: What is a requirements specification for an artificial intelligence? – volume: 51 start-page: 915 year: 2015 ident: 10.1016/j.infsof.2023.107176_b31 article-title: A systematic literature review on agile requirements engineering practices and challenges publication-title: Comput. Hum. Behav. doi: 10.1016/j.chb.2014.10.046 – volume: 23 start-page: 63 issue: 1 year: 2018 ident: 10.1016/j.infsof.2023.107176_b58 article-title: Empirical research in requirements engineering: trends and opportunities publication-title: Requir. Eng. doi: 10.1007/s00766-016-0258-2 – ident: 10.1016/j.infsof.2023.107176_b66 doi: 10.1109/REW.2019.00050 – year: 2010 ident: 10.1016/j.infsof.2023.107176_b121 – volume: 246 start-page: 75 year: 2018 ident: 10.1016/j.infsof.2023.107176_b154 article-title: Supporting diverse challenges of ageing with digital enhanced living solutions publication-title: Stud. Health Technol. Inf. – year: 2016 ident: 10.1016/j.infsof.2023.107176_b30 – year: 2017 ident: 10.1016/j.infsof.2023.107176_b59 – ident: 10.1016/j.infsof.2023.107176_b142 doi: 10.1145/3290605.3300831 – year: 2019 ident: 10.1016/j.infsof.2023.107176_b136 – year: 2012 ident: 10.1016/j.infsof.2023.107176_b112 – year: 2020 ident: 10.1016/j.infsof.2023.107176_b156 – start-page: 716 year: 2018 ident: 10.1016/j.infsof.2023.107176_b28 article-title: Communicating requirements–effectively! – volume: 127 year: 2020 ident: 10.1016/j.infsof.2023.107176_b9 article-title: Large-scale machine learning systems in real-world industrial settings: A review of challenges and solutions publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2020.106368 – volume: 23 start-page: 509 issue: 4 year: 2018 ident: 10.1016/j.infsof.2023.107176_b85 article-title: Goal model analysis of autonomy requirements for Unmanned Aircraft Systems publication-title: Requir. Eng. doi: 10.1007/s00766-017-0278-6 – start-page: 227 year: 2021 ident: 10.1016/j.infsof.2023.107176_b99 article-title: Lessons learned from applying requirements and design techniques in the development of a machine learning system for predicting lawsuits against power companies – volume: 51 start-page: 1 issue: 5 year: 2018 ident: 10.1016/j.infsof.2023.107176_b141 article-title: A survey of methods for explaining black box models publication-title: ACM Comput. Surv. doi: 10.1145/3236009 – start-page: 241 year: 2019 ident: 10.1016/j.infsof.2023.107176_b77 article-title: Toward requirements specification for machine-learned components – start-page: 768 year: 2013 ident: 10.1016/j.infsof.2023.107176_b101 article-title: Functional requirements and design issues for a socially assistive robot for elderly people with mild cognitive impairments – volume: 14 start-page: 61 issue: 1 year: 2012 ident: 10.1016/j.infsof.2023.107176_b50 article-title: Robots: ethical by design publication-title: Ethics Inform. Technol. doi: 10.1007/s10676-011-9278-2 |
| SSID | ssj0017030 |
| Score | 2.6208315 |
| SecondaryResourceType | review_article |
| Snippet | In traditional software systems, Requirements Engineering (RE) activities are well-established and researched. However, building Artificial Intelligence (AI)... |
| SourceID | crossref elsevier |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 107176 |
| SubjectTerms | Artificial intelligence Machine learning Requirements engineering Software engineering Systematic mapping study |
| Title | Requirements engineering for artificial intelligence systems: A systematic mapping study |
| URI | https://dx.doi.org/10.1016/j.infsof.2023.107176 |
| Volume | 158 |
| WOSCitedRecordID | wos000950409600001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1873-6025 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0017030 issn: 0950-5849 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Zi9swEBZptpS-lJ50e6GHvgUX2bEja9_SZUuvXUq7hbwZyZqQhsQJXu9B3_rPO9L4oim9oC_GKFYUz3wZzYzmYOy5SqSWNjSB1TYJ8J-oUA6KJAARxxr3h1xYz-n38uQknc3Uh8HgW5MLc7GSRZFeXantf2U1jiGzXersX7C7_VIcwHtkOl6R7Xj9I8Z_BBfcC5S6Bl25QYqXLH1skO_U0S_GSQWdzyhPvVfdea23W_I4NFVol03oe5v2OCLf-7y6dFFk1Y6vfrpYE47eLVZ1a3o6cLKwKvVX8PL4eLPQa-g-LDe-AdLocAFVB-CX2ncKHx2fu5fSfZdFNO5Cq8iPtpNLUzskRYDqEAlQIHGcynEwEZQa3cprqvW-I_vJDbF0Bgu-8wu3MA6iufpDqW2_eX9yy7nV0ATzgu4a24tkotIh25u-OZq9bY-inEikgo3085r8Sx8kuLvWz_Wbns5yepvdqo0NPiWQ3GEDKO6yG02uwz0262OF97DCkbm8wwrvY4XXWDngU94hhddI4R4p99nnV0enh6-DutVGkKPNWAWgJOptICcQR2GeWG2UMBbt84kZGwMRRFIkBkKhQIscYmkU5NLgDhXPYW7E-AEbFpsCHjJuI2PT2KIEMGEMkVYGkjSaQw7uhDmM99m4IVCW13XoXTuUVdYEHC4zImvmyJoRWfdZ0M7aUh2W3zwvG9pntS5JOmKGcPnlzEf_PPMxu9mh_QkbVuU5PGXX84vqy1n5rMbVd--Vn6o |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Requirements+engineering+for+artificial+intelligence+systems%3A+A+systematic+mapping+study&rft.jtitle=Information+and+software+technology&rft.au=Ahmad%2C+Khlood&rft.au=Abdelrazek%2C+Mohamed&rft.au=Arora%2C+Chetan&rft.au=Bano%2C+Muneera&rft.date=2023-06-01&rft.pub=Elsevier+B.V&rft.issn=0950-5849&rft.eissn=1873-6025&rft.volume=158&rft_id=info:doi/10.1016%2Fj.infsof.2023.107176&rft.externalDocID=S0950584923000307 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0950-5849&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0950-5849&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0950-5849&client=summon |