Quality Models for Artificial Intelligence Systems: Characteristic-Based Approach, Development and Application

The factors complicating the specification of requirements for artificial intelligence systems (AIS) and their verification for the AIS creation and modernization are analyzed. The harmonization of definitions and building of a hierarchy of AIS characteristics for regulation of the development of te...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	Sensors (Basel, Switzerland) Jg. 22; H. 13; S. 4865
Hauptverfasser:	Kharchenko, Vyacheslav, Fesenko, Herman, Illiashenko, Oleg
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	Basel MDPI AG 27.06.2022 MDPI
Schlagworte:	Artificial intelligence characteristic ISO standards Principles Product quality quality quality model Quality standards Software quality
ISSN:	1424-8220, 1424-8220
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	The factors complicating the specification of requirements for artificial intelligence systems (AIS) and their verification for the AIS creation and modernization are analyzed. The harmonization of definitions and building of a hierarchy of AIS characteristics for regulation of the development of techniques and tools for standardization, as well as evaluation and provision of requirements during the creation and implementation of AIS, is extremely important. The study aims to develop and demonstrate the use of quality models for artificial intelligence (AI), AI platform (AIP), and AIS based on the definition and ordering of characteristics. The principles of AI quality model development and its sequence are substantiated. Approaches to formulating definitions of AIS characteristics, methods of representation of dependencies, and hierarchies of characteristics are given. The definitions and harmonization options of hierarchical relations between 46 characteristics of AI and AIP are suggested. The quality models of AI, AIP, and AIS presented in analytical, tabular, and graph forms, are described. The so-called basic models with reduced sets of the most important characteristics are presented. Examples of AIS quality models for UAV video navigation systems and decision support systems for diagnosing diseases are described.
AbstractList	The factors complicating the specification of requirements for artificial intelligence systems (AIS) and their verification for the AIS creation and modernization are analyzed. The harmonization of definitions and building of a hierarchy of AIS characteristics for regulation of the development of techniques and tools for standardization, as well as evaluation and provision of requirements during the creation and implementation of AIS, is extremely important. The study aims to develop and demonstrate the use of quality models for artificial intelligence (AI), AI platform (AIP), and AIS based on the definition and ordering of characteristics. The principles of AI quality model development and its sequence are substantiated. Approaches to formulating definitions of AIS characteristics, methods of representation of dependencies, and hierarchies of characteristics are given. The definitions and harmonization options of hierarchical relations between 46 characteristics of AI and AIP are suggested. The quality models of AI, AIP, and AIS presented in analytical, tabular, and graph forms, are described. The so-called basic models with reduced sets of the most important characteristics are presented. Examples of AIS quality models for UAV video navigation systems and decision support systems for diagnosing diseases are described. The factors complicating the specification of requirements for artificial intelligence systems (AIS) and their verification for the AIS creation and modernization are analyzed. The harmonization of definitions and building of a hierarchy of AIS characteristics for regulation of the development of techniques and tools for standardization, as well as evaluation and provision of requirements during the creation and implementation of AIS, is extremely important. The study aims to develop and demonstrate the use of quality models for artificial intelligence (AI), AI platform (AIP), and AIS based on the definition and ordering of characteristics. The principles of AI quality model development and its sequence are substantiated. Approaches to formulating definitions of AIS characteristics, methods of representation of dependencies, and hierarchies of characteristics are given. The definitions and harmonization options of hierarchical relations between 46 characteristics of AI and AIP are suggested. The quality models of AI, AIP, and AIS presented in analytical, tabular, and graph forms, are described. The so-called basic models with reduced sets of the most important characteristics are presented. Examples of AIS quality models for UAV video navigation systems and decision support systems for diagnosing diseases are described.The factors complicating the specification of requirements for artificial intelligence systems (AIS) and their verification for the AIS creation and modernization are analyzed. The harmonization of definitions and building of a hierarchy of AIS characteristics for regulation of the development of techniques and tools for standardization, as well as evaluation and provision of requirements during the creation and implementation of AIS, is extremely important. The study aims to develop and demonstrate the use of quality models for artificial intelligence (AI), AI platform (AIP), and AIS based on the definition and ordering of characteristics. The principles of AI quality model development and its sequence are substantiated. Approaches to formulating definitions of AIS characteristics, methods of representation of dependencies, and hierarchies of characteristics are given. The definitions and harmonization options of hierarchical relations between 46 characteristics of AI and AIP are suggested. The quality models of AI, AIP, and AIS presented in analytical, tabular, and graph forms, are described. The so-called basic models with reduced sets of the most important characteristics are presented. Examples of AIS quality models for UAV video navigation systems and decision support systems for diagnosing diseases are described.
Author	Illiashenko, Oleg Kharchenko, Vyacheslav Fesenko, Herman
AuthorAffiliation	Department of Computer Systems, Networks and Cybersecurity, National Aerospace University “KhAI”, 17, Chkalov Str., 61070 Kharkiv, Ukraine; v.kharchenko@csn.khai.edu (V.K.); h.fesenko@csn.khai.edu (H.F.)
AuthorAffiliation_xml	– name: Department of Computer Systems, Networks and Cybersecurity, National Aerospace University “KhAI”, 17, Chkalov Str., 61070 Kharkiv, Ukraine; v.kharchenko@csn.khai.edu (V.K.); h.fesenko@csn.khai.edu (H.F.)
Author_xml	– sequence: 1 givenname: Vyacheslav orcidid: 0000-0001-5352-077X surname: Kharchenko fullname: Kharchenko, Vyacheslav – sequence: 2 givenname: Herman orcidid: 0000-0002-4084-2101 surname: Fesenko fullname: Fesenko, Herman – sequence: 3 givenname: Oleg orcidid: 0000-0002-4672-6400 surname: Illiashenko fullname: Illiashenko, Oleg
BookMark	eNplkluLFDEQhRtZcS_64D9o8EXBdnPrdNoHYRxvAysi6nOoTtIzGTJJb5JemH9vdmYVd31KSJ36TupQ59WJD95U1XOM3lDao8tECKZM8PZRdYYZYY0gBJ38cz-tzlPaIkQopeJJdUpbgQTl-Kzy32dwNu_rr0Ebl-oxxHoRsx2tsuDqlc_GObs2Xpn6xz5ls0tv6-UGIqhsok3ZquY9JKPrxTTFAGrzuv5gbowL0874XIM_VJxVkG3wT6vHI7hknt2dF9WvTx9_Lr80V98-r5aLq0YxxnODQVCEgJNBdBjhEY3CtIz3rWCkg741mOq2Q4hzpggaAbORKy36vie6A9rRi2p15OoAWzlFu4O4lwGsPDyEuJZQplTOSDXolg5dsWh7pjUaQJOBUEYAGYYFLqx3R9Y0DzujVRkrgrsHvV_xdiPX4Ub2hPcd5QXw8g4Qw_VsUpY7m1TJFbwJc5KEi64jxast0hcPpNswR1-iulVxLAQ7qC6PKhVDStGMUtl8yLf4Wycxkrd7If_uRel49aDjz_f_1_4GhBS37A
CitedBy_id	crossref_primary_10_1016_j_jmir_2024_101733 crossref_primary_10_3390_e25081123 crossref_primary_10_3390_su17030927 crossref_primary_10_1109_ACCESS_2024_3448271 crossref_primary_10_3390_a16030165 crossref_primary_10_1007_s10270_023_01117_1 crossref_primary_10_1016_j_cosrev_2024_100681 crossref_primary_10_1016_j_jretconser_2025_104403 crossref_primary_10_1007_s43681_025_00728_2 crossref_primary_10_1016_j_compbiomed_2024_108632 crossref_primary_10_3390_mti7030027 crossref_primary_10_1007_s10559_025_00757_z
Cites_doi	10.1007/978-3-319-30246-1 10.1109/DESSERT.2018.8409162 10.1007/s40593-021-00248-0 10.1145/3308560.3317590 10.1007/978-3-030-65854-0_3 10.6028/NIST.IR.8332-draft 10.1007/s12369-021-00790-w 10.1007/s11747-019-00710-5 10.1145/3430524.3442704 10.6028/NIST.IR.8312 10.1109/TBIOM.2021.3132237 10.1016/j.jbi.2020.103655 10.3390/e23010018 10.1007/978-3-319-19216-1_37 10.3390/bdcc5020020 10.15588/1607-3274-2020-4-14 10.1016/j.inffus.2019.12.012 10.1016/j.ijhcs.2020.102551 10.1007/978-3-030-57321-8_1 10.3390/app11115088 10.6028/NIST.IR.8269-draft 10.1080/10580530.2020.1849465 10.6028/NIST.IR.8367 10.1007/s13347-022-00510-w 10.18653/v1/W19-8403 10.1007/978-3-030-51110-4 10.1145/3462757.3466145 10.23919/MIPRO.2018.8400040 10.1007/s43681-021-00069-w 10.1007/978-3-030-72188-6 10.1007/s11263-022-01657-x 10.1017/S0269888921000011 10.2139/ssrn.3826358 10.1109/EDOCW52865.2021.00036 10.3390/app12094130 10.1007/s11219-021-09557-y 10.3390/make3030032 10.1007/s11948-020-00228-y 10.1007/978-3-030-65854-0_4 10.1007/978-3-030-32236-6_51 10.1109/ACCESS.2018.2870052 10.1109/MPULS.2018.2885857 10.1007/s13218-020-00636-z 10.3390/data4010004 10.1007/978-3-319-07013-1_21 10.3390/app12031353 10.6028/NIST.SP.1270 10.1002/widm.1312 10.1007/s43681-020-00022-3 10.1016/j.patter.2020.100050 10.1109/DSAA.2018.00018 10.3390/app12094459 10.1145/3334480.3375059 10.1109/EWDTS.2016.7807653 10.1365/s40702-021-00821-0 10.1109/TNNLS.2020.3027314 10.1002/widm.1391 10.1145/3351095.3372834 10.3390/app12031295 10.3390/jrfm15040165 10.1145/3292500.3332281 10.17352/ara.000011
ContentType	Journal Article
Copyright	2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. 2022 by the authors. 2022
Copyright_xml	– notice: 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. – notice: 2022 by the authors. 2022
DBID	AAYXX CITATION 3V. 7X7 7XB 88E 8FI 8FJ 8FK ABUWG AFKRA AZQEC BENPR CCPQU DWQXO FYUFA GHDGH K9. M0S M1P PHGZM PHGZT PIMPY PJZUB PKEHL PPXIY PQEST PQQKQ PQUKI PRINS 7X8 5PM DOA
DOI	10.3390/s22134865
DatabaseName	CrossRef ProQuest Central (Corporate) Health & Medical Collection ProQuest Central (purchase pre-March 2016) Medical Database (Alumni Edition) Hospital Premium Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Central (Alumni Edition) ProQuest Central UK/Ireland ProQuest Central Essentials - QC ProQuest Central ProQuest One Community College ProQuest Central Korea Health Research Premium Collection Health Research Premium Collection (Alumni) ProQuest Health & Medical Complete (Alumni) Health & Medical Collection (Alumni Edition) Medical Database ProQuest Central Premium ProQuest One Academic (New) Publicly Available Content Database ProQuest Health & Medical Research Collection ProQuest One Academic Middle East (New) ProQuest One Health & Nursing ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Directory of Open Access Journals
DatabaseTitle	CrossRef Publicly Available Content Database ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest Health & Medical Complete (Alumni) ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest One Health & Nursing ProQuest Central China ProQuest Central ProQuest Health & Medical Research Collection Health Research Premium Collection Health and Medicine Complete (Alumni Edition) ProQuest Central Korea Health & Medical Research Collection ProQuest Central (New) ProQuest Medical Library (Alumni) ProQuest One Academic Eastern Edition ProQuest Hospital Collection Health Research Premium Collection (Alumni) ProQuest Hospital Collection (Alumni) ProQuest Health & Medical Complete ProQuest Medical Library ProQuest One Academic UKI Edition ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni) MEDLINE - Academic
DatabaseTitleList	CrossRef Publicly Available Content Database MEDLINE - Academic
Database_xml	– sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: PIMPY name: Publicly Available Content Database url: http://search.proquest.com/publiccontent sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Engineering
EISSN	1424-8220
ExternalDocumentID	oai_doaj_org_article_cbd53b70f8594dd0bad2b2342a0e4181 PMC9269736 10_3390_s22134865
GroupedDBID	--- 123 2WC 53G 5VS 7X7 88E 8FE 8FG 8FI 8FJ AADQD AAHBH AAYXX ABDBF ABUWG ACUHS ADBBV ADMLS AENEX AFFHD AFKRA AFZYC ALMA_UNASSIGNED_HOLDINGS BENPR BPHCQ BVXVI CCPQU CITATION CS3 D1I DU5 E3Z EBD ESX F5P FYUFA GROUPED_DOAJ GX1 HH5 HMCUK HYE IAO ITC KQ8 L6V M1P M48 MODMG M~E OK1 OVT P2P P62 PHGZM PHGZT PIMPY PJZUB PPXIY PQQKQ PROAC PSQYO RNS RPM TUS UKHRP XSB ~8M 3V. 7XB 8FK AZQEC DWQXO K9. PKEHL PQEST PQUKI PRINS 7X8 PUEGO 5PM
ID	FETCH-LOGICAL-c446t-1a8300a62b87101f0f8e546958427a95e13d5700664c20fa14f6cd89992d7a373
IEDL.DBID	BENPR
ISICitedReferencesCount	15
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000824024400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1424-8220
IngestDate	Tue Oct 14 19:00:11 EDT 2025 Tue Nov 04 02:03:03 EST 2025 Thu Oct 02 06:50:18 EDT 2025 Tue Oct 07 07:25:07 EDT 2025 Tue Nov 18 21:25:50 EST 2025 Sat Nov 29 07:13:34 EST 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Issue	13
Language	English
License	Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c446t-1a8300a62b87101f0f8e546958427a95e13d5700664c20fa14f6cd89992d7a373
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23
ORCID	0000-0002-4084-2101 0000-0002-4672-6400 0000-0001-5352-077X
OpenAccessLink	https://www.proquest.com/docview/2686188485?pq-origsite=%requestingapplication%
PMID	35808361
PQID	2686188485
PQPubID	2032333
ParticipantIDs	doaj_primary_oai_doaj_org_article_cbd53b70f8594dd0bad2b2342a0e4181 pubmedcentral_primary_oai_pubmedcentral_nih_gov_9269736 proquest_miscellaneous_2687724185 proquest_journals_2686188485 crossref_citationtrail_10_3390_s22134865 crossref_primary_10_3390_s22134865
PublicationCentury	2000
PublicationDate	20220627
PublicationDateYYYYMMDD	2022-06-27
PublicationDate_xml	– month: 6 year: 2022 text: 20220627 day: 27
PublicationDecade	2020
PublicationPlace	Basel
PublicationPlace_xml	– name: Basel
PublicationTitle	Sensors (Basel, Switzerland)
PublicationYear	2022
Publisher	MDPI AG MDPI
Publisher_xml	– name: MDPI AG – name: MDPI
References	Zamojski (ref_121) 2015; Volume 365 ref_93 ref_92 ref_90 ref_14 (ref_61) 2021; 1 ref_13 ref_12 ref_11 Adadi (ref_40) 2018; 6 ref_99 ref_10 ref_98 ref_97 ref_96 ref_95 ref_19 ref_18 ref_17 ref_16 ref_15 Tang (ref_24) 2019; Volume 11839 ref_23 Kharchenko (ref_108) 2017; Volume 74 ref_22 ref_21 ref_20 Alaa (ref_46) 2021; 5 ref_124 ref_28 ref_27 ref_26 Sovrano (ref_86) 2022; 5 Smith (ref_30) 2020; 2800 Illiashenko (ref_123) 2020; 4 ref_72 ref_71 Baum (ref_89) 2022; 35 Toward (ref_75) 2021; 32 ref_79 Tucker (ref_91) 2021; Volume 12721 ref_77 Winkler (ref_120) 2021; Volume 404 ref_83 ref_81 ref_80 ref_87 Vilone (ref_68) 2021; 3 Gardner (ref_60) 2022; 2 Zhang (ref_110) 2020; 1 Holzinger (ref_50) 2019; 9 Vassiliades (ref_78) 2021; 36 Ryan (ref_62) 2020; 26 Nguyen (ref_84) 2020; Volume 12034 Confalonieri (ref_88) 2020; 11 ref_57 ref_56 ref_55 ref_54 ref_53 ref_52 Shin (ref_51) 2020; 146 ref_59 Holzinger (ref_82) 2020; Volume 12279 Tonetta (ref_122) 2013; Volume 8166 ref_69 Meske (ref_74) 2022; 39 ref_67 Kong (ref_85) 2021; 41 ref_66 Sgaier (ref_49) 2020; 18 ref_64 ref_63 Zamojski (ref_119) 2014; Volume 286 Gordieiev (ref_32) 2020; 94 Holzinger (ref_65) 2020; 34 Umbrello (ref_73) 2022; 14 ref_114 ref_117 ref_116 Markus (ref_58) 2021; 113 ref_118 Samek (ref_76) 2019; Volume 1 ref_36 Winkler (ref_29) 2021; Volume 404 ref_35 ref_34 Bennetot (ref_38) 2020; 58 ref_33 Dennehy (ref_94) 2021; Volume 12896 ref_111 ref_31 ref_113 ref_112 Braunschweig (ref_25) 2021; Volume 12600 ref_39 Kharchenko (ref_115) 2022; 2 ref_37 ref_104 ref_103 ref_106 ref_105 Weber (ref_48) 2019; 10 ref_107 ref_109 ref_47 ref_45 ref_44 ref_43 ref_100 ref_42 ref_41 ref_102 ref_101 ref_1 Rai (ref_70) 2020; 48 ref_3 ref_2 ref_9 ref_8 ref_5 ref_4 ref_7 ref_6
References_xml	– ident: ref_27 doi: 10.1007/978-3-319-30246-1 – ident: ref_9 – ident: ref_26 doi: 10.1109/DESSERT.2018.8409162 – ident: ref_63 doi: 10.1007/s40593-021-00248-0 – ident: ref_47 doi: 10.1145/3308560.3317590 – volume: Volume 404 start-page: 33 year: 2021 ident: ref_120 article-title: Quality assurance for AI-based systems: Overview and challenges (introduction to interactive session) publication-title: Lecture Notes in Business Information Processing doi: 10.1007/978-3-030-65854-0_3 – ident: ref_100 – ident: ref_17 doi: 10.6028/NIST.IR.8332-draft – ident: ref_39 – ident: ref_42 – volume: 14 start-page: 313 year: 2022 ident: ref_73 article-title: Designing AI for Explainability and Verifiability: A Value Sensitive Design Approach to Avoid Artificial Stupidity in Autonomous Vehicles publication-title: Int. J. Soc. Robot. doi: 10.1007/s12369-021-00790-w – volume: 2800 start-page: 1 year: 2020 ident: ref_30 article-title: Quality characteristics of artificially intelligent systems publication-title: CEUR Workshop Proc. – volume: 48 start-page: 137 year: 2020 ident: ref_70 article-title: Explainable AI: From Black Box to Glass Box publication-title: J. Acad. Mark. Sci. doi: 10.1007/s11747-019-00710-5 – ident: ref_114 – ident: ref_4 – ident: ref_31 – ident: ref_56 – ident: ref_59 doi: 10.1145/3430524.3442704 – ident: ref_10 – volume: 94 start-page: 48 year: 2020 ident: ref_32 article-title: Software individual requirement quality model publication-title: Radioelectron. Comput. Syst. – ident: ref_13 doi: 10.6028/NIST.IR.8312 – ident: ref_93 doi: 10.1109/TBIOM.2021.3132237 – volume: 113 start-page: 103655 year: 2021 ident: ref_58 article-title: The role of explainability in creating trustworthy artificial intelligence for health care: A comprehensive survey of the terminology, design choices, and evaluation strategies publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2020.103655 – ident: ref_53 doi: 10.3390/e23010018 – volume: Volume 12896 start-page: 271 year: 2021 ident: ref_94 article-title: A systematic review of fairness in artificial intelligence algorithms publication-title: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics – volume: Volume 365 start-page: 391 year: 2015 ident: ref_121 article-title: Advanced security assurance case based on ISO/IEC 15408 publication-title: Advances in Intelligent Systems and Computing doi: 10.1007/978-3-319-19216-1_37 – volume: Volume 1 start-page: 5 year: 2019 ident: ref_76 article-title: Towards explainable artificial intelligence publication-title: Explainable AI: Interpreting, Explaining and Visualizing Deep Learning – ident: ref_109 doi: 10.3390/bdcc5020020 – ident: ref_97 – volume: 4 start-page: 139 year: 2020 ident: ref_123 article-title: Conception and application of dependable Internet of Things based systems publication-title: Radio Electron. Comput. Sci. Control doi: 10.15588/1607-3274-2020-4-14 – volume: 58 start-page: 82 year: 2020 ident: ref_38 article-title: Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI publication-title: Inf. Fusion doi: 10.1016/j.inffus.2019.12.012 – ident: ref_3 – volume: 146 start-page: 102551 year: 2020 ident: ref_51 article-title: The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AI publication-title: Int. J. Hum.-Comput. Stud. doi: 10.1016/j.ijhcs.2020.102551 – ident: ref_11 – volume: Volume 12279 start-page: 1 year: 2020 ident: ref_82 article-title: Explainable artificial intelligence: Concepts, applications, research challenges and visions publication-title: Machine Learning and Knowledge Extraction doi: 10.1007/978-3-030-57321-8_1 – ident: ref_67 – ident: ref_106 – volume: Volume 74 start-page: 3 year: 2017 ident: ref_108 article-title: Concepts of green IT engineering: Taxonomy, principles and implementation publication-title: Green IT Engineering: Concepts, Models, Complex Systems Architectures – ident: ref_35 doi: 10.3390/app11115088 – ident: ref_44 – ident: ref_16 doi: 10.6028/NIST.IR.8269-draft – volume: 39 start-page: 53 year: 2022 ident: ref_74 article-title: Explainable Artificial Intelligence: Objectives, Stakeholders, and Future Research Opportunities publication-title: Inf. Syst. Manag. doi: 10.1080/10580530.2020.1849465 – volume: 2 start-page: 1 year: 2022 ident: ref_115 article-title: Basic model of non-functional characteristics for assessment of artificial intelligence quality publication-title: Radioelectron. Comput. Syst. – ident: ref_6 – ident: ref_14 doi: 10.6028/NIST.IR.8367 – ident: ref_81 – ident: ref_33 – ident: ref_112 – volume: 35 start-page: 12 year: 2022 ident: ref_89 article-title: From Responsibility to Reason-Giving Explainable Artificial Intelligence publication-title: Philos. Technol. doi: 10.1007/s13347-022-00510-w – ident: ref_101 – ident: ref_87 doi: 10.18653/v1/W19-8403 – ident: ref_92 doi: 10.1007/978-3-030-51110-4 – ident: ref_19 – ident: ref_22 – ident: ref_95 – ident: ref_79 doi: 10.1145/3462757.3466145 – volume: Volume 8166 start-page: 17 year: 2013 ident: ref_122 article-title: Security-informed safety: If it’s not secure, it’s not safe publication-title: Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) – volume: 18 start-page: 50 year: 2020 ident: ref_49 article-title: The Case for Causal AI publication-title: Soc. Innov. Rev. – ident: ref_69 doi: 10.23919/MIPRO.2018.8400040 – ident: ref_5 – ident: ref_55 – ident: ref_113 – volume: 2 start-page: 277 year: 2022 ident: ref_60 article-title: Ethical funding for trustworthy AI: Proposals to address the responsibilities of funders to ensure that projects adhere to trustworthy AI practice publication-title: AI Ethics doi: 10.1007/s43681-021-00069-w – ident: ref_64 doi: 10.1007/978-3-030-72188-6 – ident: ref_52 doi: 10.1007/s11263-022-01657-x – ident: ref_104 – volume: 36 start-page: e5 year: 2021 ident: ref_78 article-title: Argumentation and explainable artificial intelligence: A survey publication-title: Knowl. Eng. Rev. doi: 10.1017/S0269888921000011 – ident: ref_34 doi: 10.2139/ssrn.3826358 – ident: ref_80 doi: 10.1109/EDOCW52865.2021.00036 – ident: ref_98 – ident: ref_23 doi: 10.3390/app12094130 – ident: ref_124 doi: 10.1007/s11219-021-09557-y – ident: ref_8 – volume: 3 start-page: 615 year: 2021 ident: ref_68 article-title: Classification of Explainable Artificial Intelligence Methods through Their Output Formats publication-title: Mach. Learn. Knowl. Extr. doi: 10.3390/make3030032 – volume: 26 start-page: 2749 year: 2020 ident: ref_62 article-title: In AI We Trust: Ethics, Artificial Intelligence, and Reliability publication-title: Sci. Eng. Ethics doi: 10.1007/s11948-020-00228-y – volume: Volume 404 start-page: 43 year: 2021 ident: ref_29 article-title: Software quality for AI: Where we are now? publication-title: Lecture Notes in Business Information Processing doi: 10.1007/978-3-030-65854-0_4 – volume: Volume 11839 start-page: 563 year: 2019 ident: ref_24 article-title: Explainable AI: A brief survey on history, research areas, approaches and challenges publication-title: Natural Language Processing and Chinese Computing doi: 10.1007/978-3-030-32236-6_51 – ident: ref_41 – ident: ref_66 – volume: 6 start-page: 52138 year: 2018 ident: ref_40 article-title: Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) publication-title: IEEE Access doi: 10.1109/ACCESS.2018.2870052 – volume: 10 start-page: 15 year: 2019 ident: ref_48 article-title: Engineering Bias in AI publication-title: IEEE Pulse doi: 10.1109/MPULS.2018.2885857 – ident: ref_107 – volume: 34 start-page: 193 year: 2020 ident: ref_65 article-title: Measuring the Quality of Explanations: The System Causability Scale (SCS) publication-title: KI—Künstliche Intell. doi: 10.1007/s13218-020-00636-z – ident: ref_117 doi: 10.3390/data4010004 – volume: Volume 286 start-page: 223 year: 2014 ident: ref_119 article-title: Evolution of software quality models in context of the standard ISO 25010 publication-title: Advances in Intelligent Systems and Computing doi: 10.1007/978-3-319-07013-1_21 – ident: ref_1 doi: 10.3390/app12031353 – ident: ref_72 – ident: ref_20 – ident: ref_15 doi: 10.6028/NIST.SP.1270 – volume: 9 start-page: e1312 year: 2019 ident: ref_50 article-title: Causability and Explainability of Artificial Intelligence in Medicine publication-title: WIREs Data Min. Knowl. Discov. doi: 10.1002/widm.1312 – volume: Volume 12034 start-page: 507 year: 2020 ident: ref_84 article-title: Exploration of explainable AI in context of human–machine interface for the assistive driving system publication-title: Intelligent Information and Database Systems – ident: ref_7 – volume: 1 start-page: 173 year: 2021 ident: ref_61 article-title: Management perspective of ethics in artificial intelligence publication-title: AI Ethics doi: 10.1007/s43681-020-00022-3 – volume: 41 start-page: 524 year: 2021 ident: ref_85 article-title: A survey of explainable artificial intelligence decision publication-title: Syst. Eng. Theory Pract. – volume: Volume 12721 start-page: 3 year: 2021 ident: ref_91 article-title: The myth of complete AI-fairness publication-title: Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics – volume: 1 start-page: 100050 year: 2020 ident: ref_110 article-title: When Autonomous Systems Meet Accuracy and Transferability through AI: A Survey publication-title: Patterns doi: 10.1016/j.patter.2020.100050 – ident: ref_103 doi: 10.1109/DSAA.2018.00018 – ident: ref_71 doi: 10.3390/app12094459 – ident: ref_37 – ident: ref_90 doi: 10.1145/3334480.3375059 – ident: ref_102 – ident: ref_18 – ident: ref_111 – ident: ref_96 – ident: ref_21 – ident: ref_116 – ident: ref_118 doi: 10.1109/EWDTS.2016.7807653 – ident: ref_28 doi: 10.1365/s40702-021-00821-0 – volume: 32 start-page: 4793 year: 2021 ident: ref_75 article-title: A Survey on Explainable Artificial Intelligence publication-title: IEEE Trans. Neural Netw. Learn. Syst. doi: 10.1109/TNNLS.2020.3027314 – ident: ref_54 – volume: 11 start-page: e1391 year: 2020 ident: ref_88 article-title: A historical perspective of explainable Artificial Intelligence publication-title: WIREs Data Min. Knowl. Discov. doi: 10.1002/widm.1391 – ident: ref_36 doi: 10.1145/3351095.3372834 – ident: ref_2 – ident: ref_12 – ident: ref_77 doi: 10.3390/app12031295 – ident: ref_45 doi: 10.3390/jrfm15040165 – ident: ref_83 doi: 10.1145/3292500.3332281 – volume: 5 start-page: 126 year: 2022 ident: ref_86 article-title: Metrics, Explainability and the European AI Act Proposal publication-title: J – ident: ref_43 – volume: 5 start-page: 34 year: 2021 ident: ref_46 article-title: Artificial intelligence: Explainability, ethical issues and bias publication-title: Ann. Robot. Autom. doi: 10.17352/ara.000011 – ident: ref_105 – ident: ref_57 – volume: Volume 12600 start-page: 13 year: 2021 ident: ref_25 article-title: Trustworthy AI publication-title: Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) – ident: ref_99
SSID	ssj0023338
Score	2.474062
Snippet	The factors complicating the specification of requirements for artificial intelligence systems (AIS) and their verification for the AIS creation and...
SourceID	doaj pubmedcentral proquest crossref
SourceType	Open Website Open Access Repository Aggregation Database Enrichment Source Index Database
StartPage	4865
SubjectTerms	Artificial intelligence characteristic ISO standards Principles Product quality quality quality model Quality standards Software quality
SummonAdditionalLinks	– databaseName: DOAJ Directory of Open Access Journals dbid: DOA link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrZ3LSx0xFIdDkS50Ia1WvNZKWly4aDCvyaM7FaXdSBcK7oY8UZBRvFeh_70nmbmXGSi4cTs5MDMnJ5PzmyTfQehQSppzoyRR1isCX79IjGWB6CaaAOkDy8HXYhP68tLc3Ni_o1JfZU9YjwfuHXccfGyE1zSbxsoYqXeRey4kdzRJVg9dc8h6lmJqkFoClFfPERIg6o_nvIDLTJlBRrNPhfRPMsvpvsjRRHPxCW0OGSI-6Z_sM_qQui20MeIGbqOuJ1_8w6WS2f0cQ-JZ7XsaBP4zwmziAUn-C59N0MzkFKaviE8GpPhPPNo9hF1XW5b_876g64vzq7PfZCicQAKouwVhzghKneIe5BBlGZyXGtDBkGxw7WyTmIiFa6-UDJxmx2RWIYLysjxqJ7TYQWvdQ5d2ES6rnkqDeU5OMms8jy4pDzY5WxHyDB0tHdqGgSpeilvct6Auiu_ble9n6MfK9LFHafzP6LT0ysqg0K_rBYiJdoiJ9q2YmKH9ZZ-2w5Cct1wZxYyRBu7xfdUMg6mskLguPTxXG1AbheczQ3oSC5MHmrZ0d7cVy225slqovfd4g69onZdzFlQRrvfR2uLpOX1DH8PL4m7-dFBj_RXlFgZ3 priority: 102 providerName: Directory of Open Access Journals
Title	Quality Models for Artificial Intelligence Systems: Characteristic-Based Approach, Development and Application
URI	https://www.proquest.com/docview/2686188485 https://www.proquest.com/docview/2687724185 https://pubmed.ncbi.nlm.nih.gov/PMC9269736 https://doaj.org/article/cbd53b70f8594dd0bad2b2342a0e4181
Volume	22
WOSCitedRecordID	wos000824024400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 1424-8220 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0023338 issn: 1424-8220 databaseCode: DOA dateStart: 20010101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 1424-8220 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0023338 issn: 1424-8220 databaseCode: M~E dateStart: 20010101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre – providerCode: PRVPQU databaseName: Health & Medical Collection customDbUrl: eissn: 1424-8220 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0023338 issn: 1424-8220 databaseCode: 7X7 dateStart: 20010101 isFulltext: true titleUrlDefault: https://search.proquest.com/healthcomplete providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 1424-8220 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0023338 issn: 1424-8220 databaseCode: BENPR dateStart: 20010101 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: Publicly Available Content Database customDbUrl: eissn: 1424-8220 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0023338 issn: 1424-8220 databaseCode: PIMPY dateStart: 20010101 isFulltext: true titleUrlDefault: http://search.proquest.com/publiccontent providerName: ProQuest
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpZ3Lb9QwEIdHdMsBDrwRgbIKiAMHrCa24wcX1K22ooeuVgik5RQ5dlwqVdl2s63Ehb8d2_GGREJcuORgjxRH48f8bOcbgHeUZtYWjCImK4bc7GeQkLlGvDBCu_Aht7oKySb4YiFWK7mMG25tvFa5mxPDRG3W2u-RH2ImWC4EFcWnq2vks0b509WYQmMP9j2pjE5gfzZfLL_0kos4BdbxhIgT94ct9gAz4VeSwSoUYP2jCHN8P3Kw4Jw8_N-mPoIHMdRMj7q-8Rju1M0TuD8AED6FpkNo_Ex9SrTLNnURbLDvsBLp6YDXmUa2-cf0eMR4RjO3Dpr0KLLJP6SDa0ipakLNbmPwGXw7mX89_oxiBgaknUzcolwJkmWK4crpqiy3mRV14QS1i1owV7Koc2I8IJ8xqnFmVU4t08ZJOIkNV4ST5zBp1k39AlJ_fMq4M7e1orkUFTaqZpWzsVYSbRN4v_NIqSOe3GfJuCydTPHOK3vnJfC2N73qmBx_M5p5t_YGHqMdCtab8zKOylJXpiAVd59VSGpMVimDK0woVllNXeyTwMHOw2Uc2235x70JvOmr3aj0Ry2qqdc3wcbJFg8GSoCPOtOoQeOa5uJH4HtLzCQn7OW_X_4K7mH_K0bGEOYHMNluburXcFffbi_azRT2-IqHp5jGQTEN-w3uefZr7sqWp2fL778BYVEbZA
linkProvider	ProQuest
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9QwEB6VLRJw4I0IFDAIJA5ETWzHsZEQagtVV21XeyhSOQXHjqFSlS2bLah_it_IOC8SCXHrgWs8SmLny8x8fnwD8JLzyLlE8FCoXITo_WwoVWzCNLHSYPoQO5PXxSbS2UweH6v5GvzqzsL4bZWdT6wdtV0YP0e-SYUUsZRcJu_Pvoe-apRfXe1KaDSw2C8ufiJlq95NP-D3fUXp7sejnb2wrSoQGqQ-qzDWkkWRFjRHrhDFLnKySJAkYiSmqVZJETPrRd-F4IZGTsfcCWORlihqU81Shve9AuscwS4nsD6fHs4_9xSPIeNr9IsYU9FmRb1gmvSRaxD16uIAo4x2vB9zEOB2b_1vQ3MbbrapNNlqsH8H1oryLtwYCCzeg7KRCLkgvuTbaUUwQ6_tG9kMMh3okZJWu_0t2RlpWIfbGOct2Wq119-QwTYrosu6pZv4vA-fLqXDD2BSLsriIRC_PCxSNHeF5rGSObW6EDnaOKeYcQG87hCQmVZ-3VcBOc2QhnmwZD1YAnjRm541miN_M9r2MOoNvEx4fWGx_Jq1XiczuU1YnmK3EsWtjXJtaU4ZpzoqOOZ2AWx0iMpa31Vlf-AUwPO-Gb2OX0rSZbE4r22QlnnhowDSEXhHLzRuKU--1frligqVMvHo3w9_Btf2jg4PsoPpbP8xXKf-2EkkQppuwGS1PC-ewFXzY3VSLZ-2PyGBL5cN7t9RZW60
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9QwEB6VFiE48EYEChgEEgeiTWzHsZEQ6oMVq8JqDyC1p-DYMVSqsmWzBfWv8esY50UiIW49cI1HSZx8npnPj28AnnMeOZcIHgqVixC9nw2lik2YJlYaTB9iZ_K62EQ6n8vDQ7XYgF_dWRi_rbLzibWjtkvj58gnVEgRS8llMnHttojF_vTt6ffQV5DyK61dOY0GIgfF-U-kb9Wb2T7-6xeUTt992nsfthUGQoM0aB3GWrIo0oLmyBui2EVOFgkSRozKNNUqKWJmvQC8ENzQyOmYO2EsUhRFbapZyvC-l2ALU3KOY2xrMfu4OOrpHkP212gZMaaiSUW9eJr0UWwQAetCAaPsdrw3cxDspjf-5890E663KTbZacbELdgoyttwbSC8eAfKRjrknPhScCcVwcy9tm_kNMhsoFNKWk3312RvpG0d7mL8t2Sn1WR_RQbbr4gu65ZuQvQufL6QDt-DzXJZFveB-GVjkaK5KzSPlcyp1YXI0cY5xYwL4GWHhsy0suy-OshJhvTMAyfrgRPAs970tNEi-ZvRrodUb-Dlw-sLy9XXrPVGmcltwvIUu5Uobm2Ua0tzyjjVUcEx5wtgu0NX1vq0KvsDrQCe9s3ojfwSky6L5Vltg3TNCyIFkI6APHqhcUt5_K3WNVdUqJSJB_9--BO4gojOPszmBw_hKvWnUSIR0nQbNters-IRXDY_1sfV6nE7Hgl8uWhs_wZDUnd0
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Quality+Models+for+Artificial+Intelligence+Systems%3A+Characteristic-Based+Approach%2C+Development+and+Application&rft.jtitle=Sensors+%28Basel%2C+Switzerland%29&rft.au=Kharchenko%2C+Vyacheslav&rft.au=Fesenko%2C+Herman&rft.au=Illiashenko%2C+Oleg&rft.date=2022-06-27&rft.issn=1424-8220&rft.eissn=1424-8220&rft.volume=22&rft.issue=13&rft.spage=4865&rft_id=info:doi/10.3390%2Fs22134865&rft.externalDBID=n%2Fa&rft.externalDocID=10_3390_s22134865
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1424-8220&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1424-8220&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1424-8220&client=summon