Clinical Explainability Failure (CEF) & Explainability Failure Ratio (EFR) – Changing the Way We Validate Classification Algorithms

Adoption of Artificial Intelligence (AI) algorithms into the clinical realm will depend on their inherent trustworthiness, which is built not only by robust validation studies but is also deeply linked to the explainability and interpretability of the algorithms. Most validation studies for medical...

Full description

Saved in:
Bibliographic Details
Published in:Journal of medical systems Vol. 46; no. 4; p. 20
Main Authors: Venugopal, Vasantha Kumar, Takhar, Rohit, Gupta, Salil, Mahajan, Vidur
Format: Journal Article
Language:English
Published: New York Springer US 01.04.2022
Springer Nature B.V
Subjects:
Algorithms
Artificial Intelligence
Chest
Classification
Consolidation
Deep learning
Diagnostic Imaging
Failure
Health Informatics
Health Sciences
Humans
Image & Signal Processing
Medical imaging
Medicine
Medicine & Public Health
Radiography
Statistical analysis
Statistics for Life Sciences
Trustworthiness
Validation studies
X-rays
Deep learning
Medical imaging
Explainable AI
AI (Artificial Intelligence)
ISSN:0148-5598, 1573-689X, 1573-689X
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Adoption of Artificial Intelligence (AI) algorithms into the clinical realm will depend on their inherent trustworthiness, which is built not only by robust validation studies but is also deeply linked to the explainability and interpretability of the algorithms. Most validation studies for medical imaging AI report the performance of algorithms on study-level labels and lay little emphasis on measuring the accuracy of explanations generated by these algorithms in the form of heat maps or bounding boxes, especially in true positive cases. We propose a new metric – Explainability Failure Ratio (EFR) – derived from Clinical Explainability Failure (CEF) to address this gap in AI evaluation. We define an Explainability Failure as a case where the classification generated by an AI algorithm matches with study-level ground truth but the explanation output generated by the algorithm is inadequate to explain the algorithm's output. We measured EFR for two algorithms that automatically detect consolidation on chest X-rays to determine the applicability of the metric and observed a lower EFR for the model that had lower sensitivity for identifying consolidation on chest X-rays, implying that the trustworthiness of a model should be determined not only by routine statistical metrics but also by novel ‘clinically-oriented’ models.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:0148-5598
1573-689X
1573-689X
DOI:10.1007/s10916-022-01806-2