The Virtues of Interpretable Medical AI

Artificial intelligence (AI) systems have demonstrated impressive performance across a variety of clinical tasks. However, notoriously, sometimes these systems are "black boxes." The initial response in the literature was a demand for "explainable AI." However, recently, several...

Full description

Saved in:  
Bibliographic Details
Authors: Hatherley, Joshua (Author) ; Sparrow, Robert (Author) ; Howard, Mark 1971- (Author)
Format: Electronic Article
Language:English
Check availability: HBZ Gateway
Interlibrary Loan:Interlibrary Loan for the Fachinformationsdienste (Specialized Information Services in Germany)
Published: 2024
In: Cambridge quarterly of healthcare ethics
Year: 2024, Volume: 33, Issue: 3, Pages: 323-332
Further subjects:B Medicine
B deep learning
B Ethics
B artificial intelligence (AI)
B Healthcare
B explainable AI
B black box
Online Access: Volltext (kostenfrei)
Volltext (kostenfrei)
Description
Summary:Artificial intelligence (AI) systems have demonstrated impressive performance across a variety of clinical tasks. However, notoriously, sometimes these systems are "black boxes." The initial response in the literature was a demand for "explainable AI." However, recently, several authors have suggested that making AI more explainable or "interpretable" is likely to be at the cost of the accuracy of these systems and that prioritizing interpretability in medical AI may constitute a "lethal prejudice." In this paper, we defend the value of interpretability in the context of the use of AI in medicine. Clinicians may prefer interpretable systems over more accurate black boxes, which in turn is sufficient to give designers of AI reason to prefer more interpretable systems in order to ensure that AI is adopted and its benefits realized. Moreover, clinicians may be justified in this preference. Achieving the downstream benefits from AI is critically dependent on how the outputs of these systems are interpreted by physicians and patients. A preference for the use of highly accurate black box AI systems, over less accurate but more interpretable systems, may itself constitute a form of lethal prejudice that may diminish the benefits of AI to—and perhaps even harm—patients.
ISSN:1469-2147
Contains:Enthalten in: Cambridge quarterly of healthcare ethics
Persistent identifiers:DOI: 10.1017/S0963180122000664