Coming to Terms with the Black Box Problem: How to Justify AI Systems in Health Care

The use of opaque, uninterpretable artificial intelligence systems in health care can be medically beneficial, but it is often viewed as potentially morally problematic on account of this opacity—because the systems are black boxes. Alex John London has recently argued that opacity is not generally...

Descripción completa

Guardado en:  
Detalles Bibliográficos
Autor principal: Felder, Ryan Marshall (Autor)
Tipo de documento: Electrónico Artículo
Lenguaje:Inglés
Verificar disponibilidad: HBZ Gateway
Interlibrary Loan:Interlibrary Loan for the Fachinformationsdienste (Specialized Information Services in Germany)
Publicado: 2021
En: The Hastings Center report
Año: 2021, Volumen: 51, Número: 4, Páginas: 38-45
Otras palabras clave:B statistical validation
B black box problem
B Theoretical Explanation
B Artificial Intelligence
B Accountability
B AI in health care
B Opacity
B Trust
B clinical ethics
Acceso en línea: Volltext (lizenzpflichtig)
Volltext (lizenzpflichtig)
Descripción
Sumario:The use of opaque, uninterpretable artificial intelligence systems in health care can be medically beneficial, but it is often viewed as potentially morally problematic on account of this opacity—because the systems are black boxes. Alex John London has recently argued that opacity is not generally problematic, given that many standard therapies are explanatorily opaque and that we can rely on statistical validation of the systems in deciding whether to implement them. But is statistical validation sufficient to justify implementation of these AI systems in health care, or is it merely one of the necessary criteria? I argue that accountability, which holds an important role in preserving the patient-physician trust that allows the institution of medicine to function, contributes further to an account of AI system justification. Hence, I endorse the vanishing accountability principle: accountability in medicine, in addition to statistical validation, must be preserved. AI systems that introduce problematic gaps in accountability should not be implemented.
ISSN:1552-146X
Obras secundarias:Enthalten in: Hastings Center, The Hastings Center report
Persistent identifiers:DOI: 10.1002/hast.1248