Coming to Terms with the Black Box Problem: How to Justify AI Systems in Health Care
The use of opaque, uninterpretable artificial intelligence systems in health care can be medically beneficial, but it is often viewed as potentially morally problematic on account of this opacity—because the systems are black boxes. Alex John London has recently argued that opacity is not generally...
| Main Author: | |
|---|---|
| Format: | Electronic Article |
| Language: | English |
| Check availability: | HBZ Gateway |
| Journals Online & Print: | Drawer...
|
| Fernleihe: | Fernleihe für die Fachinformationsdienste |
| Published: |
Wiley
2021
|
| In: |
The Hastings Center report
Year: 2021, Volume: 51, Issue: 4, Pages: 38-45 |
| Further subjects: | B
statistical validation
B black box problem B Theoretical Explanation B Artificial Intelligence B Accountability B AI in health care B Opacity B Trust B clinical ethics |
| Online Access: |
Volltext (lizenzpflichtig) Volltext (lizenzpflichtig) |
| Summary: | The use of opaque, uninterpretable artificial intelligence systems in health care can be medically beneficial, but it is often viewed as potentially morally problematic on account of this opacity—because the systems are black boxes. Alex John London has recently argued that opacity is not generally problematic, given that many standard therapies are explanatorily opaque and that we can rely on statistical validation of the systems in deciding whether to implement them. But is statistical validation sufficient to justify implementation of these AI systems in health care, or is it merely one of the necessary criteria? I argue that accountability, which holds an important role in preserving the patient-physician trust that allows the institution of medicine to function, contributes further to an account of AI system justification. Hence, I endorse the vanishing accountability principle: accountability in medicine, in addition to statistical validation, must be preserved. AI systems that introduce problematic gaps in accountability should not be implemented. |
|---|---|
| ISSN: | 1552-146X |
| Contains: | Enthalten in: Hastings Center, The Hastings Center report
|
| Persistent identifiers: | DOI: 10.1002/hast.1248 |