Primer on an ethics of AI-based decision support systems in the clinic

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Matthias Braun
  • Patrik Hummel
  • Susanne Beck
  • Peter Dabrock

Research Organisations

External Research Organisations

  • Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU Erlangen-Nürnberg)
View graph of relations

Details

Original languageEnglish
Article number105860
Number of pages8
JournalJournal of medical ethics
Volume47
Issue numbere3
Early online date3 Apr 2020
Publication statusPublished - 29 Nov 2021

Abstract

Making good decisions in extremely complex and difficult processes and situations has always been both a key task as well as a challenge in the clinic and has led to a large amount of clinical, legal and ethical routines, protocols and reflections in order to guarantee fair, participatory and up-to-date pathways for clinical decision-making. Nevertheless, the complexity of processes and physical phenomena, time as well as economic constraints and not least further endeavours as well as achievements in medicine and healthcare continuously raise the need to evaluate and to improve clinical decision-making. This article scrutinises if and how clinical decision-making processes are challenged by the rise of so-called artificial intelligence-driven decision support systems (AI-DSS). In a first step, this article analyses how the rise of AI-DSS will affect and transform the modes of interaction between different agents in the clinic. In a second step, we point out how these changing modes of interaction also imply shifts in the conditions of trustworthiness, epistemic challenges regarding transparency, the underlying normative concepts of agency and its embedding into concrete contexts of deployment and, finally, the consequences for (possible) ascriptions of responsibility. Third, we draw first conclusions for further steps regarding a 'meaningful human control' of clinical AI-DSS.

Keywords

    decision-making, ethics

ASJC Scopus subject areas

Sustainable Development Goals

Cite this

Primer on an ethics of AI-based decision support systems in the clinic. / Braun, Matthias; Hummel, Patrik; Beck, Susanne et al.
In: Journal of medical ethics, Vol. 47, No. e3, 105860, 29.11.2021.

Research output: Contribution to journalArticleResearchpeer review

Braun M, Hummel P, Beck S, Dabrock P. Primer on an ethics of AI-based decision support systems in the clinic. Journal of medical ethics. 2021 Nov 29;47(e3):105860. Epub 2020 Apr 3. doi: 10.1136/medethics-2019-105860
Braun, Matthias ; Hummel, Patrik ; Beck, Susanne et al. / Primer on an ethics of AI-based decision support systems in the clinic. In: Journal of medical ethics. 2021 ; Vol. 47, No. e3.
Download
@article{69b96facac914c0eacbb34cc555032f4,
title = "Primer on an ethics of AI-based decision support systems in the clinic",
abstract = "Making good decisions in extremely complex and difficult processes and situations has always been both a key task as well as a challenge in the clinic and has led to a large amount of clinical, legal and ethical routines, protocols and reflections in order to guarantee fair, participatory and up-to-date pathways for clinical decision-making. Nevertheless, the complexity of processes and physical phenomena, time as well as economic constraints and not least further endeavours as well as achievements in medicine and healthcare continuously raise the need to evaluate and to improve clinical decision-making. This article scrutinises if and how clinical decision-making processes are challenged by the rise of so-called artificial intelligence-driven decision support systems (AI-DSS). In a first step, this article analyses how the rise of AI-DSS will affect and transform the modes of interaction between different agents in the clinic. In a second step, we point out how these changing modes of interaction also imply shifts in the conditions of trustworthiness, epistemic challenges regarding transparency, the underlying normative concepts of agency and its embedding into concrete contexts of deployment and, finally, the consequences for (possible) ascriptions of responsibility. Third, we draw first conclusions for further steps regarding a 'meaningful human control' of clinical AI-DSS.",
keywords = "decision-making, ethics",
author = "Matthias Braun and Patrik Hummel and Susanne Beck and Peter Dabrock",
note = "Funding Information: funding This work is part of the research project DABIGO (ZMV/1–2517 FSB 013), which has been funded by the German Ministry for Health, as well as the research project vALID (01GP1903A), which has been funded by the German Ministry of Education and Research.",
year = "2021",
month = nov,
day = "29",
doi = "10.1136/medethics-2019-105860",
language = "English",
volume = "47",
journal = "Journal of medical ethics",
issn = "0306-6800",
publisher = "BMJ Publishing Group",
number = "e3",

}

Download

TY - JOUR

T1 - Primer on an ethics of AI-based decision support systems in the clinic

AU - Braun, Matthias

AU - Hummel, Patrik

AU - Beck, Susanne

AU - Dabrock, Peter

N1 - Funding Information: funding This work is part of the research project DABIGO (ZMV/1–2517 FSB 013), which has been funded by the German Ministry for Health, as well as the research project vALID (01GP1903A), which has been funded by the German Ministry of Education and Research.

PY - 2021/11/29

Y1 - 2021/11/29

N2 - Making good decisions in extremely complex and difficult processes and situations has always been both a key task as well as a challenge in the clinic and has led to a large amount of clinical, legal and ethical routines, protocols and reflections in order to guarantee fair, participatory and up-to-date pathways for clinical decision-making. Nevertheless, the complexity of processes and physical phenomena, time as well as economic constraints and not least further endeavours as well as achievements in medicine and healthcare continuously raise the need to evaluate and to improve clinical decision-making. This article scrutinises if and how clinical decision-making processes are challenged by the rise of so-called artificial intelligence-driven decision support systems (AI-DSS). In a first step, this article analyses how the rise of AI-DSS will affect and transform the modes of interaction between different agents in the clinic. In a second step, we point out how these changing modes of interaction also imply shifts in the conditions of trustworthiness, epistemic challenges regarding transparency, the underlying normative concepts of agency and its embedding into concrete contexts of deployment and, finally, the consequences for (possible) ascriptions of responsibility. Third, we draw first conclusions for further steps regarding a 'meaningful human control' of clinical AI-DSS.

AB - Making good decisions in extremely complex and difficult processes and situations has always been both a key task as well as a challenge in the clinic and has led to a large amount of clinical, legal and ethical routines, protocols and reflections in order to guarantee fair, participatory and up-to-date pathways for clinical decision-making. Nevertheless, the complexity of processes and physical phenomena, time as well as economic constraints and not least further endeavours as well as achievements in medicine and healthcare continuously raise the need to evaluate and to improve clinical decision-making. This article scrutinises if and how clinical decision-making processes are challenged by the rise of so-called artificial intelligence-driven decision support systems (AI-DSS). In a first step, this article analyses how the rise of AI-DSS will affect and transform the modes of interaction between different agents in the clinic. In a second step, we point out how these changing modes of interaction also imply shifts in the conditions of trustworthiness, epistemic challenges regarding transparency, the underlying normative concepts of agency and its embedding into concrete contexts of deployment and, finally, the consequences for (possible) ascriptions of responsibility. Third, we draw first conclusions for further steps regarding a 'meaningful human control' of clinical AI-DSS.

KW - decision-making

KW - ethics

UR - http://www.scopus.com/inward/record.url?scp=85083239338&partnerID=8YFLogxK

U2 - 10.1136/medethics-2019-105860

DO - 10.1136/medethics-2019-105860

M3 - Article

AN - SCOPUS:85083239338

VL - 47

JO - Journal of medical ethics

JF - Journal of medical ethics

SN - 0306-6800

IS - e3

M1 - 105860

ER -