Recently, Jardas _et al_ have convincingly defended the patient preference predictor (PPP) against a range of autonomy-based objections. In this response, I propose a new autonomy-based objection to the PPP that is not explicitly discussed by Jardas _et al_. I call it the ‘objection from higher-order preferences’. Even if this objection is not sufficient reason to reject the PPP, the objection constitutes a pro tanto reason that is at least as powerful as the ones discussed by Jardas _et al._.

Background: Current practice relies on patient-designated and next-of-kin surrogates, in consultation with clinicians, to make treatment decisions for patients who lose the ability to make their own decisions. Yet there is a paucity of data on whether this approach is consistent with patients' preferences regarding who they want to make treatment decisions for them in the event of decisional incapacity. Methods: Self-administered survey of patients at a tertiary care center. Results: Overall, 1169 respondents completed the survey (response rate = 59.8%). (...) Of the 229 respondents who had previously designated a surrogate, 78.2% wanted their surrogate to make treatment decisions in the event of decisional incapacity, whereas 21.8% wanted their doctors to make treatment decisions. Of the 822 respondents who had not designated a surrogate, 66.1% wanted their family to make treatment decisions, whereas 33.9% wanted their doctors to make treatment decisions. The most common explanation provided for why respondents wanted their surrogate or family to make treatment decisions for them in the event of decisional incapacity was the belief that loved ones knew the patient's treatment preferences. Conclusions: Contrary to current practice, 33.9% of respondents who had not designated a surrogate and 21.8% of those who had designated a surrogate indicated that they wanted their doctors to make treatment decisions for them in the event of decisional incapacity. Moreover, many of those who wanted their surrogates or family members to make treatment decisions explained this preference by citing a belief that loved ones knew the patient's treatment preferences. This belief is undermined by prior research that suggests that surrogates and family members frequently are unable to predict which treatments their charges would want. Future research should assess these two concerns with current practice and, where necessary, identify approaches to address them. (shrink)

One recurring criticism of the best interests standard concerns its vagueness, and thus the inadequate guidance it offers to care providers. The lack of an agreed definition of ‘best interests’, together with the fact that several suggested considerations adopted in legislation or professional guidelines for doctors do not obviously apply across different groups of persons, result in decisions being made in murky waters. In response, bioethicists have attempted to specify the best interests standard, to reduce the indeterminacy surrounding medical decisions. (...) In this paper, we discuss the bioethicists’ response in relation to the state's possible role in clarifying the best interests standard. We identify and characterise two clarificatory strategies employed by bioethicists —elaborative and enumerative—and argue that the state should adopt the latter. Beyond the practical difficulties of the former strategy, a state adoption of it would inevitably be prejudicial in a pluralistic society. Given the gravity of best interests decisions, and the delicate task of respecting citizens with different understandings of best interests, only the enumerative strategy is viable. We argue that this does not commit the state to silence in providing guidance to and supporting healthcare providers, nor does it facilitate the abuse of the vulnerable. Finally, we address two methodological worries about adopting this approach at the state level. The adoption of the enumerative strategy is not defeatist in attitude, nor does it eventually collapse into (a form of) the elaborative strategy. (shrink)

The use of machine learning, or “artificial intelligence” (AI) in medicine is widespread and growing. In this paper, I focus on a specific proposed clinical application of AI: using models to predict incapacitated patients’ treatment preferences. Drawing on results from machine learning, I argue this proposal faces a special moral problem. Machine learning researchers owe us assurance on this front before experimental research can proceed. In my conclusion I connect this concern to broader issues in AI safety.

When making substituted judgments for incapacitated patients, surrogates often struggle to guess what the patient would want if they had capacity. Surrogates may also agonize over having the (sole) responsibility of making such a determination. To address such concerns, a Patient Preference Predictor (PPP) has been proposed that would use an algorithm to infer the treatment preferences of individual patients from population-level data about the known preferences of people with similar demographic characteristics. However, critics have suggested that even if such (...) a PPP were more accurate, on average, than human surrogates in identifying patient preferences, the proposed algorithm would nevertheless fail to respect the patient’s (former) autonomy since it draws on the ‘wrong’ kind of data: namely, data that are not specific to the individual patient and which therefore may not reflect their actual values, or their reasons for having the preferences they do. Taking such criticisms on board, we here propose a new approach: the Personalized Patient Preference Predictor (P4). The P4 is based on recent advances in machine learning, which allow technologies including large language models to be more cheaply and efficiently ‘fine-tuned’ on person-specific data. The P4, unlike the PPP, would be able to infer an individual patient’s preferences from material (e.g., prior treatment decisions) that is in fact specific to them. Thus, we argue, in addition to being potentially more accurate at the individual level than the previously proposed PPP, the predictions of a P4 would also more directly reflect each patient’s own reasons and values. In this article, we review recent discoveries in artificial intelligence research that suggest a P4 is technically feasible, and argue that, if it is developed and appropriately deployed, it should assuage some of the main autonomy-based concerns of critics of the original PPP. We then consider various objections to our proposal and offer some tentative replies. (shrink)

Artificial intelligence (AI) systems are quickly gaining ground in healthcare and clinical decision-making. However, it is still unclear in what way AI can or should support decision-making that is based on incapacitated patients’ values and goals of care, which often requires input from clinicians and loved ones. Although the use of algorithms to predict patients’ most likely preferred treatment has been discussed in the medical ethics literature, no example has been realised in clinical practice. This is due, arguably, to the (...) lack of a structured approach to the epistemological, ethical and pragmatic challenges arising from the design and use of such algorithms. The present paper offers a new perspective on the problem by suggesting that preference predicting AIs be viewed as sociotechnical systems with distinctive life-cycles. We explore how both known and novel challenges map onto the different stages of development, highlighting interdisciplinary strategies for their resolution. (shrink)

Background: Current practice frequently fails to provide care consistent with the preferences of decisionally-incapacitated patients. It also imposes significant emotional burden on their surrogates. Algorithmic-based patient preference predictors (PPPs) have been proposed as a possible way to address these two concerns. While previous research found that patients strongly support the use of PPPs, the views of surrogates are unknown. The present study thus assessed the views of experienced surrogates regarding the possible use of PPPs as a means to help make (...) treatment decisions for decisionally-incapacitated patients. -/- Methods: This qualitative study used semi-structured interviews to determine the views of experienced surrogates [n=26] who were identified from two academic medical centers and two community hospitals. The primary outcomes were respondents’ overall level of support for the idea of using PPPs and the themes related to their views on how a PPP should be used, if at all, in practice. -/- Results: Overall, 21 participants supported the idea of using PPPs. The remaining five indicated that they would not use a PPP because they made decisions based on the patient’s best interests, not based on substituted judgment. Major themes which emerged were that surrogates, not the patient’s preferences, should determine how treatment decisions are made, and concern that PPPs might be used to deny expensive care or be biased against minority groups. -/- Conclusions: Surrogates, like patients, strongly support the idea of using PPPs to help make treatment decisions for decisionally-incapacitated patients. These findings provide support for developing a PPP and assessing it in practice. At the same time, patients and surrogates disagree over whose preferences should determine how treatment decisions are made, including whether to use a PPP. These findings reveal a fundamental disagreement regarding the guiding principles for surrogate decision-making. Future research is needed to assess this disagreement and consider ways to address it. (shrink)

The patient preference predictor is a proposed computer-based algorithm that would predict the treatment preferences of decisionally incapacitated patients. Incorporation of a PPP into the decision-making process has the potential to improve implementation of the substituted judgement standard by providing more accurate predictions of patients’ treatment preferences than reliance on surrogates alone. Yet, critics argue that methods for making treatment decisions for incapacitated patients should be judged on a number of factors beyond simply providing them with the treatments they would (...) have chosen for themselves. These factors include the extent to which the decision-making process recognises patients’ freedom to choose and relies on evidence the patient themselves would take into account when making treatment decisions. These critics conclude that use of a PPP should be rejected on the grounds that it is inconsistent with these factors, especially as they relate to proper respect for patient autonomy. In this paper, we review and evaluate these criticisms. We argue that they do not provide reason to reject use of a PPP, thus supporting efforts to develop a full-scale PPP and to evaluate it in practice. There are no data in this work. (shrink)

The increasing accuracy of algorithms to predict values and preferences raises the possibility that artificial intelligence technology will be able to serve as a surrogate decision-maker for incapacitated patients. Following Camillo Lamanna and Lauren Byrne, we call this technology the autonomy algorithm. Such an algorithm would mine medical research, health records, and social media data to predict patient treatment preferences. The possibility of developing the AA raises the ethical question of whether the AA or a relative ought to serve as (...) surrogate decision-maker in cases where the patient has not issued a medical power of attorney. We argue that in such cases, and against the standard practice of vesting familial surrogates with decision making authority, the AA should have sole decision-making authority. This is because the AA will likely be better at predicting what treatment option the patient would have chosen. It would also be better at avoiding bias and, therefore, choosing in a more patient-centered manner. Furthermore, we argue that these considerations override any moral weight of the patient’s special relationship with their relatives. (shrink)

Since surrogates are not good at predicting patient preferences, and since these decisions can cause surrogates distress, some have claimed we need an alternative way to make decisions for incapaci...

The administration of pro re nata medications is the responsibility of the nurse. However, ethical uncertainties often happen due to the inability of incapacitated patients to collaborate with the nurse in the process of decision making for pro re nata medication administration. There is a lack of integrative knowledge and insufficient understanding regarding ethical considerations surrounding the administration of pro re nata medications to incapacitated patients. Therefore, they have been discussed in this paper and practical strategies to avoid unethical practices (...) have been suggested. The complicated caring situation surrounding the administration of pro re nata medications is intertwined with ethical issues affecting the consideration of the patient's wishes and interventions that override them. The patient's right of autonomy and treatment refusal, surrogacy role, paternalism, and coercion are the main ethos of ethical pro re nata medication administration. Education and training can help nurses avoid legal and ethical issues in pro re nata medicines management and improve the quality and safety of healthcare. Empirical research is needed to improve our understanding of this phenomenon in the multidisciplinary environment of medicines management. (shrink)

Background Artificial intelligence (AI) has revolutionized various healthcare domains, where AI algorithms sometimes even outperform human specialists. However, the field of clinical ethics has remained largely untouched by AI advances. This study explores the attitudes of anesthesiologists and internists towards the use of AI-driven preference prediction tools to support ethical decision-making for incapacitated patients. Methods A questionnaire was developed and pretested among medical students. The questionnaire was distributed to 200 German anesthesiologists and 200 German internists, thereby focusing on physicians who (...) often encounter patients lacking decision-making capacity. The questionnaire covered attitudes toward AI-driven preference prediction, availability and utilization of Clinical Ethics Support Services (CESS), and experiences with ethically challenging situations. Descriptive statistics and bivariate analysis was performed. Qualitative responses were analyzed using content analysis in a mixed inductive-deductive approach. Results Participants were predominantly male (69.3%), with ages ranging from 27 to 77. Most worked in nonacademic hospitals (82%). Physicians generally showed hesitance toward AI-driven preference prediction, citing concerns about the loss of individuality and humanity, lack of explicability in AI results, and doubts about AI’s ability to encompass the ethical deliberation process. In contrast, physicians had a more positive opinion of CESS. Availability of CESS varied, with 81.8% of participants reporting access. Among those without access, 91.8% expressed a desire for CESS. Physicians' reluctance toward AI-driven preference prediction aligns with concerns about transparency, individuality, and human-machine interaction. While AI could enhance the accuracy of predictions and reduce surrogate burden, concerns about potential biases, de-humanisation, and lack of explicability persist. Conclusions German physicians frequently encountering incapacitated patients exhibit hesitance toward AI-driven preference prediction but hold a higher esteem for CESS. Addressing concerns about individuality, explicability, and human-machine roles may facilitate the acceptance of AI in clinical ethics. Further research into patient and surrogate perspectives is needed to ensure AI aligns with patient preferences and values in complex medical decisions. (shrink)