This paper delves into the use of machine learning-based systems in decision-making processes and its implications for moral responsibility as traditionally defined. It focuses on the emergence of responsibility gaps and examines proposed strategies to address them. The paper aims to provide an introductory and comprehensive overview of the ongoing debate surrounding moral responsibility in automated decision-making. By thoroughly examining these issues, we seek to contribute to a deeper understanding of the implications of AI integration in society.

Important decisions that impact humans lives, livelihoods, and the natural environment are increasingly being automated. Delegating tasks to so-called automated decision-making systems can improve efficiency and enable new solutions. However, these benefits are coupled with ethical challenges. For example, ADMS may produce discriminatory outcomes, violate individual privacy, and undermine human self-determination. New governance mechanisms are thus needed that help organisations design and deploy ADMS in ways that are ethical, while enabling society to reap the full economic and (...) social benefits of automation. In this article, we consider the feasibility and efficacy of ethics-based auditing as a governance mechanism that allows organisations to validate claims made about their ADMS. Building on previous work, we define EBA as a structured process whereby an entity’s present or past behaviour is assessed for consistency with relevant principles or norms. We then offer three contributions to the existing literature. First, we provide a theoretical explanation of how EBA can contribute to good governance by promoting procedural regularity and transparency. Second, we propose seven criteria for how to design and implement EBA procedures successfully. Third, we identify and discuss the conceptual, technical, social, economic, organisational, and institutional constraints associated with EBA. We conclude that EBA should be considered an integral component of multifaced approaches to managing the ethical risks posed by ADMS. (shrink)

Automated decision making for sentencing is the use of a software algorithm to analyse a convicted offender’s case and deliver a sentence. This chapter reviews the moral arguments for and against employing automated decision making for sentencing and finds that its use is in principle morally permissible. Specifically, it argues that well-designed automated decision making for sentencing will better approximate the just sentence than human sentencers. Moreover, it dismisses common concerns about transparency, privacy and (...) bias as unpersuasive or inapplicable. The chapter also notes that moral disagreement about theories of just sentencing are plausibly resolved by applying the principle of maximising expected moral choiceworthiness, and that automated decision making is better suited to the resulting ensemble model. Finally, the chapter considers the challenge posed by penal populism. The dispiriting conclusion is that although it is in theory morally desirable to use automated decision-making for criminal sentencing, it may well be the case that we ought not to try. (shrink)

Since approval of the EU General Data Protection Regulation (GDPR) in 2016, it has been widely and repeatedly claimed that the GDPR will legally mandate a ‘right to explanation’ of all decisions made by automated or artificially intelligent algorithmic systems. This right to explanation is viewed as an ideal mechanism to enhance the accountability and transparency of automated decision-making. However, there are several reasons to doubt both the legal existence and the feasibility of such a right. In (...) contrast to the right to explanation of specific automated decisions claimed elsewhere, the GDPR only mandates that data subjects receive meaningful, but properly limited, information (Articles 13-15) about the logic involved, as well as the significance and the envisaged consequences of automated decision-making systems, what we term a ‘right to be informed’. Further, the ambiguity and limited scope of the ‘right not to be subject to automated decision-making’ contained in Article 22 (from which the alleged ‘right to explanation’ stems) raises questions over the protection actually afforded to data subjects. These problems show that the GDPR lacks precise language as well as explicit and well-defined rights and safeguards against automated decision-making, and therefore runs the risk of being toothless. We propose a number of legislative and policy steps that, if taken, may improve the transparency and accountability of automated decision-making when the GDPR comes into force in 2018. (shrink)

The era of AI-based decision-making fast approaches, and anxiety is mounting about when, and why, we should keep “humans in the loop” (“HITL”). Thus far, commentary has focused primarily on two questions: whether, and when, keeping humans involved will improve the results of decision-making (making them safer or more accurate), and whether, and when, non-accuracy-related values—legitimacy, dignity, and so forth—are vindicated by the inclusion of humans in decision-making. Here, we take up a related but distinct question, which (...) has eluded the scholarship thus far: does it matter if humans appear to be in the loop of decision-making, independent from whether they actually are? In other words, what is stake in the disjunction between whether humans in fact have ultimate authority over decision-making versus whether humans merely seem, from the outside, to have such authority? Our argument proceeds in four parts. First, we build our formal model, enriching the HITL question to include not only whether humans are actually in the loop of decision-making, but also whether they appear to be so. Second, we describe situations in which the actuality and appearance of HITL align: those that seem to involve human judgment and actually do, and those that seem automated and actually are. Third, we explore instances of misalignment: situations in which systems that seem to involve human judgment actually do not, and situations in which systems that hold themselves out as automated actually rely on humans operating “behind the curtain.” Fourth, we examine the normative issues that result from HITL misalignment, arguing that it challenges individual decision-making about automated systems and complicates collective governance of automation. (shrink)

Computers are used to make decisions in an increasing number of domains. There is widespread agreement that some of these uses are ethically problematic. Far less clear is where ethical problems arise, and what might be done about them. This paper expands and defends the Ethical Gravity Thesis: ethical problems that arise at higher levels of analysis of an automated decision-making system are inherited by lower levels of analysis. Particular instantiations of systems can add new problems, but not (...) ameliorate more general ones. We defend this thesis by adapting Marr’s famous 1982 framework for understanding information-processing systems. We show how this framework allows one to situate ethical problems at the appropriate level of abstraction, which in turn can be used to target appropriate interventions. (shrink)

The ongoing explosion of interest in artificial intelligence is fueled in part by recently developed techniques in machine learning. Those techniques allow automated systems to process huge amounts of data, utilizing mathematical methods that depart from traditional statistical approaches, and resulting in impressive advancements in our ability to make predictions and uncover correlations across a host of interesting domains. But as is now widely discussed, the way that those systems arrive at their outputs is often opaque, even to the (...) experts who design and deploy them. Is it morally problematic to make use of opaque automated methods when making high-stakes decisions, like whether to issue a loan to an applicant, or whether to approve a parole request? Many scholars answer in the affirmative. However, there is no widely accepted explanation for why transparent systems are morally preferable to opaque systems. We argue that the use of automated decision-making systems sometimes violates duties of consideration that are owed by decision-makers to decision-subjects, duties that are both epistemic and practical in character. Violations of that kind generate a weighty consideration against the use of opaque decision systems. In the course of defending our approach, we show that it is able to address three major challenges sometimes leveled against attempts to defend the moral import of transparency in automated decision-making. (shrink)

One recent priority of the U.S. government is developing autonomous robotic systems. The U.S. Army has funded research to design a metric of evil to support military commanders with ethical decision-making and, in the future, allow robotic military systems to make autonomous ethical judgments. We use this particular project as a case study for efforts that seek to frame morality in quantitative terms. We report preliminary results from this research, describing the assumptions and limitations of a program that assesses (...) the relative evil of two courses of action. We compare this program to other attempts to simulate ethical decision-making, assess possibilities for overcoming the trade-off between input simplification and output reliability, and discuss the responsibilities of users and designers in implementing such programs. We conclude by discussing the implications that this project highlights for the successes and challenges of developing automated mechanisms for ethical decision making. (shrink)

Many seem to think that AI-induced responsibility gaps are morally bad and therefore ought to be avoided. We argue, by contrast, that there is at least a pro tanto reason to welcome responsibility gaps. The central reason is that it can be bad for people to be responsible for wrongdoing. This, we argue, gives us one reason to prefer automated decision-making over human decision-making, especially in contexts where the risks of wrongdoing are high. While we are not (...) the first to suggest that responsibility gaps should sometimes be welcomed, our argument is novel. Others have argued that responsibility gaps should sometimes be welcomed because they can reduce or eliminate the psychological burdens caused by tragic moral choice-situations. By contrast, our argument explains why responsibility gaps should sometimes be welcomed even in the absence of tragic moral choice-situations, and even in the absence of psychological burdens. (shrink)

Enterprise resource planning (ERP) has a significant impact on modern businesses by enhancing productivity, automation, and streamlining of business processes, even accounting. Manufacturers can assure proper functioning and timely client demand using ERP software. Coordination, procurement control, inventory control, and dispatch of commodities are all features of supply chain management.

Existing discussions about automated decision-making focus primarily on its inputs and outputs, raising questions about data collection and privacy on one hand and accuracy and fairness on the other. Less attention has been devoted to critically examining the temporality of decision-making processes—the speed at which automated decisions are reached. In this paper, I identify four dimensions of algorithmic speed that merit closer analysis. Duration (how much time it takes to reach a judgment), timing (when automated (...) systems intervene in the activity being evaluated), frequency (how often evaluations are performed), and lived time (the human experience of algorithmic speed) are interrelated, but distinct, features of automated decision-making. Choices about the temporal structure of automated decision-making systems have normative implications, which I describe in terms of "disruption," "displacement," "re-calibration," and "temporal fairness," with values such as accuracy, fairness, accountability, and legitimacy hanging in the balance. As computational tools are increasingly tasked with making judgments about human activities and practices, the designers of decision-making systems will have to reckon, I argue, with when—and how fast—judgments ought to be rendered. Though computers are capable of reaching decisions at incredible speeds, failing to account for the temporality of automated decision-making risks misapprehending the costs and benefits automation promises. (shrink)

The mental health crisis and loneliness epidemic have sparked a growing interest in leveraging artificial intelligence (AI) and chatbots as a potential solution. This report examines the benefits and risks of incorporating chatbots in mental health treatment. AI is used for mental health diagnosis and treatment decision-making and to train therapists on virtual patients. Chatbots are employed as always-available intermediaries with therapists, flagging symptoms for human intervention. But chatbots are also sold as stand-alone virtual therapists or as friends and (...) lovers. There is evidence that these uses of AI and chatbots can provide better quality service, improve accessibility, and lower costs. The systems can reduce the stigma and shame of sharing their problems and leverage a mass of biometric and behavioral data to supplement self-reports. As the systems' intelligence rapidly improves, they will need to be rigorously tested for the accuracy and precision of their diagnoses and the quality of their interactions with patients. As chatbots become indistinguishable from humans and leverage their superhuman capacity to detect affect and draw on knowledge of a patient’s life, patients will be drawn to attribute personality to and relationship with the chatbot. Consequently, it will be essential to study what the “therapeutic alliance” with an actual human counselor provides and the risks of patients attributing such a relationship to a one-sided or “parasocial” relationship. (shrink)

While Autonomous Weapons Systems have obvious military advantages, there are prima facie moral objections to using them. By way of general reply to these objections, I point out similarities between the structure of law and morality on the one hand and of automata on the other. I argue that these, plus the fact that automata can be designed to lack the biases and other failings of humans, require us to automate the formulation, administration, and enforcement of law as much as (...) possible, including the elements of law and morality that are operated by combatants in war. I suggest that, ethically speaking, deploying a legally competent robot in some legally regulated realm is not much different from deploying a more or less well-armed, vulnerable, obedient, or morally discerning soldier or general into battle, a police officer onto patrol, or a lawyer or judge into a trial. All feature automaticity in the sense of deputation to an agent we do not then directly control. Such relations are well understood and well-regulated in morality and law; so there is not much challenging philosophically in having robots be some of these agents — excepting the implications of the limits of robot technology at a given time for responsible deputation. I then consider this proposal in light of the differences between two conceptions of law. These are distinguished by whether each conception sees law as unambiguous rules inherently uncontroversial in each application; and I consider the prospects for robotizing law on each. Likewise for the prospects of robotizing moral theorizing and moral decision-making. Finally I identify certain elements of law and morality, noted by the philosopher Immanuel Kant, which robots can participate in only upon being able to set ends and emotionally invest in their attainment. One conclusion is that while affectless autonomous devices might be fit to rule us, they would not be fit to vote with us. For voting is a process for summing felt preferences, and affectless devices would have none to weigh into the sum. Since they don't care which outcomes obtain, they don't get to vote on which ones to bring about. (shrink)

Over the past decade, scholars, institutions, and activists have voiced strong concerns about the potential of automated decision systems to indirectly discriminate against vulnerable groups. This article analyses the ethics of algorithmic indirect discrimination, and argues that we can explain what is morally bad about such discrimination by reference to the fact that it causes harm. The article first sketches certain elements of the technical and conceptual background, including definitions of direct and indirect algorithmic differential treatment. It next (...) introduces three prominent accounts of fairness as potential explanations if the badness of algorithmic indirect discrimination, but argues that all three are vulnerable to powerful levelling-down-style objections. Instead, the article demonstrates how proper attention to the way differences in decision-scenarios affect the distribution of harms can help us account for intuitions in prominent cases. Finally, the article considers a potential objection based on the fact that certain forms of algorithmic indirect discrimination appear to distribute rather than cause harm, and notes that we can explain how such distributions cause harm by attending to differences in individual and group vulnerability. (shrink)

The American justice system, from police departments to the courts, is increasingly turning to information technology for help identifying potential offenders, determining where, geographically, to allocate enforcement resources, assessing flight risk and the potential for recidivism amongst arrestees, and making other judgments about when, where, and how to manage crime. In particular, there is a focus on machine learning and other data analytics tools, which promise to accurately predict where crime will occur and who will perpetrate it. Activists and academics (...) have begun to raise critical questions about the use of these tools in policing contexts. In this chapter, I review the emerging critical literature on predictive policing and contribute to it by raising ethical questions about the use of predictive analytics tools to identify potential offenders. Drawing from work on the ethics of profiling, I argue that the much-lauded move from reactive to preemptive policing can mean wrongfully generalizing about individuals, making harmful assumptions about them, instrumentalizing them, and failing to respect them as full ethical persons. I suggest that these problems stem both from the nature of predictive policing tools and from the sociotechnical contexts in which they are implemented... (shrink)

As inductive decision-making procedures, the inferences made by machine learning programs are subject to underdetermination by evidence and bear inductive risk. One strategy for overcoming these challenges is guided by a presumption in philosophy of science that inductive inferences can and should be value-free. Applied to machine learning programs, the strategy assumes that the influence of values is restricted to data and decision outcomes, thereby omitting internal value-laden design choice points. In this paper, I apply arguments from feminist (...) philosophy of science to machine learning programs to make the case that the resources required to respond to these inductive challenges render critical aspects of their design constitutively value-laden. I demonstrate these points specifically in the case of recidivism algorithms, arguing that contemporary debates concerning fairness in criminal justice risk-assessment programs are best understood as iterations of traditional arguments from inductive risk and demarcation, and thereby establish the value-laden nature of automated decision-making programs. Finally, in light of these points, I address opportunities for relocating the value-free ideal in machine learning and the limitations that accompany them. (shrink)

Recent work on interpretability in machine learning and AI has focused on the building of simplified models that approximate the true criteria used to make decisions. These models are a useful pedagogical device for teaching trained professionals how to predict what decisions will be made by the complex system, and most importantly how the system might break. However, when considering any such model it’s important to remember Box’s maxim that "All models are wrong but some are useful." We focus on (...) the distinction between these models and explanations in philosophy and sociology. These models can be understood as a "do it yourself kit" for explanations, allowing a practitioner to directly answer "what if questions" or generate contrastive explanations without external assistance. Although a valuable ability, giving these models as explanations appears more difficult than necessary, and other forms of explanation may not have the same trade-offs. We contrast the different schools of thought on what makes an explanation, and suggest that machine learning might benefit from viewing the problem more broadly. (shrink)

Algorithmic discrimination has rapidly become a topic of intense public and academic interest. This article explores three issues raised by algorithmic discrimination: 1) the distinction between direct and indirect discrimination, 2) the notion of disadvantageous treatment, and 3) the moral badness of discriminatory automated decision-making. It argues that some conventional distinctions between direct and indirect discrimination appear not to apply to algorithmic discrimination, that algorithmic discrimination may often be discrimination between groups, as opposed to against groups, and that (...) it is not necessarily the case that morally bad algorithmic discrimination gives us reason to not use automated decision-making. For each of the three issues, the article explores implications for algorithmic discrimination, suggests some alternative answers, and clarifies how we may want to think of discrimination more broadly in light of lessons drawn from the context of algorithmic discrimination. (shrink)

Sparrow argues that military robots capable of making their own decisions would be independent enough to allow us denial for their actions, yet too unlike us to be the targets of meaningful blame or praise—thereby fostering what Matthias has dubbed “the responsibility gap.” We agree with Sparrow that someone must be held responsible for all actions taken in a military conflict. That said, we think Sparrow overlooks the possibility of what we term “blank check” responsibility: A person of sufficiently high (...) standing could accept responsibility for the actions of autonomous robotic devices—even if that person could not be causally linked to those actions besides this prior agreement. The basic intuition behind our proposal is that humans can impute relations even when no other form of contact can be established. The missed alternative we want to highlight, then, would consist in an exchange: Social prestige in the occupation of a given office would come at the price of signing away part of one's freedoms to a contingent and unpredictable future guided by another agency. (shrink)

When agents insert technological systems into their decision-making processes, they can obscure moral responsibility for the results. This can give rise to a distinct moral wrong, which we call “agency laundering.” At root, agency laundering involves obfuscating one’s moral responsibility by enlisting a technology or process to take some action and letting it forestall others from demanding an account for bad outcomes that result. We argue that the concept of agency laundering helps in understanding important moral problems in a (...) number of recent cases involving automated, or algorithmic, decision-systems. We apply our conception of agency laundering to a series of examples, including Facebook’s automated advertising suggestions, Uber’s driver interfaces, algorithmic evaluation of K-12 teachers, and risk assessment in criminal sentencing. We distinguish agency laundering from several other critiques of information technology, including the so-called “responsibility gap,” “bias laundering,” and masking. (shrink)

Inspired by recent breakthroughs in predictive modeling, practitioners in both industry and government have turned to machine learning with hopes of operationalizing predictions to drive automated decisions. Unfortunately, many social desiderata concerning consequential decisions, such as justice or fairness, have no natural formulation within a purely predictive framework. In efforts to mitigate these problems, researchers have proposed a variety of metrics for quantifying deviations from various statistical parities that we might expect to observe in a fair world and offered (...) a variety of algorithms in attempts to satisfy subsets of these parities or to trade o the degree to which they are satised against utility. In this paper, we connect this approach to fair machine learning to the literature on ideal and non-ideal methodological approaches in political philosophy. The ideal approach requires positing the principles according to which a just world would operate. In the most straightforward application of ideal theory, one supports a proposed policy by arguing that it closes a discrepancy between the real and the perfectly just world. However, by failing to account for the mechanisms by which our non-ideal world arose, the responsibilities of various decision-makers, and the impacts of proposed policies, naive applications of ideal thinking can lead to misguided interventions. In this paper, we demonstrate a connection between the fair machine learning literature and the ideal approach in political philosophy, and argue that the increasingly apparent shortcomings of proposed fair machine learning algorithms reflect broader troubles faced by the ideal approach. We conclude with a critical discussion of the harms of misguided solutions, a reinterpretation of impossibility results, and directions for future research. (shrink)

Since the Enlightenment, there have been advocates for the rationalizing efficiency of enlightened sovereigns, bureaucrats, and technocrats. Today these enthusiasms are joined by calls for replacing or augmenting government with algorithms and artificial intelligence, a process already substantially under way. Bureaucracies are in effect algorithms created by technocrats that systematize governance, and their automation simply removes bureaucrats and paper. The growth of algorithmic governance can already be seen in the automation of social services, regulatory oversight, policing, the justice system, and (...) the military. However, there have also always been justified democratic and economic criticisms of autocracy, bureaucracy, technocracy, and algorithmic governance. Bureaucrats, technocrats, and algorithms embody biases that tend to serve the interests of elites, and all require transparency and democratic accountability, oversight individual citizens are ill equipped to exercise. As state apparatuses are increasingly automated, mechanisms for collective action and democratic oversight also need to be automated. Algorithms and cyborg citizenry will enable a posthuman democracy. Democratically accountable algorithmic governance, enabled by artificial intelligence and human enhancement, can automate bottom-up citizen surveillance, inform debate, aggregate decision making, and ensure the efficient working of the gradually withering state. As paid work disappears and we transition to a postcapitalist economy with a universal basic income, market mechanisms can be replaced with democratic planning. Indeed, only algorithmic governance can secure our future against accelerating threats from technological innovation. (shrink)

A series of recent developments points towards auditing as a promising mechanism to bridge the gap between principles and practice in AI ethics. Building on ongoing discussions concerning ethics-based auditing, we offer three contributions. First, we argue that ethics-based auditing can improve the quality of decision making, increase user satisfaction, unlock growth potential, enable law-making, and relieve human suffering. Second, we highlight current best practices to support the design and implementation of ethics-based auditing: To be feasible and effective, ethics-based (...) auditing should take the form of a continuous and constructive process, approach ethical alignment from a system perspective, and be aligned with public policies and incentives for ethically desirable behaviour. Third, we identify and discuss the constraints associated with ethics-based auditing. Only by understanding and accounting for these constraints can ethics-based auditing facilitate ethical alignment of AI, while enabling society to reap the full economic and social benefits of automation. (shrink)

Algorithms can now identify patterns and correlations in the (big) datasets, and predict outcomes based on those identified patterns and correlations with the use of machine learning techniques and big data, decisions can then be made by algorithms themselves in accordance with the predicted outcomes. Yet, algorithms can inherit questionable values from the datasets and acquire biases in the course of (machine) learning, and automated algorithmic decision-making makes it more difficult for people to see algorithms as biased. While (...) researchers have taken the problem of algorithmic bias seriously, but the current discussion on algorithmic fairness tends to conceptualize ‘fairness’ in algorithmic fairness primarily as a technical issue and attempts to implement pre-existing ideas of ‘fairness’ into algorithms. In this paper, I show that such a view of algorithmic fairness as technical issue is unsatisfactory for the type of problem algorithmic fairness presents. Since decisions on fairness measure and the related techniques for algorithms essentially involve choices between competing values, ‘fairness’ in algorithmic fairness should be conceptualized first and foremost as a political issue, and it should be (re)solved by democratic communication. The aim of this paper, therefore, is to explicitly reconceptualize algorithmic fairness as a political question and suggest the current discussion of algorithmic fairness can be strengthened by adopting the accountability for reasonableness framework. (shrink)

A series of recent developments points towards auditing as a promising mechanism to bridge the gap between principles and practice in AI ethics. Building on ongoing discussions concerning ethics-based auditing, we offer three contributions. First, we argue that ethics-based auditing can improve the quality of decision making, increase user satisfaction, unlock growth potential, enable law-making, and relieve human suffering. Second, we highlight current best practices to support the design and implementation of ethics-based auditing: To be feasible and effective, ethics-based (...) auditing should take the form of a continuous and constructive process, approach ethical alignment from a system perspective, and be aligned with public policies and incentives for ethically desirable behaviour. Third, we identify and discuss the constraints associated with ethics-based auditing. Only by understanding and accounting for these constraints can ethics-based auditing facilitate ethical alignment of AI, while enabling society to reap the full economic and social benefits of automation. (shrink)

As artificial intelligence becomes more sophisticated and robots approach autonomous decision-making, debates about how to assign moral responsibility have gained importance, urgency, and sophistication. Answering Stenseke’s (2022a) call for scaffolds that can help us classify views and commitments, we think the current debate space can be represented hierarchically, as answers to key questions. We use the resulting taxonomy of five stances to differentiate—and defend—what is known as the “blank check” proposal. According to this proposal, a person activating a robot (...) could willingly make themselves answerable for whatever events ensue, even if those events stem from the robot’s autonomous decision(s). This blank check solution was originally proposed in the context of automated warfare (Champagne & Tonkens, 2015), but we extend it to cover all robots. We argue that, because moral answerability in the blank check is accepted voluntarily and before bad outcomes are known, it proves superior to alternative ways of assigning blame. We end by highlighting how, in addition to being just, this self-initiated and prospective moral answerability for robot harm provides deterrence that the four other stances cannot match. (shrink)

Decision-making Capacity matters to whether a patient’s decision should determine her treatment. But why it matters in this way isn’t clear. The standard story is that dmc matters because autonomy matters. And this is thought to justify dmc as a gatekeeper for autonomy – whereby autonomy concerns arise if but only if a patient has dmc. But appeals to autonomy invoke two distinct concerns: concern for authenticity – concern that a choice is consistent with an individual’s commitments; and (...) concern for sovereignty – concern that an individual exercises control over that which is hers to control. Here, I argue, neither concern can alone explain why dmc matters. Instead, dmc matters because it indicates a harmony between the two concerns – the demands of each concern are more likely to agree if a patient has dmc. This vindicates the standard story, but also makes clear that dmc is an inappropriate gatekeeper for autonomy. (shrink)

Decision-making capacity (DMC) plays an important role in clinical practice—determining, on the basis of a patient’s decisional abilities, whether they are entitled to make their own medical decisions or whether a surrogate must be secured to participate in decisions on their behalf. As a result, it’s critical that we get things right—that our conceptual framework be well-suited to the task of helping practitioners systematically sort through the relevant ethical considerations in a way that reliably and transparently delivers correct verdicts (...) about who should and should not have the authority to make their own medical decisions. Unfortunately, however, the standard approach to DMC does not get things right. It is of virtually no help in identifying and clarifying the relevant ethical considerations. And, embedded in the prevailing anti-paternalist paradigm, DMC assessments obfuscate and distort the underlying ethical justification for granting or withholding decisional authority. Here, we describe the core commitments of the standard approach to DMC and then highlight three problems with it. We then argue that these problems are significant enough that they call for more than merely tinkering and fine tuning—variations of the standard approach cannot adequately address them. Instead, we should ditch DMC. (shrink)

Fifty years of effort in artificial intelligence (AI) and the formalization of legal reasoning have produced both successes and failures. Considerable success in organizing and displaying evidence and its interrelationships has been accompanied by failure to achieve the original ambition of AI as applied to law: fully automated legal decision-making. The obstacles to formalizing legal reasoning have proved to be the same ones that make the formalization of commonsense reasoning so difficult, and are most evident where legal reasoning (...) has to meld with the vast web of ordinary human knowledge of the world. Underlying many of the problems is the mismatch between the discreteness of symbol manipulation and the continuous nature of imprecise natural language, of degrees of similarity and analogy, and of probabilities. (shrink)

Since the automation revolution of our technological era, diverse machines or robots have gradually begun to reconfigure our lives. With this expansion, it seems that those machines are now faced with a new challenge: more autonomous decision-making involving life or death consequences. This paper explores the philosophical possibility of artificial moral agency through the following question: could a machine obtain the cognitive capacities needed to be a moral agent? In this regard, I propose to expose, under a normative-cognitive perspective, (...) the minimum criteria through which we could recognize an artificial entity as a genuine moral entity. Although my proposal should be considered from a reasonable level of abstraction, I will critically analyze and identify how an artificial agent could integrate those cognitive features. Finally, I intend to discuss their limitations or possibilities. (shrink)

In this study, we propose a new approach based on fuzzy TODIM (Portuguese acronym for interactive and multicriteria decision-making) for decision-making problems in uncertain environments. Our method incorporates group utility and individual regret, which are often ignored in traditional multicriteria decision-making (MCDM) methods. To enhance the analysis and application of fuzzy sets in decision-making processes, we introduce novel entropy and distance measures for q-rung picture fuzzy sets. These measures include an entropy measure based on the sine (...) function and a distance measure derived from the Jensen-Shannon divergence. In our methodology, incorporating the sine function into the entropy measure stands out as a distinctive decision, grounded in a profound understanding of the inherent characteristics of fuzzy sets. Utilizing the sine function proves especially advantageous when handling fuzzy sets that exhibit cyclical variations or fluctuations in their membership degrees. We effectively weight the criteria for an improved evaluation by using this new entropy measure. The introduced distance measure finds application in the TODIM approach, allowing the execution of TODIM method steps within a fuzzy environment until the determination of one alternative’s dominance over another—an advancement beyond traditional approaches. We apply our enhanced fuzzy TODIM method to a real-life construction project management problem from the literature and compare the results with those in the literature and obtained from other MCDM methods. Our proposed measures are robust, as demonstrated by the sensitivity analysis that varied the weights of group utility and individual regret, with the results visualized in a 3D sensitivity plot. The findings demonstrate the superiority of our method in providing a more comprehensive evaluation of alternatives, making it a useful tool for decision-makers facing complex and uncertain decision-making problems. (shrink)

Data-driven predictive algorithms are widely used to automate and guide high-stake decision making such as bail and parole recommendation, medical resource distribution, and mortgage allocation. Nevertheless, harmful outcomes biased against vulnerable groups have been reported. The growing research field known as 'algorithmic fairness' aims to mitigate these harmful biases. Its primary methodology consists in proposing mathematical metrics to address the social harms resulting from an algorithm's biased outputs. The metrics are typically motivated by -- or substantively rooted in -- (...) ideals of distributive justice, as formulated by political and legal philosophers. The perspectives of feminist political philosophers on social justice, by contrast, have been largely neglected. Some feminist philosophers have criticized the local scope of the paradigm of distributive justice and have proposed corrective amendments to surmount its limitations. The present paper brings some key insights of feminist political philosophy to algorithmic fairness. The paper has three goals. First, I show that algorithmic fairness does not accommodate structural injustices in its current scope. Second, I defend the relevance of structural injustices -- as pioneered in the contemporary philosophical literature by Iris Marion Young -- to algorithmic fairness. Third, I take some steps in developing the paradigm of 'responsible algorithmic fairness' to correct for errors in the current scope and implementation of algorithmic fairness. I close by some reflections of directions for future research. (shrink)

Complex systems are difficult to manage, operate and maintain. This is why we see teams of highly specialised engineers in industries such as aerospace, nuclear and subsurface. Condition based monitoring is also employed to maximise the efficiency of extensive maintenance programmes instead of using periodic maintenance. A level of automation is often required in such complex engineering platforms in order to effectively and safely manage them. Advances in Artificial Intelligence related technologies have offered greater levels of automation but this potentially (...) pivots the weight of decision making away from the operator to the machine. Implementing AI or complex algorithms into a platform can mean that the Operators’ control over the system is diminished or removed altogether. For example, in the Boeing 737 Air Max Disaster, AI had been added to a platform and removed the operators’ control of the system. This meant that the operator could not then move outside the extremely reserved, algorithm defined, “envelope” of operation. This paper analyses the challenges of AI driven condition based monitoring where there is a potential to see similar consequences to those seen in control engineering. As the future of society becomes more about algorithm driven technology, it is prudent to ask, not only whether we should implement AI into complex systems, but how this can be achieved ethically and safely in order to reduce risk to life. (shrink)

Recently, bioethicists and the UNCRPD have advocated for supported medical decision-making on behalf of patients with intellectual disabilities. But what does supported decision-making really entail? One compelling framework is Anita Silvers and Leslie Francis’ mental prosthesis account, which envisions supported decision-making as a process in which trustees act as mere appendages for the patient’s will; the trustee provides the cognitive tools the patient requires to realize her conception of her own good. We argue that supported decision-making (...) would be better understood as a collaborative process, giving patients with intellectual disabilities the opportunity to make decisions in a respectful relationship with trusted others. We offer an alternative account of supported decision-making where the primary constraint is to protect the patient from domination by the trustee. This is advantageous in its preservation of the prospects for genuine collaboration, for the mental prosthesis approach ultimately reinforces a problematic ideal of isolated patient self-determination. (shrink)

In the case of AI, automated systems are making increasingly complex decisions with significant ethical implications, raising questions about who is responsible for decisions made by AI and how to ensure that these decisions align with society's ethical and moral values, both in India and the West. Jonathan Haidt has conducted research on moral and ethical decision-making. Today, solving problems like decision-making in autonomous vehicles can draw on the literature of the trolley dilemma in that it illustrates (...) the complexity of ethical decisions faced in emergency situations, as well as the moral implications of the decisions made. However, a series of moral principles must be understood and cited to avoid insufficient mechanistic explanations. Here we present a compilation of ethical positions both in India and the West. (shrink)

Dear Editors, -/- I found the content of your editorials to be highly intriguing [1,2]. Scientific journals are witnessing a growing prevalence of publications related to artificial intelligence (AI). Three letters to the editor were recently published in your journal [3-5]. The renowned journal Nature has dedicated approximately 25 publications solely to the subject of ChatGPT. Moreover, a quick search on Pubmed using the term "ChatGPT" yields around 900 articles, with the vast majority originating in 2023. These statistics underscore the (...) substantial interest of the scientific community in this area. -/- AI, especially the ChatGPT tool and the recent Bard, have faced criticism and been portrayed as significant adversaries of science. It is evident that many authors or researchers, who may not be well-versed in writing, can greatly benefit from these tools, as mentioned earlier. Without taking a contrarian stance, one should consider the potential advantages of such technologies for researchers in less privileged regions, where access to new technologies is limited, and local or regional challenges abound [6]. AI cannot be confounded with other technologies, as it specifically focuses on replicating human-like intelligence and decision-making processes, rather than simply automating tasks or improving performance based on data patterns. -/- The translation into English poses challenges due to the dominance of English in worldwide publications, with over 95% of articles being published in this language, and even reaching 98% in some fields. Although this manuscript was partially translated using AI, it can still benefit researchers from non-native English regions. Even simple tasks like text editing can be problematic for researchers in underprivileged areas. AI can play a crucial role in the evolution of online lectures and classes, providing valuable support for African maxillofacial surgeons who lack the luxury of taking breaks from work to update their knowledge, as they may be the only available option [7]. One of the remarkable features of AI is its ability to discover knowledge gaps. The use of simple tools like reference organizers is rapidly evolving and can become automated or semi-automated through AI. However, we must carefully consider whether we should refrain from relying too heavily on AI in certain cases, as this could be seen as a significant regression. -/- On the other hand, we must be cautious about freely allowing AI tools to circulate in scientific journals and books without proper regulation [8]. Currently, accurately identifying texts generated by AI is challenging, and their effectiveness remains relatively low, at less than 30%. This means that only about 30 out of every 100 texts can be confidently classified as AI-generated. The technology must advance further to increase detection accuracy or at least raise suspicion. Academic journals no longer view authors acknowledging artificial intelligence tools as co-authors in their research favorably. This is crucial to prevent certain unscrupulous individuals, such as "false prophets," charlatans, and flat-earthers, from infiltrating the realm of science, potentially impeding the progress of serious research conducted by professionals dedicated to advancing humanity through science. -/- It is essential to keep in mind that AI does not generate anything novel. Human authors can not be fully substituted [9]. In research involving groundbreaking concepts, innovations, case reports, or technical notes, the use of AI tends to be less frequent due to its lack of capability in creating innovative outcomes. On the other hand, reviews, whether narrative, systematic, or scoping, are based on existing publications. To address potential fraudulent practices, editors, reviewers, and journals themselves should exercise greater vigilance and apply more stringent filters for this type of publication. -/- An article from over a decade ago already discussed the professions most susceptible to replacement by computerization [10]. Maxillofacial surgeons, physicians, dentists, and psychologists are among the professions that are less likely to be displaced. This position can be attributed to the significant level of patient-professional interaction, the development of specific manual skills over time, and the ability to make adaptable decisions during procedures. These intricacies pose formidable challenges for AI to grasp, regardless of its level of advancement. -/- We should maintain a composed yet vigilant stance at this juncture. Just as Portuguese navigators feared encountering serpents and sea monsters when they ventured into uncharted waters, the uncertainty and novelty of AI can evoke apprehension in us all. Nonetheless, we must embrace the benefits that AI can offer while imposing strict regulations and appropriate penalties to prevent any potential abuses carried out "in the name of science." -/- Sincerely yours,. (shrink)

There is wide consensus among bioethicists about the importance of autonomy when determining whether or not a patient has the right to refuse life-saving treatment (LST). In this context, autonomy has typically been understood in terms of the patient’s ability to make an informed decision. According to the traditional view, decision-making capacity (DMC) is seen as both necessary and sufficient for the right to refuse LST. Recently, this view has been challenged by those who think that considerations of (...) authenticity and putative counterexamples should lead us to revise the traditional account. In this paper, we respond to these revisionist arguments, and we defend the traditional view according to which we have autonomy-based reasons to respect a patient’s decision to refuse LST if and only if she has DMC. (shrink)

Across two studies the hypotheses were tested that stressful situations affect both leadership ethical acting and leaders' recognition of ethical dilemmas. In the studies, decision makers recruited from 3 sites of a Swedish multinational civil engineering company provided personal data on stressful situations, made ethical decisions, and answered to stress-outcome questions. Stressful situations were observed to have a greater impact on ethical acting than on the recognition of ethical dilemmas. This was particularly true for situations involving punishment and lack (...) of rewards. The results are important for the Corporate Social Responsibility (CSR) of an organization, especially with regard to the analysis of the Stressors influencing managerial work and its implications for ethical behavior. (shrink)

Using artificial intelligence (AI) to make decisions in human resource management (HRM) raises questions of how fair employees perceive these decisions to be and whether they experience respectful treatment (i.e., interactional justice). In this experimental survey study with open-ended qualitative questions, we examine decision making in six HRM functions and manipulate the decision maker (AI or human) and decision valence (positive or negative) to determine their impact on individuals’ experiences of interactional justice, trust, dehumanization, and perceptions of (...) decision-maker role appropriate- ness. In terms of decision makers, the use of human decision makers over AIs generally resulted in better perceptions of respectful treatment. In terms of decision valence, people experiencing positive over negative decisions generally resulted in better perceptions of respectful treatment. In instances where these cases conflict, on some indicators people preferred positive AI decisions over negative human decisions. Qualitative responses show how people identify justice concerns with both AI and human decision making. We outline implications for theory, practice, and future research. (shrink)

Nowadays, the economic and social nature of contemporary business organizations chiefly banks binds them to face with the sheer volume of data and information and the key to commercial success in this area is the proper use of data for making better, faster and flawless decisions. To achieve this goal organizations requires strong and effective tools to enable them in automating task analysis, decision-making, strategy formulation and risk prediction to prevent bankruptcy and fraud .Business Intelligence is a set of (...) skills, technologies and application systems used to collect, store, analyze and create effective access to the task to help organizations better understand the business context and make accurate decision timely and respond quickly toward inflation, rate fluctuations and the market price. In this paper we review recent literature in the search for trends in business intelligence applications for the banking industry and its challenges and finally some articles that comprise this special issue are introduced and characterized in terms of business intelligence research framework. (shrink)

Decisions are made under uncertainty when there are distinct outcomes of a given action, and one is uncertain to which the act will lead. Decisions are made under indeterminacy when there are distinct outcomes of a given action, and it is indeterminate to which the act will lead. This paper develops a theory of (synchronic and diachronic) decision-making under indeterminacy that portrays the rational response to such situations as inconstant. Rational agents have to capriciously and randomly choose how to (...) resolve the indeterminacy relevant to a given choice-situation, but such capricious choices once made constrain how they will choose in the future. The account is illustrated by the case of self-interested action in situations where it is indeterminate whether you yourself will survive to benefit or suffer the consequences. The conclusion emphasizes some distinctive anti-hedging predictions of the account. (shrink)

Albert Jonsen and Stephen Toulmin have argued that the best way to resolve complex “moral” issues in clinical settings is to focus on the details of specific cases. This approach to medical decision-making, labeled ‘casuistry’, has met with much criticism in recent years. In response to this criticism, Carson Strong has attempted to salvage much of Jonsen’s and Toulmin’s version of casuistry. He concludes that much of their analysis, including Jonsen’s further elaboration about the casuistic methodology, is on the (...) mark. In this essay, the details of Jonsen’s and Toulmin’s version of casuistry and the major criticisms against their approach to clinical decision-making are explicated. Furthermore, it is argued that Strong’s salvage efforts fail to deflect these criticisms. The upshot of this analysis, which includes a few additional criticisms, is that Jonsen’s and Toulmin’s version of casuistry is not an appropriate framework from which to resolve complex “moral” issues in clinical settings. (shrink)

Shared decision-making involves health professionals and patients/clients working together to achieve true person-centred health care. However, this goal is infrequently realized, and most barriers are unknown. Discussion between philosophers, clinicians, and researchers can assist in confronting the epistemic and moral basis of health care, with benefits to all. The aim of this paper is to describe what shared decision-making is, discuss its necessary conditions, and develop a definition that can be used in practice to support excellence in maternity (...) care. Discussion between the authors, with backgrounds in philosophy, clinical maternity care, health care management, and maternity care research, assisted the team to confront established norms in maternity care and challenge the epistemic and moral basis of decision-making for caesarean section. The team concluded that shared decision-making must start in pregnancy and continue throughout labour and birth, with equality in discourse facilitated by the clinician. Clinicians have a duty of care for the adequacy of women's knowledge, which can only be fulfilled when relevant knowledge is offered freely and when personal beliefs and biases that may impinge on decision-making (defeaters) are disclosed. Informed consent is not shared decision-making. Key barriers include existing cultural norms of “the doctor knows best” and “patient acquiescence” that prevent defeaters being acknowledged and discussed and can lead to legal challenges, overuse of medical intervention and, in some areas, obstetric violence. Shared decision-making in maternity care can thus be defined as an enquiry by clinician and expectant woman aimed at deciding upon a course of care or none, which takes the form of a dialogue within which the clinician fulfils their duty of care to the client's knowledge by making available their complete knowledge (based on all types of evidence) and expertise, including an exposition of any relevant and recognized potential defeaters. Research to develop measurement tools is required. (shrink)

The Internet of Things (IoT) infrastructure forms a gigantic network of interconnected and interacting devices. This infrastructure involves a new generation of service delivery models, more advanced data management and policy schemes, sophisticated data analytics tools, and effective decision making applications. IoT technology brings automation to a new level wherein nodes can communicate and make autonomous decisions in the absence of human interventions. IoT enabled solutions generate and process enormous volumes of heterogeneous data exchanged among billions of nodes. This (...) results in Big Data congestion, data management, storage issues and various inefficiencies. Fog Computing aims at solving the issues with data management as it includes intelligent computational components and storage closer to the data sources. Often, an IoT-enabled infrastructure is shared among many users with various requirements. Sharing resources, sharing operational costs and collective decision making (consensus) among many stakeholders is frequently neglected. This research addresses an essential requirement for adaptive, autonomous and consensus-based Fog computational solutions which are able to support distributed and in-network schemes and policies. These network schemes and policies need to meet the requirements of many users. In this work, innovative consensus-based computational solutions are investigated. These proposed solutions aim to correlate and organise data for effective management and decision making in Fog. Instead of individual decision making, the algorithms aim to aggregate several decisions into a consensus decision representing a collective agreement, benefiting from the individuals variant knowledge and meeting multiple stakeholders requirements. In order to validate the proposed solutions, hybrid research methodology is involved that includes the design of a test-bed and the execution of several experiments. In order to investigate the effectiveness of the paradigm, three experiments were designed and validated. Real-life sensor data and synthetic statistical data was collected, processed and analysed. Bayesian Machine Learning models and Analytics were used to consolidate the design and evaluate the performance of the algorithms. In the Fog environment, the first scenario tests the Aggregation by Distribution algorithm. The solution contribute in achieving a notable efficiency of data delivery obtained with a minimal loss in precision. The second scenario validates the merits of the approach in predicting the activities of high mobility IoT applications. The third scenario tests the applications related to smart home IoT. All proposed Consensus algorithms use statistical analysis to support effective decision making in Fog and enable data aggregation for optimal storage, data transmission, processing and analytics. The final results of all experiments showed that all the implemented consensus approaches surpass the individual ones in different performance terms. Formal results also showed that the paradigm is a good fit in many IoT environments and can be suitable for different scenarios when applying data analysis to correlate data with the design. Finally, the design demonstrates that Fog Computing can compete with Cloud Computing in terms of accuracy with an added preference of locality. (shrink)

Machine intelligence already helps medical staff with a number of tasks. Ethical decision-making, however, has not been handed over to computers. In this proof-of-concept study, we show how an algorithm based on Beauchamp and Childress’ prima-facie principles could be employed to advise on a range of moral dilemma situations that occur in medical institutions. We explain why we chose fuzzy cognitive maps to set up the advisory system and how we utilized machine learning to train it. We report on (...) the difficult task of operationalizing the principles of beneficence, non-maleficence and patient autonomy, and describe how we selected suitable input parameters that we extracted from a training dataset of clinical cases. The first performance results are promising, but an algorithmic approach to ethics also comes with several weaknesses and limitations. Should one really entrust the sensitive domain of clinical ethics to machine intelligence? (shrink)

This volume presents research that integrates decision making and creativity within the social contexts in which these processes occur. The volume is an essential addition to and expansion of recent approaches to decision making. Such approaches attempt to incorporate more of the psychological and socio-cultural context in which human decision making takes place. The authors come from different disciplines and also belong to a broad spectrum of research traditions. They present innovative chapters dealing with both theoretical and (...) empirical aspects of decision making in different personal and organizational contexts. All chapters are written from the perspective that human decision making is inherently social and more or less creative. The volume addresses fundamental questions about the nature of human decision making as it occurs in different social contexts. Thereby, it becomes essential reading for researchers in decision making and for advanced students in psychology, management science, informatics, and related disciplines. (shrink)

In recent years there has been an explosion of interest in Artificial Intelligence (AI) both in health care and academic philosophy. This has been due mainly to the rise of effective machine learning and deep learning algorithms, together with increases in data collection and processing power, which have made rapid progress in many areas. However, use of this technology has brought with it philosophical issues and practical problems, in particular, epistemic and ethical. In this paper the authors, with backgrounds in (...) philosophy, maternity care practice and clinical research, draw upon and extend a recent framework for shared decision-making (SDM) that identified a duty of care to the client's knowledge as a necessary condition for SDM. This duty entails the responsibility to acknowledge and overcome epistemic defeaters. This framework is applied to the use of AI in maternity care, in particular, the use of machine learning and deep learning technology to attempt to enhance electronic fetal monitoring (EFM). In doing so, various sub-kinds of epistemic defeater, namely, transparent, opaque, underdetermined, and inherited defeaters are taxonomized and discussed. The authors argue that, although effective current or future AI-enhanced EFM may impose an epistemic obligation on the part of clinicians to rely on such systems' predictions or diagnoses as input to SDM, such obligations may be overridden by inherited defeaters, caused by a form of algorithmic bias. The existence of inherited defeaters implies that the duty of care to the client's knowledge extends to any situation in which a clinician (or anyone else) is involved in producing training data for a system that will be used in SDM. Any future AI must be capable of assessing women individually, taking into account a wide range of factors including women's preferences, to provide a holistic range of evidence for clinical decision-making. (shrink)

I identify an undertheorized problem with decisions we make with the aid of algorithms: the problem of inauthenticity. When we make decisions with the aid of algorithms, we can make ones that go against our commitments and values in a normatively important way. In this paper, I present a framework for algorithm-aided decision-making that can lead to inauthenticity. I then construct a taxonomy of the features of the decision environment that make such outcomes likely, and I discuss three (...) possible solutions to the problem. (shrink)

This essay investigates, via the concepts of the philosophy of orientation, Annie Duke’s decision-making theory in "Thinking in Bets" and scrutinizes as to what extent one can universalize the 'orientation skill' of decision-making with regard to our everyday and professional life.

Any ethical inquiry into addiction research is faced with the preliminary challenge that the term “addiction” is itself a matter of scientific and ethical controversy. Accordingly, the chapter begins with a brief history of the term “addiction.” The chapter then turns to ethical issues surrounding consent and decision-making capacity viewed from the perspective of the current opioid epidemic. One concern is the neglect of the cyclical nature of addiction and the implications of this for the validity of current psychometric (...) instruments used to evaluate decision-making capacity in addiction. Another is the apparent discrepancy—possibly an ethical double standard—in the manner in which society and addiction researchers view the mental capacity and vulnerability of individuals who suffer from severe addiction. On the whole, the main ethical concern of the chapter is the puzzling lack of clinical research on decision-making capacity in research on addiction. (shrink)