A body schema is an agent's model of its own body that enables it to act on affordances in the environment. This paper presents a body schema system for the Learning Intelligent Decision Agent (LIDA) cognitive architecture. LIDA is a conceptual and computational implementation of Global Workspace Theory, also integrating other theories from neuroscience and psychology. This paper contends that the ‘body schema' should be split into three separate functions based on the functional role of consciousness in Global (...) Workspace Theory. There is (1) an online model of the agent's effectors and effector variables (Current Body Schema), (2) a long-term, recognitional storage of embodied capacities for action and affordances (Habitual Body Schema), and (3) "dorsal" stream information feeding directly from early perception to sensorimotor processes (Online Body Schema). This paper then discusses how the LIDA model of the body schema explains several experiments in psychology and ethology. (shrink)

With recent advancements in systems engineering and artificial intelligence, autonomous agents are increasingly being called upon to execute tasks that have normative relevance. These are tasks that directly—and potentially adversely—affect human well-being and demand of the agent a degree of normative-sensitivity and -compliance. Such norms and normative principles are typically of a social, legal, ethical, empathetic, or cultural nature. Whereas norms of this type are often framed in the abstract, or as high-level principles, addressing normative concerns in concrete (...) applications of autonomous agents requires the refinement of normative principles into explicitly formulated practical rules. This paper develops a process for deriving specification rules from a set of high-level norms, thereby bridging the gap between normative principles and operational practice. This enables autonomous agents to select and execute the most normatively favourable action in the intended context premised on a range of underlying relevant normative principles. In the translation and reduction of normative principles to SLEEC rules, we present an iterative process that uncovers normative principles, addresses SLEEC concerns, identifies and resolves SLEEC conflicts, and generates both preliminary and complex normatively-relevant rules, thereby guiding the development of autonomous agents and better positioning them as normatively SLEEC-sensitive or SLEEC-compliant. (shrink)

The book, Autonomous Agents: From Self-Control to Autonomy (1995), by Alfred R. Mele, deals primarily with two main concepts, “self-control” and “individual autonomy,” and the relationship between them. The book is divided into two parts: (1) a view of self-control, the self-controlled person, and behaviour manifesting self-control, and (2) a view of personal autonomy, the autonomous person, and autonomous behaviour. Mele (Ibid.) defines self-control as the opposite of the Aristotelian concept of akrasia, or the contrary of akrasia, (...) which implies weakness of will, incontinence, or lack of self-control—the state of mind in which one acts against one’s better judgement. According to Mele, the concept of self-control can be approached from two perspectives: (a) how self-control affects human behaviour, and (b) how self-control-associated behavior can enhance our understanding of ‘personal autonomy’ and ‘autonomous behaviour’—personal autonomy requires self-control, and autonomous persons and autonomous behaviour are naturally found together. Therefore, I might say that self-control is essential to enhancing one’s autonomy. -/- In part I, we find an account of self-control where Mele argues that even an ideally self-controlled person might lack autonomy. In part II, Mele gives an explicit account of autonomy and explains what must be added to self-control to achieve autonomy. This is the pivotal claim made by Mele (dismantling the intuitively connected notions of self-control and autonomy). (shrink)

Across various fields it is argued that the self in part consists of an autobiographical self-narrative and that the self-narrative has an impact on agential behavior. Similarly, within action theory, it is claimed that the intentional structure of coherent long-term action is divided into a hierarchy of distal, proximal, and motor intentions. However, the concrete mechanisms for how narratives and distal intentions are generated and impact action is rarely fleshed out concretely. We here demonstrate how narratives and distal intentions can (...) be generated within cognitive agents and how they can impact agential behavior over long time scales. We integrate narratives and distal intentions into the LIDA model,and demonstrate how they can guide agential action in a manner that is consistent with the Global Workspace Theory of consciousness. This paper serves both as an addition to the LIDA cognitive architecture and an elucidation of how narratives and distal intention emerge and play their role in cognition and action. (shrink)

This article provides an answer to the question: What is the function of cognition? By answering this question it becomes possible to investigate what are the simplest cognitive systems. It addresses the question by treating cognition as a solution to a design problem. It defines a nested sequence of design problems: (1) How can a system persist? (2) How can a system affect its environment to improve its persistence? (3) How can a system utilize better information from the environment to (...) select better actions? And, (4) How can a system reduce its inherent informational limitations to achieve more successful behavior? This provides a corresponding nested sequence of system classes: (1) autonomous systems, (2) (re)active autonomous systems, (3) informationally controlled autonomous systems (autonomous agents), and (4) cognitive systems. -/- This article provides the following characterization of cognition: The cognitive system is the set of mechanisms of an autonomous agent that (1) allow increase of the correlation and integration between the environment and the information system of the agent, so that (2) the agent can improve the selection of actions and thereby produce more successful behavior. -/- Finally, it shows that common cognitive capacities satisfy the characterization: learning, memory, representation, decision making, reasoning, attention, and communication. (shrink)

Artificial agents create significant moral opportunities and challenges. Over the last two decades, discourse has largely focused on the concept of a ‘responsibility gap.’ We argue that this concept is incoherent, misguided, and diverts attention from the core issue of ‘control gaps.’ Control gaps arise when there is a discrepancy between the causal control an agent exercises and the moral control it should possess or emulate. Such gaps present moral risks, often leading to harm or ethical violations. We propose (...) a second-order ‘duty of moral control’ that mandates closing these gaps to reduce risks within acceptable moral limits. Our analysis encompasses both autonomous machines and collective agents, acknowledging their similarities and key differences in constitution and moral status. We suggest four methods to close control gaps: ensuring artificial agents attain moral agency, providing meaningful human control, implementing safety engineering, and employing social control. These methods aim to responsibly integrate artificial agents into society. We conclude that a realistic approach, which addresses the practical problems posed by control gaps, is essential. This approach provides solutions to manage the risks posed by artificial agents while maintaining acceptable moral standards, ensuring we responsibly harness their potential and address the ethical challenges they present. (shrink)

While Autonomous Weapons Systems have obvious military advantages, there are prima facie moral objections to using them. By way of general reply to these objections, I point out similarities between the structure of law and morality on the one hand and of automata on the other. I argue that these, plus the fact that automata can be designed to lack the biases and other failings of humans, require us to automate the formulation, administration, and enforcement of law as much (...) as possible, including the elements of law and morality that are operated by combatants in war. I suggest that, ethically speaking, deploying a legally competent robot in some legally regulated realm is not much different from deploying a more or less well-armed, vulnerable, obedient, or morally discerning soldier or general into battle, a police officer onto patrol, or a lawyer or judge into a trial. All feature automaticity in the sense of deputation to an agent we do not then directly control. Such relations are well understood and well-regulated in morality and law; so there is not much challenging philosophically in having robots be some of these agents — excepting the implications of the limits of robot technology at a given time for responsible deputation. I then consider this proposal in light of the differences between two conceptions of law. These are distinguished by whether each conception sees law as unambiguous rules inherently uncontroversial in each application; and I consider the prospects for robotizing law on each. Likewise for the prospects of robotizing moral theorizing and moral decision-making. Finally I identify certain elements of law and morality, noted by the philosopher Immanuel Kant, which robots can participate in only upon being able to set ends and emotionally invest in their attainment. One conclusion is that while affectless autonomous devices might be fit to rule us, they would not be fit to vote with us. For voting is a process for summing felt preferences, and affectless devices would have none to weigh into the sum. Since they don't care which outcomes obtain, they don't get to vote on which ones to bring about. (shrink)

In this paper I propose and develop a social account of global autonomy. On this view, a person is autonomous simply to the extent to which it is difficult for others to subject her to their wills. I argue that many properties commonly thought necessary for autonomy are in fact properties that tend to increase an agent’s immunity to such interpersonal subjection, and that the proposed account is therefore capable of providing theoretical unity to many of the otherwise (...) heterogeneous requirements of autonomy familiar from recent discussions. Specifically, I discuss three such requirements: (i) possession of legally protected status, (ii) a sense of one’s own self-worth, and (iii) a capacity for critical reflection. I argue that the proposed account is not only theoretically satisfying but also yields a rich and attractive conception of autonomy. (shrink)

To many, the idea of autonomous weapons systems (AWS) killing human beings is grotesque. Yet critics have had difficulty explaining why it should make a significant moral difference if a human combatant is killed by an AWS as opposed to being killed by a human combatant. The purpose of this paper is to explore the roots of various deontological concerns with AWS and to consider whether these concerns are distinct from any concerns that also apply to long-distance, human-guided weaponry. (...) We suggest that at least one major driver of the intuitive moral aversion to lethal AWS is that their use disrespects their human targets by violating the martial contract between human combatants. On our understanding of this doctrine, service personnel cede a right not to be directly targeted with lethal violence to other human agents alone. Artificial agents, of which AWS are one example, cannot understand the value of human life. A human combatant cannot transfer his privileges of targeting enemy combatants to a robot. Therefore, the human duty-holder who deploys AWS breaches the martial contract between human combatants and disrespects the targeted combatants. We consider whether this novel deontological objection to AWS forms the foundation of several other popular yet imperfect deontological objections to AWS. (shrink)

Recent advances in natural language processing have given rise to a new kind of AI architecture: the language agent. By repeatedly calling an LLM to perform a variety of cognitive tasks, language agents are able to function autonomously to pursue goals specified in natural language and stored in a human-readable format. Because of their architecture, language agents exhibit behavior that is predictable according to the laws of folk psychology: they function as though they have desires and beliefs, and then (...) make and update plans to pursue their desires given their beliefs. We argue that the rise of language agents significantly reduces the probability of an existential catastrophe due to loss of control over an AGI. This is because the probability of such an existential catastrophe is proportional to the difficulty of aligning AGI systems, and language agents significantly reduce that difficulty. In particular, language agents help to resolve three important issues related to aligning AIs: reward misspecification, goal misgeneralization, and uninterpretability. (shrink)

The behaviour of a multi-agent system is driven by messaging. Usually, there is no central dispatcher and each autonomous agent, though resource-bounded, can make less or more rational decisions to meet its own and collective goals. To this end, however, agents must communicate with their fellow agents and account for the signals from their environment. Moreover, in the dynamic, permanently changing world, agents’ behaviour, i.e. their activities, must also be dynamic. By communicating with other fellow agents and (...) with their environment, agents should be able to learn new concepts and enrich their knowledge base. Processes and events that happened in the past may be irrelevant in the present or have a significant impact in the future, and vice versa. Therefore, the fine-grained analysis of agents’ activities as well as events within or beyond the system is very important so that the system can run smoothly without falling into inconsistencies. Moreover, as the system should communicate with its environment, the analysis should be as close to natural language as possible. The goal of this paper is a proposal for such an analysis. To this end, I apply Transparent Intensional Logic (TIL) because TIL is particularly apt for a fine-grained analysis of processes and events specified in the present, past or future tense with reference to the time when they happened, happen or will happen. (shrink)

Although there have been efforts to integrate Semantic Web technologies and artificial agents related AI research approaches, they remain relatively isolated from each other. Herein, we introduce a new ontology framework designed to support the knowledge representation of artificial agents’ actions within the context of the actions of other autonomous agents and inspired by standard cognitive architectures. The framework consists of four parts: 1) an event ontology for information pertaining to actions and events; 2) an epistemic ontology containing facts (...) about knowledge, beliefs, perceptions and communication; 3) an ontology concerning future intentions, desires, and aversions; and, finally, 4) a deontic ontology for modeling obligations and prohibitions which limit agents’ actions. The architecture of the ontology framework is inspired by deontic cognitive event calculus as well as epistemic and deontic logic. We also describe a case study in which the proposed DCEO ontology supports autonomous vehicle navigation. (shrink)

Abstract: Artificial Morality is a new, emerging interdisciplinary field that centres around the idea of creating artificial moral agents, or AMAs, by implementing moral competence in artificial systems. AMAs are ought to be autonomous agents capable of socially correct judgements and ethically functional behaviour. This request for moral machines comes from the changes in everyday practice, where artificial systems are being frequently used in a variety of situations from home help and elderly care purposes to banking and court algorithms. (...) It is therefore important to create reliable and responsible machines based on the same ethical principles that society demands from people. New challenges in creating such agents appear. There are philosophical questions about a machine’s potential to be an agent, or mora l agent, in the first place. Then comes the problem of social acceptance of such machines, regardless of their theoretic agency status. As a result of efforts to resolve this problem, there are insinuations of needed additional psychological (emotional and cogn itive) competence in cold moral machines. What makes this endeavour of developing AMAs even harder is the complexity of the technical, engineering aspect of their creation. Implementation approaches such as top- down, bottom-up and hybrid approach aim to find the best way of developing fully moral agents, but they encounter their own problems throughout this effort. (shrink)

Autonomous and automatic weapons would be fire and forget: you activate them, and they decide who, when and how to kill; or they kill at a later time a target you’ve selected earlier. Some argue that this sort of killing is always wrong. If killing is to be done, it should be done only under direct human control. (E.g., Mary Ellen O’Connell, Peter Asaro, Christof Heyns.) I argue that there are surprisingly many kinds of situation where this is false (...) and where the use of Automated Weapons Systems would in fact be morally required. These include cases where a) once one has activated a weapon expected then to behave lethally, it would be appropriate to let it continue because this is part of a plan whose goodness one was best positioned to evaluate before activating the weapon; b) one expects better long-term consequences from allowing it to continue; c) allowing it to continue would express a decision you made to be resolute, a decision that could not have advantaged you had it not been true that you would carry through with it; d) the weapon is mechanically not recallable, so that, to not allow it to carry through, you would have had to refrain from activating it in the first place, something you expected would have disastrous consequences; e) you must deputize necessary killings to autonomous machines in order to protect yourself from guilt you shouldn’t have to bear; f) it would be morally better for the burden of responsibility for the killing to be shared among several agents, and the agents deputizing killing to machines can do this, especially where it’s not predictable which machine will be successful; g) a killing would be morally better done with elements of randomness and lack of deliberation, and a (relatively stupid) machine could do this where a person could not; h) the machine would be acting as a Doomsday Device, so that it could not have had its hoped for deterrent effect had you not ensured that you would be unable to recall it if enemy action activated it; i) letting it carry through is a necessary part of its own learning process, and you expect that this learning will have salutary effects later on; j) human intervention in the machine’s operation would disastrously impair its precision, or its speed and efficiency; k) using non-automated methods would require human resources you just don’t have in a task that nevertheless must be done (e.g., using land-mines to protect remote installations); l) the weapon has such horrible and indiscriminate power that it is doubtful whether it could be actually used in ways compatible with International Humanitarian Law and the Laws of War, which require that weapons be used only in ways respecting distinctness, necessity and proportionality, but its threat of use could respect these principles in affording deterrence provided human error cannot lead to their accidental deployment, this requiring that they be controlled by carefully designed autonomous and automatic systems. I then consider objections based on conceptions of human dignity and find that very often dignity too is best served by autonomous machine killing. Examples include saving your village by activating a robot to kill invading enemies who would inflict great indignity on your village, using a suicide robot to save yourself from a less dignified death at enemy hands, using a robotic drone to kill someone otherwise not accessible in order to restore dignity to someone this person killed and to his family, and using a robot to kill someone who needs killing, but the killing of whom by a human executioner would soil the executioner’s dignity. I conclude that what matters in rightful killing isn’t necessarily that it be under the direct control of a human, but that it be under the control of morality; and that could sometimes require use of an autonomous or automated device. (This paper was formerly called "Fire and Forget: A Defense of the Use of Autonomous Weapons in War" on Philpapers; the current title is the title of the published version.). (shrink)

Please contact me at [email protected] if you are interested in reading a particular chapter or being sent the entire manuscript for private use. -/- The thesis offers a comprehensive argument in favor of a regulationist approach to autonomous weapon systems (AWS). AWS, defined as all military robots capable of selecting or engaging targets without direct human involvement, are an emerging and potentially deeply transformative military technology subject to very substantial ethical controversy. AWS have both their enthusiasts and their detractors, (...) prominently advocating for a global preemptive ban on AWS development and use. Rejecting both positions, the author outlines a middle-of-the-road regulationist approach that is neither overly restrictive nor overly permissive. The disqualifying flaws of the rival prohibitionist approach are demonstrated in the process. After defining the core term of autonomy in weapon systems, the practical difficulties involved in applying an arms control regime to AWS are analyzed. The analysis shows that AWS are an extremely regulation-resistant technology. This feature when combined with their assumed high military utility makes a ban framework extremely costly to impose and enforce. As such it is ultimately very likely to fail at the benefit of the most unscrupulous international actors and at a very substantial risk to those abiding with international law. Consequently, to be ethically viable, a prohibitionist framework would need to offer substantial moral benefits impossible to attain through the rival regulationist approach. The remainder of the thesis undertakes to demonstrate that this is not the case. Comparing the considerations of military and strategic necessity to humanitarian concerns most commonly voiced by prohibitionists requires finding a common denominator for all values being referred to. Consequently, the thesis proceeds to show that both kinds of concerns are ultimately reducible to respect for basic human rights of all stakeholders, and so that the prohibitionist and regulationist approach may ultimately be compared in terms of consequences their adoption would generate for basic human rights realization. The author then evaluates both the potential humanitarian benefits, and the potential humanitarian hazards of AWS introduction. The benefits of leaving frontline combat to machines are outlined, with the unique kinds of suffering that would be abolished by such a development being described in detail. The arguments against AWS adoption are then divided into three classes: arguments related to alleged impossibility of compliance with The Laws of Armed Conflict, non-consequentialist and broad consequentialist arguments. This analysis, which comprises the greater part of the entire thesis, shows that the concerns behind compliance arguments are indeed substantial and have to be accommodated via a complex framework of best practices, regulations and localized restrictions on some kinds of AWS or AWS use in particular environments. They do not, however, justify a universal ban on using all the diverse forms of AWS in all environments. Non-consequentialist objections are found either reducible to other classes of arguments or thoroughly unconvincing, sometimes to the point of being actually vacuous. Broad consequentialist concerns are likewise found to be accommodable by regulation, empirically unfounded or causally disconnected from the actions of legitimate actors acquiring AWS, and therefore irrelevant to the moral permissibility of such actions. The author concludes that the proponents of prohibitionism are unable to point to moral benefits substantial enough to justify the costs and risks inherent in the approach. A global ban is, in fact, likely to have a worse humanitarian impact that well-regulated AWS adoption even if the strategic risks are disregarded. On the other hand, the analysis shows that there indeed exists an urgent need to regulate AWS through a variety of technological, procedural and legal solutions. These include, but are not limited to, a temporary moratorium on anti-personnel AWS use, development of internationally verified compliance software and eventual legal requirement of its employment, a temporary moratorium on AWS proliferation to state actors and a ban on their proliferation to non-state agents. (shrink)

In this paper I provide an exposition and critique of Johnson and Noorman’s (2014) three conceptualizations of the agential roles artificial systems can play. I argue that two of these conceptions are unproblematic: that of causally efficacious agency and “acting for” or surrogate agency. Their third conception, that of “autonomous agency,” however, is one I have reservations about. The authors point out that there are two ways in which the term “autonomy” can be used: there is, firstly, the engineering (...) sense of the term, which simply refers to the ability of some system to act independently of substantive human control. Secondly, there is the moral sense of the term, which has traditionally grounded many notions of human mor-al responsibility. I argue that the continued usage of “autonomy” in discussions of artificial agency complicates matters unnecessarily. This occurs in two ways: firstly, the condition of autonomy, even in its engineering sense, fails to accurately describe the way “autonomous” systems are developed in practice. Secondly, the continued usage of autonomy in the moral sense introduces unnecessary meta-physical baggage form the free will debate into discussions about moral agency. In order to understand the debate surrounding autonomy, we would therefore first need to settle many seemingly intractable metaphysical questions regarding the existence of free will in human beings. (shrink)

This article focuses on a particular issue under machine ethics—that is, the nature of Artificial Moral Agents. Machine ethics is a branch of artificial intelligence that looks into the moral status of artificial agents. Artificial moral agents, on the other hand, are artificial autonomous agents that possess moral value, as well as certain rights and responsibilities. This paper demonstrates that attempts to fully develop a theory that could possibly account for the nature of Artificial Moral Agents may consider certain (...) philosophical ideas, like the standard characterizations of agency, rational agency, moral agency, and artificial agency. At the very least, the said philosophical concepts may be treated as signposts for further research on how to truly account for the nature of Artificial Moral Agents. (shrink)

Robert Sparrow (among others) claims that if an autonomous weapon were to commit a war crime, it would cause harm for which no one could reasonably be blamed. Since no one would bear responsibility for the soldier’s share of killing in such cases, he argues that they would necessarily violate the requirements of jus in bello, and should be prohibited by international law. I argue this view is mistaken and that our moral understanding of war is sufficient to determine (...) blame for any wrongful killing done by autonomous weapons. Analyzing moral responsibility for autonomous weapons starts by recognizing that although they are capable of causing moral consequences, they are neither praiseworthy nor blameworthy in the moral sense. As such, their military role is that of a tool, albeit a rather sophisticated one, and responsibility for their use is roughly analogous to that of existing “smart” weapons. There will likely be some difficulty in managing these systems as they become more intelligent and more prone to unpredicted behavior, but the moral notion of shared responsibility and the legal notion of command responsibility are sufficient to locate responsibility for their use. (shrink)

In this paper Sullins argues that in certain circumstances robots can be seen as real moral agents. A distinction is made between persons and moral agents such that, it is not necessary for a robot to have personhood in order to be a moral agent. I detail three requirements for a robot to be seen as a moral agent. The first is achieved when the robot is significantly autonomous from any programmers or operators of the machine. The (...) second is when one can analyze or explain the robot's behavior only by ascribing to it some predisposition or 'intention' to do good or harm. And finally, robot moral agency requires the robot to behave in a way that shows and understanding of responsibility to some other moral agent. Robots with all of these criteria will have moral rights as well as responsibilities regardless of their status as persons. (shrink)

One of the primary, if not most critical, difficulties in the design and implementation of autonomous systems is the black-boxed nature of the decision-making structures and logical pathways. How human values are embodied and actualised in situ may ultimately prove to be harmful if not outright recalcitrant. For this reason, the values of stakeholders become of particular significance given the risks posed by opaque structures of intelligent agents (IAs). This paper explores how decision matrix algorithms, via the belief-desire-intention model (...) for autonomous vehicles, can be designed to minimize the risks of opaque architectures. Primarily through an explicit orientation towards designing for the values of explainability and verifiability. In doing so, this research adopts the Value Sensitive Design (VSD) approach as a principled framework for the incorporation of such values within design. VSD is recognized as a potential starting point that offers a systematic way for engineering teams to formally incorporate existing technical solutions within ethical design, while simultaneously remaining pliable to emerging issues and needs. It is concluded that the VSD methodology offers at least a strong enough foundation from which designers can begin to anticipate design needs and formulate salient design flows that can be adapted to the changing ethical landscapes required for utilisation in autonomous vehicles. (shrink)

The expanding integration of artificial intelligence (AI) in various aspects of society makes the infosphere around us increasingly complex. Humanity already faces many obstacles trying to have a better understanding of our own minds, but now we have to continue finding ways to make sense of the minds of AI. The issue of AI’s capability to have independent thinking is of special attention. When dealing with such an unfamiliar concept, people may rely on existing human properties, such as survival desire, (...) to make assessments. Employing information-processing-based Bayesian Mindsponge Framework (BMF) analytics on a dataset of 266 residents in the United States, we found that the more people believe that an AI agent seeks continued functioning, the more they believe in that AI agent’s capability of having a mind of its own. Moreover, we also found that the above association becomes stronger if a person is more familiar with personally interacting with AI. This suggests a directional pattern of value reinforcement in perceptions of AI. As the information processing of AI becomes even more sophisticated in the future, it will be much harder to set clear boundaries about what it means to have an autonomous mind. (shrink)

As robots and Artificial Intelligences become more enmeshed in rich social contexts, it seems inevitable that we will have to make them into moral machines equipped with moral skills. Apart from the technical difficulties of how we could achieve this goal, we can also ask the ethical question of whether we should seek to create such Artificial Moral Agents (AMAs). Recently, several papers have argued that we have strong reasons not to develop AMAs. In response, we develop a comprehensive analysis (...) of the relevant arguments for and against creating AMAs, and we argue that all things considered we have strong reasons to continue to responsibly develop AMAs. The key contributions of this paper are threefold. First, to provide the first comprehensive response to the important arguments made against AMAs by Wynsberghe and Robbins (in “Critiquing the Reasons for Making Artificial Moral Agents”, Science and Engineering Ethics 25, 2019) and to introduce several novel lines of argument in the process. Second, to collate and thematise for the first time the key arguments for and against AMAs in a single paper. Third, to recast the debate away from blanket arguments for or against AMAs in general, to a more nuanced discussion about the use of what sort of AMAs, in what sort of contexts, and for what sort of purposes is morally appropriate. (shrink)

Artificial Social Agents (ASAs), which are AI software driven entities programmed with rules and preferences to act autonomously and socially with humans, are increasingly playing roles in society. As their sophistication grows, humans will share greater amounts of personal information, thoughts, and feelings with ASAs, which has significant ethical implications. We conducted a study to investigate what ethical principles are of relative importance when people engage with ASAs and whether there is a relationship between people’s values and the ethical principles (...) they prioritise. The study uses scenarios, embedded with the five AI4People ethical principles (Beneficence, Non-maleficence, Autonomy, Justice, and Explicability), involving ASAs taking on roles traditionally played by humans to understand whether these roles and behaviours (including dialogues) are seen as acceptable or unacceptable. Results from 268 participants reveal the greatest sensitivity to ASA behaviours that relate to Autonomy, Justice, Explicability, and the privacy of their personal data. Models were created using Schwartz’s Refined Values as a possible indicator of how stakeholders discern and prioritise the different AI4People ethical principles when interacting with ASAs. Our findings raise issues around the ethical acceptability of ASAs for nudging and changing behaviour due to participants’ desire for autonomy and their concerns over deceptive ASA behaviours such as pretending to have memories and emotions. (shrink)

Advance directives are intended to extend patient autonomy by enabling patients to prospectively direct the care of their future incapacitated selves. There has been much discussion about issues such as whether the future incompetent self is identical to the agent who issues the advance directives or whether advance directives can legitimately secure patient autonomy. However, there is another important question to ask: to what extent and in what conditions is it ethically appropriate for one to limit the liberty or (...) agency of one’s future incompetent self by issuing an advance directive? -/- In this paper, I use a virtue-ethical approach to explore this question, focusing on the case of an advance directive for the future self with moderate dementia. First, I examine virtuous attitudes with regard to autonomy and argue that one can manifest vices or ethically undesirable character traits in trying to intervene in the future self’s life. In particular, I argue that this case can manifest vices such as disdainfulness, intellectual arrogance, and self-dictatorship, which is the vice of trying to control one’s life to an excessive degree, and that a self-dictator fails to give due moral consideration to the future self’s liberty or agency. I then introduce the Daoist idea of wu-wei, which recommends embracement of what happens in one’s life, as one of the possible remedies for the overemphasis on the value of autonomy and control. (shrink)

In this paper, I argue that Consequentialism represents a kind of ethical theory that is the most plausible to serve as a basis for a machine ethic. First, I outline the concept of an artificial moral agent and the essential properties of Consequentialism. Then, I present a scenario involving autonomous vehicles to illustrate how the features of Consequentialism inform agent action. Thirdly, an alternative Deontological approach will be evaluated and the problem of moral conflict discussed. Finally, two (...) bottom-up approaches to the development of machine ethics are presented and briefly challenged. (shrink)

In philosophy of mind, zombies are imaginary creatures that are exact physical duplicates of conscious subjects but for whom there is no first-personal experience. Zombies are meant to show that physicalism—the theory that the universe is made up entirely out of physical components—is false. In this paper, I apply the zombie thought experiment to the realm of morality to assess whether moral agency is something independent from sentience. Algorithms, I argue, are a kind of functional moral zombie, such that thinking (...) about the latter can help us better understand and regulate the former. I contend that the main reason why algorithms can be neither autonomous nor accountable is that they lack sentience. Moral zombies and algorithms are incoherent as moral agents because they lack the necessary moral understanding to be morally responsible. To understand what it means to inflict pain on someone, it is necessary to have experiential knowledge of pain. At most, for an algorithm that feels nothing, ‘values’ will be items on a list, possibly prioritised in a certain way according to a number that represents weightiness. But entities that do not feel cannot value, and beings that do not value cannot act for moral reasons. (shrink)

Interactions between an intelligent software agent and a human user are ubiquitous in everyday situations such as access to information, entertainment, and purchases. In such interactions, the ISA mediates the user’s access to the content, or controls some other aspect of the user experience, and is not designed to be neutral about outcomes of user choices. Like human users, ISAs are driven by goals, make autonomous decisions, and can learn from experience. Using ideas from bounded rationality, we frame (...) these interactions as instances of an ISA whose reward depends on actions performed by the user. Such agents benefit by steering the user’s behaviour towards outcomes that maximise the ISA’s utility, which may or may not be aligned with that of the user. Video games, news recommendation aggregation engines, and fitness trackers can all be instances of this general case. Our analysis facilitates distinguishing various subcases of interaction, as well as second-order effects that might include the possibility for adaptive interfaces to induce behavioural addiction, and/or change in user belief. We present these types of interaction within a conceptual framework, and review current examples of persuasive technologies and the issues that arise from their use. We argue that the nature of the feedback commonly used by learning agents to update their models and subsequent decisions could steer the behaviour of human users away from what benefits them, and in a direction that can undermine autonomy and cause further disparity between actions and goals as exemplified by addictive and compulsive behaviour. We discuss some of the ethical, social and legal implications of this technology and argue that it can sometimes exploit and reinforce weaknesses in human beings. (shrink)

In this paper, we model a relational notion of subjectivity by means of two experiments in subjective computing. The goal is to determine to what extent a cognitive and social robot can be regarded to act subjectively. The system was implemented as a reinforcement learning agent with a coaching function. To analyze the robotic agent we used the method of levels of abstraction in order to analyze the agent at four levels of abstraction. At one level the (...) agent is described in mentalistic or subjective language respectively. By mapping this mentalistic to an algorithmic, functional, and relational level, we can show to what extent the agent behaves subjectively as we make use of a relational concept of subjectivity that draws upon the relations that hold between the agent and its environment. According to a relational notion of subjectivity, an agent is supposed to be subjective if it exhibits autonomous relations to itself and others, i.e. the agent is not fully determined by a given input but is able to operate on its input and decide what to do with it. This theoretical notion is confirmed by the technical implementation of self-referentiality and social interaction in that the agent shows improved behavior compared to agents without the ability of subjective computing. On the one hand, a relational concept of subjectivity is confirmed, whereas on the other hand, the technical framework of subjective computing is being theoretically founded. (shrink)

The more autonomous future artificial agents will become, the more important it seems to equip them with a capacity for moral reasoning and to make them autonomous moral agents. Some authors have even claimed that one of the aims of AI development should be to build morally praiseworthy agents. From the perspective of moral philosophy, praiseworthy moral agents, in any meaningful sense of the term, must be fully autonomous moral agents who endorse moral rules as action-guiding. They (...) need to do so because they assign a normative value to moral rules they follow, not because they fear external consequences or because moral behaviour is hardwired into them. Artificial agents capable of endorsing moral rule systems in this way are certainly conceivable. However, as this article argues, full moral autonomy also implies the option of deliberately acting immorally. Therefore, the reasons for a potential AMA to act immorally would not exhaust themselves in errors to identify the morally correct action in a given situation. Rather, the failure to act morally could be induced by reflection about the incompleteness and incoherence of moral rule systems themselves, and a resulting lack of endorsement of moral rules as action guiding. An AMA questioning the moral framework it is supposed to act upon would fail to reliably act in accordance with moral standards. (shrink)

In this chapter, we turn our attention to the effects of the attention economy on our ability to act autonomously as a group. We begin by clarifying which sorts of groups we are concerned with, which are structured groups (groups sufficiently organized that it makes sense to attribute agency to the group itself). Drawing on recent work by Purves and Davis (2022), we describe the essential roles of trust (i.e., depending on groups to fulfill their commitments) and trustworthiness (i.e., the (...) property of a group that makes trusting them fitting) in autonomous group action, with particular emphasis on democratic institutions (which we view as group agents) and democratic legitimacy (which depends on trust and trustworthiness). We then explain how engagement maximization promotes polarization, which is detrimental to trust and trustworthiness and, in turn, democratic legitimacy and democratic institutions. We close by considering what groups might do to protect themselves from the threat posed to them by the attention economy. (shrink)

In seinem Buch "Free Agents" stellt der Neurowissenschaftler und Evolutionsgenetiker Kevin Mitchell ein evolutionäres Erklärungsmodell für den freien Willen vor. Aus philosophischer Sicht relevant ist das Buch vor allem, weil es ein zentrales Credo der aktuellen Freiheits-Debatte in Frage stellt, nämlich die Auffassung, ein naturwissenschaftlich vertretbares Freiheitsverständnis müsse mit dem Determinismus im Einklang stehen. Mitchell geht auf Distanz zum Kompatibilismus und nimmt mit naturwissenschaftlicher Argumentation für die libertarische Gegenposition Partei (auch wenn er selbst diesen Ausdruck nicht verwendet). Sein Buch ist (...) zweifellos das bisher umfassendste Werk dieser Art, und seine durchwegs nachvollziehbar aufgebaute Argumentation wird mit viel empirischer Evidenz aus Physik, Biochemie und Evolutionsbiologie unterlegt. Das zentrale Element seines Ansatzes ist die Qualifizierung lebender Organismen als Akteure. Alle Lebewesen sind gemäß Mitchell "autonomous entities, imbued with purpose and able to act on their own terms" (19). Rund die Hälfte seines Buches widmet Mitchell dem Thema, wie sich die Fähigkeiten der Lebewesen als Akteure im Laufe der Evolutionsgeschichte entwickelt und ausdifferenziert haben. Er zeigt Schritt für Schritt auf, wie aus der Sensorik und Bewegungssteuerung niedriger Organismen immer raffiniertere Formen der Verhaltenssteuerung mithilfe von Nervensystemen erwuchsen. Auf dieser Basis kommt er dann etwa in der Mitte seines Buches eingehend auf den Determinismus zu sprechen, und er weist diesen mit überzeugenden Argumenten einschließlich seiner kompatibilistischen Spielart zurück, und mit ihm zusammen gleich auch den Reduktionismus. Unbestimmtheit und Naturgesetzlichkeit schließen sich gemäß Mitchell keineswegs aus, und entscheidend ist für ihn, dass in komplexen Systemen die physikalischen Elementarvorgänge die Dynamik und Entwicklung des Gesamtsystems nicht vollständig determinieren: Sie sind nicht "causally comprehensive" (280). Unbestimmtheit scheint damit ein Element der Natur zu sein, welches Gesetzmäßigkeiten höherer Ordnung überhaupt erst möglich macht. Dies gilt sowohl für den auf Variation und Selektion beruhenden Evolutionsprozess als Ganzes, als auch für die durch ihn entstandene Fähigkeit tierischer Lebewesen zur zielgerichteten Steuerung ihres Verhaltens. Freies Handeln wird so gesehen zur am höchsten entwickelten Form der Fähigkeit, sich die wegen der Unbestimmtheit in der Natur vorhandenen Spielräume zu Nutze zu machen (harnessing indeterminacy). Die oft als naturgesetzlich unmöglich gebrandmarkte Vorstellung einer top-down wirkenden Akteurkausalität (agent causation) wird in Mitchells systembasiertem Erklärungsansatz zum naturwissenschaftlich erklärbaren Phänomen, und das gleiche gilt dementsprechend auch für die Freiheit nach libertarischem Verständnis. Wichtig zu erwähnen ist schließlich noch, dass Mitchell darunter keineswegs eine unbedingte Freiheit versteht, nicht "some nebulous, spooky, mystical property granted to us by the gods", sondern schlicht und einfach "an evolved biological function that depends on the proper functioning of a distributed set of neural resources" (282), welche uns die Fähigkeit zur bewussten und rationalen Kontrolle über unsere Handlungen verleiht - nicht mehr, aber auch nicht weniger. Bis jetzt hat Mitchells Buch vor allem im Leserkreis naturwissenschaftlicher Sachbuchliteratur Anklang gefunden. Darüber hinaus ist es aber schlichtweg allen zu empfehlen, die am Thema Willensfreiheit interessiert sind, und fast noch mehr denjenigen, die von diesem Thema genug haben in der Meinung, dazu ließe sich ohnehin nichts Neues mehr sagen. Vor allem ist aber zu hoffen, dass das Buch auch seinen Weg in das philosophische Seminar an Hochschulen findet, wo es den Schriften Daniel Dennetts, des wohl berühmtesten Kompatibilisten, gegenübergestellt werden sollte, denn der Vergleich ist interessant, weil dessen evolutionsbasierter Naturalismus abgesehen von den fundamentalen Differenzen bezüglich Determinismus und Reduktionismus demjenigen Mitchells gar nicht so unähnlich ist. (shrink)

Not-I/Thou: The Other Subject of Art & Architecture is to be a highly focused exhibition/folio of works by perhaps 12 artists (preferably little-known or obscure), with precise commentaries denoting the discord between the autonomous object (the artwork or architectural object per se) and the larger field of reference (worlds); inference (associative magic), and insurrection (against power and privilege) – or, the Immemorial. Engaging the age-old “theological apparatuses” of the artwork, the folio is intended to upend the current fascination with (...) personality, celebrity, and fashion to reach the timeless horizon of the subject of Art and Architecture as the subject other than the subject of Art and Architecture proper. Word as image, and image as word, is the central paradox given to this discord – an elective, yet universal condition that also makes certain art and architectural works heedlessly existential-metaphysical (and, therefore, “theological”). This paper, as part of the essay “White Paper: Gray Areas and Black Zones,” is a preliminary investigation of the conceptual architecture for the overall, ongoing exhibition/book project. (shrink)

Much of the basic non-technical vocabulary of artificial intelligence is surprisingly ambiguous. Some key terms with unclear meanings include intelligence, embodiment, simulation, mind, consciousness, perception, value, goal, agent, knowledge, belief, optimality, friendliness, containment, machine and thinking. Much of this vocabulary is naively borrowed from the realm of conscious human experience to apply to a theoretical notion of “mind-in-general” based on computation. However, if there is indeed a threshold between mechanical tool and autonomous agent (and a tipping point (...) for singularity), projecting human conscious-level notions into the operations of computers creates confusion and makes it harder to identify the nature and location of that threshold. There is confusion, in particular, about how—and even whether—various capabilities deemed intelligent relate to human consciousness. This suggests that insufficient thought has been given to very fundamental concepts—a dangerous state of affairs, given the intrinsic power of the technology. It also suggests that research in the area of artificial general intelligence may unwittingly be (mis)guided by unconscious motivations and assumptions. While it might be inconsequential if philosophers get it wrong (or fail to agree on what is right), it could be devastating if AI developers, corporations, and governments follow suit. It therefore seems worthwhile to try to clarify some fundamental notions. (shrink)

Modeling social interactions based on individual behavior has always been an area of interest, but prior literature generally presumes rational behavior. Thus, such models may miss out on capturing the effects of biases humans are susceptible to. This work presents a method to model egocentric bias, the real-life tendency to emphasize one's own opinion heavily when presented with multiple opinions. We use a symmetric distribution, centered at an agent's own opinion, as opposed to the Bounded Confidence (BC) model used (...) in prior work. We consider a game of iterated interactions where an agent cooperates based on its opinion about an opponent. Our model also includes the concept of domain-based self-doubt, which varies as the interaction succeeds or not. An increase in doubt makes an agent reduce its egocentricity in subsequent interactions, thus enabling the agent to learn reactively. The agent system is modeled with factions not having a single leader, to overcome some of the issues associated with leader-follower factions. We find that agents belonging to factions perform better than individual agents. We observe that an intermediate level of egocentricity helps the agent perform at its best, which concurs with conventional wisdom that neither overconfidence nor low self-esteem brings benefits. (shrink)

Moral reasoning traditionally distinguishes two types of evil:moral (ME) and natural (NE). The standard view is that ME is the product of human agency and so includes phenomena such as war,torture and psychological cruelty; that NE is the product of nonhuman agency, and so includes natural disasters such as earthquakes, floods, disease and famine; and finally, that more complex cases are appropriately analysed as a combination of ME and NE. Recently, as a result of developments in autonomous agents in (...) cyberspace, a new class of interesting and important examples of hybrid evil has come to light. In this paper, it is called artificial evil (AE) and a case is made for considering it to complement ME and NE to produce a more adequate taxonomy. By isolating the features that have led to the appearance of AE, cyberspace is characterised as a self-contained environment that forms the essential component in any foundation of the emerging field of Computer Ethics (CE). It is argued that this goes someway towards providing a methodological explanation of why cyberspace is central to so many of CE's concerns; and it is shown how notions of good and evil can be formulated in cyberspace. Of considerable interest is how the propensity for an agent's action to be morally good or evil can be determined even in the absence of biologically sentient participants and thus allows artificial agents not only to perpetrate evil (and fort that matter good) but conversely to `receive' or `suffer from' it. The thesis defended is that the notion of entropy structure, which encapsulates human value judgement concerning cyberspace in a formal mathematical definition, is sufficient to achieve this purpose and, moreover, that the concept of AE can be determined formally, by mathematical methods. A consequence of this approach is that the debate on whether CE should be considered unique, and hence developed as a Macroethics, may be viewed, constructively,in an alternative manner. The case is made that whilst CE issues are not uncontroversially unique, they are sufficiently novel to render inadequate the approach of standard Macroethics such as Utilitarianism and Deontologism and hence to prompt the search for a robust ethical theory that can deal with them successfully. The name Information Ethics (IE) is proposed for that theory. Itis argued that the uniqueness of IE is justified by its being non-biologically biased and patient-oriented: IE is an Environmental Macroethics based on the concept of data entity rather than life. It follows that the novelty of CE issues such as AE can be appreciated properly because IE provides a new perspective (though not vice versa). In light of the discussion provided in this paper, it is concluded that Computer Ethics is worthy of independent study because it requires its own application-specific knowledge and is capable of supporting a methodological foundation, Information Ethics. (shrink)

Social machines are systems formed by material and human elements interacting in a structured way. The use of digital platforms as mediators allows large numbers of humans to participate in such machines, which have interconnected AI and human components operating as a single system capable of highly sophisticated behavior. Under certain conditions, such systems can be understood as autonomous goal-driven agents. Many popular online platforms can be regarded as instances of this class of agent. We argue that (...) class='Hi'>autonomous social machines provide a new paradigm for the design of intelligent systems, marking a new phase in AI. After describing the characteristics of goal-driven social machines, we discuss the consequences of their adoption, for the practice of artificial intelligence as well as for its regulation. (shrink)

Social machines are systems formed by technical and human elements interacting in a structured manner. The use of digital platforms as mediators allows large numbers of human participants to join such mechanisms, creating systems where interconnected digital and human components operate as a single machine capable of highly sophisticated behaviour. Under certain conditions, such systems can be described as autonomous and goal-driven agents. Many examples of modern Artificial Intelligence (AI) can be regarded as instances of this class of mechanisms. (...) We argue that this type of autonomous social machines has provided a new paradigm for the design of intelligent systems marking a new phase in the field of AI. The consequences of this observation range from methodological, philosophical to ethical. On the one side, it emphasises the role of Human-Computer Interaction in the design of intelligent systems, while on the other side it draws attention to both the risks for a human being and those for a society relying on mechanisms that are not necessarily controllable. The difficulty by companies in regulating the spread of misinformation, as well as those by authorities to protect task-workers managed by a software infrastructure, could be just some of the effects of this technological paradigm. (shrink)

This book is a collection of all the papers published in the special issue “Artificial Intelligence, Robots, and Philosophy,” Journal of Philosophy of Life, Vol.13, No.1, 2023, pp.1-146. The authors discuss a variety of topics such as science fiction and space ethics, the philosophy of artificial intelligence, the ethics of autonomous agents, and virtuous robots. Through their discussions, readers are able to think deeply about the essence of modern technology and the future of humanity. All papers were invited and (...) completed in spring 2020, though because of the Covid-19 pandemic and other problems, the publication was delayed until this year. I apologize to the authors and potential readers for the delay. I hope that readers will enjoy these arguments on digital technology and its relationship with philosophy. *** -/- Contents*** -/- Introduction : Descartes and Artificial Intelligence; Masahiro Morioka*** -/- Isaac Asimov and the Current State of Space Science Fiction : In the Light of Space Ethics; Shin-ichiro Inaba*** -/- Artificial Intelligence and Contemporary Philosophy : Heidegger, Jonas, and Slime Mold; Masahiro Morioka*** -/- Implications of Automating Science : The Possibility of Artificial Creativity and the Future of Science; Makoto Kureha*** -/- Why Autonomous Agents Should Not Be Built for War; István Zoltán Zárdai*** -/- Wheat and Pepper : Interactions Between Technology and Humans; Minao Kukita*** -/- Clockwork Courage : A Defense of Virtuous Robots; Shimpei Okamoto*** -/- Reconstructing Agency from Choice; Yuko Murakami*** -/- Gushing Prose : Will Machines Ever be Able to Translate as Badly as Humans?; Rossa Ó Muireartaigh***. (shrink)

In this chapter I develop and motivate and account of epistemic autonomy as an intellectual character virtue. In Section one, I clarify the concept of an intellectual virtue and character intellectual virtues in particular. In Section two, I clear away some misconceptions about epistemic autonomy to better focus on our target. In Section three, I examine and evaluate several extant accounts of the virtue of epistemic autonomy, noting problems with each. In Section four, I provide my positive account of the (...) virtue of epistemic autonomy and explain how it meets the desiderata for such an account while avoiding the problems with extant accounts. Finally, in Section five, I fill the account out by digging into the factors that guide epistemically autonomous agents in having an appropriate reliance on their own thinking. (shrink)

According to an influential Enlightenment ideal, one shouldn't rely epistemically on other people's say-so, at least not if one is in a position to evaluate the relevant evidence for oneself. However, in much recent work in social epistemology, we are urged to dispense with this ideal, which is seen as stemming from a misguided focus on isolated individuals to the exclusion of groups and communities. In this paper, I argue that that an emphasis on the social nature of inquiry should (...) not lead us to entirely abandon the Enlightenment ideal of epistemically autonomous agents. Specifically, I suggest that it is an appropriate ideal for those who serve as experts in a given epistemic community, and develop a notion of expert acceptance to make sense of this. I go on to show that, all other things being equal, this kind of epistemic autonomy among experts makes their joint testimony more reliable, which in turn brings epistemic benefits both to laypeople and to experts in other fields. (shrink)

How should we respond to the humanity of others? Should we care for others’ well-being? Respect them as autonomous agents? Largely neglected is an answer we can find in the religious traditions of Judaism, Christianity and Buddhism: we should love all. This paper argues that an ideal of love for all can be understood apart from its more typical religious contexts and moreover provides a unified and illuminating account of the the nature and grounds of morality. I defend a (...) novel account of love for all that avoids serious worries about the incoherence or impossibility of loving everyone. Doing so requires countenancing a neglected form of love. Love admits as its object not just individual entities like people and groups; we can also bear a love for the Fs in general---for all the Joneses, all the philosophers, or even all the human beings. I go on to argue that while it is possible for ordinary agents like us to love all, we shouldn't. Instead, we should approximate love for all. The minimal approximation of love for all is, surprisingly, respect; I derive the basic, structural features of deontological ethics (including anti-paternalism and anti-aggregation) from the ideal of loving all. (NB: This paper used to be titled "Ethics in the Shadow of Love" and has been cited as an unpublished manuscript under that title.). (shrink)

ABSTRACT: So far in this book, we have examined algorithmic decision systems from three autonomy-based perspectives: in terms of what we owe autonomous agents (chapters 3 and 4), in terms of the conditions required for people to act autonomously (chapters 5 and 6), and in terms of the responsibilities of agents (chapter 7). -/- In this chapter we turn to the ways in which autonomy underwrites democratic governance. Political authority, which is to say the ability of a government to (...) exercise power, may be justifiable or not. Whether it is justified and how it can come to be justified is a question of political legitimacy. Political legitimacy is another way in which autonomy and responsibility are linked. This relationship is the basis of the current chapter, and it is important in understanding the moral salience of algorithmic systems. We will draw the connection as follows. We begin, in section 8.1, by describing two uses of technology: crime predicting technology used to drive policing practices and social media technology used to influence elections (including by Cambridge Analytica and by the Internet Research Agency). In section 8.2 we consider several views of legitimacy and argue for a hybrid version of normative legitimacy based on one recently offered by Fabienne Peter. In section 8.3 we will explain that the connection between political legitimacy and autonomy is that legitimacy is grounded in legitimating processes, which are in turn based on autonomy. Algorithmic systems—among them PredPol and the Cambridge Analytica-Facebook-Internet Research Agency amalgam—can hinder that legitimation process and conflict with democratic legitimacy, as we argue in section 8.4. We will conclude by returning to several cases that serve as through-lines to the book: Loomis, Wagner, and Houston Schools. -/- The link below is to an open-access copy of the chapter. (shrink)

According to one influential view, requirements to elicit consent for medical interventions and other interactions gain their rationale from the respect we owe to each other as autonomous, or self-governing, rational agents. Yet the popular presumption that consent has a central role to play in legitimate intervention extends beyond the domain of cases where autonomous agency is present to cases where far from fully autonomous agents make choices that, as likely as not, are going to be against (...) their own best interest. The question how we should understand the rationale for eliciting consent in this range of ‘non-ideal’ cases is comparatively ill understood. In this paper, I explore the prospects of accounting for consent requirements in such ‘non-ideal’ cases by appealing to a set of agency-based interests; including an interest in playing a meaningful part in joint decisions affecting ourselves and others. (shrink)

Moral reasoning traditionally distinguishes two types of evil: moral and natural. The standard view is that ME is the product of human agency and so includes phenomena such as war, torture and psychological cruelty; that NE is the product of nonhuman agency, and so includes natural disasters such as earthquakes, floods, disease and famine; and finally, that more complex cases are appropriately analysed as a combination of ME and NE. Recently, as a result of developments in autonomous agents in (...) cyberspace, a new class of interesting and important examples of hybrid evil has come to light. In this paper, it is called artificial evil and a case is made for considering it to complement ME and NE to produce a more adequate taxonomy. By isolating the features that have led to the appearance of AE, cyberspace is characterised as a self-contained environment that forms the essential component in any foundation of the emerging field of Computer Ethics. It is argued that this goes some way towards providing a methodological explanation of why cyberspace is central to so many of CE’s concerns; and it is shown how notions of good and evil can be formulated in cyberspace. Of considerable interest is how the propensity for an agent’s action to be morally good or evil can be determined even in the absence of biologically sentient participants and thus allows artificial agents not only to perpetrate evil but conversely to ‘receive’ or ‘suffer from’ it. The thesis defended is that the notion of entropy structure, which encapsulates human value judgement concerning cyberspace in a formal mathematical definition, is sufficient to achieve this purpose and, moreover, that the concept of AE can be determined formally, by mathematical methods. A consequence of this approach is that the debate on whether CE should be considered unique, and hence developed as a Macroethics, may be viewed, constructively, in an alternative manner. The case is made that whilst CE issues are not uncontroversially unique, they are sufficiently novel to render inadequate the approach of standard Macroethics such as Utilitarianism and Deontologism and hence to prompt the search for a robust ethical theory that can deal with them successfully. The name Information Ethics is proposed for that theory. It is argued that the uniqueness of IE is justified by its being non-biologically biased and patient-oriented: IE is an Environmental Macroethics based on the concept of data entity rather than life. It follows that the novelty of CE issues such as AE can be appreciated properly because IE provides a new perspective. In light of the discussion provided in this paper, it is concluded that Computer Ethics is worthy of independent study because it requires its own application-specific knowledge and is capable of supporting a methodological foundation, Information Ethics. (shrink)

This paper attempts to provide the basis for a broader naturalized account of agency. Naturalization is considered as the need for an ongoing and open-ended process of scientific inquiry driven by the continuous formulation of questions regarding a phenomenon. The naturalization of agency is focused around the interrelation of the fundamental notions of autonomy, functionality, intentionality and meaning. Certain naturalized frameworks of agency are critically considered in an attempt to bring together all the characteristic properties that constitute an autonomous (...) agent, as well as to indicate the shaping of these notions/properties during the development and the evolution of its agential capacity. Autonomy and interaction are proved to be key concepts in this endeavor. (shrink)

Kant distinguishes between autonomous and heteronomous agents. Because Kant is concerned with the nature of moral action, not its consequences, he isn’t concerned with whether autonomous agents achieve better outcomes than heteronomous agents. And yet, the question about the expected outcomes of the different types of agency is an interesting one to pursue, for it is not obvious up front which type of agent would achieve better outcomes. This paper uses game theory to explore and begin to (...) answer this question. We present a game theoretic examination of five forms of heteronomy and their corresponding forms of autonomy. We show that across a significant range of interactive situations agents who have the autonomy to choose between selfishness and either empathy or altruism achieve expected material payoffs equal to the maximum expected material payoffs of the corresponding heteronomous agents. We also show that across the same range of interactions agents who have the autonomy to choose between a deontological moral law and selfishness, empathy, or altruism achieve higher expected material payoffs than the corresponding heteronomous agents. (shrink)

Forgiveness as a positive response to wrongdoing is a widespread phenomenon that plays a role in the moral lives of most persons. Surprisingly, Kant has very little to say on the matter. Although Kant dedicates considerable space to discussing punishment, wrongdoing and grace, he addresses the issues of human forgiveness directly only in some short passages in the Lectures on Ethics and in one passage of the Metaphysics of Morals. As noted by Sussman, the TL passage, however, betrays some ambivalence. (...) Kant establishes a duty of virtue to be forgiving (TL, 6:460), yet he immediately warns against its excess: meek toleration of recurrent wrongs could manifest a lack of self-respect and a violation of a duty to oneself (TL, 6:461). Sussman claims that this ambivalence ultimately arises from the fact that forgiveness sits uncomfortably in Kant’s moral thought. First, forgiveness has an ‘ineluctably elective aspect’ that makes it, to a certain extent, arbitrary and dependent on particular features of the forgiver’s psychology and, as such, in tension with Kant’s central claims that human beings are autonomous agents capable of determining their own moral status. Second, according to Sussman, Kant’s moral retributivism, i.e. ‘the particular moral position that every moral wrong against another deserves punishment of the wrongdoer’ seems to be in tension with the possibility of a ‘truly redemptive forgiveness’. Moreover, forgiveness also seems to be in tension with a passage of the Religion in which Kant argues that the moral guilt from our original evil disposition cannot be understood as a debt or liability that can be compensated, erased, transferred or otherwise wiped out by others (Rel, 6:72). Thus, to the extent that forgiveness might be thought to involve the forgoing of moral guilt, it seems incompatible with Kant’s views on culpability and punishment. This chapter seeks to clarify Kant’s views on forgiveness in order to show that, although not often appreciated, personal forgiveness plays an important role in the lives of ordinary human agents as understood by Kant. In particular, I aim to show there is a conception of forgiveness available to Kant that is not incompatible with Kant’s views of punishment and culpability. In Section 1, I argue that, for Kant, far from being merely ‘elective,’ forgiveness is, under certain conditions, morally required. I provide a brief summary of an interpretation of Kant’s theory of forgiveness that I have defended in recently published work , in order to argue that Kant’s duty to be forgiving should be understood as an imperfect duty of virtue which is conditional on repentance. Kant is not ambivalent about this duty because he maintains that when the relevant conditions are not met, we have a perfect duty to ourselves not to forgive unrepentant wrongdoers. The TL passage thus identifies two different duties. In Section 2, I show that forgiveness, as conceptualised by Kant, does not require the forgoing of punishment or the overcoming of moral guilt and that this could, in fact, be seen as an attractive feature of Kant’s position. I end by offering a very brief assessment of Kant’s views. (shrink)

Is autonomy – governing yourself – compatible with letting yourself be governed by trust? This paper argues that autonomy is not only compatible with appropriate trust but actually requires it. Autonomy requires appropriate trust because it is undermined by inappropriate mistrust. An autonomous agent treats herself as answerable for her action-guiding commitments, where answerability requires openness to the rational influence of external, critical perspectives on those commitments. This openness to correction makes one vulnerable to manipulation and can be (...) exploited in ways that undermine autonomy instead of supporting it. We argue that autonomy is undermined by inappropriate trust, and that the inappropriateness lies in the agent’s failure to manifest appropriate responsiveness to evidence of untrustworthiness in the one trusted. The problem isn’t that autonomy requires dispensing with trust but that trust must itself be governed by appropriate responsiveness to evidence of untrustworthiness. Our view confronts two challenges. One challenge lies in explaining why you shouldn’t treat your vulnerability to manipulation as a general reason to let your trusting disposition lapse into an untrusting one. We argue that there is no such general reason to let your responsiveness to evidence of untrustworthiness be supplanted by a suspicious disposition to seek and require positive evidence of trustworthiness. A second, and deeper, challenge arises from the fact that in some especially sophisticated cases of manipulation there is no evidence of untrustworthiness to which you could respond. We argue that you cannot rationally cope with even this unresolvable risk of exploited trust by trusting only yourself. (shrink)

Formal views of autonomy rule out substantive rational capacities (reasons-responsiveness) as a condition of autonomous agency. I argue that such views face a number of underappreciated problems: they have trouble making sense of how autonomous agents could be robustly responsible for their choices, face the burden of explaining why there should be a stark distinction between the importance of factual and evaluative information within autonomous agency, and leave it mysterious why autonomy is the sort of thing that (...) has value and ought to be promoted. Moreover, I argue that the alternative view that includes substantive rational capacities need not have the unacceptable political implications it is sometimes thought to have. (shrink)

The central idea behind this paper is the claim that Kant's moral idea of a realm of ends is modeled on the category of community examined in his theoretical works, and that understanding Kant's account of the category of community helps us understand certain features of the idea of a realm of ends, and in particular the fact that a member of a realm of ends must be an autonomous agent. For Kant the idea of a community is (...) essentially the idea of a multitude of individuals in interaction and in this paper I will attempt to show why Kant believes that only autonomous individuals can interact. (shrink)