Cooperation is vital to our survival and progress. Evolutionary game theory offers a lens to understand the structures and incentives that enable cooperation to be a successful strategy. As artificial intelligence agents become integral to human systems, the dynamics of cooperation take on unprecedented significance. Decentralized frameworks like Web3, grounded in transparency, accountability, and trust, offer a foundation for fostering cooperation by establishing enforceable rules and incentives for humans and AI agents. Guided by our Incentivized Symbiosis model, a paradigm (...) aligning human and AI agent goals through bidirectional incentives and mutual adaptation, we investigate mechanisms for embedding cooperation into human-agent coevolution. We conceptualize Incentivized Symbiosis as part of a contemporary moral framework inspired by Web3 principles, encoded in blockchain technology to define and enforce rules, incentives, and consequences for both humans and AI agents. By integrating these principles into the very architecture of human-agent interactions, Web3 ecosystems catalyze an environment ripe for collaborative innovation. Our study traverses several transformative applications of Incentivized Symbiosis, from decentralized finance to governance and cultural adaptation, illustrating how AI agents can coevolve with humans to forge a trajectory of shared, sustainable progress. (shrink)

In his wide-ranging study of architecture and cultural evolution, Chris Abel argues that, despite progress in sustainable development and design, resistance to changing personal and social identities shaped by a technology-based and energy-hungry culture is impeding efforts to avert drastic climate change. The book traces the roots of that culture to the coevolution of Homo sapiens and technology, from the first use of tools as artificial extensions of the human body to the motorized cities spreading around the world, (...) whose uncontrolled effects are fast changing the planet itself. Advancing a new concept of the meme, called the 'technical meme', as the primary agent of cognitive extension and technical embodiment, Abel proposes a theory of the 'extended self' as a complex and diffuse outcome of that coevolution. Challenging conventional ideas of the self as a separate and autonomous being, the extended self, he explains, encompasses material and spatial as well as psychological and social elements, including the built environment and artifacts, and now reaches out into the virtual world of cyberspace. Drawing upon research into extended cognition and embodied minds from philosophy, psychology and the neurosciences, the book presents a new approach to environmental and cultural studies. N.B. This book was the winner of the International Committee of Architectural Critics 2017 Bruno Zevi Book Award by unanimous decision of the international jury. (shrink)

In computational cognitive science, a valuationist picture of human agent architecture has become widespread. At the heart of valuationism is a simple and sweeping claim: Every time an agent acts, they do so on the basis of value representations, which are, roughly, representations of the expected value of one’s response options. In this essay, I do three things. First, I give a systematic, philosophically rich account of the valuationist picture of agency. I also highlight the generality of (...) the model in explaining diverse forms of person-level agency. Second, I discuss connections between the valuationist model and two traditional models in philosophy, the belief/desire model and the decision-theoretic model. Valuationism is related to both, but critical differences remain. Third, I canvas the wide-ranging implications of valuationism for philosophical inquiry. Among other things, valuationism illuminates the elusive boundary between activity and passivity; it flips the standard philosophical understanding of decision around, with decision being a source of, rather than a product of, one’s agency; it reconceptualizes motivation as, in part, a representational phenomenon; it challenges a philosophical dogma that control over action is more extensive than control over belief; and it offers an intriguing “accuracy-based” approach to the normative criticism of agency. (shrink)

The following is an interpretation of Aquinas’ agent intellect focusing on Summa Theologiae I, qq. 75-89, and proposing that the agent intellect is a metaphysical rather than a formal a priori of human understanding. A formal a priori is responsible for the intelligibility as content of the object of human understanding and is related to Kant’s epistemological views; whereas a metaphysical a priori is responsible for intelligibility as mode of being of this same object. We can (...) find in Aquinas’ text many indications that the agent intellect is not productive of the universal as content but is, rather, productive of the abstracted or intelligible mode of being of the universal nature. This is because for Aquinas the universal nature, which is the object of human understanding, is present in the things themselves but with a different mode of being. Chapter 1 is intended to establish the fact which requires for Aquinas an agent intellect, and provides two very important principles: one is that the object of human understanding (the universal nature) is present in the things themselves and, the other, that it is not in the things themselves with a mode of being which makes it available to the intellectual eye. These two principles lead us to the main point of Chapter 2, namely the distinction between the intelligible object and its intelligible mode of being. Now, because knowing is receptive of the intelligible object (Chapter 3), which is present in the things themselves (Chapter 1), the agent intellect is productive not of the object’s intelligible content, but of its abstracted or intelligible mode of being (Chapter 4). (shrink)

Interactions between an intelligent software agent and a human user are ubiquitous in everyday situations such as access to information, entertainment, and purchases. In such interactions, the ISA mediates the user’s access to the content, or controls some other aspect of the user experience, and is not designed to be neutral about outcomes of user choices. Like human users, ISAs are driven by goals, make autonomous decisions, and can learn from experience. Using ideas from bounded rationality, we (...) frame these interactions as instances of an ISA whose reward depends on actions performed by the user. Such agents benefit by steering the user’s behaviour towards outcomes that maximise the ISA’s utility, which may or may not be aligned with that of the user. Video games, news recommendation aggregation engines, and fitness trackers can all be instances of this general case. Our analysis facilitates distinguishing various subcases of interaction, as well as second-order effects that might include the possibility for adaptive interfaces to induce behavioural addiction, and/or change in user belief. We present these types of interaction within a conceptual framework, and review current examples of persuasive technologies and the issues that arise from their use. We argue that the nature of the feedback commonly used by learning agents to update their models and subsequent decisions could steer the behaviour of human users away from what benefits them, and in a direction that can undermine autonomy and cause further disparity between actions and goals as exemplified by addictive and compulsive behaviour. We discuss some of the ethical, social and legal implications of this technology and argue that it can sometimes exploit and reinforce weaknesses in human beings. (shrink)

This paper has three goals. The first is to introduce the “knowledge game”, a new, simple and yet powerful tool for analysing some intriguing philosophical questions. The second is to apply the knowledge game as an informative test to discriminate between conscious (human) and conscious-less agents (zombies and robots), depending on which version of the game they can win. And the third is to use a version of the knowledge game to provide an answer to Dretske’s question “how do (...) you know you are not a zombie?”. (shrink)

Sacred value attitudes involve a distinctive profile of norm psychology: an absolutist prohibition on transgressing the value, combined with outrage at even hypothetical transgressions. This article considers three mechanisms by which such attitudes may be adaptive, and relates them to central theories regarding the evolution of religion. The first, “deterrence” mechanism functions to dissuade coercive expropriation of valuable resources. This mechanism explains the existence of sacred value attitudes prior to the development of religion and also explains analogues of sacred value (...) in non-human species. The two remaining mechanisms, “assurance” and “coalitional,” are more likely to have been involved in the cultural evolution of specifically religious behavior. In the assurance mechanism, sacred value attitudes increase the cost of ideological commitments, making them more reliable as signals of a cooperative disposition. In the coalitional mechanism, sacred value attitudes make it dangerous for third parties to dissent from a social norm, and thus discourage competitor ideologies. While both these mechanisms are compatible with major accounts of the evolution of religion, different theories suggest a greater or lesser emphasis on one mechanism or the other. (shrink)

Meanings are present everywhere in our environment and within ourselves. But these meanings do not exist by themselves. They are associated to information and have to be created, to be generated by agents. The Meaning Generator System (MGS) has been developed on a system approach to model meaning generation in agents following an evolutionary perspective. The agents can be natural or artificial. The MGS generates meaningful information (a meaning) when it receives information that has a connection with an internal constraint (...) to which the agent is submitted. The generated meaning is to be used by the agent to implement actions aimed at satisfying the constraint. We propose here to highlight some characteristics of the MGS that could be related to items of philosophy of information. (shrink)

The dilemma of free will is that if actions are caused deterministically, then they are not free, and if they are not caused deterministically then they are not free either because then they happen by chance and are not up to the agent. I propose a conception of free will that solves this dilemma. It can be called agent causation but it differs from what Chisholm and others have called so.

This dissertation is a defence of agent-regret and an exploration of its role in our lives. I argue that agent-regret shows that an agent takes seriously her status as an agent who impacts the world, but who only has fallible control over it. To accept responsibility for any outcomes, she must accept responsibility for unintended outcomes, too: agent-regret is part of being a human agent. In doing this, I try to defend and develop (...) Williams’s own conception of agent-regret. -/- In the first part, I explore the nature of agent-regret. Agent-regret is distinct from guilt because we can feel agent-regret without being at fault. I argue that several challenges that seek to reduce agent-regret to a form of guilt fail. I further argue that agent-regret takes as its object not only something one has done, but the fact that one did it; I discuss this in terms of what Bernard Williams called taking an “external” view on one’s own action. -/- I suggest that we can best understand the object of agent-regret as one’s responsibility for an outcome. I argue that this form of “responsibility” is conceptually separate from liability or answerability; it concerns whether the outcome can be ascribed to an agent. This is a restricted form of causal responsibility but retains its agential character. I suggest that we can be responsible for outcomes even when we did not intend to bring them about. -/- In the second part, I vindicate the propriety of agent-regret against the ideas that we are not responsible for unintended outcomes or that such responsibility is not important. I set out several challenges to this effect. I argue that we are responsible for unintended outcomes because in order to be responsible as agents at all, we must use fallible abilities. When we exercise these abilities but fail, we are responsible as agents for those unintended outcomes that arise. I then consider the importance of being responsible for particular unintended outcomes and analyse the idea that this affects our identities. I argue that responsibility for an outcome affects a form of identity, but that it does not involve essential features of a person. Instead, our responsibility for outcomes is a contingent feature that nonetheless plays an important role in our interpersonal interactions and self-conceptions. I argue that these reactions are appropriate, because our responsibility for particular outcomes is independently significant—but these reactions also lend this responsibility added significance as part of inescapable human practices. -/- Thus our responsibility for outcomes is important. Its importance means that it can serve as an appropriate object of agent-regret that vindicates the propriety of agent-regret. I end by considering several interesting features of agent-regret, including its expression and “pure” cases, which are cases where an agent feels agent-regret despite not regretting the result of her action. (shrink)

Artificial agents create significant moral opportunities and challenges. Over the last two decades, discourse has largely focused on the concept of a ‘responsibility gap.’ We argue that this concept is incoherent, misguided, and diverts attention from the core issue of ‘control gaps.’ Control gaps arise when there is a discrepancy between the causal control an agent exercises and the moral control it should possess or emulate. Such gaps present moral risks, often leading to harm or ethical violations. We propose (...) a second-order ‘duty of moral control’ that mandates closing these gaps to reduce risks within acceptable moral limits. Our analysis encompasses both autonomous machines and collective agents, acknowledging their similarities and key differences in constitution and moral status. We suggest four methods to close control gaps: ensuring artificial agents attain moral agency, providing meaningful human control, implementing safety engineering, and employing social control. These methods aim to responsibly integrate artificial agents into society. We conclude that a realistic approach, which addresses the practical problems posed by control gaps, is essential. This approach provides solutions to manage the risks posed by artificial agents while maintaining acceptable moral standards, ensuring we responsibly harness their potential and address the ethical challenges they present. (shrink)

Where artificial agents are not liable to be ascribed true moral agency and responsibility in their own right, we can understand them as acting as proxies for human agents, as making decisions on their behalf. What I call the ‘Moral Proxy Problem’ arises because it is often not clear for whom a specific artificial agent is acting as a moral proxy. In particular, we need to decide whether artificial agents should be acting as proxies for low-level agents — (...) e.g. individual users of the artificial agents — or whether they should be moral proxies for high-level agents — e.g. designers, distributors or regulators, that is, those who can potentially control the choice behaviour of many artificial agents at once. Who we think an artificial agent is a moral proxy for determines from which agential perspective the choice problems artificial agents will be faced with should be framed: should we frame them like the individual choice scenarios previously faced by individual human agents? Or should we, rather, consider the expected aggregate effects of the many choices made by all the artificial agents of a particular type all at once? This paper looks at how artificial agents should be designed to make risky choices, and argues that the question of risky choice by artificial agents shows the moral proxy problem to be both practically relevant and difficult. (shrink)

Did we get Aquinas’ Epistemology right? St. Thomas is often interpreted according to Kantian principles, particularly in Transcendental Thomism. When this happens, it can appear as though Aquinas, too—along with Kant—had made the “turn to the subject”; as if Aquinas were no longer the Aristotelian “believer” who thinks nature is what it is but, instead, the Kantian “thinker” who holds that nature is what we think of it; as if St. Thomas, like Kant, had concluded that nature is intelligible not (...) only when we think of it, but because we think of it. After much struggle with this problem, the challenge seemed obvious to me: to show the radical difference between Aquinas and Kant. Kant had reasons to make his turn, his Copernican revolution. Could I explain those reasons, could I pinpoint the problem leading Kant to think in those terms? Could I show Aquinas facing the same problem and clearly taking a different direction in his proposed solution? That is what I have tried to do in this book. This book provides an interpretation of Aquinas’ agent intellect focusing on Summa Theologiae I, qq. 75-89, and proposing that the agent intellect is a metaphysical rather than a formal a priori of human understanding. A formal a priori is responsible for the intelligibility as content of the object of human understanding and is related to Kant’s epistemological views, whereas a metaphysical a priori is responsible for intelligibility as mode of being of this same object. We can find in Aquinas’ text many indications that the agent intellect is not productive of the intelligible object but is, rather, productive of the abstracted or intelligible mode of being of this object. This is because for Aquinas the universal as nature, which is the object of human understanding, is present in the things themselves but with a different mode of being. In this four-chapter book, Chapter 1 is intended to establish the fact which requires for Aquinas an agent intellect, and provides two very important principles: one is that the object of human understanding (the universal as nature) is present in the things themselves and, the other, that it is not in the things themselves with a mode of being which makes it available to the intellectual eye. These two principles lead us to the main point of Chapter 2, namely the distinction between the intelligible object and its intelligible mode of being. Now, because knowing is receptive of the intelligible object (Chapter 3), which is present in the things themselves (Chapter 1), the agent intellect is productive not of the object’s intelligible content, but of its abstracted or intelligible mode of being (Chapter 4). (shrink)

This paper focuses on the research field of machine ethics and how it relates to a technological singularity—a hypothesized, futuristic event where artificial machines will have greater-than-human-level intelligence. One problem related to the singularity centers on the issue of whether human values and norms would survive such an event. To somehow ensure this, a number of artificial intelligence researchers have opted to focus on the development of artificial moral agents, which refers to machines capable of moral reasoning, judgment, (...) and decision-making. To date, different frameworks on how to arrive at these agents have been put forward. However, there seems to be no hard consensus as to which framework would likely yield a positive result. With the body of work that they have contributed in the study of moral agency, philosophers may contribute to the growing literature on artificial moral agency. While doing so, they could also think about how the said concept could affect other important philosophical concepts. (shrink)

Recent advances in natural language processing have given rise to a new kind of AI architecture: the language agent. By repeatedly calling an LLM to perform a variety of cognitive tasks, language agents are able to function autonomously to pursue goals specified in natural language and stored in a human-readable format. Because of their architecture, language agents exhibit behavior that is predictable according to the laws of folk psychology: they function as though they have desires and beliefs, and (...) then make and update plans to pursue their desires given their beliefs. We argue that the rise of language agents significantly reduces the probability of an existential catastrophe due to loss of control over an AGI. This is because the probability of such an existential catastrophe is proportional to the difficulty of aligning AGI systems, and language agents significantly reduce that difficulty. In particular, language agents help to resolve three important issues related to aligning AIs: reward misspecification, goal misgeneralization, and uninterpretability. (shrink)

Imagination contributes to human agency in ways that haven't been well understood. I argue here that pathways from imagistic imagining to emotional engagement support three important agential capacities: 1. bodily preparedness for potential events in one's nearby environment; 2. evaluation of potential future action; and 3. empathy-based moral appraisal. Importantly, however, the kind of pathway in question (I-C-E-C: imagining-categorization-emotion-conceptualization) also enables engagement with fiction. So human enchantment with fiction is a consequence of imaginative pathways that make us the (...) kind of agents we are. Finally, I use this approach to address imaginative resistance and the paradox of fiction. [The version archived here is a penultimate draft. Please email me at [email protected] to receive a pdf of the final in accordance with fair use.]. (shrink)

Agent-causal libertarians maintain we are irreducible agents who, by acting, settle matters that aren’t already settled. This implies that the neural matters underlying the exercise of our agency don’t conform to deterministic laws, but it does not appear to exclude the possibility that they conform to statistical laws. However, Pereboom (Noûs 29:21–45, 1995; Living without free will, Cambridge University Press, Cambridge, 2001; in: Nadelhoffer (ed) The future of punishment, Oxford University Press, New York, 2013) has argued that, if these (...) neural matters conform to either statistical or deterministic physical laws, the complete conformity of an irreducible agent’s settling of matters with what should be expected given the applicable laws would involve coincidences too wild to be credible. Here, I show that Pereboom’s argument depends on the assumption that, at times, the antecedent probability certain behavior will occur applies in each of a number of occasions, and is incapable of changing as a result of what one does from one occasion to the next. There is, however, no evidence this assumption is true. The upshot is the wild coincidence objection is an empirical objection lacking empirical support. Thus, it isn’t a compelling argument against agent-causal libertarianism. (shrink)

The question whether AI systems have agency is gaining increasing importance in discussions of responsibility for AI behavior. This paper argues that an approach to artificial agency needs to be teleological, and consider the role of human goals in particular if it is to adequately address the issue of responsibility. I will defend the view that while AI systems can be viewed as autonomous in the sense of identifying or pursuing goals, they rely on human goals and other (...) values incorporated into their design, and are, as such, dependent on human agents. As a consequence, AI systems cannot be held morally responsible, and responsibility attributions should take into account normative and social aspects involved in the design and deployment of the said AI. My argument falls in line with approaches critical of attributing moral agency to artificial agents, but draws from the philosophy of action, highlighting further philosophical underpinnings of current debates on artificial agency. (shrink)

This chapter revolves around the problem of the disappearing agent. Shepherd suggests that as typically formulated, the problem relies on an improper focus upon the causation of action, and an inadequate characterization of agency. One result is that a key function of mental action for human agents tends to be misconstrued. Furthermore, Shepherd argues that an adequate characterization of agency illuminates why agents may seem (misleadingly) to disappear in some cases of action, and illuminates as well a key (...) function of mental action for human (and similar) agents. According to the sketch offered in this chapter, mental action enables human agents to rationally glue themselves together. (shrink)

Artificial agents have become increasingly prevalent in human social life. In light of the diversity of new human–machine interactions, we face renewed questions about the distribution of moral responsibility. Besides positions denying the mere possibility of attributing moral responsibility to artificial systems, recent approaches discuss the circumstances under which artificial agents may qualify as moral agents. This paper revisits the discussion of how responsibility might be distributed between artificial agents and human interaction partners (including producers of artificial (...) agents) and raises the question of whether attributions of responsibility should remain entirely on the human side. While acknowledging a crucial difference between living human beings and artificial systems culminating in an asymmetric feature of human–machine interactions, this paper investigates the extent to which artificial agents may reasonably be attributed a share of moral responsibility. To elaborate on criteria that can justify a distribution of responsibility in certain human–machine interactions, the role of types of criteria (interaction-related criteria and criteria that can be deferred from socially constructed responsibility relationships) is examined. Thereby, the focus will lay on the evaluation of potential criteria referring to the fact that artificial agents surpass in some aspects the capacities of humans. This is contrasted with socially constructed responsibility relationships that do not take these criteria into account. In summary, situations are examined in which it seems plausible that moral responsibility can be distributed between artificial and human agents. (shrink)

For an artificial agent to be morally praiseworthy, its rules for behaviour and the mechanisms for supplying those rules must not be supplied entirely by external humans. Such systems are a substantial departure from current technologies and theory, and are a low prospect. With foreseeable technologies, an artificial agent will carry zero responsibility for its behavior and humans will retain full responsibility.

While philosophers hold that it is patently absurd to blame robots or hold them morally responsible [1], a series of recent empirical studies suggest that people do ascribe blame to AI systems and robots in certain contexts [2]. This is disconcerting: Blame might be shifted from the owners, users or designers of AI systems to the systems themselves, leading to the diminished accountability of the responsible human agents [3]. In this paper, we explore one of the potential underlying reasons (...) for robot blame, namely the folk's willingness to ascribe inculpating mental states or "mens rea" to robots. In a vignette-based experiment (N=513), we presented participants with a situation in which an agent knowingly runs the risk of bringing about substantial harm. We manipulated agent type (human v. group agent v. AI-driven robot) and outcome (neutral v. bad), and measured both moral judgment (wrongness of the action and blameworthiness of the agent) and mental states attributed to the agent (recklessness and the desire to inflict harm). We found that (i) judgments of wrongness and blame were relatively similar across agent types, possibly because (ii) attributions of mental states were, as suspected, similar across agent types. This raised the question - also explored in the experiment - whether people attribute knowledge and desire to robots in a merely metaphorical way (e.g., the robot "knew" rather than really knew). However, (iii), according to our data people were unwilling to downgrade to mens rea in a merely metaphorical sense when given the chance. Finally, (iv), we report a surprising and novel finding, which we call the inverse outcome effect on robot blame: People were less willing to blame artificial agents for bad outcomes than for neutral outcomes. This suggests that they are implicitly aware of the dangers of overattributing blame to robots when harm comes to pass, such as inappropriately letting the responsible human agent off the moral hook. (shrink)

The prohibition against using others ‘merely as means’ is one of Kant’s most famous ideas, but it has proven difficult to spell out with precision what it requires of us in practice. In ‘How to Use Someone “Merely as a Means”’ (2020), I proposed a new interpretation of the necessary and sufficient conditions for using someone ‘merely as a means’. I argued that my agent-focused actual consent inter- pretation has strong textual support and significant advantages over other readings of (...) the prohibition. In the present essay, I respond to comments by Claudia Blöser, Irina Schumski, and Oliver Sensen. I first address the role of maxims in relation to the Formula of Humanity, and I spell out in more detail the relation between the agent’s belief and the actual facts pertaining to the consent of the person who is used as means to the agent’s end. I then discuss the importance of the requirement that agents make their use of others conditional on the others’ consent as a matter of moral principle. I next show that the proposed reading of the prohibition, despite its focus on the agent’s maxims and practical reasoning, yields important conclusions about the moral status of external actions, and I address several cases that are pur- ported to spell trouble for my reading of Kant’s prohibition. I end by outlining two challenges for possible (rational) consent readings of the prohibition against using others merely as means. (shrink)

The potential capacity for robots to deceive has received considerable attention recently. Many papers explore the technical possibility for a robot to engage in deception for beneficial purposes (e.g., in education or health). In this short experimental paper, I focus on a more paradigmatic case: robot lying (lying being the textbook example of deception) for nonbeneficial purposes as judged from the human point of view. More precisely, I present an empirical experiment that investigates the following three questions: (a) Are (...) ordinary people willing to ascribe deceptive intentions to artificial agents? (b) Are they as willing to judge a robot lie as a lie as they would be when human agents engage in verbal deception? (c) Do people blame a lying artificial agent to the same extent as a lying human agent? The response to all three questions is a resounding yes. This, I argue, implies that robot deception and its normative consequences deserve considerably more attention than they presently receive. (shrink)

In this chapter, I attempt to show that evil exists only if what I call Agent Causal Theism (ACT) is true. According to ACT, human beings are immaterial, conscious agents endued (by God) with a power of self-motion: the power to think, decide, and act for ends in light of reasons, but without being externally caused to do so (even by God himself). By contrast, I argue that there is no space for evil in the worldviews of naturalistic (...) Darwinism or theistic Calvinism. (shrink)

This article faces the classic problem of the interpretation of what Aristotle calls in de An. III, 5 “the intellect that produces all things”, which is commonly named agent intellect. Historically, there have been two approaches: one that goes back to Alexander of Aphrodisias, who associates the agent intellect with the unmoved mover and the divinity, and another one, associated with Theophrastus but whose major representatives are Philoponus and St. Thomas of Aquinas, who consider that agent intellect (...) is an exclusively human faculty. This last interpretation has been the most accepted historically. Nevertheless, in recent years there has been a resurgence of interpretations of the agent intellect as divine (Caston, Frede, Burnyeat, and others). What we want to demonstrate in this article is that this revival, more than responding to a reinterpretation of the agent intellect, is due to a different understanding of the divinity in Aristotle’s philosophy, which supposes immanent characteristics closer to the human intellect. (shrink)

—Commentary on Mikhalevich and Powell on invertebrate minds.— Whether or not arthropods are sentient, they can have moral standing. Appeals to sentience are not necessary and retard progress in human treatment of other species, including invertebrates. Other increasingly well-documented aspects of invertebrate minds are pertinent to their welfare. Even if arthropods are not sentient, they can be agents whose goals—and therefore interests—can be frustrated. This kind of agency is sufficient for moral status and requires that we consider their welfare.

AI-based technologies are increasingly pervasive in a number of contexts. Our affective and emotional life makes no exception. In this article, we analyze one way in which AI-based technologies can affect them. In particular, our investigation will focus on affective artificial agents, namely AI-powered software or robotic agents designed to interact with us in affectively salient ways. We build upon the existing literature on affective artifacts with the aim of providing an original analysis of affective artificial agents and their distinctive (...) features. We argue that, unlike comparatively low-tech affective artifacts, affective artificial agents display a specific form of agency, which prevents them from being perceived by their users as extensions of their selves. In addition to this, we claim that their functioning crucially depends on the simulation of human-like emotion-driven behavior and requires a distinctive form of transparency—we call it emotional transparency—that might give rise to ethical and normative tensions. (shrink)

Normative moral theories are frequently invoked to serve one of two distinct purposes: (1) explicate a criterion of rightness, or (2) provide an ethical decision-making procedure. Although a criterion of rightness provides a valuable theoretical ideal, proposed criteria rarely can be (nor are they intended to be) directly translated into a feasible decision-making procedure. This paper applies the computational framework of bounded rationality to moral decision-making to ask: how ought a bounded human agent make ethical decisions? We suggest (...) agents ought to follow moral maxims: principles that approximate rightness in many situations, but that can be overridden in specific, precisely describable circumstances. While this intuitive idea has been proposed many times before, we provide a precise model of how maxim consequentialism functions as an approximation to an act-consequentialist criterion of rightness, while maintaining the flexibility and defeasibility that has eluded most forms of rule consequentialism. Furthermore, while our overarching aim is to propose a new normative standard of moral decision-making, we demonstrate how maxim consequentialism can also function as a descriptive account of human behavior. We conclude by noting that different criteria of rightness may lead to different maxim-based ethics. (shrink)

Whether we are free agents or not and to what extent depends on factors such as the necessary conditions for free will and our definition of human agency and identity. The present article, apart from possible alternatives and the causality of the agent regarding his actions, addresses the element of inclination as a necessary condition for free will. Therefore, an analysis of these conditions determines that even though in some circumstances the range of alternatives the agent can (...) choose is very limited or the agent chooses an action without having the inclination to choose it; however, this does not make the agent forced; rather, free will has levels and every individual possesses a certain extent of it in different conditions. Just the fact that the ultimate choice is made by the agent himself and has voluntarily performed the act himself ultimately is sufficient for being free. As a result, even though the influence of external factors on human actions cannot be disregarded; however, because the action is ultimately not outside his control, accordingly, there is neither such a thing as a compelled agent and nor are our actions left to luck. The character of the agent that is voluntarily formed through our actions plays a determinant role in our choices and actions due to the epistemic and motivational components they possess. (shrink)

Poverty, understood as basic capability deprivation, can only be solved through a process of expanding the freedoms that people value and have reason to value. This process can only begin if the capability to imagine and aspire for an altenative lifestyle worthy of human dignity is cultivated by an education program that develops both the capability to reason and to value. These two facets play a major role in the creative exercise of human agency. This program of humane (...) education can only come from an adequate description of the human agent as a persona that seeks to actualize itself based on his/her understanding of the good. Education must therefore seek to cultivate the capability to have an adequate conception of the good (normative) as well as the capability to constantly re-evaluate one’s conception of the good (evaluative) in order to freely and reasonably choose a life that one values and has reason to value. Education must therefore entail not merely the development of skills nor specialization in a particular field but must concentrate on the integration of the human person as a whole which leads to self-creative praxis. (shrink)

Commonsense reasoning is a crucial human ability employed in everyday tasks. In this talk I provide a knowledge level analysis of the main representational and reasoning problems affecting the cognitive architectures for what concerns this issue. In providing this analysis I will show, by considering some of the main cognitive architectures currently available (e.g. SOAR, ACT-R, CLARION), how one of the main problems of such architectures is represented by the fact that their knowledge representation and processing mechanisms are not (...) sufficiently constrained with insights coming from cognitive science (Lieto 2021; Lieto, Lebiere, Oltramari, 2018). As a possible way out to such knowledge processing issues, I present the main assumptions that have led to the development of the Dual PECCS categorization system (Lieto, Radicioni, Rho 2017) and discuss some of the lessons learned and their possible implications in the design of the knowledge modules and knowledge-processing mechanisms of integrated cognitive architectures. (shrink)

In this paper I provide an exposition and critique of Johnson and Noorman’s (2014) three conceptualizations of the agential roles artificial systems can play. I argue that two of these conceptions are unproblematic: that of causally efficacious agency and “acting for” or surrogate agency. Their third conception, that of “autonomous agency,” however, is one I have reservations about. The authors point out that there are two ways in which the term “autonomy” can be used: there is, firstly, the engineering sense (...) of the term, which simply refers to the ability of some system to act independently of substantive human control. Secondly, there is the moral sense of the term, which has traditionally grounded many notions of human mor-al responsibility. I argue that the continued usage of “autonomy” in discussions of artificial agency complicates matters unnecessarily. This occurs in two ways: firstly, the condition of autonomy, even in its engineering sense, fails to accurately describe the way “autonomous” systems are developed in practice. Secondly, the continued usage of autonomy in the moral sense introduces unnecessary meta-physical baggage form the free will debate into discussions about moral agency. In order to understand the debate surrounding autonomy, we would therefore first need to settle many seemingly intractable metaphysical questions regarding the existence of free will in human beings. (shrink)

Humans often behave altruistically towards strangers with no chance of reciprocation. From an evolutionary perspective, this is puzzling. The evolution of altruistic cooperative behavior—in which an organism’s action reduces its fitness and increases the fitness of another organism —only makes sense when it is directed at genetically related organisms or when one can expect the favor to be returned. Therefore, evolutionary theorists such as Sober and Wilson have argued that we should revise Neo-Darwininian evolutionary theory. They argue that human (...) altruism evolved through group selection in which groups of altruists were naturally selected because they had a comparative advantage over other groups. Wilson and Sober’s hypothesis attracted followers but is rejected by most of their peers. The heated debate between advocates and critics of group selection often suffers from a lack of conceptual clarity. In response, I set out to clearly distinguish ‘genetic’ from ‘cultural’ group selection and argue that the latter does not face the potentially debilitating problems plaguing the former. I defend the claim that human altruistic dispositions evolved through cultural group selection and gene-culture coevolution and offer empirical evidence in support. I also argue that actual altruistic behavior often goes beyond the kind of behavior humans have evolved to display. Conscious and voluntary reasoning processes, I show, have an important role in altruistic behavior. This is often overlooked in the scientific literature on human altruism. (shrink)

In this position paper for the 2019 CSCW workshop Good Systems: Ethical AI for CSCW I propose one tool and one idea for navigating the complex ethical problem space that results from the interaction of human and/or AI agents in shared, hopefully cooperative, computing environments.

This paper proposes a metaphysical framework for distinguishing between human and machine intelligence. It posits two identical deterministic worlds -- one comprising a human agent and the other a machine agent. These agents exhibit different information processing mechanisms despite their apparent sameness in a causal sense. Providing a conceptual modeling of their difference, this paper resolves what it calls “the vantage point problem” – namely, how to justify an omniscient perspective through which a determinist asserts determinism (...) from within the supposedly deterministic universe. (shrink)

This paper addresses a fundamental question in folk metaphysics: how do we ordinarily view human agency? According to the transcendence account, we view human agency as standing outside of the causal order and imbued with exceptional powers. According to a naturalistic account, we view human agency as subject to the same physical laws as other objects and completely open to scientific investigation. According to exceptionalist naturalism, the truth lies somewhere in between: we view human agency as (...) fitting broadly within the causal order while still being exceptional in important respects. In this paper, I report seven experiments designed to decide between these three competing theories. Across a variety of contexts and types of action, participants agreed that human agents can resist outcomes described as inevitable, guaranteed, and causally determined. Participants viewed non-human animal agents similarly, whereas they viewed computers, robots, and simple inanimate objects differently. At the same time, participants judged that human actions are caused by many things, including psychological, neurological, and social events. Overall, in folk metaphysics, human and non-human animals are viewed as exceptional parts of the natural world. (shrink)

This article argues that agents can initiate causal processes.

”Meaningful human control” is a term invented in the political and legal debate on autonomous weapons system, but it is nowadays also used in many other contexts. It is supposed to specify conditions under which an artificial system is under the right kind of control to avoid responsibility gaps: that is, situations in which no moral agent is responsible. Santoni de Sio and Van den Hoven have recently suggested a framework that can be used by system designers to (...) operationalize this kind of control. It is the purpose of this paper to facilitate further operationalization of ”meaningful human control”. -/- This paper consists of two parts. In the first part I resolve an ambiguity that plagues current operationalizations of MHC. One of the design conditions says that the system should track the reasons of the relevant agents. This condition is ambiguous between the kind of reasons involved. On one interpretation it says that a system should track motivating reasons, while it is concerned with normative reasons on the other. Current participants in the debate interpret the framework as being concerned with (something in the vicinity of) motivating reasons. I argue against this interpretation by showing that meaningful human control requires that a system tracks normative reasons. Moreover, I maintain that an operationalization of meaningful human control that fails to track the right kind of reasons is morally problematic.When this is properly understood, it can be shown that the framework of MHC is committed to the agent-relativity of reasons. More precisely, I argue in the second part of this paper that if the tracking condition of MHC plays an important role in responsibility attribution (as the proponents of the view maintain), then the framework is incompatible with first-order normative theories that hold that normative reasons are agent-neutral (such as many versions of consequentialism). In the final section I present three ways forward for the proponent of MHC as reason-responsiveness. (shrink)

This paper proposes a metaphysical framework for distinguishing between human and machine intelligence. By drawing an analogy from Kant’s incongruent counterparts, it posits two identical deterministic worlds -- one comprising a human agent and the other comprising a machine agent. These agents exhibit different types of information processing mechanisms despite their apparent sameness in a causal sense. By postulating the distinctiveness of human over machine intelligence, this paper resolves what it refers to as “the vantage (...) point problem” – namely, how to legitimize a determinist’s assertion of determinism by placing the determinist within the universe. (shrink)

This paper proposes a new metaphysical framework for distinguishing between human and machine intelligence. By drawing an analogy from Kant’s incongruent counterparts, it posits two deterministic worlds -- one comprising a human agent and the other comprising a machine agent. Using ideas from Wittgenstein and Gödel, the paper defines “deterministic knowledge” and investigates how this knowledge is processed differently in those worlds. By postulating the distinctiveness of human intelligence, this paper addresses what it refers to (...) as “the vantage point problem” – namely, how to make a qualitative distinction between the determinist and the universe where the determinist belongs. (shrink)

One of the goals of physiologists who study the detailed physical, chemical,and neurological mechanisms operating within the human body is to understand the intricate causal processes which underlie human abilities and activities. It is doubtless premature to predict that they will eventually be able to explain the behaviour of a particular human being as we might now explain the behaviour of a pendulum clock or even the invisible changes occurring within the hardware of a modern electronic computer. (...) Nonetheless, it seems fair to say that hovering in the background of investigations into human physiology is the promise or threat, depending upon how one looks at the matter that human beings are complete physical-chemical systems and that all events taking place within their bodies and all movements of their bodies could be accounted for by physical causes if we but knew enough. I am not concerned at the moment with whether or not this ’mechanistic’ hypothesis is true, assuming that it is clear enough to be intelligible, nor with whether or not we could ever know that it is true. I wish to consider the somewhat more accessible yet equally important question whether our coming to believe that the hypothesis is true would warrant our relinquishing our conception of ourselves as beings who are capable of acting for reasons to achieve ends of our own choosing. I use the word ’warrant’ to indicate that I will not be discussing the possibility that believing the mechanistic hypothesis might lead us, as a matter of psychological fact, to think of human beings as mere automata, as objects whose movements are to be explained only by causes rather than by reasons, as are the actions of a personal subject. I intend to consider only whether the acceptance of mechanism would in fact justify such a change in conception. (shrink)

Nietzsche promises to “translate man back into nature,” but it remains unclear what he meant by this and to what extent he succeeded at it. To help come to grips with Nietzsche’s conceptions of drive (Trieb), instinct (Instinkt) and virtue (Tugend and/or Keuschheit), I develop novel digital humanities methods to systematically track his use of these terms, constructing a near-comprehensive catalogue of what he takes these dispositions to be and how he thinks they are related. Nietzsche individuate drives and instincts (...) by the type of actions they motivate. One way in which the “translation” of man back into nature might succeed is through naturalistic explanation and reduction of moral notions such as virtue in terms of amoral, naturalistic notions, such as drives and instincts. I go on to show that this is indeed Nietzsche’s project: for him, a virtue is a well-calibrated drive. Such calibration relates both to the rest of the agent’s psychic economy (her other drives) and to her social context (what’s considered praiseworthy and blameworthy in her community). (shrink)

The Seed Thoughts proposed by YU Youngmo and HAM Sukhun may each be summed up by propositions expressed in “People are a May-fly seed” and “Seeds embody the eternal meaning”. They used “seed” to refer to humans or people on the one hand and placed the notion of seed in the holistic context of the Eastern Asian tradition on the other. Then, I seek to connect the anthropological notion and the holistic notion via cheng(誠) or integration. 『The Doctrine of the (...) Mean』says that any ultimate integration(至誠) reflects the total nature of objects involved(盡性) by showing that self realization and all other realizations are one and not two(成己成物) and by arriving at the stage of holiness (聖). Then, I may be allowed to say that cheng is a mind or a power not only of humans but also of all other things. Important elements of cheng intentionality can be read out of the two thinker’s various conceptual aspects. YU’s interpretation of history to be internalistic, his view of Hangul(Korean written language) as a revealational medium, his hermeneutics of Christian God as the Vacuum cannot be understood on the dichotomous model of human-nature. HAM’s seed holism, his beliefs that humans’s minds are the heavenly mind and that all things under the heaven should come to be unified are best to be understood on the model of cheng intentionality of integration. (shrink)

The article aims at formulating a philosophical framework and by this giving some means at hand to save human libertarian freedom, God’s omniscience and God’s ”eternity’. This threefold aim is achieved by 1) conceiving of an agent as having different possibilities to act, 2) regarding God’s knowledge -- with respect to agents -- not only as being ”propositional’ in character but also as being ”experiential’: God knows an agent also from the ”first person perspective’, as the (...) class='Hi'>agent knows herself, and, 3), formulating ”eternity’ and ”temporality’ as being homeomorphically related to each other. This gives rise to a coherent interplay that saves both human libertarian freedom and God’s omniscient ”view from eternity’. (shrink)

The pace of technological change continues to outstrip the evolution of democratic institutions, creating an urgent need for innovative approaches to democratic reform. However, the experimentation bottleneck - characterized by slow speed, high costs, limited scalability, and ethical risks - has long hindered progress in democracy research. This paper proposes a novel solution: employing generative artificial intelligence (GenAI) to create synthetic data through the simulation of digital homunculi, GenAI-powered entities designed to mimic human behavior in social contexts. By enabling (...) rapid, low-risk experimentation with alternative institutional designs, this approach could significantly accelerate democratic innovation. I examine the potential of GenAI-assisted research to mitigate current limitations in democratic experimentation, including the ability to simulate large-scale societal interactions and test complex institutional mechanisms. While acknowledging potential risks such as algorithmic bias, reproducibility challenges, and AI alignment issues, I argue that the benefits of synthetic data are likely to outweigh their drawbacks if implemented with proper caution. To address existing challenges, I propose a range of technical, methodological, and institutional adaptations. The paper concludes with a call for interdisciplinary collaboration in the development and implementation of GenAI-assisted methods in democracy research, highlighting their potential to bridge the gap between democratic theory and practice in an era of rapid technological change. (shrink)

It is indubitable that machines with artificial intelligence (AI) will be an essential component in humans’ quest to become a spacefaring civilization. Most would agree that long-distance space travel and the colonization of Mars will not be possible without adequately developed AI. Machines with AI have a normative function, but some argue that it can also be evaluated from the perspective of ethical norms. This essay is based on the assumption that machine ethics is an essential philosophical perspective in realizing (...) the aim of humanity becoming a spacefaring civilization. In this essay, I explore two questions in the field of machine ethics, that I believe to be relevant to the role AI will play in long-distance space travel. The first is, should moral theory be extended to include machines with AI, and second, can machines be fully ethical agents? In this essay, I define AI and then discuss the difference between implicit, explicit and full ethical agents in relation to machines with AI. I then present the argument that the inclusion of moral theory is essential in the development of machines with AI. Without an adequate inclusion of moral theory in the design of AI it may pose an existential threat to humanity, especially in the development of super-intelligent machines. I also highlight that conceptual clarity is essential in the field of machine ethics and the choice of the conceptual foundation that informs AI research and development has ethical implications, especially in the case of super-intelligent machines. This essay is an exploratory and speculative philosophical analysis of certain aspects of machine ethics relevant to long-distance space travel and does not attempt to provide definitive answers to the questions posed in the essay, but instead aims to bring attention to what I deem important considerations. (shrink)

Artificial Social Agents (ASAs), which are AI software driven entities programmed with rules and preferences to act autonomously and socially with humans, are increasingly playing roles in society. As their sophistication grows, humans will share greater amounts of personal information, thoughts, and feelings with ASAs, which has significant ethical implications. We conducted a study to investigate what ethical principles are of relative importance when people engage with ASAs and whether there is a relationship between people’s values and the ethical principles (...) they prioritise. The study uses scenarios, embedded with the five AI4People ethical principles (Beneficence, Non-maleficence, Autonomy, Justice, and Explicability), involving ASAs taking on roles traditionally played by humans to understand whether these roles and behaviours (including dialogues) are seen as acceptable or unacceptable. Results from 268 participants reveal the greatest sensitivity to ASA behaviours that relate to Autonomy, Justice, Explicability, and the privacy of their personal data. Models were created using Schwartz’s Refined Values as a possible indicator of how stakeholders discern and prioritise the different AI4People ethical principles when interacting with ASAs. Our findings raise issues around the ethical acceptability of ASAs for nudging and changing behaviour due to participants’ desire for autonomy and their concerns over deceptive ASA behaviours such as pretending to have memories and emotions. (shrink)

Just as AI has moved away from classical AI, human-computer interaction (HCI) must move away from what I call ‘good old fashioned HCI’ to ‘new HCI’ – it must become a part of cognitive systems research where HCI is one case of the interaction of intelligent agents (we now know that interaction is essential for intelligent agents anyway). For such interaction, we cannot just ‘analyze the data’, but we must assume intentions in the other, and I suggest these are (...) largely recognized through resistance to carrying out one’s own intentions. This does not require fully cognitive agents but can start at a very basic level. New HCI integrates into cognitive systems research and designs intentional systems that provide resistance to the human agent. (shrink)