The aim of this paper is to clarify the extent to which relationships between Human Agents (HAs) and Artificial Agents (AAs) can be adequately defined in terms of trust. Since such relationships consist mostly in the allocation of tasks to technological products, particular attention is paid to the notion of delegation. In short, I argue that it would be more accurate to describe direct relationships between HAs and AAs in terms of reliance, rather than in terms of trust. However, as (...) mediums of human actions to which tasks are delegated, AAs indirectly mediate trust between users and other social actors involved in their design, manufacture, commercialisation and deployment. In this sense, AAs mediate social trust. My conclusion is that relationships between HAs and AAs are thus to be understood directly in terms of reliance and indirectly in terms of social trust mediation. (shrink)

Self-driving vehicles offer great potential to improve efficiency on roads, reduce traffic accidents, increase productivity, and minimise our environmental impact in the process. However, they have also seen resistance from different groups claiming that they are unsafe, pose a risk of being hacked, will threaten jobs, and increase environmental pollution from increased driving as a result of their convenience. In order to reap the benefits of SDVs, while avoiding some of the many pitfalls, it is important to effectively determine what (...) challenges we will face in the future and what steps need to be taken now to avoid them. The approach taken in this paper is the construction of a likely future, through the process of a policy scenario methodology, if we continue certain trajectories over the coming years. The purpose of this is to articulate issues we currently face and the construction of a foresight analysis of how these may develop in the next 6 years. It will highlight many of the key facilitators and inhibitors behind this change and the societal impacts caused as a result. This paper will synthesise the wide range of ethical, legal, social and economic impacts that may result from SDV use and implementation by 2025, such as issues of autonomy, privacy, liability, security, data protection, and safety. It will conclude with providing steps that we need to take to avoid these pitfalls, while ensuring we reap the benefits that SDVs bring. (shrink)

While philosophers and scientists sometimes suggest (or take for granted) that consciousness is an essential condition for free will and moral responsibility, there is surprisingly little discussion of why consciousness (and what sorts of conscious experience) is important. We discuss some of the proposals that have been offered. We then discuss our studies using descriptions of humanoid robots to explore people’s attributions of free will and responsibility, of various kinds of conscious sensations and emotions, and of reasoning capacities, and examine (...) the relationships between these attributions. Our initial results suggest that people’s attributions of free will are strongly influenced by their attributions of conscious emotions, such as happiness and disappointment, including Strawsonian emotions, such as pride and regret. These results provide some support for an intriguing proposal: Free will requires the capacity to make decisions that really matter to the agent, and for anything to really matter to the agent, she must be able to consciously experience the good and bad effects of the decisions she makes—to suffer and regret, or to enjoy and feel proud of, their outcomes. (shrink)

The question of whether AI systems such as robots can or should be afforded moral agency or patiency is not one amenable either to discovery or simple reasoning, because we as societies constantly reconstruct our artefacts, including our ethical systems. Consequently, the place of AI systems in society is a matter of normative, not descriptive ethics. Here I start from a functionalist assumption, that ethics is the set of behaviour that maintains a society. This assumption allows me to exploit the (...) theoretical biology of sociality and autonomy to explain our moral intuitions. From this grounding I extend to consider possible ethics for maintaining either human- or of artefact-centred societies. I conclude that while constructing AI systems as either moral agents or patients is possible, neither is desirable. In particular, I argue that we are unlikely to construct a coherent ethics in which it it is ethical to afford AI moral subjectivity. We are therefore obliged not to build AI we are obliged to. (shrink)

Why has autonomy been a leading idea in philosophical writing on bioethics, and why has trust been marginal? In this important book, Onora O'Neill suggests that the conceptions of individual autonomy so widely relied on in bioethics are philosophically and ethically inadequate, and that they undermine rather than support relations of trust. She shows how Kant's non-individualistic view of autonomy provides a stronger basis for an approach to medicine, science and biotechnology, and does not marginalize untrustworthiness, while also explaining why (...) trustworthy individuals and institutions are often undeservingly mistrusted. Her arguments are illustrated with issues raised by practices such as the use of genetic information by the police or insurers, research using human tissues, uses of new reproductive technologies, and media practices for reporting on medicine, science and technology. Autonomy and Trust in Bioethics will appeal to a wide range of readers in ethics, bioethics and related disciplines. (shrink)

Moral Repair examines the ethics and moral psychology of responses to wrongdoing. Explaining the emotional bonds and normative expectations that keep human beings responsive to moral standards and responsible to each other, Margaret Urban Walker uses realistic examples of both personal betrayal and political violence to analyze how moral bonds are damaged by serious wrongs and what must be done to repair the damage. Focusing on victims of wrong, their right to validation, and their sense of justice, Walker presents a (...) unified and detailed philosophical account of hope, trust, resentment, forgiveness, and making amends - the emotions and practices that sustain moral relations. Moral Repair joins a multidisciplinary literature concerned with transitional and restorative justice, reparations, and restoring individual dignity and mutual trust in the wake of serious wrongs. (shrink)

In this paper we raise the question whether technological artifacts can properly speaking be trusted or said to be trustworthy. First, we set out some prevalent accounts of trust and trustworthiness and explain how they compare with the engineer’s notion of reliability. We distinguish between pure rational-choice accounts of trust, which do not differ in principle from mere judgments of reliability, and what we call “motivation-attributing” accounts of trust, which attribute specific motivations to trustworthy entities. Then we consider some examples (...) of technological entities that are, at first glance, best suited to serve as the objects of trust: intelligent systems that interact with users, and complex socio-technical systems. We conclude that the motivation-attributing concept of trustworthiness cannot be straightforwardly applied to these entities. Any applicable notion of trustworthy technology would have to depart significantly from the full-blown notion of trustworthiness associated with interpersonal trust. (shrink)

One of the enduring concerns of moral philosophy is deciding who or what is deserving of ethical consideration. Much recent attention has been devoted to the "animal question" -- consideration of the moral status of nonhuman animals. In this book, David Gunkel takes up the "machine question": whether and to what extent intelligent and autonomous machines of our own making can be considered to have legitimate moral responsibilities and any legitimate claim to moral consideration. The machine question poses a fundamental (...) challenge to moral thinking, questioning the traditional philosophical conceptualization of technology as a tool or instrument to be used by human agents. Gunkel begins by addressing the question of machine moral agency: whether a machine might be considered a legitimate moral agent that could be held responsible for decisions and actions. He then approaches the machine question from the other side, considering whether a machine might be a moral patient due legitimate moral consideration. Finally, Gunkel considers some recent innovations in moral philosophy and critical theory that complicate the machine question, deconstructing the binary agent--patient opposition itself. Technological advances may prompt us to wonder if the science fiction of computers and robots whose actions affect their human companions could become science fact. Gunkel's argument promises to influence future considerations of ethics, ourselves, and the other entities who inhabit this world. (shrink)

Trust is difficult to define. Instead of doing so, I propose that the best way to understand the concept is through a genealogical account. I show how a root notion of trust arises out of some basic features of what it is for humans to live socially, in which we rely on others to act cooperatively. I explore how this concept acquires resonances of hope and threat, and how we analogically apply this in related but different contexts. The genealogical account (...) explains both why the notion has such value for us and why it is difficult to define. (shrink)

In this paper, I articulate and defend a conception of trust that solves what I call “the trickster problem.” The problem results from the fact that many accounts of trust treat it similar to, or identical with, relying on someone’s good will. But a trickster could rely on your good will to get you to go along with his scheme, without trusting you to do so. Recent philosophical accounts of trust aim to characterize what it is for one person to (...) trust another so as to avoid this problem, but no extant account successfully does so. I argue that connecting trust to important, normatively defined relationships like friendship, romantic partnerships and parenting shows us something important about trust. The clearest cases of trust are found within the confines of normatively defined relationships like these, suggesting that there is a normative element to trust. Trusting someone involves not just believing that another person’s good will covers your interactions. Trusting involves believing that, at least in a certain domain of interaction, you are entitled to rely on that person’s good will. This account solves the trickster problem, because a trickster is not entitled to his victim’s good will. (shrink)

What makes trust such a powerful concept? Is it merely that in trust the whole range of social forces that we know play together? Or is it that trust involves a peculiar element beyond those we can account for? While trust is an attractive and evocative concept that has gained increasing popularity across the social sciences, it remains elusive, its many facets and applications obscuring a clear overall vision of its essence. In this book, Guido Möllering reviews a broad range (...) of trust research and extracts three main perspectives adopted in the literature for understanding trust. Accordingly, trust is presented as a matter of reason, routine or reflexivity. While all these perspectives contribute something to our understanding of trust, Möllering shows that they imply, but cannot explain, ‘suspension’ – the leap of faith that is typical of trust. He therefore proposes a new direction in trust research that builds on existing perspectives but places the suspension of uncertainty and vulnerability at the heart of the concept of trust. Beyond a purely theoretical line of argument, the author discusses implications for empirical studies of trust and presents original case material that captures the experience of trust in terms of reason, routine, reflexivity and suspension. Möllering concludes by suggesting how the new approach can enhance the relevance of trust research and its contributions to broader research agendas concerning the constitution of positive expectations in the face of prevalent uncertainty and change at various levels in our economies and societies. The book is essential reading for anyone who wants to gain a thorough understanding of trust. It can serve as a general introduction for advanced students and scholars in the social sciences, especially in economics, sociology, psychology and management. For more experienced researchers, it is a challenging and provocative critique of the field and a new approach to understanding trust. (shrink)

In this essay, I describe and explain the standard accounts of agency, natural agency, artificial agency, and moral agency, as well as articulate what are widely taken to be the criteria for moral agency, supporting the contention that this is the standard account with citations from such widely used and respected professional resources as the Stanford Encyclopedia of Philosophy, Routledge Encyclopedia of Philosophy, and the Internet Encyclopedia of Philosophy. I then flesh out the implications of some of these well-settled theories (...) with respect to the prerequisites that an ICT must satisfy in order to count as a moral agent accountable for its behavior. I argue that each of the various elements of the necessary conditions for moral agency presupposes consciousness, i.e., the capacity for inner subjective experience like that of pain or, as Nagel puts it, the possession of an internal something-of-which-it is-is-to-be-like. I ultimately conclude that the issue of whether artificial moral agency is possible depends on the issue of whether it is possible for ICTs to be conscious. (shrink)

A summary of the philosophical literature on trust.

Philosophers and social scientists have focussed a great deal of attention on our human capacity to trust, but relatively little on the capacity to hope. This is a significant oversight, as hope and trust are importantly interconnected. This paper argues that, even though trust can and does feed our hopes, it is our empowering capacity to hope that significantly underwrites—and makes rational—our capacity to trust.

Traditionally, the manufacturer/operator of a machine is held (morally and legally) responsible for the consequences of its operation. Autonomous, learning machines, based on neural networks, genetic algorithms and agent architectures, create a new situation, where the manufacturer/operator of the machine is in principle not capable of predicting the future machine behaviour any more, and thus cannot be held morally responsible or liable for it. The society must decide between not using this kind of machine any more (which is not a (...) realistic option), or facing a responsibility gap, which cannot be bridged by traditional concepts of responsibility ascription. (shrink)

Can we decide to trust? Sometimes, yes. And when we do, we need not believe that our trust will be vindicated. This paper is motivated by the need to incorporate these facts into an account of trust. Trust involves reliance; and in addition it requires the taking of a reactive attitude to that reliance. I explain how the states involved here differ from belief. And I explore the limits of our ability to trust. I then turn to the idea of (...) trusting what others say. I suggest that we sometimes decide to trust people to be sincere and knowledgeable; and that having taken this attitude towards them, we come to believe what they say. I spell out some consequences that this has for an account of testimony, and for van Fraassen's decision theoretic principle of Reflection. (shrink)

Governments, companies, and citizens all think trust is important. Especially today, in the networked era, where we make use of all sorts of e-services and increasingly interact and buy online, trust has become a necessary condition for society to thrive. But what do we mean when we talk about trust and how does the rise of the Internet transform the functioning of trust? This books starts off with a thorough conceptual analysis of trust, drawing on insights from - amongst others (...) philosophy and sociology - to sharpen our understanding of the topic. The book explains how the arrival of large systems - such as the internet - has changed the character of trust which today is no longer based on interpersonal interactions but has become completely mediated by technologies. Based on the layered building plan of the Internet itself, a new conceptual lens called 4 Cs is developed to analyse and understand trust in the networked era. The 4Cs refer to the 4 layers which all have to be taken into account to assess trust online, namely: context, code, codification, and curation. The 4Cs bring together the firsthand experiences of the user (context), the sort of technology that is being used (code), the legal implication (codification) and business interests (curation) in order to get a clear picture of the trust issues that may arise. In the final part of the book some real-life cases are discussed (digital hotel keys, Airbnb, online personalization) to illustrate how trust -analysed through the 4 Cs lens- might flourish or be challenged in our current networked era. (shrink)

Agricultural Big Data analytics (ABDA) is being proposed to ensure better farming practices, decision-making, and a sustainable future for humankind. However, the use and adoption of these technologies may bring about potentially undesirable consequences, such as exercises of power. This paper will analyse Brey’s five distinctions of power relationships (manipulative, seductive, leadership, coercive, and forceful power) and apply them to the use agricultural Big Data. It will be shown that ABDA can be used as a form of manipulative power to (...) initiate cheap land grabs and acquisitions. Seductive power can be exercised by pressuring farmers into situations they would not have otherwise chosen (such as installing monitors around their farm and limited access to their farm and machinery). It will be shown that agricultural technology providers (ATPs) demonstrate leadership power by getting farmers to agree to use ABDA without informed consent. Coercive power is exercised when ATPs threaten farmers with the loss of ABDA if they do not abide by the policies and requirements of the ATP or are coerced to remain with the ATP because of fear of legal and economic reprisal. ATPs may use ABDA to determine willingness-to-pay rates from farmers, using this information to force farmers into precarious and vulnerable positions. Altogether, this paper will apply these five types of power to the use and implementation of ABDA to demonstrate that it is being used to exercise power in the agricultural industry. (shrink)

This work examines the concept of trust in the light of virtue theory, and takes our responsibility to be trustworthy as central. Rather than thinking of trust as risk-taking, Potter views it as equally a matter of responsibility-taking. Her work illustrates that relations of trust are never independent from considerations of power, and that asking ourselves what we can do to be trustworthy allows us to move beyond adversarial trust relationships and toward a more democratic, just, and peaceful society.

We argue that the notion of trust, as it figures in an ethical context, can be illuminated by examining research in artificial intelligence on multi-agent systems in which commitment and trust are modeled. We begin with an analysis of a philosophical model of trust based on Richard Holton’s interpretation of P. F. Strawson’s writings on freedom and resentment, and we show why this account of trust is difficult to extend to artificial agents (AAs) as well as to other non-human entities. (...) We then examine Margaret Urban Walker’s notions of “default trust” and “default, diffuse trust” to see how these concepts can inform our analysis of trust in the context of AAs. In the final section, we show how ethicists can improve their understanding of important features in the trust relationship by examining data resulting from a classic experiment involving AAs. (shrink)

Can we trust robots? Responding to the literature on trust and e-trust, this paper asks if the question of trust is applicable to robots, discusses different approaches to trust, and analyses some preconditions for trust. In the course of the paper a phenomenological-social approach to trust is articulated, which provides a way of thinking about trust that puts less emphasis on individual choice and control than the contractarian-individualist approach. In addition, the argument is made that while robots are neither human (...) nor mere tools, we have sufficient functional, agency-based, appearance-based, social-relational, and existential criteria left to evaluate trust in robots. It is also argued that such evaluations must be sensitive to cultural differences, which impact on how we interpret the criteria and how we think of trust in robots. Finally, it is suggested that when it comes to shaping conditions under which humans can trust robots, fine-tuning human expectations and robotic appearances is advisable. (shrink)

This paper provides a new analysis of e - trust , trust occurring in digital contexts, among the artificial agents of a distributed artificial system. The analysis endorses a non-psychological approach and rests on a Kantian regulative ideal of a rational agent, able to choose the best option for itself, given a specific scenario and a goal to achieve. The paper first introduces e-trust describing its relevance for the contemporary society and then presents a new theoretical analysis of this phenomenon. (...) The analysis first focuses on an agent’s trustworthiness , this one is presented as the necessary requirement for e-trust to occur. Then, a new definition of e-trust as a second-order-property of first-order relations is presented. It is shown that the second-order-property of e-trust has the effect of minimising an agent’s effort and commitment in the achievement of a given goal. On this basis, a method is provided for the objective assessment of the levels of e-trust occurring among the artificial agents of a distributed artificial system. (shrink)

Are trust relationships involving humans and artificial agents possible? This controversial question has become a hotly debated topic in the emerging field of machine ethics. Employing a model of trust advanced by Buechner and Tavani :39–51, 2011), I argue that the “short answer” to this question is yes. However, I also argue that a more complete and nuanced answer will require us to articulate the various levels of trust that are also possible in environments comprising both human agents and AAs. (...) In defending this view, I show how James Moor’s model for distinguishing four levels of ethical agents in the context of machine ethics :18–21, 2006) can help us to develop a framework that differentiates four levels of trust. Via a series of hypothetical scenarios, I illustrate each level of trust involved in HA–AA relationships. Finally, I argue that these levels of trust reflect three key factors or variables: the level of autonomy of the individual AAs involved, the degree of risk/vulnerability on the part of the HAs who place their trust in the AAs, and the kind of interactions that occur between the HAs and AAs in the trust environments. (shrink)

After discussing the distinction between artifacts and natural entities, and the distinction between artifacts and technology, the conditions of the traditional account of moral agency are identified. While computer system behavior meets four of the five conditions, it does not and cannot meet a key condition. Computer systems do not have mental states, and even if they could be construed as having mental states, they do not have intendings to act, which arise from an agent’s freedom. On the other hand, (...) computer systems have intentionality, and because of this, they should not be dismissed from the realm of morality in the same way that natural objects are dismissed. Natural objects behave from necessity; computer systems and other artifacts behave from necessity after they are created and deployed, but, unlike natural objects, they are intentionally created and deployed. Failure to recognize the intentionality of computer systems and their connection to human intentionality and action hides the moral character of computer systems. Computer systems are components in human moral action. When humans act with artifacts, their actions are constituted by the intentionality and efficacy of the artifact which, in turn, has been constituted by the intentionality and efficacy of the artifact designer. All three components – artifact designer, artifact, and artifact user – are at work when there is an action and all three should be the focus of moral evaluation. (shrink)

A program for the simulation of rational social normative trust, predictive `trust,' and predictive reliance between agents will be introduced. It offers a tool for social scientists or a trust component for multi-agent simulations/multi-agent systems, which need to include trust between agents to guide the decisions about the course of action. It is based on an analysis of rational social normative trust (RSNTR) (revised version of M. Tuomela 2002), which is presented and briefly argued. For collective agents, belief conditions for (...) collective agency should be added. For the various forms of trust agents must have (at least) subjectively rational reasons to believe that the conditions of the trust account are fulfilled. A list of such reasons (of varied weights), e.g., given by empirical research, can manually be built into a parameter file or be generated by a calling program in a fixed format. From this list of reasons the program randomly generates a belief base for the agents of the artificial society. Reasons can be chained together so that one set of reasons satisfies several belief conditions. The program checks if the conditions are fulfilled for the artificial agents' social normative trust/predictive `trust'/`predictive reliance' in another agent that he will perform an action X. Each outcome is logged to a result file. In conclusion we discuss various aspects of the application of a trust component of the suggested kind in empirical research, social simulation, and multi-agent systems. (shrink)