This chapter defends the view that manipulated behaviour is explained by an injustice. Injustices that explain manipulated behaviour need not involve agential features such as intentionality. Therefore, technology can manipulate us, even if technological artefacts like robots, intelligent software agents, or other ‘mere tools’ lack agential features such as intentionality. The chapter thus sketches a comprehensive account of manipulated behaviour related to but distinct from existing accounts of manipulative behaviour. It then builds on that account to defend the possibility that (...) we are being manipulated by technology. (shrink)

Are we being manipulated online? If so, is being manipulated by online technologies and algorithmic systems notably different from human forms of manipulation? And what is under threat exactly when people are manipulated online? This volume provides philosophical and conceptual depth to debates in digital ethics about online manipulation. The contributions explore the ramifications of our increasingly consequential interactions with online technologies such as online recommender systems, social media, user-friendly design, micro-targeting, default-settings, gamification, and real-time profiling. The authors in this (...) volume address four broad and interconnected themes: • What is the conceptual nature of online manipulation? And how, methodologically, should the concept be defined? • Does online manipulation threaten autonomy, freedom, and meaning in life, and if so, how? • What are the epistemic, affective, and political harms and risks associated with online manipulation? • What are legal and regulatory perspectives on online manipulation? The Philosophy of Online Manipulation brings these various considerations together to offer philosophically robust answers to critical questions concerning our online interactions with one another and with autonomous systems. It will be of interest to researchers and advanced students working in moral philosophy, digital ethics, philosophy of technology, and the ethics of manipulation. (shrink)

The libertarian attribute of Thaler and Sunstein’s nudge theory (Nudge: improving decisions about health, wealth, and happiness. Yale University Press, New Haven, 2008) is one of the most important features for its candidature as a new model for public policy-making. It relies on the reversibility of choices made under the influence of nudging. Since the mind is articulated into two systems, the choice taken by System 1 is always reversible because it can be overridden by the deliberative and corrective role (...) of System 2. This article does not aim to criticise the whole theory of nudge and neither to assess its practical efficacy as a policy-making tool. Rather it intends to show that there are doubts that the specific claim of reversibility is correct for a subset of nudges called “System 1 nudges” (Sunstein in The ethics of influence, Cambridge University Press, Cambridge, 2016). And that therefore, in this case, the libertarian claim seems little justified. The thrust of my argument contests the truth of the main pillar of the libertarian claim, namely the dual-process theory of mind. I will show that even the minimal version of dual reasoning, namely the Type 1 and Type 2 processes proposed by Evans and Stanovich (Perspect Psychol Sci 8(3):223–241, 2013), is weakened by psychological and neural data. (shrink)

We have identified an emerging tool being used by the UK government across a range of public bodies in the service of public policy - the online targeted advertising infrastructure and the practices, consultancy firms, and forms of expertise which have grown up around it. This reflects an intensification and adaptation of a broader ‘behavioural turn’ in the governmentality of the UK state and the increasing sophistication of everyday government communications. Contemporary UK public policy is fusing with the powerful tools (...) for behaviour change created by the platform economy. Operational data and associated systems of classification and profiling from public bodies are being hybridised with traditional consumer marketing profiles and then ‘projected’ onto the classification systems of the targeted advertising infrastructures. This is not simply a case of algorithms being used for sorting, surveilling, and scoring; rather this suggests that targeted interventions in the cultural and behavioural life of communities are now a core part of governmental power which is being algorithmically-driven, in combination with influencer networks, traditional forms of messaging, and frontline operational practices. We map these uses and practices of what we describe as the ‘Surveillance Influence Infrastructure’, identifying key ethical issues and implications which we believe have yet to be fully investigated or considered. What we find particularly striking is the coming-together of two separate structures of power - the governmental turn to behaviourism and prevention on one hand, and the infrastructures of targeting and influence on the other. We theorise this as a move beyond ‘nudge’ or ‘behavioural science’ approaches, towards a programme which we term ‘influence government’. (shrink)

This study puts forward a rounder conceptual model for interpreting short and long-term effects of choice behavior. Kahneman’s (2011) distinction between cognitive processing System 1 and System 2 reflect the more rigorous distinction between Brief and Immediate and Extended and Elaborated Relational Responding. Specifically, we provide theoretical accounts and applied examples of how nudging, or the manipulation of environmental contingencies, works on the creation and modification of relational frames. The subset denominated educational nudges, or boosts, are particularly useful towards their (...) maintenance. We define and illustrate the fundamental mediating role of verbal behavior towards formulating rules, which inform and guide choice behavior over time. Furthermore, we suggest adopting the Implicit Relations Association Procedure to inform how coherent and immediate responding to new relational frames may be, whenever choices need be made. We provide empirical accounts of consumer behavior, stereotypy and prejudices, eating behavior, and overcoming cognitive biases. The conclusions depict a promising way forward towards an improved model for interpreting and overcoming human errors thanks to changes in the contingencies of choice behavior. (shrink)

Default rules, taken as such, do not intrude on autonomy, even if they influence people without persuading them. If default rules give people certain rights automatically (such as the right to free...

Nudge is a popular public policy tool that harnesses well-known biases in human judgement to subtly guide people’s decisions, often to improve their choices or to achieve some socially desirable outcome. Thanks to recent developments in artificial intelligence (AI) methods new possibilities emerge of how and when our decisions can be nudged. On the one hand, algorithmically personalized nudges have the potential to vastly improve human daily lives. On the other hand, blindly outsourcing the development and implementation of nudges to (...) “black box” AI systems means that the ultimate reasons for why such nudges work, that is, the underlying human cognitive processes that they harness, will often be unknown. In this paper, we unpack this concern by considering a series of examples and case studies that demonstrate how AI systems can learn to harness biases in human judgment to reach a specified goal. Drawing on an analogy in a philosophical debate concerning the methodology of economics, we call for the need of an interdisciplinary oversight of AI systems that are tasked and deployed to nudge human behaviours. (shrink)

In contrast to China’s efforts to upgrade its system of governance around a stupefying amount of data collection and electronic scoring, countries committed to democracy and human rights did not upgrade their systems. Instead, those countries ended up with surveillance capitalism. It is vital for the survival of those ideas about governance to perform such an upgrade. This paper aims to contribute to that goal. I propose a framework of epistemic actorhood in terms of four roles and characterize digital lifeworlds (...) and what matters about them both in terms of how they fit in with Max Tegmark’s distinctions among stages of life and in terms of how they generate their own episteme, the data episteme, with its immense possibilities of infopower. Epistemic rights that strengthen existing human rights – as part of a fourth generation of rights – are needed to protect epistemic actorhood in those roles. In the long run, we might well need a new kind of right, the right to the exercise of genuinely human intelligence. (shrink)

Advances in psychology and neuroscience have elucidated the social aspects of human agency, leading to a broad shift in our thinking about fundamental concepts such as autonomy and responsibility. Here, we address a critical aspect of this inquiry by investigating how people consider the socio-relational nature of their own agency, particularly the influence of others on their perceived control over their decisions and actions. Specifically, in a series of studies using contrastive vignettes, we examine public attitudes about when external influences (...) on everyday decisions are perceived as " undue " – that is, as undermining the control conditions for these decisions to be considered autonomous – vs. when they are perceived as appropriate and even supportive of autonomous decision-making. We found that the influence of preauthorized agents – individuals and institutions with whom we share a worldview – was judged to be less undue than non-preauthorized agents, even after controlling for the familiarity of the agent. These effects persisted irrespective of the extent to which respondents identified as communitarian or individualistic, and were consistent across two distinct scenarios. We also found that external influences that were rational were perceived as less undue than those that were arational. Our study opens new avenues of inquiry into the " folk conception " of autonomy, and we discuss the implications of our findings for the ethics of public policies designed to influence decisions and for information sharing in social networks. (shrink)

Deceased organ donation is widely considered as a case of easy rescue―that is, a case in which A may bestow considerable benefits on B while incurring negligent costs herself. Yet, the policy implications of this observation remain unclear. Drawing on Christopher H. Wellman’s samaritan account of political obligations, the paper develops a case for a so-called opt-out system, i.e., a scheme in which people are defaulted into being donors. The proposal’s key idea is that we may arrange people’s options in (...) specific ways for the sake of others. (shrink)

The majority of research on how learning a second language (L2) has focused on the personal benefits of being bilingual or multilingual. In this paper, we focus on the potential positive effect of actively thinking in L2. Our approach is inspired by recent experimental research suggesting that actively thinking in an L2 leads to improved reasoning and decision-making, which is known as the foreign-language effect (FLE). We examine the possibility that one could selectively engage in L2 thinking in order to (...) reap these potential benefits. Integrating this research with research in positive psychology, we explain how doing so might be understood as a type of “nudge,” or intervention that one could use to increase their chances of making autonomous decisions reflecting their own best interest. Nudges have been associated with improved outcomes with respect to many aspects of our lives - for instance sticking to goals, saving money, exercising more frequently, maintaining a healthy diet. It may be that bilinguals can assume an active role in increasing their happiness or well-being by making better decisions through strategic implementation of L2 in decision-making contexts. We also discuss the ethics of using the FLE as a nudge when it has beneficial consequences, as there are instances when doing so could be beneficial with respect to public policy as well. For instance, it has been shown that people are less averse to sustainable farming and eating practices (e.g. eating insects) when actively thinking in an L2. After reviewing the current research on the FLE, we suggest that further research needs to be done because actively thinking in L2 seems to function beneficially in some circumstances but may pose cognitive disadvantages in others. (shrink)

Volume 19, Issue 5, May 2019, Page 70-72.

Volume 19, Issue 5, May 2019, Page 72-74.

The aim of this article is to question the epistemic presuppositions of applying behavioural science in public policymaking. Philosophers of science who have examined the recent applications of the behavioural sciences to policy have contributed to discussions on causation, evidence, and randomised controlled trials. These have focused on epistemological and methodological questions about the reliability of scientific evidence and the conditions under which we can predict that a policy informed by behavioural research will achieve the policymakers’ goals. This paper argues (...) that the philosophical work of Helen Longino can also help us to have a better and fuller understanding of the knowledge which the behavioural sciences provide. The paper advances an analysis of the knowledge claims that are made in the context of policy applications of behavioural science and compares them with the behavioural research on which they are based. This allows us to show that behavioural policy and the debates accompanying it are based on an oversimplified understanding of what knowledge behavioural science actually provides. Recognising this problem is important as arguments that justify reliance on the behavioural sciences in policy typically presume this simplification. (shrink)

In this paper, I examine how nudges affect the autonomy and freedom of those nudged. I consider two arguments put forth by Thaler and Sunstein for the claim that these effects can only be minor. According to the first of these arguments, nudges cannot significantly restrict a person’s autonomy or freedom since they are easy to resist. According to the second argument, the existence of nudges is inevitable, and thus, pursuing libertarian paternalism by nudging people doesn’t make a relevant difference (...) to people’s autonomy and freedom. After arguing that both of these arguments fail, I elucidate the general conditions in which, and the degrees to which, a person’s autonomy and freedom are affected by nudges. One focus of this discussion concerns how people’s autonomy and freedom are affected if—for example, due to progress in information technology—nudges become more effective, more individualized and more common, and affect more people. (shrink)

Critics frequently argue that nudges are more covert, less transparent, and more difficult to monitor than traditional regulatory tools. Edward Glaeser, for example, argues that “[p]ublic monitoring of soft paternalism is much more difficult than public monitoring of hard paternalism”. As one of the leading proponents of soft paternalism, Cass Sunstein, acknowledges, while “[m]andates and commands are highly visible”, soft paternalism, “and some nudges in particular[,] may be invisible”. In response to this challenge, proponents of nudging argue that invisibility for (...) any given individual in a particular choice environment is compatible with “careful public scrutiny” of the nudge. This paper offers the first of its kind experimental evidence that tests whether nudges are, in fact, compatible with “careful public scrutiny”. Using three sets of experiments, the paper argues that, even when entirely visible, nudges attract less scrutiny than their “hard law” counterparts. (shrink)

Artificial intelligence is shaping strategy, activities, interactions, and relationships in business and specifically in marketing. The drawback of the substantial opportunities AI systems and applications provide in marketing are ethical controversies. Building on the literature on AI ethics, the authors systematically scrutinize the ethical challenges of deploying AI in marketing from a multi-stakeholder perspective. By revealing interdependencies and tensions between ethical principles, the authors shed light on the applicability of a purely principled, deontological approach to AI ethics in marketing. To (...) reconcile some of these tensions and account for the AI-for-social-good perspective, the authors make suggestions of how AI in marketing can be leveraged to promote societal and environmental well-being. (shrink)

One of the most pervasive criticisms of nudges has been the claim that they violate, undermine or decrease people’s autonomy. This claim, however, is seldom backed up by an explicit and detailed conception of autonomy. In this paper, we aim to do three things. First, we want to clear up some conceptual confusion by distinguishing the different conceptions used by Cass Sunstein and his critics in order to get clear on how they conceive of autonomy. Second, we want to add (...) to the existing discussion by distinguishing between ‘autonomy’ as the ability to set your own ends and ‘autocracy’ as the ability to actually realize those ends. This will allow for a more careful ethical evaluation of specific nudge interventions. Third, we will introduce the idea of ‘perimeters of autonomy’ in an attempt to provide a realistic account of personal autonomy and we will argue that it can alleviate most of the worries about nudging being autonomy-undermining. (shrink)

Personal AI assistants are now nearly ubiquitous. Every leading smartphone operating system comes with a personal AI assistant that promises to help you with basic cognitive tasks: searching, planning, messaging, scheduling and so on. Usage of such devices is effectively a form of algorithmic outsourcing: getting a smart algorithm to do something on your behalf. Many have expressed concerns about this algorithmic outsourcing. They claim that it is dehumanising, leads to cognitive degeneration, and robs us of our freedom and autonomy. (...) Some people have a more subtle view, arguing that it is problematic in those cases where its use may degrade important interpersonal virtues. In this article, I assess these objections to the use of AI assistants. I will argue that the ethics of their use is complex. There are no quick fixes or knockdown objections to the practice, but there are some legitimate concerns. By carefully analysing and evaluating the objections that have been lodged to date, we can begin to articulate an ethics of personal AI use that navigates those concerns. In the process, we can locate some paradoxes in our thinking about outsourcing and technological dependence, and we can think more clearly about what it means to live a good life in the age of smart machines. (shrink)

To develop more effective ethics education for cross-cultural and international engineering, a study was conducted to determine what Chinese engineering students have learned and think about ethics. Recent research shows traditional approaches to ethics education are potentially ineffective, but also points towards ways of improving ethical behaviors. China is the world’s most populous country, graduating and employing the highest number of STEM majors, although little empirical research exists about the ethical knowledge and perspectives of Chinese engineering students. When compared to (...) engineering students in the US, Chinese engineering students received less ethics education; the form of the education they did receive stressed virtue ethics or the development of moral character; conceive of ethics in contradistinction to the law, where ethics deals with matters of right and wrong not covered by legality. Based on these findings and research in moral psychology and behavioral ethics, recommendations are made for improving engineering ethics education both in China and abroad. (shrink)

Interactions between an intelligent software agent and a human user are ubiquitous in everyday situations such as access to information, entertainment, and purchases. In such interactions, the ISA mediates the user’s access to the content, or controls some other aspect of the user experience, and is not designed to be neutral about outcomes of user choices. Like human users, ISAs are driven by goals, make autonomous decisions, and can learn from experience. Using ideas from bounded rationality, we frame these interactions (...) as instances of an ISA whose reward depends on actions performed by the user. Such agents benefit by steering the user’s behaviour towards outcomes that maximise the ISA’s utility, which may or may not be aligned with that of the user. Video games, news recommendation aggregation engines, and fitness trackers can all be instances of this general case. Our analysis facilitates distinguishing various subcases of interaction, as well as second-order effects that might include the possibility for adaptive interfaces to induce behavioural addiction, and/or change in user belief. We present these types of interaction within a conceptual framework, and review current examples of persuasive technologies and the issues that arise from their use. We argue that the nature of the feedback commonly used by learning agents to update their models and subsequent decisions could steer the behaviour of human users away from what benefits them, and in a direction that can undermine autonomy and cause further disparity between actions and goals as exemplified by addictive and compulsive behaviour. We discuss some of the ethical, social and legal implications of this technology and argue that it can sometimes exploit and reinforce weaknesses in human beings. (shrink)

Some recent arguments for paternalist government interventions have been based in empirical results in psychology and behavioral economics that would seem to show that adult human beings are far removed from the ideals of rationality presupposed by much of philosophical and economic theory. In this paper it is argued that we need to move to a different conception of human decision-making competence than the one that lies behind that common line of philosophical and economic thinking, and which actually still lies (...) in the background of some of these recent approaches to paternalist interventions. An alternative picture of human decision-making competence is outlined and four criteria for identifying areas where paternalist interventions have a basic moral and political legitimacy are then identified on the basis of this picture. (shrink)

An effective method to increase the number of potential cadaveric organ donors is to make people donors by default with the option to opt out. This non-coercive public policy tool to influence people’s choices is often justified on the basis of the as-judged-by-themselves principle: people are nudged into choosing what they themselves truly want. We review three often hypothesized reasons for why defaults work and argue that the as-judged-by-themselves principle may hold only in two of these cases. We specify further (...) conditions for when the principle can hold in these cases and show that whether those conditions are met is often unclear. We recommend ways to expand nationwide surveys to identify the actual reasons for why defaults work and discuss mandated choice policy as a viable solution to many arising conundrums. (shrink)

As the use of nudges by governmental agencies becomes more common, the need for normative guidelines regarding the processes by which decisions about the implementation of specific nudges are taken becomes more acute. In order to find a justified set of such guidelines one must meet several theoretical challenges to Libertarian Paternalism that arise at the foundational level. In this paper, I identify three central challenges to Libertarian Paternalism, and suggest that Susan Hurley's political philosophy as presented in her Natural (...) Reasons (1989) can be viewed as offering powerful responses to them. (shrink)

In this panel, we explore the future of value sensitive design (VSD). The stakes are high. Many in public and private sectors and in civil society are gradually realizing that taking our values seriously implies that we have to ensure that values effectively inform the design of technology which, in turn, shapes people’s lives. Value sensitive design offers a highly developed set of theory, tools, and methods to systematically do so.

Ever-increasing numbers of human interactions with intelligent software agents, online and offline, and their increasing ability to influence humans have prompted a surge in attention toward the concept of (online) manipulation. Several scholars have argued that manipulative influence is always hidden. But manipulation is sometimes overt, and when this is acknowledged the distinction between manipulation and other forms of social influence becomes problematic. Therefore, we need a better conceptualisation of manipulation that allows it to be overt and yet clearly distinct (...) from related concepts of social influence. I argue that manipulation is careless influence, show how this account helps to alleviate the shortcomings of the hidden influence view of manipulation, and derive implications for digital ethics. (shrink)