Social media use is soaring globally. Existing research of its ethical implications predominantly focuses on the relationships amongst human users online, and their effects. The nature of the software-to-human relationship and its impact on digital well-being, however, has not been sufficiently addressed yet. This paper aims to close the gap. I argue that some intelligent software agents, such as newsfeed curator algorithms in social media, manipulate human users because they do not intend their means of influence to reveal the user’s (...) reasons. I support this claim by defending a novel account of manipulation and by showing that some intelligent software agents are manipulative in this sense. Apart from revealing a priori reason for thinking that some intelligent software agents are manipulative, the paper offers a framework for further empirical investigation of manipulation online. (shrink)

The human propensity to take an ethical stance toward oneself and others is found in every known society, yet we also know that values taken for granted in one society can contradict those in another. Does ethical life arise from human nature itself? Is it a universal human trait? Or is it a product of one's cultural and historical context? Webb Keane offers a new approach to the empirical study of ethical life that reconciles these questions, showing how ethics arise (...) at the intersection of human biology and social dynamics. Drawing on the latest findings in psychology, conversational interaction, ethnography, and history, Ethical Life takes readers from inner city America to Samoa and the Inuit Arctic to reveal how we are creatures of our biology as well as our history--and how our ethical lives are contingent on both. Keane looks at Melanesian theories of mind and the training of Buddhist monks, and discusses important social causes such as the British abolitionist movement and American feminism. He explores how styles of child rearing, notions of the person, and moral codes in different communities elaborate on certain basic human tendencies while suppressing or ignoring others."--Publisher's Web site. (shrink)

In the international bestseller, Thinking, Fast and Slow, Daniel Kahneman, the renowned psychologist and winner of the Nobel Prize in Economics, takes us on a groundbreaking tour of the mind and explains the two systems that drive the way we think. System 1 is fast, intuitive, and emotional; System 2 is slower, more deliberative, and more logical. The impact of overconfidence on corporate strategies, the difficulties of predicting what will make us happy in the future, the profound effect of cognitive (...) biases on everything from playing the stock market to planning our next vacation—each of these can be understood only by knowing how the two systems shape our judgments and decisions. -/- Engaging the reader in a lively conversation about how we think, Kahneman reveals where we can and cannot trust our intuitions and how we can tap into the benefits of slow thinking. He offers practical and enlightening insights into how choices are made in both our business and our personal lives—and how we can use different techniques to guard against the mental glitches that often get us into trouble. Winner of the National Academy of Sciences Best Book Award and the Los Angeles Times Book Prize and selected by The New York Times Book Review as one of the ten best books of 2011, Thinking, Fast and Slow is destined to be a classic. (shrink)

Although some authors claim that deception requires intention, we argue that there can be deception in social robotics, whether or not it is intended. By focusing on the deceived rather than the deceiver, we propose that false beliefs can be created in the absence of intention. Supporting evidence is found in both human and animal examples. Instead of assuming that deception is wrong only when carried out to benefit the deceiver, we propose that deception in social robotics is wrong when (...) it leads to harmful impacts on individuals and society. The appearance and behaviour of a robot can lead to an overestimation of its functionality or to an illusion of sentience or cognition that can promote misplaced trust and inappropriate uses such as care and companionship of the vulnerable. We consider the allocation of responsibility for harmful deception. Finally, we make the suggestion that harmful impacts could be prevented by legislation, and by the development of an assessment framework for sensitive robot applications. (shrink)

People who have not experienced diseases and health conditions tend to judge them to be worse than they are reported to be by people who have experienced them. This phenomenon, known as the disability paradox, presents a challenge for health policy, and in particular, healthcare resource distribution. This divergence between patient and public preferences is most plausibly explained as a result of hedonic adaptation, a widespread phenomenon in which people tend to adapt fairly quickly to the state they are in, (...) good or bad, and adjust their baseline utility accordingly.If patient utilities can be shown to be inappropriate for use in public policy decision making, the disability paradox fades away. This paper offers a critique of one such attempt: the idea that adaptation leads to adaptive preferences. I argue that none of the main accounts of adaptive preferences in fact characterise adapted patient preferences as irrational. Adapted preferences should not, therefore, be treated as synonymous with adaptive preferences. I suggest that much patient adaptation should be understood as a form of the ubiquitous human ability to respond to environmental change. Consequently, we ought not to discount patient preferences. (shrink)

According to some philosophers of technology, technology embodies moral values in virtue of its functional properties and the intentions of its designers. But this paper shows that such an account makes the values supposedly embedded in technology epistemically opaque and that it does not allow for values to change. Therefore, to overcome these shortcomings, the paper introduces the novel Affordance Account of Value Embedding as a superior alternative. Accordingly, artefacts bear affordances, that is, artefacts make certain actions likelier given the (...) circumstances. Based on an interdisciplinary perspective that invokes recent moral anthropology, I conceptualize affordances as response-dependent properties. That is, they depend on intrinsic as well as extrinsic properties of the artefact. We have reason to value these properties. Therefore, artefacts embody values and are not value-neutral, which has practical implications for the design of new technologies. (shrink)

Fricker shows that virtue epistemology provides a general epistemological idiom in which these issues can be forcefully discussed.

The starting point regarding consent has to be that it is both extremely important, and that it is often suspicious. In this article, the author tries to make sense of both of these claims, from a largely liberal perspective, tying consent, predictably, to the value of autonomy and distinguishing between autonomy as sovereignty and autonomy as nonalienation. The author then discusses adaptive preferences, claiming that they suffer from a rationality flaw but that it's not clear that this flaw matters morally (...) or politically. What matters is whether they suffer from an autonomy flaw. To answer this question, the author develops an account of autonomy failure, according to which a preference is nonautonomous if an injustice played an appropriate role in its causal history. The author then discusses the moral implications—and in an initial way, the political ones as well—of proclaiming a preference, or consent based on it, nonautonomous in this way. (shrink)

We explore the question of whether machines can infer information about our psychological traits or mental states by observing samples of our behaviour gathered from our online activities. Ongoing technical advances across a range of research communities indicate that machines are now able to access this information, but the extent to which this is possible and the consequent implications have not been well explored. We begin by highlighting the urgency of asking this question, and then explore its conceptual underpinnings, in (...) order to help emphasise the relevant issues. To answer the question, we review a large number of empirical studies, in which samples of behaviour are used to automatically infer a range of psychological constructs, including affect and emotions, aptitudes and skills, attitudes and orientations (e.g. values and sexual orientation), personality, and disorders and conditions (e.g. depression and addiction). We also present a general perspective that can bring these disparate studies together and allow us to think clearly about their philosophical and ethical implications, such as issues related to consent, privacy, and the use of persuasive technologies for controlling human behaviour. (shrink)

Interactions between an intelligent software agent and a human user are ubiquitous in everyday situations such as access to information, entertainment, and purchases. In such interactions, the ISA mediates the user’s access to the content, or controls some other aspect of the user experience, and is not designed to be neutral about outcomes of user choices. Like human users, ISAs are driven by goals, make autonomous decisions, and can learn from experience. Using ideas from bounded rationality, we frame these interactions (...) as instances of an ISA whose reward depends on actions performed by the user. Such agents benefit by steering the user’s behaviour towards outcomes that maximise the ISA’s utility, which may or may not be aligned with that of the user. Video games, news recommendation aggregation engines, and fitness trackers can all be instances of this general case. Our analysis facilitates distinguishing various subcases of interaction, as well as second-order effects that might include the possibility for adaptive interfaces to induce behavioural addiction, and/or change in user belief. We present these types of interaction within a conceptual framework, and review current examples of persuasive technologies and the issues that arise from their use. We argue that the nature of the feedback commonly used by learning agents to update their models and subsequent decisions could steer the behaviour of human users away from what benefits them, and in a direction that can undermine autonomy and cause further disparity between actions and goals as exemplified by addictive and compulsive behaviour. We discuss some of the ethical, social and legal implications of this technology and argue that it can sometimes exploit and reinforce weaknesses in human beings. (shrink)

An adaptive preference is a preference that is regimented in response to an agent’s set of feasible options. The fabled fox in the sour grapes story undergoes an adaptive preference change. I consider adaptive preferences more broadly, to include adaptive preference formation as well. I argue that many adaptive preferences that other philosophers have cast out as irrational sour-grapes-like preferences are actually fully rational preferences worthy of pursuit. I offer a means of distinguishing rational and worthy adaptive preferences from irrational (...) and unworthy ones. The distinction is based on the agent’s own appraisal of the adaptive preference. (shrink)

I argue that character planning differs from sour grapes in that the former but not the latter leaves the agent with a coherent preference structure.

In recent years, 'nudge units' or 'behavioral insights teams' have been created in the United States, the United Kingdom, Germany, and other nations. All over the world, public officials are using the behavioral sciences to protect the environment, promote employment and economic growth, reduce poverty, and increase national security. In this book, Cass R. Sunstein, the eminent legal scholar and best-selling co-author of Nudge, breaks new ground with a deep yet highly readable investigation into the ethical issues surrounding nudges, choice (...) architecture, and mandates, addressing such issues as welfare, autonomy, self-government, dignity, manipulation, and the constraints and responsibilities of an ethical state. Complementing the ethical discussion, The Ethics of Influence: Government in the Age of Behavioral Science contains a wealth of new data on people's attitudes towards a broad range of nudges, choice architecture, and mandates. (shrink)

Ockham's razor, the principle of parsimony, states that simpler theories are better than theories that are more complex. It has a history dating back to Aristotle and it plays an important role in current physics, biology, and psychology. The razor also gets used outside of science - in everyday life and in philosophy. This book evaluates the principle and discusses its many applications. Fascinating examples from different domains provide a rich basis for contemplating the principle's promises and perils. It is (...) obvious that simpler theories are beautiful and easy to understand; the hard problem is to figure out why the simplicity of a theory should be relevant to saying what the world is like. In this book, the ABCs of probability theory are succinctly developed and put to work to describe two 'parsimony paradigms' within which this problem can be solved. (shrink)

In this major book Martha Nussbaum, one of the most innovative and influential philosophical voices of our time, proposes a kind of feminism that is genuinely international, argues for an ethical underpinning to all thought about development planning and public policy, and dramatically moves beyond the abstractions of economists and philosophers to embed thought about justice in the concrete reality of the struggles of poor women. Nussbaum argues that international political and economic thought must be sensitive to gender difference as (...) a problem of justice, and that feminist thought must begin to focus on the problems of women in the third world. Taking as her point of departure the predicament of poor women in India, she shows how philosophy should undergird basic constitutional principles that should be respected and implemented by all governments, and used as a comparative measure of quality of life across nations. (shrink)

Especially troublesome in this dispute is the status of the natural sciences, and this is where Hacking finds some of his most telling cases, from the conflict ...

In controversies about technology and society, there is no idea more pro vocative than the notion that technical things have political qualities. At issue is the claim that the machines, structures, and systems of modern material culture can be accurately judged not only for their contributions of efficiency and pro-ductivity, not merely for their positive and negative environmental side effects, but also for the ways in which they can embody specific forms of power and authority. Since ideas of this kind (...) have a persistent and troubling presence in discussions about the meaning of technology, they deserve explicit attention... (shrink)

Ever-increasing numbers of human interactions with intelligent software agents, online and offline, and their increasing ability to influence humans have prompted a surge in attention toward the concept of (online) manipulation. Several scholars have argued that manipulative influence is always hidden. But manipulation is sometimes overt, and when this is acknowledged the distinction between manipulation and other forms of social influence becomes problematic. Therefore, we need a better conceptualisation of manipulation that allows it to be overt and yet clearly distinct (...) from related concepts of social influence. I argue that manipulation is careless influence, show how this account helps to alleviate the shortcomings of the hidden influence view of manipulation, and derive implications for digital ethics. (shrink)

This article argues that manipulation is negligent influence. Manipulation is negligent in the sense that manipulators do not chose their method of influence because for its potential to reveal reasons to their victims. Thus, manipulation is a lack of care, or negligence, exclusively understood exclusively in terms of how one influences. That makes the proposed account superior to the most influential alternative, which analyses manipulation disjunctively as violation of several distinct types of norms. The implication is a paradigm shift in (...) understanding manipulation in terms of what manipulators intend to do toward a focus on what they fail to do or intend. (shrink)

Manipulative actions come in a bewildering variety of forms: direct and indirect deception, playing on emotions, tempting, inciting, and so on. It is not obvious what feature all these actions share in virtue of which they are all of the same kind and in virtue of which they are all morally wrong. This article argues that all manipulative actions are cases in which the manipulator attempts to lead the victim astray by trying to get her to have emotions, beliefs, or (...) desires that, as the manipulator sees it, are not ideal for the victim. To attempt to lead a person astray in this way is to fail to respect the moral and rational agency of the victim. This analysis captures the fact that actions of many kinds--and with many different psychological effects--can be manipulative, and it tells us what is wrong with acting manipulatively. It also helps distinguish manipulation from non rational persuasion. (shrink)

More and more researchers argue that online technologies manipulate human users and, therefore, undermine their autonomy. We call this the MAL view on online technology because it argues from Manipulation to Autonomy-Loss. MAL enjoys public visibility and will shape the academic discussion to come. This view of online technology, however, fails conceptually. MAL presupposes that manipulation equals autonomy loss, and that autonomy is the absence of manipulation. That is mistaken. In short, an individual can be manipulated while being fully personally (...) autonomous. Internet policy researchers should be aware of this point to avoid looking in the wrong place in future research on manipulative and harmful online technology. (shrink)