The potential to collect brain data more directly, with higher resolution, and in greater amounts has heightened worries about mental and brain privacy. In order to manage the risks to individuals posed by these privacy challenges, some have suggested codifying new privacy rights, including a right to “mental privacy.” In this paper, we consider these arguments and conclude that while neurotechnologies do raise significant privacy concerns, such concerns are—at least for now—no different from those raised by other well-understood data collection (...) technologies, such as gene sequencing tools and online surveillance. To better understand the privacy stakes of brain data, we suggest the use of a conceptual framework from information ethics, Helen Nissenbaum’s “contextual integrity” theory. To illustrate the importance of context, we examine neurotechnologies and the information flows they produce in three familiar contexts—healthcare and medical research, criminal justice, and consumer marketing. We argue that by emphasizing what is distinct about brain privacy issues, rather than what they share with other data privacy concerns, risks weakening broader efforts to enact more robust privacy law and policy. (shrink)

In this open access book, Timothy Aylsworth and Clinton Castro draw on the deep well of Kantian ethics to argue that we have moral duties, both to ourselves and to others, to protect our autonomy from the threat posed by the problematic use of technology. The problematic use of technologies like smartphones threatens our autonomy in a variety of ways, and critics have only begun to appreciate the vast scope of this problem. In the last decade, we have seen a (...) flurry of books making “self-help” arguments about how we could live happier, more fulfilling lives if we were less addicted to our phones. But none of these authors see this issue as one involving a moral duty to protect our autonomy. (shrink)

The impact of large digital corporations on our freedom is often lamented but rarely investigated systematically. This paper aims to fill this desideratum by focusing on the power of social media corporations and the freedom of their users. In order to analyze this relationship, I distinguish two forms of freedom and two corresponding forms of power. Social media corporations extend their users’ freedom of choice by providing many new options. This provision, however, comes with the domination by these corporations because (...) it is based on their power of uncontrolled interference. Users could escape this domination through exit. One reason why they do not choose this option is that they would lose the benefits associated with the network effects provided by social media services. A second reason is that the power of social media corporations runs so deep that they are able to manipulate the autonomous decision-making processes of their users. Users are provided with many new avenues for authentic self-presentation on social media. By using them, however, users need to conform to a web interface that is designed by corporations to undermine self-control. Through these two mechanisms, corporations are able to promote an interest in users to present themselves on their platforms. Insofar as this works, they secure the users’ compliance to their domination through subjectivation. This double conjunction of choice and domination, on the one hand, and autonomy and subjectivation, on the other, makes the case that the very power of corporate social media stems from their intrinsic connection to genuine practices of freedom. (shrink)

Generative AI enables automated, effective manipulation at scale. Despite the growing general ethical discussion around generative AI, the specific manipulation risks remain inadequately investigated. This article outlines essential inquiries encompassing conceptual, empirical, and design dimensions of manipulation, pivotal for comprehending and curbing manipulation risks. By highlighting these questions, the article underscores the necessity of an appropriate conceptualisation of manipulation to ensure the responsible development of Generative AI technologies.

Are we being manipulated online? If so, is being manipulated by online technologies and algorithmic systems notably different from human forms of manipulation? And what is under threat exactly when people are manipulated online? This volume provides philosophical and conceptual depth to debates in digital ethics about online manipulation. The contributions explore the ramifications of our increasingly consequential interactions with online technologies such as online recommender systems, social media, user-friendly design, micro-targeting, default-settings, gamification, and real-time profiling. The authors in this (...) volume address four broad and interconnected themes: • What is the conceptual nature of online manipulation? And how, methodologically, should the concept be defined? • Does online manipulation threaten autonomy, freedom, and meaning in life, and if so, how? • What are the epistemic, affective, and political harms and risks associated with online manipulation? • What are legal and regulatory perspectives on online manipulation? The Philosophy of Online Manipulation brings these various considerations together to offer philosophically robust answers to critical questions concerning our online interactions with one another and with autonomous systems. It will be of interest to researchers and advanced students working in moral philosophy, digital ethics, philosophy of technology, and the ethics of manipulation. (shrink)

Open access-introduction into moral philosophy in German language that contains chapters on the concept of morality, on the development and the main positions of normative ethics, on meta-ethics, and on the various fields of applied ethics. One of its distinctive features is that it explicitly reflects on the role of morality and ethics in modern society and that it analyses the import of alternative conceptual and normative positions for determining this role. The book can be freely downloaded from the publisher's (...) website via the URL below. (shrink)

Franke Philosophy & Technology, 35(4), 1-7, (2022) offers an interesting claim that algorithmic transparency as manipulation does not necessarily follow that it is good or bad. Different people can have good reasons to adopt different evaluative attitudes towards this manipulation. Despite agreeing with some of his observations, this short reply will examine three crucial misconceptions in his arguments. In doing so, it defends why we are morally obliged to care about the manipulative potential of algorithmic transparency. It suggests that we (...) as society have a moral duty to incorporate the value of transparency into algorithmic systems while keeping algorithmic transparency itself sensitive to power relations. (shrink)

Automated algorithms are silently making crucial decisions about our lives, but most of the time we have little understanding of how they work. To counter this hidden influence, there have been increasing calls for algorithmic transparency. Much ink has been spilled over the informational account of algorithmic transparency—about how much information should be revealed about the inner workings of an algorithm. But few studies question the power structure beneath the informational disclosure of the algorithm. As a result, the information disclosure (...) itself can be a means of manipulation used by a group of people to advance their own interests. Instead of concentrating on information disclosure, this paper examines algorithmic transparency from the perspective of power, explaining how algorithmic transparency under a disciplinary power structure can be a technique of normalizing people’s behavior. The informational disclosure of an algorithm can not only set up some de facto norms, but also build a scientific narrative of its algorithm to justify those norms. In doing so, people would be internally motivated to follow those norms with less critical analysis. This article suggests that we should not simply open the black box of an algorithm without challenging the existing power relations. (shrink)

Love is often seen as the most intimate aspect of our lives, but it is increasingly engineered by a few programmers with Artificial Intelligence (AI). Nowadays, numerous dating platforms are deploying so-called smart algorithms to identify a greater number of potential matches for a user. These AI-enabled matchmaking systems, driven by a rich trove of data, can not only predict what a user might prefer but also deeply shape how people choose their partners. This paper draws on Jürgen Habermas’s “colonization (...) of the lifeworld” thesis to critically explore the insidious influence of delegating romantic decision-making to an algorithm. The love lifeworld is colonized inasmuch as online dating algorithms encroach into our romantic relations to the extent that communicative action within romance is replaced by the technocratic rules of an algorithm. (shrink)

The potential to collect brain data more directly, with higher resolution, and in greater amounts has heightened worries about mental and brain privacy. In order to manage the risks to individuals posed by these privacy challenges, some have suggested codifying new privacy rights, including a right to “mental privacy.” In this paper, we consider these arguments and conclude that while neurotechnologies do raise significant privacy concerns, such concerns are—at least for now—no different from those raised by other well-understood data collection (...) technologies, such as gene sequencing tools and online surveillance. To better understand the privacy stakes of brain data, we suggest the use of a conceptual framework from information ethics, Helen Nissenbaum’s “contextual integrity” theory. To illustrate the importance of context, we examine neurotechnologies and the information flows they produce in three familiar contexts—healthcare and medical research, criminal justice, and consumer marketing. We argue that by emphasizing what is distinct about brain privacy issues, rather than what they share with other data privacy concerns, risks weakening broader efforts to enact more robust privacy law and policy. (shrink)

Mobile health applications that promise the user to help her with some aspect of her health are very popular: for-profit apps such as MyFitnessPal, Fitbit, or Headspace have tens of millions of users each. For-profit health apps are designed and run as optimization systems. One would expect that these health apps aim to optimize the health of the user, but in reality they aim to optimize user engagement and, in effect, conversion. This is problematic, I argue, because digital health environments (...) that aim to optimize user engagement risk being manipulative. To develop this argument, I first provide a brief analysis of the underlying business models and the resulting designs of the digital environments provided by popular for-profit health apps. In a second step, I present a concept of manipulation that can help analyze digital environments such as health apps. In the last part of the article, I use my concept of manipulation to analyze the manipulative potential of for-profit health apps. Although for-profit health can certainly empower their users, the conditions for empowerment also largely overlap with the conditions for manipulation. As a result, we should be cautious when embracing the empowerment discourse surrounding health apps. An additional aim of this article is to contribute to the rapidly growing literature on digital choice architectures and the ethics of influencing behavior through such choice architectures. I take health apps to be a paradigmatic example of digital choice architectures that give rise to ethical questions, so my analysis of the manipulative potential of health apps can also inform the larger literature on digital choice architectures. (shrink)

Choice architecture describes the environment in which choices are presented to decision-makers. In recent years, public and private actors have looked at choice architecture with great interest as they seek to influence human behaviour. These actors are typically called choice architects. Increasingly, however, this role of architecting choice is not performed by a human choice architect, but an algorithm or artificial intelligence, powered by a stream of Big Data and infused with an objective it has been programmed to maximise. We (...) call this entity the autonomous choice architect. In this paper, we present an account of why artificial intelligence can fulfil the role of a choice architect and why this creates problems of transparency, responsibility and accountability for nudges. We argue that choice architects, be them autonomous computational systems or human-beings, at a most basic level select, from a range of designs, the design which is most likely to maximise a pre-determined objective. We then proceed to argue that, given the growing demand for targeted, personalised choice architecture and for faster, dynamic reconfigurations of choice architecture, as well as the ever-expanding pool of data from which feedback can be drawn, the role of the human choice architect is increasingly obscured behind algorithmic, artificially intelligent systems. We provide a discussion of the implications of autonomous choice architects, focusing on the importance of the humans who programme these systems, ultimately arguing that despite technological advances, the responsibility of choice architecture and influence remains firmly one human beings must bear. (shrink)

While the ethics of technology is analyzed across disciplines from science and technology studies, engineering, computer science, critical management studies, and law, less attention is paid to the role that firms and managers play in the design, development, and dissemination of technology across communities and within their firm. Although firms play an important role in the development of technology, and make associated value judgments around its use, it remains open how we should understand the contours of what firms owe society (...) as the rate of technological development accelerates. We focus here on digital technologies: devices that rely on rapidly accelerating digital sensing, storage, and transmission capabilities to intervene in human processes. This symposium focuses on how firms should engage ethical choices in developing and deploying these technologies. In this introduction, we, first, identify themes the symposium articles share and discuss how the set of articles illuminate diverse facets of the intersection of technology and business ethics. Second, we use these themes to explore what business ethics offers to the study of technology and, third, what technology studies offers to the field of business ethics. Each field brings expertise that, together, improves our understanding of the ethical implications of technology. Finally we introduce each of the five papers, suggest future research directions, and interpret their implications for business ethics. (shrink)

In this paper, I defend what I call the ‘Inference Principle’. This principle holds that if an agent obtains some information legitimately, then the agent can make any inference she wants based on the information, without violating anyone’s right to privacy. This principle is interesting for at least three reasons. First, it constitutes a novel answer to the timely question of whether the widespread use of ‘data analytics’ to infer personal information about individuals is morally permissible. Second, it contradicts what (...) seems to be a common view of inferences’ ability to violate privacy rights. Third, it offers an account of the theoretically underdeveloped issue of what duties are engendered by the moral right to privacy with regard to inferred information. (shrink)

My aim in this article is to set out some counter-intuitive claims about the challenges posed by artificial intelligence (AI) applications to the protection and enjoyment of human rights and to be your guide through my unorthodox ideas. While there are familiar human rights issues raised by AI and its applications, these are perhaps the easiest of the challenges because they are already recognized by the human rights regime as problems. Instead, the more pernicious challenges are those that have yet (...) to be identified or articulated, because they arise from new affordances rather than directly through AI modeled as a technology. I suggest that we need to actively explore the potential problem space on this basis. I suggest that we need to adopt models and metaphors that systematically exclude the possibility of applying the human rights regime to AI applications. This orientation will present us with the difficult, intractable problems that most urgently require responses. There are convincing ways of understanding AI that lock out the very possibility for human rights responses and this should be grounds for serious concern. I suggest that responses need to exploit both sets of insights I present in this paper: first that proactive and systematic searches of the potential problem space need to be continuously conducted to find the problems that require responses; and second that the monopoly that the human rights regime holds with regards to addressing harm and suffering needs to be broken so that we can deploy a greater range of barriers against failures to recognize and remedy AI-induced wrongs. (shrink)

This research statement presents a roadmap for the ethical evaluation of contact tracing apps. Assuming the possible development of an effective and secure contact tracing app, this roadmap explores three ethical concerns—privacy, data monopolists and coercion- based on three scenarios. The first scenario envisions and critically evaluates an app that is built on the conceptualization of privacy as anonymity and a mere individual right rather than a social value. The second scenario sketches and critically discusses an app that adequately addresses (...) privacy concerns but is facilitated by data monopolists such as Google and Apple. The final scenario discusses the coerced installation and use of a privacy-friendly, independently developed contact tracing app. The main worry is coercion through societal exclusion and limited societal participation. The statement concludes with three suggestions for designing an ethical contact tracing app and a research agenda. (shrink)

Eyewitness testimony is a powerful form of evidence, and this is especially true in the United States criminal legal system. At the same time, eyewitness misidentification is the greatest contributing factor to wrongful convictions proven by DNA testing. In this paper, I offer a close examination of this tension between the enormous epistemic weight that eyewitness testimony is afforded in the United States criminal legal system and the fact that there are important questions about its reliability as a source of (...) evidence. In Sections 1 and 2, I argue that lineups and interrogations often function by way of extracting testimony from an eyewitness through practices that are manipulative, deceptive, or coercive. I then show, in Section 3, that when testimony that is extracted in these ways is given an unwarranted excess of credibility, the eyewitness in question is the victim of what I call agential testimonial injustice. I conclude that since much of the testimony of eyewitnesses is both extracted and given an excess of credibility, there is a fairly widespread form of epistemic injustice being inflicted upon testifiers in the United States criminal legal system. This calls for reforms along both dimensions—lineups and interrogations should go through a witness's epistemic agency, rather than bypassing, exploiting, or undermining it, and the weight of the resulting testimony should be viewed in the broader context of its significant fallibility. (shrink)

Philosophy &Public Affairs, Volume 51, Issue 4, Page 333-372, Fall 2023.

This is an interdisciplinary article providing an account of a phenomenon that is quite widespread but has been thus far mostly neglected by scholars: the overuse of digital technologies. Digital overuse can be defined as a usage of digital technologies that subjects perceive as dissatisfactory and non-meaningful a posteriori. DO has often been implicitly conceived as one of the main obstacle to so-called digital well-being. The article is structured in two parts. The first provides a definition of the phenomenon and (...) a brief review of the explanations provided by various disciplines, in particular psychology and the evolutionary and behavioural sciences. Specifically, the article distinguishes between the endogenous and exogenous factors underlying digital overuse, that is between causes that seem to be intrinsic to digital technologies, and design techniques intentionally aimed at nudging users towards this behaviour. The second part is devoted to a discussion of the ethical concerns surrounding the phenomenon of the overuse of digital technologies, and how it may be possible to reduce such overuse among users. (shrink)

In this paper, we introduce a distinctive kind of psychological abuse we call Tightlacing. We begin by presenting four examples and argue that there is a distinctive form of abuse in these examples that cannot be captured by our existing moral categories. We then outline our diagnosis of this distinctive form of abuse. Tightlacing consists in inducing a mistaken self-conception in others that licenses overburdening demands on them such that victims apply those demands to themselves. We discuss typical Tightlacing strategies (...) and argue that Tightlacing typically is manipulative. Typical tightlacers will be motivated by a strong desire to suppress a kind of behaviour on the victim’s part. We will then differentiate Tightlacing from a related and widely discussed form of psychological abuse, Gaslighting. While Gaslighting focuses on the victim’s epistemic capacities and typically serves to insulate the abuser from potential dissent, Tightlacing focuses on the kind of person the victim is and typically serves to insulate the abuser from confronting ways of behaviour they cannot cope with. While Gaslighting targets the victim’s epistemic self-trust, Tightlacing targets their basic sense of who they are and their sense of entitlement to conduct themselves as who they really are. We finish by diagnosing the wrong-making features of Tightlacing, arguing that Tightlacing, among many secondary wrongs, makes the victim complicit in a denial of their rights as well as an erasure of who they are. (shrink)

In the past few years, scholars have been questioning whether the current approach in data ethics based on the higher level case studies and general principles is effective. In particular, some have been complaining that such an approach to ethics is difficult to be applied and to be taught in the context of data science. In response to these concerns, there have been discussions about how ethics should be “embedded” in the practice of data science, in the sense of showing (...) how ethical issues emerge in small technical choices made by data scientists in their day-to-day activities, and how such an approach can be used to teach data ethics. However, a precise description of how such proposals have to be theoretically conceived and could be operationalized has been lacking. In this article, we propose a full-fledged characterization of ‘embedding’ ethics, and how this can be applied especially to the problem of teaching data science ethics. Using the emerging model of ‘microethics’, we propose a way of teaching daily responsibility in digital activities that is connected to the higher level ethical challenges discussed in digital/data ethics. We ground this microethical approach into a virtue theory framework, by stressing that the goal of a microethics is to foster the cultivation of moral virtues. After delineating this approach of embedding ethics in theoretical detail, this article discusses a concrete example of how such a ‘micro-virtue ethics’ approach could be practically taught to data science students. (shrink)

Automated Influence is the use of Artificial Intelligence to collect, integrate, and analyse people’s data in order to deliver targeted interventions that shape their behaviour. We consider three central objections against Automated Influence, focusing on privacy, exploitation, and manipulation, showing in each case how a structural version of that objection has more purchase than its interactional counterpart. By rejecting the interactional focus of “AI Ethics” in favour of a more structural, political philosophy of AI, we show that the real problem (...) with Automated Influence is the crisis of legitimacy that it precipitates. (shrink)

This paper presents an overview of the risks and benefits of Social AI, understood as conversational AI systems that cater to human social needs like romance, companionship, or entertainment. Section 1 of the paper provides a brief history of conversational AI systems and introduces conceptual distinctions to help distinguish varieties of Social AI and pathways to their deployment. Section 2 of the paper adds further context via a brief discussion of anthropomorphism and its relevance to assessment of human-chatbot relationships. Section (...) 3 of the paper provides a survey of potential and in some cases demonstrated harms associated with user interactions with Social AI systems. Finally, Section 4 discusses how the benefits and harms of Social AI can best be addressed, with a primary focus on how frameworks from AI ethics can inform their development. (shrink)

Ever-increasing numbers of human interactions with intelligent software agents, online and offline, and their increasing ability to influence humans have prompted a surge in attention toward the concept of (online) manipulation. Several scholars have argued that manipulative influence is always hidden. But manipulation is sometimes overt, and when this is acknowledged the distinction between manipulation and other forms of social influence becomes problematic. Therefore, we need a better conceptualisation of manipulation that allows it to be overt and yet clearly distinct (...) from related concepts of social influence. I argue that manipulation is careless influence, show how this account helps to alleviate the shortcomings of the hidden influence view of manipulation, and derive implications for digital ethics. (shrink)

This study concerns the sociotechnical bases of human autonomy. Drawing on recent literature on AI ethics, philosophical literature on dimensions of autonomy, and on independent philosophical scrutiny, we first propose a multi-dimensional model of human autonomy and then discuss how AI systems can support or hinder human autonomy. What emerges is a philosophically motivated picture of autonomy and of the normative requirements personal autonomy poses in the context of algorithmic systems. Ranging from consent to data collection and processing, to computational (...) tasks and interface design, to institutional and societal considerations, various aspects related to sociotechnical systems must be accounted for in order to get the full picture of potential effects of AI systems on human autonomy. It is clear how human agents can, for example, via coercion or manipulation, hinder each other’s autonomy, or how they can respect each other’s autonomy. AI systems can promote or hinder human autonomy, but can they literally respect or disrespect a person’s autonomy? We argue for a philosophical view according to which AI systems—while not moral agents or bearers of duties, and unable to literally respect or disrespect—are governed by so-called “ought-to-be norms.” This explains the normativity at stake with AI systems. The responsible people (designers, users, etc.) have duties and ought-to-do norms, which correspond to these ought-to-be norms. (shrink)