Automated influence is one of the most pervasive applications of artificial intelligence in our day-to-day lives, yet a thoroughgoing account of its associated individual and societal harms is lacking. By far the most widespread, compelling, and intuitive account of the harms associated with automated influence follows what I call the control argument. This argument suggests that users are persuaded, manipulated, and influenced by automated influence in a way that they have little or no control over. Based on evidence about the (...) effectiveness of targeted advertising as well as empirical results about the nature of attentional control, I provide reasons to reject this argument. In turn, I use C. Thi Nguyen's theory of value collapse to develop a new account of the harmfulness of automated influence. (shrink)

The prevailing discourse around AI ethics lacks the language and formalism necessary to capture the diverse ethical concerns that emerge when AI systems interact with individuals. Drawing on Sen and Nussbaum’s capability approach, we present a framework formalizing a network of ethical concepts and entitlements necessary for AI systems to confer meaningful benefit or assistance to stakeholders. Such systems enhance stakeholders’ ability to advance their life plans and well-being while upholding their fundamental rights. We characterize two necessary conditions for morally (...) permissible interactions between AI systems and those impacted by their functioning, and two sufficient conditions for realizing the ideal of meaningful benefit. We then contrast this ideal with several salient failure modes, namely, forms of social interactions that constitute unjustified paternalism, coercion, deception, exploitation and domination. The proliferation of incidents involving AI in high-stakes domains underscores the gravity of these issues and the imperative to take an ethics-led approach to AI systems from their inception. (shrink)

Many technology ethicists hold that the time has come to articulate _neurorights_: our normative claims vis-à-vis our brains and minds. One such claim is the right to _mental integrity_ (‘MI’). I begin by considering some paradigmatic threats to MI (§1) and how the dominant autonomy-based conception (‘ABC’) of MI attempts to make sense of them (§2). I next consider the objection that the ABC is _overbroad_ in its understanding of what threatens MI and suggest a friendly revision to the ABC (...) that addresses the objection (§3). I then consider a second objection: that the ABC cannot make sense of the MI of the _non-autonomous_. This objection appears fatal even to the revised ABC (§4). On that basis, I develop an alternative conception on which MI is grounded in a plurality of simpler capacities, namely, those for _affect_, _cognition_, and _volition_. Each of these more basic capacities grounds a set of fundamental interests, and they are for that reason worthy of protection even when they do not rise to the level of complexity necessary for autonomy (§5). This yields a fully general theory of MI that accounts for its manifestations in both the autonomous and the non-autonomous. (shrink)

With an eye on the future of global ethics, I argue that social-media technologies are not morally neutral tools but are, for all intents and purposes, a kind of agent. They nudge us to do things that are bad for us. Moreover, I argue that we have a duty to quit using social-media platforms, not just on account of possible duties to preserve our own well-being but because users are akin to test subjects on whom developers are testing new nudges, (...) and we ought to deprive them of their test subjects. (shrink)

In this open access book, Timothy Aylsworth and Clinton Castro draw on the deep well of Kantian ethics to argue that we have moral duties, both to ourselves and to others, to protect our autonomy from the threat posed by the problematic use of technology. The problematic use of technologies like smartphones threatens our autonomy in a variety of ways, and critics have only begun to appreciate the vast scope of this problem. In the last decade, we have seen a (...) flurry of books making “self-help” arguments about how we could live happier, more fulfilling lives if we were less addicted to our phones. But none of these authors see this issue as one involving a moral duty to protect our autonomy. (shrink)

In recent years, philosophers have identified a number of moral and psychological harms associated with the attention economy (Alysworth & Castro, 2021; Castro & Pham, 2020; Williams, 2018). Missing from many of these accounts of the attention economy, however, is what exactly attention is. As a result of this neglect of the cognitive science of attention, many of these accounts are not empirically credible. They rely on oversimplified and unsophisticated accounts of not only attention, but self- control, and addiction as (...) well. Of note are accounts of the attention economy that rely on the ‘brain disease’ rhetoric of addiction and subsequent control failures (Aylsworth & Castro, 2021; Bhargava & Velasquez, 2021), accounts that rely on a strict dichotomy of top-down vs. bottom-up attention (Williams, 2018; Aylsworth & Castro, 2021), and accounts that construe attention as a limited resource (Williams, 2018). -/- Drawing on recent work from the neuroscience and psychology of attention, I demonstrate the shortcomings of these accounts and sketch a way forward for an empirically grounded account of the attention economy. These accounts tend to uphold strict dichotomies of voluntary control (e.g., compulsion versus choice, dual-process models of self-control, and top-down versus bottom-up) that cannot account for the complexities of attentional control, mental agency, and decision-making. As such, these empirically and conceptually impoverished accounts cannot adequately address the current so-called crisis of attention. To better understand the harms associated with the attention economy, we need an empirically responsible account of the nature and function of attention and mental agency. (shrink)

In this chapter, we turn our attention to the effects of the attention economy on our ability to act autonomously as a group. We begin by clarifying which sorts of groups we are concerned with, which are structured groups (groups sufficiently organized that it makes sense to attribute agency to the group itself). Drawing on recent work by Purves and Davis (2022), we describe the essential roles of trust (i.e., depending on groups to fulfill their commitments) and trustworthiness (i.e., the (...) property of a group that makes trusting them fitting) in autonomous group action, with particular emphasis on democratic institutions (which we view as group agents) and democratic legitimacy (which depends on trust and trustworthiness). We then explain how engagement maximization promotes polarization, which is detrimental to trust and trustworthiness and, in turn, democratic legitimacy and democratic institutions. We close by considering what groups might do to protect themselves from the threat posed to them by the attention economy. (shrink)

Despite growing understanding of the addictive qualities of the internet, and rising concerns about the effects of excessive internet use on personal wellbeing and mental health, the corresponding ethical debate is still in its infancy, and many of the relevant philosophical and conceptual frameworks are underdeveloped. Our goal in this chapter is to explore some of this evolving terrain. While there are unique ethical considerations that pertain to the formalisation of a disorder related to excessive internet use, our ethical concerns (...) (and indeed our mental health concerns) about whether certain technologies undermine wellbeing can and should be far broader than the debates about the appropriateness of particular diagnostic categories. In this chapter we introduce some of these wider debates with regards to persuasive digital technologies— particularly those which aim to maximise use, or even to encourage compulsive engagement—as well as the difficulty in articulating the harms involved in excessive internet use, especially where such use has not led to functional impairment. Following these conversations we briefly consider some more practical ethical implications, including regulation of certain design features, concerns about growing socioeconomic inequality in online services, and whether there should be a “right to disconnect.”. (shrink)

Our time is marked by a resurgence of hate that threatens to increase oppression. Social media has contributed to this by acting as a medium through which hate speech is spread. How should we model the spread of hate? This article considers two models. First, I consider a simple contagion model. In this model, hate spreads like a virus through a social network. This model, however, fails to capture the fact that people do not acquire hatred from a single infectious (...) contact. Instead, it builds up in a person's beliefs and attitudes through time until the infection reaches a level where the subject themselves becomes a generator of hate speech. Second, to accommodate this, I consider an alternative model known as complex contagion. I argue that not only is a complex contagion model more explanatory and predictive, but it can be used to explain why certain features of social media cause it to be a promoter of hate. I conclude by sketching some mitigation strategies. (shrink)

By introducing the concept of “mental data,” Palermos (2023) highlights an underappreciated aspect of data ethics that policymakers would do well to heed. Sweeping artificial intelligence (AI) legi...

Smartphone use plays an increasingly important role in our daily lives. Philosophical research that has used first wave or second wave theories of extended cognition in order to understand our engagement with digital technologies has focused on the contribution of these technologies to the completion of specific cognitive tasks (e.g., remembering, reasoning, problem-solving, navigation).However, in a considerable number of cases, everyday smartphone use is task-unrelated. In psychological research, these cases have been captured by notions such as absent-minded smart-phone use (Marty-Dugas (...) et al., 2018) or smartphone-related inattentiveness (Liebherr et al., 2020).Given the prevalence of these cases, we develop a conceptual framework that can accommodate the functional and phenomenological characteristics of task-unrelated smartphone use. To this end, we will integrate research on second wave extended cognition with mind-wandering research and introduce the concept of ‘extended mind-wandering’. Elaborating the family resemblances approach to mind-wandering (Seli, Kane, Smallwood, et al., 2018), we will argue that task-unrelated smartphone use shares many characteristics with mind-wandering. We will suggest that an empirically informed conceptual analysis of cases of extended mind-wandering can enrich current work on digitally extended cognition by specifying the influence of the attention economy on our cognitive dynamics. (shrink)

Is it wrong to distract? Is it wrong to direct others’ attention in ways they otherwise would not choose? If so, what are the grounds of this wrong – and, in expounding them, do we have to at once condemn large chunks of contemporary digital commerce (also known as the attention economy)? In what follows, I attempt to cast light on these questions. Specifically, I argue – following the pioneering work of Jasper Tran and Anuj Puri – that there is (...) a right to attention, and that its existence underlies some of our claims regarding the wrongness of distractions. However, I depart from both these authors in two respects: first, I present a new way of deriving the right to attention, grounding it in the more fundamental right to mental integrity. Second, I remain agnostic on whether the contemporary business practices of capturing attention in exchange for a variety of digital products and services are plagued by routine violations of the right. (shrink)

Is it wrong to distract? Is it wrong to direct others’ attention in ways they otherwise would not choose? If so, what are the grounds of this wrong – and, in expounding them, do we have to at once condemn large chunks of contemporary digital commerce (also known as the attention economy)? In what follows, I attempt to cast light on these questions. Specifically, I argue – following the pioneering work of Jasper Tran and Anuj Puri – that there is (...) a right to attention, and that its existence underlies some of our claims regarding the wrongness of distractions. However, I depart from both these authors in two respects: first, I present a new way of deriving the right to attention, grounding it in the more fundamental right to mental integrity. Second, I remain agnostic on whether the contemporary business practices of capturing attention in exchange for a variety of digital products and services are plagued by routine violations of the right. (shrink)

What precisely does a distraction threaten? An agent who spends an inordinate amount of time attending to her smartphone – what precisely is she lacking? I argue that whereas agency of attention is the agent’s non-automatic decision-making on what she currently pays attention to, autonomy of attention is the agent, through her second-order desires, effectively interfering with her non-automatic decision-making on what she currently pays attention to. Freedom of attention is the agent’s possibility to hold or switch her focus of (...) attention without fixating on any specific focus against her will or without distraction from chosen foci. This conceptual work provides resources to track manipulations that diminish a person’s freedom of attention. (shrink)

Augmented reality (AR) technologies function to ‘augment’ normal perception by superimposing virtual objects onto an agent’s visual field. The philosophy of augmented reality is a small but growing subfield within the philosophy of technology. Existing work in this subfield includes research on the phenomenology of augmented experiences, the metaphysics of virtual objects, and different ethical issues associated with AR systems, including (but not limited to) issues of privacy, property rights, ownership, trust, and informed consent. This paper addresses some epistemological issues (...) posed by AR systems. I focus on a near-future version of AR technology called the Real-World Web, which promises to radically transform the nature of our relationship to digital information by mixing the virtual with the physical. I argue that the Real-World Web (RWW) threatens to exacerbate three existing epistemic problems in the digital age: the problem of digital distraction, the problem of digital deception, and the problem of digital divergence. The RWW is poised to present new versions of these problems in the form of what I call the augmented attention economy, augmented skepticism, and the problem of other augmented minds. The paper draws on a range of empirical research on AR and offers a phenomenological analysis of virtual objects as perceptual affordances to help ground and guide the speculative nature of the discussion. It also considers a few policy-based and designed-based proposals to mitigate the epistemic threats posed by AR technology. (shrink)

The attention economy — the market where consumers’ attention is exchanged for goods and services — poses a variety of threats to individuals’ autonomy, which, at minimum, involves the ability to set and pursue ends for oneself. It has been argued that the threat wireless mobile devices pose to autonomy gives rise to a duty to oneself to be a digital minimalist, one whose interactions with digital technologies are intentional such that they do not conflict with their ends. In this (...) paper, we argue that there is a corresponding duty to others to be an attention ecologist, one who promotes digital minimalism in others. Although the moral reasons for being an attention ecologist are similar to those that motivate the duty to oneself, the arguments diverge in important ways. We explore the application of this duty in various domains where we have special obligations to promote autonomy in virtue of the different roles we play in the lives of others, such as parents and teachers. We also discuss the consequences of our arguments for employers, software developers, and policy makers. (shrink)

The harms associated with wireless mobile devices (e.g. smartphones) are well documented. They have been linked to anxiety, depression, diminished attention span, sleep disturbance, and decreased relationship satisfaction. Perhaps what is most worrying from a moral perspective, however, is the effect these devices can have on our autonomy. In this article, we argue that there is an obligation to foster and safeguard autonomy in ourselves, and we suggest that wireless mobile devices pose a serious threat to our capacity to fulfill (...) this obligation. We defend the existence of an imperfect duty to be a ‘digital minimalist’. That is, we have a moral obligation to be intentional about how and to what extent we use these devices. The empirical findings already justify prudential reasons in favor of digital minimalism, but the moral duty is distinct from and independent of prudential considerations. (shrink)

What are the proper epistemic aims of social media sites? A great deal of social media critique presupposes an exceptionalist attitude, according to which social media is either uniquely good, or uniquely bad for our collective knowledge-generating practices. Exceptionalism about social media is troublesome, both because it leads to oversimplistic narratives, and because it prevents us making relevant comparisons to other epistemic systems. The goal of this chapter is to offer an anti-exceptionalist account of the epistemic aims of social media. (...) I will argue that social systems (and epistemic institutions in general) ought to pursue three distinct epistemic goals: promoting good epistemic outcomes for users, realising epistemically good institutional features, and achieving structural epistemic justice. Although these goals are often mutually supportive, I will consider a number of cases in which these values conflict. This means that there are epistemic dilemmas about how to design social media platforms (and other kinds of epistemic system) which can only be resolved by appealing to ethical considerations. This discussion highlights that just as in the political realm, there is no such thing as a neutral epistemic system. (shrink)

Critics of persuasive advertising argue that it undermines the autonomy of consumers by manipulating their desires in morally problematic ways. My aim is this paper is to refine that argument by employing a conception of autonomy that is not at odds with certain forms of manipulation. I argue that the charge of manipulation is not sufficient for condemning persuasive advertising. On my view, manipulation of an agent’s desires through advertising is justifiable in cases where the agent accepts the process through (...) which the desires were developed. I show how the standard manipulation objection proves too much as it would also condemn cases of that kind. I argue that this distinction is especially important when we consider the implications of “new media.” In addition to increasing vulnerability to manipulation, new media have considerable impacts on well-being. By siding with the traditional autonomy argument, we would be compelled to take an implausible stand against all forms of manipulation through advertising, but I suggest that only a proper subset of those cases are morally problematic. This conclusion opens up a space for persuasive advertising that is permissible while nevertheless condemning cases that violate consumers’ autonomy. (shrink)

Is it possible to measure a people’s capacity for containing the ambitions of any regime at its helm—its ability to resist the power of a tyrant? We begin here from the premise that this power has to be in proportion to individuals’ capacity (both individually and in groups) for communicating, at least among themselves, dissatisfaction with the regime. As the paper subsequently shows, by articulating an ontology of information diffusion on a communication network structure, it is possible to take some (...) stock of the features of a communications network that facilitate resistance to tyranny (among other things), and so to begin answering questions about the sort of power that people living within them might be able to mobilize, while not yet answering outright the question of how to measure the power to resist. (shrink)