It is often claimed that social media accelerate political extremism by employing personalization algorithms that filter users into groups with homogenous beliefs. While an intuitive position, recent research has shown that social media users exhibit self-filtering tendencies. In this paper, I apply Hannah Arendt’s theory of political judgment to hypothesize a cause for self-filtering on social media. According to Arendt, a crucial step in political judgment is the imagination of a general standpoint of distinct yet equal perspectives, against which individuals (...) compare their own judgments in order to test their defensibility. I argue that social media inhibit this step by gamifying the pursuit of social status, which encourages users to consider the perspectives of others not for the sake of a general standpoint but for the sake of improving their social status, resulting in self-filtering. Consequently, ameliorating political extremism on social media requires not just reforming the algorithms that deliver content to users, but the interfaces on which users present their social identities. (shrink)

The negative impacts of social media have given rise to philosophical questions around whether social media companies have the authority to regulate user-generated content on their platforms. The most popular justification for that authority is to appeal to private ownership rights. Social media companies own their platforms, and their ownership comes with various rights that ground their authority to moderate user-generated content on their platforms. However, we argue that ownership rights can be limited when their exercise results in significant harms (...) to others or the perpetration of injustices. We outline some of the substantive harms that social media platforms inflict through their practices of content moderation and some of the procedural injustices that arise through their arbitrary application of community guidelines. This provides a normative basis for calls to better regulate user-generated content on social media platforms. We conclude by considering some of the political and legal implications of our argument. (shrink)

This paper proposes a conceptual framework for evaluating how social networking platforms fare as epistemic environments for human users. I begin by proposing a situated concept of epistemic agency as fundamental for evaluating epistemic environments. Next, I show that algorithmic personalisation of information makes social networking platforms problematic for users’ epistemic agency because these platforms do not allow users to adapt their behaviour sufficiently. Using the tracing principle inspired by the ethics of self-driving cars, I operationalise it here and identify (...) three requirements that automated epistemic environments need to fulfil: (a) the users need to be afforded a range of skilled actions; (b) users need to be sensitive to the possibility to use their skills; (c) the habits built when adapting to the platform should not undermine the user’s pre-existing skills. I then argue that these requirements are almost impossible to fulfil all at the same time on current SN platforms; yet nevertheless, we need to pay attention to these whenever we evaluate an epistemic environment with automatic features. Finally, as an illustration, I show how Twitter, a popular social networking platform, will fare regarding these requirements. (shrink)

New technologies are the source of uncertainties about the applicability of moral and morally connotated concepts. These uncertainties sometimes call for conceptual engineering, but it is not often recognized when this is the case. We take this to be a missed opportunity, as a recognition that different researchers are working on the same kind of project can help solve methodological questions that one is likely to encounter. In this paper, we present three case studies where philosophers of technology implicitly engage (...) in conceptual engineering (without naming it as such). We subsequently reflect on the case studies to find out how these illustrate conceptual engineering as an appropriate method to deal with pressing concerns in the philosophy of technology. We have two main goals. We first want to contribute to the literature on conceptual engineering by presenting concrete examples of conceptual engineering in the philosophy of technology. This is especially relevant, because the technologies that are designed based on the conceptual work done by philosophers of technology potentially have crucial moral and social implications. Secondly, we want to make explicit what choices are made when doing this conceptual work. Making explicit that some of the implicit assumptions are, in fact, debated in the literature allows for reflection on these questions. Ultimately, our hope is that conscious reflection leads to an improvement of the conceptual work done. (shrink)

Are we being manipulated online? If so, is being manipulated by online technologies and algorithmic systems notably different from human forms of manipulation? And what is under threat exactly when people are manipulated online? This volume provides philosophical and conceptual depth to debates in digital ethics about online manipulation. The contributions explore the ramifications of our increasingly consequential interactions with online technologies such as online recommender systems, social media, user-friendly design, micro-targeting, default-settings, gamification, and real-time profiling. The authors in this (...) volume address four broad and interconnected themes: • What is the conceptual nature of online manipulation? And how, methodologically, should the concept be defined? • Does online manipulation threaten autonomy, freedom, and meaning in life, and if so, how? • What are the epistemic, affective, and political harms and risks associated with online manipulation? • What are legal and regulatory perspectives on online manipulation? The Philosophy of Online Manipulation brings these various considerations together to offer philosophically robust answers to critical questions concerning our online interactions with one another and with autonomous systems. It will be of interest to researchers and advanced students working in moral philosophy, digital ethics, philosophy of technology, and the ethics of manipulation. (shrink)

YouTube has been implicated in the transformation of users into extremists and conspiracy theorists. The alleged mechanism for this radicalizing process is YouTube’s recommender system, which is optimized to amplify and promote clips that users are likely to watch through to the end. YouTube optimizes for watch-through for economic reasons: people who watch a video through to the end are likely to then watch the next recommended video as well, which means that more advertisements can be served to them. This (...) is a seemingly innocuous design choice, but it has a troubling side-effect. Critics of YouTube have alleged that the recommender system tends to recommend extremist content and conspiracy theories, as such videos are especially likely to capture and keep users’ attention. To date, the problem of radicalization via the YouTube recommender system has been a matter of speculation. The current study represents the first systematic, pre-registered attempt to establish whether and to what extent the recommender system tends to promote such content. We begin by contextualizing our study in the framework of technological seduction. Next, we explain our methodology. After that, we present our results, which are consistent with the radicalization hypothesis. Finally, we discuss our findings, as well as directions for future research and recommendations for users, industry, and policy-makers. (shrink)

In this paper, we examine how the availability of massive quantities of data i.e., the “Big Data” phenomenon, contributes to the creation, spread, and harms of online misinformation. Specifically, we argue that a factor in the problem of online misinformation is the evolved human instinct to recognize patterns. While the pattern-recognition instinct is a crucial evolutionary adaptation, we argue that in the age of Big Data, these capacities have, unfortunately, rendered us vulnerable. Given the ways in which online media outlets (...) profit from the spread of misinformation by preying on this pattern-finding instinct, we conceptualize the problem that we identify as a morally objectionable form of “epistemic exploitation.” As we argue, the consumer of digital misinformation is often exploited by having her pattern-recognition instinct used against her. This exploitation is morally objectionable because it deprives her of an epistemic good to which she has a right. This epistemic good is the integrity of the pattern-recognition instinct itself which, we argue, is a capacity that allows us to participate in uniquely human goods. While our primary goal is to bring attention to this form of epistemic exploitation, we conclude by briefly evaluating some general solutions to the growing problem of online misinformation. (shrink)

The primary goal of this essay is to provide a comprehensive overview and analysis of the various relations between material artifacts and the embodied mind. A secondary goal of this essay is to identify some of the trends in the design and use of artifacts. First, based on their functional properties, I identify four categories of artifacts co-opted by the embodied mind, namely (1) embodied artifacts, (2) perceptual artifacts, (3) cognitive artifacts, and (4) affective artifacts. These categories can overlap and (...) so some artifacts are members of more than one category. I also identify some of the techniques (or skills) we use when interacting with artifacts. Identifying these categories of artifacts and techniques allows us to map the landscape of relations between embodied minds and the artifactual world. Second, having identified categories of artifacts and techniques, this essay then outlines some of the trends in the design and use of artifacts, focussing on neuroprosthetics, brain-computer interfaces, and personalisation algorithms nudging their users towards particular epistemic paths of information consumption. (shrink)

In this essay, I explore ethical considerations that might arise from the use of collaborative filtering algorithms on dating apps. Collaborative filtering algorithms can predict the preferences of a target user by looking at the past behavior of similar users. By recommending products through this process, they can influence the news we read, the movies we watch, and more. They are extremely powerful and effective on platforms like Amazon and Google. Recommender systems on dating apps are likely to group people (...) by race, since they exhibit similar patterns of behavior: users on dating platforms seem to segregate themselves based on race, exclude certain races from romantic and sexual consideration, and generally show a preference for white men and women. As collaborative filtering algorithms learn from these patterns to predict preferences and build recommendations, they can homogenize the behavior of dating app users and exacerbate biased sexual and romantic behavior. (shrink)

The topic of fake news has received increased attention from philosophers since the term became a favorite of politicians (Habgood-Coote 2016; Dentith 2016). Notably missing from the conversation, however, is a discussion of fake news and conspiracy theory media as a market. This paper will take as its starting point the account of noxious markets put forward by Debra Satz (2010), and will argue that there is a pro tanto moral reason to restrict the market for fake news. Specifically, we (...) begin with Satz’s argument that restricting a market may be required when i) that market inhibits citizens from being able to stand in an equal relationship with one another, and ii) this problem cannot be solved without such direct restrictions. Our own argument then proceeds in three parts: first, we argue that the market for fake news fits Satz’s description of a noxious market; second, we argue against explanations of the proliferation of fake news that are couched in terms of “epistemic vice”, and likewise argue against prescribing critical thinking education as a solution to the problem; finally, we conclude that, in the absence of other solutions to mitigate the noxious effects of the fake news market, we have a pro tanto moral reason to impose restrictions on this market. At the end of the paper, we consider one proposal to regulate the fake news market, which involves making social media outlets potentially liable in civil court for damages caused by the fake news hosted on their websites. (shrink)

What are the proper epistemic aims of social media sites? A great deal of social media critique presupposes an exceptionalist attitude, according to which social media is either uniquely good, or uniquely bad for our collective knowledge-generating practices. Exceptionalism about social media is troublesome, both because it leads to oversimplistic narratives, and because it prevents us making relevant comparisons to other epistemic systems. The goal of this chapter is to offer an anti-exceptionalist account of the epistemic aims of social media. (...) I will argue that social systems (and epistemic institutions in general) ought to pursue three distinct epistemic goals: promoting good epistemic outcomes for users, realising epistemically good institutional features, and achieving structural epistemic justice. Although these goals are often mutually supportive, I will consider a number of cases in which these values conflict. This means that there are epistemic dilemmas about how to design social media platforms (and other kinds of epistemic system) which can only be resolved by appealing to ethical considerations. This discussion highlights that just as in the political realm, there is no such thing as a neutral epistemic system. (shrink)

In this paper, I argue that businesses bear a pro tanto, negative, moral obligation to refuse to engage in economic relationships with representatives of intolerable ideologies. For example, restaurants should refuse to serve those displaying Nazi symbols. The crux of this argument is the claim that normal economic activity is not a morally neutral activity but rather an exercise of political power. When a business refuses to engage with someone because of their membership in some group, e.g., Black Americans, this (...) is a use of political power to signal that Black Americans are other. Conversely, when businesses engage with someone who is clearly representing an intolerable ideology, this is a use of political power that signals the acceptability of that ideology. Businesses should not do this. (shrink)

The current political climate is awash with groups that we might be tempted to label irrational, extremist, hyper-partisan; it is full of echo-chambers, radicalization, and epistemic bubbles. Philosophers have profitably analyzed some of these phenomena. In this essay, I draw attention to a crucial but neglected aspect of our time: the way in which certain groups are fanatical. I distinguish fanatical groups from other types of problematic groups, such as extremist and cultish groups. I argue that a group qualifies as (...) fanatical only if it has features that promote individual fanaticism. But how might a group promote individual fanaticism? I argue that a typical feature of fanatical groups is their tendency to encourage an emotion that philosophers sometimes call “ressentiment,” which differs from ordinary resentment. I explain what ressentiment is, how it can be fostered, and how it can lead to fanaticism. I contend that this account helps us to identify a disturbing and increasingly widespread feature of contemporary social and political groups. (shrink)

Digital technology is rapidly transforming human life. But our cognition is honed for an analog world. I call this the problem of digital whiplash: that the digital transformation of society, like a vehicle whose sudden acceleration injures its occupants, is too fast to be safe. I focus on the unprecedented phenomenon of digital surveillance, which I argue poses a long-term threat to human autonomy that our cognition is ill-suited to recognize or respond to. Human cognition is embodied and context-sensitive, and (...) thus faces four problems of digital whiplash vis-à-vis digital surveillance. First is the problem of signal sparsity, that there are few if any perceptible indications of digital surveillance. Second is the problem of signal elusiveness, that the few indications there are prohibitively difficult to discover. Third is the distraction problem, that using digital technologies corrodes the cognitive abilities we need to recognize and respond to digital surveillance. Fourth is the hooking problem, that digital technologies are engineered to cultivate dependency. I address, among other objections, the idea that we choose to exchange our privacy for the use of digital technologies, so their use is in fact an expression of autonomy. The response to digital whiplash, I argue, is not to slow down the digitalization of society in its current form so that we can adapt our cognitive capacities. It is to allow ourselves the time to reflect on and debate whether digitalization, in its current form, is delivering a socially and ethically desirable future. (shrink)

In analyzing oppressive systems like racism, social theorists have articulated accounts of the dynamic interaction and mutual dependence between psychological components, such as individuals’ patterns of thought and action, and social components, such as formal institutions and informal interactions. We argue for the further inclusion of physical components, such as material artifacts and spatial environments. Drawing on socially situated and ecologically embedded approaches in the cognitive sciences, we argue that physical components of racism are not only shaped by, but also (...) shape psychological and social components of racism. Indeed, while our initial focus is on racism and racist things, we contend that our framework is also applicable to other oppressive systems, including sexism, classism, and ableism. This is because racist things are part of a broader class of oppressive things, which are material artifacts and spatial environments that are in congruence with an oppressive system. (shrink)

So‐called nudge policies utilize insights from behavioral science to achieve policy outcomes. Nudge policies try to improve people's decisions by changing the ways options are presented to them, rather than changing the options themselves or incentivizing or coercing people. Nudging has been met with great enthusiasm but also fierce criticism. This paper provides an overview of the debate on the ethics of nudging to date. After outlining arguments in favor of nudging, we first discuss different objections that all revolve around (...) the worry that nudging vitiates personal autonomy. We split up this worry into different dimensions of autonomy, such as freedom of choice, volitional autonomy, rational agency, and freedom as nondomination. We next discuss worries that nudging is manipulative, violates human dignity, and prevents more important structural reform. Throughout, we will present responses that proponents of nudging can muster. On the whole, we conclude that the objections fail to establish that the nudge program as a whole should be rejected. At the same time, they give us important guidance when moving towards an ethical assessment of nudges on a case‐by‐case basis. Towards the end, we provide some possible ways forward in debates around the ethics of nudging. (shrink)

In this chapter we argue that emotions are mediated in an incomplete way in online social media because of the heavy reliance on textual messages which fosters a rationalistic bias and an inclination towards less nuanced emotional expressions. This incompleteness can happen either by obscuring emotions, showing less than the original intensity, misinterpreting emotions, or eliciting emotions without feedback and context. Online interactions and deliberations tend to contribute rather than overcome stalemates and informational bubbles, partially due to prevalence of anti-social (...) emotions. It is tempting to see emotions as being the cause of the problem of online verbal aggression and bullying. However, we argue that social media are actually designed in a predominantly rationalistic way, because of the reliance on text-based communication, thereby filtering out social emotions and leaving space for easily expressed antisocial emotions. Based on research on emotions that sees these as key ingredients to moral interaction and deliberation, as well as on research on text-based versus non-verbal communication, we propose a richer understanding of emotions, requiring different designs of online deliberation platforms. We propose that such designs should move from text-centred designs and should find ways to incorporate the complete expression of the full range of human emotions so that these can play a constructive role in online deliberations. (shrink)

What is indoctrination? This paper clarifies and defends a structural epistemic account of indoctrination according to which indoctrination is the inculcation of closed-minded belief caused by “epistemically insulating content.” This is content which contains a proviso that serious critical consideration of the relevant alternatives to one's belief is reprehensible whether morally or epistemically. As such, it does not demand that indoctrination be a type of unethical instruction, ideological instruction, unveridical instruction, or instruction which bypasses the agent's rational evaluation. In this (...) way, we can account for why indoctrination can occur for liberal democratic beliefs as much as it occurs for fascist, fundamentalist, or fanatical belief: for indoctrination is fundamentally a structural epistemic phenomenon. (shrink)

Transhumanism at once embodies our most modern thinking and our biggest longstanding problems. Transhumanism aims to enhance human core capacities: health-span, lifespan, and cognition. The thesis answers the following ethical challenges arising from transhumanist aims. First, whether transhumanism can be an ethical endeavour if it relies on authoritarian intervention by governments and governing bodies to change, generate and enforce behaviour, or to influence and enforce the uptake of medical procedures. Second, the thesis answers the challenge that it is unethical deliberately (...) to encourage the uptake of and pursuit of medical transhumanism given the extent of accessibility and distributive issues that remain unresolved in existing medicine. Finally, the thesis addresses a particular mental health crisis that is often predicted for transhuman beings, namely loss of meaning from loss of death and vulnerability, resulting in widespread loss of social cohesion. The thesis argues that the right solution to the first two problems is a libertarian paternalist approach, viz. nudging, and that this approach will also neutralise the risk of widespread and inevitable boredom or alienation that might otherwise result from the widespread introduction of human enhancement if people are nudged to engage more and more reflectively in their enhancement choices. Additionally, lifestyle issues like obesity, heart disease, cancers, and inaccessibility of vaccines and birth control pose unresolved problems for existing general medicine, killing millions every year worldwide. As a result, another serious challenge for enhancement medicine, which I propose would be addressed by the nudge approach, is to justify its place in the professional domain of medicine. (shrink)

ABSTRACT Understanding is a demanding epistemic state. It involves not just knowledge that things are thus and so, but grasping the reasons why and seeing how things hang together. Understanding, then, typically requires inquiry. Many of our inquiries are conducted online nowadays, with the help of search engines, forums, and social media platforms. In this paper, I explore the idea that online inquiry easily leads to what I will call online illusions of understanding. Both the structure of online information presentation (...) (with hyperlinks, shares, retweets, likes, etc.) and the operation of recommender systems and the like make it easy for people using them to form the impression that they are conducting inquiry responsibly, whereas they are in fact fed with irrelevant information, or, even worse, falsehoods, misinformation, disinformation, or outright conspiracy theories. (shrink)

The epistemic position of an agent often depends on their position in a larger network of other agents who provide them with information. In general, agents are better off if they have diverse and independent sources. Sullivan et al. [19] developed a method for quantitatively characterizing the epistemic position of individuals in a network that takes into account both diversity and independence; and presented a proof-of-concept, closed-source implementation on a small graph derived from Twitter data [19]. This paper reports on (...) an open-source reimplementation of their algorithm in Python, optimized to be usable on much larger networks. In addition to the algorithm and package, we also show the ability to scale up our package to large synthetic social network graph profiling, and finally demonstrate its utility in analyzing real-world empirical evidence of ‘echo chambers’ on online social media, as well as evidence of interdisciplinary diversity in an academic communications network. (shrink)

In this paper I argue that social networking sites (SNSs) are emotion technologies that promote a highly charged emotional environment where intrinsic emotion regulation is significantly weakened, and people's emotions are more strongly modulated by other people and by the technology itself. I show that these features of social media promote a simplistic emotional outlook which is an obstacle to the development and maintenance of virtue. In addition, I focus on the mechanisms that promote group-based anger and thus give rise (...) to affective polarisation. In the final section, after a discussion of the positive value of some forms of anger, I argue that SNSs should not be designed to prohibit or suppress anger, but that its encouragement should also be avoided. I conclude with a suggestion about how this might be achieved. (shrink)

Whereas epistemology is the philosophical theory of knowledge, its nature and scope, metaepistemology takes a step back from particular substantive debates in epistemology in order to inquire into the assumptions and commitments made by those who engage in these debates. This entry will focus on a selection of these assumptions and commitments, including whether there are objective epistemic facts; and how to characterize the subject matter and the methodology of epistemology.

Xenophobia is one of the key drivers of marginalisation, discrimination, and conflict, yet many prominent machine learning fairness frameworks fail to comprehensively measure or mitigate the resulting xenophobic harms. Here we aim to bridge this conceptual gap and help facilitate safe and ethical design of artificial intelligence (AI) solutions. We ground our analysis of the impact of xenophobia by first identifying distinct types of xenophobic harms, and then applying this framework across a number of prominent AI application domains, reviewing the (...) potential interplay between AI and xenophobia on social media and recommendation systems, healthcare, immigration, employment, as well as biases in large pre-trained models. These help inform our recommendations towards an inclusive, xenophilic design of future AI systems. (shrink)

Standard compatibilist accounts adjudicating when individuals are morally responsible for their actions are predicated on the assumption that individuals will have responsibility for the valuational structure undergirding their actions. However, I will claim that evidence from psychology and social psychology seems to show that manipulation of our valuational structure, far from being esoteric, is more common than we might pre-theoretically think. I call this evidence of manipulation the Manipulationist Threat. Given the Manipulationist Threat, I will argue that the strategies employed (...) by reasons-responsiveness and Deep Self accounts for responding to manipulation are inadequate; they fail at either giving appropriate excusing conditions, or explaining why individuals subject to manipulation maintain responsibility. (shrink)