Privacy and surveillance scholars increasingly worry that data collectors can use the information they gather about our behaviors, preferences, interests, incomes, and so on to manipulate us. Yet what it means, exactly, to manipulate someone, and how we might systematically distinguish cases of manipulation from other forms of influence—such as persuasion and coercion—has not been thoroughly enough explored in light of the unprecedented capacities that information technologies and digital media enable. In this paper, we develop a definition of (...) class='Hi'>manipulation that addresses these enhanced capacities, investigate how information technologies facilitate manipulative practices, and describe the harms—to individuals and to social institutions—that flow from such practices. -/- We use the term “online manipulation” to highlight the particular class of manipulative practices enabled by a broad range of information technologies. We argue that at its core, manipulation is hidden influence—the covert subversion of another person’s decision-making power. We argue that information technology, for a number of reasons, makes engaging in manipulative practices significantly easier, and it makes the effects of such practices potentially more deeply debilitating. And we argue that by subverting another person’s decision-making power, manipulation undermines his or her autonomy. Given that respect for individual autonomy is a bedrock principle of liberal democracy, the threat of online manipulation is a cause for grave concern. (shrink)

Ever-increasing numbers of human interactions with intelligent software agents, online and offline, and their increasing ability to influence humans have prompted a surge in attention toward the concept of (online) manipulation. Several scholars have argued that manipulative influence is always hidden. But manipulation is sometimes overt, and when this is acknowledged the distinction between manipulation and other forms of social influence becomes problematic. Therefore, we need a better conceptualisation of manipulation that allows it to (...) be overt and yet clearly distinct from related concepts of social influence. I argue that manipulation is careless influence, show how this account helps to alleviate the shortcomings of the hidden influence view of manipulation, and derive implications for digital ethics. (shrink)

Are we being manipulated online? If so, is being manipulated by online technologies and algorithmic systems notably different from human forms of manipulation? And what is under threat exactly when people are manipulated online? This volume provides philosophical and conceptual depth to debates in digital ethics about online manipulation. The contributions explore the ramifications of our increasingly consequential interactions with online technologies such as online recommender systems, social media, user-friendly design, micro-targeting, default-settings, (...) gamification, and real-time profiling. The authors in this volume address four broad and interconnected themes: • What is the conceptual nature of online manipulation? And how, methodologically, should the concept be defined? • Does online manipulation threaten autonomy, freedom, and meaning in life, and if so, how? • What are the epistemic, affective, and political harms and risks associated with online manipulation? • What are legal and regulatory perspectives on online manipulation? The Philosophy of Online Manipulation brings these various considerations together to offer philosophically robust answers to critical questions concerning our online interactions with one another and with autonomous systems. It will be of interest to researchers and advanced students working in moral philosophy, digital ethics, philosophy of technology, and the ethics of manipulation. (shrink)

More and more researchers argue that online technologies manipulate human users and, therefore, undermine their autonomy. We call this the MAL view on online technology because it argues from Manipulation to Autonomy-Loss. MAL enjoys public visibility and will shape the academic discussion to come. This view of online technology, however, fails conceptually. MAL presupposes that manipulation equals autonomy loss, and that autonomy is the absence of manipulation. That is mistaken. In short, an individual can (...) be manipulated while being fully personally autonomous. Internet policy researchers should be aware of this point to avoid looking in the wrong place in future research on manipulative and harmful online technology. (shrink)

Social media use is soaring globally. Existing research of its ethical implications predominantly focuses on the relationships amongst human users online, and their effects. The nature of the software-to-human relationship and its impact on digital well-being, however, has not been sufficiently addressed yet. This paper aims to close the gap. I argue that some intelligent software agents, such as newsfeed curator algorithms in social media, manipulate human users because they do not intend their means of influence to reveal the (...) user’s reasons. I support this claim by defending a novel account of manipulation and by showing that some intelligent software agents are manipulative in this sense. Apart from revealing a priori reason for thinking that some intelligent software agents are manipulative, the paper offers a framework for further empirical investigation of manipulation online. (shrink)

Since 2016, when the Facebook/Cambridge Analytica scandal began to emerge, public concern has grown around the threat of “online manipulation”. While these worries are familiar to privacy researchers, this paper aims to make them more salient to policymakers — first, by defining “online manipulation”, thus enabling identification of manipulative practices; and second, by drawing attention to the specific harms online manipulation threatens. We argue that online manipulation is the use of information technology (...) to covertly influence another person’s decision-making, by targeting and exploiting their decision-making vulnerabilities. Engaging in such practices can harm individuals by diminishing their economic interests, but its deeper, more insidious harm is its challenge to individual autonomy. We explore this autonomy harm, emphasising its implications for both individuals and society, and we briefly outline some strategies for combating online manipulation and strengthening autonomy in an increasingly digital world. (shrink)

At the most general level, "manipulation" refers one of many ways of influencing behavior, along with (but to be distinguished from) other such ways, such as coercion and rational persuasion. Like these other ways of influencing behavior, manipulation is of crucial importance in various ethical contexts. First, there are important questions concerning the moral status of manipulation itself; manipulation seems to be mor- ally problematic in ways in which (say) rational persuasion does not. Why is this (...) so? Furthermore, the notion of manipulation has played an increasingly central role in debates about free will and moral responsibility. Despite its significance in these (and other) contexts, however, the notion of manipulation itself remains deeply vexed. I would say notoriously vexed, but in fact direct philosophical treatments of the notion of manipulation are few and far between, and those that do exist are nota- ble for the sometimes widely divergent conclusions they reach concerning what it is. I begin by addressing (though certainly not resolving) the conceptual issue of how to distinguish manipulation from other ways of influencing behavior. Along the way, I also briefly address the (intimately related) question of the moral status of manipulation: what, if anything, makes it morally problematic? Then I discuss the controversial ways in which the notion of manipulation has been employed in contemporary debates about free will and moral responsibility. (shrink)

This chapter defends the view that manipulated behaviour is explained by an injustice. Injustices that explain manipulated behaviour need not involve agential features such as intentionality. Therefore, technology can manipulate us, even if technological artefacts like robots, intelligent software agents, or other ‘mere tools’ lack agential features such as intentionality. The chapter thus sketches a comprehensive account of manipulated behaviour related to but distinct from existing accounts of manipulative behaviour. It then builds on that account to defend the possibility that (...) we are being manipulated by technology. (shrink)

Technology scholars and journalists have recently called attention to digital platforms’ and devices’ ability to influence users based on their present moods, stress level, hunger, and other transient features. For them, such influence based on users’ present status – what the chapter calls “real-time profiling” – is not only a clear form of wrongful manipulation but also online manipulation’s future. The chapter aims to explain what makes real-time profiling wrong (when wrong) and discusses problems associated with its (...) regulation. After explaining what real-time profiling consists in and showing that it can be presumed to be a form of manipulation, the chapter argues that real-time profiling is wrong both because the profiler psychologically hijacks profiled subjects and because it works as a gateway to further wrongs. Towards the end, the chapter discusses some implications of the proposed account for the legal regulation of online manipulative technologies like real-time profiling. It is argued that existing legal frameworks are not fine-grained enough to deal with the wrongs associated with real-time profiling and related forms of online manipulation. (shrink)

This chapter discusses a problematic relation between user-friendly design and manipulation. Some specific features of the design of a website can make it a more or less potent tool for manipulation. In particular, features that can be summed up as creating a user-friendly experience are also manipulation-friendly. The ease of using a website also makes it easier to be manipulated via the website. The chapter provides an argument that this can be explained as a less intellectually virtuous (...) engagement with websites that are more user-friendly. It is simply more difficult to mobilize suitable intellectual virtues when the website is quick and easy to use. For instance, when Google Search presents search results quickly and easily users become less intellectually cautious and independent than they ought to be. The chapter discusses a mechanism that links user-friendly design to an overly trusting attitude towards a website that leads to this intellectually careless behaviour. This link is support with empirical evidence based on processing fluency effects. (shrink)

I argue for a manipulationist-mechanistic framework for content-NCC research in the case of visual consciousness (Bechtel 2008; Neisser 2012). Reference to mechanisms is common in the NCC research. Furthermore, recent developments in non-invasive brain stimulation techniques (NIBS) lend support to a manipulationist standpoint. The crucial question is to understand what is changed after manipulation of a brain mechanism. In the second part of the paper I review the literature on intentionalism, and argue that intervention on the neural mechanism is (...) likely to change the intentional content of consciousness. This urges us to shift from content-NCC to what I call “intentional mechanisms”. Such mechanisms, it is argued, should be understood as neural prerequisites of conscious visual experience. (shrink)

Psychometrics firms such as Cambridge Analytica (CA) and troll factories such as the Internet Research Agency (IRA) have had a significant effect on democratic politics, through narrow targeting of political advertising (CA) and concerted disinformation campaigns on social media (IRA) (U.S. Department of Justice 2019; Select Committee on Intelligence, United States Senate 2019; DiResta et al. 2019). It is natural to think that such activities manipulate individuals and, hence, are wrong. Yet, as some recent cases illustrate, the moral concerns with (...) these activities cannot be reduced simply to the effects they have on individuals. Rather, we will argue, the wrongness of these activities relates to the threats they present to the legitimacy of political orders. This occurs primarily through a mechanism we call “emergent manipulation,” rather than through the sort of manipulation that involves specific individuals. (shrink)

We aimed to identify the critical insights from empirical peer-reviewed studies on online romance fraud published between 2000 and 2021 through a systematic literature review using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) protocol. The corpus of studies that met our inclusion criteria comprised twenty-six studies employing qualitative (n = 13), quantitative (n = 11), and mixed (n = 2) methods. Most studies focused on victims, with eight focusing on offenders and fewer investigating public perspectives. All (...) the victim-focused studies relied on data from the Global North, except for Malaysia. Five offender-focused studies used online data available in the public domain, and three derived their data from West Africa. Our review highlights offenders' techniques to deceive and manipulate victims, as revealed in these studies, and highlights some limitations of offender- and victim-focused studies. The dominant framework used across the studies was found to be the “Scammers Persuasive Techniques Model.” While this framework provides a helpful way of considering the stages of victim involvement, it also faces some limitations, which we highlight. Our study reviews the current state of empirical knowledge on romance fraud and identifies certain gaps and biases in the literature. We argue there is a need for further research into online romance fraud to enhance our understanding of it both from the perspective of the offender as well as the experience of the victim. We also highlight the need for a more inclusive and greater range of regional and global diverse range of data sources and perspectives. Given the scale and impact of online romance fraud, we conclude that its study would benefit from a richer empirical engagement that recognizes it as both a regional and global phenomenon. (shrink)

Algorithm engineering is sometimes portrayed as a new 21st century return of manipulative social engineering. Yet algorithms are necessary tools for individuals to navigate online platforms. Algorithms are like a sensory apparatus through which we perceive online platforms: this is also why individuals can be subtly but pervasively manipulated by biased algorithms. How can we better understand the nature of algorithm engineering and its proper function? In this chapter I argue that algorithm engineering can be best conceptualized as (...) a type of environmental engineering aimed at making the online environment more hospitable to human use, in particular by safeguarding the conditions that allow for trust. (shrink)

This paper describes the ways in which trolls and bots impede the acquisition of knowledge online. I distinguish between three ways in which trolls and bots can impede knowledge acquisition, namely, by deceiving, by encouraging misplaced skepticism, and by interfering with the acquisition of warrant concerning persons and content encountered online. I argue that these threats are difficult to resist simultaneously. I argue, further, that the threat that trolls and bots pose to knowledge acquisition goes beyond the mere (...) threat of online misinformation, or the more familiar threat posed by liars offline. Trolls and bots are, in effect, fake persons. Consequently, trolls and bots can systemically interfere with knowledge acquisition by manipulating the signals whereby individuals acquire knowledge from one another online. I conclude with a brief discussion of some possible remedies for the problem of fake persons. (shrink)

A perennial problem in social epistemology is the problem of expert testimony, specifically expert testimony regarding scientific issues: for example, while it is important for me to know information pertaining to anthropogenic climate change, vaccine safety, Covid-19, etc., I may lack the scientific background required to determine whether the information I come across is, in fact, true. Without being able to evaluate the science itself, then, I need to find trustworthy expert testifiers to listen to. A major project in social (...) epistemology has thus become determining what the markers of trustworthiness are that laypersons can appeal to in order to identify and acquire information from expert testifiers. At the same time, the ways in which we acquire scientific information has changed significantly, with much of it nowadays being acquired in online environments. While much has been said about the potential pitfalls of seeking information online, little has been said about how the nature of seeking information online should make us think about the problem of expert testimony. Indeed, it seems to be an underlying assumption that good markers of trustworthiness apply equally well when seeking information from expert testifiers in online and offline environments alike, and that the new challenges and opportunities presented by online environments merely affects the methods by which we can acquire evidence of said trustworthiness. Here I argue that in making this assumption one risks failing to account for how unique features of the ways in which we acquire information online affect how we evaluate the trustworthiness of experts. Specifically, I argue for two main claims: first, that the nature of information-seeking online is such that the extent to which information is susceptible to manipulation is a dominant marker of trustworthiness; second, as a result, one will be more likely to seek out a particular kind of expert testifier in online environments, what I call a cooperative as opposed to preemptive expert. The result is that criteria for expert trustworthiness may look significantly different when acquiring information online as opposed to offline. (shrink)

This volume compiles international contributions that explore the potential risks and chances coming along with the wide-scale migration of society into digital space. Suggesting a shift of paradigm from Spiral of Silence to Nexus of Noise, the opening chapter provides an overview on systematic approaches and mechanisms of manipulation – ranging from populist political players to Cambridge Analytica. After a discussion of the the juxtaposition effects of social media use on social environments, the efficient instrumentalization of Twitter by Turkish (...) politicans in the course of the US-decision to recognize Jerusalem as Israel’s capital is being analyzed. Following a case study of Instagram, Black Lives Matter and racism is a research about the impact of online pornography on the academic performance of university students. Another chapter is pointing out the potential of online tools for the successful relaunch of shadow brands. The closing section of the book deals with the role of social media on the opinion formation about the Euromaidan movement during the Ukrainian revolution and offers a comparative study touching on Russian and Western depictions of political documentaries in the 2000s. (shrink)

Using the search engine Google to locate information linked to individuals and organizations has become part of everyday functioning. This article addresses whether the “gaming” of Internet applications in attempts to modify reputations raises substantial ethical concerns. It analyzes emerging approaches for manipulation of how personally-identifiable information is accessed online as well as critically-important international differences in information handling. It investigates privacy issues involving the data mining of personally-identifiable information with search engines and social media platforms. Notions of (...) “gaming” and “manipulation” have negative connotations as well as instrumental functions, which are distinguished in this article. The article also explores ethical matters engendered by the expanding industry of reputation management services that assist in these detailed technical matters. Ethical dimensions of online reputation are changing in the advent of reputation management, raising issues such as fairness and legitimacy of various information-related practices; the article provides scenarios and questions for classroom deliberation. (shrink)

(Dân trí) - Bạn hãy thử hình dung một bức tranh thể hiện hình ảnh một thương gia cưỡi một chú lạc đà. Dưới chân họ chỉ có cát nóng bỏng của sa mạc khô cằn, phía sau lưng họ là ánh mặt trời chói lòa, bỏng rát. Hai bên đường chỉ có sương rồng gai góc, như biểu trưng cho hành trình vất vả đầy chông gai. Một điều gây bất ngờ: chú lạc đà lại kéo theo một chiếc (...) xe hơi sang trọng. (shrink)

Concerns about threats to human autonomy feature prominently in the field of AI ethics. One aspect of this concern relates to the use of AI systems for problematically manipulative influence. In response to this, the European Union’s draft AI Act (AIA) includes a prohibition on AI systems deploying subliminal techniques that alter people’s behavior in ways that are reasonably likely to cause harm (Article 5(1)(a)). Critics have argued that the term ‘subliminal techniques’ is too narrow to capture the target cases (...) of AI-based manipulation. We propose a definition of ‘subliminal techniques’ that (a) is grounded on a plausible interpretation of the legal text; (b) addresses all or most of the underlying ethical concerns motivating the prohibition; (c) is defensible from a scientific and philosophical perspective; and (d) does not over-reach in ways that impose excessive administrative and regulatory burdens. The definition is meant to provide guidance for design teams seeking to pursue responsible and ethically aligned AI innovation. (shrink)

It is well known that on the Internet, computer algorithms track our website browsing, clicks, and search history to infer our preferences, interests, and goals. The nature of this algorithmic tracking remains unclear, however. Does it involve what many cognitive scientists and philosophers call ‘mindreading’, i.e., an epistemic capacity to attribute mental states to people to predict, explain, or influence their actions? Here I argue that it does. This is because humans are in a particular way embedded in the process (...) of algorithmic tracking. Specifically, if we endorse common conditions for extended cognition, then human mindreading (by website operators and users) is often literally extended into, that is, partly realized by, not merely causally coupled to, computer systems performing algorithmic tracking. The view that human mindreading extends outside the body into computers in this way has significant ethical advantages. It points to new conceptual ways to reclaim our autonomy and privacy in the face of increasing risks of computational control and online manipulation. These benefits speak in favor of endorsing the notion of extended mindreading. (shrink)

Children continue to be overlooked as a topic of concern in discussions around the ethical use of people’s data and information. Where children are the subject of such discussions, the focus is often primarily on privacy concerns and consent relating to the use of their data. This paper highlights the unique challenges children face when it comes to online interferences with their decision-making, primarily due to their vulnerability, impressionability, the increased likelihood of disclosing personal information online, and their (...) developmental capacities. These traits allow for practices such as hypernudging to be executed on them more accurately and with more serious consequences, specifically by potentially undermining their autonomy. We argue that children are autonomous agents in the making and thus require additional special protections to ensure that the development of their autonomy is safeguarded. This means that measures should be taken to prohibit most forms of hypernudging children and thus ensure that they are protected from this powerful technique of digital manipulation. (shrink)

Do people fall for online disinformation, or do they actively utilize it as a tool to accomplish their goals? Currently, the notion of the members of the public as victims of deception and manipulation prevails in the debate. It emphasizes the need to limit people’s exposure to falsehoods and bolster their deficient reasoning faculties. However, the observed epistemic irrationality can also stem from politically motivated reasoning incentivized by digital platforms. In this context, the readily available disinformation facilitates an (...) arms race in loyalty signaling via a public endorsement of fanciful partisan claims. Such a signaling arms race appears capable of derailing democratic decision-making perhaps more effectively than any known reasoning deficiency. Appreciating the role of an instrumentally rational cost-benefit calculus in triggering the disinformation crisis thus appears vital. Examining these themes, the paper contributes to the current debates in political epistemology and democratic theory. (shrink)

Al Mele’s Manipulated Agents: A Window to Moral Responsibility (OUP 2019) is an extraordinarily careful and clear little book. A central recurring element is the use of examples of radical value reversals due to manipulation. In this commentary, I discuss the relevance of these examples to a simple quality of will account of blameworthiness without explicit historical conditions. Such an account, I suggest, can fairly straightforwardly explain how value reversals might mitigate blameworthiness. But I also suggest that the intuition (...) that they completely remove blameworthiness should instead be explained away. (shrink)

Recent develops in AI technology have led to increasingly sophisticated forms of video manipulation. One such form has been the advent of deepfakes. Deepfakes are AI-generated videos that typically depict people doing and saying things they never did. In this paper, I demonstrate that there is a close structural relationship between deepfakes and more traditional fake barn cases in epistemology. Specifically, I argue that deepfakes generate an analogous degree of epistemic risk to that which is found in traditional cases. (...) Given that barn cases have posed a long-standing challenge for virtue-theoretic accounts of knowledge, I consider whether a similar challenge extends to deepfakes. In doing so, I consider how Duncan Pritchard’s recent anti-risk virtue epistemology meets the challenge. While Pritchard’s account avoids problems in traditional barn cases, I claim that it leads to local scepticism about knowledge from online videos in the case of deepfakes. I end by considering how two alternative virtue-theoretic approaches might vindicate our epistemic dependence on videos in an increasingly digital world. (shrink)

The recent emergence of machine-manipulated media raises an important societal question: How can we know whether a video that we watch is real or fake? In two online studies with 15,016 participants, we present authentic videos and deepfakes and ask participants to identify which is which. We compare the performance of ordinary human observers with the leading computer vision deepfake detection model and find them similarly accurate, while making different kinds of mistakes. Together, participants with access to the model’s (...) prediction are more accurate than either alone, but inaccurate model predictions often decrease participants’ accuracy. To probe the relative strengths and weaknesses of humans and machines as detectors of deepfakes, we examine human and machine performance across video-level features, and we evaluate the impact of preregistered randomized interventions on deepfake detection. We find that manipulations designed to disrupt visual processing of faces hinder human participants’ performance while mostly not affecting the model’s performance, suggesting a role for specialized cognitive capacities in explaining human deepfake detection performance. -/- . (shrink)

The simulation hypothesis can reinforce a cynical dismissal of human potential. This attitude can allow online platform designers to rationalize employing manipulative neuromarketing techniques to control user decisions. We point to cognitive boosting techniques at both user and designer levels to build critical reflection and mindfulness.

Several studies have lately revealed that social media conceal at least three dangerous pitfalls. Firstly, social media can negatively impact sociopolitical processes in advanced liberal democracies by becoming vehicles for the spread of false information that augments political polarization (Lee et al. 2017; Ostillio 2018). Secondly, as a result of the first point, social mediacan rapidly become a source of incorrect beliefs for those subjects with low digital literacy (Guess et al. 2019). Thirdly, because of the first and second points, (...) intentionally deceitful manipulations of social media content are potent generators of information cascades that increase group polarizations across groups of vulnerable social media users (Jang and Kim2018, Wang et al. 2018, Colliander 2019). These findings support the claim that the circulation of biased content on social media potentially threatens sociopolitical stability in liberal Western democracies (Duffy 2018; Sunstein 2018). Although this claim is far from being speculative, as shown by the FacebookFile investigations (Wall Street Journal 2019) and the center for humane technology’s recen tresearch, it introduces a thorny dilemma regarding the founding principles of liberal Western democracies. Namely, should Western legislators limit free speech by introducing severe penalties for those who spread fake news and the likes on social media? Or should they let the free market autonomously produce efficient technology allowing people to identify biased social media content?In other words, is a libertarian solution to the plight of online fake news and the like preferable to adequate legislation that punishes those who spread such content? Though appealing, it is unrealistic to believe that the free market can resolve this problem. On the other hand, it is realistic to suppose that Western governments should engage in a merciless battle against biased social media content. For instance, following the publication of the Report of the independent High level Group on fake news and online disinformation in 2018, the European Union introduced new directives to limit the spread of fake news online in 2021, when the Covid19 pandemic started fading. Although initiatives as such might look like limitations of free speech, there is solid philosophical ground to defend such initiatives. To prove this contention, we resort to Hobbes’s (1651, Part II, §18 and §29) argument that humans can avoid falling back into the Hobbesian state of war only if they stipulate a covenant. Specifically, we appeal to Hobbes’s (1651) argument in favor of bestowing the sovereign the right to ban those seditious doctrines that might undermine peace and sociopolitical stability in the Hobbesian Commonwealth. In this regard, we show that the Hobbesian covenant resolves conflict among humans in the same way a correlated equilibrium limits noncooperation in game theory. Namely, like game theory players, citizens enjoy greater welfare whenever they observe rules that mitigate conflict (Slomp 2010). Accordingly, we argue that citizens would be better off only if Western governments introduced severe penalties for those who intentionally spread fake news. Notably, we argue that effective regulation would create disincentives for spreading biased content and incentives for spreading truthful content. Furthermore, we argue that effective regulation against online fake news would assuage the polarizing effects of online availability cascades on social networks. Importantly, we provide empirical evidence supporting these claims by showing that the lack of effective regulation led the American government to miserably fail to contain the devasting effects of the online infodemic (i.e., the epidemic of false online information)that took place during the first two waves of the Covid19 pandemic (Evanega et al. 2020, Milosh et al. 2020). (shrink)

Public health scholars and public health officials increasingly worry about health-related misinformation online, and they are searching for ways to mitigate it. Some have suggested that the tools of digital influence are themselves a possible answer: we can use targeted, automated digital messaging to counter health-related misinformation and promote accurate information. In this commentary, I raise a number of ethical questions prompted by such proposals—and familiar from the ethics of influence and ethics of AI—highlighting hidden costs of targeted digital (...) messaging that ought to be weighed against the health benefits they promise. (shrink)

This dissertation compares the notions of homo rationalis in Philosophy and homo oeconomicus in Economics. Particularly, in Part I, we claim that both notions are close methodological substitutes. Accordingly, we show that the constraints involved in the notion of economic rationality apply to the philosophical notion of rationality. On these premises, we explore the links between the notions of Kantian and Humean rationality in Philosophy and the constructivist and ecological approaches to rationality in economics, respectively. Particularly, we show that the (...) constraints involved in both approaches to rationality in economics apply to the notions of Kantian and Humean rationality. That is why we introduce the notion of minimal global rationality. In a nutshell, the latter links one’s rationality to one’s ability to make good use of their cognitive apparatus to process contextual variables. On this basis, in Part II, we present two empirical tests showing that minimal global rationality is at work in philosophical experiments because systematic manipulations of contextual variables predictably affect philosophical judgment in the Trolley Problem and in some Knobe-like vignettes. In the first case, the manipulation of the information provided to subjects predictably causes inconsistent judgments. More precisely, subjects’ response to information shocks predictably causes them to issue inconsistent judgments. Instead, in the second case, our experimental results reveal that the Knobe Effect activates only if the perpetrator of an action is likely to be perceived as evil and unfriendly. Besides, when the Knobe-like vignettes include probabilistic outcomes, the Knobe Effect does not activate or is reduced in magnitude. For these reasons, we maintain that the availability heuristic bias arguably affects one’s judgment in Knobe-like experiment settings. Eventually, in Part III, we survey the general implications of the findings presented in Part II. First and foremost, we show that when manned social media algorithms produce wide-ranging availability cascades, agents predictably respond to those cascades by herding around biased claims. Interestingly, we find that the exposure to similarly redundant online content makes new social groups emerge unhindered. That is why populists and conspiracy theorists obtain such a large follow-up online. Secondly, we find that manned social media algorithms can exploit the flaws of minimal global rationality at a faster pace than humans. Yet, given that latter algorithms cannot do so on their own, we argue that the Turing Test is still an open game. Specifically, we argue so because state-of-the-art technology can request a service to be supplied (e.g., Google Duplex) but cannot operate direct sales. This constraint of state-of-the-art technology is linked to its inability to exploit the flaws of global minimal rationality as well as humans can. Importantly, we show that if algorithms were able to do so, the involved sociopolitical risk would be high. Therefore, we argue that only some form of regulation over state-of-the-art technology can prevent and reduce such sociopolitical risks. -/- In case you want a copy of this dissertation, please email me. (shrink)

For many employees, ‘work’ is no longer something performed while sitting at a computer in an office. Employees in a growing number of industries are expected to carry mobile devices and be available for work-related interactions even when beyond the workplace and outside of normal business hours. In this article it is argued that a future step will increasingly be to move work-related information and communication technology (ICT) inside the human body through the use of neuroprosthetics, to create employees who (...) are always ‘online’ and connected to their workplace’s digital ecosystems. At present, neural implants are used primarily to restore abilities lost through injury or illness, however their use for augmentative purposes is expected to grow, resulting in populations of human beings who possess technologically altered capacities for perception, memory, imagination, and the manipulation of physical environments and virtual cyberspace. Such workers may exchange thoughts and share knowledge within posthuman cybernetic networks that are inaccessible to unaugmented human beings. Scholars note that despite their potential benefits, such neuroprosthetic devices may create numerous problems for their users, including a sense of alienation, the threat of computer viruses and hacking, financial burdens, and legal questions surrounding ownership of intellectual property produced while using such implants. Moreover, different populations of human beings may eventually come to occupy irreconcilable digital ecosystems as some persons embrace neuroprosthetic technology, others feel coerced into augmenting their brains to compete within the economy, others might reject such technology, and still others will simply be unable to afford it. In this text we propose a model for analyzing how particular neuroprosthetic devices will either facilitate human beings’ participation in new forms of socioeconomic interaction and digital workplace ecosystems – or undermine their mental and physical health, privacy, autonomy, and authenticity. We then show how such a model can be used to create device ontologies and typologies that help us classify and understand different kinds of advanced neuroprosthetic devices according to the impact that they will have on individual human beings. (shrink)

The technology to create and automate large numbers of fake social media users, or “social bots”, is becoming increasingly more accessible to private individuals. This paper explores one potential use of the technology, namely the creation of “political bots”: social bots aimed at influencing the political opinions of others. Despite initial worries about licensing the use of such bots by private individuals, this paper provides an, albeit limited, argument in favour of this. The argument begins by providing a prima facie (...) case in favour of these political bots and proceeds by attempting to answer a series of potential objections. These objections are based on (1) the dangerous effectiveness of the technology; the (2) corruptive, (3) deceitful and (4) manipulating nature of political bots; (5) the worry that the technology will lead to chaos and be detrimental to trust online; and (6) practical issues involved in ensuring acceptable use of the technology. In all cases I will argue that the objections are overestimated, and that a closer look at the use of political bots helps us realise that using them is simply a new way of speaking up in modern society. (shrink)

The human mind possesses matchless creativity and extensive capacity to create its own reality. It has a remarkable capability for contemplation, reflection and even manipulation. Sadly, the excellent human mind has been polluted by the rituals, dogmas, and deceptions of cultures, religions and politics. Its fickleness leads to its being held captive by maya (material world). In his hymns, Guru Tegh Bahadur enunciates that the fickleness of the mind is the primary cause of unhappiness and failure in achieving our (...) prescribed life goals. The Guru urges that a human being can restrain and channelize one's mental energies, by diverting one's mind from its animalistic tendencies and turning it to the mind's innate longing for spiritual enlightenment. He asserts that with the continual longing for the Divine Grace and having a compassionate and contented attitude, one can achieve the goal of harnessing one's mind. (shrink)

"The Manipulation Argument has recently taken center stage in the free-will debate, yet little else can be said of this newcomer that is uncontroversial. At present, even the most fundamental elements of the Manipulation Argument--its structure, conclusion, and target audience--are a matter of dispute. As such, we cannot begin, as we ideally would, with a simple and relatively uncontroversial overview of the argument. Instead, clarifying the debate over the basic structure and general conclusion of the Manipulation Argument (...) will be our goal." -/- UPDATE: I now refer to an isolated objection to the counterexample step as a hardline reply, an isolated attack on the generalization step a softline reply, and an isolated response to the explanation step as an "al dente" reply. Al dente replies have been given in Mele's 2005 critique of the Four-Case Argument and my 2015 (2012) critique of Mele's Zygote Argument. I also now refer to a manipulation argument which has a generalization step that concludes to impossibilism and an explanation step which proposes an explanation for the impossibility of free will as a "Master Manipulation Argument" (examples of master manipulation arguments include Mickelson 2015 and 2019). (shrink)

It is often thought that religious experiences provide support for the cumulative case for the existence of the God of classical monotheism. In this paper, I formulate an Evil-god challenge that invites classical monotheists to explain why, based on evidence from religious experience, the belief in an omnipotent, omniscient, omnibenevolent god is significantly more reasonable than the belief in an omnipotent, omniscient, evil god. I demonstrate that religious experiences substantiate the existence of Evil-god more so than they do the existence (...) of Good-god, and, consequently, that the traditional argument from religious experience fails: it should not be included in the cumulative case for the existence of Good-god. (shrink)

I outline a heretofore neglected difference between manipulation scenarios and merely deterministic ones. Plausible scientific determinism does not imply that the relevant prior history of the universe is independent of us, while manipulation does. Owing to sensitive dependence of physical outcomes upon initial conditions, in order to trace a deterministic history, a microphysical level of analysis is required. But on this level physical laws are time-symmetrically deterministic, and causality, conceived asymmetrically, disappears. I then consider a revised scenario to (...) resurrect the threat of manipulation even in the presence of time-symmetry and sensitive dependence upon initial conditions. To do so we posit a manipulator containing all the information of the manipulated and time-symmetrically related to him. The new scenario violates special relativity, but even waiving that objection, the scenario faces a dilemma. I argue that the manipulator either lacks agency enough to manipulate the target, or can integrate thoughts separated by long time spans into a single decision. In the latter case, the 'manipulated agent' disappears into the manipulator, making it the story of just one agent. (shrink)

Human-centered explainable AI (HCXAI) advocates for the integration of social aspects into AI explanations. Central to the HCXAI discourse is the Social Transparency (ST) framework, which aims to make the socio-organizational context of AI systems accessible to their users. In this work, we suggest extending the ST framework to address the risks of social misattributions in Large Language Models (LLMs), particularly in sensitive areas like mental health. In fact LLMs, which are remarkably capable of simulating roles and personas, may lead (...) to mismatches between designers' intentions and users' perceptions of social attributes, risking to promote emotional manipulation and dangerous behaviors, cases of epistemic injustice, and unwarranted trust. To address these issues, we propose enhancing the ST framework with a fifth 'W-question' to clarify the specific social attributions assigned to LLMs by its designers and users. This addition aims to bridge the gap between LLM capabilities and user perceptions, promoting the ethically responsible development and use of LLM-based technology. (shrink)

This article is an exercise in the virtue epistemology of the internet, an area of applied virtue epistemology that investigates how online environments impact the development of intellectual virtues, and how intellectual virtues manifest within online environments. I examine online echo chambers and epistemic bubbles (Nguyen 2020, Episteme 17(2), 141–61), exploring the conceptual relationship between these online environments and the virtue of open-mindedness (Battaly 2018b, Episteme 15(3), 261–82). The article answers two key individual-level, virtue epistemic questions: (...) (Q1) How does immersion in online echo chambers and epistemic bubbles affect the cultivation and preservation of open-mindedness, and (Q2) Is it always intellectually virtuous to exhibit open-mindedness in the context of online echo chambers and epistemic bubbles? In response to Q1, I contend that both online echo chambers and online epistemic bubbles threaten to undermine the cultivation and preservation of open-mindedness, albeit via different mechanisms and to different degrees. In response to Q2, I affirm that both a deficiency and an excess of open-mindedness can be virtuous in these online environments, depending on the epistemic orientation of the digital user. (shrink)

I provide a manipulation-style argument against classical compatibilism—the claim that freedom to do otherwise is consistent with determinism. My question is simple: if Diana really gave Ernie free will, why isn't she worried that he won't use it precisely as she would like? Diana's non-nervousness, I argue, indicates Ernie's non-freedom. Arguably, the intuition that Ernie lacks freedom to do otherwise is stronger than the direct intuition that he is simply not responsible; this result highlights the importance of the denial (...) of the principle of alternative possibilities for compatibilist theories of responsibility. Along the way, I clarify the dialectical role and structure of “manipulation arguments”, and compare the manipulation argument I develop with the more familiar Consequence Argument. I contend that the two arguments are importantly mutually supporting and reinforcing. The result: classical compatibilists should be nervous—and if PAP is true, all compatibilists should be nervous. (shrink)

American History X (hereafter AHX) has been accused by numerous critics of a morally dangerous cinematic seduction: using stylish cinematography, editing, and sound, the film manipulates the viewer through glamorizing an immoral and hate-filled neo-nazi protagonist. In addition, there’s the disturbing fact that the film seems to accomplish this manipulation through methods commonly grouped under the category of “fascist aesthetics.” More specifically, AHX promotes its neo-nazi hero through the use of several filmic techniques made famous by Nazi propagandist Leni (...) Riefenstahl. Now most critics admit that, in the end, the film claims to denounce racism and attempts to show us the conversion of the protagonist to the path of righteousness, but they complain that nonetheless the film (perhaps unintentionally) ends up implicitly promoting the immoral worldview it rather superficially professes to reject in its final act. This charge of hypocrisy is connected to another worry: the moral conversion in the film is said to fall flat because the intellectual resources on display to support the character’s racism are not counterbalanced by equally explicit (but superior) arguments for the anti-racist position ultimately embraced by the character. In other words, just as the devil is said to get all the good lines in Milton’s Paradise Lost, in AHX the racists get all the arguments. This has been taken to be a morally problematic flaw of the film. Critics lament that Derek’s conversion seems to result not from relevant logical inferences and valid rational argumentation but from overly simplistic and arguably egoistic insights (e.g., “has anything you've done made your life better?”) combined, perhaps, with a hackneyed cliché (in prison, one of his best friends is a black person!) In this paper I’ll attempt to rebut these charges and defend the film as a powerful, and powerfully moral, work of art. I’ll be suggesting that the seductive techniques employed allow for many viewers a degree of sympathy towards the protagonist that is crucial, both for making that character’s more horrific actions especially unsettling, and also for making his eventual conversion plausible and ultimately compelling. I’ll also argue that the manner in which his conversion is presented is in fact subtler than many critics have allowed: Derek’s transformation is not artificial or implausible but is depicted as resulting from a cumulative series of emotionally powerful life events and personal engagements. It is certainly true that it is not represented in the way some would seemingly have preferred, i.e. as straightforwardly resulting from a process of gradual intellectual improvement in Derek’s reasoning on questions of race and politics. However, I’ll argue that the decidedly emotional basis of his moral evolution is both refreshingly realistic and no hindrance to accepting his conversion as rational. Finally, properly understanding the legitimacy of the emotional foundations of much moral thought will also allow us to appreciate the ways in which our initial worries about this film’s (not insignificant) ability to persuade viewers through the engagement of emotions need not, in itself, be seen as a barrier to endorsing the film as a morally praiseworthy work. (shrink)

This article argues that manipulation is negligent influence. Manipulation is negligent in the sense that manipulators do not chose their method of influence because for its potential to reveal reasons to their victims. Thus, manipulation is a lack of care, or negligence, exclusively understood exclusively in terms of how one influences. That makes the proposed account superior to the most influential alternative, which analyses manipulation disjunctively as violation of several distinct types of norms. The implication is (...) a paradigm shift in understanding manipulation in terms of what manipulators intend to do toward a focus on what they fail to do or intend. (shrink)

Alfred Mele’s zygote argument is widely considered to be the strongest version of the manipulation argument against compatibilism (about free will and determinism). Opponents have focused largely on the first of its two premises and on the overall dialectic. My focus here will be on the underlying thought experiment—the Diana scenario—and on the second premise of the argument. I will argue that reflection on the Diana scenario shows that the second premise does not hold, and we will see that (...) my objection to the second premise helps to defend the claim that manipulation arguments face, in general, a dilemma. (shrink)

Agrippa was the main expounder of the occult philosophy, which is the knowledge of the hidden causes of things and is finalized to their manipulation by magic. Magic, in turn, is the highest form and the end of philosophy. According to his De occulta philosophia, magic is threefold: natural (concerning sublunar world), celestial (concerning stars and heavenly intelligences), and divine (concerning God and higher angels). It consists of the manipulation of concrete objects and of the summoning of intelligences (...) and God, which is performed on the basis of the precepts of the Kabbalah. Agrippa’s overall aim was to purify magic from its necromantic and irrational components: this would enable the restoration of the prelapsarian condition of man (in accordance with the Hermetic ideal of deification) and a Christian reform of culture. The critique of philosophical knowledge and of every science, presented in Agrippa’s De vanitate, and his critique to the subordination of woman typical of Scholastic theology, contained in the De nobilitate foeminei sexus, are functional to these ends. (shrink)

Incompatibilists and compatibilists (mostly) agree that there is a strong intuition that a manipulated agent, i.e., an agent who is the victim of methods such as indoctrination or brainwashing, is unfree. They differ however on why exactly this intuition arises. Incompatibilists claim our intuitions in these cases are sensitive to the manipulated agent’s lack of ultimate control over her actions, while many compatibilists argue that our intuitions respond to damage inflicted by manipulation on the agent’s psychological and volitional capacities. (...) Much hangs on this issue because manipulation-based arguments are among the most important for defending incompatibilist views of free will. In this paper, I investigate this issue from a experimental perspective, using a set of statistical methods well suited for identifying the features of hypothetical cases people’s intuitions are responding to. Results strongly support the compatibilist view—subjects’ tendency to judge that a manipulated agent is unfree was found to depend on their judgments that the agent suffers impairments to certain psychological/volitional capacities that compatibilists say are the basis for free will. I discuss the significance of these results for the use of manipulation cases in the philosophical debate about free will. (shrink)

Our understanding of what exactly needs protected against in order to safeguard a plausible construal of our ‘freedom of thought’ is changing. And this is because the recent influx of cognitive offloading and outsourcing—and the fast-evolving technologies that enable this—generate radical new possibilities for freedom-of-thought violating thought manipulation. This paper does three main things. First, I briefly overview how recent thinking in the philosophy of mind and cognitive science recognises—contrary to traditional Cartesian ‘internalist’ assumptions—ways in which our cognitive faculties, (...) and even our beliefs, can be materially realised by as well as stored non-biologically and extracranially. Second, and taking brain-computer interface technologies (BCIs) and the associated possibility of ‘extended’ beliefs as a reference point, I propose and defend a sufficient condition on freedom-of-thought violating (extended) thought manipulation. On the view proposed, the right not to have one’s thoughts or opinions manipulated is violated if one is (i) caused to acquire non-autonomous propositional attitudes (acquisition manipulation) or (ii) caused to have otherwise autonomous propositional attitudes non-autonomously eradicated (eradication manipulation). The implications of this view are then illustrated through four thought experiments, which map on to four distinct ways—what I call Type 1-Type 4 manipulation—in which, and with reference to the view defended, one’s freedom of thought is plausibly violated. (shrink)

In this paper we analyze the non-coercive ways in which researchers can use knowledge about the decision-making tendencies of potential participants in order to motivate them to consent to research enrollment. We identify which modes of influence preserve respect for participants’ autonomy and which disrespect autonomy, and apply the umbrella term of manipulation to the latter. We then apply our analysis to a series of cases adapted from the experiences of clinical researchers in order to develop a framework for (...) thinking through the ethics of manipulating people into research participation. All manipulation disrespects autonomy and is therefore pro tanto wrong. However, only deceptive manipulation invalidates the consent that results from it. Use of the other forms of manipulation can be permissible, but only if the outcome of using manipulation is sufficiently good and if the research cannot be carried out using ethically preferable means to obtain consent. (shrink)

A probability aggregation rule assigns to each profile of probability functions across a group of individuals (representing their individual probability assignments to some propositions) a collective probability function (representing the group's probability assignment). The rule is “non-manipulable” if no group member can manipulate the collective probability for any proposition in the direction of his or her own probability by misrepresenting his or her probability function (“strategic voting”). We show that, except in trivial cases, no probability aggregation rule satisfying two mild (...) conditions (non-dictatorship and consensus preservation) is non-manipulable. (shrink)

In mental action there is no motor output to be controlled and no sensory input vector that could be manipulated by bodily movement. It is therefore unclear whether this specific target phenomenon can be accommodated under the predictive processing framework at all, or if the concept of “active inference” can be adapted to this highly relevant explanatory domain. This contribution puts the phenomenon of mental action into explicit focus by introducing a set of novel conceptual instruments and developing a first (...) positive model, concentrating on epistemic mental actions and epistemic self-control. Action initiation is a functionally adequate form of self-deception; mental actions are a specific form of predictive control of effective connectivity, accompanied and possibly even functionally mediated by a conscious “epistemic agent model”. The overall process is aimed at increasing the epistemic value of pre-existing states in the conscious self-model, without causally looping through sensory sheets or using the non-neural body as an instrument for active inference. (shrink)