In “Regulating social media as a public good: Limiting epistemic segregation” (2022), Toby Handfield tackles a well-known problematic aspect of widespread social media use: the formation of ideologically monotone and insulated social networks. Handfield argues that we can take some cues from economics to reduce the extent to which echo chambers grow up around individual users. Specifically, he argues that tax incentives to encourage network heterophily may be levied at any of three different groups: individual (...) class='Hi'>social media users, social media sites/companies, or advertisers who use social media to promote their products and material. In this response, I examine the plausibility of using such incentives on each of the these groups. I argue, first, that using tax incentives on either (1) social media companies or (2) advertisers would be ineffective as these incentives could not feasibly be made strong enough to override the enormous financial gain of the standard social media algorithms. Next, I argue that levying the incentives/penalties on individual users would be a hazard, due to the risk of what is called the epistemic “backfire effect”. Finally, I argue that the problem lies in relying on incentives and disincentives—rather than direct regulation—to increase network heterophily. (shrink)

Recent conversation has blurred two very different social epistemic phenomena: echo chambers and epistemic bubbles. Members of epistemic bubbles merely lack exposure to relevant information and arguments. Members of echo chambers, on the other hand, have been brought to systematically distrust all outside sources. In epistemic bubbles, other voices are not heard; in echo chambers, other voices are actively undermined. It is crucial to keep these phenomena distinct. First, echo chambers can explain the post-truth phenomena (...) in a way that epistemic bubbles cannot. Second, each type of structure requires a distinct intervention. Mere exposure to evidence can shatter an epistemic bubble, but may actually reinforce an echo chamber. Finally, echo chambers are much harder to escape. Once in their grip, an agent may act with epistemic virtue, but social context will pervert those actions. Escape from an echo chamber may require a radical rebooting of one's belief system. (shrink)

It is often claimed that epistemic bubbles and echo chambers foster post-truth by filtering our access to information and manipulating our epistemic attitude. In this paper, I try to add a further level of analysis by adding the issue of belief formation. Building on cognitive psychology work, I argue for a dual-system theory according to which beliefs derive from a default system and a critical system. One produces beliefs in a quasi-automatic, effortless way, the other in a slow, effortful (...) way. I also argue that digital socio-epistemic environments tend to inculcate disvalues in their agent's epistemic identity, a process that causes the cognitive shortcircuits typical of conspiracy theories. (shrink)

Are extreme beliefs constitutive of echo chambers, or only typically caused by them? Or are many echo chambers unproblematic, amplifying relatively benign beliefs? This paper details the conceptual relations between echo chambers and extreme beliefs, showing how different conceptual choice-points in how we understand both echo chambers and extreme beliefs affects how we should evaluate, study, and engage with echo chambering groups. We also explore how our theories of extreme beliefs and echo chambers shape (...) social scientific research and contribute in a practical way when treating these phenomena, focusing on examples of climate change scepticism. (shrink)

Intractable political disagreements threaten to fracture the common ground upon which we can build a political community. The deepening divisions in society are partly fueled by the ways social media has shaped political engagement. Social media allows us to sort ourselves into increasingly likeminded groups, consume information from different sources, and end up in polarized and insular echo chambers. To solve this, many argue for various ways of cultivating more responsible epistemic agency. This chapter argues that this (...) epistemic lens does not reveal the complete picture and therefore misses a form of moral respect required to reestablish cooperation across disagreements in a divided society. The breakdown of discourse online provides renewed reasons to draw out not an epistemic but a moral basis for political cooperation among diverse citizens—one inspired by Rawlsian political liberalism. We need ways to cultivate mutual respect for our fellow citizens in order to reestablish common moral ground for political debate. (shrink)

The epistemic position of an agent often depends on their position in a larger network of other agents who provide them with information. In general, agents are better off if they have diverse and independent sources. Sullivan et al. [19] developed a method for quantitatively characterizing the epistemic position of individuals in a network that takes into account both diversity and independence; and presented a proof-of-concept, closed-source implementation on a small graph derived from Twitter data [19]. This paper reports on (...) an open-source reimplementation of their algorithm in Python, optimized to be usable on much larger networks. In addition to the algorithm and package, we also show the ability to scale up our package to large synthetic social network graph profiling, and finally demonstrate its utility in analyzing real-world empirical evidence of ‘echo chambers’ on online social media, as well as evidence of interdisciplinary diversity in an academic communications network. (shrink)

Some common explanations of issue polarization and echo chambers rely on social or cognitive mechanisms of exclusion. Accordingly, suggested interventions like “be more open-minded” target these mechanisms: avoid epistemic bubbles and don’t discount contrary information. Contrary to such explanations, we show how a much weaker mechanism—the preference for belief—can produce issue polarization in epistemic communities with little to no mechanisms of exclusion. We present a network model that demonstrates how a dynamic interaction between the preference for belief and (...) common structures of epistemic communities can turn very small unequal distributions of initial beliefs into full-blown polarization. This points to a different class of explanations, one that emphasizes the importance of the initial spread of information. We also show how our model complements extant explanations by including a version of biased assimilation and motivated reasoning—cognitive mechanisms of exclusion. We find that mechanisms of exclusion can exacerbate issue polarization, but may not be the ultimate root of it. Hence, the recommended interventions suggested by extant literature is expected to be limited and the problem of issue polarization to be even more intractable. (shrink)

My aim in this paper is to engage with C. Thi Nguyen’s characterization of the echo chamber and to propose two things. First, I argue that a proper reading of his concept of echo chamber should make use of the notion of ignorance in the form of a structural epistemic insensitivity. My main contention is that ignorance as a substantive structural practice accounts for the epistemically deleterious effects of echo chambers. Second, I propose that from the talk (...) of ignorance we should be able to see echo chambers in terms of their more harmful impacts in our daily lives. To do that, I argue that we should think of echo chambers as tools to promote hermeneutical domination. If my representation of Nguyen’s concept is accurate, I believe we can see some important theoretical consequences stemming from the way Nguyen understands it. (shrink)

C. Thi Nguyen's (2020) recent account of echo chambers as social epistemic structures that actively exclude outsiders’ voices has sparked debate on the connection between echo chambers and epistemic injustice (Santos 2021; Catala 2021; Elzinga 2021).In this paper I am mainly concerned with the connection between echo chambers and testimonial injustice, understood as an instance whereby a speaker receives less epistemic credibility than they deserve, due to a prejudice in the hearer (Fricker 2007). In her reconstruction (...) of the types of testimonial injustice, Catala implicitly equates incidental testimonial injustice as resulting from epistemic prejudice and systematic testimonial injustice as resulting from identity prejudice. As I will argue, there as certain cases that fall in between these interpretations, namely instances of incidental testimonial injustice, whereby the impact on the speaker is localized, but where the credibility deficit nevertheless results from identity prejudice. One example of how this can manifest is the structural distrust against health-care experts in anti-vaccination echo-chambers, wherein said experts’ testimony is dismissed due to unwarranted assumptions regarding their motives qua their social type. To understand the importance and severity of the testimonial injustices in echo chambers, we need to look beyond the specific harms that are done to the targeted speakers and the immediate loss of knowledge, but also take into account the consequences for fairness in public deliberation—the latter being a fundamental condition for procedural democratic legitimacy. (shrink)

Social epistemologists should be well-equipped to explain and evaluate the growing vulnerabilities associated with filter bubbles, echo chambers, and group polarization in social media. However, almost all social epistemology has been built for social contexts that involve merely a speaker-hearer dyad. Filter bubbles, echo chambers, and group polarization all presuppose much larger and more complex network structures. In this paper, we lay the groundwork for a properly social epistemology that gives the role and (...) structure of networks their due. In particular, we formally define epistemic constructs that quantify the structural epistemic position of each node within an interconnected network. We argue for the epistemic value of a structure that we call the (m,k)-observer. We then present empirical evidence that (m,k)-observers are rare in social media discussions of controversial topics, which suggests that people suffer from serious problems of epistemic vulnerability. We conclude by arguing that social epistemologists and computer scientists should work together to develop minimal interventions that improve the structure of epistemic networks. (shrink)

Hostile epistemology is the study of how environmental features exploit our cognitive vulnerabilities. I am particularly interested in those vulnerabilities arise from the basic character of our epistemic lives. We are finite beings with limited cognitive resources, perpetually forced to reasoning a rush. I focus on two sources of unavoidable vulnerability. First, we need to use cognitive shortcuts and heuristics to manage our limited time and attention. But hostile forces can always game the gap between the heuristic and the ideal. (...) Second, we need to trust others, and trust makes us vulnerable. In particular, we need to trust experts whose expertise lies beyond our individual ability to vet. So we must rely on various imperfect signals and proxies, like institutional affiliation, to manage our trust. We are forced to use these imperfect and exploitable forms of reasoning, in order to cope with a cognitively overwhelming world. I present the hostile epistemology framework as a counterbalance to vice epistemology, which tends to locate responsibility for bad beliefs in the character of the believer. I draw two conclusions from my analysis. First: suppose we accept that that only communities and institutions can know about the world. This deeply social approach doesn’t solve the problem of expert identification. The individual still faces a problem: given their incomplete understanding, how should the individual pick which group to trust? Second: we might have hoped to get some kind of static picture of the right principles of reasoning — but hostile epistemology presents a different picture. We have to use risky heuristics and shortcuts, which hostile forces can game and exploit. We can respond by shifting to a different set of heuristics, but this simply shifts the location of our vulnerabilities. These new heuristics are also exploitable. There is no end to this, only a constant struggle to adapt. Limited beings in a hostile epistemic environment are locked in an unending epistemic arms race. (shrink)

In this paper I explore Phyllis Rooney’s 2003 chapter, “Feminist Epistemology and Naturalized Epistemology: An Uneasy Alliance,” taking guidance from her critique of naturalized epistemology in pursuing my own analysis of another uneasy alliance: that between feminist epistemology and social epistemology. Investigating some of the background assumptions at work in prominent conceptions of social epistemology, I consider recent analyses of "epistemic bubbles" to ask how closely such analyses are aligned with ongoing research in feminist epistemology. I argue that (...) critical feminist insights in political philosophy are called for here, especially those that focus on multiple politically salient relationships and also emphasize practices of personal transformation as inseparably bound up with broader movements for social transformation. Insofar as feminist epistemology continues to carry another world in its heart, I argue that it will continue to rest uneasily with any effort to align it with—let alone subsume it within—the still emerging field of social epistemology. (shrink)

It’s intuitive to think that (a) the more sure you are of something, the harder it’ll be to change your mind about it, and (b) you can’t be open-minded about something if you’re very sure about it. If these thoughts are right, then, with minimal assumptions, it follows that you can’t be in a good position to both escape echo chambers and be rationally resistant to fake news: the former requires open-mindedness, but the latter is inimical to it. I (...) argue that neither thought is true and that believing them will get us all mixed up. I show that you can be open-minded and have confidently held beliefs, and that beliefs in which you are less sure are not, thereby, more fragile. I close with some reflections on the nature of rational belief change and open-mindedness and a brief sketch about what might actually help us in the fight against misinformation and belief polarization …. [please read below the rest of the article]. (shrink)

The “incel” phenomenon began after 2010 when like-minded young – mostly straight white – men started to share similar thoughts and worldviews on certain digital platforms and online forums leading to an exclusive community. The phenomenon is characterized by misogynism, racism and homophobia. The most extreme forms of the phenomenon have led to violent hate crimes. The aim of this paper is to understand this phenomenon and analyze it by applying the echo chamber theory.

Twitter makes conversation into something like a game. It scores our communication, giving us vivid and quantified feedback, via Likes, Retweets, and Follower counts. But this gamification doesn’t just increase our motivation to communicate; it changes the very nature of the activity. Games are more satisfying than ordinary life precisely because game-goals are simpler, cleaner, and easier to apply. Twitter is thrilling precisely because its goals have been artificially clarified and narrowed. When we buy into Twitter’s gamification, then our values (...) shift from the complex and pluralistic values of communication, to the narrower quest for popularity and virality. Twitter’s gamification bears some resemblance with the phenomena of echo chambers and moral outrage porn. In all these phenomena, we are instrumentalizing our ends for hedonistic reasons. We have shifted our aims in an activity, not because the new aims are more valuable, but in exchange for extra pleasure. (shrink)

Religious fundamentalism remains a significant force in global politics and religion. Despite a range of problems arising from fundamentalism, the beliefs fundamentalists hold can seem quite reasonable. This paper considers whether, in fact, fundamentalist beliefs are rational by drawing on recent ideas in contemporary epistemology. The paper presents a general theory of fundamentalist beliefs in terms of their propositional content and the high credence levels attributed to them. It then explores the way these beliefs are both acquired and retained by (...) applying ideas from the social epistemology of echo chambers and group belief. The paper then considers three accounts of the rationality of belief: evidentialist, reliabilist, and virtue-theoretic. It is argued that fundamentalist beliefs can be reasonable on evidentialist standards, but are nevertheless still problematic on reliabilist and virtue standards, since they are formed in environments that are not truth-conducive and which cultivate intellectual vice. (shrink)

What is the value of intellectual playfulness? Traditional characterizations of the ideal thinker often leave out playfulness; the ideal inquirer is supposed to be sober, careful, and conscientiousness. But elsewhere we find another ideal: the laughing sage, the playful thinker. These are models of intellectual playfulness. Intellectual playfulness, I suggest, is the disposition to try out alternate belief systems for fun – to try on radically different perspectives for the sheer pleasure of it. But what would the cog-nitive value be (...) of such playfulness? I suggest that intellectual playfulness function as, at the very least, a kind of intellectual insurance policy against epistemic traps. An epistemic trap is a belief system that re-directs good-faith inquiry to bad results. Am epistemic trap manipulates background beliefs to fend off contrary evidence. For example, a conspiracy theory might include a set of beliefs about how the mainstream media has been taken over by some vicious cabal. Normal epistemic attempts will be captured by a well-wrought epistemic trap, because normal attempts at inquiry are guided by these background beliefs -- which set what counts as a plausible path to explore, and what is implausible or beyond the pale. And a clever epistemic trap will manipulate those background beliefs for ill effect. Intellectual playfulness, on the other hand, isn’t motivated by an epistemic interest in the truth, but in the sheer pleasure of intellectual exploration. Since intellectual playfulness isn’t oriented towards the truth, it won’t be constrained by an agent’s background beliefs – it won’t, for example, prefer to investigate apparently more plausible pathways. Intellectual playfulness offers an opportunity to escape from epistemic traps. But intellectual playfulness has its own limitations. It will only drive us to explore belief systems when that exploration is fun. What we need is an array of differently-motivated exploratory tendencies – empathy, curiosity, playfulness – each of which will each cover for the others’ limitations. (shrink)

According to some, the current political fracture is best described as political polarization – where extremism and political separation infest an entire whole population. Political polarization accounts often point to the psychological phenomenon of belief polarization – where being in a like-minded groups tends to boost confidence. The political polarization story is an essentially symmetrical one, where both sides are subject to the same basic dividing forces and cognitive biases, and are approximately as blame-worthy. On a very different account, what's (...) going on is best described propaganda – where a discrete set of bad actors have manipulated some part of the media environ-ment. The propaganda story is usually told as a highly asymmetrical story, where only some media consumers are under the spell of the propagandists. Which is right? I consider two analyses of the 2016 American election: Robert Talisse's polarization-style account in Overdoing Democracy, and Benkler et. al.'s propaganda-style account in Network Propaganda. I suggest that the propaganda account has better empirical support. I also offer a diagnosis of the appeal of the polarization story. Those who accept a polarization account are often political centrists, who accuse those at the political extremes of motivated reasoning – of believing what they find comfortable. Such centrists also tend to treat political extremism as the product of the irrational belief polarization, arising from living in like-minded groups. But, I argue, these arguments are too quick. First, we can’t dismiss a group as irrational merely be-cause they are likeminded. The existence of like-minded group can be explained in terms of irrational belief polarization, but it can also be explained by rational convergence on the truth. Second, belief polarization is not always irrational, such as when its emotional effects are used to repair impaired self-confidence. Third, political centrists are also subject to similar debunking argument. When we accept a polarization account, we get to feel the comfort of being “above it all”. Political centrists are just as plausibly subject to the irrational effects of living in like-minded groups. Belief polarization isn’t just for extremists. (shrink)

Academic social networks and social media have revolutionised the way individuals gather information and express themselves, particularly in academia, science, and research. Through the lens of academics, this study aims to investigate the epistemological and psychosocial aspects of these knowledge sources. The epistemological attitude model presented a framework to delve into and reflect upon the existence of knowledge sources, comprising subjective, interactional, and knowledge dimensions. One hundred and twenty-six university academics participated in this study, including lecturers and researchers (...) from different higher education institutions in Latvia. The study employed two methods: the Epistemological Attitudes towards Sources of Knowledge Questionnaire and the Epistemological Attitudes towards Sources of Knowledge Semantic Questionnaire. The data analysis involved several procedures, including exploratory and confirmatory factor analysis, correlation analysis, and test statistics. By implementing these methods, the study gained valuable insights into the sources of knowledge, examining them from two perspectives. The first perspective brought attention to the differences in academics’ appraisals by discussing their understanding, approach, use, and valuations of these sources. By scrutinising the constructs of meanings, the second perspective sheds light on the anticipated knowledge which is deemed ideal, the concrete knowledge that is both social and objective, and the subjectively valuable nature of academic social networks and social media. The findings underscore the specialised knowledge and qualities that academics rely on for producing knowledge. In terms of epistemology, methodology, social science, and education, the study holds theoretical and practical implications, especially in comprehending knowledge and its sources. (shrink)

What are the proper epistemic aims of social media sites? A great deal of social media critique presupposes an exceptionalist attitude, according to which social media is either uniquely good, or uniquely bad for our collective knowledge-generating practices. Exceptionalism about social media is troublesome, both because it leads to oversimplistic narratives, and because it prevents us making relevant comparisons to other epistemic systems. The goal of this chapter is to offer an anti-exceptionalist account of the epistemic (...) aims of social media. I will argue that social systems (and epistemic institutions in general) ought to pursue three distinct epistemic goals: promoting good epistemic outcomes for users, realising epistemically good institutional features, and achieving structural epistemic justice. Although these goals are often mutually supportive, I will consider a number of cases in which these values conflict. This means that there are epistemic dilemmas about how to design social media platforms (and other kinds of epistemic system) which can only be resolved by appealing to ethical considerations. This discussion highlights that just as in the political realm, there is no such thing as a neutral epistemic system. (shrink)

We are consumers of drugs and news, and sometimes call ourselves addicts or junkies of one or both. I propose to take the concept of news – more generally, doxastic – addiction seriously. I define doxastic addiction and relate this type of addiction to echo chambers and religious belief. I show how this analysis directs attention to appropriate interventions to help doxastic addicts, and how it offers a new type of justification for limits on free speech. -/- .

Despite the initial promise of social media platforms as a means of facilitating discourse on matters of civic discourse, in practice it has turned out to impair fruitful conversation on civic issues by a number of means. From self-isolation into echo chambers, to algorithmically supported filter bubbles, to widespread failure to engage politically owing to psychological phenomena like the ‘spiral of silence’, a variety of factors have been blamed. I argue that extant accounts overlook the importance of interpersonal (...) relationships to sustaining quality civic discourse on social media. Drawing on an Aristotelian account of friendship with an emphasis on the value of interpersonal difference plus the influence of interactions on individual character, I argue that a common scapegoat for the failure of civic discourse online—the variety of “unfriend” disconnection tools offered on various platforms—actually show promise at promoting better-quality civic conversation and overcoming the obstacles present on social media platforms. (shrink)

An increasingly popular solution to the anti-scientific climate rising on social media platforms has been the appeal to more critical thinking from the user's side. In this paper, we zoom in on the ideal of critical thinking and unpack it in order to see, specifically, whether it can provide enough epistemic agency so that users endowed with it can break free from enclosed communities on social media (so called epistemic bubbles). We criticise some assumptions embedded in the ideal (...) of critical thinking online and, instead, we propose that a better way to understand the virtuous behaviour at hand is as critical engagement, namely a mutual cultivation of critical skills among the members of an epistemic bubble. This mutual cultivation allows members within an epistemic bubble (in contrast, as we will show, with the authority-based models of epistemic echo chambers) to become more autonomous critical thinkers by cultivating self-trust. We use the model of relational autonomy as well as resources from work on epistemic self-trust and epistemic interdependence to develop an explanatory framework, which in turn may ground rules for identifying and creating virtuous epistemic bubbles within the environments of social media platforms. (shrink)

When should you engage with difficult arguments against your cherished controversial beliefs? The primary conclusion of this book is that your obligations to engage with counterarguments are more limited than is often thought. In some standard situations, you shouldn't engage with difficult counterarguments and, if you do, you shouldn't engage with them open-mindedly. This conclusion runs counter to aspects of the Millian political tradition and political liberalism, as well as what people working in informal logic tend to say about argumentation. (...) -/- Not all misleading arguments wear their flaws on their sleeve. Each step of a misleading argument might seem compelling and you might not be able to figure out what's wrong with it. Still, even if you can't figure out what's wrong with an argument, you can know that it's misleading. One way to know that an argument is misleading is, counterintuitively, to lack expertise in the methods and evidence-types employed by the argument. When you know that a counterargument is misleading, you shouldn't engage with it open-mindedly and sometimes shouldn't engage with it at all. You shouldn't engage open-mindedly because you shouldn't be willing to reduce your confidence in response to arguments you know are misleading. And you sometimes shouldn't engage closed-mindedly, because to do so can be manipulative or ineffective. -/- In making this case, Jeremy Fantl discusses echo chambers and group polarization, the importance in academic writing of a sympathetic case for the opposition, the epistemology of disagreement, the account of open-mindedness, and invitations to problematic academic speakers. (shrink)

Journalism and media studies lack robust theoretical concepts for studying journalistic knowledge ‎generation. More specifically, conceptual challenges attend the emergence of big data and ‎algorithmic sources of journalistic knowledge. A family of frameworks apt to this challenge is ‎provided by “social epistemology”: a young philosophical field which regards society’s participation ‎in knowledge generation as inevitable. Social epistemology offers the best of both worlds for ‎journalists and media scholars: a thorough familiarity with biases and failures of obtaining ‎knowledge, and (...) a strong orientation toward best practices in the realm of knowledge-acquisition ‎and truth-seeking. This paper articulates the lessons of social epistemology for two central nodes of ‎knowledge-acquisition in contemporary journalism: human-mediated knowledge and technology-‎mediated knowledge. ‎. (shrink)

This volume considers forms of information manipulation and restriction in contemporary society. It explores whether and when manipulation of the conditions of inquiry without the consent of those manipulated is morally or epistemically justified. The contributors provide a wealth of examples of manipulation, and debate whether epistemic paternalism is distinct from other forms of paternalism debated in political theory. Special attention is given to medical practice, science communication, and research in science, technology, and society. Some of the contributors (...) argue that unconsenting interference with or "conceptual engineering" of people’s beliefs and ability of inquire is consistent with, and others that it is inconsistent with, efforts to democratize knowledge and decision-making. (shrink)

In their responses to my article “Epistemically Pernicious Groups and the Groupstrapping Problem” (Boyd, 2018), Bert Baumgaertner (“Groupstrapping, Boostrapping, and Oops-strapping: A Reply to Boyd”) and C. Thi Nguyen (“Group-strapping, Bubble, or Echo Chamber?”) have raised interesting questions and opened lines of inquiry regarding my discussion of what I hope to be a way to help make sense of how members of groups can continue to hold beliefs that are greatly outweighed by countervailing evidence (e.g. antivaxxers, climate-change deniers, etc.). (...) Here I respond to these arguments and suggestions by providing three new reasons to believe that groupstrapping as I describe it occurs in epistemically pernicious groups. (shrink)

Recently, there has been growing concern that increased partisanship in news sources, as well as new ways in which people acquire information, has led to a proliferation of epistemic bubbles and echo chambers: in the former, one tends to acquire information from a limited range of sources, ones that generally support the kinds of beliefs that one already has, while the latter function in the same way, but possess the additional characteristic that certain beliefs are actively reinforced. Here I (...) argue, first, that we should conceive of epistemic bubbles and echo chambers as types of epistemically pernicious groups, and second, that while analyses of such groups have typically focused on relationships between individual members, at least part of what such groups epistemically pernicious pertains to the way that members rely on the groups themselves as sources of information. I argue that member reliance on groups results in groups being attributed a degree of credibility that outruns their warrant, a process I call groupstrapping. I argue that by recognizing the groupstrapping as an illicit method of forming and updating beliefs we can make progress on some of the open questions concerning epistemically pernicious groups. (shrink)

Are fanatical beliefs rational? This paper examines this question. After outlining two arguments for the rationality of fanatical beliefs, based respectively on what I call the "crippled epistemology" explanation and the "echo chambers" explanation, the paper rejects these arguments by appeal to considerations related to higher-order evidence. Then it explains what defending the rationality of fanatical beliefs actually requires. From this, it derives the practical conclusion that radicalization can be prevented and the growth of fanaticism stalled by preventing the (...) encroachment of "fragile values.". (shrink)

Many of us hold false beliefs about matters that are relevant to public policy such as climate change and the safety of vaccines. What can be done to rectify this situation? This question can be read in two ways. According to the descriptive reading, it concerns which methods will be effective in persuading people that their beliefs are false. According to the normative reading, it concerns which methods we are permitted to use in the service of persuading people. Some effective (...) methods—a programme of brainwashing, say—would not be permissible. In this paper I compare “methods of rational persuasion” with what you might call “marketing methods” such as how one frames the problem of climate change. My aim is to show that “marketing methods” are preferable to “methods of rational persuasion”. My argument has two parts. First, I argue that the evidence suggests that “marketing methods” are more effective in persuading people to change their minds. Second, I argue that “marketing methods” are an acceptable response to the normative question. (shrink)

I propose to study one problem for epistemic dependence on experts: how to locate experts on what I will call cognitive islands. Cognitive islands are those domains for knowledge in which expertise is required to evaluate other experts. They exist under two conditions: first, that there is no test for expertise available to the inexpert; and second, that the domain is not linked to another domain with such a test. Cognitive islands are the places where we have the fewest resources (...) for evaluating experts, which makes our expert dependences particularly risky. -/- Some have argued that cognitive islands lead to the complete unusability of expert testimony: that anybody who needs expert advice on a cognitive island will be entirely unable to find it. I argue against this radical form of pessimism, but propose a more moderate alternative. I demonstrate that we have some resources for finding experts on cognitive islands, but that cognitive islands leave us vulnerable to an epistemic trap which I will call runaway echo chambers. In a runaway echo chamber, our inexpertise may lead us to pick out bad experts, which will simply reinforce our mistaken beliefs and sensibilities. (shrink)

This article is an exercise in the virtue epistemology of the internet, an area of applied virtue epistemology that investigates how online environments impact the development of intellectual virtues, and how intellectual virtues manifest within online environments. I examine online echo chambers and epistemic bubbles (Nguyen 2020, Episteme 17(2), 141–61), exploring the conceptual relationship between these online environments and the virtue of open-mindedness (Battaly 2018b, Episteme 15(3), 261–82). The article answers two key individual-level, virtue epistemic questions: (Q1) How does (...) immersion in online echo chambers and epistemic bubbles affect the cultivation and preservation of open-mindedness, and (Q2) Is it always intellectually virtuous to exhibit open-mindedness in the context of online echo chambers and epistemic bubbles? In response to Q1, I contend that both online echo chambers and online epistemic bubbles threaten to undermine the cultivation and preservation of open-mindedness, albeit via different mechanisms and to different degrees. In response to Q2, I affirm that both a deficiency and an excess of open-mindedness can be virtuous in these online environments, depending on the epistemic orientation of the digital user. (shrink)

Social media platforms have been rapidly increasing the number of informational labels they are appending to user-generated content in order to indicate the disputed nature of messages or to provide context. The rise of this practice constitutes an important new chapter in social media governance, as companies are often choosing this new “middle way” between a laissez-faire approach and more drastic remedies such as removing or downranking content. Yet information labeling as a practice has, thus far, been mostly (...) tactical, reactive, and without strategic underpinnings. In this paper, we argue against defining success as merely the curbing of misinformation spread. The key to thinking about labeling strategically is to consider it from an epistemic perspective and to take as a starting point the “social” dimension of online social networks. The strategy we articulate emphasizes how the moderation system needs to improve the epistemic position and relationships of platform users — i.e., their ability to make good judgements about the sources and quality of the information with which they interact on the platform — while also appropriately respecting sources, seekers, and subjects of information. A systematic and normatively grounded approach can improve content moderation efforts by providing clearer accounts of what the goals are, how success should be defined and measured, and where ethical considerations should be taken into consideration. We consider implications for the policies of social media companies, propose new potential metrics for success, and review research and innovation agendas in this regard. (shrink)

This paper explores how the social and affective lives of people with marginalized social identities are particularly affected by digital influences. Specifically, the paper examines whether and how social media enables LGBTQ+ people to experience feelings of belonging. It does so by drawing on literature from digital epistemology and phenomenology of the digital, and by presenting and analyzing the results of a qualitative study consisting of 25 interviews with LGBTQ+ people. The interviews were conducted to explore the (...) social media experiences of LGBTQ+ people through an empirical framework informed by both phenomenology and social epistemology, particularly feminist standpoint theory. The paper emphasizes the importance of positionality and the epistemic value of research that centers marginalized perspectives and employs an anti-oppressive research approach, and focuses on understanding the digital experiences of LGBTQ+ people from within their marginalized perspective. (shrink)

This book argues that misinformation poses a multi-faceted threat to knowledge, while arguing that some forms of content moderation risk exacerbating these threats. It proposes alternative forms of content moderation that aim to address this complexity while enhancing human epistemic agency. The proliferation of fake news, false conspiracy theories, and other forms of misinformation on the internet and especially social media is widely recognized as a threat to individual knowledge and, consequently, to collective deliberation and democracy itself. This book (...) argues that misinformation presents a three-pronged threat to knowledge. While researchers often focus on the role of misinformation in causing false beliefs, this deceptive potential of misinformation exists alongside the potential to suppress trust and to distort the perception of evidence. Recognizing the multi-faceted nature of this threat is essential to the development of effective measures to mitigate the harms associated with misinformation. The book weaves together work in analytic epistemology with emerging empirical work in other disciplines to offer novel insights into the threats posed by misinformation. Additionally, it breaks new ground by systematically assessing different forms of content moderation from the perspective of epistemology. Misinformation, Content Moderation, and Epistemology will appeal to philosophers working in applied and social epistemology, as well as scholars and advanced students in disciplines such as communication studies, political science, and social psychology who are researching misinformation. (shrink)

Thanks to the advent of social media, large numbers of Americans believe outlandish falsehoods that have been widely debunked. Many of us have a tendency to fault the individuals who hold such beliefs. We naturally assume that the individuals who form and maintain such beliefs do so in virtue of having violated some epistemic obligation: perhaps they failed to scrutinize their sources, or failed to seek out the available competing evidence. I maintain that very many ordinary individuals who acquire (...) outlandish false beliefs thanks to their use of popular social media platforms (and other similar internet technologies) deserve little or no blame for believing these falsehoods. Such individuals would be fully blameworthy only if they had formed or maintained the relevant beliefs partly in virtue of violating some epistemic obligation and had no excuse for violating that obligation. However, the nature of these internet technologies provides excuses for violating the relevant epistemic obligations, and so individuals are excused for holding the resulting false beliefs. (shrink)

This short piece draws on political philosophy to show how social media interference operations can be used by hostile states to weaken the apparent legitimacy of democratic governments. Democratic societies are particularly vulnerable to this form of attack because democratic governments depend for their legitimacy on citizens' trust in one another. But when citizen see one another as complicit in the distribution of deceptive content, they lose confidence in the epistemic preconditions for democracy. The piece concludes with policy recommendations (...) for how democratic governments should protect themselves. (shrink)

This study develops a Science–Technology–Society (STS)-based science ethics education program for high school students majoring in or planning to major in science and engineering. Our education program includes the fields of philosophy, history, sociology and ethics of science and technology, and other STS-related theories. We expected our STS-based science ethics education program to promote students’ epistemological beliefs and moral judgment development. These psychological constructs are needed to properly solve complicated moral and social dilemmas in the fields of science and (...) engineering. We applied this program to a group of Korean high school science students gifted in science and engineering. To measure the effects of this program, we used an essay-based qualitative measurement. The results indicate that there was significant development in both epistemological beliefs and moral judgment. In closing, we briefly discuss the need to develop epistemological beliefs and moral judgment using an STS-based science ethics education program. (shrink)

I argue that introspection recruits the same mental mechanism as that which is required for the production of ordinary speech acts. In introspection, in effect, we intentionally tell ourselves that we are in some mental state, aiming thereby to produce belief about that state in ourselves. On one popular view of speech acts, however, this is precisely what speakers do when speaking to others. On this basis, I argue that every bias discovered by social epistemology applies to introspection and (...) other forms of self-directed representation. If so, it becomes unclear in what sense social epistemology is social. (shrink)

Since at least 2016, many have worried that social media enables authoritarians to meddle in democratic politics. The concern is that trolls and bots amplify deceptive content. In this chapter I argue that these tactics have a more insidious anti-democratic purpose. Lies implanted in democratic discourse by authoritarians are often intended to be caught. Their primary goal is not to successfully deceive, but rather to undermine the democratic value of testimony. In well-functioning democracies, our mutual reliance on testimony also (...) generates a distinctively democratic value: decentralized testimonial networks evade control by the state or powerful actors. The deliberate exposure of deception in democratic testimonial networks undermines this value by implicating citizens in their own epistemic corruption, weakening the resilience of democratic society against authoritarian pressure. In this chapter I illustrate that danger through a close reading of recent Russian social media interference operations, showing both their epistemic underpinnings and their ongoing political threat. (shrink)

“Filter bubble”, “echo chambers”, “information diet” – the metaphors to describe today’s information dynamics on social media platforms are fairly diverse. People use them to describe the impact of the viral spread of fake, biased or purposeless content online, as witnessed during the recent race for the US presidency or the latest outbreak of the Ebola virus (in the latter case a tasteless racist meme was drowning out any meaningful content). This unravels the potential envisioned to arise from (...) emergent activities of human collectives on the World Wide Web, as exemplified by the Arab Spring mass movements or digital disaster response supported by the Ushahidi tool suite. (shrink)

Social media has transformed how individuals handle their illnesses. While many patients increasingly use these online platforms to understand embodied information surrounding their conditions, healthcare professionals often frame these practices as negative and do not consider the expertise that patients generate through social media. Through a combination of insights from social epistemology and ignorance studies, this paper problematizes the distinctive understandings of social media between patients and healthcare professionals from a different perspective. A total of four (...) ideas are introduced: (1) healthcare professionals see embodied knowledge that arises from patients’ social media practices as uncomfortable knowledge; (2) healthcare professionals engage in several behaviours to preserve their authority and power in front of embodied knowledge created through these online platforms; (3) failing to consider embodied knowledge can have consequences not only in terms of trust between patients and healthcare professionals but also in connection with epistemological populism and the transition towards patient-centred care; and (4) media and digital health literacy could help healthcare professionals enhance the uses of social media in healthcare. Adopting this framework allows not only to offer valuable insights into how healthcare professionals manage patients’ social media practices, but also opens new avenues to improve healthcare digitisation. (shrink)

From the outset, critical social theory has sought to diagnose people’s participation in their own oppression, by revealing the roots of irrational and self-undermining choices in the complex interplay between human nature, social structures, and cultural beliefs. As part of this project, Ideologiekritik has aimed to expose faulty conceptions of this interplay, so that the objectively pathological character of what people are “freely” choosing could come more clearly into view. The challenge, however, has always been to find a (...) way of doing this without arrogantly assuming special access to what is good for people. And this danger of paternalism is one to which social theorists have all too often fallen prey. In this brief essay, I focus on contemporary instances of clearly self-defeating behavior in contexts of complex choices. I begin by discussing a recent attempt to diagnose and solve these failures of choices, namely the public policy recommendations of behavioral economist Richard Thaler and reform-minded legal theorist Cass Sunstein. Their influential “libertarian paternalist” approach is particularly interesting, both in what it includes (attention to the socially constructed nature of choice situations and the roots of the problems in human nature) and in what it leaves out (an understanding of the social construction of human nature and an adequate appreciation of the value of autonomy). After discussing it, I consider a broadly perfectionist alternative, to the effect that the problem lies in a failure to adequately appreciate the importance of developing autonomy. I then turn to sketching the outlines of a new approach, based on the concept of “autonomy gaps,” which approaches overly demanding policies in relational and action-theoretical terms. In the final section, I show how this provides the basis for an analysis both in terms of a critique of ideology and of social pathology. (shrink)

In this essay, I argue non-profit and non-governmental social organizations can play a crucial role in enhancing social solidarity in the age of social media. Their strengths lie in their adaptability, memetic power, and credibility. Future research should focus on social organizations' role in rehabilitating public shaming, public epistemology, and cultural dimensions.

"The Personal is Political": This was an often-heard slogan of feminist groups in the late sixties and early seventies. The slogan is no doubt open to many interpretations. There is one interpretation which touches on the epistemology of social facts, viz. the slogan claims that in assessing the features of a political system, personal experiences have privileged evidentiary value. For instancte, in the face of third person reports about political corruption, I may remain unmoved in my belief that the (...) political powers are morally upstanding, and it is only when I myself am adversely affected, that I come to change my views. There are two standard patterns of explanation of this type of belief formation: (i) We know that third-person reports may be lessreliable than first-person experiences; (ii) If the third-person reports are no less reliable than first-person experiences, we may just be dealing with a standard pattern of epistemic irrationality. However, we argue that there is also a much more surprising pattern of explanation: under certain conditions, a Bayesian argument can be proffered to the effect that it is rational to change one's beliefs in the face of personal experiences and not in the face of third-person reports, even if these experiences and reports are equally reliable. Hence, the feminist slogan (at least on one particular interpretation of it) receives unexpected support from Bayesian comers. We also show that this pattern of explanation has surprising repercussions on the question of the evidentiary value of miracles in philosophy of religion. (shrink)

The debate on whether and why misinformation is bad primarily focuses on the spread of false beliefs as its main harm. From the assumption that misinformation primarily causes harm through the spread of false beliefs as a starting point, it has been contended that the problem of misinformation has been exaggerated. Its tendency to generate false beliefs appears to be limited. However, the near-exclusive focus on whether or not misinformation dupes people with false beliefs neglects other epistemic harms associated with (...) it. Specifically, I show that misinformation also causes trouble for the epistemic goods of truth attainment, intellectual autonomy and debate pluriformity. Moreover, for each of these goods, I argue that emphasizing error-avoidance exacerbates, rather than mitigates, the harms caused by misinformation. These oversights and dilemmas show that prioritizing error-avoidance in the fight against misinformation is not a neutral default policy or necessarily a net positive. A shift in focus away from the spread of false beliefs as the main harm of misinformation is needed to better understand and counter its negative effects. (shrink)

Information providing and gathering increasingly involve technologies like search ‎engines, which actively shape their epistemic surroundings. Yet, a satisfying account ‎of the epistemic responsibilities associated with them does not exist. We analyze ‎automatically generated search suggestions from the perspective of social ‎epistemology to illustrate how epistemic responsibilities associated with a ‎technology can be derived and assigned. Drawing on our previously developed ‎theoretical framework that connects responsible epistemic behavior to ‎practicability, we address two questions: first, given the different technological ‎possibilities (...) available to searchers, the search technology, and search providers, ‎who should bear which responsibilities? Second, given the technology’s ‎epistemically relevant features and potential harms, how should search terms be ‎autocompleted? Our analysis reveals that epistemic responsibility lies mostly with ‎search providers, which should eliminate three categories of autosuggestions: those ‎that result from organized attacks, those that perpetuate damaging stereotypes, and ‎those that associate negative characteristics with specific individuals.‎. (shrink)

With an eye on the future of global ethics, I argue that social-media technologies are not morally neutral tools but are, for all intents and purposes, a kind of agent. They nudge us to do things that are bad for us. Moreover, I argue that we have a duty to quit using social-media platforms, not just on account of possible duties to preserve our own well-being but because users are akin to test subjects on whom developers are testing (...) new nudges, and we ought to deprive them of their test subjects. (shrink)

Social epistemology is autonomous: When applied to the same evidential situations, the principles of social rationality and the principles of individual rationality sometimes recommend inconsistent beliefs. If we stipulate that reasoning rationally from justified beliefs to a true belief is normally sufficient for knowledge, the autonomy thesis implies that some knowledge is essentially social. When the principles of social and individual rationality are applied to justified evidence and recommend inconsistent beliefs and the belief endorsed by (...) class='Hi'>social rationality is true, then that true belief would be an instance of social knowledge but not individual knowledge. (shrink)