This paper analyses the phenomenology and epistemology of chatbots such as ChatGPT and Bard. The computational architecture underpinning these chatbots are large language models (LLMs), which are generative artificial intelligence (AI) systems trained on a massive dataset of text extracted from the Web. We conceptualise these LLMs as multifunctional computational cognitive artifacts, used for various cognitive tasks such as translating, summarizing, answering questions, information-seeking, and much more. Phenomenologically, LLMs can be experienced as a “quasi-other”; when that happens, users anthropomorphise them. (...) For most users, current LLMs are black boxes, i.e., for the most part, they lack data transparency and algorithmic transparency. They can, however, be phenomenologically and informationally transparent, in which case there is an interactional flow. Anthropomorphising and interactional flow can, in some users, create an attitude of (unwarranted) trust towards the output LLMs generate. We conclude this paper by drawing on the epistemology of trust and testimony to examine the epistemic implications of these dimensions. Whilst LLMs generally generate accurate responses, we observe two epistemic pitfalls. Ideally, users should be able to match the level of trust that they place in LLMs to the degree that LLMs are trustworthy. However, both their data and algorithmic opacity and their phenomenological and informational transparency can make it difficult for users to calibrate their trust correctly. The effects of these limitations are twofold: users may adopt unwarranted attitudes of trust towards the outputs of LLMs (which is particularly problematic when LLMs hallucinate), and the trustworthiness of LLMs may be undermined. (shrink)

This article is an exercise in the virtue epistemology of the internet, an area of applied virtue epistemology that investigates how online environments impact the development of intellectual virtues, and how intellectual virtues manifest within online environments. I examine online echo chambers and epistemic bubbles (Nguyen 2020, Episteme 17(2), 141–61), exploring the conceptual relationship between these online environments and the virtue of open-mindedness (Battaly 2018b, Episteme 15(3), 261–82). The article answers two key individual-level, virtue epistemic questions: (Q1) How does immersion (...) in online echo chambers and epistemic bubbles affect the cultivation and preservation of open-mindedness, and (Q2) Is it always intellectually virtuous to exhibit open-mindedness in the context of online echo chambers and epistemic bubbles? In response to Q1, I contend that both online echo chambers and online epistemic bubbles threaten to undermine the cultivation and preservation of open-mindedness, albeit via different mechanisms and to different degrees. In response to Q2, I affirm that both a deficiency and an excess of open-mindedness can be virtuous in these online environments, depending on the epistemic orientation of the digital user. (shrink)

Are we being manipulated online? If so, is being manipulated by online technologies and algorithmic systems notably different from human forms of manipulation? And what is under threat exactly when people are manipulated online? This volume provides philosophical and conceptual depth to debates in digital ethics about online manipulation. The contributions explore the ramifications of our increasingly consequential interactions with online technologies such as online recommender systems, social media, user-friendly design, micro-targeting, default-settings, gamification, and real-time profiling. The authors in this (...) volume address four broad and interconnected themes: • What is the conceptual nature of online manipulation? And how, methodologically, should the concept be defined? • Does online manipulation threaten autonomy, freedom, and meaning in life, and if so, how? • What are the epistemic, affective, and political harms and risks associated with online manipulation? • What are legal and regulatory perspectives on online manipulation? The Philosophy of Online Manipulation brings these various considerations together to offer philosophically robust answers to critical questions concerning our online interactions with one another and with autonomous systems. It will be of interest to researchers and advanced students working in moral philosophy, digital ethics, philosophy of technology, and the ethics of manipulation. (shrink)

This chapter discusses a problematic relation between user-friendly design and manipulation. Some specific features of the design of a website can make it a more or less potent tool for manipulation. In particular, features that can be summed up as creating a user-friendly experience are also manipulation-friendly. The ease of using a website also makes it easier to be manipulated via the website. The chapter provides an argument that this can be explained as a less intellectually virtuous engagement with websites (...) that are more user-friendly. It is simply more difficult to mobilize suitable intellectual virtues when the website is quick and easy to use. For instance, when Google Search presents search results quickly and easily users become less intellectually cautious and independent than they ought to be. The chapter discusses a mechanism that links user-friendly design to an overly trusting attitude towards a website that leads to this intellectually careless behaviour. This link is support with empirical evidence based on processing fluency effects. (shrink)

Technology should be aligned with our values. We make the case that attempts to align emerging technologies with our values should reflect critically on these values. Critical thinking seems like a natural starting point for the critical assessment of our values. However, extant conceptualizations of critical thinking carve out no space for the critical scrutiny of values. We will argue that we need critical thinking that focuses on values instead of taking them as unexamined starting points. In order to play (...) a crucial role in helping to align values and technology, critical thinking needs to be modified and refocused on values. Here, we outline what value-centred critical thinking could look like. (shrink)

This paper engages in what might be called anticipatory virtue epistemology, as it anticipates some virtue epistemological risks related to a near-future version of brain-computer interface technology that Michael Lynch (2014) calls 'neuromedia.' I analyze how neuromedia is poised to negatively affect the intellectual character of agents, focusing specifically on the virtue of intellectual perseverance, which involves a disposition to mentally persist in the face of challenges towards the realization of one’s intellectual goals. First, I present and motivate what I (...) call ‘the cognitive offloading argument’, which holds that excessive cognitive offloading of the sort incentivized by a device like neuromedia threatens to undermine intellectual virtue development from the standpoint of the theory of virtue responsibilism. Then, I examine the cognitive offloading argument as it applies to the virtue of intellectual perseverance, arguing that neuromedia may increase cognitive efficiency at the cost of intellectual perseverance. If used in an epistemically responsible manner, however, cognitive offloading devices may not undermine intellectual perseverance but instead allow us to persevere with respect to intellectual goals that we find more valuable by freeing us from different kinds of menial intellectual labor. (shrink)

An increasingly popular solution to the anti-scientific climate rising on social media platforms has been the appeal to more critical thinking from the user's side. In this paper, we zoom in on the ideal of critical thinking and unpack it in order to see, specifically, whether it can provide enough epistemic agency so that users endowed with it can break free from enclosed communities on social media (so called epistemic bubbles). We criticise some assumptions embedded in the ideal of critical (...) thinking online and, instead, we propose that a better way to understand the virtuous behaviour at hand is as critical engagement, namely a mutual cultivation of critical skills among the members of an epistemic bubble. This mutual cultivation allows members within an epistemic bubble (in contrast, as we will show, with the authority-based models of epistemic echo chambers) to become more autonomous critical thinkers by cultivating self-trust. We use the model of relational autonomy as well as resources from work on epistemic self-trust and epistemic interdependence to develop an explanatory framework, which in turn may ground rules for identifying and creating virtuous epistemic bubbles within the environments of social media platforms. (shrink)

It is well known that on the Internet, computer algorithms track our website browsing, clicks, and search history to infer our preferences, interests, and goals. The nature of this algorithmic tracking remains unclear, however. Does it involve what many cognitive scientists and philosophers call ‘mindreading’, i.e., an epistemic capacity to attribute mental states to people to predict, explain, or influence their actions? Here I argue that it does. This is because humans are in a particular way embedded in the process (...) of algorithmic tracking. Specifically, if we endorse common conditions for extended cognition, then human mindreading (by website operators and users) is often literally extended into, that is, partly realized by, not merely causally coupled to, computer systems performing algorithmic tracking. The view that human mindreading extends outside the body into computers in this way has significant ethical advantages. It points to new conceptual ways to reclaim our autonomy and privacy in the face of increasing risks of computational control and online manipulation. These benefits speak in favor of endorsing the notion of extended mindreading. (shrink)

The application of extended mind theory to the Internet and Web yields the possibility of Internet-extended knowledge—a form of extended knowledge that arises as a result of an individual's interactions with the online environment. The present paper seeks to advance our understanding of Internet-extended knowledge by describing the functionality of a real-world application, called the HoloArt app. In part, the goal of the paper is illustrative: it is intended to show how recent advances in mixed reality, cloud-computing, and machine intelligence (...) might be combined so as to yield a putative case of Internet-extended knowledge. Beyond this, however, the paper is intended to support the philosophical effort to understand the notions of extended knowledge and the extended mind. In particular, the HoloArt app raises questions about the universality of some of the criteria that have been used to evaluate putative cases of cognitive extension. The upshot is a better appreciation of the way in which claims about extended knowledge and the extended mind might be affected by a consideration of technologically-advanced resources. (shrink)

We might worry that our seamless reliance on AI systems makes us prone to adopting the strange errors that these systems commit. One proposed solution is to design AI systems so that they are not phenomenally transparent to their users. This stops cognitive extension and the automatic uptake of errors. Although we acknowledge that some aspects of AI extension are concerning, we can address these concerns without discouraging transparent employment altogether. First, we believe that the potential danger should be put (...) into perspective – many unreliable technologies are unlikely to be used transparently precisely because they are unreliable. Second, an agent who transparently employs a resource may also reflect (opaquely) on its reliability. Finally, agents can rely on a process transparently and be yanked out of their transparent use when it turns unreliable. When an agent is responsive to the reliability of their process in this way, they have epistemically integrated it, and the beliefs they form with it are formed responsibly. This prevents the agent from automatically incorporating problematic beliefs. Responsible (and transparent) use of AI resources – and consequently responsible AI extension – is hence possible. We end the paper with several design and policy recommendations that encourage epistemic integration of AI-involving belief-forming processes. (shrink)

Arguments for the extended mind suggest the possibility of extended knowers, individuals whose epistemic standing is tied to the operation of cognitive circuits that extend beyond the bounds of skin and skull. When applied to the Internet, this idea yields the possibility of Internet-extended knowledge, a form of extended knowledge that derives from our interactions and engagements with the online environment. This, however, yields a tension: proponents of the extended mind have suggested that cognitive extension requires the automatic endorsement of (...) bio-external content, but such a commitment appears to conflict with the need to carefully evaluate the veracity of online information. Lukas Schwengerer proposes a solution to this problem. He suggests that proponents of the extended mind ought to accept an alternative conception of the extended mind, one that allows for the evaluation of online content via the exercise of intellectual virtue. We highlight a number of problems with this proposal and suggest that further research is required before a virtue-theoretic approach to Internet-extended knowledge can be adopted. On a more positive note, we suggest that the exercise of intellectual virtue may play an important role in the developmental emergence of Internet-extended knowers. (shrink)