This paper analyses the phenomenology and epistemology of chatbots such as ChatGPT and Bard. The computational architecture underpinning these chatbots are large language models (LLMs), which are generative artificial intelligence (AI) systems trained on a massive dataset of text extracted from the Web. We conceptualise these LLMs as multifunctional computational cognitive artifacts, used for various cognitive tasks such as translating, summarizing, answering questions, information-seeking, and much more. Phenomenologically, LLMs can be experienced as a “quasi-other”; when that happens, users anthropomorphise them. (...) For most users, current LLMs are black boxes, i.e., for the most part, they lack data transparency and algorithmic transparency. They can, however, be phenomenologically and informationally transparent, in which case there is an interactional flow. Anthropomorphising and interactional flow can, in some users, create an attitude of (unwarranted) trust towards the output LLMs generate. We conclude this paper by drawing on the epistemology of trust and testimony to examine the epistemic implications of these dimensions. Whilst LLMs generally generate accurate responses, we observe two epistemic pitfalls. Ideally, users should be able to match the level of trust that they place in LLMs to the degree that LLMs are trustworthy. However, both their data and algorithmic opacity and their phenomenological and informational transparency can make it difficult for users to calibrate their trust correctly. The effects of these limitations are twofold: users may adopt unwarranted attitudes of trust towards the outputs of LLMs (which is particularly problematic when LLMs hallucinate), and the trustworthiness of LLMs may be undermined. (shrink)

Computer assisted theorem proving is an increasingly important part of mathematical methodology, as well as a long-standing topic in artificial intelligence (AI) research. However, the current generation of theorem proving software have limited functioning in terms of providing new proofs. Importantly, they are not able to discriminate interesting theorems and proofs from trivial ones. In order for computers to develop further in theorem proving, there would need to be a radical change in how the software functions. Recently, machine learning results (...) in solving mathematical tasks have shown early promise that deep artificial neural networks could learn symbolic mathematical processing. In this paper, I analyze the theoretical prospects of such neural networks in proving mathematical theorems. In particular, I focus on the question how such AI systems could be incorporated in practice to theorem proving and what consequences that could have. In the most optimistic scenario, this includes the possibility of autonomous automated theorem provers (AATP). Here I discuss whether such AI systems could, or should, become accepted as active agents in mathematical communities. (shrink)

In the past few years, the ethical ramifications of AI technologies have been at the center of intense debates. Considerable attention has been devoted to understanding how a morally responsible practice of data science can be promoted and which values have to shape it. In this context, ethics and moral responsibility have been mainly conceptualized as compliance to widely shared principles. However, several scholars have highlighted the limitations of such a principled approach. Drawing from microethics and the virtue theory tradition, (...) in this paper, we formulate a different approach to ethics in data science which is based on a different conception of “being ethical” and, ultimately, of what it means to promote a morally responsible data science. First, we develop the idea that, rather than only compliance, ethical decision-making consists in using certain moral abilities, which are cultivated by practicing and exercising them in the data science process. An aspect of virtue development that we discuss here is moral attention, which is the ability of data scientists to identify the ethical relevance of their own technical decisions in data science activities. Next, by elaborating on the capability approach, we define a technical act as ethically relevant when it impacts one or more of the basic human capabilities of data subjects. Therefore, rather than “applying ethics”, data scientists should cultivate ethics as a form of reflection on how technical choices and ethical impacts shape one another. Finally, we show how this microethical framework concretely works, by dissecting the ethical dimension of the technical procedures involved in data understanding and preparation of electronic health records. (shrink)

Digital Twins are conceptualised in the academic technical discourse as real-time realistic digital representations of physical entities. Originating from product engineering, the Digital Twin quickly advanced into other fields, including the life sciences and earth sciences. Digital Twins are seen by the tech sector as the new promising tool for efficiency and optimisation, while governmental agencies see it as a fruitful means for improving decision-making to meet sustainability goals. A striking example of the latter is the European Commission who wishes (...) to delegate a significant role to Digital Twins in addressing climate change and supporting Green Deal policy. As Digital Twins give rise to high expectations, ambitions, and are being entrusted important societal roles, it is crucial to critically reflect on the nature of Digital Twins. In this article, we therefore philosophically reflect on Digital Twins by critically analysing dominant conceptualisations, the assumptions underlying them, and their normative implications. We dissect the concept and argue that a Digital Twin does not merely fulfil the role of being a representation, but is in fact a steering technique used to direct a physical entity towards certain goals by means of multiple representations. Currently, this steering seems mainly fuelled by a reductionist approach focused on efficiency and optimisation. However, this is not the only direction from which a Digital Twin can be thought and, consequently, designed and deployed. We therefore set an agenda based on a critical understanding of Digital Twins that helps to draw out their beneficial potential, while addressing their potential issues. (shrink)

This article draws on contributions from the Sociology of Science and Technology and Science and Technology Studies, the Sociology of Risk and Uncertainty, and the Sociology of Work, focusing on the transformations of employment regarding expanded automation, robotization and informatization. The new work patterns emerging due to the introduction of software and hardware technologies, which are based on artificial intelligence, algorithms, big data gathering and robotic systems are examined closely. This article attempts to “open the black boxes” of the “black (...) carpet” (robotic sorting system) and examine the reorganization of Greek postal services through the introduction of software and hardware technologies, highlighting a) the high risk of flexible, pluralistic, decentralized (under)employment and aspects of the sub-politics of automation, b) the new forms of work organization and c) aspects of labor precariousness as a result of de-specialization or “flexible expertise” interconnected with new forms of inequalities based on AI, algorithms, big data and robots as reflected in the lived experiences of workers. The above are investigated through primary empirical social research in postal service companies in Greece. (shrink)

This paper aims to outline the foundations for an ethics of digital touch. Digital touch refers to hardware and software technologies, often collectively referred to as ‘haptics’, that provide somatic sensations including touch and kinaesthesis, either as a stand-alone interface to users, or as part of a wider immersive experience. Digital touch has particular promise in application areas such as communication, affective computing, medicine, and education. However, as with all emerging technologies, potential value needs to be considered against potential risk. (...) We therefore identify some areas where digital touch raises ethical concerns, and we identify why these concerns arise, based on the distinctive physiological and functional properties of the human somatosensory system. Most scientific research in digital touch has focused on user interaction with external objects (active touch). However, the most pressing ethical concerns with digital touch technologies arise when users are being passively touched. Our analysis identifies several important questions about control, transparency, and epistemic procedure in digital touch scenarios. First, human somatosensation is “always on”, and many digital touch technologies take advantage of this (e.g., alerting systems). As a result, digital touch technologies can undermine individuals’ sensory autonomy (i.e., the right to choose what sensations one experiences). Second, users may reasonably want to know who or what is touching them, and for what purpose. Consent for digital touch will therefore need to be carefully and transparently transacted. Third, because touch gives us a special, direct experience of interacting with our physical environment, digital touch technologies that manipulate this interaction could potentially provide a major epistemic challenge, by changing a user’s basic understanding of reality and their relation to it. Informed by this discussion, we conclude by suggesting a basis for an ethical design framework for digital touch systems. (shrink)

Automated algorithms are silently making crucial decisions about our lives, but most of the time we have little understanding of how they work. To counter this hidden influence, there have been increasing calls for algorithmic transparency. Much ink has been spilled over the informational account of algorithmic transparency—about how much information should be revealed about the inner workings of an algorithm. But few studies question the power structure beneath the informational disclosure of the algorithm. As a result, the information disclosure (...) itself can be a means of manipulation used by a group of people to advance their own interests. Instead of concentrating on information disclosure, this paper examines algorithmic transparency from the perspective of power, explaining how algorithmic transparency under a disciplinary power structure can be a technique of normalizing people’s behavior. The informational disclosure of an algorithm can not only set up some de facto norms, but also build a scientific narrative of its algorithm to justify those norms. In doing so, people would be internally motivated to follow those norms with less critical analysis. This article suggests that we should not simply open the black box of an algorithm without challenging the existing power relations. (shrink)

Modern democratic states are increasingly adopting new information and communication technologies to enhance the efficiency and quality of public administration, public policy and services. However, there is substantial variation in the extent to which countries are successful in pursuing such public digitalization. This paper zooms in on the role of social trust as a possible account for the observed empirical pattern in the range and scope of public digitalization across countries. Our argument is that high social trust makes it easier (...) to digitalize the public sector to the benefit of overall society. We develop a simple game-theoretical model that specifies this positive externality from a high-trust culture and provide empirical evidence that a higher level of social trust is associated with a higher level of public digitalization. Of course, high-trust countries cannot do without the rule of law and some institutionalized mechanisms of control and accountability. However, from our argument, it follows that one future challenge could be that control crowds out trust, so that the balance is no longer optimal. If such overcontrol occurs, public digitalization win–win situations between citizens and government can be undermined, even in high-trust countries. (shrink)

Background The use of Artificial Intelligence (AI) has the potential to provide relief in the challenging and often stressful clinical setting for physicians. So far, however, the actual changes in work for physicians remain a prediction for the future, including new demands on the social level of medical practice. Thus, the question of how the requirements for physicians will change due to the implementation of AI is addressed. Methods The question is approached through conceptual considerations based on the potentials that (...) AI already offer and the focus on central normative concepts of trust, explainability, and responsibility which play an important role when implementing AI in everyday clinical practice. Conclusion Interpersonal communication will not disappear upon implementation of AI. Instead, it is much more likely that the exchange between various actors in medical practice will become increasingly important. This adds another level of complexity to practical concepts such as Shared-Decision-Making, which must be addressed in empirical research, including the involvement of AI systems as actors in communication. (shrink)

This paper is about the opposite of judgement and calculation. This opposition has been a traditional anchor of critiques concerned with the rise of AI decision making over human judgement. Contrary to these approaches, it is argued that human judgement is not and cannot be replaced by calculation, but that it is human judgement that contextualises computational structures and gives them meaning and purpose. The article focuses on the epistemic structure of algorithms and artificial neural networks to find that they (...) always depend on human judgement to be related to real life objects or purposes. By introducing the philosophical concept of judgement, it becomes clear that the property of judgement to provide meaning and purposiveness is based on the temporality of human life and the ambiguity of language, which quantitative processes lack. A juxtaposition shows that calculations and clustering can be used and referred to in more or less prejudiced and reflecting as well as opaque and transparent ways, but thereby always depend on human judgement. The paper clearly asserts that the transparency of AI is necessary for their autonomous use. This transparency requires the explicitness of the judgements that constitute these computational structures, thereby creating an awareness of the conditionality of such epistemic entities. (shrink)

The Morality First strategy for developing AI systems that can represent and respond to human values aims to first develop systems that can represent and respond to moral values. I argue that Morality First and other X-First views are unmotivated. Moreover, according to some widely accepted philosophical views about value, these strategies are positively distorting. The natural alternative, according to which no domain of value comes “first” introduces a new set of challenges and highlights an important but otherwise obscured problem (...) for e-AI developers. (shrink)

It is frequently demanded that AI-based Decision Support Tools (AI-DSTs) ought to be both explainable to, and trusted by, those who use them. The joint pursuit of these two principles is ordinarily believed to be uncontroversial. In fact, a common view is that AI systems should be made explainable so that they can be trusted, and in turn, accepted by decision-makers. However, the moral scope of these two principles extends far beyond this particular instrumental connection. This paper argues that if (...) we were to account for the rich and diverse moral reasons that ground the call for explainable AI, and fully consider what it means to “trust” AI in a descriptively rich sense of the term, we would uncover a deep and persistent tension between the two principles. For explainable AI to usefully serve the pursuit of normatively desirable goals, decision-makers must carefully monitor and critically reflect on the content of an AI-DST’s explanation. This entails a deliberative attitude. Conversely, calls for trust in AI-DSTs imply the disposition to put questions about their reliability out of mind. This entails an unquestioning attitude. As such, the joint pursuit of explainable and trusted AI calls on decision-makers to simultaneously adopt incompatible attitudes towards their AI-DST, which leads to an intractable implementation gap. We analyze this gap and explore its broader implications: suggesting that we may need alternate theoretical conceptualizations of what explainability and trust entail, and/or alternate decision-making arrangements that separate the requirements for trust and deliberation to different parties. (shrink)

Due to its enormous potential, artificial intelligence (AI) can transform healthcare on a seemingly infinite scale. However, as we continue to explore the immense potential of AI, it is vital to consider the ethical concerns associated with its development and deployment. One specific concern that has been flagged in the literature is the responsibility gap (RG) due to the introduction of AI in healthcare. When the use of an AI algorithm or system results in a negative outcome for a patient(s), (...) to whom can or should responsibility for that outcome be assigned? Although the concept of the RG was introduced in Anglo-American and European philosophy, this paper aims to broaden the debate by providing an Ubuntu-inspired perspective on the RG. Ubuntu, deeply rooted in African philosophy, calls for collective responsibility, and offers a uniquely forward-looking approach to address the alleged RG caused by AI in healthcare. An Ubuntu-inspired perspective can serve as a valuable guide and tool when addressing the alleged RG. Incorporating Ubuntu into the AI ethics discourse can contribute to a more ethical and responsible integration of AI in healthcare. (shrink)

Human decisions are increasingly supported by decision support systems (DSS). Humans are required to remain “on the loop,” by monitoring and approving/rejecting machine recommendations. However, use of DSS can lead to overreliance on machines, reducing human oversight. This paper proposes “reflection machines” (RM) to increase meaningful human control. An RM provides a medical expert not with suggestions for a decision, but with questions that stimulate reflection about decisions. It can refer to data points or suggest counterarguments that are less compatible (...) with the planned decision. RMs think against the proposed decision in order to increase human resistance against automation complacency. Building on preliminary research, this paper will (1) make a case for deriving a set of design requirements for RMs from EU regulations, (2) suggest a way how RMs could support decision-making, (3) describe the possibility of how a prototype of an RM could apply to the medical domain of chronic low back pain, and (4) highlight the importance of exploring an RM’s functionality and the experiences of users working with it. (shrink)

The study explores the future of AI-driven media and info-communication as envisioned by experts from all world regions, defining relevant terminology and expectations for 2050. Participants engaged in a 4-week series of surveys, questioning their definitions and projections about AI for the field of media and communication. Their expectations predict universal access to democratically available, automated, personalized and unbiased information determined by trusted narratives, recolonization of information technology and the demystification of the media process. These experts, as technology ambassadors, advocate (...) AI-to-AI solutions to mitigate technology-driven misuse and misinformation. The optimistic scenarios shift responsibility to future generations, relying on AI-driven solutions and finding inspiration in nature. Their present-based forecasts could be construed as being indicative of professional near-sightedness and cognitive dissonance. Visualizing our findings into a Glasses Model of AI Trust, the study contributes to key debates regarding AI policy, developmental trajectories, and academic research in media and info-communication fields. (shrink)