Advances in artificial intelligence (AI) create an increasing similarity between the performance of AI systems or AI-based robots and human communication. They raise the questions: whether it is possible to communicate with, understand, and even empathically perceive artificial agents; whether we should ascribe actual subjectivity and thus quasi-personal status to them beyond a certain level of simulation; what will be the impact of an increasing dissolution of the distinction between simulated and real encounters. (1) To answer these questions, the paper (...) argues that the precondition for actually understanding others consists in the implicit assumption of the subjectivity of our counterpart, which makes shared feelings and a „we-intentionality” possible. This assumption is ultimately based on the presupposition of a shared form of life, conceived here as „conviviality.” (2) The possibility that future artificial agents could meet these preconditions is refuted on the basis of embodied and enactive cognition, which links subjectivity and consciousness to the aliveness of an organism. (3) Even if subjectivity is in principle impossible for artificial agents, the distinction between simulated and real subjectivity might nevertheless become increasingly blurred. Here, possible consequences are discussed, especially using the example of virtual psychotherapy. Finally, the paper makes case for a mindful appproach to the language we use to talk about artificial systems and pleads for preventing a systematic pretense of subjectivity. (shrink)

Kazuo Ishiguro’s novel Klara and the Sun (2021) philosophizes on how in the current technologically saturated culture, the gradual evolution of the empathetic humanoids has, on one hand, problematized our normative notions of cognitive and affective categories, and on the other, has triggered an order of emotional uncanniness due to our reliance on hyperreal real objects for receiving solace and companionship. The novel may be conceived to be a commentary on the emerging discourse in the domain of cognitive and emotional (...) computing that aspires to transform the inner life and social relationships of the human community. The novelty of the paper lies in its ability to showcase how Kazuo Ishiguro’s Klara and the Sun (2021) creates a rupture in the existing research and literary narrative by critiquing the theoretical underpinnings of emotional computing that optimistically foresees a future where simulated empathetic minds will be able to decode the complexities of the human emotions. It discusses how literature turns into an apt tool to reflect on the limitations of the programmed machines to decode the elusiveness of the human mind that defies the one-to-one correlation between words, multiple connotations, and their underlying emotions. Through the lenses of the fictional narrative, the paper foregrounds how the concept of the social robot designed to offer empathy, care, and companionship turns into a failed project. The paper draws on critical perspectives from disposability theory, posthuman affect, and immaterial bodies to foreground the noncodified feature of affective experientialities that emerge as a result of the interface between humans and nonanimate beings. (shrink)

The complex relationships between humans and AI-empowered machines have created and inspired new products and services as well as controversial debates, fiction and entertainment, and last but not least, a striving and vital field of research. The convergence between the two categories of entities has created stimulating concepts and theories in the past, such as the uncanny valley, machinization of humans through datafication, or humanization of machines, known as anthropomorphization. In this article, we identify a new gap in the relational (...) interaction between humans and AI triggered by commercial interests, making use of AI through advertisement, marketing, and corporate communications. Our scope is to broaden the field of AI and society by adding the business-society-nexus. Thus, we build on existing research streams of machinewashing and the analogous phenomenon of greenwashing to theorize about the humanwashing of AI-enabled machines as a specific anthropomorphization notion. In this way, the article offers a contribution to the anthropomorphization literature conceptualizing humanwashing as a deceptive use of AI-enabled machines aimed at intentionally or unintentionally misleading organizational stakeholders and the broader public about the true capabilities that AIEMs possess. (shrink)

Debates about the moral status of social robots (SRs) currently face a second-order, or metatheoretical impasse. On the one hand, moral individualists argue that the moral status of SRs depends on their possession of morally relevant properties. On the other hand, moral relationalists deny that we ought to attribute moral status on the basis of the properties that SRs instantiate, opting instead for other modes of reflection and critique. This paper develops and defends a pragmatic approach which aims to reconcile (...) these two positions. The core of this proposal is that moral individualism and moral relationalism are best understood as distinct deliberative strategies for attributing moral status to SRs, and that both are worth preserving insofar as they answer to different kinds of practical problems that we face as moral agents. (shrink)

Are digital subjects in virtual reality morally equivalent to human subjects? We divide this problem into two questions bearing, respectively, on cognitive and emotional equivalence. Typically, cognitive equivalence does not hold due to the lack of substantialist indistinguishability, but emotional equivalence applies: digital subjects endowed with face or language elicit emotional responses on a par with real-world pleasure, desire, horror, or fear. This is sufficient for projecting moral traits on avatars in the metaverse or on dialog systems based on large (...) language models. Our main case study is a chatbot trained on the chat history between a Canadian man and his deceased fiancée. To demonstrate emotional equivalence and the mechanism of moral transfer, we compare digital devices with the functioning of oracles in a story by Plutarch and in a narrative that draws on the book of Genesis. Finally, we note that, along with the projections of ethical issues, humans also tend to bring real-world solutions of moral conundrums into extended reality. We argue that the lack of cognitive equivalence makes such projections problematic as they lead to overpolicing and a sanitized metaverse. (shrink)

By critically analyzing the status and differentiation of bodies and their lives, the author expands the vision of governmentality beyond the West in order to define the body beyond the pacified techno-promises of their emancipation through fragmentation, calculability and programmability. By elaborating the nature, power, and promises of dominant digital technologies and technobodies, the author conceptualizes them in relation to the shift between bio- and necropolitics/power and in relation to violence, (digital) coloniality, and racialization to which bodies are exposed. It (...) is about the normality of violence against the Other, also in relation to the principle of separation of virtual bodies and “surplus flesh,” which increases exponentially with technological development. The author seeks to understand how we have come to the point where techno-objects are humanized, given agency, while the body and life of the Other are dehumanized, deprived of any rights. The article contextualizes and re-politicizes the shifting relations between subject and object, particularly within our forensic contemporaneity. (shrink)

People meeting a robot for the first time do not know what it is capable of and therefore how to interact with it—what actions to produce, and how to produce them. Despite social robotics’ long-standing interest in the effects of robots’ appearance and conduct on users, and efforts to identify factors likely to improve human–robot interaction, little attention has been paid to how participants evaluate their robotic partner in the unfolding of actual interactions. This paper draws from qualitative analyses of (...) video-recorded interactions between a robot and groups of participants, in the framework of ethnomethodology and conversation analysis. We analyse the particular ways in which participants shape their embodied actions, how they can reproduce a prior action that failed to obtain a response from the robot; and how they explore the robot’s embodied nature. We find a set of recurrent methods or practices, showing that robot-recipient design displays not only participants’ initial assumptions about the robot’s competences, but also more importantly perhaps their continuous assessment of the robot’s behaviour, and their attempts to adapt to it. Participants locally produce and constantly revise their understanding of the robot as a more or less competent co-participant, drawing from its past, current, and projected conduct and responsiveness. We discuss the implications of these findings for research in robotics and human–robot interactions, and the value of the approach to shed new light on old questions by paying attention to the quality of gesture and the sequential organisation of interaction. (shrink)

Machine learning, and more broadly artificial intelligence (AI), is a fascinating technology and can be considered as the closest approximation to the Cartesian “thinking thing” that humans have ever created. Just as the industrial revolution required a new ethos, the age of intelligent machines will create its own, challenging the established moral, economic, and political presuppositions. This paper discusses the relationship between AI and society; it presents several thought experiments to explore the complexity of the relationship and highlights the insufficiency (...) of the current normative paradigm in addressing technological expansion. I argue that many of the externalities, such as security risks, loss of privacy, and economic instability will result from trying to fit the emerging technologies into the existing frame of efficiency and utility, by redefining the notions of human value, identity, autonomy, purity, and truth, among others. The age of the intelligent machine is elevating alienation to new levels, treating the individual as mere patterns in data—its primary commodity. I further argue that while the possibility of unintended consequences, due to the potential misuse of AI is ever present, the intelligent machine per se is unlikely to engage in a zero-sum game for power on its own initiative. I question whether singularity is at all attainable and argue that technology will forever remain a proxy for human interests. I conclude by posing questions for charting the path forward. Through this analysis, I aim to provide a more nuanced understanding of the complex relationship between the AI and humans. (shrink)