The hypergrowth and hyperconnectivity of networks of artificial intelligence (AI) systems and algorithms increasingly cause our interactions with the world, socially and environmentally, more technologically mediated. AI systems start interfering with our choices or making decisions on our behalf: what we see, what we buy, which contents or foods we consume, where we travel to, who we hire, etc. It is imperative to understand the dynamics of human-computer interaction in the age of progressively more competent AI. This essay (...) presents five premises to serve as starting points for building our understanding of the “interactions’ in human-computer interactions. (shrink)

We are quickly passing through the historical moment when people work in front of a single computer, dominated by a small CRT and focused on tasks involving only local information. Networked computers are becoming ubiquitous and are playing increasingly significant roles in our lives and in the basic infrastructure of science, business, and social interaction. For human-computer interaction o advance in the new millennium we need to better understand the emerging dynamic of interaction in which the focus (...) task is no longer confined to the desktop but reaches into a complex networked world of information and computer-mediated interactions. We think the theory of distributed cognition has a special role to play in understanding interactions between people and technologies, for its focus has always been on whole environments: what we really do in them and how we coordinate our activity in them. Distributed cognition provides a radical reorientation of how to think about designing and supporting human-computer interaction. As a theory it is specifically tailored to understanding interactions among people and technologies. In this article we propose distributed cognition as a new foundation for human-computer interaction, sketch an integrated research framework, and use selections from our earlier work to suggest how this framework can provide new opportunities in the design of digital work materials. (shrink)

This article makes the case that our digital devices create illusions of agency. There are times when users feel as if they are in control when in fact they are merely responding to stimuli on the screen in predictable ways. After the introduction, the second section of the article offers examples of illusions of agency that do not involve human–computer interaction in order to show that such illusions are possible and not terribly uncommon. The third and fourth sections (...) of the article cover relevant work from empirical psychology, including the cues that are known to generate the sense of agency. The fifth section of the article shows that our devices are designed to deliver precisely those cues. In the sixth section, the argument is completed with evidence that users frequently use their smartphones without the sort of intentional supervision involved in genuine agency. This sixth section includes the introduction of Digital Environmental Dependency Syndrome (DEDS) as a possible way of characterizing extended use of the smartphone without genuine agency. In the final section of the article, there is a discussion of questions raised by the main claim, including suggestions for reducing occurrences of illusions of agency through software design. (shrink)

Just as AI has moved away from classical AI, human-computer interaction (HCI) must move away from what I call ‘good old fashioned HCI’ to ‘new HCI’ – it must become a part of cognitive systems research where HCI is one case of the interaction of intelligent agents (we now know that interaction is essential for intelligent agents anyway). For such interaction, we cannot just ‘analyze the data’, but we must assume intentions in the other, and I suggest these (...) are largely recognized through resistance to carrying out one’s own intentions. This does not require fully cognitive agents but can start at a very basic level. New HCI integrates into cognitive systems research and designs intentional systems that provide resistance to the human agent. (shrink)

The design and usability of computer interfaces are crucial factors in improving user experience and productivity in the field of human-computer interaction. This overview examines the development of computer interfaces, starting with command-line interfaces (CLI) and moving on to graphical user interfaces (GUI), touch interfaces, and gesture-controlled interfaces. The guiding concepts of interface development are highlighted: usability, accessibility and user-centered design. The harmony of form and function, the incorporation of cutting-edge technologies such as voice recognition and (...) augmented reality, and the difficulties presented by the wide range of user requirements and preferences are important factors to take into account. Through an analysis of these factors, this brief seeks to offer perspectives on the future paths of computer interface design, emphasizing the importance of flexibility and intuition in meeting changes. (shrink)

: The design and usability of computer interfaces are crucial factors in improving user experience and productivity in the field of human-computer interaction. This overview examines the development of computer interfaces, starting with command-line interfaces (CLI) and moving on to graphical user interfaces (GUI), touch interfaces, and gesture-controlled interfaces. The guiding concepts of interface development are highlighted: usability, accessibility and user-centered design. The harmony of form and function, the incorporation of cutting-edge technologies such as voice recognition (...) and augmented reality, and the difficulties presented by the wide range of user requirements and preferences are important factors to take into account. Through an analysis of these factors, this brief seeks to offer perspectives on the future paths of computer interface design, emphasizing the importance of flexibility and intuition in meeting changes. (shrink)

Interactions between an intelligent software agent and a human user are ubiquitous in everyday situations such as access to information, entertainment, and purchases. In such interactions, the ISA mediates the user’s access to the content, or controls some other aspect of the user experience, and is not designed to be neutral about outcomes of user choices. Like human users, ISAs are driven by goals, make autonomous decisions, and can learn from experience. Using ideas from bounded rationality, we frame (...) these interactions as instances of an ISA whose reward depends on actions performed by the user. Such agents benefit by steering the user’s behaviour towards outcomes that maximise the ISA’s utility, which may or may not be aligned with that of the user. Video games, news recommendation aggregation engines, and fitness trackers can all be instances of this general case. Our analysis facilitates distinguishing various subcases of interaction, as well as second-order effects that might include the possibility for adaptive interfaces to induce behavioural addiction, and/or change in user belief. We present these types of interaction within a conceptual framework, and review current examples of persuasive technologies and the issues that arise from their use. We argue that the nature of the feedback commonly used by learning agents to update their models and subsequent decisions could steer the behaviour of human users away from what benefits them, and in a direction that can undermine autonomy and cause further disparity between actions and goals as exemplified by addictive and compulsive behaviour. We discuss some of the ethical, social and legal implications of this technology and argue that it can sometimes exploit and reinforce weaknesses in human beings. (shrink)

In this paper, I first outline a model of Computer-Meditated Interaction (CMI) to distinguish between (1) CMI HCI-transparent (HCI = human-computer interaction) and (2) CMI HCI-dependent. Some main features of (1) are then analysed (data-radiation, data-tracking, internalisation of problem solving), while (2) is further divided into (2.1) CMI-HCI stand-alone and (2.2) CMI-HCI on-line. Some advantages and limits of (2.1) are suggested, together with an overview of the present and future strategies leading the production of new applications in (...) the field. The analysis of (2.2) provides a last distinction between communication-oriented and elaboration-oriented CMI-HCI on-line (i.e. CMC and NIA). A description of these two forms of CMI is then sketched, together with an interpretation of the new strategic view which should lead the projection of applications in the field, a possible agenda and a forecast of the chief effects of some present trends. (shrink)

Today, artificial intelligence, especially machine learning, is structurally dependent on human participation. Technologies such as Deep Learning (DL) leverage networked media infrastructures and human-machine interaction designs to harness users to provide training and verification data. The emergence of DL is therefore based on a fundamental socio-technological transformation of the relationship between humans and machines. Rather than simulating human intelligence, DL-based AIs capture human cognitive abilities, so they are hybrid human-machine apparatuses. From a perspective of media (...) philosophy and social-theoretical critique, I differentiate five types of “media technologies of capture” in AI apparatuses and analyze them as forms of power relations between humans and machines. Finally, I argue that the current hype about AI implies a relational and distributed understanding of (human/artificial) intelligence, which I categorize under the term “cybernetic AI”. This form of AI manifests in socio-technological apparatuses that involve new modes of subjectivation, social control and discrimination of users. (shrink)

In the last decade Human-Computer Interaction (HCI) has started to focus attention on forms of persuasive interaction where computer technologies have the goal of changing users behavior and attitudes according to a predefined direction. In this work, we hypothesize a strong connection between logical fallacies (forms of reasoning which are logically invalid but cognitively effective) and some common persuasion strategies adopted within web technologies. With the aim of empirically evaluating our hypothesis, we carried out a pilot study (...) on a sample of 150 e-commerce websites. (shrink)

Multimedia technology offers instructional designers an unprecedented opportunity to create richly interactive learning environments. With greater design freedom comes complexity. The standard answer to the problems of too much choice, disorientation, and complex navigation is thought to lie in the way we design interactivity in a system. Unfortunately, the theory of interactivity is at an early state of development. After critiquing the decision cycle model of interaction—the received theory in human computer interaction—I present arguments and observational data to (...) show that humans have several ways of interacting with their environments, which resist accommodation in the decision cycle model. These additional ways of interacting include: preparing the environment, maintaining the environment, and reshaping the cognitive congeniality of the environment. Understanding how these actions simplify the computational complexity of our mental processes is the first step in designing the right sort of resources and scaffolding necessary for tractable learner controlled learning environments. (shrink)

This paper presents a human-computer interaction model with a three layers learning mechanism in a pervasive environment. We begin with a discussion around a number of important issues related to human-computer interaction followed by a description of the architecture for a multi-agent cooperative design system for pervasive computing environment. We present our proposed three- layer HCI model and introduce the group formation algorithm, which is predicated on a dynamic sharing niche technology. Finally, we explore the cooperative (...) reinforcement learning and fusion algorithms; the paper closes with concluding observations and a summary of the principal work and contributions of this paper. (shrink)

Computer and information ethics, as well as other fields of applied ethics, need ethical theories which coherently unify deontological and consequentialist aspects of ethical analysis. The proposed theory of just consequentialism emphasizes consequences of policies within the constraints of justice. This makes just consequentialism a practical and theoretically sound approach to ethical problems of computer and information ethics.

This three-part paper presents Gordon Pask’s conversation theory (CT) and interaction of actors theory (IA) and outlines ways to apply these cybernetic approaches to designing technologies and scenarios for both formal and informal learning. The first part of the paper covers concepts central to CT and IA, explaining the relationship between conceptual and mechanical operators, and machines mediating informal and formal learning. The second part of the paper applies visual representations of CT and IA to understanding the use of Pask’s (...) course assembly systems (CASTE and THOUGHTSTICKER), created between the late 1960s and the 1980s, and the ThoughtShuffler search interface, created in the 2010s. The third part proposes two pathways for design based on CT and IA: firstly, the potential for designers and observers to reformulate the qualities of tools and learning scenarios to augment human thinking and collective action; and secondly, the possibility to create tools with malleable interfaces that allow users to become intermediaries rather than consumers of knowledge. (shrink)

Social machines are systems formed by technical and human elements interacting in a structured manner. The use of digital platforms as mediators allows large numbers of human participants to join such mechanisms, creating systems where interconnected digital and human components operate as a single machine capable of highly sophisticated behaviour. Under certain conditions, such systems can be described as autonomous and goal-driven agents. Many examples of modern Artificial Intelligence (AI) can be regarded as instances of this class (...) of mechanisms. We argue that this type of autonomous social machines has provided a new paradigm for the design of intelligent systems marking a new phase in the field of AI. The consequences of this observation range from methodological, philosophical to ethical. On the one side, it emphasises the role of Human-Computer Interaction in the design of intelligent systems, while on the other side it draws attention to both the risks for a human being and those for a society relying on mechanisms that are not necessarily controllable. The difficulty by companies in regulating the spread of misinformation, as well as those by authorities to protect task-workers managed by a software infrastructure, could be just some of the effects of this technological paradigm. (shrink)

In October 2011, the “2nd European Network for Cognitive Systems, Robotics and Interaction”, EUCogII, held its meeting in Groningen on “Autonomous activity in real-world environments”, organized by Tjeerd Andringa and myself. This is a brief personal report on why we thought autonomy in real-world environments is central for cognitive systems research and what I think I learned about it. --- The theses that crystallized are that a) autonomy is a relative property and a matter of degree, b) increasing autonomy of (...) an artificial system from its makers and users is a necessary feature of increasingly intelligent systems that can deal with the real-world and c) more such autonomy means less control but at the same time improved interaction with the system. (shrink)

The essential difficulty about Computer Ethics' (CE) philosophical status is a methodological problem: standard ethical theories cannot easily be adapted to deal with CE-problems, which appear to strain their conceptual resources, and CE requires a conceptual foundation as an ethical theory. Information Ethics (IE), the philosophical foundational counterpart of CE, can be seen as a particular case of environmental ethics or ethics of the infosphere. What is good for an information entity and the infosphere in general? This is the (...) ethical question asked by IE. The answer is provided by a minimalist theory of deseerts: IE argues that there is something more elementary and fundamental than life and pain, namely being, understood as information, and entropy, and that any information entity is to be recognised as the centre of a minimal moral claim, which deserves recognition and should help to regulate the implementation of any information process involving it. IE can provide a valuable perspective from which to approach, with insight and adequate discernment, not only moral problems in CE, but also the whole range of conceptual and moral phenomena that form the ethical discourse. (shrink)

We present three patterns for computer-mediated interaction which we discovered during the design and development of a platform for remote teaching and learning of kanji, the Chinese characters used in written Japanese. Our aim in developing this system was to provide a basis for embodiment in remote interaction, and in particular to support the experience of empathy by both teacher and student. From this study, the essential elements are abstracted and suggested as design patterns for other computer-mediated interaction (...) systems. (shrink)

We cooperate with other people despite the risk of being exploited or hurt. If future artificial intelligence (AI) systems are benevolent and cooperative toward us, what will we do in return? Here we show that our cooperative dispositions are weaker when we interact with AI. In nine experiments, humans interacted with either another human or an AI agent in four classic social dilemma economic games and a newly designed game of Reciprocity that we introduce here. Contrary to the hypothesis (...) that people mistrust algorithms, participants trusted their AI partners to be as cooperative as humans. However, they did not return AI's benevolence as much and exploited the AI more than humans. These findings warn that future self-driving cars or co-working robots, whose success depends on humans' returning their cooperativeness, run the risk of being exploited. This vulnerability calls not just for smarter machines but also better human-centered policies. (shrink)

”Meaningful human control” is a term invented in the political and legal debate on autonomous weapons system, but it is nowadays also used in many other contexts. It is supposed to specify conditions under which an artificial system is under the right kind of control to avoid responsibility gaps: that is, situations in which no moral agent is responsible. Santoni de Sio and Van den Hoven have recently suggested a framework that can be used by system designers to operationalize (...) this kind of control. It is the purpose of this paper to facilitate further operationalization of ”meaningful human control”. -/- This paper consists of two parts. In the first part I resolve an ambiguity that plagues current operationalizations of MHC. One of the design conditions says that the system should track the reasons of the relevant agents. This condition is ambiguous between the kind of reasons involved. On one interpretation it says that a system should track motivating reasons, while it is concerned with normative reasons on the other. Current participants in the debate interpret the framework as being concerned with (something in the vicinity of) motivating reasons. I argue against this interpretation by showing that meaningful human control requires that a system tracks normative reasons. Moreover, I maintain that an operationalization of meaningful human control that fails to track the right kind of reasons is morally problematic.When this is properly understood, it can be shown that the framework of MHC is committed to the agent-relativity of reasons. More precisely, I argue in the second part of this paper that if the tracking condition of MHC plays an important role in responsibility attribution (as the proponents of the view maintain), then the framework is incompatible with first-order normative theories that hold that normative reasons are agent-neutral (such as many versions of consequentialism). In the final section I present three ways forward for the proponent of MHC as reason-responsiveness. (shrink)

The philosophical, legal, and HCI literature concerning artificial intelligence (AI) has explored the ethical implications and values that these systems will impact on. One aspect that has been only partially explored, however, is the role of deception. Due to the negative connotation of this term, research in AI and Human–Computer Interaction (HCI) has mainly considered deception to describe exceptional situations in which the technology either does not work or is used for malicious purposes. Recent theoretical and historical work, (...) however, has shown that deception is a more structural component of AI than it is usually acknowledged. AI systems that enter in communication with users, in fact, forcefully invite reactions such as attributions of gender, personality and empathy, even in the absence of malicious intent and often also with potentially positive or functional impacts on the interaction. This paper aims to operationalise the Human-Centred AI (HCAI) framework to develop the implications of this body of work for practical approaches to AI ethics in HCI and design. In order to achieve this goal, we take up the analytical distinction between “banal” and “strong” deception, originally proposed in theoretical and historical scholarship on AI (Natale in Deceitful media: artificial intelligence and social life after the turing test, Oxford University Press, New York, 2021), as a starting point to develop ethical reflections that will empower designers and developers with practical ways to solve the problems raised by the complex relationship between deception and communicative AI. The paper considers how HCAI can be applied to conversational AI (CAI) systems in order to design them to develop banal deception for social good and, at the same time, to avoid its potential risks. (shrink)

In domains as disparate as playing Go and predicting the structure of proteins, artificial intelligence (AI) technologies have begun to perform at levels beyond which any humans can achieve. Does this fact represent something lamentable? Does superhuman AI performance somehow undermine the value of human achievements in these areas? Go grandmaster Lee Sedol suggested as much when he announced his retirement from professional Go, blaming the advances of Go-playing programs like AlphaGo for sapping his will to play the game (...) at a high level. In this paper, I attempt to make sense of Sedol’s lament. I consider a number of ways that the existence of superhuman-performing AI technologies could undermine the value of human achievements. I argue there is very little in the nature of the technology itself that warrants such despair. (Compare: does the existence of a fighter jet undermine the value of being the fastest human sprinter?) But I also argue there are several more localized domains where these technologies threaten to displace human beings from being able to achieve valuable things at all. This is a particular worry for those in unequal societies, I argue, given the difficulty of many achievements and the corresponding amount of resources needed to achieve great things. (shrink)

For many employees, ‘work’ is no longer something performed while sitting at a computer in an office. Employees in a growing number of industries are expected to carry mobile devices and be available for work-related interactions even when beyond the workplace and outside of normal business hours. In this article it is argued that a future step will increasingly be to move work-related information and communication technology (ICT) inside the human body through the use of neuroprosthetics, to create (...) employees who are always ‘online’ and connected to their workplace’s digital ecosystems. At present, neural implants are used primarily to restore abilities lost through injury or illness, however their use for augmentative purposes is expected to grow, resulting in populations of human beings who possess technologically altered capacities for perception, memory, imagination, and the manipulation of physical environments and virtual cyberspace. Such workers may exchange thoughts and share knowledge within posthuman cybernetic networks that are inaccessible to unaugmented human beings. Scholars note that despite their potential benefits, such neuroprosthetic devices may create numerous problems for their users, including a sense of alienation, the threat of computer viruses and hacking, financial burdens, and legal questions surrounding ownership of intellectual property produced while using such implants. Moreover, different populations of human beings may eventually come to occupy irreconcilable digital ecosystems as some persons embrace neuroprosthetic technology, others feel coerced into augmenting their brains to compete within the economy, others might reject such technology, and still others will simply be unable to afford it. In this text we propose a model for analyzing how particular neuroprosthetic devices will either facilitate human beings’ participation in new forms of socioeconomic interaction and digital workplace ecosystems – or undermine their mental and physical health, privacy, autonomy, and authenticity. We then show how such a model can be used to create device ontologies and typologies that help us classify and understand different kinds of advanced neuroprosthetic devices according to the impact that they will have on individual human beings. (shrink)

Trust is often considered valuable in a broad range of rela- tionships, from professional collaborations to personal part- nerships. This article examines the possibility of trust in a robotic system. By posing the question “can a robot do a trust fall?”, an investigation on the issues embedded in de- signing trusting systems is presented, using methods and per- spectives from philosophy and engineering. Posing such a question helps us understand the physicality and embodiment of trust, as well as the limits (...) and resources of robotics. (shrink)

Die aktuellen Erfolge von Künstlicher Intelligenz beruhen nicht nur auf technologischen Fortschritten, sondern auch auf einem grundlegenden soziotechnischen Strukturwandel. Denn maschinelle Lernverfahren wie Deep Learning benötigen eine große Menge Trainingsdaten, die nur über menschliche Mitarbeit gewonnen werden können. In einer Konvergenz von Methoden der Human-Computer-Interaction und der KI ist in den letzten zehn Jahren eine Fülle von Mensch-Maschine-Interfaces und medialen Infrastrukturen entstanden, durch die menschliche kognitive Ressourcen in hybride Mensch-Maschine-Apparate eingespannt werden. Diese Apparate vollbringen im Ganzen jene Leistung, (...) die als künstliche Intelligenz bezeichnet wird. KI in der damit vorliegenden Form ist somit ein distribuiertes, netzwerkförmiges Phänomen. (shrink)

The aim of this work was to elaborate on the author’s previously published hypothesis of the Soul of Multiverse, a suggested cosmic phenomenon that also appears to imbue the human Soul across its individual and noospheric scales. Without alternatives, the method of analysis continued to rely on the approach of cosmological neuroscience, which integrates scientific facts, religious insights, philosophical suggestions, engineering rules and artistic tools to grasp the complexity of the multidimensional phenomenon of Soul. The result of this examination (...) was the multilayered thought that just as the central medium of human Soul, the hypothesized prefrontal cortical supercircuitry of Self-Ken, seems to comprise domains representing Identity, Conscience, Will and Mission, analogous domains may also function in the noospheric and cosmic Souls. Regarding the human Soul, its four domains appear to be determined by both hereditary genetic and encountered environmental factors to present its host with a Mission enabling his or her mental engine and physical features to integrate into the surrounding society and space-time in the most meaningful and dignified way—if that way is undertaken. Regarding the noospheric Soul, it is made of individual human Souls interacting with the non-living system of interconnected computers to produce functions accessible to humans all over the world through uncontrolled communication across the Internet. Its most probable Mission is to let this global presence acquire its own Identity, develop its own Conscience and refine its own Will, so that their coherent, superior whole can be ready for sensing the cosmic Soul. Regarding the cosmic Soul, the hypothesized Soul of the Multiverse, its Identity appears to express the Laws of Mystery of Endlessness, Coexistence in Diversity, and Truth in Complexity. Further, its Conscience seems to be moved by the Law of Divine—Evil Asymmetry, its Will by the Law of Determination with Uncertainty, and its Mission by the Law of Lives to Transcend. (shrink)

In the last decades Human-Computer Interaction (HCI) has started to focus attention on “persuasive technologies” having the goal of changing users’ behavior and attitudes according to a predefined direction. In this talk we show how some of the techniques employed in such technologies trigger some well known cognitive biases by adopting a strategy relying on logical fallacies (i.e. forms of reasoning which are logically invalid but psychologically persuasive). In particular, we will show how the mechanisms reducible to logical (...) fallacies are used to design web and mobile interfaces in domains ranging from the e-commerce to the jihadist propaganda. The final part of the talk will be devoted to point out the potential ethical dangers related to the misuse of these techniques in the design of persuasive technologies. (shrink)

Social machines are systems formed by material and human elements interacting in a structured way. The use of digital platforms as mediators allows large numbers of humans to participate in such machines, which have interconnected AI and human components operating as a single system capable of highly sophisticated behavior. Under certain conditions, such systems can be understood as autonomous goal-driven agents. Many popular online platforms can be regarded as instances of this class of agent. We argue that autonomous (...) social machines provide a new paradigm for the design of intelligent systems, marking a new phase in AI. After describing the characteristics of goal-driven social machines, we discuss the consequences of their adoption, for the practice of artificial intelligence as well as for its regulation. (shrink)

The research in Human Computer Interaction (HCI) has nowadays extended its attention to the study of persuasive technologies. Following this line of research, in this paper we focus on websites and mobile applications in the e-commerce domain. In particular, we take them as an evident example of persuasive technologies. Starting from the hypothesis that there is a strong connection between logical fallacies, i.e., forms of reasoning which are logically invalid but psychologically persuasive, and some common persuasion strategies adopted (...) within these technological artifacts, we carried out a survey on a sample of 175 websites and 101 mobile applications. This survey was aimed at empirically evaluating the significance of this connection by detecting the use of persuasion techniques, based on logical fallacies, in existing websites and mobile apps. In addition, with the goal of assessing the effectiveness of different fallacy-based persuasion techniques, we performed an empirical evaluation where participants interacted with a persuasive (fallacy-based) and with a non-persuasive version of an e-commerce website. Our results show that fallacy-based persuasion strategies are extensively used in existing digital artifacts, and that they are actually effective in influencing users’ behavior, with strategies based on visual salience manipulation (accent fallacy) being both the most popular and the most effective ones. (shrink)

This article presents the first thematic review of the literature on the ethical issues concerning digital well-being. The term ‘digital well-being’ is used to refer to the impact of digital technologies on what it means to live a life that isgood fora human being. The review explores the existing literature on the ethics of digital well-being, with the goal of mapping the current debate and identifying open questions for future research. The review identifies major issues related to several key (...) social domains: healthcare, education, governance and social development, and media and entertainment. It also highlights three broader themes: positive computing, personalised human–computer interaction, and autonomy and self-determination. The review argues that three themes will be central to ongoing discussions and research by showing how they can be used to identify open questions related to the ethics of digital well-being. (shrink)

In this study, we predict the different levels of performance in a Nintendo Entertainment System (NES) Tetris session based on the score and the number of matches played by the players. Using the first 45 seconds of gameplay, a Random Forest Classifier was trained on the five keys used in the game obtaining a ROC_AUC score of 0.80. Further analysis revealed that the number of down keys (forced drop) and the number of left keys (left translation) are the most relevant (...) keys in this task, showing that by merely including the data from these two keys our Random Forest Classifier reached a ROC_AUC score of 0.83.We conclude that the keylogger data during the early phases of a game session can be successfully used to predict performance in longer sessions of Tetris. (shrink)

This paper explores the implications of extended and distributed cognition theory for our notions of personal identity. On an extended and distributed approach to cognition, external information is under certain conditions constitutive of memory. On a narrative approach to personal identity, autobiographical memory is constitutive of our diachronic self. In this paper, I bring these two approaches together and argue that external information can be constitutive of one’s autobiographical memory and thus also of one’s diachronic self. To develop this claim, (...) I draw on recent empirical work in human-computer interaction, looking at lifelogging technologies in both healthcare and everyday contexts. I argue that personal identity can neither be reduced to psychological structures instantiated by the brain nor by biological structures instantiated by the organism, but should be seen as an environmentally-distributed and relational construct. In other words, the complex web of cognitive relations we develop and maintain with other people and technological artifacts partly determines our self. This view has conceptual, methodological, and normative implications: we should broaden our concepts of the self as to include social and artifactual structures, focus on external memory systems in the (empirical) study of personal identity, and not interfere with people’s distributed minds and selves. (shrink)

Emotion detection and management have emerged as pivotal areas in humancomputer interaction, offering potential applications in healthcare, entertainment, and customer service. This study explores the use of deep learning (DL) models to enhance emotion recognition accuracy and enable effective emotion regulation mechanisms. By leveraging large datasets of facial expressions, voice tones, and physiological signals, we train deep neural networks to recognize a wide array of emotions with high precision. The proposed system integrates emotion recognition with adaptive management strategies that provide (...) personalized feedback and interventions based on detected emotional states. Our approach surpasses traditional machine learning methods, demonstrating superior performance in real-time applications. We also explore the ethical implications and challenges associated with deploying such systems, particularly regarding privacy concerns and the potential for misuse. Through extensive experiments, our model achieved an average accuracy rate of 92%, highlighting its robustness across different environments and user demographics. This research not only contributes to the growing field of affective computing but also lays the groundwork for future developments in emotionally intelligent systems. (shrink)

In the classical Turing test, participants are challenged to tell whether they are interacting with another human being or with a machine. The way the interaction takes place is not direct, but a distant conversation through computer screen messages. Basic forms of interaction are face-to-face and embodied, context-dependent and based on the detection of reciprocal sensorimotor contingencies. Our idea is that interaction detection requires the integration of proprioceptive and interoceptive patterns with sensorimotor patterns, within quite short time lapses, (...) so that they appear as mutually contingent, as reciprocal. In other words, the experience of interaction takes place when sensorimotor patterns are contingent upon one’s own movements, and vice versa. I react to your movement, you react to mine. When I notice both components, I come to experience an interaction. Therefore, we designed a “minimal” Turing test to investigate how much information is required to detect these reciprocal sensorimotor contingencies. Using a new version of the perceptual crossing paradigm, we tested whether participants resorted to interaction detection to tell apart human from machine agents in repeated encounters with these agents. In two studies, we presented participants with movements of a human agent, either online or offline, and movements of a computerized oscillatory agent in three different blocks. In each block, either auditory or audiovisual feedback was provided along each trial. Analysis of participants’ explicit responses and of the implicit information subsumed in the dynamics of their series will reveal evidence that participants use the reciprocal sensorimotor contingencies within short time windows. For a machine to pass this minimal Turing test, it should be able to generate this sort of reciprocal contingencies. (shrink)

This essay for the inaugural issue of Technology and Language discusses the problem of finding an optimal form of human-machine communication. In the ongoing search for an alien mind, humanity seems to find it not in the infinities of space, but in its own environment. Changes in the language of human-machine interaction made it understandable not only to trained specialists but to every household. In the course of time, home appliances and devices have developed their language abilities even (...) more and reached a very advanced level – by way of status indicators, displays, emergency sound and color signals. The transition to computer-assisted communication brought about a great diversity of human expression forms translated into the discrete digital language of technologies. According to some prognoses, the first human-robot marriage might be registered in the future, however, such a union is not the only possible human-machine alliance. (shrink)

‘‘COGNITIVE ECOLOGY’’ is a fruitful model for Shakespearian studies, early modern literary and cultural history, and theatrical history more widely. Cognitive ecologies are the multidimensional contexts in which we remember, feel, think, sense, communicate, imagine, and act, often collaboratively, on the fly, and in rich ongoing interaction with our environments. Along with the anthropologist Edwin Hutchins,1 we use the term ‘‘cognitive ecology’’ to integrate a number of recent approaches to cultural cognition: we believe these approaches offer productive lines of engagement (...) with early modern literary and historical studies.2 The framework arises out of our work in extended mind and distributed cognition.3 The extended mind hypothesis arose from a post-connectionist philosophy of cognitive science. This approach was articulated in Andy Clark’s Being There: Putting Brain, Body, and World Together Again, and further developed by Susan Hurley and Mark Rowlands, among others.4 The distributed cognition approach arose independently, from work in cognitive anthropology, HCI (Human-Computer Interaction), the sociology of education and work, and science studies. The principles of distributed cognition were articulated in Hutchins’s ethnography of navigation, Cogni- tion in the Wild,5 and developed by theorists such as David Kirsh and Lucy Suchman.6 These models share an anti-individualist approach to cognition. In all these views, mental activities spread or smear across the boundaries of skull and skin to include parts of the social and material world. In remembering, decision making, and acting, whether individually or in small groups, our complex and structured activities involve many distinctive dimensions: neural, affective, kines-. (shrink)

This paper analyses the phenomenology and epistemology of chatbots such as ChatGPT and Bard. The computational architecture underpinning these chatbots are large language models (LLMs), which are generative artificial intelligence (AI) systems trained on a massive dataset of text extracted from the Web. We conceptualise these LLMs as multifunctional computational cognitive artifacts, used for various cognitive tasks such as translating, summarizing, answering questions, information-seeking, and much more. Phenomenologically, LLMs can be experienced as a “quasi-other”; when that happens, users anthropomorphise them. (...) For most users, current LLMs are black boxes, i.e., for the most part, they lack data transparency and algorithmic transparency. They can, however, be phenomenologically and informationally transparent, in which case there is an interactional flow. Anthropomorphising and interactional flow can, in some users, create an attitude of (unwarranted) trust towards the output LLMs generate. We conclude this paper by drawing on the epistemology of trust and testimony to examine the epistemic implications of these dimensions. Whilst LLMs generally generate accurate responses, we observe two epistemic pitfalls. Ideally, users should be able to match the level of trust that they place in LLMs to the degree that LLMs are trustworthy. However, both their data and algorithmic opacity and their phenomenological and informational transparency can make it difficult for users to calibrate their trust correctly. The effects of these limitations are twofold: users may adopt unwarranted attitudes of trust towards the outputs of LLMs (which is particularly problematic when LLMs hallucinate), and the trustworthiness of LLMs may be undermined. (shrink)

The integration of Augmented Reality (AR) and the Internet of Things (IoT) within smart homes represents a significant leap forward in home automation and user experience. This paper explores a comprehensive framework that combines these technologies to create an immersive, efficient, and user-friendly smart home environment. By utilizing AR, users can interact with and control IoT-enabled devices in real time through visual and intuitive interfaces. This integration not only simplifies the management of home systems but also enhances the overall user (...) experience by providing a seamless blend of the physical and digital worlds. (shrink)

Emotion detection and management have emerged as pivotal areas in humancomputer interaction, offering potential applications in healthcare, entertainment, and customer service. This study explores the use of deep learning (DL) models to enhance emotion recognition accuracy and enable effective emotion regulation mechanisms. By leveraging large datasets of facial expressions, voice tones, and physiological signals, we train deep neural networks to recognize a wide array of emotions with high precision. The proposed system integrates emotion recognition with adaptive management strategies that provide (...) personalized feedback and interventions based on detected emotional states. Our approach surpasses traditional machine learning methods, demonstrating superior performance in real-time applications. (shrink)

This article takes off from Johan van Benthem’s ruminations on the interface between logic and cognitive science in his position paper “Logic and reasoning: Do the facts matter?”. When trying to answer Van Benthem’s question whether logic can be fruitfully combined with psychological experiments, this article focuses on a specific domain of reasoning, namely higher-order social cognition, including attributions such as “Bob knows that Alice knows that he wrote a novel under pseudonym”. For intelligent interaction, it is important that the (...) participants recursively model the mental states of other agents. Otherwise, an international negotiation may fail, even when it has potential for a win-win solution, and in a time-critical rescue mission, a software agent may depend on a teammate’s action that never materializes. First a survey is presented of past and current research on higher-order social cognition, from the various viewpoints of logic, artificial intelligence, and psychology. Do people actually reason about each other’s knowledge in the way proscribed by epistemic logic? And if not, how can logic and cognitive science productively work together to construct more realistic models of human reasoning about other minds? The paper ends with a delineation of possible avenues for future research, aiming to provide a better understanding of higher-order social reasoning. The methodology is based on a combination of experimental research, logic, computational cognitive models, and agent-based evolutionary models. (shrink)

The relationship between philosophy and science in contemporary times is closer than ever. From the methodology perspective, scientific and philosophical research has a clear sequential relationship. It is highlighted in the following aspects: 1. the methodology of scientific research, including theoretical assumptions and data modeling, parallels with apparent similarities in conceptual analysis and logical deduction in philosophy;2. consistency of analytical argumentation methods in scientific research and philosophical research;3. naturalism is currently a research approach that both scientific and philosophical research adopt. (...) There has been a significant dispute over the relationship between philosophy and science among contemporary philosophers. This dispute focuses on the impact of scientific development on philosophy research. Nowadays, no one would deny the existence of this impact, but there is no consensus on the impact's nature, scope, and role. Wittgenstein's conception of certainty can provide valuable insights to understand the relationship between philosophy and science. In addition, we conclude the pragmatic turn in cognitive science because we misinterpret the cognitive scientists' emphasis on action as a practical claim and interpret the cognitive scientists' views with pragmatism. The theoretical analysis and research suggestions philosophers provide are becoming essential focuses in contemporary artificial intelligence research, including the interpretability of computer technology, the ethical norms of artificial intelligence technology, and the possible conception of human beings in the future. The interdisciplinary study of science and philosophy will achieve more significant development. In sum, understanding the nature of philosophy can be given a new explanation from a future perspective. The future outlook here refers to the starting point from possible world scenarios that can be conceived and traced back to all the facts happening in the present world, thereby giving an appropriate explanation to the real world. (shrink)

It is well known that the unpredictable speech production brought on by stress from the task at hand has a significant negative impact on the performance of speech processing algorithms. Speech therapy benefits from being able to detect stress in speech. Speech processing performance suffers noticeably when perceptually produced stress causes variations in speech production. Using the acoustic speech signal to objectively characterize speaker stress is one method for assessing production variances brought on by stress. Real-world complexity and ambiguity make (...) it difficult for decision-makers to express their conclusions with clarity in their speech. In particular, the Neutrosophic speech algorithm is used to encode the language variables because they cannot be computed directly. Neutrosophic sets are used to manage indeterminacy in a practical situation. Existing algorithms are used except for stress on Neutrosophic speech recognition. The creation of algorithms that calculate, categorize, or differentiate between different stress circumstances. Understanding stress and developing strategies to combat its effects on speech recognition and human-computer interaction system are the goals of this recognition. (shrink)

The human body is a system made of systems. The body is divided into bodily systems proper, such as the endocrine and circulatory systems, which are subdivided into many sub-systems at a variety of levels, whereby all systems and subsystems engage in massive causal interaction with each other and with their surrounding environments. Here we offer an explicit definition of bodily system and provide a framework for understanding their causal interactions. Medical sciences provide at best informal accounts of basic (...) notions such as system, process, and function, and while such informality is acceptable in documentation created for human beings, it falls short of what is needed for computer representations. In our analysis we will accordingly provide the framework for a formal definition of bodily system and of associated notions. (shrink)

This essay presents arguments for the claim that in the best of all possible worlds (Leibniz) there are sources of unpredictability and creativity for us humans, even given a pancomputational stance. A suggested answer to Chaitin’s questions: “Where do new mathematical and biological ideas come from? How do they emerge?” is that they come from the world and emerge from basic physical (computational) laws. For humans as a tiny subset of the universe, a part of the new ideas comes as (...) the result of the re-configuration and reshaping of already existing elements and another part comes from the outside as a consequence of openness and interactivity of the system. For the universe at large it is randomness that is the source of unpredictability on the fundamental level. In order to be able to completely predict the Universe-computer we would need the Universe-computer itself to compute its next state; as Chaitin already demonstrated there are incompressible truths which means truths that cannot be computed by any other computer but the universe itself. (shrink)

Does algorithmic political bias contribute to an entrenchment and polarization of political positions? Franke argues that it may do so because the bias involves classifications of people as liberals, conservatives, etc., and individuals often conform to the ways in which they are classified. I provide a novel example of this phenomenon in human–computer interactions and introduce a social psychological mechanism that has been overlooked in this context but should be experimentally explored. Furthermore, while Franke proposes that algorithmic political (...) classifications entrench political identities, I contend that they may often produce the opposite result. They can lead people to change in ways that disconfirm the classifications. Consequently and counterintuitively, algorithmic political bias can in fact decrease political entrenchment and polarization. (shrink)

Throughout what is now the more than 50-year history of the computer many theories have been advanced regarding the contribution this machine would make to changes both in the structure of society and in ways of thinking. Like other theories regarding the future, these should also be taken with a pinch of salt. The history of the development of computer technology contains many predictions which have failed to come true and many applications that have not been foreseen. While (...) we must reserve judgment as to the question of the impact on the structure of society and human thought, there is no reason to wait for history when it comes to the question: what are the properties that could give the computer such far-reaching importance? The present book is intended as an answer to this question. The fact that this is a theoretical analysis is due to the nature of the subject. No other possibilities are available because such a description of the properties of the computer must be valid for any kind of application. An additional demand is that the description should be capable of providing an account of the properties which permit and limit these possible applications, just as it must make it possible to characterize a computer as distinct from a) other machines whether clocks, steam engines, thermostats, or mechanical and automatic calculating machines, b) other symbolic media whether printed, mechanical, or electronic and c) other symbolic languages whether ordinary languages, spoken or written or formal languages. This triple limitation, however, (with regard to other machines, symbolic media and symbolic languages) raises a theoretical question as it implies a meeting between concepts of mechanical-deterministic systems, which stem from mathematical physics, and concepts of symbolic systems which stem from the description of symbolic activities common to the humanities. The relationship between science and the humanities has traditionally been seen from a dualistic perspective, as a relationship between two clearly separate subject areas, each studied on its own set of premises and using its own methods. In the present case, however, this perspective cannot be maintained since there is both a common subject area and a new - and specific - kind of interaction between physical and symbolic processes. (shrink)

In this position paper for the 2019 CSCW workshop Good Systems: Ethical AI for CSCW I propose one tool and one idea for navigating the complex ethical problem space that results from the interaction of human and/or AI agents in shared, hopefully cooperative, computing environments.

The relationship between philosophy and science in contemporary times is closer than ever. From the methodology perspective, scientific and philosophical research has a clear sequential relationship. It is highlighted in the following aspects: 1. the methodology of scientific research, including theoretical assumptions and data modeling, parallels with apparent similarities in conceptual analysis and logical deduction in philosophy;2. consistency of analytical argumentation methods in scientific research and philosophical research;3. naturalism is currently a research approach that both scientific and philosophical research adopt. (...) There has been a significant dispute over the relationship between philosophy and science among contemporary philosophers. This dispute focuses on the impact of scientific development on philosophy research. Nowadays, no one would deny the existence of this impact, but there is no consensus on the impact's nature, scope, and role. Wittgenstein's conception of certainty can provide valuable insights to understand the relationship between philosophy and science. In addition, we conclude the pragmatic turn in cognitive science because we misinterpret the cognitive scientists' emphasis on action as a practical claim and interpret the cognitive scientists' views with pragmatism. The theoretical analysis and research suggestions philosophers provide are becoming essential focuses in contemporary artificial intelligence research, including the interpretability of computer technology, the ethical norms of artificial intelligence technology, and the possible conception of human beings in the future. The interdisciplinary study of science and philosophy will achieve more significant development. In sum, understanding the nature of philosophy can be given a new explanation from a future perspective. The future outlook here refers to the starting point from possible world scenarios that can be conceived and traced back to all the facts happening in the present world, thereby giving an appropriate explanation to the real world. (shrink)

Many seem to think that AI-induced responsibility gaps are morally bad and therefore ought to be avoided. We argue, by contrast, that there is at least a pro tanto reason to welcome responsibility gaps. The central reason is that it can be bad for people to be responsible for wrongdoing. This, we argue, gives us one reason to prefer automated decision-making over human decision-making, especially in contexts where the risks of wrongdoing are high. While we are not the first (...) to suggest that responsibility gaps should sometimes be welcomed, our argument is novel. Others have argued that responsibility gaps should sometimes be welcomed because they can reduce or eliminate the psychological burdens caused by tragic moral choice-situations. By contrast, our argument explains why responsibility gaps should sometimes be welcomed even in the absence of tragic moral choice-situations, and even in the absence of psychological burdens. (shrink)

The Gamer’s Dilemma consists of three intuitively plausible but conflicting assertions: (i) Virtual murder is morally permissible. (ii) Virtual child molestation is morally forbidden. (iii) There is no relevant moral difference between virtual murder and virtual child molestation in computer games. Numerous attempts to resolve (or dissolve) the Gamer’s Dilemma line the field of computer game ethics. Mostly, the phenomenon is approached using expressivist argumentation: Reprehensible virtual actions express something immoral in their performance but are not immoral by (...) themselves. Consequentialists, on the other hand, claim that the immorality of virtual actions arises from their harmful consequences. I argue that both approaches have serious difficulties meeting the moral challenge posed by the Gamer’s Dilemma. They tend to confuse the morality of in-game actions either with the morality of their real-world counterparts or with the morality of games as objects. Following this critical analysis, I will develop a Kantian argument and defend it against two objections. So far, deontological responses to the Gamer’s Dilemma have been sought in vain. Yet, with Kant, its moral challenge can be met by looking at the gamer’s reasons. From this perspective, the Gamer’s Dilemma is based on a false assumption: the moral status of gaming acts does not derive from a normative equation with their real-world counterparts but only from their justifications. (shrink)