Recent work in social robotics, which is aimed both at creating an artificial intelligence and providing a test-bed for psychological theories of human social development, involves building robots that can learn from ‘face-to-face’ interaction with human beings — as human infants do. The building-blocks of this interaction include the robot’s ‘expressive’ behaviours, for example, facial-expression and head-and-neck gesture. There is here an ideal opportunity to apply Wittgensteinian conceptual analysis to current theoretical and empirical work in the sciences. Wittgenstein’s (...) philosophical psychology is sympathetic to embodied and situated Artificial Intelligence (see Proudfoot, 2002, 2004b), and his discussion of facial-expression is remarkably modern. In this chapter, I explore his approach to facial-expression, using smiling as a representative example, and apply it to the canonical interactive face robot, Cynthia Breazeal’s Kismet (see e.g. Breazeal, 2009, 2002). I assess the claim that Kismet has expressive behaviours, with the aim of generating philosophical insights for AI. (shrink)

Facial Expression conveys non-verbal cues, which plays an important role in interpersonal relations. The Cognitive Emotion AI system is the process of identifying the emotional state of a person. The main aim of our study is to develop a robust system which can detect as well as recognize human emotion from live feed. There are some emotions which are universal to all human beings like angry, sad, happy, surprise, fear, disgust and neutral. The methodology of this system is (...) based on two stages- facial detection is done by extraction of Haar Cascade features of a face using Viola Jones algorithm and then the emotion is verified and recognized using Artificial Intelligence Techniques. The system will take image or frame as an input and by providing the image to the model the model will perform the preprocessing and feature selection after that it will be predict the emotional state. (shrink)

Methodological problems often arise when a special case is confused with the general principle. So you will find affordances only for ‚artifacts’ if you restrict the analysis to ‚artifacts’. The general principle, however, is an ‚invitation character’, which triggers an action. Consequently, an action-theoretical approach known as ‚pragmatic turn’ in cognitive science is recommended. According to this approach, the human being is not a passive-receptive being but actively produces those action effects that open up the world to us. This ‚ideomotor (...) approach’ focuses on the so-called ‚epistemic actions’, which guide our perception as conscious and unconscious cognitions. Due to ‚embodied cognition’ the own body is assigned an indispensable role. The action theoretical approach of ‚enactive cognition’ enables that every form can be consistently processualized. Thus, each ‚Gestalt’ is understood as the process result of interlocking cognitions of ‚forward modelling’ and ‚inverse modelling’. As can be shown, these cognitions are fed by previous experiences of real interaction, which later changes into a mental trial treatment, which is highly automated and can therefore take place unconsciously. It is now central that every object may have such affordances that call for instrumental or epistemic action. In the simplest case, it is the body and the facial expressions of our counterpart that can be understood as a question and provoke an answer/reaction. Thus, emotion is not only to be understood as expression/output according to the scheme ‚input-processing-output’, but acts itself as a provocative act/input. Consequently, artifacts are neither necessary nor sufficient conditions for affordances. Rather, they exist in all areas of cognition—from Enactive Cognition to Social Cognition. (shrink)

In this article, I link Lisa Feldman Barrett's theory of constructed emotion1 to decolonial perspectives that also challenge this universality of affect in cross-cultural facial expressions. After first outlining some of the present-day political stakes of these questions, I turn to Sylvia Wynter on the "ethnoclass of Man" in Western modernity, where she asks: how were concepts of not only being, truth, power, and freedom but also affect—the intelligibility of one's feelings toward others—framed by histories of colonial violence and (...) refusals of imaginative identification?2 Wynter argues that the overrepresentation of the Western ethnoclass results in the naturalization of a limited and contingent mode of being as... (shrink)

This paper presents an analytical framework for analyzing how multimodal resources of emotion expression are semiotically materialized in discursive interactions specific to political discourse. Interested in how political personae are emotionally constructed through multimodal meaning-making practices, our analysis model assumes an interdisciplinary perspective, which integrates facial expression analysis – using FaceReader™ software –, the theory of emotional arcs and bodily actions (hand gestures) analysis that express emotions, in the analytical framework of multimodality. The results show how the (...) multimodal choices that political actors make during discursive interactions allow them to build their political brand and make connections with the audience on an emotional level. (shrink)

An analysis of the identity issues involved in facial allograft transplantation is provided in this paper. The identity issues involved in organ transplantation in general, under both theoretical accounts of personal identity and subjective accounts provided by organ recipients, are examined. It is argued that the identity issues involved in facial allograft transplantation are similar to those involved in organ transplantation in general, but much stronger because the face is so closely linked with personal identity. Recipients of (...) class='Hi'>facial allograft transplantation have the potential to feel that their identity is a mix between their own and the donor’s, and the donor’s family is potentially likely to feel that their loved one ‘‘lives on’’. It is also argued that facial allograft transplantation allows the recipients to regain an identity, because they can now be seen in the social world. Moreover, they may regain expressivity, allowing for them to be seen even more by others, and to regain an identity to an even greater extent. Informing both recipients and donors about the role that identity plays in facial allograft transplantation could enhance the consent process for facial allograft transplantation and donation. (shrink)

Expression is the central concept in Wittgenstein’s philosophy of mind, and our experiences are reflected in our bodily expressions or gestures, facial expressions, behaviors and linguistic expressions. It seems true that we have no access of other people’s experiences but we can know or talk about them in so far as they are the common experiences of all. This inaccessibility of other’s experiences may create a genuine thinking that one’s experiences are private and the first person present tense (...) psychological utterances are not descriptive at all. They are understood solely as expressive and expression is the outer concept of a mental phenomenon. In this paper, an attempt will be made on the basis of Wittgenstein’s critique of the relationship between the concepts of experience and expression we shall argue that certain uses of the dichotomy between the inner and the outer are mistakes. According to Wittgenstein, the inner is not a set of experiences which are or are not expressed by our immediate (primitive) expressions or linguistic expressions rather it is the capacity of the subject to express himself genuinely. (shrink)

In this study, we extracted facial action units (AUs) data during a Hearthstone tournament to investigate behavioural differences between expert, intermediate, and novice players. Our aim was to obtain insights into the nature of expertise and how it may be tracked using non-invasive methods such as AUs. These insights may shed light on the endogenous responses in the player and at the same time may provide information to the opponents during a competition. Our results show that player expertise may (...) be characterised by specific patterns in facial expressions. More specifically, AU17 (chin raiser), AU25 (lips apart), and AU26 (jaws drop) intensity responses during gameplay may vary according to players' expertise. Such results were obtained by training a random forest classifier to test whether we can use these three AUs alone to accurately detect players' expertise. The classifier reached 0.75 accuracy on 5-fold cross-validation, after balancing the class weights, and 0.85 after having applied the Synthetic Minority Over-sampling Technique (SMOTE) function. These results suggest that AUs can be effectively used to discriminate different levels of expertise in competitive video game players. (shrink)

Is it not surprising that we look with so much pleasure and emotion at works of art that were made thousands of years ago? Works depicting people we do not know, people whose backgrounds are usually a mystery to us, who lived in a very different society and time and who, moreover, have been ‘frozen’ by the artist in a very deliberate pose. It was the Classical Greek philosopher Aristotle who observed in his Poetics that people could apparently be moved (...) even by the imitation of a person or an act. And although we are usually well aware that it is a simulacrum, not a real situation, it nevertheless sometimes seems as if we ourselves are standing there on the stage or in the painting, so intense and emotional is our response, even though we are just spectators. Aristotle concludes from this that we have intellectual capacities which allow us put ourselves in another’s place and consequently to react to simulated situations as though they are actually happening to us, here and now. In this process, he contends, observation, memory, imagination and emotions are crucial elements. In the past it was not customary to invoke human mental faculties to explain our response to works of art. The Ancient Greeks, after all, knew little about the human body or brain and usually referred to the extended world of the gods in their endeavours to comprehend the ‘inner world’ of human beings. In our time the situation is completely different—such an allusion to the brain no longer surprises us. Whether it is about the mystery of the consciousness, the question of free will or accounts of bizarre psychological aberrations or disorders, we have become accustomed to references to parts of the brain, to images of brain scans, to reports about neural networks and the like. However, because there are so many factors that play a part in our appreciation of works of art we need a complex explanation for it, and it is not enough to look only at certain properties of the brain that are determined by evolution. Those properties are shared by every human being, and so are rather useless in explaining people’s different reactions to the same work of art. Evidently the brains of individuals differ so much that they make it possible for people to respond differently to one and the same artwork. This, of course, raises questions concerning the painted emotions that can be seen in this exhibition. Virtually everyone, after all, is fascinated by such paintings and usually recognizes the emotions they represent. The reactions to these painted emotions are also often similar. This is probably why artworks like this are generally highly valued, then and now, here and elsewhere: from the enigmatically smiling Egyptian Queen Nefertiti and the startled Rembrandt to a seemingly despairing African mask. Aristotle observed that in the theatre players imitate actions that are associated with emotions in a number of ways and that these emotions are shared in a particular fashion by the playwright, the actors and the audience. The audience may even be carried away by these emotions to such an extent that they are in a sense purged of them and can subsequently leave the theatre relieved. Are such emotional reactions perhaps related to the fact that emotions are universal and that brains respond similarly to them? Is this why we can so readily identify painted emotions? May we therefore also assume that the properties of the brain determined by evolution help us to explain these emotions? In answering these questions we shall discuss a number of insights into emotions in psychology and brain science and explore some theories about the possible function of emotions and their expression. (shrink)

A well-documented “beauty is good” stereotype is expressed in the expectation that physically attractive people have more positive characteristics. Recent evidence has also found that unattractive faces are associated with negative character inferences. Is what is good (bad) also beautiful (ugly)? Whether this conflation of aesthetic and moral values is bidirectional is not known. This study tested the hypothesis that complementary “good is beautiful” and “bad is ugly” stereotypes bias aesthetic judgments. Using highly controlled face stimuli, this preregistered study examined (...) whether moral character influences perceptions of attractiveness for different ages and sexes of faces. Compared to faces paired with nonmoral vignettes, those paired with prosocial vignettes were rated significantly more attractive, confident, and friendlier. The opposite pattern characterized faces paired with antisocial vignettes. A significant interaction between vignette type and the age of the face was detected for attractiveness. Moral transgressions affected attractiveness more negatively for younger than older faces. Sex-related differences were not detected. These results suggest information about moral character affects our judgments about facial attractiveness. Better (worse) people are considered more (less) attractive. These findings suggest that beliefs about moral goodness and physical beauty influence each other bidirectionally. (shrink)

Twenty-five years ago, my colleagues Miyuki Kamachi and Jiro Gyoba and I designed and photographed JAFFE, a set of facial expression images intended for use in a study of face perception. In 2019, without seeking permission or informing us, Kate Crawford and Trevor Paglen exhibited JAFFE in two widely publicized art shows. In addition, they published a nonfactual account of the images in the essay “Excavating AI: The Politics of Images in Machine Learning Training Sets.” The present article (...) recounts the creation of the JAFFE dataset and unravels each of Crawford and Paglen’s fallacious statements. I also discuss JAFFE more broadly in connection with research on facial expression, affective computing, and human-computer interaction. (shrink)

In this paper I argue that the detection of emotional expressions is, in its early stages, informationally encapsulated. I clarify and defend such a view via the appeal to data from social perception on the visual processing of faces, bodies, facial and bodily expressions. Encapsulated social perception might exist alongside processes that are cognitively penetrated, and that have to do with recognition and categorization, and play a central evolutionary function in preparing early and rapid responses to the emotional stimuli.

Social cognition researchers have become increasingly interested in the ways that behavioral, physiological, and neural coupling facilitate social interaction and interpersonal understanding. We distinguish two ways of conceptualizing the role of such coupling processes in social cognition: strong and moderate interactionism. According to strong interactionism (SI), low-level coupling processes are alternatives to higher-level individual cognitive processes; the former at least sometimes render the latter superfluous. Moderate interactionism (MI) on the other hand, is an integrative approach. Its guiding assumption is that (...) higher-level cognitive processes are likely to have been shaped by the need to coordinate, modulate, and extract information from low-level coupling processes. In this paper, we present a case study on Möbius Syndrome (MS) in order to contrast SI and MI. We show how MS—a form of congenital bilateral facial paralysis—can be a fruitful source of insight for research exploring the relation between high-level cognition and low-level coupling. Lacking a capacity for facial expression, individuals with MS are deprived of a primary channel for gestural coupling. According to SI, they lack an essential enabling feature for social interaction and interpersonal understanding more generally and thus ought to exhibit severe deficits in these areas. We challenge SI’s prediction and show how MS cases offer compelling reasons for instead adopting MI’s pluralistic model of social interaction and interpersonal understanding. We conclude that investigations of coupling processes within social interaction should inform rather than marginalize or eliminate investigation of higher-level individual cognition. (shrink)

This article discusses experimental studies of facial imitation in infants in the light of Sartre's and Merleau-Ponty's phenomenological theories of embodiment. I argue that both Sartre's account of the gaze of the other and Merleau-Ponty's account of the reversibility of the flesh provide a fertile ground for interpreting the data demonstrating that very young infants can imitate facial expressions of adults. Sartre's and Merleau-Ponty's accounts of embodiment offer, in my view, a desirable alternative to the dominant mentalistic interpretation (...) of facial imitation in terms of the theory of mind. (shrink)

Basic Emotion Theory, or BET, has dominated the affective sciences for decades (Ekman, 1972, 1992, 1999; Ekman and Davidson, 1994; Griffiths, 2013; Scarantino and Griffiths, 2011). It has been highly influential, driving a number of empirical lines of research (e.g., in the context of facial expression detection, neuroimaging studies and evolutionary psychology). Nevertheless, BET has been criticized by philosophers, leading to calls for it to be jettisoned entirely (Colombetti, 2014; Hufendiek, 2016). This paper defuses those criticisms. In addition, (...) it shows that we have good reason to retain BET. Finally, it reviews and puts to rest worries that BET’s commitment to affect programs renders it outmoded. We propose that, with minor adjustments, BET can avoid such criticisms when conceived under a radically enactive account of emotions. Thus, rather than leaving BET behind, we show how its basic ideas can be revised, refashioned and preserved. Hence, we conclude, our new BET is still a good bet. (shrink)

For many years emotion theory has been characterized by a dichotomy between the head and the body. In the golden years of cognitivism, during the nineteen-sixties and seventies, emotion theory focused on the cognitive antecedents of emotion, the so-called “appraisal processes.” Bodily events were seen largely as byproducts of cognition, and as too unspecific to contribute to the variety of emotion experience. Cognition was conceptualized as an abstract, intellectual, “heady” process separate from bodily events. Although current emotion theory has moved (...) beyond this disembodied stance by conceiving of emotions as involving both cognitive processes (perception, attention, and evaluation) and bodily events (arousal, behavior, and facial expressions), the legacy of cognitivism persists in the tendency to treat cognitive and bodily events as separate constituents of emotion. Thus the cognitive aspects of emotion are supposedly distinct and separate from the bodily ones. This separation indicates that cognitivism’s disembodied conception of cognition continues to shape the way emotion theorists conceptualize emotion. (shrink)

Mindreading is the ability to attribute mental states to other individuals. According to the Theory-Theory (TT), mindreading is based on one's possession of a Theory of Mind. On the other hand, the Simulation Theory (ST) maintains that one arrives at the attribution of a mental state by simulating it in one's own mind. In this paper, I propose a ST-TT hybrid model of the ability to attribute disgust on the basis of visual stimuli such as facial expressions, body postures, (...) etc. More precisely, while I defend Goldman's (2006) thesis that the ability to attribute disgust based on observing disgusted facial expressions stems from a mirror-based simulation process, I argue that ST is unable to account for the ability to attribute disgust based on non-facial visual stimuli; I propose, rather, that this latter ability is theory-based. My model is grounded in evidence from individuals suffering from Huntington's Disease. (shrink)

Interactive social cognition theory and approaches of developmental psychology widely agree that central aspects of emotional and social experience arise in the unfolding of processes of embodied social interaction. Bi-directional dynamical couplings of bodily displays such as facial expressions, gestures, and vocalizations have repeatedly been described in terms of coordination, synchrony, mimesis, or attunement. In this paper, I propose conceptualizing such dynamics rather as processes of affective resonance. Starting from the immediate phenomenal experience of being immersed in interaction, I (...) develop the philosophical notion of affective resonance to refer to a dynamic entanglement of moving and being-moved in relation. The concept of affective resonance makes visible that the interaction dynamic itself creates an affective experience rather than transmitting internal feeling states between pre-existent individuals. This leads to a philosophical framework in which relationality and ontogeny are primary over separate individuals, and in which the naturalistic distinction of a fundamental physical level versus an emerging level of social processes has to be given up. (shrink)

I consider the developmental origins of the socially extended mind. First, I argue that, from birth, the physical interventions caregivers use to regulate infant attention and emotion (gestures, facial expressions, direction of gaze, body orientation, patterns of touch and vocalization, etc.) are part of the infant’s socially extended mind; they are external mechanisms that enable the infant to do things she could not otherwise do, cognitively speaking. Second, I argue that these physical interventions encode the norms, values, and patterned (...) practices distinctive of their specific sociocultural milieu. Accordingly, not only do they enhance and extend the infant’s cognitive competence. They also entrain the infant to think and act in culturally appropriate ways. These physical interventions are thus arguably the earliest examples of social practices that scaffold the infant’s cognitive development and shape the development of their cultural education. (shrink)

Emotion detection and management have emerged as pivotal areas in humancomputer interaction, offering potential applications in healthcare, entertainment, and customer service. This study explores the use of deep learning (DL) models to enhance emotion recognition accuracy and enable effective emotion regulation mechanisms. By leveraging large datasets of facial expressions, voice tones, and physiological signals, we train deep neural networks to recognize a wide array of emotions with high precision. The proposed system integrates emotion recognition with adaptive management strategies that (...) provide personalized feedback and interventions based on detected emotional states. Our approach surpasses traditional machine learning methods, demonstrating superior performance in real-time applications. We also explore the ethical implications and challenges associated with deploying such systems, particularly regarding privacy concerns and the potential for misuse. Through extensive experiments, our model achieved an average accuracy rate of 92%, highlighting its robustness across different environments and user demographics. This research not only contributes to the growing field of affective computing but also lays the groundwork for future developments in emotionally intelligent systems. (shrink)

Emotion detection and management have emerged as pivotal areas in humancomputer interaction, offering potential applications in healthcare, entertainment, and customer service. This study explores the use of deep learning (DL) models to enhance emotion recognition accuracy and enable effective emotion regulation mechanisms. By leveraging large datasets of facial expressions, voice tones, and physiological signals, we train deep neural networks to recognize a wide array of emotions with high precision. The proposed system integrates emotion recognition with adaptive management strategies that (...) provide personalized feedback and interventions based on detected emotional states. Our approach surpasses traditional machine learning methods, demonstrating superior performance in real-time applications. (shrink)

In the exploratory study reported here, we tested the efficacy of an intervention designed to train teenagers with Möbius syndrome (MS) to increase the use of alternative communication strategies (e.g., gestures) to compensate for their lack of facial expressivity. Specifically, we expected the intervention to increase the level of rapport experienced in social interactions by our participants. In addition, we aimed to identify the mechanisms responsible for any such increase in rapport. In the study, five teenagers with MS interacted (...) with three naïve participants without MS before the intervention, and with three different naïve participants without MS after the intervention. Rapport was assessed by self-report and by behavioral coders who rated videos of the interactions. Individual non-verbal behavior was assessed via behavioral coders, whereas verbal behavior was automatically extracted from the sound files. Alignment was assessed using cross recurrence quantification analysis and mixed-effects models. The results showed that observer-coded rapport was greater after the intervention, whereas self-reported rapport did not change significantly. Observer-coded gesture and expressivity increased in participants with and without MS, whereas overall linguistic alignment decreased. Fidgeting and repetitiveness of verbal behavior also decreased in both groups. In sum, the intervention may impact non-verbal and verbal behavior in participants with and without MS, increasing rapport as well as overall gesturing, while decreasing alignment. (shrink)

A simple definition of consciousness is sensory awareness of the body, the self, and the world. The fetus may be aware of the body, for example by perceiving pain. It reacts to touch, smell, and sound, and shows facial expressions responding to exter- nal stimuli. However, these reactions are probably preprogrammed and have a subcortical nonconscious origin. Furthermore, the fetus is almost continuously asleep and unconscious partially due to endog- enous sedation. Conversely, the newborn infant can be awake, exhibit (...) sensory awareness, and process memorized mental representations. It is also able to differentiate between self and nonself touch, express emotions, and show signs of shared feelings. Yet, it is unreflective, present oriented, and makes little reference to concept of him/herself. Newborn infants display features characteristic of what may be referred to as basic consciousness and they still have to undergo considerable maturation to reach the level of adult consciousness. The preterm infant, ex utero, may open its eyes and establish minimal eye contact with its mother. It also shows avoidance reactions to harmful stimuli. However, the thalamocortical connections are not yet fully established, which is why it can only reach a minimal level of consciousness. (shrink)

Starting from the assumption that one can literally perceive someone's anger in their face, I argue that this would not be possible if what is perceived is a static facial signature of their anger. There is a product–process distinction in talk of facial expression, and I argue that one can see anger in someone's facial expression only if this is understood to be a process rather than a product.

This article focuses on situations and emotional perception. To this end, I start with the Kuleshov effect wherein identical shots of performers manifest different expressions when cut to different contexts. However, I conducted experiments with a twist, using Darth Vader and non-primates, and even here expressions varied with contexts. Building on historically and conceptually linked Gibsonian, Gestalt, phenomenological and pragmatic schools, along with consonant experimental work, I extrapolate these results to defend three interconnected points. First, I argue that while perceiving (...) expression is sometimes about reading minds, it is more squarely about perceiving solicitations or closures for action. Second, I frame expressions as a subcategory of Gibson’s affordances. This includes those showing up through context, in turn suggesting Kuleshov-like scenarios are not mere perceptual tricks. Third, I maintain that situations—with or without other human beings—have action-motivating expressive qualities or what Gestalt theorists called physiognomic characters, following Werner. These likewise emerge through ecological relations, and are very much like affordances and in the world as much as them. With resemblance theories, my account agrees that we perceive expression in the world. However, it indicates a broad range of cases in which expression shows up as consequences of overall situations that solicit or close actions, as opposed to mere resemblance between entities and human expressions. (shrink)

I argue that emojis are essentially little pictures, rather than words, gestures, expressives, or diagrams. ???? means that the world looks like that, from some viewpoint. I flesh out a pictorial semantics in terms of geometric projection with abstraction and stylization. Since such a semantics delivers only very minimal contents I add an account of pragmatic enrichment, driven by coherence and nonliteral interpretation. The apparent semantic distinction between emojis depicting entities (like ????) and those depicting facial expressions (like ????) (...) I analyze as a difference between truth-conditional and use-conditional pictorial content: ???? depicts what the world of evaluation looks like, while ???? depicts what the utterance context looks like. (shrink)

Though there are many challenges to Ekman’s thesis that there are basic emotions with universal corresponding facial expressions, our main criticism revolves around the extent to which grounding situations alter how people read faces. To that end, we recruit testifying experimental studies that show identical faces expressing varying emotions when contextualized differently. Rather than dismissing these as illusions, we start with the position—generally favored by embodied thinkers—that situations are primary: they are where specifiable and hence knowable properties first show (...) up. We further argue that situationally inflected emotional expressions are informationally meaningful. We reject the idea that reading expressions is primarily about ascertaining internal mental states, arguing instead that people are registering overall situations when looking at faces. However, if mind is understood as a situated phenomenon that extends into active ecological frames, then one can still argue that mindreading is going on. Although we do not claim isolated things like cliffs or cars have agency, we speculate networked systems with cliffs, people, cars, bears, etc., collectively function with intentionality, more so if advancing a robust situated mind thesis, contra figures like Dennett who argue that people over-impute mind to things. Our position has practical implications insofar as it casts doubts on recent attempts to develop AI systems that extract emotional intent out of facial expressions since many of these systems are grounded on Ekman’s basic view. (shrink)

I argue that when we use email, text messaging, or social media websites such as Facebook to interact, rather than communicating face-to-face, we do not experience the best kind of empathy, which is most conducive to experiencing benevolence for others. My arguments rely on drawing interdisciplinary connections between sources: early modern accounts of sympathy, dance theory, philosophy of technology, and neuroscience/psychology. I reflect on theories from these disciplines which, taken together, suggest that to empathize optimally, we must see or hear (...) each other’s bodily gestures, vocal intonations, and facial expressions. (shrink)

Two art exhibitions, “Training Humans” and “Making Faces,” and the accompanying essay “Excavating AI: The politics of images in machine learning training sets” by Kate Crawford and Trevor Paglen, are making substantial impact on discourse taking place in the social and mass media networks, and some scholarly circles. Critical scrutiny reveals, however, a self-contradictory stance regarding informed consent for the use of facial images, as well as serious flaws in their critique of ML training sets. Our analysis underlines the (...) non-negotiability of informed consent when using human data in artistic and other contexts, and clarifies issues relating to the description of ML training sets. (shrink)

We can share experiences with a person online, but the experiences seem thin when compared with face-to-face experiences. Online adventures (social networking, gaming) can certainly strengthen friendship bonds that were forged in more embodied interactions, but can they create those bonds? The kind of presence required for deep friendship does not seem cultivated in many online interactions. Presence in friendship requires “being with” and “doing for” (sacrifice). The forms of “being with” and “doing for” on social networking sites (or even (...) in interactive gaming) seem trivial because the stakes are very low. More important, the “shared space” of digital life is disembodied space. We cannot really touch one another, smell one another, detect facial expressions or moods, and so on. Real bonding is more biological than psychological and requires physical contact. The emotional entanglement of real friendship produces oxytocin and endorphins in the brains and bodies of friends — cementing them together in ways that are more profound than other relationships. -/- It is possible that virtual reality and augmented reality technology will soon be able to generate such friendship-forming experiences. Having embodied adventures with another person — even in a V.R. suit — is more likely to trigger the deeper oxytocin-based bonding. Current social networking, however, seems to privilege the shallow triggers of the brain’s reward system (dopamine squirts in the ventral tegumental area). (shrink)

Emotion detection and management have emerged as pivotal areas in humancomputer interaction, offering potential applications in healthcare, entertainment, and customer service. This study explores the use of deep learning (DL) models to enhance emotion recognition accuracy and enable effective emotion regulation mechanisms. By leveraging large datasets of facial expressions, voice tones, and physiological signals, we train deep neural networks to recognize a wide array of emotions with high precision. The proposed system integrates emotion recognition with adaptive management strategies that (...) provide personalized feedback and interventions based on detected emotional states. Our approach surpasses traditional machine learning methods, demonstrating superior performance in real-time applications. (shrink)

I aim to develop an alternative theoretical model for the direct cognition of the elementary states of others called the theory of interaction (henceforth TI), also known as the “second person” approach. The model I propose emerges from a critical reformulation of the displaced perception model proposed by FRED DRETSKE (1995) for the introspective knowledge of our own mental states. Moreover, against Dretske, I argue that no meta-representation (second-order representation of a first-order representation as a representation) is involved in the (...) process, but only concepts, rudimentary enough, of others’ emotions: contentment and discontentment. Strictly speaking, all the empirical data and findings in developmental psychology only support the hypothesis that children in the pre-linguistic phase understand perceptual facial expressions of contentment and discontentment. My proposal consists of the following thesis: The direct perception of others' elementary mental states is not a perception in the usual sense of the word according to which we just perceive things, but rather a “perception of facts.” But how to understand that? It is nothing more than an epistemological process that is automatic and reliable at the same time. It is reliable in the epistemological-externalist sense of not involving any inference, reflection, theorizing or epistemic justification: a baby’s perception of her mom’s facial expression of discontentment (in the usual sense of “per- ception”) does not constitute a reason supporting the belief that mommy is discontent. The very word “belief” should not be understood in the usual sense but rather in the sense of a natural inclination for truth. But at the same time, it is automatic because the belief is a result or output of a process entirely subliminal and computational in nature. Thus, for instance, a child perceives that her mom is discontent (fact-awareness) by perceiving consciously (“perception” in the usual sense) a facial expression of discontentment (sensorial input) but recognizes that her mother is discontent as a result (output) of an entirely subliminal process. (shrink)

Happiness, like other basic emotions, has visual properties that create the conditions for happiness to be perceived in others. This is to say that happiness is perceivable. Its visual properties are to be identified with those facial expressions that are characteristic of happiness. Yet saying that something is perceivable does not suffice for us to conclude that it is perceived. We therefore need to show that happiness is perceived. Empirical evidence suggests that the visual system functions to perceive happiness (...) as well as other basic emotions. Experiences that can be had simply by virtue of how the perceptual system functions are known as observations. I will thus argue that visual experiences in which we become aware of others’ happiness are observations. This approach will provide the necessary conceptual framework to show that we have perceptual knowledge of others’ happiness. (shrink)

American Sign Language, or ASL as its acronym is commonly known, is a fascinating language, and many people outside of the Deaf community have begun to recognize its value and purpose. It is a visual language consisting of coordinated hand gestures, body movements, and facial expressions. Sign language is not a universal language; it varies by country and is heavily influenced by the native language and culture. The American Sign Language alphabet and the British Sign Language alphabet are completely (...) contrary. Fingerspelling is one-handed in ASL and two-handed in BSL, with the exception of the letter C. AI technologies, particularly deep learning, can play an important role in breaking down communication barriers between deaf or hearing-impaired people and other communities, significantly contributing to their social inclusion. Recent advances in sensing technologies and AI algorithms have paved the way for the development of a wide range of applications aimed at meeting the needs of the deaf and hearing-impaired communities. To that end, the purpose of this paper is By attempting to translate sign language using artificial intelligence algorithms, we focused in this paper on a transfer learning technique based on deep learning using a ResNet algorithm and compared it to previous papers in which we used VGG19[1]and mobileNet [2], where we get in the ResNet algorithm on the degree of Accuracy 93,48% e number of images (43500 in the dataset in size 64*64 pixel ) and the data split training data into training dataset (70%) and validation dataset(15%) and testing dataset(15%) and 20 epoch. (shrink)

Cellular, or mobile phones are great: they allow people to communicate over long distances whenever and wherever they are, and instantaneously at that when the one called is wearing one too. Having said that, though, it must immediately be added that they, also, have a complex disadvantage, and it is one we are hard pushed to understand. In fact, due to its complexity people simply tend to neglect it, even though everyone in his right mind has had experience with it. (...) Now Walter Benjamin defined aura as “a distance however close it may be”.1) This has standardly been interpreted as a characterisation of an experience of presence, also by Benjamin. This aura supposedly suffered from the rise of photography. Aura can, also, be understood as inertia, the absence of something present. And whether aura is gone or widespread I gladly leave to more speculative-minded thinkers. I submit that we experience a person’s “aura”—her distance however close she may be—when perception tells us the person is present yet our mind realises that she isn’t. I am referring here to the observation had of another person engaged in a cell phone conversation. The inertia of the cell phone caller consists in her incapacity to address those who observe her. I think there is an immoral streak to her selfappointed moral autonomy. In a previous edition of this Dutch-Russian exchange on inertia I argued that our trafficking with facial expressions forms the model with which we’d best understand the workings of art—facial expression is the anthropological foundation of art. My discussion, today, of the cell phone conversation is meant to add to that previous suggestion. (shrink)

In this chapter, I will present an empirical conjecture to the effect that some bodily actions are categorically perceived. These are bodily actions such as grasping or reaching for something, which I am going to call motor actions. My conjecture builds on one recently put forward about how the categorical perception of facial expressions of some emotions works. I shall motivate my own conjecture on the basis of both theoretical and empirical considerations, describe how it could be operationalised and (...) what explanatory gain could be obtained from it. (shrink)

Interaction between drivers and pedestrians is often facilitated by informal communicative cues, like hand gestures, facial expressions, and eye contact. In the near future, however, when semi- and fully autonomous vehicles are introduced into the traffic system, drivers will gradually assume the role of mere passengers, who are casually engaged in non-driving-related activities and, therefore, unavailable to participate in traffic interaction. In this novel traffic environment, advanced communication interfaces will need to be developed that inform pedestrians of the current (...) state and future behavior of an autonomous vehicle, in order to maximize safety and efficiency for all road users. The aim of the present review is to provide a comprehensive account of empirical work in the field of external human–machine interfaces for autonomous vehicle-to- pedestrian communication. In the great majority of covered studies, participants clearly benefited from the presence of a communication interface when interacting with an autonomous vehicle. Nevertheless, standardized interface evaluation procedures and optimal interface specifications are still lacking. (shrink)

In our everyday interactions we easily and effortlessly perceive emotions in others’ facial expressions and bodily behavior. How do we do that? Philosophers and psychologists have long argued about the fundamentals of emotion perception and the debate is far from settled. While some insist on the sufficiency of the morphological information contained in facial expressions, others construe the objects of emotion perception as more complex, comprising multimodal information such as touch, tone of voice, body postures, and so on. (...) Others, in turn, have gone so far as to deny that there is a pre-given object in emotion perception in the first place, so that processes of emotion perception must be conceptualized as emergent and co-constructed phenomena in contexts of social interaction. The purpose of this paper is to argue that John Dewey’s pragmatist theory of emotions can help us make significant theoretical advancements in the understanding of emotion perception, according to which emotions are coordinated modes of behavior that we enact with others in the contexts of social interactions. In this picture, perceiving emotions is a matter of participating in a joint activity of socio- affective coordination. This theory allows us to apprehend important insights about emotion perception that appear in these contemporary debates, while at the same time avoiding their pitfalls. (shrink)

Emotion recognition systems (ERS) offer the ability to identify the emotions of others, based on an analysis of their facial expressions and regardless of culture, ethnicity, context, gender or social class. By claiming universalism in the expression as well as in the recognition of emotions, we believe that ERS present significant risks of causing great harm to some individuals, in addition to targeting, in some contexts, specific social groups. Drawing on a wide range of multidisciplinary knowledge - including (...) philosophy, psychology, computer science and anthropology - this research project aims to identify the current limitations of ERS and the main risks that their use brings, with the goal of providing a clear and robust analysis of the use of ERS and their contribution to greater social justice. Pointing to technical limitations, we refute, on the one hand, the idea that ERS are able to prove the causal link between specific emotions and specific facial expressions. We support our argument with evidence of the inability of ERS to distinguish facial expressions of emotions from facial expressions as communication signals. On the other hand, due to the contextual and cultural limitations of current ERS, we refute the idea that ERS are able to recognise, with equal performance, the emotions of individuals, regardless of their culture, ethnicity, gender and social class. Our ethical analysis shows that the risks are considerably more numerous and important than the benefits that could be derived from using ERS. However, we have separated out a specific type of ERS, whose use is limited to the field of care, and which shows a remarkable potential to actively participate in social justice, not only by complying with the minimum requirements, but also by meeting the criterion of beneficence. While ERS currently pose significant risks, it is possible to consider the potential for specific types to participate in social justice and provide emotional and psychological support and assistance to certain members of society. (shrink)

Melancholy is a central expressive property of the Before films and key to understanding and appreciating the trilogy as a whole. That, in a nutshell, is the thesis I develop in this paper. In the first section, I present a philosophical account of melancholy in general and aesthetic melancholy in particular. Melancholy is understood here as the profound and bittersweet emotional experience that occurs when we vividly grasp a harsh truth about human existence in such a way that we come (...) to appreciate certain aspects of life more deeply. The second section of the paper focuses on the many intense as well as more subtle moments of melancholy in the various encounters between Celine and Jesse. These moments, I argue, are partly prompted by the environment and the circumstances in which they find themselves. But both of them also actively seek out and create such moments by the stories they tell and the reflections they engage in. That seems part of who they are as individuals and, I contend, it may be part of what attracts them to each other. In the third section, I address ‘film expression’, as opposed to ‘character expression’, and argue that melancholy is not just present in the characters’ dialogue and in their facial and bodily expressions but is also expressed through various cinematic means. The final section centres on the audience and the reception of the Before trilogy. I introduce the distinction between expression and expressiveness and suggest that the films may have resonated deeply with some viewers because they are so expressive of melancholy. (shrink)

De todos os aspectos do comportamento não-verbal, a face é sem dúvida uma das mais ricas e importantes fontes de informação sobre o estado inter- no do outro. Mas expressões faciais são raramente percebidas de forma isolada. Ao contrário, são tipicamente inseridas em contextos sociais ricos e dinâmicos, que incluem gestos e posturas corporais, conhecimento situacional, etc. Com base nessas observações, podemos nos perguntar se o contexto no qual uma expressão é percebida pode influenciar a percepção de emoções nesta expressão. (...) No caso de uma resposta afirmativa, de que modo se daria essa influência contextual, e quais seriam os seus limites? O propósito desse artigo é explorar algumas possibilidades sobre o papel do contexto na percepção de emoções, desde a teoria das emoções básicas, que defende que categorias discretas de emoções podem ser lidas diretamente da face de forma invariável, a abordagens mais contemporâneas, que atribuem um papel constitutivo para o contexto na percepção de emoções. Embora o debate esteja longe de ser resolvido, as conclusões deste artigo apontam para um novo modo de se pensar sobre fenômenos emocionais, onde a díade de interação torna-se a unidade básica de análise, e onde emoções são concebidas como propriedades emergentes de relações em contextos particulares de interação social. (shrink)

What do we see when we look at someone's expression of fear? I argue that one of the things that we see is fear itself. I support this view by developing a theory of affect perception. The theory involves two claims. One is that expressions are patterns of facial changes that carry information about affects. The other is that the visual system extracts and processes such information. In particular, I argue that the visual system functions to detect the (...) affects of others when they are expressed in the face. I develop my theory by drawing on empirical data from psychology and brain science. Finally, I outline a theory of the semantics of affect perception. (shrink)

This publication articulated in three parts, and twelve chapters endeavours to engage with the complex negative emotions and consequent phenomenon of self-deceit, radicalisation and extremism. First part: Emotions as Lines of Demarcation or Guidelines to Our Self. The Psychodynamic Surrounding of our Intentional Self; second part: Case Studies of Some Concrete Societal Encapsulations of the Negative Passions; and third part: Resisting the Colonisation of Tyrannical Affections. Possible Paths of Mitigating Radicalisation and Extremism. What kind of educational responses can be given (...) to extremist claims of territory, identity, resources, power, and interpretations? How can a dialogue on unifying ethical principles and values aid in developing common grounds for preventing radical and extremist excesses? With authors from three continents, this publication endeavours to not only ask the uncomfortable questions with regard to the exteriorisation of human emotive predispositions and inclinations to ostracize, stigmatise and discriminate. The exit door from the extreme is also clearly presented, through four contributions, notably the interplay of Charvaka philosophy, Sikh wisdom on balanced forms of engagement with strong emotions. (shrink)

Reflections on Trevor Paglen's (ab)use of the JAFFE dataset.

The extended mind thesis (EM) asserts that some cognitive processes are (partially) composed of actions consisting of the manipulation and exploitation of environmental structures. Might some processes at the root of social cognition have a similarly extended structure? In this paper, I argue that social cognition is fundamentally an interactive form of space management—the negotiation and management of ‘‘we-space”—and that some of the expressive actions involved in the negotiation and management of we-space (gesture, touch, facial and whole-body expressions) drive (...) basic processes of interpersonal understanding and thus do genuine social-cognitive work. Social interaction is a kind of extended social cognition, driven and at least partially constituted by environmental (non-neural) scaffolding. Challenging the Theory of Mind paradigm, I draw upon research from gesture studies, developmental psychology, and work on Moebius Syndrome to support this thesis. (shrink)

I draw upon the conceptual resources of the extended mind thesis to analyze empathy and interpersonal understanding. Against the dominant mentalistic paradigm, I argue that empathy is fundamentally an extended bodily activity and that much of our social understanding happens outside of the head. First, I look at how the two dominant models of interpersonal understanding, theory theory and simulation theory, portray the cognitive link between folk psychology and empathy. Next, I challenge their internalist orthodoxy and offer an alternative "extended" (...) characterization of empathy. In support of this characterization, I analyze some narratives of individuals with Moebius syndrome, a kind of expressive deficit resulting from bilateral facial paralysis. I conclude by discussing how a Zen Buddhist ethics of responsiveness is helpful for articulating the practical significance of an extended, body-based account of empathy. (shrink)

The paper is about H. Odera Oruka's Sage Philosophy project. Oruka interviewed rural sages of Kenya, saying that like Socrates, these wise elders had been philosophizing without writing anything down. Paulin Hountondji (at the time) criticized efforts of oral philosophizing, saying that Africa needed a written tradition of philosophizing. Some philosophers were representatives of an "individualist" position which says that philosophical ideas must be attributed to specific named individuals. Kwame Gyekye instead argued that anonymous community wisdom of Africans had indeed (...) been created by individuals, but individual names were not important to Africans at the time they created the wisdom. The paper then argues that hearing a certain bit of wise philosophy coming from a particular person in an interpersonal oral communication at a certain time and in a certain context can impress an idea upon this listener, commanding their attention in a way that a written text does not, due to the importance of presence in interpersonal communication. Respect for the speaker, and the way in which the speaker uses voice inflection and facial and bodily expressions while communicating all play a role in the message's reception. The paper does not argue that written philosophy or oral philosophy are superior to each other in all ways; rather, each has a strength that the other does not have. (shrink)

The SIMS model claims that it is by means of an embodied simulation that we determine the meaning of an observed smile. This suggests that crucial interpretative work is done in the mapping that takes us from a perceived smile to the activation of one's own facial musculature. How is this mapping achieved? Might it depend upon a prior interpretation arrived at on the basis of perceptual and contextual information?