Social cognition researchers have become increasingly interested in the ways that behavioral, physiological, and neural coupling facilitate social interaction and interpersonal understanding. We distinguish two ways of conceptualizing the role of such coupling processes in social cognition: strong and moderate interactionism. According to strong interactionism (SI), low-level coupling processes are alternatives to higher-level individual cognitive processes; the former at least sometimes render the latter superfluous. Moderate interactionism (MI) on the other hand, is an integrative approach. Its guiding assumption is that (...) higher-level cognitive processes are likely to have been shaped by the need to coordinate, modulate, and extract information from low-level coupling processes. In this paper, we present a case study on Möbius Syndrome (MS) in order to contrast SI and MI. We show how MS—a form of congenital bilateral facial paralysis—can be a fruitful source of insight for research exploring the relation between high-level cognition and low-level coupling. Lacking a capacity for facial expression, individuals with MS are deprived of a primary channel for gestural coupling. According to SI, they lack an essential enabling feature for social interaction and interpersonal understanding more generally and thus ought to exhibit severe deficits in these areas. We challenge SI’s prediction and show how MS cases offer compelling reasons for instead adopting MI’s pluralistic model of social interaction and interpersonal understanding. We conclude that investigations of coupling processes within social interaction should inform rather than marginalize or eliminate investigation of higher-level individual cognition. (shrink)

An analysis of the identity issues involved in facial allograft transplantation is provided in this paper. The identity issues involved in organ transplantation in general, under both theoretical accounts of personal identity and subjective accounts provided by organ recipients, are examined. It is argued that the identity issues involved in facial allograft transplantation are similar to those involved in organ transplantation in general, but much stronger because the face is so closely linked with personal identity. Recipients of (...) class='Hi'>facial allograft transplantation have the potential to feel that their identity is a mix between their own and the donor’s, and the donor’s family is potentially likely to feel that their loved one ‘‘lives on’’. It is also argued that facial allograft transplantation allows the recipients to regain an identity, because they can now be seen in the social world. Moreover, they may regain expressivity, allowing for them to be seen even more by others, and to regain an identity to an even greater extent. Informing both recipients and donors about the role that identity plays in facial allograft transplantation could enhance the consent process for facial allograft transplantation and donation. (shrink)

Background: This study tested the core tenets of how facial scars are perceived by characterizing layperson response to faces with scars. The authors predicted that scars closer to highly viewed structures of the face (i.e., upper lip and lower lid), scars aligned against resting facial tension lines, and scars in the middle of anatomical subunits of the face would be rated less favorably. Methods: -/- Volunteers aged 18 years and older from the United States were recruited through Amazon’s (...) Mechanical Turk to complete a face rating survey. Scars were digitally added in different locations and orientations for a total of 14 unique scars added to each face. Each participant rated 50 different faces on confidence, friendliness, and attractiveness. Data were analyzed using linear mixed effects models. Results: -/- A total of 88,850 ratings [82,990 scarred (93.4 percent)] for attractiveness, friendliness, and confidence were analyzed. In univariate linear mixed effects models, the presence of a facial scar did not significantly impact attractiveness (β = 0.016, SE = 0.014, z = 1.089, p = 0.276). A second set of linear mixed effects models identified interactions between location, subunit placement, and orientation to facial tension lines. Scars located on the lower lid mid subunit perpendicular to facial tension lines were rated less attractive (β = −0.065, SE = 0.028, z = −2.293, p = 0.022). Conclusions: -/- On average, a single well-healed facial scar does not negatively affect first impressions of attractiveness, confidence, or friendliness. Specific scar location and orientation combinations, however, such as a perpendicular scar at the mid-lower eyelid, may result in lower perceived attractiveness, confidence, and friendliness. (shrink)

Background: Facial proportionality and symmetry are positively associated with perceived levels of facial attractiveness. -/- Objective: The aims of this study were to confirm and extend the association of proportionality with perceived levels of attractiveness and character traits and determine differences in attractiveness and character ratings between "anomalous" and "typical" faces using a large dataset. -/- Methods: Ratings of 597 unique individuals from the Chicago Face Database were used. A formula was developed as a proxy of relative horizontal (...) proportionality, where a proportionality score of "0" indicated perfect proportionality and more negative scores indicated less proportionality. Faces were categorized as "anomalous" or "typical" by 2 independent reviewers based on physical features. -/- Results: Across the ratings for all faces, Spearman correlations revealed greater proportionality was associated with attractiveness ( ρ = 0.292, P < 0.001) and trustworthiness ( ρ = 0.193, P < 0.001), while lesser proportionality was associated with impressions of anger (ρ = 0.132, P = 0.001), dominance (ρ = 0.259, P < 0.001), and threateningness ( ρ = 0.234, P < 0.001). Mann-Whitney U tests revealed the typical cohort had significantly higher levels of proportionality (-13.98 versus -15.14, P = 0.030) and ratings of attractiveness (3.39 versus 2.99, P < 0.001) and trustworthiness (3.48 versus 3.35, P < 0.001). -/- Conclusions: This study demonstrated that facial proportionality is not only significantly associated with higher ratings of attractiveness, but also associated with judgements of trustworthiness. Proportionality plays a role in evoking negative attributions of personality characteristics to people with facial anomalies. (shrink)

In their recent paper Bi-facial truth: a case for generalized truth values Zaitsev and Shramko [7] distinguish between an ontological and an epistemic interpretation of classical truth values. By taking the Cartesian product of the two disjoint sets of values thus obtained, they arrive at four generalized truth values and consider two “semi-classical negations” on them. The resulting semantics is used to define three novel logics which are closely related to Belnap’s well-known four valued logic. A syntactic characterization of (...) these logics is left for further work. In this paper, based on our previous work on a functionally complete extension of Belnap’s logic, we present a sound and complete tableau calculus for these logics. It crucially exploits the Cartesian nature of the four values, which is reflected in the fact that each proof consists of two tableaux. The bi-facial notion of truth of Z&S is thus augmented with a bi-facial notion of proof. We also provide translations between the logics for semi-classical negation and classical logic and show that an argument is valid in a logic for semi-classical negation just in case its translation is valid in classical logic. (shrink)

The “scarred villain” trope, where facial differences like scars signify moral corruption, is ubiquitous in film (e.g., Batman’s The Joker). Strides by advocacy groups to undermine the trope, however, suggest cinematic representations of facial differences could be improving with time. This preregistered study characterized facial differences in film across cultures (US vs. India) and time (US: 1980-2019, India: 2000-2019). Top-grossing films by country and decade were screened for characters with facial differences. We found that the scarred (...) villain trope has actually worsened with time, although in tandem with progress in also representing non-villainous characters with facial anomalies. Country of origin did not predict the presence of facial differences in villains or heroes. “Action” and “fantasy” movies were the most likely genres to depict villains with facial differences. Finally, villains’ facial differences crossed more facial subunits and were more likely to involve lips, chin, and mandible than when present in heroes. Our findings underscore the need for critical reflection on the role of cultural practices—even when seemingly innocuous—in shaping and maintaining negative biases against already stigmatized groups. (shrink)

Recent work in social robotics, which is aimed both at creating an artificial intelligence and providing a test-bed for psychological theories of human social development, involves building robots that can learn from ‘face-to-face’ interaction with human beings — as human infants do. The building-blocks of this interaction include the robot’s ‘expressive’ behaviours, for example, facial-expression and head-and-neck gesture. There is here an ideal opportunity to apply Wittgensteinian conceptual analysis to current theoretical and empirical work in the sciences. Wittgenstein’s philosophical (...) psychology is sympathetic to embodied and situated Artificial Intelligence (see Proudfoot, 2002, 2004b), and his discussion of facial-expression is remarkably modern. In this chapter, I explore his approach to facial-expression, using smiling as a representative example, and apply it to the canonical interactive face robot, Cynthia Breazeal’s Kismet (see e.g. Breazeal, 2009, 2002). I assess the claim that Kismet has expressive behaviours, with the aim of generating philosophical insights for AI. (shrink)

This article examines how facial recognition technology reshapes the philosophical debate over the ethics of video surveillance. When video surveillance is augmented with facial recognition, the data collected is no longer anonymous, and the data can be aggregated to produce detailed psychological profiles. I argue that – as this non-anonymous data of people’s mundane activities is collected – unjust risks of harm are imposed upon individuals. In addition, this technology can be used to catalogue all who publicly participate (...) in political, religious, and socially stigmatised activities, and I argue that this would undermine central interests of liberal democracies. I examine the degree to which the interests of individuals and the societal interests of liberal democracies to maintain people’s obscurity while in public coincide with privacy interests, as popularly understood, and conclude that there is a practical need to articulate a novel right to obscurity to protect the interests of liberal democratic societies. (shrink)

For more than two decades, police in the United States have used facial recognition to surveil civilians. Local police departments deploy facial recognition technology to identify protestors’ faces while federal law enforcement agencies quietly amass driver’s license and social media photos to build databases containing billions of faces. Yet, despite the widespread use of facial recognition in law enforcement, there are neither federal laws governing the deployment of this technology nor regulations settings standards with respect to its (...) development. To make matters worse, the Fourth Amendment—intended to limit police power and enacted to protect against unreasonable searches—has struggled to rein in new surveillance technologies since its inception. -/- This Article examines the Supreme Court’s Fourth Amendment jurisprudence leading up to Carpenter v. United States and suggests that the Court is reinterpreting the amendment for the digital age. Still, the too-slow expansion of privacy protections raises challenging questions about racial bias, the legitimacy of police power, and ethical issues in artificial intelligence design. This Article proposes the development of an algorithmic auditing and accountability market that not only sets standards for AI development and limitations on governmental use of facial recognition but encourages collaboration between public interest technologists and regulators. Beyond the necessary changes to the technological and legal landscape, the current system of policing must also be reevaluated if hard-won civil liberties are to endure. (shrink)

We assess the state of thinking about gender identities in computer vision through an analysis of how research papers in gender and facial recognition are designed, what claims they make about trans and non-binary people, what values they espouse, and what they describe as ongoing challenges for the field. In our corpus of 50 research papers, the seven papers that consider trans and non-binary identities use questionable assumptions about medicalization as a measure of transness, about gender transition as a (...) linear and bounded process, and about the concept of gender deception. Otherwise, non-normative gender identities are absent and their consideration is in fact hindered by prevailing research values, particularly deeply embedded ones such as performance and accuracy. We point out how the use of shared datasets calcifies binary conceptions of gender. In the way that the field of computer vision conceives of ongoing challenges for its research, it does not yet face questions that trans and non-binary user experiences pose and often falls back on biologically essentialist notions of sex classification. We make two recommendations: that computer vision researchers undertake interdisciplinary work with researchers who study gender as a socio-cultural phenomenon, and that journal editors and conference organizers do the same in peer review and conference acceptance processes. (shrink)

Background: Facial attractiveness influences our perceptions of others, with beautiful faces reaping societal rewards and anomalous faces encountering penalties. The purpose of this study was to determine associations of visual attention with bias and social dispositions toward people with facial anomalies. -/- Methods: Sixty subjects completed tests evaluating implicit bias, explicit bias, and social dispositions before viewing publicly available images of preoperative and postoperative patients with hemifacial microsomia. Eye-tracking was used to register visual fixations. -/- Results: Participants with (...) higher implicit bias scores fixated significantly less on the cheek and ear region preoperatively (P = 0.004). Participants with higher scores in empathic concern and perspective taking fixated more on the forehead and orbit preoperatively (P = 0.045) and nose and lips (P = 0.027) preoperativel. -/- Conclusions: Participants with higher levels of implicit bias spent less visual attention on anomalous facial anatomy, whereas participants with higher levels of empathic concern and perspective taking spent more visual attention on normal facial anatomy. Levels of bias and social dispositions such as empathy may predict layperson gaze patterns toward those with facial anomalies and provide insights to neural mechanisms underlying the "anomalous is bad" paradigm. (shrink)

How does aging affect facial attractiveness? We tested the hypothesis that people find older faces less attractive than younger faces, and furthermore, that these aging effects are modulated by the age and sex of the perceiver and by the specific kind of attractiveness judgment being made. Using empirical and computational network science methods, we confirmed that with increasing age, faces are perceived as less attractive. This effect was less pronounced in judgments made by older than younger and middle-aged perceivers, (...) and more pronounced by men (especially for female faces) than women. Attractive older faces were perceived as elegant more than beautiful or gorgeous. Furthermore, network analyses revealed that older faces were more similar in attractiveness and were segregated from younger faces. These results indicate that perceivers tend to process older faces categorically when making attractiveness judgments. Attractiveness is not a monolithic construct. It varies by age, sex, and the dimensions of attractiveness being judged. (shrink)

In this paper, we assess the possibility of a critical knowledge of technology. In the case of facial recognition systems, 'FRS', we argue that behaviorism underlies this technology, and analyze the debate about behaviorism to show the lack of consensus about its theoretical foundations. In particular we analyze the structure of knowledge generated by FRS as affected by a technological behaviorism. Our last point is a suggestion to use the concept of dasiacritical knowledgepsila, which we borrow from Ladriere, to (...) question and challenge the technological finalities and the foundational scientific theory underlying FRS. (shrink)

Methodological problems often arise when a special case is confused with the general principle. So you will find affordances only for ‚artifacts’ if you restrict the analysis to ‚artifacts’. The general principle, however, is an ‚invitation character’, which triggers an action. Consequently, an action-theoretical approach known as ‚pragmatic turn’ in cognitive science is recommended. According to this approach, the human being is not a passive-receptive being but actively produces those action effects that open up the world to us. This ‚ideomotor (...) approach’ focuses on the so-called ‚epistemic actions’, which guide our perception as conscious and unconscious cognitions. Due to ‚embodied cognition’ the own body is assigned an indispensable role. The action theoretical approach of ‚enactive cognition’ enables that every form can be consistently processualized. Thus, each ‚Gestalt’ is understood as the process result of interlocking cognitions of ‚forward modelling’ and ‚inverse modelling’. As can be shown, these cognitions are fed by previous experiences of real interaction, which later changes into a mental trial treatment, which is highly automated and can therefore take place unconsciously. It is now central that every object may have such affordances that call for instrumental or epistemic action. In the simplest case, it is the body and the facial expressions of our counterpart that can be understood as a question and provoke an answer/reaction. Thus, emotion is not only to be understood as expression/output according to the scheme ‚input-processing-output’, but acts itself as a provocative act/input. Consequently, artifacts are neither necessary nor sufficient conditions for affordances. Rather, they exist in all areas of cognition—from Enactive Cognition to Social Cognition. (shrink)

Investigators increasingly need high quality face photographs that they can use in service of their scholarly pursuits—whether serving as experimental stimuli or to benchmark face recognition algorithms. Up to now, an index of known face databases, their features, and how to access them has not been available. This absence has had at least two negative repercussions: First, without alternatives, some researchers may have used face databases that are widely known but not optimal for their research. Second, a reliance on databases (...) comprised only of young white faces will lead to science that isn't representative of all the people whose tax contributions, in many cases, make that research possible. The “Face Image Meta-Database” (fIMDb) provides researchers with the tools to find the face images best suited to their research, with filters to locate databases with people of a varied racial and ethnic backgrounds and ages. Problems of representation in face databases are not restricted to race and ethnicity or age – there is a dearth of databases with faces that have visible differences (e.g., scars, port wine stains, and cleft lip and palate). A well-characterized database is needed to support programmatic research into perceivers' attitudes, behaviors, and neural responses to anomalous faces. The “ChatLab Facial Anomaly Database” (CFAD) was constructed to fill this gap, with photographs of faces with visible differences of various types, etiologies, sizes, locations, and that depict individuals from various ethnic backgrounds and age groups. Both the fIMDb and CFAD are available from cliffordworkman[dot]com/resources/. (shrink)

This review aims to identify (1) sources of knowledge and (2) important themes of the ethical debate related to surgical alteration of facial features in East Asians. This article integrates narrative and systematic review methods. In March 2014, we searched databases including PubMed, Philosopher’s Index, Web of Science, Sociological Abstracts, and Communication Abstracts using key terms “cosmetic surgery,” “ethnic*,” “ethics,” “Asia*,” and “Western*.” The study included all types of papers written in English that discuss the debate on rhinoplasty and (...) blepharoplasty in East Asians. No limit was put on date of publication. Combining both narrative and systematic review methods, a total of 31 articles were critically appraised on their contribution to ethical reflection founded on the debates regarding the surgical alteration of Asian features. Sources of knowledge were drawn from four main disciplines, including the humanities, medicine or surgery, communications, and economics. Focusing on cosmetic surgery perceived as a westernising practice, the key debate themes included authenticity of identity, interpersonal relationships and socio-economic utility in the context of Asian culture. The study shows how cosmetic surgery of ethnic features plays an important role in understanding female identity in the Asian context. Based on the debate themes authenticity of identity, interpersonal relationships, and socio-economic utility, this article argues that identity should be understood as less individualistic and more as relational and transformational in the Asian context. In addition, this article also proposes to consider cosmetic surgery of Asian features as an interplay of cultural imperialism and cultural nationalism, which can both be a source of social pressure to modify one’s appearance. (shrink)

Facial Expression conveys non-verbal cues, which plays an important role in interpersonal relations. The Cognitive Emotion AI system is the process of identifying the emotional state of a person. The main aim of our study is to develop a robust system which can detect as well as recognize human emotion from live feed. There are some emotions which are universal to all human beings like angry, sad, happy, surprise, fear, disgust and neutral. The methodology of this system is based (...) on two stages- facial detection is done by extraction of Haar Cascade features of a face using Viola Jones algorithm and then the emotion is verified and recognized using Artificial Intelligence Techniques. The system will take image or frame as an input and by providing the image to the model the model will perform the preprocessing and feature selection after that it will be predict the emotional state. (shrink)

A well-documented “beauty is good” stereotype is expressed in the expectation that physically attractive people have more positive characteristics. Recent evidence has also found that unattractive faces are associated with negative character inferences. Is what is good (bad) also beautiful (ugly)? Whether this conflation of aesthetic and moral values is bidirectional is not known. This study tested the hypothesis that complementary “good is beautiful” and “bad is ugly” stereotypes bias aesthetic judgments. Using highly controlled face stimuli, this preregistered study examined (...) whether moral character influences perceptions of attractiveness for different ages and sexes of faces. Compared to faces paired with nonmoral vignettes, those paired with prosocial vignettes were rated significantly more attractive, confident, and friendlier. The opposite pattern characterized faces paired with antisocial vignettes. A significant interaction between vignette type and the age of the face was detected for attractiveness. Moral transgressions affected attractiveness more negatively for younger than older faces. Sex-related differences were not detected. These results suggest information about moral character affects our judgments about facial attractiveness. Better (worse) people are considered more (less) attractive. These findings suggest that beliefs about moral goodness and physical beauty influence each other bidirectionally. (shrink)

In this study, we extracted facial action units (AUs) data during a Hearthstone tournament to investigate behavioural differences between expert, intermediate, and novice players. Our aim was to obtain insights into the nature of expertise and how it may be tracked using non-invasive methods such as AUs. These insights may shed light on the endogenous responses in the player and at the same time may provide information to the opponents during a competition. Our results show that player expertise may (...) be characterised by specific patterns in facial expressions. More specifically, AU17 (chin raiser), AU25 (lips apart), and AU26 (jaws drop) intensity responses during gameplay may vary according to players' expertise. Such results were obtained by training a random forest classifier to test whether we can use these three AUs alone to accurately detect players' expertise. The classifier reached 0.75 accuracy on 5-fold cross-validation, after balancing the class weights, and 0.85 after having applied the Synthetic Minority Over-sampling Technique (SMOTE) function. These results suggest that AUs can be effectively used to discriminate different levels of expertise in competitive video game players. (shrink)

This pre-registered study (osf[dot]io/b9g6v) tested the hypothesis that implicit biases towards people with visible facial differences, like scars and palsies, can be reduced through routine exposure to faces bearing such anomalous features. Participants’ implicit biases were measured before and after they completed one of two exposure interventions—to people with facial anomalies, or to people of color (POC). The interventions were delivered remotely using a custom mobile phone application and consisted of two sessions per day over 5 consecutive days. (...) Each session began with exposure to 10 face photographs (anomalous or POC) followed by another person’s face (anomalous or POC) presented alongside a moral exemplar story ostensibly about them. After receiving the anomalous faces intervention, implicit biases against anomalous faces were significantly reduced but implicit biases against POC were not affected. The POC intervention did not have a targeted effect on bias against people of color, instead reducing biases against both people with visible differences and POC. Reductions in implicit biases were positively associated with perspective taking ratings made during the intervention. These findings suggest that exposure to people with facial anomalies, especially exposure that elicits perspective taking, can reduce implicit biases towards them in a targeted fashion. (shrink)

In this paper, we report on an experiment with The Walking Dead (TWD), which is a narrative-driven adventure game with morally charged decisions set in a post-apocalyptic world filled with zombies. This study aimed to identify physiological markers of moral decisions and non-moral decisions using infrared thermal imaging (ITI). ITI is a non-invasive tool used to capture thermal variations due to blood flow in specific body regions that might be caused by sympathetic activity. Results show that moral decisions seem to (...) elicit a significant decrease in temperature in the chin region 20 seconds after participants are presented with a moral decision. However, given the small sample involved, and the lack of significance in other regions, future studies might be needed to confirm the results obtained in this work. (shrink)

This paper presents an analytical framework for analyzing how multimodal resources of emotion expression are semiotically materialized in discursive interactions specific to political discourse. Interested in how political personae are emotionally constructed through multimodal meaning-making practices, our analysis model assumes an interdisciplinary perspective, which integrates facial expression analysis – using FaceReader™ software –, the theory of emotional arcs and bodily actions (hand gestures) analysis that express emotions, in the analytical framework of multimodality. The results show how the multimodal choices (...) that political actors make during discursive interactions allow them to build their political brand and make connections with the audience on an emotional level. (shrink)

Twenty-five years ago, my colleagues Miyuki Kamachi and Jiro Gyoba and I designed and photographed JAFFE, a set of facial expression images intended for use in a study of face perception. In 2019, without seeking permission or informing us, Kate Crawford and Trevor Paglen exhibited JAFFE in two widely publicized art shows. In addition, they published a nonfactual account of the images in the essay “Excavating AI: The Politics of Images in Machine Learning Training Sets.” The present article recounts (...) the creation of the JAFFE dataset and unravels each of Crawford and Paglen’s fallacious statements. I also discuss JAFFE more broadly in connection with research on facial expression, affective computing, and human-computer interaction. (shrink)

There are many psychic mechanisms by which people engage with their selves. We argue that an important yet hitherto neglected one is self-appraisal via meta-emotions. We discuss the intentional structure of meta-emotions and explore the phenomenology of a variety of examples. We then present a pilot study providing preliminary evidence that some facial displays may indicate the presence of meta-emotions. We conclude by arguing that meta-emotions have an important role to play in higher-order theories of psychic harmony.

In this article, I link Lisa Feldman Barrett's theory of constructed emotion1 to decolonial perspectives that also challenge this universality of affect in cross-cultural facial expressions. After first outlining some of the present-day political stakes of these questions, I turn to Sylvia Wynter on the "ethnoclass of Man" in Western modernity, where she asks: how were concepts of not only being, truth, power, and freedom but also affect—the intelligibility of one's feelings toward others—framed by histories of colonial violence and (...) refusals of imaginative identification?2 Wynter argues that the overrepresentation of the Western ethnoclass results in the naturalization of a limited and contingent mode of being as... (shrink)

This article discusses experimental studies of facial imitation in infants in the light of Sartre's and Merleau-Ponty's phenomenological theories of embodiment. I argue that both Sartre's account of the gaze of the other and Merleau-Ponty's account of the reversibility of the flesh provide a fertile ground for interpreting the data demonstrating that very young infants can imitate facial expressions of adults. Sartre's and Merleau-Ponty's accounts of embodiment offer, in my view, a desirable alternative to the dominant mentalistic interpretation (...) of facial imitation in terms of the theory of mind. (shrink)

The transformational pace of modern education, healthcare, business management systems, etc., requires new approaches for prompt and reliable personality assessment. Phenotypology is one of such theories and it claims of the discovered interconnections of a person’s psychological and psychophysical characteristics on the basis of individual features of his/her phenotype. The article aim is to present some validation results for the Phenotypology hypotheses as a possible tool for personality assessment. In order to verify connections between phenotypic treats and individual behavior, we (...) conducted the study when respondents were differentiated according to some anthropometric (facial) peculiarities and characterological features. The results were quantified and analyzed using the mathematical-statistical linear regression. The research output contains the rationale for the conclusion that there are no statistically significant correlations between some phenotypic body features and such individual psychological characteristics as aggressiveness, impetuosity, pedantry, passivity, etc. In particular, the validity of using of appropriate phenotypologic representations to predict the examined character traits was studied. The obtained results disproved the possibility to use directly the phenotypic approach for reliable characterological profiling. Though, the study outcome is tentative due to some limitations on generality. It is necessary to continue verification of the Phenotypology hypotheses with a broader experimental sample with the inclusion of various ethnic and racial groups’ representatives. However, until then, based on actual findings, the practical application of the Phenotypology statements is doubtful, at least for the purposes of character diagnosis and personality assessment. (shrink)

A model of face representation, inspired by the biology of the visual system, is compared to experimental data on the perception of facial similarity. The face representation model uses aggregate primary visual cortex (V1) cell responses topographically linked to a grid covering the face, allowing comparison of shape and texture at corresponding points in two facial images. When a set of relatively similar faces was used as stimuli, this Linked Aggregate Code (LAC) predicted human performance in similarity judgment (...) experiments. When faces of perceivable categories were used, dimensions such as apparent sex and race emerged from the LAC model without training. The dimensional structure of the LAC similarity measure for the mixed category task displayed some psychologically plausible features but also highlighted differences between the model and the human similarity judgements. The human judgements exhibited a racial perceptual bias that was not shared by the LAC model. The results suggest that the LAC based similarity measure may offer a fertile starting point for further modelling studies of face representation in higher visual areas, including studies of the development of biases in face perception. (shrink)

Two art exhibitions, “Training Humans” and “Making Faces,” and the accompanying essay “Excavating AI: The politics of images in machine learning training sets” by Kate Crawford and Trevor Paglen, are making substantial impact on discourse taking place in the social and mass media networks, and some scholarly circles. Critical scrutiny reveals, however, a self-contradictory stance regarding informed consent for the use of facial images, as well as serious flaws in their critique of ML training sets. Our analysis underlines the (...) non-negotiability of informed consent when using human data in artistic and other contexts, and clarifies issues relating to the description of ML training sets. (shrink)

The extended mind thesis (EM) asserts that some cognitive processes are (partially) composed of actions consisting of the manipulation and exploitation of environmental structures. Might some processes at the root of social cognition have a similarly extended structure? In this paper, I argue that social cognition is fundamentally an interactive form of space management—the negotiation and management of ‘‘we-space”—and that some of the expressive actions involved in the negotiation and management of we-space (gesture, touch, facial and whole-body expressions) drive (...) basic processes of interpersonal understanding and thus do genuine social-cognitive work. Social interaction is a kind of extended social cognition, driven and at least partially constituted by environmental (non-neural) scaffolding. Challenging the Theory of Mind paradigm, I draw upon research from gesture studies, developmental psychology, and work on Moebius Syndrome to support this thesis. (shrink)

Mindreading is the ability to attribute mental states to other individuals. According to the Theory-Theory (TT), mindreading is based on one's possession of a Theory of Mind. On the other hand, the Simulation Theory (ST) maintains that one arrives at the attribution of a mental state by simulating it in one's own mind. In this paper, I propose a ST-TT hybrid model of the ability to attribute disgust on the basis of visual stimuli such as facial expressions, body postures, (...) etc. More precisely, while I defend Goldman's (2006) thesis that the ability to attribute disgust based on observing disgusted facial expressions stems from a mirror-based simulation process, I argue that ST is unable to account for the ability to attribute disgust based on non-facial visual stimuli; I propose, rather, that this latter ability is theory-based. My model is grounded in evidence from individuals suffering from Huntington's Disease. (shrink)

For many years emotion theory has been characterized by a dichotomy between the head and the body. In the golden years of cognitivism, during the nineteen-sixties and seventies, emotion theory focused on the cognitive antecedents of emotion, the so-called “appraisal processes.” Bodily events were seen largely as byproducts of cognition, and as too unspecific to contribute to the variety of emotion experience. Cognition was conceptualized as an abstract, intellectual, “heady” process separate from bodily events. Although current emotion theory has moved (...) beyond this disembodied stance by conceiving of emotions as involving both cognitive processes (perception, attention, and evaluation) and bodily events (arousal, behavior, and facial expressions), the legacy of cognitivism persists in the tendency to treat cognitive and bodily events as separate constituents of emotion. Thus the cognitive aspects of emotion are supposedly distinct and separate from the bodily ones. This separation indicates that cognitivism’s disembodied conception of cognition continues to shape the way emotion theorists conceptualize emotion. (shrink)

Basic Emotion Theory, or BET, has dominated the affective sciences for decades (Ekman, 1972, 1992, 1999; Ekman and Davidson, 1994; Griffiths, 2013; Scarantino and Griffiths, 2011). It has been highly influential, driving a number of empirical lines of research (e.g., in the context of facial expression detection, neuroimaging studies and evolutionary psychology). Nevertheless, BET has been criticized by philosophers, leading to calls for it to be jettisoned entirely (Colombetti, 2014; Hufendiek, 2016). This paper defuses those criticisms. In addition, it (...) shows that we have good reason to retain BET. Finally, it reviews and puts to rest worries that BET’s commitment to affect programs renders it outmoded. We propose that, with minor adjustments, BET can avoid such criticisms when conceived under a radically enactive account of emotions. Thus, rather than leaving BET behind, we show how its basic ideas can be revised, refashioned and preserved. Hence, we conclude, our new BET is still a good bet. (shrink)

In this paper I argue that the detection of emotional expressions is, in its early stages, informationally encapsulated. I clarify and defend such a view via the appeal to data from social perception on the visual processing of faces, bodies, facial and bodily expressions. Encapsulated social perception might exist alongside processes that are cognitively penetrated, and that have to do with recognition and categorization, and play a central evolutionary function in preparing early and rapid responses to the emotional stimuli.

Starting from the assumption that one can literally perceive someone's anger in their face, I argue that this would not be possible if what is perceived is a static facial signature of their anger. There is a product–process distinction in talk of facial expression, and I argue that one can see anger in someone's facial expression only if this is understood to be a process rather than a product.

I draw upon the conceptual resources of the extended mind thesis to analyze empathy and interpersonal understanding. Against the dominant mentalistic paradigm, I argue that empathy is fundamentally an extended bodily activity and that much of our social understanding happens outside of the head. First, I look at how the two dominant models of interpersonal understanding, theory theory and simulation theory, portray the cognitive link between folk psychology and empathy. Next, I challenge their internalist orthodoxy and offer an alternative "extended" (...) characterization of empathy. In support of this characterization, I analyze some narratives of individuals with Moebius syndrome, a kind of expressive deficit resulting from bilateral facial paralysis. I conclude by discussing how a Zen Buddhist ethics of responsiveness is helpful for articulating the practical significance of an extended, body-based account of empathy. (shrink)

I consider the developmental origins of the socially extended mind. First, I argue that, from birth, the physical interventions caregivers use to regulate infant attention and emotion (gestures, facial expressions, direction of gaze, body orientation, patterns of touch and vocalization, etc.) are part of the infant’s socially extended mind; they are external mechanisms that enable the infant to do things she could not otherwise do, cognitively speaking. Second, I argue that these physical interventions encode the norms, values, and patterned (...) practices distinctive of their specific sociocultural milieu. Accordingly, not only do they enhance and extend the infant’s cognitive competence. They also entrain the infant to think and act in culturally appropriate ways. These physical interventions are thus arguably the earliest examples of social practices that scaffold the infant’s cognitive development and shape the development of their cultural education. (shrink)

Though there are many challenges to Ekman’s thesis that there are basic emotions with universal corresponding facial expressions, our main criticism revolves around the extent to which grounding situations alter how people read faces. To that end, we recruit testifying experimental studies that show identical faces expressing varying emotions when contextualized differently. Rather than dismissing these as illusions, we start with the position—generally favored by embodied thinkers—that situations are primary: they are where specifiable and hence knowable properties first show (...) up. We further argue that situationally inflected emotional expressions are informationally meaningful. We reject the idea that reading expressions is primarily about ascertaining internal mental states, arguing instead that people are registering overall situations when looking at faces. However, if mind is understood as a situated phenomenon that extends into active ecological frames, then one can still argue that mindreading is going on. Although we do not claim isolated things like cliffs or cars have agency, we speculate networked systems with cliffs, people, cars, bears, etc., collectively function with intentionality, more so if advancing a robust situated mind thesis, contra figures like Dennett who argue that people over-impute mind to things. Our position has practical implications insofar as it casts doubts on recent attempts to develop AI systems that extract emotional intent out of facial expressions since many of these systems are grounded on Ekman’s basic view. (shrink)

The paper is about H. Odera Oruka's Sage Philosophy project. Oruka interviewed rural sages of Kenya, saying that like Socrates, these wise elders had been philosophizing without writing anything down. Paulin Hountondji (at the time) criticized efforts of oral philosophizing, saying that Africa needed a written tradition of philosophizing. Some philosophers were representatives of an "individualist" position which says that philosophical ideas must be attributed to specific named individuals. Kwame Gyekye instead argued that anonymous community wisdom of Africans had indeed (...) been created by individuals, but individual names were not important to Africans at the time they created the wisdom. The paper then argues that hearing a certain bit of wise philosophy coming from a particular person in an interpersonal oral communication at a certain time and in a certain context can impress an idea upon this listener, commanding their attention in a way that a written text does not, due to the importance of presence in interpersonal communication. Respect for the speaker, and the way in which the speaker uses voice inflection and facial and bodily expressions while communicating all play a role in the message's reception. The paper does not argue that written philosophy or oral philosophy are superior to each other in all ways; rather, each has a strength that the other does not have. (shrink)

Interactive social cognition theory and approaches of developmental psychology widely agree that central aspects of emotional and social experience arise in the unfolding of processes of embodied social interaction. Bi-directional dynamical couplings of bodily displays such as facial expressions, gestures, and vocalizations have repeatedly been described in terms of coordination, synchrony, mimesis, or attunement. In this paper, I propose conceptualizing such dynamics rather as processes of affective resonance. Starting from the immediate phenomenal experience of being immersed in interaction, I (...) develop the philosophical notion of affective resonance to refer to a dynamic entanglement of moving and being-moved in relation. The concept of affective resonance makes visible that the interaction dynamic itself creates an affective experience rather than transmitting internal feeling states between pre-existent individuals. This leads to a philosophical framework in which relationality and ontogeny are primary over separate individuals, and in which the naturalistic distinction of a fundamental physical level versus an emerging level of social processes has to be given up. (shrink)

In the exploratory study reported here, we tested the efficacy of an intervention designed to train teenagers with Möbius syndrome (MS) to increase the use of alternative communication strategies (e.g., gestures) to compensate for their lack of facial expressivity. Specifically, we expected the intervention to increase the level of rapport experienced in social interactions by our participants. In addition, we aimed to identify the mechanisms responsible for any such increase in rapport. In the study, five teenagers with MS interacted (...) with three naïve participants without MS before the intervention, and with three different naïve participants without MS after the intervention. Rapport was assessed by self-report and by behavioral coders who rated videos of the interactions. Individual non-verbal behavior was assessed via behavioral coders, whereas verbal behavior was automatically extracted from the sound files. Alignment was assessed using cross recurrence quantification analysis and mixed-effects models. The results showed that observer-coded rapport was greater after the intervention, whereas self-reported rapport did not change significantly. Observer-coded gesture and expressivity increased in participants with and without MS, whereas overall linguistic alignment decreased. Fidgeting and repetitiveness of verbal behavior also decreased in both groups. In sum, the intervention may impact non-verbal and verbal behavior in participants with and without MS, increasing rapport as well as overall gesturing, while decreasing alignment. (shrink)

A simple definition of consciousness is sensory awareness of the body, the self, and the world. The fetus may be aware of the body, for example by perceiving pain. It reacts to touch, smell, and sound, and shows facial expressions responding to exter- nal stimuli. However, these reactions are probably preprogrammed and have a subcortical nonconscious origin. Furthermore, the fetus is almost continuously asleep and unconscious partially due to endog- enous sedation. Conversely, the newborn infant can be awake, exhibit (...) sensory awareness, and process memorized mental representations. It is also able to differentiate between self and nonself touch, express emotions, and show signs of shared feelings. Yet, it is unreflective, present oriented, and makes little reference to concept of him/herself. Newborn infants display features characteristic of what may be referred to as basic consciousness and they still have to undergo considerable maturation to reach the level of adult consciousness. The preterm infant, ex utero, may open its eyes and establish minimal eye contact with its mother. It also shows avoidance reactions to harmful stimuli. However, the thalamocortical connections are not yet fully established, which is why it can only reach a minimal level of consciousness. (shrink)

Emotion detection and management have emerged as pivotal areas in humancomputer interaction, offering potential applications in healthcare, entertainment, and customer service. This study explores the use of deep learning (DL) models to enhance emotion recognition accuracy and enable effective emotion regulation mechanisms. By leveraging large datasets of facial expressions, voice tones, and physiological signals, we train deep neural networks to recognize a wide array of emotions with high precision. The proposed system integrates emotion recognition with adaptive management strategies that (...) provide personalized feedback and interventions based on detected emotional states. Our approach surpasses traditional machine learning methods, demonstrating superior performance in real-time applications. We also explore the ethical implications and challenges associated with deploying such systems, particularly regarding privacy concerns and the potential for misuse. Through extensive experiments, our model achieved an average accuracy rate of 92%, highlighting its robustness across different environments and user demographics. This research not only contributes to the growing field of affective computing but also lays the groundwork for future developments in emotionally intelligent systems. (shrink)

I argue that emojis are essentially little pictures, rather than words, gestures, expressives, or diagrams. ???? means that the world looks like that, from some viewpoint. I flesh out a pictorial semantics in terms of geometric projection with abstraction and stylization. Since such a semantics delivers only very minimal contents I add an account of pragmatic enrichment, driven by coherence and nonliteral interpretation. The apparent semantic distinction between emojis depicting entities (like ????) and those depicting facial expressions (like ????) (...) I analyze as a difference between truth-conditional and use-conditional pictorial content: ???? depicts what the world of evaluation looks like, while ???? depicts what the utterance context looks like. (shrink)

Emotion detection and management have emerged as pivotal areas in humancomputer interaction, offering potential applications in healthcare, entertainment, and customer service. This study explores the use of deep learning (DL) models to enhance emotion recognition accuracy and enable effective emotion regulation mechanisms. By leveraging large datasets of facial expressions, voice tones, and physiological signals, we train deep neural networks to recognize a wide array of emotions with high precision. The proposed system integrates emotion recognition with adaptive management strategies that (...) provide personalized feedback and interventions based on detected emotional states. Our approach surpasses traditional machine learning methods, demonstrating superior performance in real-time applications. (shrink)

Cheating is a growing academic and ethical concern in higher education. This article examines the rise of artificial intelligence (AI) generative chatbots for use in education and provides a review of research literature and relevant scholarship concerning the cheating-related issues involved and their implications for pedagogy. The technological “arms race” that involves cheating-detection system developers versus technology savvy students is attracting increased attention to cheating. AI has added new dimensions to academic cheating challenges as students (as well as faculty and (...) staff) can easily access powerful systems for generating content that can be presented in assignments, exams, or published papers as their own. AI methodology is also providing some emerging anti-cheating approaches, including facial recognition and water- marking. This article provides an overview of human/AI collaboration approaches and frames some educational misuses of such AI generative systems as ChatGPT and Bard as forms of “misattributed co-authorship.” As with other kinds of collaborations, the work that students produce with AI assistance can be presented in transparent and straightforward modes or (unfortunately) in opaquer and ethically-problematic ways. However, rather than just for catching or entrapping students, the emerging varieties of technological cheating-detection strategies can be used to assist students in learning how to document and attribute properly their AI-empowered as well as human-human collaborations. Construing misuses of AI generative systems as misattributed co-authorship can recognize the growing capabilities of these tools and how stressing responsible and mindful usage by students can help prepare them for a highly collaborative, AI-saturated future. (shrink)

What do we see when we look at someone's expression of fear? I argue that one of the things that we see is fear itself. I support this view by developing a theory of affect perception. The theory involves two claims. One is that expressions are patterns of facial changes that carry information about affects. The other is that the visual system extracts and processes such information. In particular, I argue that the visual system functions to detect the affects (...) of others when they are expressed in the face. I develop my theory by drawing on empirical data from psychology and brain science. Finally, I outline a theory of the semantics of affect perception. (shrink)

Are people with flawed faces regarded as having flawed moral characters? An “anomalous-is-bad” stereotype is hypothesized to facilitate negative biases against people with facial anomalies (e.g., scars), but whether and how these biases affect behavior and brain functioning remain open questions. We examined responses to anomalous faces in the brain (using a visual oddball paradigm), behavior (in economic games), and attitudes. At the level of the brain, the amygdala demonstrated a specific neural response to anomalous faces—sensitive to disgust and (...) a lack of beauty but independent of responses to salience or arousal. At the level of behavior, people with anomalous faces were subjected to less prosociality from participants highest in socioeconomic status. At the level of attitudes, we replicated previously reported negative character evaluations made about individuals with facial anomalies, and further identified explicit biases directed against them as a group. Across these levels of organization, the specific amygdala response to facial anomalies correlated with stronger just-world beliefs (i.e., people get what they deserve), less dispositional empathic concern, and less prosociality toward people with facial anomalies. Characterizing the “anomalous-is-bad” stereotype at multiple levels of organization can reveal underappreciated psychological burdens shouldered by people who look different. (shrink)

I argue that when we use email, text messaging, or social media websites such as Facebook to interact, rather than communicating face-to-face, we do not experience the best kind of empathy, which is most conducive to experiencing benevolence for others. My arguments rely on drawing interdisciplinary connections between sources: early modern accounts of sympathy, dance theory, philosophy of technology, and neuroscience/psychology. I reflect on theories from these disciplines which, taken together, suggest that to empathize optimally, we must see or hear (...) each other’s bodily gestures, vocal intonations, and facial expressions. (shrink)