People often appear to conflate anger and disgust, seemingly using expressions of both emotions interchangeably in response to moral violations. Yet, anger and moral disgust differ in their antecedents and consequences. These empirical observations are associated with two broad theoretical perspectives: one describes expressions of moral disgust as metaphors for anger, whereas the other describes moral disgust as functionally distinct from anger. Both accounts have received empirical support from separate and seemingly inconsistent literatures. The present study seeks to resolve this (...) inconsistency by focusing on the different ways moral emotions have been measured. We formalise three theoretical models of moral emotions: one in which expressions of disgust are purely associated with anger (but not physiological disgust), one in which disgust and anger are fully separated and have distinct functions, and an integrative model that accommodates both metaphorical use in language and distinctive function. We test these models on responses to moral violations (four studies; N = 1608). Our results suggest that moral disgust has distinct functions, but that expressions of moral disgust are sometimes used to convey moralistic anger. These findings have implications for the theoretical status and measurement of moral emotions. (shrink)

Research in person and face perception has broadly focused on group-level consensus that individuals hold when making judgments of others. However, a growing body of research demonstrates that individual variation is larger than shared, stimulus-level variation for many social trait judgments. Despite this insight, little research to date has focused on building and explaining individual models of face perception. Studies and methodologies that have examined individual models are limited in what visualizations they can reliably produce to either noisy and blurry (...) or computer avatar representations. Methods that produce low-fidelity visual representations inhibit generalizability by being clearly computer manipulated and produced. In the present work, we introduce a novel paradigm to visualize individual models of face judgments by leveraging state-of-the-art computer vision methods. Our proposed method can produce a set of photorealistic face images that correspond to an individual's mental representation of a specific attribute across a variety of attribute intensities. We provide a proof-of-concept study which examines perceived trustworthiness/untrustworthiness and masculinity/femininity. We close with a discussion of future work to substantiate our proposed method. (shrink)

Error-related electroencephalographic signals have been widely studied concerning the human cognitive capability of differentiating between erroneous and correct actions. Midfrontal error-related negativity and theta band oscillations are believed to underlie post-action error monitoring. However, it remains elusive how early monitoring activity is trackable and what are the pre-response brain mechanisms related to performance monitoring. Moreover, it is still unclear how task-specific parameters, such as cognitive demand or motor control, influence these processes. Here, we aimed to test pre- and post-error EEG (...) patterns for different types of motor responses and investigate the neuronal mechanisms leading to erroneous actions. We implemented a go/no-go paradigm based on keypresses and saccades. Participants received an initial instruction about the direction of response to be given based on a facial cue and a subsequent one about the type of action to be performed based on an object cue. The paradigm was tested in 20 healthy volunteers combining EEG and eye tracking. We found significant differences in reaction time, number, and type of errors between the two actions. Saccadic responses reflected a higher number of premature responses and errors compared to the keypress ones. Nevertheless, both led to similar EEG patterns, supporting previous evidence for increased ERN amplitude and midfrontal theta power during error commission. Moreover, we found pre-error decreased theta activity independent of the type of action. Source analysis suggested different origin for such pre- and post-error neuronal patterns, matching the anterior insular cortex and the anterior cingulate cortex, respectively. This opposite pattern supports previous evidence of midfrontal theta not only as a neuronal marker of error commission but also as a predictor of action performance. Midfrontal theta, mostly associated with alert mechanisms triggering behavioral adjustments, also seems to reflect pre-response attentional mechanisms independently of the action to be performed. Our findings also add to the discussion regarding how salience network nodes interact during performance monitoring by suggesting that pre- and post-error patterns have different neuronal sources within this network. (shrink)

In this article, robust evidence is provided showing that an individual’s moral character can contribute to the aesthetic quality of their appearance, as well as being beautiful or ugly itself. It is argued that this evidence supports two main conclusions. First, moral beauty and ugliness reside on the inside, and beauty and ugliness are not perception-dependent as a result; and, second, aesthetic perception is affected by moral information, and thus moral beauty and ugliness are on the outside as well.

Facial information is a powerful channel for human-to-human communication. Characteristically, faces can be defined as biological objects that are four-dimensional (4D) patterns, whereby they have concurrently a spatial structure as well as temporal dynamics. The spatial characteristics of facial objects possess three dimensions (3D), namely breadth, height and importantly, depth. The temporal properties of facial objects are defined by how a 3D facial structure evolves dynamically over time; where time is referred to as the fourth dimension (4D). Our entire perspective (...) of another’s face, whether it be social, affective or cognitive perceptions, is therefore built on a combination of 3D and 4D visual cues. Counterintuitively, over the past few decades of experimental research in psychology, facial stimuli have largely been presented to participants as a spatial pattern that has been flattened into two dimensions (2D), while remaining largely static. The following review aims to advance and update facial researchers, on the recent revolution in computer-generated, realistic 4D facial models produced from real-life human subjects. We delve in-depth to summarize recent studies which have utilized facial stimuli that possess 3D structural cues (geometry and depth) and 4D temporal cues (3D structure + dynamic viewpoint and movement). In sum, we have found that higher-order perceptions such as identity, gender, ethnicity, emotion and personality, are critically influenced by the 4D characteristics embedded within natural human faces. In future, it is recommended that facial stimuli incorporate the 4D space-time perspective with the proposed time-resolved methods. (shrink)

We explore the question of whether machines can infer information about our psychological traits or mental states by observing samples of our behaviour gathered from our online activities. Ongoing technical advances across a range of research communities indicate that machines are now able to access this information, but the extent to which this is possible and the consequent implications have not been well explored. We begin by highlighting the urgency of asking this question, and then explore its conceptual underpinnings, in (...) order to help emphasise the relevant issues. To answer the question, we review a large number of empirical studies, in which samples of behaviour are used to automatically infer a range of psychological constructs, including affect and emotions, aptitudes and skills, attitudes and orientations (e.g. values and sexual orientation), personality, and disorders and conditions (e.g. depression and addiction). We also present a general perspective that can bring these disparate studies together and allow us to think clearly about their philosophical and ethical implications, such as issues related to consent, privacy, and the use of persuasive technologies for controlling human behaviour. (shrink)

ABSTRACTWe examined the utility of a gaze cueing paradigm to examine sensitivity to differences among negatively valenced expressions. Participants judged target stimuli, the lo...

Most experimental studies of facial expression processing have used static stimuli (photographs), yet facial expressions in daily life are generally dynamic. In its original photographic format, the Karolinska Directed Emotional Faces (KDEF) has been frequently utilized. In the current study, we validate a dynamic version of this database, the KDEF-dyn. To this end, we applied animation between neutral and emotional expressions (happy, sad, angry, fearful, disgusted, and surprised; 1,033-ms unfolding) to 40 KDEF models, with morphing software. Ninety-six human observers categorized (...) the expressions of the resulting 240 video-clip stimuli, and automated face analysis assessed the evidence for 6 expressions and 20 facial action units (AUs) at 31 intensities. Low-level image properties (luminance, signal-to-noise ratio, etc.) and other purely perceptual factors (e.g., size, unfolding speed) were controlled. Human recognition performance (accuracy, efficiency, and confusions) patterns were consistent with prior research using static and other dynamic expressions. Automated assessment of expressions and AUs was sensitive to intensity manipulations. Significant correlations emerged between human observers’ categorization and automated classification. The KDEF-dyn database aims to provide a balance between experimental control and ecological validity for research on emotional facial expression processing. The stimuli and the validation data are available to the scientific community. (shrink)

Responses to surprising events are dynamic. We argue that initial responses are primarily driven by the unexpectedness of the surprising event and reflect an interrupted and surprised state in which the outcome does not make sense yet. Later responses, after sense-making, are more likely to incorporate the valence of the outcome itself. To identify initial and later responses to surprising stimuli, we conducted two repetition-change studies and coded the general valence of facial expressions using computerised facial coding and specific facial (...) action using the Facial Action Coding System (FACS). Results partly supported our unfolding logic. The computerised coding showed that initial expressions to positive surprises were less positive than later expressions. Moreover, expressions to positive and negative surprises were initially similar, but after some time differentiated depending on the valence of the event. Importantly, these patterns were particularly pronounced in a subset of facially expressive participants, who also showed facial action in the FACS coding. The FACS data showed that the initial phase was characterised by limited facial action, whereas the later increase in positivity seems to be explained by smiling. Conceptual as well as methodological implications are discussed. (shrink)

ABSTRACTDynamic changes in emotional expressions are a valuable source of information in social interactions. As the expressive behaviour of a person changes, the inferences drawn from the behaviour may also change. Here, we test the possibility that dynamic changes in emotional expressions affect person perception in terms of stable trait attributions. Across three experiments, we examined perceivers’ inferences about others’ personality traits from changing emotional expressions. Expressions changed from one emotion to another emotion, allowing us to disentangle potential primacy, recency, (...) and averaging effects. Drawing on three influential models of person perception, we examined perceptions of dominance and affiliation, competence and warmth, and dominance and trustworthiness. A strong recency effect was consistently found across all trait judgments, that is, the end emotion of dynamic expressions had a strong impact on t... (shrink)

It has been repeatedly stated that approach and avoidance reactions to emotional faces are triggered by the intention signalled by the emotion. This line of thought suggests that each emotion signals a specific intention triggering a specific behavioural reaction. However, empirical results examining this assumption are inconsistent, suggesting that it might be too short-sighted. We hypothesise that the same emotional expression can signal different social messages and, therefore, trigger different reactions; which social message is signalled by an emotional expression should (...) be influenced by moderating variables, such as the group membership of the expresser. In two experiments, we show that group membership influences approach and avoidance reactions to emotional expressions: Emotions (fear and happiness) expressed by in-group members elicited concordant behaviour, whereas emotions expressed by out-group members activated the reverse pattern. A third experiment, in which participants directly evaluated smiling and fearful individuals resembling in-group and out-group members supported this result. (shrink)

In his novel Remembrance of Things Past, Marcel Proust argues that conventional descriptions of the phenomenology of consciousness are incomplete because they focus too much on the highly-salient sensory information that dominates each moment of awareness and ignore the network of associations that lies in the background. In this paper, I explicate Proust’s theory of conscious experience and show how it leads him directly to a theory of aesthetic perception. Proust’s division of awareness into two components roughly corresponds to William (...) James’ division of the stream of thought into a “nucleus” and “fringe.” Proust argues that the function of art is to evoke the underlying associative network indirectly in the mind of the observer by using carefully chosen sensory surfaces to control the stream of thought. I propose a possible neural basis for this Proustian/Jamesian phenomenology, and argue that the general principles of Proustian aesthetics can be applied to all forms of art. I conclude that a scientific theory of art should follow in a straightforward manner from a scientific theory of consciousness. (shrink)

This paper serves three specific goals. First, it reports the development of an Indian Asian face set, to serve as a free resource for psychological research. Second, it examines whether the use of pre-tested U.S.-specific norms for stimulus selection or weighting may introduce experimental confounds in studies involving non-U.S. face stimuli and/or non-U.S. participants. Specifically, it examines whether subjective impressions of the face stimuli are culturally dependent, and the extent to which these impressions reflect social stereotypes and ingroup favoritism. Third, (...) the paper investigates whether differences in face familiarity impact accuracy in identifying face ethnicity. To this end, face images drawn from volunteers in India as well as a subset of Caucasian face images from the Chicago Face Database were presented to Indian and U.S. participants, and rated on a range of measures, such as perceived attractiveness, warmth, and social status. Results show significant differences in the overall valence of ratings of ingroup and outgroup faces. In addition, the impression ratings show minor differentiation along two basic stereotype dimensions, competence and trustworthiness, but not warmth. We also find participants to show significantly greater accuracy in correctly identifying the ethnicity of ingroup faces, relative to outgroup faces. This effect is found to be mediated by ingroup-outgroup differences in perceived group typicality of the target faces. Implications for research on intergroup relations in a cross-cultural context are discussed. (shrink)

State-of-the-art facial expression methods outperform human beings, especially, thanks to the success of convolutional neural networks. However, most of the existing works focus mainly on analyzing an adult’s face and ignore the important problems: how can we recognize facial expression from a baby’s face image and how difficult is it? In this paper, we first introduce a new face image database, named BabyExp, which contains 12,000 images from babies younger than two years old, and each image is with one of (...) three facial expressions. To the best of our knowledge, the proposed dataset is the first baby face dataset for analyzing a baby’s face image, which is complementary to the existing adult face datasets and can shed some light on exploring baby face analysis. We also propose a feature guided CNN method with a new loss function, called distance loss, to optimize interclass distance. In order to facilitate further research, we provide the benchmark of expression recognition on the BabyExp dataset. Experimental results show that the proposed network achieves the recognition accuracy of 87.90% on BabyExp. (shrink)

There is increasing interest in clarifying how different face emotion expressions are perceived by people from different cultures, of different ages and sex. However, scant availability of well-controlled emotional face stimuli from non-Western populations limit the evaluation of cultural differences in face emotion perception and how this might be modulated by age and sex differences. We present a database of East Asian face expression stimuli, enacted by young and older, male and female, Taiwanese using the Facial Action Coding System (FACS). (...) Combined with a prior database, this present database consists of 90 identities with happy, sad, angry, fearful, disgusted, surprised and neutral expressions amounting to 628 photographs. 20 young and 24 older East Asian raters scored the photographs for intensities of multiple-dimensions of emotions and induced affect. Multivariate analyses characterized the dimensionality of perceived emotions and quantified effects of age and sex. We also applied commercial software to extract computer-based metrics of emotions in photographs. Taiwanese raters perceived happy faces as one category, sad, angry, and disgusted expressions as one category, and fearful and surprised expressions as one category. Younger females were more sensitive to face emotions than younger males. Whereas older males showed reduced face emotion sensitivity, older female sensitivity was similar or accentuated relative to young females. Commercial software dissociated six emotions according to the FACS demonstrating that defining visual features were present. Our findings show that East Asians perceive a different dimensionality of emotions than Western-based definitions in face recognition software, regardless of age and sex. Critically, stimuli with detailed cultural norms are indispensable in interpreting neural and behavioral responses involving human facial expression processing. To this end, we add to the tools, which are available upon request, for conducting such research. (shrink)

ABSTRACTIn this research, we investigated whether appraisals of faces follow distinct rules of information integration under arousing versus non-arousing conditions. Support for this prediction was found in four experiments in which participants observed angry faces that were presented with a direct versus an averted gaze, on a red versus a grey background, and after performing a motor exercise versus no exercise. Under arousing conditions, participants’ appraisals of faces reflected summation whereas, under non-arousing conditions, appraisals did not reflect summation and could (...) instead be accounted for by three alternative rules of information integration based on averaging, mere exposure, or the number of strong stimuli. (shrink)

ABSTRACTEmpathy represents a fundamental ability that allows for the creation and cultivation of social bonds. As part of the empathic process, individuals use their own emotional state to interpret the content and intensity of other people’s emotions. Therefore, the current study was designed to test two hypotheses: empathy for the pain of another will result in biased emotional intensity judgment; and changing one’s emotion via emotion regulation will modulate these biased judgments. To test these hypotheses, in experiment one we used (...) a modified version of a well-known task that triggers an empathic reaction We found that empathy resulted in biased emotional intensity judgment. To the best of our knowledge, this is the first demonstration of a bias in the recognition of emotional facial expressions as a function of empathy for pain. In experiment two, we replicated these findings in an independent sample, and further found that this biased emotional intensity judgment can be moderated via reappr... (shrink)

Research on automatic attention to emotional faces offers mixed results. Therefore we examined validity effects for facial expressions of different emotions with a dot-probe paradigm in seven studies. Systematic variations of type of emotion, CTI, task, cue size, and masking allow for a differentiated assessment of attentional capture by emotions and possible moderating factors. Results indicate a general absence of emotional validity effects as well as a lack of significant interactions with either of the manipulated factors, indicating that facial expressions (...) of emotions do not capture attention in a fully automatic fashion. These findings suggest that situational and contextual factors have to be taken into account when investigating attentional capture of emotional faces. (shrink)

Attentional bias is assumed to be partly responsible for the onset and maintenance of anxiety by major cognitive theories of emotional disorders. Although much is already known about the therapeutic effects of attentional bias training, only a few studies have examined the mechanism responsible for these effects. In order to test if low-level, cognitive effects of attentional bias training depend on attentional control, 73 participants, who completed the STAI-x2 and the ACS questionnaires, were randomly assigned to a control or attentional (...) training group. The attentional manipulation was followed by a search task, during which novel neutral or negative faces could be presented within an array of all-neutral, all-negative or all-positive faces. It was found that individuals with higher ACS score displayed stronger attentional training effects, i.e., they were less accurate in detecting distinctive negative faces, and this effect was not found to be associated with STAI-x2 score. These results show that there is individual variability even in immediate, cognitive effects of attentional bias modification and that special abilities, such as attentional control, might be required for attentional training to be efficient. (shrink)

Across taxa, strength and size are elementary determinants of relative fighting capacity; in species with complex behavioral repertoires, numerous additional factors also contribute. When many factors must be considered simultaneously, decision-making in agonistic contexts can be facilitated through the use of a summary representation. Size and strength may constitute the dimensions used to form such a representation, such that tactical advantages or liabilities influence the conceptualized size and muscularity of an antagonist. If so, and given the continued importance of physical (...) strength in human male-male conflicts, a man’s own strength will influence his conceptualization of the absolute size and strength of an opponent. In the research reported here, male participants’ chest compression strength was compared with their estimates of the size and muscularity of an unfamiliar potential antagonist, presented either as a supporter of a rival sports team (Study 1, conducted in urban California, and Study 2, conducted in rural Fiji) or as a man armed with a handgun (Study 3, conducted in rural Fiji). Consistent with predictions, composite measures of male participants’ estimates of the size/strength of a potential antagonist were inversely correlated with the participant’s own strength. Therefore, consonant with a history wherein violent intrasexual selection has acted on human males, a man’s own physical strength influences his representations of potential antagonists. (shrink)

In higher-level cognitive tasks, older compared to younger adults show a bias towards positive emotion information and away from negative information (a positivity effect). It is unclear whether this effect occurs in early perceptual processing. This issue is important for determining if the positivity effect is due to automatic rather than controlled processing. We tested this with older and younger adults on a positive/negative face emotion valence classification task using masked priming. Positive (happy) and negative (angry) face targets were preceded (...) by masked repetition or valence primes with neutral face baselines. In Experiment 1, 30 younger and 30 older adults were tested with 50 ms primes. Younger adults showed repetition priming for both positive and negative targets. Older adults showed repetition priming for positive but not negative targets. Neither group showed valence priming. In Experiment 2, 30 older and 29 younger adults were tested with longer duration primes. Younger adults showed repetition priming for both positive and negative emotions, and no valence priming. Older adults only showed repetition and valence priming for positive targets. We proposed older adults’ lack of angry face priming was due to an early attention orienting strategy favouring happy expressions at the expense of angry ones. (shrink)

Benzodiazepines and antidepressants have been shown to change responses to unfairness; however, the effects of their combined use on unfairness evaluation are unknown. This study examines the effects of concomitant benzodiazepines and antidepressants long-term use on the evaluation of fair and unfair offers. To analyze behavioral changes on responses to unfairness, we compared the performance of medicated participants and healthy controls in the Ultimatum Game, both in the proposer and in the respondent role. The results showed that long-term psychotropic users (...) had the worse economic strategy by accepting less offers than control subjects. However, in the proposer role, the unfair offers made by participants were similar between groups. The present results suggest that long-term use of psychotropic medication, specifically the combination of benzodiazepines and antidepressants, may increase the sensitivity to unfairness, resulting in higher rejection rates in conditions where this strategy is the most disadvantageous. (shrink)

Background: This study developed a photo and video database of 4-to-6-year-olds expressing the seven induced and posed universal emotions and a neutral expression. Children participated in photo and video sessions designed to elicit the emotions, and the resulting images were further assessed by independent judges in two rounds. Methods: In the first round, two independent judges, experts in the Facial Action Coding System, firstly analysed 3,668 emotions facial expressions stimuli from 132 children. Both judges reached 100% agreement regarding 1,985 stimuli, (...) which were then selected for a second round of analysis between judges 3 and 4. Results: The result was 1,985 stimuli were produced from 124 participants. A Kappa index of 0.70 and an accuracy of 73% between experts were observed. Lower accuracy was found for emotional expression by 4-year-olds than 6-year-olds. Happiness, disgust and contempt had the highest agreement. After a sub-analysis evaluation of all four judges, 100% agreement was reached for 1,381 stimuli which compound the ChildEFES database with 124 participants and 51% induced photographs. The number of stimuli of each emotion were: 87 for neutrality, 363 for happiness, 170 for disgust, 104 for surprise, 152 for fear, 144 for sadness, 157 for anger 157, and 183 for contempt. Conclusions: The findings show that this photo and video database can facilitate research on the mechanisms involved in early childhood recognition of facial emotions in children, contributing to the understanding of facial emotion recognition deficits which characterise several neurodevelopmental and psychiatric disorders. (shrink)