A key feature of facial behavior is its dynamic quality. However, most previous research has been limited to the use of static images of prototypical expressive patterns. This article explores the role of facial dynamics in the perception of emotions, reviewing relevant empirical evidence demonstrating that dynamic information improves coherence in the identification of affect (particularly for degraded and subtle stimuli), leads to higher emotion judgments (i.e., intensity and arousal), and helps to differentiate between genuine and fake expressions. The findings (...) underline that using static expressions not only poses problems of ecological validity, but also limits our understanding of what facial activity does. Implications for future research on facial activity, particularly for social neuroscience and affective computing, are discussed. (shrink)

This study investigated the emotional and behavioural effects of looming threats using both recalled (self-reported valence) and real-time response measurements (facial expressions). The looming bias refers to the tendency to underestimate the time of arrival of rapidly approaching (looming) stimuli, providing additional time for defensive reactions. While previous research has shown negative emotional responses to looming threats based on self-reports after stimulus exposure, facial expressions offer valuable insights into emotional experiences and non-verbal behaviour during stimulus exposure. A face reading experiment (...) examined responses to threats in motion, considering stimulus direction (looming versus receding motion) and threat strength (more versus less threatening stimuli). We also explored the added value of facial expression recognition compared to self-reported valence. Results indicated that looming threats elicit more negative facial expressions than receding threats, supporting previous findings on the looming bias. Further, more (vs. less) threatening stimuli evoked more negative facial expressions, but only when the threats were looming rather than receding. Interestingly, facial expressions of valence and self-reported valence showed opposing results, suggesting the importance of incorporating facial expression recognition to understand defensive responses to looming threats more comprehensively. (shrink)

Everyday joint remembering, from family remembering around the dinner table to team remembering in the operating theatre, relies on the successful interweaving of multiple cognitive, bodily, social and material resources, anchored in specific cultural ecosystems. Such systems for joint remembering in social interactions are composed of processes unfolding over multiple but complementary timescales, which we distinguish for analytic purposes so as better to study their interanimation in practice: (i) faster, lower-level coordination processes of behavioral matching and interactional synchrony occurring at (...) timescale t1; (ii) mid-range collaborative processes which re-evoke past experiences in groups, unfolding at timescale t2; (iii) cooperative processes involved in the transmission of memories over longer periods occurring at timescale t3; and (iv) cultural processes and practices operating within distributed socio-cognitive networks over evolutionary and historical timeframes, unfolding at timescale t4. In this paper we survey studies of how the processes operating across these overlapping and complementary timescales constitute joint remembering in social interactions. We describe coordination, collaboration, cooperation, and culture as complementary aspects of interacting to remember, which we consider as a complex phenomenon unfolding over multiple timescales (t1, t2, t3, t4). (shrink)

Android robots capable of emotional interactions with humans have considerable potential for application to research. While several studies developed androids that can exhibit human-like emotional facial expressions, few have empirically validated androids’ facial expressions. To investigate this issue, we developed an android head called Nikola based on human psychology and conducted three studies to test the validity of its facial expressions. In Study 1, Nikola produced single facial actions, which were evaluated in accordance with the Facial Action Coding System. The (...) results showed that 17 action units were appropriately produced. In Study 2, Nikola produced the prototypical facial expressions for six basic emotions, and naïve participants labeled photographs of the expressions. The recognition accuracy of all emotions was higher than chance level. In Study 3, Nikola produced dynamic facial expressions for six basic emotions at four different speeds, and naïve participants evaluated the naturalness of the speed of each expression. The effect of speed differed across emotions, as in previous studies of human expressions. These data validate the spatial and temporal patterns of Nikola’s emotional facial expressions, and suggest that it may be useful for future psychological studies and real-life applications. (shrink)

Emotion plays an essential role in the perception of time such that time is perceived to “fly” when events are enjoyable, while unenjoyable moments are perceived to “drag.” Previous studies have reported a time-drag effect when participants are presented with emotional facial expressions, regardless of the emotion presented. This effect can hardly be explained by induced emotion given the heterogeneous nature of emotional expressions. We conducted two experiments ( n = 44 and n = 39) to examine the cognitive mechanism (...) underlying this effect by presenting dynamic sequences of emotional expressions to participants. Each sequence started with a particular expression, then morphed to another. The presentation of dynamic facial expressions allows a comparison between the time-drag effect of homogeneous pairs of emotional expressions sharing similar valence and arousal to heterogeneous pairs. Sequences of seven durations (400, 600, 800, 1000, 1200, 1400, 1600 ms) were presented to participants, who were asked to judge whether the sequences were closer to 400 or 1600 ms in a two-alternative forced choice task. The data were then collated according to conditions and fit into cumulative Gaussian curves to estimate the point of subjective equivalence indicating the perceived duration of 1000 ms. Consistent with previous reports, a feeling of “time dragging” is induced regardless of the sequence presented, such that 1000 ms is perceived to be longer than 1000 ms. In addition, dynamic facial expressions exert a greater effect on perceived time drag than static expressions. The effect is most prominent when the dynamics involve an angry face or a change in valence. The significance of this sensitivity is discussed in terms of emotion perception and its evolutionary significance for our attention mechanism. (shrink)

According to the Communicative Theory of Emotions, we experience emotions when events occur that are important for our goals and plans. A method of choice for studying these matters is the emotion diary. Emotions configure our cognitive systems and our relationships. Many of our emotions concern our relationships, and empathy is central to our experience of them. We do not always recognize our emotions or the emotions of others, but literary fiction can help improve our skills of recognition and understanding.

Everyday joint remembering, from family remembering around the dinner table to team remembering in the operating theatre, relies on the successful interweaving of multiple cognitive, bodily, social and material resources, anchored in specific cultural ecosystems. Such systems for joint remembering in social interactions are composed of processes unfolding over multiple but complementary timescales, which we distinguish for analytic purposes so as better to study their interanimation in practice: faster, lower-levelcoordination processesof behavioral matching and interactional synchrony occurring at timescale t1; mid-rangecollaborative (...) processeswhich re-evoke past experiences in groups, unfolding at timescale t2; cooperative processesinvolved in the transmission of memories over longer periods occurring at timescale t3; and cultural processesand practices operating within distributed socio-cognitive networks over evolutionary and historical timeframes, unfolding at timescale t4. In this paper we survey studies of how the processes operating across these overlapping and complementary timescales constitute joint remembering in social interactions. We describe coordination, collaboration, cooperation, and culture as complementary aspects of interacting to remember, which we consider as a complex phenomenon unfolding over multiple timescales. (shrink)

We investigate whether smile mimicry and emotional contagion are evident in non-text-based computer-mediated communication (CMC). Via an ostensibly real-time audio-visual CMC platform, participants interacted with a confederate who either smiled radiantly or displayed a neutral expression throughout the interaction. Automatic analyses of expressions displayed by participants indicated that smile mimicry was at play: A higher level of activation of the facial muscle that characterises genuine smiles was observed among participants who interacted with the smiling confederate than among participants who interacted (...) with the unexpressive confederate. However, there was no difference in the self-reported level of joviality between participants in the two conditions. Our findings demonstrate that people mimic smiles in audio-visual CMC, but that even though the diffusion of emotions has been documented in text-based CMC in previous studies, we find no convincing support for the phenomenon of emotional contagion in non-text-based CMC. (shrink)

Micro-expression is an extremely quick and uncontrollable facial movement that lasts for 40–200 ms and reveals thoughts and feelings that an individual attempts to cover up. Though much more difficult to detect and recognize, ME recognition is similar to macro-expression recognition in that it is influenced by facial features. Previous studies suggested that facial attractiveness could influence facial expression recognition processing. However, it remains unclear whether facial attractiveness could also influence ME recognition. Addressing this issue, this study tested 38 participants (...) with two ME recognition tasks in a static condition or dynamically. Three different MEs at two attractiveness levels. The results showed that participants recognized MEs on attractive faces much quicker than on unattractive ones, and there was a significant interaction between ME and facial attractiveness. Furthermore, attractive happy faces were recognized faster in both the static and the dynamic conditions, highlighting the happiness superiority effect. Therefore, our results provided the first evidence that facial attractiveness could influence ME recognition in a static condition or dynamically. (shrink)

Emotion is critical for cultural dynamics, that is, for the formation, maintenance, and transformation of culture over time. We outline the component micro- and macro-level processes of cultural dynamics, and argue that emotion not only facilitates the transmission and retention of cultural information, but also is shaped and crafted by cultural dynamics. Central to this argument is our understanding of emotion as a complete information package that signals the adaptive significance of the information that the agent is processing. It captures (...) an agent’s appraisal about the relationship between themself and the object of emotional focus, as well as action orientation and allostasis in context. We discuss implications of this perspective in the context of the changing natural and geopolitical environment, and future cultural dynamics into the 21st century. (shrink)

Emotional processing without conscious awareness plays an important role in human social interaction. Several behavioral studies reported that subliminal presentation of photographs of emotional facial expressions induces unconscious emotional processing. However, it was difficult to elicit strong and robust effects using this method. We hypothesized that dynamic presentations of facial expressions would enhance subliminal emotional effects and tested this hypothesis with two experiments. Fearful or happy facial expressions were presented dynamically or statically in either the left or the right visual (...) field for 20 (Experiment 1) and 30 (Experiment 2) ms. Nonsense target ideographs were then presented, and participants reported their preference for them. The results consistently showed that dynamic presentations of emotional facial expressions induced more evident emotional biases toward subsequent targets than did static ones. These results indicate that dynamic presentations of emotional facial expressions induce more evident unconscious emotional processing. (shrink)