Sostengo que la controversia entre la teoría de las emociones básicas y el construccionismo psicológico yace en diferencias sobre el rol de los conceptos cotidianos de emoción en el ámbito científico. Para esto, analizo las discusiones en torno a la universalidad de las expresiones faciales y a la existencia de correspondencias neurofisiológicas para cada emoción. Muestro que en ambas discusiones estamos en un espacio de subdeterminación empírica, lo que impide saldar la controversia aludiendo a resultados experimentales. Finalizo con algunas sugerencias (...) sobre cómo podría saldarse la controversia. (shrink)

In this paper I review some leading developments in the empirical theory of affect. I argue that (1) affect is a distinct perceptual representation governed system, and (2) that there are significant modular factors in affect. The paper concludes with the observation thatfeeler (affective perceptual system) may be a natural kind within cognitive science. The main purpose of the paper is to explore some hitherto unappreciated connections between the theory of affect and the computational theory of mind.

The accurate recognition of emotion is important for interpersonal interaction and when navigating our social world. However not all facial displays reflect the emotional experience currently being felt by the expresser. Indeed faces express both genuine and posed displays of emotion. In this article, we summarise the importance of motion for the recognition of face identity before critically outlining the role of dynamic information in determining facial expressions and distinguishing between genuine and posed expressions of emotion. We propose that both (...) dynamic information and face familiarity may modulate our ability to determine whether an expression is genuine or not. Finally, we consider the shared role for dynamic information across different face recognition tasks and the wider impact of face familiarity on determining genuine from posed expressions during real-world interactions. (shrink)

Neuroscience has established several brain pathways that process visual information. Distinct neural circuits analyze body appearance and movement providing information about the person’s cognitive and emotional states. The activity of the pathways depends on the salience of visual stimuli for the organism in the given circumstances. Since ballet performances are not among the crucial events for the viewer’s organism, not all viewers perceive and interpret bodily signs that express the mental state of the dancer. Treatment of the dancer as close (...) other activates the neural circuits that elaborate emotions, this enables the viewer to feel the internal state of the dancer and enrich the interpretation of the scenic action. (shrink)

Jointly coordinated affective activities are fundamental for social relationships. This study investigates a naturally occurring interaction between two women who produced reciprocal emotional stances towards similar past experiences. Adopting a microanalytic approach, we describe how the participants re-enact their past experiences through different but aligning synchronized gestures. This embodied dialogue evolves into affective flooding, in which participants co-produce their body memories of pulling down window blinds to block out sunshine. We show how the participants live this moment intercorporeally and how (...) multiple timescales are tied together in gesture, which is both an incarnation of body history and a novel expression of it. Thus, collaborative gesturing is a resource for experiencing together emotions re-enacted from body memories. Contributing to our understanding of the intercorporeality of human action, we provide an empirical investigation into how emotions and multiple timescales are nested in cooperative gestures. Data are in Finnish with English translations. (shrink)

This study investigates affective meanings expressed in facial expressions and bodily gestures from a semiotic perspective. Particularly, the study focuses on disentangling relations of affective meanings and exploring the meaning potential of facial expressions and bodily gestures. Based on the analysis of over three hundred screenshots from two films (one animation and one live-action film), this study proposes a system of visual affect, as well as a system of visual resources involved in the expression of visual affect. The system of (...) visual affect makes a further step in the investigation of affective meanings afforded by facial expressions and bodily gestures, and can provide methodological insights into the examination of affective meanings expressed visually. The system of visual resources provides a more meaning-motivated framework for systematic tracking of the visual resources, which may be applied to the analysis of other visual media apart from films. (shrink)

This study investigates moments in which one participant in an interaction embodies that he is “doing thinking,” a display that is commonly referred to as “thinking face. ” From an interactional perspective, it is assumed that embodied displays of “doing thinking” are a recurring social practice and serve interactive functions. While previous studies have examined thinking faces primarily in word searches and storytelling, the present study focuses on argumentative activities, in which children engage in processes of joint decision-making. The paper (...) has two interrelated aims. The first aim is to describe how multiple modalities—beyond the face—are temporally coordinated to create multimodal gestalts of “doing thinking.” It is shown that thinking displays not only involve dynamic imaginative gaze but also stylized bodily postures. The second aim is to generate knowledge about the functions of thinking displays in children's argumentative activities. The analysis describes how both speakers and recipients use thinking displays in different turn positions and align them with verbal talk or silence. The data for this study comprise video recordings of decision-making processes in groups of older children. Drawing on a multimodal approach to situated interaction, it will be proposed that embodied displays of “doing thinking” provide a resource to shape participation frameworks, mark epistemic stances and create epistemic ecologies for collaborative reasoning. By investigating thinking displays in a particular conversational activity, the study sheds light on the diversity and context-sensitive functionality of thinking displays. It also contributes to recent research on children's collaborative reasoning as an embodied discursive practice. (shrink)

Motivated by historical insights, the current study examines whether speech-concomitant nonverbal behavior differs between social classes. On the basisof widely accepted concepts relating to cognitive theories of nonverbal communication and a preliminary outline of a concept of ‘communicative physicality’, a TV corpus of autobiographical narratives is analyzed according to a set of working-hypotheses. The results confirm the leading assumption of class-specific differences.

How does sign language compare with gesture, on the one hand, and spoken language on the other? Sign was once viewed as nothing more than a system of pictorial gestures without linguistic structure. More recently, researchers have argued that sign is no different from spoken language, with all of the same linguistic structures. The pendulum is currently swinging back toward the view that sign is gestural, or at least has gestural components. The goal of this review is to elucidate the (...) relationships among sign language, gesture, and spoken language. We do so by taking a close look not only at how sign has been studied over the past 50 years, but also at how the spontaneous gestures that accompany speech have been studied. We conclude that signers gesture just as speakers do. Both produce imagistic gestures along with more categorical signs or words. Because at present it is difficult to tell where sign stops and gesture begins, we suggest that sign should not be compared with speech alone but should be compared with speech-plus-gesture. Although it might be easier (and, in some cases, preferable) to blur the distinction between sign and gesture, we argue that distinguishing between sign (or speech) and gesture is essential to predict certain types of learning and allows us to understand the conditions under which gesture takes on properties of sign, and speech takes on properties of gesture. We end by calling for new technology that may help us better calibrate the borders between sign and gesture. (shrink)

The commentaries have led us to entertain expansions of our paradigm to include new theoretical questions, new criteria for what counts as a gesture, and new data and populations to study. The expansions further reinforce the approach we took in the target article: namely, that linguistic and gestural components are two distinct yet integral sides of communication, which need to be studied together.

I offer a novel view of the mechanisms underlying the spontaneous facial expression of emotion. According to my Social Amplification View, facial expressions result from the interplay of two processes: an emotional process that activates specific facial muscles, though not always to the point of visible contraction, followed by a social cognitive process that amplifies these activations so that they may function more effectively as social signals. I argue that SAV outperforms both the Neurocultural View and the Behavioral Ecology View, (...) as well as previously proposed syntheses of these views, in accounting for various empirical findings. (shrink)

Human–robot interactions are often affected by error situations that are caused by either the robot or the human. Therefore, robots would profit from the ability to recognize when error situations occur. We investigated the verbal and non-verbal social signals that humans show when error situations occur in human–robot interaction experiments. For that, we analyzed 201 videos of five human–robot interaction user studies with varying tasks from four independent projects. The analysis shows that there are two types of error situations: social (...) norm violations and technical failures. Social norm violations are situations in which the robot does not adhere to the underlying social script of the interaction. Technical failures are caused by technical shortcomings of the robot. The results of the video analysis show that the study participants use many head movements and very few gestures, but they often smile, when in an error situation with the robot. The results suggest that participants do not see the robot as a social interaction partner with comparable communication skills. Our findings have implications for builders and evaluators of human–robot interaction systems. The builders need to consider including modules for recognition and classification of head movements to the robot input channels. The evaluators need to make sure that the presence of an experimenter does not skew the results of their user studies. (shrink)

What constitutes our human capacity to engage and be in the same frame of mind as another human? How do we come to share a sense of what ‘looks good’ and what ‘makes sense’? How do we handle differences and come to coexist with them? How do we come to feel that we understand what someone else is experiencing? How are we able to walk in silence with someone familiar and be sharing a peaceful space? All of these aspects are (...) part of human ‘interaction’. In designing interactive technologies designers have endeavoured to explicate, analyse and simulate, our capacity for social adaptation. Their motivations are mixed and include the desires to improve efficiency, improve consumption, to connect people, to make it easier for people to work together, to improve education and learning. In these endeavours to explicate, analyse and simulate, there is a fundamental human capacity that is beyond technology and that facilitates these aspects of being, feeling and thinking with others. That capacity, we suggest, is human entrainment. This is our ability to coordinate the timing of our behaviours and rhythmically synchronise our attentional resources. Expressed within the movements of our bodies and voices, it has a quality that is akin to music. In this paper, disparate domains of research such as pragmatics, social psychology, behaviourism, cognitive science, computational linguistics, gesture, are brought together, and considered in light of the developments in interactive technology, in order to shape a conceptual framework for understanding entrainment in everyday human interaction. (shrink)

Cultural and biographical influences on the expression of emotions manifest themselves in so-called “display rules.” These rules determine the time, intensity, and situations in which an emotion is expressed. To date, only a small number of empirical studies deal with this transformation of how migrants, who are faced with a new culture, may change their emotional expression. The present, cross-sectional study focuses on changes in anger expression as part of a complex acculturation process among Iranian migrants. To this end, Iranian (...) citizens in Iran, German citizens, and Iranian migrants in Germany were compared in terms of anger expression behavior and acculturation strategy was assessed among the migrants, using the Frankfurt Acculturation Scale. A questionnaire developed in a preliminary study was used to measure anger expression via subjective anger experience and anger expression within 16 hypothetical situations. Multivariate Analyses of Variance revealed that Iranians and Iranian migrants reported higher anger experience ratings than Germans and directed their anger more often inward. Further findings suggest that transformation processes may have affected Iranian migrants in terms of suppressed anger : Iranian migrants with a higher orientation toward German culture reported lower average anger-in scores. These results suggest that there was different emotional expression among Iranian migrants, depending on their acculturation. The results provide new insight into socio-cultural and individual adjustment processes. (shrink)

When asked to explain their solutions to a problem, both adults and children gesture as they talk. These gestures at times convey information that is not conveyed in speech and thus reveal thoughts that are distinct from those revealed in speech. In this study, we use the classic Tower of Hanoi puzzle to validate the claim that gesture and speech taken together can reflect the activation of two cognitive strategies within a single response. The Tower of Hanoi is a well‐studied (...) puzzle, known to be most efficiently solved by activating subroutines at theoretically defined choice points. When asked to explain how they solved the Tower of Hanoi puzzle, both adults and children produced significantly more gesture‐speech mismatches—explanations in which speech conveyed one path and gesture another—at these theoretically defined choice points than they produced at non‐choice points. Even when the participants did not solve the problem efficiently, gesture could be used to indicate where the participants were deciding between alternative paths. Gesture can, thus, serve as a useful adjunct to speech when attempting to discover cognitive processes in problem‐solving. (shrink)

The present study examined the psychometric properties of the Chinese version of the Trait Emotional Intelligence Questionnaire Short Form (TEIQue-SF). Analyses were performed using a sample of undergraduates (N = 585) recruited from four universities across China. Confirmatory factor analysis of the Chinese TEIQue-SF supported the one-factor structure of trait emotional intelligence. Measurement invariance analyses were conducted across the Chinese sample and a sample of Canadian undergraduate students (N = 638). Although the two samples demonstrated configural and partial metric invariance, (...) scalar invariance was not found. Cross-cultural implications and explanations of the present findings, as well as suggestions for future research are discussed. (shrink)

This article addresses the issue of non-verbal communication in the light of the Gricean conceptualisation of intentionally conveyed meanings. The first goal is to testify that non-verbal cues can be interpreted as nonnatural meanings and speaker meanings, which partake in intentional communication. Secondly, it is argued that non-verbal signals, exemplified by gestures, are similar to utterances which generate the communicator's what is said and/or conversational implicatures, together with their different subtypes and manifestations. Both of these objectives necessitate a critical overview (...) of Grice's work on the focal aspects of meaning and communication, also on the strength of neo-Gricean research. (shrink)

While a large body of literature on pejorative language has emerged recently, derogatory communication is a broader phenomenon that need not constitutively involve the use of words. This paper delineates the class of non-verbal pejoratives and sketches an account of the derogatory power of a subset of NVPs, namely those whose effectiveness crucially relies on iconicity. Along the way, I point out some ways in which iconic NVPs differ from wholly arbitrary NVPs and ritualized threat signals in the animal kingdom, (...) such as the wolf’s snarl, which do not threaten or demean targets by virtue of any kind of iconographic depiction. An iconic portrayal such as a racist caricature disparages its target by inviting recipients to entertain an unflattering image of the target. “Blackface” performers in the nineteenth-century, for example, promulgated an unflattering image of African-Americans by means of make-up, costumes, and vocal impersonations. (shrink)

In initial teacher training, the micro-teaching activities and retroaction have for goals to develop reflexive practitioners and competent professionals with a high professional identity. The double analyze of the teacher’s action – observation of teacher gestures and analysis of retroaction - requires two complementary methods to make the links between interactive and postactive phase. In this article, the authors describe the different training activities, and explain the research approach with an illustration of a concrete case.

What explains people's propensity to ask existential questions that they have little hope of resolving, such as: Why are we here? What, if any, is our purpose? What is the structure of the universe? That humans engage in these endeavors has long puzzled evolutionary theorists, as they go beyond the immediate demands of fending for ourselves, seeking safety, finding food, and reproducing, which occupy the daily lives of other animals. In this book, philosopher Helen De Cruz draws on a wide (...) range of disciplines and thinkers, from Aristotle and 12th-century Muslim philosopher Ibn Tufayl to Jewish thinker Abraham Heschel and science writer Rachel Carson, showing how awe and wonder lie at the heart of such existential questions. She argues that there is an emotional basis to this drive for inquiry, as wonder and awe are epistemic emotions that help us think about big-picture questions and that motivate the answers we provide to those questions. (shrink)

Cet article interroge la question des corpus en analyse multimodale des corpus oraux d’interactions filmées dans le cadre d’une linguistique qui intègre l’étude des gestes à celle du discours pour rendre compte des pratiques langagières dans leur globalité. Ce type d’approche est traditionnellement associé à des petits corpus supports d’analyses qualitatives. À l’appui d’un tour d’horizon de recherches contemporaines en analyse multimodale des interactions orales, nous montrons que l’étude linguistique des gestes se prête à une grande variété d’approches innovantes au (...) plan méthodologique. En pratique, il reste à ce jour difficile de construire des grands corpus pour l’analyse gestuelle, parce qu’il s’agit d’une entreprise longue et coûteuse (enregistrement, transcription, annotation) : les petits corpus sont nombreux parce qu’ils sont plus faciles à construire pour un chercheur seul ou une petite équipe de recherche aux moyens limités. Cette situation tend cependant à évoluer, et ce de plusieurs manières, grâce aux collaborations nationales et internationales et aux nouveaux outils numériques. Les « petits » corpus n’en restent pas moins sources de résultats précieux en analyse gestuelle. Pour diverses raisons, les standards internationaux de l’évaluation de la recherche tendent à valoriser l’analyse quantitative aux dépens de l’analyse qualitative, faisant oublier que ces deux types d’approches ont des objectifs certes différents mais complémentaires : ils permettent de répondre à des questions de recherche différentes (étroites ou larges) et de proposer des savoirs d’origines différentes (généralisabilité des résultats ou généralisabilité des processus observés), dont la légitimité est elle aussi de nature différente (réfutabilité des résultats ou consilience des experts). Nombre de travaux récents en analyse gestuelle encouragent à remettre en question la dichotomie traditionnelle entre analyses qualitatives et quantitatives, en intégrant les deux approches de diverses manières. (shrink)

This paper investigates the nature of emotional experience in relation to the senses, and it defends the thesis that emotional experience is partly non-sensory. In §1 I introduce my reader to the debate. I reconstruct a position I call ‘restrictivism’ and motivate it as part of a reductive approach to mind’s place in nature. Drawing on intuitive but insightful remarks on the nature of sensation from Plato, I map out the conditions under which the restrictivist thesis is both substantive and (...) plausible. I then present two arguments against it. The first argument, which I lay out in §2, draws on recent empirical results in emotion research to show that restrictivism cannot be reconciled with the possibility of knowledge of one’s own emotional state by acquaintance. The second argument, which I present in §3, individuates a claim on which most contemporary theories of emotional valence converge and uses it to demonstrate that restrictivism has a false implication: it must deny that valence is experientially felt. (shrink)

Although cognitive science was multidisciplinary from the start, an under-emphasis on anthropology has left the field with limited research in small scale, indigenous societies. Neglecting the anthropological perspective is risky, given that once-canonical cognitive science findings have often been shown to be artifacts of enculturation rather than cognitive universals. This imbalance has become more problematic as the increased use of Western theory-driven approaches, many of which assume human uniformity (“universality”), confronts the absence of a robust descriptive base that might provide (...) clarifying or even contrary evidence. We highlight the need for remedies to such shortcomings by suggesting a two-fold methodological shift. First, studies conducted in indigenous societies can benefit by relying on multidisciplinary research groups to diminish ethnocentrism and enhance the quality of the data. Second, studies devised for Western societies can readily be adapted to the changing settings encountered in the field. Here, we provide examples, drawn from the areas of emotion and facial expressions, to illustrate potential solutions to recurrent problems in enhancing the quality of data collection, hypothesis testing, and the interpretation of results. (shrink)

Speakers frequently produce elaborate hand movements during talk that have been shown to serve a communicative function. Nevertheless, two-thirds of the semantic content of these hand movements is encoded linguistically elsewhere in the discourse . The present experiment demonstrated that while 62.9% of semantic information in gesture was elsewhere, most gestures retained at least one semantic feature that was never represented linguistically. Semantic features were more explicit when they occurred in gesture than when represented linguistically. Even in cases where the (...) imagistic gesture appeared somewhat redundant, gesture at the narrative level preserves a discernable communicative function. (shrink)

This study is concerned with the organisation of gestural phases of non-movement, in particular the prolonged hold and provisional home position, as accountably and in situ produced segments of behaviour. Through fine-grained transcriptions and multimodal analysis of videotaped conversation in natural and everyday settings, it is found that movement phases may be exploited by participants in order to indicate that a pursued trajectory or line of action is maintained, suspended or abandoned. Also, through constant monitoring, participants may adjust the location (...) of non-movement as the interaction unfolds in time. It is argued that various possible locations of non-movement are arranged along a continuum ranging from the space of gesticulation to a relaxed rest position and that these locations reflect various degrees of involvement or claim of speakership in the gesturer. (shrink)

This study investigates metaphoric gestures in face-to-face conversation. It is found that gestures of this kind are mainly performed in the central gesture space with noticeable and discernable configurations, providing visible evidence for cross-domain cognitive mappings and the grounding of conceptual metaphors in people's recurrent bodily experiences and in what people habitually do in social and cultural practices. Moreover, whether metaphorical thinking is conveyed by gesture exclusively or along with metaphoric speech, the manual enactment of even conventional metaphors manifests dynamism (...) in communicating metaphors. Metaphoric gestures can provide salient, additional information about the aspect of the conceptualization which is the speaker's focus of attention in real-time multimodal communication. (shrink)

Research on collective emotion spans social sciences, psychology and philosophy. There are detailed case studies and diverse theories of collective emotion. However, experimental evidence regarding the universal characteristics, antecedents and consequences of collective emotion remains sparse. Moreover, current research mainly relies on emotion self-reports, accounting for the subjective experience of collective emotion and ignoring their cognitive and physiological bases. In response to these challenges, we argue for experimental research on collective emotion. We start with an overview of theoretical frameworks to (...) identify a set of three characteristics of collective emotion. Based on research in cognitive and affective sciences, we then examine the corresponding candidate mechanisms. Finally, we highlight outstanding questions, review experimental evidence, and suggest ideas for future experimental research. (shrink)

Classical theories of emotion have long debated the extent to which human emotion is a universal or culturally constructed experience. Recent advances in emotion research in cultural neuroscience highlight several aspects of emotional generation and experience that are both phylogenetically conserved as well as constructed within human cultural contexts. This review highlights theories and methods from cultural neuroscience that examine how cultural and biological processes shape emotional generation, experience, and regulation across multiple time scales. Recent advances in the neurobiological basis (...) of culture-bound syndromes, such as Hwa-Byung (fire illness), provide further novel insights into emotion and mental health across cultures. Implications for emotion research in cultural neuroscience for population health disparities in psychopathology and global mental health will be discussed. (shrink)

Our claim in this paper is that a theory of “pretense” (in all its crucial uses in human society and cognition) can be built only if it is grounded on the general theory of “behavioral implicit communication” (BIC), which is not to be confused with non-verbal communication (with distinct notions being frequently conflated, such as “signs” vs. “messages”, or goal as “intention” vs. goal as “function”). Pretense presupposes some BIC-based human interaction, where a normal, practical behavior is used for signifying (...) something, based on a sign that is not a conventional one. In light of BIC interaction theory, one can exploit this sign or message in a deceptive way in order to induce the other to believe that he/she is performing a given behavior or has a given mental state. -/- . (shrink)

This paper presents a proposal for the description of gesture phases derived from articulatory characteristics observable in their execution. Based on the results of an explorative study examining the execution of gesture phases of ten German speakers, the paper presents two sets of articulatory features, i.e., distinctive and additional features by which gesture phases are characterized from a context-independent and context-sensitive point of view. It will be shown that gesture phases show a particular distribution of the features, thus distinguishing one (...) phase from another. Furthermore, changes in the execution of phases in linear successions can be described by means of features. Contrary to other accounts, whose focus on gesture phases is primarily in relation to speech and/or adjacent phases, this proposal concentrates on the visible physical characteristics of gesture phases. (shrink)