Intersemiotic translation (IT) was defined by Roman Jakobson (The Translation Studies Reader, Routledge, London, p. 114, 2000) as “transmutation of signs”—“an interpretation of verbal signs by means of signs of nonverbal sign systems.” Despite its theoretical relevance, and in spite of the frequency in which it is practiced, the phenomenon remains virtually unexplored in terms of conceptual modeling, especially from a semiotic perspective. Our approach is based on two premises: (i) IT is fundamentally a semiotic operation process (semiosis) and (ii) (...) IT is a deeply iconic-dependent process. We exemplify our approach by means of literature to dance IT and we explore some implications for the development of a general model of IT. (shrink)

Although pantomimic scenarios recur in the most important historical as well as current accounts of language origins, a serious problem is the lack of a commonly accepted definition of “pantomime”. We scrutinise several areas of study, from theatre studies to semiotics to primatology, pointing to the differences in use that may give rise to misunderstandings, and working towards a set of definitional criteria of “pantomime” specifically useful for language evolution research. We arrive at a definition of pantomime as a communication (...) mode that is mimetic; non-conventional and motivated; multimodal ; improvised; using the whole body rather than exclusively manual; holistic; communicatively complex and self-sufficient; semantically complex; displaced, open-ended and universal. So conceived, “pantomime” is a near synonym of “bodily-mimetic communication” as envisaged by Donald and Zlatev. On a wider plane, our work may help organise some of the terminology and discussion in language evolution, e.g. by drawing a clear distinction between gestural and pantomimic scenarios or by specifying the relation between pantomimic and multimodal scenarios. (shrink)

Using a cross-modal semantic priming paradigm, both experiments of the present study investigated the link between the mental representations of iconic gestures and words. Two groups of the participants performed a primed lexical decision task where they had to discriminate between visually presented words and nonwords (e.g., flirp). Word targets (e.g., bird) were preceded by video clips depicting either semantically related (e.g., pair of hands flapping) or semantically unrelated (e.g., drawing a square with both hands) gestures. The duration of gestures (...) was on average 3,500 ms in Experiment 1 but only 1,000 ms in Experiment 2. Significant priming effects were observed in both experiments, with faster response latencies for related gesture–word pairs than unrelated pairs. These results are consistent with the idea of interactions between the gestural and lexical representational systems, such that mere exposure to iconic gestures facilitates the recognition of semantically related words. (shrink)

The goal of this paper is to explore, from a phenomenologically informed perspective, the phenomenon of the operative spatialization of human thinking, viewed in its relationship with the embodied human organism’s spatial experience. Operative spatialization in this context refers to the cognitive role and functioning of spatial schematizations and differentiations in human thinking. My particular focus is the domain of conceptualization. By drawing on Husserl’s discussion of the (linguistic) process of a sedimentation of meaning, I aim to show that spatialization (...) functions in a structurally ambivalent manner. On the one hand, spatialization predisposes and thus narrows the scope of human conceptual thought. On the other hand, spatialization establishes an implicit cognitive scaffold indispensable for the development and practice of human higher-order thinking. The structure and functioning of this scaffold, I argue, is intrinsically related to the spatial structure and dynamics of human embodiment. Synthesizing insights from phenomenological studies concerning the experiential constitution of space, and classic and recent research findings from fields such as cognitive linguistics and psychology concerning the cognitive dimension of image-schemas and gestural behavior, I argue that the living human body functions centrally as the sense-constitutive ‘site of conversion’ (Husserl) between concrete structures of spatial experience and abstract structures of conceptual thought. (shrink)

The set of design features developed by Charles Hockett in the 1950s and 1960s remains probably the most influential means of juxtaposing animal communication with human language. However, the general theoretical perspective of Hockett is largely incompatible with that of modern language evolution research. Consequently, we argue that his classificatory system—while useful for some descriptive purposes—is of very limited use as a theoretical framework for evolutionary linguistics. We see this incompatibility as related to the ontology of language, i.e. deriving from (...) Hockett’s interest in language as a product rather than a suite of sensorimotor, cognitive and social abilities that enable the use but also acquisition of language by biological creatures. After a reconstruction of Hockett’s views on design features, we raise two criticisms: focus on the means at the expense of content and focus on the code itself rather than the cognitive abilities of its users. Finally, referring to empirical data, we illustrate some of the problems resulting from Hockett’s approach by addressing three specific points—namely arbitrariness and semanticity, cultural transmission, and displacement—and show how the change of perspective allows to overcome those difficulties. (shrink)

The present study investigates the types of verb and symbolic representational strategies used by 10 deaf signing adults and 13 deaf signing children who described in Italian Sign Language 45 video clips representing nine action types generally communicated by five general verbs in spoken Italian. General verbs, in which the same sign was produced to refer to several different physical action types, were rarely used by either group of participants. Both signing children and adults usually produced specific depicting predicates by (...) incorporating, through a representational strategy, the object and/or the modality of the action into the sign. As for the different types of representational strategies, the adults used the hand-as-object strategy more frequently than the children, who, in turn, preferred to use the hand-as-hand strategy, suggesting that different degrees of cognitive complexity are involved in these two symbolic strategies. Addressing the symbolic iconic strategies underlying sign formation could provide new insight into the perceptual and cognitive processes of linguistic meaning construction. The findings reported here support two main assumptions of cognitive linguistics applied to sign languages: there is a strong continuity between gestures and language; lexical units and depicting constructions derive from the same iconic core mechanism of sign creation. (shrink)

I engage phenomenological and empirical perspectives on dialogical relations in infancy in a mutually enlightening and challenging relation. On the one hand, the empirical contributions provide evidence for the primacy of first-to-second person interrelatedness in human sociality, as opposed to the claim of primary syncretism heralded by Merleau-Ponty, and also in distinction from the ego-alter ego model routinely used in phenomenology. On the other hand, phenomenological considerations regarding the lived affective experience of dialogical relatedness enrich and render intelligible the psychological (...) accounts of dialogue in terms of observable behavior. Phenomenological and empirical perspectives on dialogical relatedness thus combine to offer an affectively charged and conversationally patterned notion of primary intersubjectivity in the I-you mode. (shrink)

ASL can express plurals by repeating a noun, in an unpunctuated fashion, in different parts of signing space. We argue that this construction may come with a rich iconic component: the geometric arrangement of the repetitions provides information about the arrangement of the denoted plurality; in addition, the number and speed of the repetitions provide information about the size of the denoted plurality. Interestingly, the shape of the repetitions may introduce a new singular discourse referent when a vertex can be (...) inferred to denote a singular object. Thus one may point towards the first or last iteration of a horizontal repetition of BOOK to denote the left- or right-edge of the corresponding row. This yields a remarkable interaction between iconic semantics and standard logical semantics. We show that our analysis extends to ‘punctuated’ repetitions, which involve clearly individuated iterations of a singular noun. While these may initially look like coordinated indefinites, they are better handled by the same iconic framework as plural, unpunctuated repetitions. Some repetition-based mass terms also give rise to iconic effects, and to different readings depending on whether the repetition is continuous, unpunctuated, or punctuated. Our analysis highlights the need for a formal semantics with iconicity to study the integration of such iconic and logical conditions. It also raises a question: can similar facts be found in spoken language when gestures are taken into account? We suggest that several effects can be replicated, especially when one considers examples involving ‘pro-speech gestures’. (shrink)

In dynamic theories of presupposition, a trigger pp′ with presupposition p and at-issue component p′ comes with a requirement that p should be entailed by the local context of pp′. We argue that some co-speech gestures should be analyzed within a presuppositional framework, but with a twist: an expression p co-occurring with a co-speech gesture G with content g comes with the requirement that the local context of p should guarantee that p entails g; we call such assertion-dependent presuppositions ‘cosuppositions’. (...) We show that this analysis can be combined with earlier theories of local contexts to account for complex patterns of gesture projection in quantified and in attitudinal contexts, and we compare our account to two potential alternatives: one based on supervaluations, and one, due to Cornelia Ebert, that treats co-speech gestures as supplements. We argue that the latter is correct, but for ‘post-speech’ gestures, rather than for co-speech gestures. (shrink)

When learners self-explain, they try to make sense of new information. Although research has shown that bodily actions and written notes are an important part of learning, previous analyses of self-explanations rarely take into account written and non-verbal data produced spontaneously. In this paper, the extent to which interpretations of self-explanations are influenced by the systematic consideration of such data is investigated. The video recordings of 33 undergraduate students, who learned with worked-out examples dealing with complex numbers, were categorized successively (...) including three different data bases: verbal data, verbal and written data, and verbal, written and non-verbal data. Results reveal that including written data and non-verbal data leads to a more accurate analysis of self-explanations than an analysis solely based on verbal data. This influence is even stronger for the categorization of self-explanations as adequate or inadequate. (shrink)

While recent studies have claimed that non-referential gestures are used to mark discourse-new and/or -accessible referents and focused information in adult speech, to our knowledge, no prior investigation has studied the relationship between information structure and gesture referentiality in children’s narrative speech from a developmental perspective. A longitudinal database consisting of 332 narratives performed by 83 children at two different time points in development was coded for IS and gesture referentiality. Results revealed that at both time points, both referential and (...) non-referential gestures were produced more with information that moves discourse forward and predication rather than topical or background information. Further, at 7–9 years of age, children tended to use more non-referential gestures to mark focus and comment constituents than referential gestures. In terms of the marking of the newness of discourse referents, non-referential gestures already seem to play a key role at 5–6 years old, whereas referential gestures did not show any patterns. This relationship was even stronger at 7–9 years old. All in all, our findings offer supporting evidence that in contrast with referential gestures, non-referential gestures have been found to play a key role in marking IS, and that the development of this relationship solidifies at a period in development that coincides with a spurt in non-referential gesture production. (shrink)

Theories of embodied cognition hypothesize interdependencies between psychological well-being and physical posture. The purpose of this study was to assess the feasibility of objectively measuring posture, and to explore the relationship between posture and affect and other patient centered outcomes in breast cancer survivors with persistent postsurgical pain over a 12-week course of therapeutic Qigong mind-body training. Twenty-one BCS with PPSP attended group Qigong training. Clinical outcomes were pain, fatigue, self-esteem, anxiety, depression, stress and exercise self-efficacy. Posture outcomes were vertical (...) spine and vertical head angles in the sagittal plane, measured with a 3D motion capture system in three conditions: eyes open, eyes open relaxed and eyes closed. Assessments were made before and after the Qigong training. The association between categorical variables was measured by Cramer’s V. In the EO condition, most participants who improved in fatigue and anxiety scales also had better vertical head values. For the EOR condition, a moderate correlation was observed between changes in vertical head angle and changes in fatigue scale. In the EC condition, most of the participants who improved in measures of fatigue also improved vertical head angle. Additionally, pain severity decreased while vertical spine angle improved. These preliminary findings support that emotion and other patient centered outcomes should be considered within an embodied framework, and that Qigong may be a promising intervention for addressing biopsychosocially complex interventions such as PPSP in BCSs. (shrink)

This paper has two objectives. The first is to formulate a critique of present-day cognitive linguistics concerning the inner workings of the cognitive system during language use, and the second is to put forward an alternative account that is inspired by the phenomenology of Merleau-Ponty. Due to its third-person methodology, CL views language use essentially as a problem-solving activity, as coping with two subproblems: the problem of minimum and maximum, which consists in selecting the appropriate expression out of an unlimited (...) multitude of possibilities, and the problem of the underdetermination of signification. This approach presupposes a notion of an isolated subject and a representationalist view of perception. We defend an alternative view of man's relation to the world in which intersubjectivity is constitutive of embodied subjectivity and which exchanges the representationalist view of perception for a direct nonrepresentationalism. We describe the ensuing view of linguistic action as intra- and interpersonal “all-at-onceness.” This approach dismisses the two subproblems CL implicitly identifies as constitutive of language use. The first is countered by rethinking what it means to be a situated speaking subject and results in the concept of “style.” The second is tackled by opposing the concept of “overdetermination” to CL's notion of underdetermination. (shrink)

This paper describes our general framework for the investigation of how human gestures can be used to facilitate the interaction and communication between humans and robots. Two studies were carried out to reveal which “naturally occurring” gestures can be observed in a scenario where users had to explain to a robot how to perform a home task. Both studies followed a within-subjects design: participants had to demonstrate how to lay a table to a robot using two different methods — utilizing (...) only gestures or gestures and speech. The first study enabled the validation of the COGNIRON coding scheme for human gestures in Human–Robot Interaction. Based on the data collected in both studies, an annotated video corpus was produced and characteristics such as frequency and duration of the different gestural classes have been gathered to help capture requirements for the designers of HRI systems. The results from the first study regarding the frequencies of the gestural types suggest an interaction between the order of presentation of the two methods and the actual type of gestures produced. However, the analysis of the speech produced along with the gestures did not reveal differences due to ordering of the experimental conditions. The second study expands the issues addressed by the first study: we aimed at extending the role of the interaction partner by introducing some positive acknowledgement of the participants’ activity. The results show no significant differences in the distribution of gestures between the two explanation methods, in contrast to the previous study. Implications for HRI are discussed focusing on issues relevant for the design of the robot’s communication skills to support the interaction loop with humans in home scenarios. (shrink)

Journal Name: Semiotica Issue: Ahead of print.

Recently, in cognitive science, the enactivist account of cognition has been gaining ground, due in part to studies of movement in conjunction with thought. The idea, as Noë , has put it, that “cognition is not something happening inside us or to us, but it’s something we do, something we achieve,” is increasingly supported by research on joint attention, movement coordination, and gesture. Not surprisingly, therefore, enactivists have also begun to look at “movement specialists”—dancers—for both scientific and phenomenological accounts of (...) thinking with and through movement. In this paper, I argue that a serious exploration of dance and movement does not merely bolster the enactivist view, but rather, it suggests a radical enactivism, as envisaged by, e.g., Hutto . To support this claim, I examine an account of “Thinking in Movement” provided by Maxine Sheets-Johnstone in order to highlight the ways in which intentional agency and meaning-making occur in improvisational dance. These processes, I further argue, closely mirror some of the key components of participatory sense making, as described by De Jaegher and Di Paolo :485–507, 2007). This is beneficial to my case, because it permits a discussion of “thought-full action” that does not depend upon standard cognitivist frameworks for explanation. By carefully focusing on how agency can help to separate mere “thrashing about” from meaningful movement, this paper aim to strengthen the position of radical enactivism from the unique perspective and dance and sense-making. (shrink)

Did protolanguage users use discrete words that referred to objects, actions, locations, etc., and then, at some point, combine them; or on the contrary did they have words that globally indexed whole semantic complexes, and then come to divide them? Our answer is: early humans were forming language units consisting of global and discrete dimensions of semiosis in dynamic opposition. These units of thinking-for-speaking, or ‘growth points’ (GPs) were, jointly, analog imagery (visuo-spatio-motoric) and categorically-contrastive (-emic) linguistic encodings. This discrete-global duality (...) was a new mode of embodied cognition that enabled thinking and acting in new ways: the dawn of protolanguage. Where did this mode of cognition come from? We have some suggestions based on the hypothesis that gestures gained the power to orchestrate actions, manual and vocal, with significances other than those of the actions themselves, giving rise to cognition framed in the proposed dual terms. Note, however, our proposal is not one of the ‘gesture-first’ theories of language origins. Such theories predict what did not evolve: a language of pantomime; rather than what did evolve: an integrated system of synchronized gestures and spoken forms. GP theory is an account of the cognition underlying such an integrated system. A scenario for the evolutionary selection of this cognitive mode is ‘Mead’s Loop’, a model in which one’s cognition is enriched by one’s own gestures, insofar as they are objects in social interactions. (shrink)

Art theory has consistently emphasised the importance of situational, cultural, institutional and historical factors in viewers’ experience of fine art. However, the link between this heavily context-dependent interpretation and the workings of the mind is often left unexamined. Drawing on relevance theory—a prominent, cogent and productive body of work in cognitive pragmatics—we here argue that fine art achieves its effects by prompting the use of cognitive processes that are more commonly employed in the interpretation of words and other stimuli presented (...) in a communicative context. We describe in particular how institutional factors effectively co-opt these processes for new ends, allowing viewers to achieve cognitive effects that they otherwise would not, and so provide cognitivist backing for an Institutional Theory of Art, such as that put forward by Arthur Danto. More generally, we situate and describe the Western fine art tradition as a phenomenon that is a consequence of both the cognitive processes involved in communication, and of cultural norms, practices and institutions. (shrink)

In previous analyses of the influence of language on cognition, speech has been the main channel examined. In studies conducted among Yucatec Mayas, efforts to determine the preferred frame of reference in use in this community have failed to reach an agreement (Bohnemeyer & Stolz, 2006; Levinson, 2003 vs. Le Guen, 2006, 2009). This paper argues for a multimodal analysis of language that encompasses gesture as well as speech, and shows that the preferred frame of reference in Yucatec Maya is (...) only detectable through the analysis of co-speech gesture and not through speech alone. A series of experiments compares knowledge of the semantics of spatial terms, performance on nonlinguistic tasks and gestures produced by men and women. The results show a striking gender difference in the knowledge of the semantics of spatial terms, but an equal preference for a geocentric frame of reference in nonverbal tasks. In a localization task, participants used a variety of strategies in their speech, but they all exhibited a systematic preference for a geocentric frame of reference in their gestures. (shrink)

From the late 1950s until 1975, cognition was understood mainly as disembodied symbol manipulation in cognitive psychology, linguistics, artificial intelligence, and the nascent field of Cognitive Science. The idea of embodied cognition entered the field of Cognitive Linguistics at its beginning in 1975. Since then, cognitive linguists, working with neuroscientists, computer scientists, and experimental psychologists, have been developing a neural theory of thought and language (NTTL). Central to NTTL are the following ideas: (a) we think with our brains, that is, (...) thought is physical and is carried out by functional neural circuitry; (b) what makes thought meaningful are the ways those neural circuits are connected to the body and characterize embodied experience; (c) so-called abstract ideas are embodied in this way as well, as is language. Experimental results in embodied cognition are seen not only as confirming NTTL but also explained via NTTL, mostly via the neural theory of conceptual metaphor. Left behind more than three decades ago is the old idea that cognition uses the abstract manipulation of disembodied symbols that are meaningless in themselves but that somehow constitute internal “representations of external reality” without serious mediation by the body and brain. This article uniquely explains the connections between embodied cognition results since that time and results from cognitive linguistics, experimental psychology, computational modeling, and neuroscience. (shrink)

The aim of this essay is to situate the thought of Tetsurō Watsuji within contemporary approaches to social cognition. I argue for Watsuji’s current relevance, suggesting that his analysis of embodiment and social space puts him in step with some of the concerns driving ongoing treatments of social cognition in philosophy of mind and cognitive science. Yet, as I will show, Watsuji can potentially offer a fruitful contribution to this discussion by lending a phenomenologically informed critical perspective. This is because (...) Watsuji challenges the internalist and cognitivist presuppositions informing the currently dominant “Theory of Mind” paradigm that is driving much social cognition research. Additionally, I show that Watsuji’s alternative model is not merely confined to the realm of phenomenological description but that it also receives robust empirical support from a number of different sources. I thus hope to open up aspects of Watsuji’s thinking that have yet to be fully appreciated. (shrink)

The framework of depicting put forward byClark (2016)offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-embedded nonverbal depictions,” namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American (...) TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance. (shrink)

Despite recommendations for a more reflexive and theoretical turn to interviewing, the analysis of language and speech still occupies center stage. This study attempts to advance our understanding of the interview by including the use of gesture, gaze, and other embodied resources in concert with speech. Looking at a focus group interview evaluating community policing policy, I show how inclusion of embodied conduct offers a more robust approach to co-constructed meaning in the interview than looking at language practices alone. More (...) explicitly, I investigate how an interviewee’s narrative includes gestures to solicit an affiliative stance from other interviewees and how ambiguous metacommunicative norms in the focus group influence the contributions of other police participants. I show how jurisdictional boundary and professional identity emerge in and through the integration of embodied conduct and sociocultural solidarity. (shrink)

The extended mind hypothesis (Clark and Chalmers in Analysis 58(1):7–19, 1998; Clark 2008) is an influential hypothesis in philosophy of mind and cognitive science. I argue that the extended mind hypothesis is born to be wild. It has undeniable and irrepressible tendencies of flouting grounding assumptions of the traditional information-processing paradigm. I present case-studies from social cognition which not only support the extended mind proposal but also bring out its inherent wildness. In particular, I focus on cases of action-understanding and (...) discuss the role of embodied intentionality in the extended mind project. I discuss two theories of action-understanding for exploring the support for the extended mind hypothesis in embodied intersubjective interaction, namely, simulation theory and a non-simulationist perceptual account. I argue that, if the extended mind adopts a simulation theory of action-understanding, it rejects representationalism. If it adopts a non-simulationist perceptual account of action-understanding, it rejects the classical sandwich view of the mind. (shrink)

Issue Title: Logic, Meaning, and Truth-Making States of Affairs in Philosophical Semantics/Guest Edited by Dale Jacquette.

Although there are many points of continuity, there are also a number of changes in the pedagogical form of the anatomy lecture over the longue durée, over centuries of epistemic change, rather than over years or decades. The article begins with an analysis of the physical and technical arrangements of the early modern anatomy lecture, showing how these present a general underlying similarity compared to those in place today. It then goes on to consider examples of elements of speech and (...) presentation, description and illustration that are used in the biology lecture from the early modern (sixteenth to seventeenth centuries) and late modern (or contemporary) eras. The anatomy lecture thus demonstrates a basic physical and technical continuity in the classroom or theater, whereas the larger epistemic functions in which it is embedded have changed: from a descriptive, discursive function, focusing on individual organs and their physicality, to one that is more integrative, systemic and also performative in both form and content. (shrink)

Although for many years a sharp distinction has been made in language research between rules and words—with primary interest on rules—this distinction is now blurred in many theories. If anything, the focus of attention has shifted in recent years in favor of words. Results from many different areas of language research suggest that the lexicon is representationally rich, that it is the source of much productive behavior, and that lexically specific information plays a critical and early role in the interpretation (...) of grammatical structure. But how much information can or should be placed in the lexicon? This is the question I address here. I review a set of studies whose results indicate that event knowledge plays a significant role in early stages of sentence processing and structural analysis. This poses a conundrum for traditional views of the lexicon. Either the lexicon must be expanded to include factors that do not plausibly seem to belong there; or else virtually all information about word meaning is removed, leaving the lexicon impoverished. I suggest a third alternative, which provides a way to account for lexical knowledge without a mental lexicon. (shrink)

Cognitive ecology is the study of cognitive phenomena in context. In particular, it points to the web of mutual dependence among the elements of a cognitive ecosystem. At least three fields were taking a deeply ecological approach to cognition 30 years ago: Gibson’s ecological psychology, Bateson’s ecology of mind, and Soviet cultural-historical activity theory. The ideas developed in those projects have now found a place in modern views of embodied, situated, distributed cognition. As cognitive theory continues to shift from units (...) of analysis defined by inherent properties of the elements to units defined in terms of dynamic patterns of correlation across elements, the study of cognitive ecosystems will become an increasingly important part of cognitive science. (shrink)

Denis Noble has produced a succinct analysis of the ‘Illusions of the Modern Synthesis’. At the heart of the matter is the place of agency in organisms. This paper examines the nature of conscious agent action in organisms, and the role of affects in shaping agent choice. It examines the dual role these have in shaping evolution, and in the social worlds of scientists that shape evolutionary theory. Its central claim follows Noble, that agency is central to the structure of (...) organisms, and raises careful consideration for the role animal agency and affective evaluations in biology, and in biologists. (shrink)

This paper considers the importance of the body for self-esteem, communication, and emotional expression and experience, through the reflections of those who live with various neurological impairments of movement and sensation; sensory deafferentation, spinal cord injury and Möbius Syndrome. People with severe sensory loss, who require conscious attention and visual feedback for movement, describe the imperative to use the same strategies to reacquire gesture, to appear normal and have embodied expression. Those paralysed after spinal cord injury struggle to have others (...) see them as people rather than as people in wheelchairs and have been active in the disability movement, distinguishing between their medical impairment and the social induced disability others project onto them. Lastly those with Möbius reveal the importance of the face for emotional expression and communication and indeed for emotional experience itself. All these examples explore the crucial role of the body as agent for social and personal expression and self-esteem. (shrink)

This study is concerned with the organisation of gestural phases of non-movement, in particular the prolonged hold and provisional home position, as accountably and in situ produced segments of behaviour. Through fine-grained transcriptions and multimodal analysis of videotaped conversation in natural and everyday settings, it is found that movement phases may be exploited by participants in order to indicate that a pursued trajectory or line of action is maintained, suspended or abandoned. Also, through constant monitoring, participants may adjust the location (...) of non-movement as the interaction unfolds in time. It is argued that various possible locations of non-movement are arranged along a continuum ranging from the space of gesticulation to a relaxed rest position and that these locations reflect various degrees of involvement or claim of speakership in the gesturer. (shrink)

Why does symbolic communication in humans develop primarily in an oral medium, and how do theories of language origin explain this? Non-human primates, despite their ability to learn and use symbolic signs, do not develop symbols as in oral language. This partly owes to the lack of a direct cortico-motoneuron control of vocalizations in these species compared to humans. Yet such modality-related factors that can impinge on the rise of symbolic language are interpreted differently in two types of evolutionary storylines. (...) 1) Some theories posit that symbolic language originated in a gestural modality, as in “sign languages”. However, this overlooks work on emerging sign and spoken language showing that gestures and speech shape signs differently. 2) In modality-dependent theories, some emphasize the role of iconic sounds, though these lack the efficiency of arbitrary symbols. Other theorists suggest that ontogenesis serves to identify human-specific mechanisms underlying an evolutionary shift from pitch varying to orally-modulated vocalizations (babble). This shift creates numerous oral features that can support efficient symbolic associations. We illustrate this principle using a sound-picture association task with 40 learners who hear words in an unfamiliar language (Mandarin) with and without a filtering of oral features. Symbolic associations arise more rapidly and accurately for sounds containing oral features compared to sounds bearing only pitch features, an effect also reported in experiments with infants. The results imply that, beyond a competence to learn and use symbols, the rise of symbolic language rests on the types of signs that a modality of expression affords. (shrink)

The face is a shifting, multiplex, distributed and layered phenomenon. It is by far the most mercurial feature of the human body, and even a single face cannot be isolated in, on or outside any one body. In the following discussion I will employ a variety of differing accounts of the face and suggest that the differences separating each account are merely reflective of the multiplex nature of the face itself.

ABSTRACTThe paper compares Mead’s and Quine’s behaviouristic theories of meaning and language, focusing in particular on Mead’s notion of sympathy and Quine’s notion of empathy. On the one hand, Quine seems to resort to an explanation similar to Mead’s notion of sympathy, referring to ‘empathy’ in order to justify the human ability to project ourselves into the witness’s position; on the other hand, Quine’s reference to the notion of empathy paves the way to a more insightful comparison between Mead’s behaviourism (...) and an explanation of the emergence of the linguistic from pre-linguistic communication based on empathic identification processes. However, Mead is less ambiguous than Quine in his use of the notion of sympathy finds a fecund parallel in the current neuroscientific and neuro-phenomenological hypothesis on ‘empathy’. The article contends that the ambiguity in Quine’s account of empathy is due to the exigency of trying to elucidate the link between the rules of language in a cultural context and... (shrink)