Event integration – the conflation of multiple events into a unitary event – plays a vital role in language and cognition. However, the conditions under which event integration occurs in linguistic representation and the differences in how linguistic forms encode complex events remain unclear. This corpus study examines two types of Japanese complex predicates – compound verbs [V1-V2]V and complex predicates consisting of a deverbal compound noun and the light verb suru ‘do’ [[V1-V2]N suru]V – using an original “related-event approach”. (...) Findings indicate that [[V1-V2]N suru]V can be established based on coextensiveness alone, whereas [V1-V2]V typically requires direct or shared causality (“the inevitable co-occurrence constraint”). The related-event approach examines related events of linguistic concepts, such as causes and purposes of an event, identified through “complex sentences” from ultra-large-scale web corpora. This study demonstrates that such an approach is effective in clarifying causal relationships between verbs. Furthermore, this paper contributes to the “iconicity versus frequency” debate by showing that conceptually more accessible events (causality plus coextensiveness) tend to be represented in a simpler form than less accessible events (coextensiveness only), due to “efficiency”. The frequency of usage is a result of the nature of concepts rather than the driving force of coding asymmetries. (shrink)

The paper develops a new holistic theory of the word by integrating semiotic, linguistic, and psychological perspectives and introduces the Cogitative-Sensory Word Model, the CogSens Model, that unites the human mind and body. Saussure’s two-sided sign is replaced by a Peirce-inspired three-sided conception in which the expression unit mediates two content units, namely, an idea content connected to the human mind and an image content linked to the human body. It is argued that it is the word that makes human (...) language a unique tool of communication. Moreover, it is demonstrated how words interact with grammar to create an utterance. Finally, it is suggested that speech perception, i.e., fission of idea and image content, is the mirror image of speech production, i.e., fusion of idea and image content. (shrink)

Intersemiotic translation (IT) was defined by Roman Jakobson (The Translation Studies Reader, Routledge, London, p. 114, 2000) as “transmutation of signs”—“an interpretation of verbal signs by means of signs of nonverbal sign systems.” Despite its theoretical relevance, and in spite of the frequency in which it is practiced, the phenomenon remains virtually unexplored in terms of conceptual modeling, especially from a semiotic perspective. Our approach is based on two premises: (i) IT is fundamentally a semiotic operation process (semiosis) and (ii) (...) IT is a deeply iconic-dependent process. We exemplify our approach by means of literature to dance IT and we explore some implications for the development of a general model of IT. (shrink)

I argue that an evolutionary adaptation for bodily mimesis, the volitional use of the body as a representational devise, is the “small difference” that gave rise to unique and yet pre-linguistic features of humanity such as imitation, pedagogy, intentional communication and the possibility of a cumulative, representational culture. Furthermore, it is this that made the evolution of language possible. In support for the thesis that speech evolved atop bodily mimesis and a transitional multimodal protolanguage, I review evidence for the extensive (...) presence of sound-symbolism in modern languages, for its psychological reality in adults, and for its contribution to language acquisition in children. On a meta-level, the argument is that dividing human cognitive-semiotic evolution into a sequence of stages is crucial for resolving classical dichotomies concerning human nature and language, which are both natural and cultural, both continuous with and discontinuous from those of animals. (shrink)

Several language experiments have been carried out on apes and other animals aiming to narrow down the presumed qualitative gap that separates humans from other animals. These experiments, however, have been driven by the understanding of language as a purely symbolic sign system, often connected to a profound disinterest for language use in real situations and a propensity to perceive grammatical and syntactic information as the only fundamental aspects of human language. For these reasons, the language taught to apes tends (...) to discard iconic and indexical elements in favour of symbolic signs. This paper sheds light on the iconic components of human language, with close attention to the iconic properties of language as present in the ape language experiments. We emphasise the role of the body in the interpretation and production of iconic signs, while demonstrating the need to take into account the Umwelt theory in the research paradigm of the experiments. Uexküll’s Umwelt theory is used to exemplify the methodological problems connected to the teaching of human language to other animal species; furthermore, we discuss how the modelling capacities of language affect the biological layer that constitutes the animal Umwelt. Language is analysed as a particular case of Umwelt transition, and as such its implications are further discussed in the article. With this paper, we enrich the discussion surrounding the human-ape pidgin language by advocating for the need to include iconic components as vital parts of this research area. With this inclusion, we uncover the inter-dependency of iconic, indexical and symbolic signs in human language, aiming to further develop the research paradigm of the ape language experiments. (shrink)

Certain nonwords, like maluma and takete, are associated with roundness and sharpness, respectively. However, this has typically been demonstrated using explicit tasks. We investigated whether this association would be detectable using a more implicit measure—a sequential priming task. We began with a replication of the standard Maluma/Takete effect before examining whether round and sharp nonword primes facilitated the categorization of congruent shapes. We found modest evidence of a priming effect in response accuracy. We next examined whether nonword primes affected categorization (...) of ambiguous shapes, using visual and auditory primes. We found that ambiguous shapes were categorized as round more often following the presentation of a round nonword. This suggests that phonemes may activate related shape information which then affects the processing of shapes, and that this association emerges even when participants are not explicitly searching for it. (shrink)

Human communication is by defaultpolysemiotic: it involves the spontaneous combination of two or moresemiotic systems, the most important ones beinglanguage,gesture, anddepiction. We formulate an original cognitive-semiotic framework for the analysis of polysemiosis, contrasting this with more familiar systems based on the ambiguous term “multimodality.” To be fully explicit, we developed a coding system for the analysis of polysemiotic utterances containing speech, gesture, and drawing, and implemented this in the ELAN video annotation software. We used this to analyze 23 video-recordings of (...) sand drawing performances on Paama, Vanuatu and 20 sand stories of the Pitjantjatjara culture in Central Australia. Methodologically we used theconceptual-empirical loopof cognitive semiotics: our theoretical framework guided general considerations, such as distinguishing between the “tiers” of gesture and depiction, and the three kinds of semiotic grounds (iconic, indexical, symbolic), but the precise decisions on how to operationalize these were made only after extensive work with the material. We describe the coding system in detail and provide illustrative examples from the Paamese and Pitjantjatjara data, remarking on both similarities and differences in the polysemiosis of the two cultural practices. We conclude by summarizing the contributions of the study and point to some directions for future research. (shrink)

Cognitive Science, Volume 46, Issue 10, October 2022.

The framework of depicting put forward byClark (2016)offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-embedded nonverbal depictions,” namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American (...) TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance. (shrink)

Our study focuses on the perception of the iconicity of handshapes – one of the formational parameters of the sign in signed language. Seventy Hebrew speakers were asked to match handshapes to Hebrew translations of 45 signs, which are specified for one of the handshapes in Israeli Sign Language. The results show that participants reliably match handshapes to corresponding sign translations for highly iconic signs, but are less accurate for less iconic signs. This demonstrates that there is a notable degree (...) of iconicity in the lexicon of ISL, which is recognizable even to non-signers. The ability of non-signers to detect handshape to form is explained by the fact that word meanings are understood by both deaf and hearing peoples via the mental elaboration of simple iconic sources in which handshape meanings are grounded. The results suggest that while language external iconic mapping could ease the learning of direct iconic forms, it has a more limited capacity to help hearing non-signers learn indirect and opaque forms. The full semiotic distribution of handshapes in the lexicon and their use in language remain difficult for hearing non-signers to understand and depends on more specific language and cultural knowledge. (shrink)

In the present study, cross-modal (i.e., across sensory modalities such as smell and sound) iconicity (i.e., resemblance) and indexicality (i.e., contiguity) in lexical sensory and emotional signs in Finnish Sign Language will be considered from an articulatory perspective (i.e., the production of signs). Such cross-modal iconicity has not been extensively studied previously, so here, with the help of cognitive semiotics, I aim to carefully describe the cross-modal patterns observed across 118 signs, including 60 sensory signs and 58 emotional signs. The (...) analysis is framed within the theoretical model of Semiotic Hierarchy, which entails a non-reductionist view of meaning. In addition, a pheno-methodological triangulation will be applied: phenomenology (first-person method), literature of phenomenological and semiotic descriptions (second-person perspective) and experimental findings (third-person perspective). The results of this analysis show that (a) 71 of the 118 sensory and emotional signs are cross-modally indexical, (b) only 10 of the 71 signs can be regarded as cross-modally iconic, (c) cross-modal iconicity is highly diagrammatic, (d) iconicity and indexicality are highly integrated, and (e) articulatory feedback matters in the formation of semiotic patterns. This study contributes to our understanding of cross-modal iconicity in signed languages, as well as studies in semiotic systems more generally. (shrink)

Investigations of iconicity in language, whereby interactants coordinate meaningful bodily actions to create resemblances, are prevalent across the human communication sciences. However, when it comes to analysing and comparing iconicity across different interactions and modes of communication, it is not always clear we are looking at the same thing. For example, tokens of spoken ideophones and manual depicting actions may both be analysed as iconic forms. Yet spoken ideophones may signal depictive and descriptive qualities via speech, while manual actions may (...) signal depictive, descriptive, and indexical qualities via the shape, movement, and placement of the hands in space. Furthermore, each may co-occur with other semiotics articulated with the face, hands, and body within composite utterances. The paradigm of iconicity as a single property is too broad and coarse for comparative semiotics, as important details necessary for understanding the range of human communicative potentialities may be masked. Here, we draw on semiotic approaches to language and communication, including the model of language as signalled via describing, indicating and/or depicting and the notion of non-referential indexicality, to illustrate the multidimensionality of iconicity in co-present interactions. This builds on our earlier proposal for analysing how different methods of semiotic signalling are combined in multimodal language use. We discuss some implications for the language and communication sciences and explain how this approach may inform a theory of biosemiotics. (shrink)

Would metaphors used in the context of psychotherapy by people who experience various forms of anxiety disorders differ from those used by people who experience stress? We investigated this question with the help of the Motivation & Sedimentation Model (MSM), a theory of meaning-making developed within the synthetic new discipline of cognitive semiotics. The analysis of a sample of ten transcripts of psychotherapy sessions concerning the topic of anxiety, and a comparable sample concerning stress, showed a significantly stronger proportion of (...) conventionalized metaphors in the stress sample, and a marginally significant difference in the number of innovative metaphors in the anxiety sample. These results suggest that lived experience of an anxiety disorder or another form of maladaptive anxiety affects metaphorical meaning-making, and manifests itself in spontaneous metaphor use. Furthermore, as a result of the conceptual and the empirical investigations of the topic, we propose novel theoretical and operational definitions of the notion of metaphoricity. (shrink)

This paper explores a semiotic notion of body as starting point for bridging biosemiotic with social semiotic theory. The cornerstone of the argument is that the social semiotic criticism of the classic view of meaning as double articulation can support the criticism of language-centrism that lies at the foundation of biosemiotics. Besides the pragmatic epistemological advantages implicit in a theoretical synthesis, I argue that this brings a semiotic contribution to philosophy of mind broadly. Also, it contributes to overcoming the polemic (...) in linguistics between, loosely put, cognitive universalism and cultural relativism. This possibility is revealed by the recent convergence of various semiotic theories towards a criticism of the classic notion of meaning as double articulation. In biosemiotics, the interest to explicate meaning as multiply articulated stems from the construal of Umwelt as relying on the variety of sense perception channels and semiotic systems that a species has at its disposal. Recently, social semiotics developed an unexplored interest for embodiment by starting from the other end, namely the consideration of the modal heterogeneity of meaning. To bridge these notions, I employ the cognitive semantic notion of embodiment and Mittelberg’s cognitive semiotic notion of exbodiment. In light of these, I explore the possible intricacies between the biosemiotic notion of primary modeling system and concepts referring to preconceptual structures for knowledge organization stemming from cognitive linguistics. Further, Mittelberg’s concept of exbodiment allows for a construal of meaning articulation as mediation between the exbodying and embodying directions of mind. (shrink)

Topical Themes in Argumentation Theory brings together twenty exploratory studies on important subjects of research in contemporary argumentation theory. The essays are based on papers that were presented at the 7th Conference of the International Society for the Study of Argumentation in Amsterdam in June 2010. They give an impression of the nature and the variety of the kind of research that has recently been carried out in the study of argumentation. The volume starts with three essays that provide stimulating (...) theoretical perspectives on argumentation. Subsequently, some views are explained on the intriguing topics of ‘dissensus’ and ‘deep disagreement’. After a discussion of three different approaches to the treatment of types of argumentation some classical themes from antique argumentation theory are revisited. The new research area of visual argumentation is explored in the next part. The volume concludes with three reports of experimental studies concerning argumentative discourse. The volume starts with three essays that provide stimulating theoretical perspectives on argumentation. Subsequently, some views are explained on the intriguing topics of ‘dissensus’ and ‘deep disagreement’. After a discussion of three different approaches to the treatment of types of argumentation some classical themes from antique argumentation theory are revisited. The new research area of visual argumentation is explored in the next part. The volume concludes with three reports of experimental studies concerning argumentative discourse. The volume starts with three essays that provide stimulating theoretical perspectives on argumentation. Subsequently, some views are explained on the intriguing topics of ‘dissensus’ and ‘deep disagreement’. After a discussion of three different approaches to the treatment of types of argumentation some classical themes from antique argumentation theory are revisited. The new research area of visual argumentation is explored in the next part. The volume concludes with three reports of experimental studies concerning argumentative discourse. (shrink)

It is being increasingly recognized that the Saussurean dictum of “the arbitrariness of the linguistic sign” is in conflict with the pervasiveness of the phenomenon commonly known as “sound symbolism”. After first presenting a historical overview of the debate, however, we conclude that both positions have been exaggerated, and that an adequate explanation of sound symbolism is still lacking. How can there, for example, be (perceived) similarity between expressionsand contents across different sensory modalities? We offer an answer, based on the (...) Peircian notion of iconic ground, and G. Sonesson’s distinction betweenprimary and secondary iconicity. Furthermore, we describe an experimental study, in a paradigm first pioneered by W. Kohler, and recently popularized by V.Ramachandran, in which we varied vowels and consonants in fictive word-forms, and conclude that both types of sounds play a role in perceiving an iconic ground between the word-forms and visual figures. The combination of historical conceptual analysis, semiotic explication and psychological experimentationpresented in this article is characteristic of the emerging paradigm of cognitive semiotics. (shrink)