Contrary to the assumption of arbitrariness in modern linguistics, sound symbolism, which is the non-arbitrary relationship between sounds and meanings, exists. Sound symbolism, including the “Bouba–Kiki” effect, implies the universality of such relationships; individuals from different cultural and linguistic backgrounds can similarly relate sound-symbolic words to referents, although the extent of these similarities remains to be fully understood. Here, we examined if subjects from different countries could similarly infer the surface texture properties from words that sound-symbolically represent hardness in Japanese. (...) We prepared Japanese sound-symbolic words of which novelty was manipulated by a genetic algorithm. Japanese speakers in Japan and English speakers in both Singapore and the United States rated these words based on surface texture properties, as well as familiarity. The results show that hardness-related words were rated as harder and rougher than softness-related words, regardless of novelty and countries. Multivariate analyses of the ratings classified the hardness-related words along the hardness-softness dimension at over 80% accuracy, regardless of country. Multiple regression analyses revealed that the number of speech sounds /g/ and /k/ predicted the ratings of the surface texture properties in non-Japanese countries, suggesting a systematic relationship between phonetic features of a word and perceptual quality represented by the word across culturally and linguistically diverse samples. (shrink)

Researchers typically use the “big five” traits as a standard way to describe personality. Evaluation of personality is generally conducted using self-report questionnaires that require participants to respond to a large number of test items. To minimize the burden on participants, this paper proposes an alternative method of estimating multidimensional personality traits from only a single word. We constructed a system that can convert a sound-symbolic word that intuitively expresses personality traits into information expressed by 50 personality-related adjective pairs. This (...) system can obtain information equivalent to the adjective scales using only a single word instead of asking many direct questions. To achieve this, we focused on SSWs in Japanese that have the association between linguistic sounds and meanings and express diverse and complex aspects of personality traits. We evaluated the prediction accuracy of the system and found that the multiple correlation coefficients for 48 personality-related adjective pairs exceeded 0.75, indicating that the model could explain more than half of the variations in the data. In addition, we conducted an evaluation experiment in which participants rated the appropriateness of the system output using a seven-point scale. The average score for 50 personality-related adjective pairs was 1.25. Thus, we believe that this system can contribute to the field of personality computing, particularly in terms of personality evaluation and communication. (shrink)

The idea that the form of a word reflects information about its meaning has its roots in Platonic philosophy, and has been experimentally investigated for concrete, sensory-based properties since the early 20th century. Here, we provide evidence for an abstract property of ‘boundedness’ that introduces a systematic, iconic bias on the phonological expectations of a novel lexicon. We show that this abstract property is general across events and objects. In Experiment 1, we show that subjects are systematically more likely to (...) associate sign language signs that end with a gestural boundary with telic verbs (denoting events with temporal boundaries, e.g., die, arrive) and with count nouns (denoting objects with spatial boundaries, e.g., ball, coin). In Experiments 2–3, we show that this iconic mapping acts on conceptual representations, not on grammatical features. Specifically, the mapping does not carry over to psychological nouns (e.g. people are not more likely to associate a gestural boundary with idea than with knowledge). Although these psychological nouns are still syntactically encoded as either count or mass, they do not denote objects that are conceived of as having spatial boundaries. The mapping bias thus breaks down. Experiments 4–5 replicate these findings with a new set of stimuli. Finally, in Experiments 6–11, we explore possible extensions to a similar bias for spoken language stimuli, with mixed results. Generally, the results here suggest that ‘boundedness’ of words' referents (in space or time) has a powerful effect on intuitions regarding the form that the words should take. (shrink)

Sound symbolism refers to non‐arbitrary mappings between the sounds of words and their meanings and is often studied by pairing auditory pseudowords such as “maluma” and “takete” with rounded and pointed visual shapes, respectively. However, it is unclear what auditory properties of pseudowords contribute to their perception as rounded or pointed. Here, we compared perceptual ratings of the roundedness/pointedness of large sets of pseudowords and shapes to their acoustic and visual properties using a novel application of representational similarity analysis (RSA). (...) Representational dissimilarity matrices (RDMs) of the auditory and visual ratings of roundedness/pointedness were significantly correlated crossmodally. The auditory perceptual RDM correlated significantly with RDMs of spectral tilt, the temporal fast Fourier transform (FFT), and the speech envelope. Conventional correlational analyses showed that ratings of pseudowords transitioned from rounded to pointed as vocal roughness (as measured by the harmonics‐to‐noise ratio, pulse number, fraction of unvoiced frames, mean autocorrelation, shimmer, and jitter) increased. The visual perceptual RDM correlated significantly with RDMs of global indices of visual shape (the simple matching coefficient, image silhouette, image outlines, and Jaccard distance). Crossmodally, the RDMs of the auditory spectral parameters correlated weakly but significantly with those of the global indices of visual shape. Our work establishes the utility of RSA for analysis of large stimulus sets and offers novel insights into the stimulus parameters underlying sound symbolism, showing that sound‐to‐shape mapping is driven by acoustic properties of pseudowords and suggesting audiovisual cross‐modal correspondence as a basis for language users' sensitivity to this type of sound symbolism. (shrink)

This review covers experimental approaches to sound-symbolism—from infants to adults, and from Sapir’s foundational studies to twenty-first century product naming. It synthesizes recent behavioral, developmental, and neuroimaging work into a systematic overview of the cross-modal correspondences that underpin iconic links between form and meaning. It also identifies open questions and opportunities, showing how the future course of experimental iconicity research can benefit from an integrated interdisciplinary perspective. Combining insights from psychology and neuroscience with evidence from natural languages provides us with (...) opportunities for the experimental investigation of the role of sound-symbolism in language learning, language processing, and communication. The review finishes by describing how hypothesis-testing and model-building will help contribute to a cumulative science of sound-symbolism in human language. (shrink)

During much of the past century, it was widely believed that phonemes--the human speech sounds that constitute words--have no inherent semantic meaning, and that the relationship between a combination of phonemes (a word) and its referent is simply arbitrary. Although recent work has challenged this picture by revealing psychological associations between certain phonemes and particular semantic contents, the precise mechanisms underlying these associations have not been fully elucidated. Here we provide novel evidence that certain phonemes have an inherent, non-arbitrary emotional (...) quality. Moreover, we show that the perceived emotional valence of certain phoneme combinations depends on a specific acoustic feature--namely, the dynamic shift within the phonemes' first two frequency components. These data suggest a phoneme-relevant acoustic property influencing the communication of emotion in humans, and provide further evidence against previously held assumptions regarding the structure of human language. This finding has potential applications for a variety of social, educational, clinical, and marketing contexts. (shrink)

In this article, I focus on Johann Nikolaus Tetens’s linguistic theory to make three arguments: (a) this linguistic theory endorses a phonological (contra phonetic) approach to the acoustic sphere of language; (b) the phonological approach is based on the idea that sounds can turn into phonemes (of a properly human language) only when a minimally rational reflection on them is made; and (c) the phonological approach allows us to understand the phoneme as a differential unity, as being composed of structure (...) and function, and as giving a theoretical basis for language learning. (shrink)

In the present study, cross-modal (i.e., across sensory modalities such as smell and sound) iconicity (i.e., resemblance) and indexicality (i.e., contiguity) in lexical sensory and emotional signs in Finnish Sign Language will be considered from an articulatory perspective (i.e., the production of signs). Such cross-modal iconicity has not been extensively studied previously, so here, with the help of cognitive semiotics, I aim to carefully describe the cross-modal patterns observed across 118 signs, including 60 sensory signs and 58 emotional signs. The (...) analysis is framed within the theoretical model of Semiotic Hierarchy, which entails a non-reductionist view of meaning. In addition, a pheno-methodological triangulation will be applied: phenomenology (first-person method), literature of phenomenological and semiotic descriptions (second-person perspective) and experimental findings (third-person perspective). The results of this analysis show that (a) 71 of the 118 sensory and emotional signs are cross-modally indexical, (b) only 10 of the 71 signs can be regarded as cross-modally iconic, (c) cross-modal iconicity is highly diagrammatic, (d) iconicity and indexicality are highly integrated, and (e) articulatory feedback matters in the formation of semiotic patterns. This study contributes to our understanding of cross-modal iconicity in signed languages, as well as studies in semiotic systems more generally. (shrink)

This study aims to find out whether speakers of different language backgrounds (English, French, Spanish, and Macedonian) are sensitive to semantic associations (‘fluid’ and ‘forcible contact’) attached respectively to two purported phonaesthemes (/fl-/ and /tr-/). Participants completed the task in oral and written conditions. They had to match phonaestheme-related definitions with either of two non-words (one phonaestheme-bearing and the other containing a distractor). The results obtained indicate that participants significantly chose non-words beginning with /tr-/ when the definition activated a meaning (...) related to forcible contact, and non-words starting with /fl-/ when the definitions made reference to fluids in the four languages. The results point to the existence of non-arbitrary sound-meaning relations. A corpus-driven study of frequencies of lemmas and word tokens starting with the purported phonaesthemes also sheds light on the possible origin of the phonaesthemic associations, suggesting that both iconicity and systematicity motivate such associations. The results obtained are interpreted in the context of a functional, usage-based model of language, which can accommodate the existence of iconic tendencies, the role of learning and linguistic experience in language, and arbitrariness. (shrink)

Gesture-first theories of language origins often raise two unsubstantiated arguments against vocal origins. First, they argue that great ape vocal behavior is highly constrained, limited to a fixed, species-typical repertoire of reflexive calls. Second, they argue that vocalizations lack any significant potential to ground meaning through iconicity, or resemblance between form and meaning. This paper reviews the considerable evidence that debunks these two “myths”. Accumulating evidence shows that the great apes exercise voluntary control over their vocal behavior, including their breathing (...) apparatus, larynx, and supralaryngeal articulators. They are also able to learn new vocal behaviors, and even show some rudimentary ability for vocal imitation. In addition, an abundance of research demonstrates that the vocal modality affords rich potential for iconicity. People can understand iconicity in sound symbolism, and they can produce iconic vocalizations to communicate a diverse range of meanings. Thus, two of the primary arguments against vocal origins theories are not tenable. As an alternative, the paper concludes that the origins of language – going as far back as our last common ancestor with great apes – are rooted in iconicity in both gesture and vocalization. (shrink)

Sound-symbolism is the nonarbitrary link between the sound and meaning of a word. Japanese-speaking children performed better in a verb generalization task when they were taught novel sound-symbolic verbs, created based on existing Japanese sound-symbolic words, than novel nonsound-symbolic verbs (Imai, Kita, Nagumo, & Okada, 2008). A question remained as to whether the Japanese children had picked up regularities in the Japanese sound-symbolic lexicon or were sensitive to universal sound-symbolism. The present study aimed to provide support for the latter. In (...) a verb generalization task, English-speaking 3-year-olds were taught novel sound-symbolic verbs, created based on Japanese sound-symbolism, or novel nonsound-symbolic verbs. English-speaking children performed better with the sound-symbolic verbs, just like Japanese-speaking children. We concluded that children are sensitive to universal sound-symbolism and can utilize it in word learning and generalization, regardless of their native language. (shrink)

Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural strategy or an automatic processing effect? If automatic, does it also apply when the same pitch contours no longer sound like speech? Implicit Association Tests (IATs) provide an indirect measure of cross-modal association. In a series of IAT (...) studies, conducted with participants with three kinds of language backgrounds (Chinese-dominant bilinguals, Chinese balanced bilinguals, and English speakers with no Chinese experience) we find language-specific congruence effects for Mandarin lexical tones but not for matched sine-wave stimuli. That is, for linguistic stimuli, non-Chinese speakers show advantages for pitch-height congruence (high-pointy, low-curvy); no congruence effects were found for Chinese speakers. For non-linguistic stimuli, all participant groups showed advantages for pitch-height congruence. The present findings suggest that non-lexical tone congruence (high-pointy, low-curvy) is a basic congruence pattern, and the acquisition of a language with lexical tone can alter this perception. (shrink)

Cognitive Science, Volume 45, Issue 11, November 2021.

Sound symbolism is a non‐arbitrary correspondence between sound and meaning. The majority of studies on sound symbolism have focused on consonants and vowels, and the sound‐symbolic properties of suprasegmentals, particularly phonation types, have been largely neglected. This study examines the size and shape symbolism of four phonation types: modal and creaky voices, falsetto, and whisper. Japanese speakers heard 12 novel words (e.g., /íbi/, /ápa/) pronounced with the four types of phonation and rated the size and roundedness/pointedness each of the 48 (...) stimuli seemed to represent on seven‐point scales. The results showed that phonation types as well as consonantal and vocalic features influenced the ratings. Creaky voice was associated with larger and more pointed images than modal voice, which was in turn associated with larger and more pointed images than whisper. Falsetto was also associated with roundedness but not with smallness. These results shed new light on the acoustic approaches to sound symbolism and suggest the significance of phonation types and other suprasegmental features in the phenomenon. (shrink)

Sounds like h-nmm, hh-aaaah, hn-hn, unkay, nyeah, ummum, uuh, um-hm-uh-hm, um and uh-huh occur frequently in American English conversation but have thus far escaped systematic study. This article reports a study of both the forms and functions of such tokens in a corpus of American English conversations. These sounds appear not to be lexical, in that they are productively generated rather than finite in number, and in that the sound¿meaning mapping is compositional rather than arbitrary. This implies that English bears (...) within it a small specialized sub-language which follows different rules from the language as a whole. The functions supported by this sub-language complement those of main-channel English; they include low-overhead control of turn-taking, negotiation of agreement, signaling of recognition and comprehension, management of interpersonal relations such as control and affiliation, and the expression of emotion, attitude, and affect. (shrink)

Sound symbolism refers to non-arbitrary associations between word forms and meaning, such as those observed for some properties of sounds and size or shape. Recent evidence suggests that these connections extend to emotional concepts. Here we investigated two types of non-arbitrary relationships. Study 1 examined whether iconicity scores (i.e. resemblance-based mapping between aspects of a word’s form and its meaning) for words can be predicted from ratings in the affective dimensions of valence and arousal and/or the discrete emotions of happiness, (...) anger, fear, disgust and sadness. Words denoting negative concepts were more likely to have more iconic word forms. Study 2 explored whether statistical regularities in single phonemes (i.e. systematicity) predicted ratings in affective dimensions and/or discrete emotions. Voiceless (/p/, /t/) and voiced plosives (/b/, /d/, /g/) were related to high arousing words, whereas high arousing negative words tended to include fricatives (/s/, /z/). Hissing consonants were also more likely to occur in words denoting all negative discrete emotions. Additionally, words conveying certain discrete emotions included specific phonemes. Overall, our data suggest that emotional features might explain variations in iconicity and provide new insight about phonemic patterns showing sound symbolic associations with the affective properties of words. (shrink)

Name der Zeitschrift: Semiotica Jahrgang: 2015 Heft: 207 Seiten: 279-301.

Recent experiments have shown that people iconically modulate their prosody corresponding with the meaning of their utterance. This article reports findings from a story reading task that expands the investigation of iconic prosody to abstract meanings in addition to concrete ones. Participants read stories that contrasted along concrete and abstract semantic dimensions of speed and size. Participants read fast stories at a faster rate than slow stories, and big stories with a lower pitch than small stories. The effect of speed (...) was distributed across the stories, including portions that were identical across stories, whereas the size effect was localized to size-related words. Overall, these findings enrich the documentation of iconicity in spoken language and bear on our understanding of the relationship between gesture and speech. (shrink)

Iconicity is a fundamental property of spoken and signed languages. However, quantitative analysis of sound-meaning association in Chinese has not been extensively developed, and little is known about the impact of sound symbolism in children’s literature. As sound symbolism is supposed to be a universal cognitive phenomenon, this research seeks to investigate whether iconic structures of Mandarin are embodied in native Chinese speakers’ language experience. The paper describes a case study of Chinese storybooks with the goal of testing whether phonosemantic (...) association is prominent between name sounds and character features. A quantitative method was used to investigate the distribution of different phonological units in character denomination depending on their physical and emotional traits. The results show that phonemes and syllable combination patterns are closely related to perceivable character features. By comparing schematic mapping in Chinese with other languages, the study illuminates a cross-linguistic tendency in addition to a Chinese-specific iconic relation between sound and meaning. (shrink)

Several language experiments have been carried out on apes and other animals aiming to narrow down the presumed qualitative gap that separates humans from other animals. These experiments, however, have been driven by the understanding of language as a purely symbolic sign system, often connected to a profound disinterest for language use in real situations and a propensity to perceive grammatical and syntactic information as the only fundamental aspects of human language. For these reasons, the language taught to apes tends (...) to discard iconic and indexical elements in favour of symbolic signs. This paper sheds light on the iconic components of human language, with close attention to the iconic properties of language as present in the ape language experiments. We emphasise the role of the body in the interpretation and production of iconic signs, while demonstrating the need to take into account the Umwelt theory in the research paradigm of the experiments. Uexküll’s Umwelt theory is used to exemplify the methodological problems connected to the teaching of human language to other animal species; furthermore, we discuss how the modelling capacities of language affect the biological layer that constitutes the animal Umwelt. Language is analysed as a particular case of Umwelt transition, and as such its implications are further discussed in the article. With this paper, we enrich the discussion surrounding the human-ape pidgin language by advocating for the need to include iconic components as vital parts of this research area. With this inclusion, we uncover the inter-dependency of iconic, indexical and symbolic signs in human language, aiming to further develop the research paradigm of the ape language experiments. (shrink)

Some spoken words are iconic, exhibiting a resemblance between form and meaning. We used native speaker ratings to assess the iconicity of 3001 English words, analyzing their iconicity in relation to part-of-speech differences and differences between the sensory domain they relate to. First, we replicated previous findings showing that onomatopoeia and interjections were highest in iconicity, followed by verbs and adjectives, and then nouns and grammatical words. We further show that words with meanings related to the senses are more iconic (...) than words with abstract meanings. Moreover, iconicity is not distributed equally across sensory modalities: Auditory and tactile words tend to be more iconic than words denoting concepts related to taste, smell and sight. Last, we examined the relationship between iconicity and systematicity. We find that iconicity in English words is more strongly related to sensory meanings than systematicity. Altogether, our results shed light on the extent and distribution of iconicity in modern English. (shrink)

A classic example of the arbitrary relation between the way a word sounds and its meaning is that microorganism is a very long word that refers to a very small entity, whereas whale is a very short word that refers to something very big. This example, originally presented in Hockett's list of language's design features, has been often cited over the years, not only by those discussing the arbitrary nature of language, but also by researchers of sound symbolism. While the (...) two groups disagreed regarding the role of arbitrariness and sound symbolism in language, they both agreed there is a nonsound symbolic relation between word length and entity size in this case. This paper shows that the length of the words whale and microorganism in fact reflects a sound symbolic pattern. An analysis of >600 languages from >100 language families shows that languages use longer words to denote the concept small than they do to denote the concept big. The paper thus shows how explicit judgments might differ from implicit cognitive association and the problem of relying on these in sound symbolism research. (shrink)

Cognitive Science, Volume 46, Issue 6, June 2022.

Why does symbolic communication in humans develop primarily in an oral medium, and how do theories of language origin explain this? Non-human primates, despite their ability to learn and use symbolic signs, do not develop symbols as in oral language. This partly owes to the lack of a direct cortico-motoneuron control of vocalizations in these species compared to humans. Yet such modality-related factors that can impinge on the rise of symbolic language are interpreted differently in two types of evolutionary storylines. (...) 1) Some theories posit that symbolic language originated in a gestural modality, as in “sign languages”. However, this overlooks work on emerging sign and spoken language showing that gestures and speech shape signs differently. 2) In modality-dependent theories, some emphasize the role of iconic sounds, though these lack the efficiency of arbitrary symbols. Other theorists suggest that ontogenesis serves to identify human-specific mechanisms underlying an evolutionary shift from pitch varying to orally-modulated vocalizations (babble). This shift creates numerous oral features that can support efficient symbolic associations. We illustrate this principle using a sound-picture association task with 40 learners who hear words in an unfamiliar language (Mandarin) with and without a filtering of oral features. Symbolic associations arise more rapidly and accurately for sounds containing oral features compared to sounds bearing only pitch features, an effect also reported in experiments with infants. The results imply that, beyond a competence to learn and use symbols, the rise of symbolic language rests on the types of signs that a modality of expression affords. (shrink)

Research on the relation between sound and meaning in language has reported substantial evidence for implicit associations between articulatory–acoustic characteristics of phonemes and emotions. In the present study, we specifically tested the relation between the acoustic properties of a text and its emotional tone as perceived by readers. To this end, we asked participants to assess the emotional tone of single stanzas extracted from a large variety of poems. The selected stanzas had either an extremely high, a neutral, or an (...) extremely low average formant dispersion. To assess the average formant dispersion per stanza, all words were phonetically transcribed and the distance between the first and second formant per vowel was calculated. Building on a long tradition of research on associations between sound frequency on the one hand and non‐acoustic concepts such as size, strength, or happiness on the other hand, we hypothesized that stanzas with an extremely high average formant dispersion would be rated lower on items referring to Potency (dominance) and higher on items referring to Activity (arousal) and Evaluation (emotional valence). The results confirmed our hypotheses for the dimensions of Potency and Evaluation, but not for the dimension of Activity. We conclude that, at least in poetic language, extreme values of acoustic features of vowels are a significant predictor for the emotional tone of a text. (shrink)

Previous research shows that simultaneously executed grasp and vocalization responses are faster when the precision grip is performed with the vowel [i] and the power grip is performed with the vowel [ɑ]. Research also shows that observing an object that is graspable with a precision or power grip can activate the grip congruent with the object. Given the connection between vowel articulation and grasping, this study explores whether grasp‐related size of observed objects can influence not only grasp responses but also (...) vowel pronunciation. The participants had to categorize small and large objects into natural and manufactured categories by pronouncing the vowel [i] or [ɑ]. As predicted, [i] was produced faster when the object's grasp‐related size was congruent with the precision grip while [ɑ] was produced faster when the size was congruent with the power grip (Experiment 1). The effect was not, however, observed when the participants were presented with large objects that are not typically grasped by the power grip (Experiment 2). This study demonstrates that vowel production is systematically influenced by grasp‐related size of a viewed object, supporting the account that sensory‐motor processes related to grasp planning and representing grasp‐related properties of viewed objects interact with articulation processes. The paper discusses these findings in the context of size–sound symbolism, suggesting that mechanisms that transform size‐grasp affordances into corresponding grasp‐ and articulation‐related motor programs might provide a neural basis for size‐sound phenomena that links small objects with closed‐front vowels and large objects with open‐back vowels. (shrink)

To what extent do people attribute meanings to “nonsense” words? How general is such attribution of meaning? We used a set of words lacking conventional meanings to elicit drawings of made‐up creatures. Separate groups of participants rated the nonsense words and the drawings on several semantic dimensions and selected what name best corresponded to each creature. Despite lacking conventional meanings, “nonsense” words elicited a high level of consistency in the produced drawings. Meaning attributions made to nonsense words corresponded with meaning (...) attributions made by separate people to drawings that were inspired by the name. Naïve participants were able to recover the name that inspired the drawing with greater‐than‐chance accuracy. These results suggest that people make liberal and consistent use of non‐arbitrary relationships between forms and meanings.Open Research Badges This article has been awarded Open Materials and Open Data badges. All materials and data are publicly accessible via the Open Science Framework at https://osf.io/8juyc/. Learn more about the Open Practices badges from the Center for Open Science: https://osf.io/tvyxz/wiki. (shrink)

It is being increasingly recognized that the Saussurean dictum of “the arbitrariness of the linguistic sign” is in conflict with the pervasiveness of the phenomenon commonly known as “sound symbolism”. After first presenting a historical overview of the debate, however, we conclude that both positions have been exaggerated, and that an adequate explanation of sound symbolism is still lacking. How can there, for example, be (perceived) similarity between expressionsand contents across different sensory modalities? We offer an answer, based on the (...) Peircian notion of iconic ground, and G. Sonesson’s distinction betweenprimary and secondary iconicity. Furthermore, we describe an experimental study, in a paradigm first pioneered by W. Kohler, and recently popularized by V.Ramachandran, in which we varied vowels and consonants in fictive word-forms, and conclude that both types of sounds play a role in perceiving an iconic ground between the word-forms and visual figures. The combination of historical conceptual analysis, semiotic explication and psychological experimentationpresented in this article is characteristic of the emerging paradigm of cognitive semiotics. (shrink)