Sound symbolism refers to non‐arbitrary mappings between the sounds of words and their meanings and is often studied by pairing auditory pseudowords such as “maluma” and “takete” with rounded and pointed visual shapes, respectively. However, it is unclear what auditory properties of pseudowords contribute to their perception as rounded or pointed. Here, we compared perceptual ratings of the roundedness/pointedness of large sets of pseudowords and shapes to their acoustic and visual properties using a novel application of representational similarity analysis (RSA). (...) Representational dissimilarity matrices (RDMs) of the auditory and visual ratings of roundedness/pointedness were significantly correlated crossmodally. The auditory perceptual RDM correlated significantly with RDMs of spectral tilt, the temporal fast Fourier transform (FFT), and the speech envelope. Conventional correlational analyses showed that ratings of pseudowords transitioned from rounded to pointed as vocal roughness (as measured by the harmonics‐to‐noise ratio, pulse number, fraction of unvoiced frames, mean autocorrelation, shimmer, and jitter) increased. The visual perceptual RDM correlated significantly with RDMs of global indices of visual shape (the simple matching coefficient, image silhouette, image outlines, and Jaccard distance). Crossmodally, the RDMs of the auditory spectral parameters correlated weakly but significantly with those of the global indices of visual shape. Our work establishes the utility of RSA for analysis of large stimulus sets and offers novel insights into the stimulus parameters underlying sound symbolism, showing that sound‐to‐shape mapping is driven by acoustic properties of pseudowords and suggesting audiovisual cross‐modal correspondence as a basis for language users' sensitivity to this type of sound symbolism. (shrink)

What connection is there between linguistic sounds and meaning? The present study claims that there is no such connection, and that linguistic sounds are the same as meaning. It is traditionally accepted that there is an arbitrary association between linguistic sounds and meaning. In the present paper, drawing from the concept of language authority for mind, I will talk about a distinction between live time of understanding - in which linguistic sounds are produced and understood - and non-live or historical (...) time of understanding. Through making this distinction, I will show that in live time of understanding, assuming any relationship between the mental state of linguistic sounds and that of meaning is inadequate, and that the best way to explain why linguistic sounds are understood instantly and effortlessly as soon as they are heard is to imagine that linguistic sounds are the same as meaning or that at least we are only faced with a single sound-meaning mental state. In addition, making a comparison between hearing linguistic sounds and seeing objects helps us consider linguistic sounds the same as meaning in the context of live time of understanding. (shrink)