This study investigated the relative contribution of perception/cognition and language-specific semantics in nonverbal categorization of spatial relations. English and Korean speakers completed a video-based similarity judgment task involving containment, support, tight fit, and loose fit. Both perception/cognition and language served as resources for categorization, and allocation between the two depended on the target relation and the features contrasted in the choices. Whereas perceptual/cognitive salience for containment and tight-fit features guided categorization in many contexts, language-specific semantics influenced categorization where the two (...) features competed for similarity judgment and when the target relation was tight support, a domain where spatial relations are perceptually diverse. In the latter contexts, each group categorized more in line with semantics of their language, that is, containment/support for English and tight/loose fit for Korean. We conclude that language guides spatial categorization when perception/cognition alone is not sufficient. In this way, language is an integral part of our cognitive domain of space. (shrink)

Two studies investigated the interaction between utterance and scene processing by monitoring eye movements in agent–action–patient events, while participants listened to related utterances. The aim of Experiment 1 was to determine if and when depicted events are used for thematic role assignment and structural disambiguation of temporarily ambiguous English sentences. Shortly after the verb identified relevant depicted actions, eye movements in the event scenes revealed disambiguation. Experiment 2 investigated the relative importance of linguistic/world knowledge and scene information. When the verb (...) identified either only the stereotypical agent of a (nondepicted) action, or the (nonstereotypical) agent of a depicted action as relevant, verb‐based thematic knowledge and depicted action each rapidly influenced comprehension. In contrast, when the verb identified both of these agents as relevant, the gaze pattern suggested a preferred reliance of comprehension on depicted events over stereotypical thematic knowledge for thematic interpretation. We relate our findings to language comprehension and acquisition theories. (shrink)

In this article, we explore whether cross-linguistic differences in grammatical aspect encoding may give rise to differences in memory and cognition. We compared native speakers of two languages that encode aspect differently (English and Swedish) in four tasks that examined verbal descriptions of stimuli, online triads matching, and memory-based triads matching with and without verbal interference. Results showed between-group differences in verbal descriptions and in memory-based triads matching. However, no differences were found in online triads matching and in memory-based triads (...) matching with verbal interference. These findings need to be interpreted in the context of the overall pattern of performance, which indicated that both groups based their similarity judgments on common perceptual characteristics of motion events. These results show for the first time a cross-linguistic difference in memory as a function of differences in grammatical aspect encoding, but they also contribute to the emerging view that language fine tunes rather than shapes perceptual processes that are likely to be universal and unchanging. (shrink)

This study has two goals. First, we present much‐needed empirical linguistic data and systematic analyses on the spatial semantic systems in English and Korean, two languages that have been extensively compared to date in the debate on spatial language and spatial cognition. We conduct our linguistic investigation comprehensively, encompassing the domains of tight‐ and loose‐fit as well as containment and support relations. The current analysis reveals both cross‐linguistic commonalities and differences: From a common set of spatial features, each language highlights (...) a subset of those features for its principal categorization, and those primary features are importantly different between English and Korean: English speakers categorize events predominantly by containment and support relations (and do so with prepositions), whereas Korean speakers categorize them by tight‐fit and loose‐fit relations (and do so with verbs), with a further distinction of containment and support within the loose‐fit relation. The analysis also shows that the tight‐fit domain is more cross‐linguistically diverse in categorization than is the loose‐fit domain. Second, we test the language data against the nonlinguistic categorization results reported in Choi and Hattrup (2012). The results show a remarkable degree of convergence between the patterns predicted from the current linguistic analysis and those found in C&H's nonlinguistic study and thus provide empirical and strong evidence for an influence of language on nonlinguistic spatial cognition. At the same time, the study reveals areas where the two systems closely interact with each other as well as those where one is independent from the other. Taking both parts of the study together, we identify the specific roles that language and spatial perception/cognition play in spatial categorization. (shrink)