Traditionally, the language faculty was supposed to be a device that maps linguistic inputs to semantic or conceptual representations. These representations themselves were supposed to be distinct from the representations manipulated by the hearer’s perceptual and motor systems. Recently this view of language has been challenged by advocates of embodied cognition. Drawing on empirical studies of linguistic comprehension, they have proposed that the language faculty reuses the very representations and processes deployed in perceiving and acting. I review some of the (...) evidence and arguments in favor of the embodied view of language comprehension, and argue that none of it is conclusive. Moreover, the embodied view itself blurs two important distinctions: first, the distinction between linguistic comprehension and its typical consequences; and second, the distinction between representational content and vehicles. Given that these distinctions are well-motivated, we have good reason to reject the embodied view of linguistic understanding.Keywords: Language; Comprehension; Perception; Action; Embodied cognition; Representation. (shrink)

We approach the semantics of prepositions from the perspective of conceptual spaces. Focusing on purely spatial locative and directional prepositions, we analyze both types of prepositions in terms of polar coordinates instead of Cartesian coordinates. This makes it possible to demonstrate that the property of convexity holds quite generally in the domain of prepositions of location and direction, supporting the important role that this property plays in conceptual spaces.

This contribution presents a corpus of spatial descriptions and describes the development of a human-driven spatial language robot system for their comprehension. The domain of application is an eldercare setting in which an assistive robot is asked to “fetch” an object for an elderly resident based on a natural language spatial description given by the resident. In Part One, we describe a corpus of naturally occurring descriptions elicited from a group of older adults within a virtual 3D home that simulates (...) the eldercare setting. We contrast descriptions elicited when participants offered descriptions to a human versus robot avatar, and under instructions to tell the addressee how to find the target versus where the target is. We summarize the key features of the spatial descriptions, including their dynamic versus static nature and the perspective adopted by the speaker. In Part Two, we discuss critical cognitive and perceptual processing capabilities necessary for the robot to establish a common ground with the human user and perform the “fetch” task. Based on the collected corpus, we focus here on resolving the perspective ambiguity and recognizing furniture items used as landmarks in the descriptions. Taken together, the work presented here offers the key building blocks of a robust system that takes as input natural spatial language descriptions and produces commands that drive the robot to successfully fetch objects within our eldercare scenario. (shrink)

The computational paradigm, which has dominated psychology and artificial intelligence since the cognitive revolution, has been a source of intense debate. Recently, several cognitive scientists have argued against this paradigm, not by objecting to computation, but rather by objecting to the notion of representation. Our analysis of these objections reveals that it is not the notion of representation per se that is causing the problem, but rather specific properties of representations as they are used in various psychological theories. Our analysis (...) suggests that all theorists accept the idea that cognitive processing involves internal information-carrying states that mediate cognitive processing. These mediating states are a superordinate category of representations. We discuss five properties that can be added to mediating states and examine their importance in various cognitive models. Finally, three methodological lessons are drawn from our analysis and discussion. (shrink)

This paper concerns how motor actions are neurally represented and coded. Action planning and motor preparation can be studied using a specific type of representational activity, motor imagery. A close functional equivalence between motor imagery and motor preparation is suggested by the positive effects of imagining movements on motor learning, the similarity between the neural structures involved, and the similar physiological correlates observed in both imaging and preparing. The content of motor representations can be inferred from motor images at a (...) macroscopic level, based on global aspects of the action and the motor rules and constraints which predict the spatial path and kinematics of movements. A more microscopic neural account calls for a representation of object-oriented action. Object attributes are processed in different neural pathways depending on the kind of task the subject is performing. During object-oriented action, a pragmatic representation is activated in which object affordances are transformed into specific motor schemas. Animal as well as human clinical data implicate the posterior parietal and premotor cortical areas in schema instantiation. A mechanism is proposed that is able to encode the desired goal of the action and is applicable to different levels of representational organization. (shrink)

Jeannerod's target article describes support, through empirical and neurological findings, for the intriguing idea of motor imagery, a form of representation hypothesized to have levels of functional equivalence with motor preparation, while being consciously accessible. Jeannerod suggests that the subjectively accessible content of motor imagery allows it to be distinguished from motor preparation, which is unconscious. Motor imagery is distinguished from visual imagery in terms of content. Motor images are kinesthetic in nature; they are parametrized by variables such as force (...) and time and they are potentially governed by kinematic rules. Jeannerod acknowledges, however, that motor and visual imagery may not easily be separated, because actions take place in a spatial environment. I agree; in fact, I suggest here that visualization may generally be concomitant with, and may even subjectively dominate, motor imagery. (shrink)

The semantics of directional prepositions is investigated from the perspective of aspect. What distinguishes telic PPs (like to the house) from atelic PPs (like towards the house), taken as denoting sets of paths, is their algebraic structure: atelic PPs are cumulative, closed under the operation of concatenation, telic PPs are not. Not only does this allow for a natural and compositional account of how PPs contribute to the aspect of a sentence, but it also guides our understanding of the lexical (...) semantics of prepositions in important ways. Semantically, prepositions turn out to be quite similar to nouns and verbs. Nominal distinctions (like singular and plural, mass and count) and verbal classes (like semelfactives and degree achievements) have their prepositional counterparts. (shrink)

In this paper, we focus on the development of geometric cognition. We argue that to understand how geometric cognition has been constituted, one must appreciate not only individual cognitive factors, such as phylogenetically ancient and ontogenetically early core cognitive systems, but also the social history of the spread and use of cognitive artifacts. In particular, we show that the development of Greek mathematics, enshrined in Euclid’s Elements, was driven by the use of two tightly intertwined cognitive artifacts: the use of (...) lettered diagrams; and the creation of linguistic formulae. Together, these artifacts formed the professional language of geometry. In this respect, the case of Greek geometry clearly shows that explanations of geometric reasoning have to go beyond the confines of methodological individualism to account for how the distributed practice of artifact use has stabilized over time. This practice, as we suggest, has also contributed heavily to the understanding of what mathematical proof is; classically, it has been assumed that proofs are not merely deductively correct but also remain invariant over various individuals sharing the same cognitive practice. Cognitive artifacts in Greek geometry constrained the repertoire of admissible inferential operations, which made these proofs inter-subjectively testable and compelling. By focusing on the cognitive operations on artifacts, we also stress that mental mechanisms that contribute to these operations are still poorly understood, in contrast to those mechanisms which drive symbolic logical inference. (shrink)

Ineffability, the degree to which percepts or concepts resist linguistic coding, is a fairly unexplored nook of cognitive science. Although philosophical preoccupations with qualia or nonconceptual content certainly touch upon the area, there has been little systematic thought and hardly any empirical work in recent years on the subject. We argue that ineffability is an important domain for the cognitive sciences. For examining differential ineffability across the senses may be able to tell us important things about how the mind works, (...) how different modalities talk to one another, and how language does, or does not, interact with other mental faculties. (shrink)

According to classical theories of language and cognition, human cognition is characterized by strong universal commonalities built around notions such as object, space, agency, number, time, and event (Clark, 1973; Miller & Johnson‐Laird, 1976). Languages select from this prelinguistic conceptual repertoire the concepts that become encoded in their lexical and grammatical stock. Language acquisition, on this view, is a mapping process in which the learner needs to figure out which sounds in the language spoken in the environment correspond to which (...) concepts from the ones already in the mind (Fodor, 1975; Gleitman, 1990; Pinker, 1994). (shrink)

What is the relationship between language and event cognition? Past work has suggested that linguistic/aspectual distinctions encoding the internal temporal profile of events map onto nonlinguistic event representations. Here, we use a novel visual detection task to directly test the hypothesis that processing telic versus atelic sentences (e.g., “Ebony folded a napkin in 10 seconds” vs. “Ebony did some folding for 10 seconds”) can influence whether the very same visual event is processed as containing distinct temporal stages including a well‐defined (...) endpoint or lacking such structure, respectively. In two experiments, we show that processing (a)telicity in language shifts how people later construe the temporal structure of identical visual stimuli. We conclude that event construals are malleable representations that can align with the linguistic framing of events. (shrink)

Formal theories of mental representation have receded from the importance they had in the early days of cognitive science. I argue that such theories are crucial in any mental domain, not just for their own sake, but to guide experimental inquiry, as well as to integrate the domain into the mind as a whole. To illustrate the criteria of adequacy for theories of mental representation, I compare two theoretical approaches to language: classical generative grammar (Chomsky, 1965, 1981, 1995) and the (...) parallel architecture (Jackendoff, 1997, 2002). The grounds for comparison include (a) the internal coherence of the theory across phonology, syntax, and semantics; (b) the relation of language to other mental faculties; (c) the relationship between grammar and lexicon; (d) relevance to theories of language processing; and (e) the possibility of languages with little or no syntax. (shrink)

Containment and support have traditionally been assumed to represent universal conceptual foundations for spatial terms. This assumption can be challenged, however: English in and on are applied across a surprisingly broad range of exemplars, and comparable terms in other languages show significant variation in their application. We propose that the broad domains of both containment and support have internal structure that reflects different subtypes, that this structure is reflected in basic spatial term usage across languages, and that it constrains children's (...) spatial term learning. Using a newly developed battery, we asked how adults and 4-year-old children speaking English or Greek distribute basic spatial terms across subtypes of containment and support. We found that containment showed similar distributions of basic terms across subtypes among all groups while support showed such similarity only among adults, with striking differences between children learning English versus Greek. We conclude that the two domains differ considerably in the learning problems they present, and that learning in and on is remarkably complex. Together, our results point to the need for a more nuanced view of spatial term learning. (shrink)

Space can be understood through perception and language, but are the processes that represent spatial information the same in both cases? This paper reviews psychological evidence for the functional equivalence of spatial representations based on perceptual and linguistic inputs. It is proposed that spatial information is processed by a specialised spatial representation system (SRS) that creates geometric representations of space. The SRS receives inputs from perceptual and linguistic systems and uses these basic inputs to construct mental spatial models of the (...) observed or described environment. A mental spatial model is created by determining the coordinate locations of objects in the egocentric or allocentric frame of reference. The goal of the SRS is not to represent strictly what is perceived, but to model an environment that has an inherent three‐dimensional spatial structure. (shrink)

What aspects of spatial relations influence speakers’ choice of locative? This article presents a study of static spatial descriptions from 24 languages. The study reveals two kinds of spatial terms evident cross‐linguistically: specific spatial terms and general spatial terms (GSTs). Whereas specific spatial terms—including English prepositions—occur in a limited range of situations, with concomitant specificity in their meaning, GSTs occur in all spatial descriptions (in languages that employ them). Because of the extreme differences in range of application, the two are (...) considered separately. A multidimensional scaling analysis is used with specific spatial terms to extract statistically valid similarities across the languages sampled. For GSTs, which have not been previously analyzed in the literature, a semantic analysis is proposed and experimentally validated. The results suggest the importance of geometry, function, and qualitative physics to the meanings of both kinds of spatial terms, although the details differ. (shrink)

The ability to combine words into novel sentences has been used to argue that humans have symbolic language production abilities. Critiques of connectionist models of language often center on the inability of these models to generalize symbolically (Fodor & Pylyshyn, 1988; Marcus, 1998). To address these issues, a connectionist model of sentence production was developed. The model had variables (role‐concept bindings) that were inspired by spatial representations (Landau & Jackendoff, 1993). In order to take advantage of these variables, a novel (...) dual‐pathway architecture with event semantics is proposed and shown to be better at symbolic generalization than several variants. This architecture has one pathway for mapping message content to words and a separate pathway that enforces sequencing constraints. Analysis of the model's hidden units demonstrated that the model learned different types of information in each pathway, and that the model's compositional behavior arose from the combination of these two pathways. The model's ability to balance symbolic and statistical behavior in syntax acquisition and to model aphasic double dissociations provided independent support for the dual‐pathway architecture. (shrink)

When people describe motion events, their path expressions are biased toward inclusion of goal paths (e.g., into the house) and omission of source paths (e.g., out of the house). In this paper, we explored whether this asymmetry has its origins in people’s non-linguistic representations of events. In three experiments, 4-year-old children and adults described or remembered manner of motion events that represented animate/intentional and physical events. The results suggest that the linguistic asymmetry between goals and sources is not fully rooted (...) in non-linguistic event representations: linguistic descriptions showed the goal bias for both kinds of events, whereas non-linguistic memory for events showed the goal bias only for events involving animate, goal-directed motion. The findings are discussed in terms of the mapping between non-linguistic representations of goals and sources in language, focusing on the role that linguistic principles play in producing a more absolute goal bias from more gradient non-linguistic representations of paths. (shrink)

Space can be understood through perception and language, but are the processes that represent spatial information the same in both cases? This paper reviews psychological evidence for the functional equivalence of spatial representations based on perceptual and linguistic inputs. It is proposed that spatial information is processed by a specialised spatial representation system (SRS) that creates geometric representations of space. The SRS receives inputs from perceptual and linguistic systems and uses these basic inputs to construct mental spatial models of the (...) observed or described environment. A mental spatial model is created by determining the coordinate locations of objects in the egocentric or allocentric frame of reference. The goal of the SRS is not to represent strictly what is perceived, but to model an environment that has an inherent three‐dimensional spatial structure. (shrink)

Landau also pushes the role of syntax and its mapping to semantics in learning what some would consider “easy words”—the simplest spatial prepositions in English, in and on. Taking as a starting point that the syntactic distribution of a word is a reflex of its meaning, Landau shows that careful study of how children and adults linguistically encode a range of containment and support configurations reveals a special status for “core” configurations in each domain. She proposes that children come to (...) learning spatial terms with the expectation that configurations reflecting core concepts of containment and support will be expressed with the maximally simple, unmarked, linguistic expression. (shrink)

How does the human brain link relational concepts to perceptual experience? For example, a speaker may say “the cup to the left of the computer” to direct the listener's attention to one of two cups on a desk. We provide a neural dynamic account for both perceptual grounding, in which relational concepts enable the attentional selection of objects in the visual array, and for the generation of descriptions of the visual array using relational concepts. In the model, activation in neural (...) populations evolves dynamically under the influence of both inputs and strong interaction as formalized in dynamic field theory. Relational concepts are modeled as patterns of connectivity to perceptual representations. These generalize across the visual array through active coordinate transforms that center the representation of target objects in potential reference objects. How the model perceptually grounds or generates relational descriptions is probed in 104 simulations that systematically vary the spatial and movement relations employed, the number of feature dimensions used, and the number of matching and nonmatching objects. We explain how sequences of decisions emerge from the time‐ and state‐continuous neural dynamics, how relational hypotheses are generated and either accepted or rejected, followed by the selection of new objects or the generation of new relational hypotheses. Its neural realism distinguishes the model from information processing accounts, its capacity to autonomously generate sequences of processing steps distinguishes it from deep neural network accounts. The model points toward a neural dynamic theory of higher cognition. (shrink)

We investigate a possible universal constraint on spatial meaning. It has been proposed that people attend preferentially to the endpoints of spatial motion events, and that languages may therefore make finer semantic distinctions at event endpoints than at event beginnings. We test this proposal. In Experiment 1, we show that people discriminate the endpoints of spatial motion events more readily than they do event beginnings—suggesting a non-linguistic attentional bias toward endpoints. In Experiment 2, speakers of Arabic, Chinese, and English each (...) described a set of spatial events displayed in video clips. Although the spatial systems of these languages differ, speakers of all three languages made finer semantic distinctions at event endpoints, compared to event beginnings. These findings are consistent with the proposal that event endpoints are privileged over event beginnings, in both language and perception. (shrink)