We introduce a computational theory of situated language understanding in which the meaning of words and utterances depends on the physical environment and the goals and plans of communication partners. According to the theory, concepts that ground linguistic meaning are neither internal nor external to language users, but instead span the objective‐subjective boundary. To model the possible interactions between subject and object, the theory relies on the notion of perceived affordances: structured units of interaction that can be used for prediction (...) at multiple levels of abstraction. Language understanding is treated as a process of filtering perceived affordances. The theory accounts for many aspects of the situated nature of human language use and provides a unified solution to a number of demands on any theory of language understanding including conceptual combination, prototypicality effects, and the generative nature of lexical items.To support the theory, we describe an implemented system that understands verbal commands situated in a virtual gaming environment. The implementation uses probabilistic hierarchical plan recognition to generate perceived affordances. The system has been evaluated on its ability to correctly interpret free‐form spontaneous verbal commands recorded from unrehearsed game play between human players. The system is able to “step into the shoes” of human players and correctly respond to a broad range of verbal commands in which linguistic meaning depends on social and physical context. We quantitatively compare the system's predictions in response to direct player commands with the actions taken by human players and show generalization to unseen data across a range of situations and verbal constructions. (shrink)

What role do speakers'/authors’ communicative intentions play in language interpretation? Cognitive scientists generally assume that listeners'/readers’ recognitions of speakers'/authors’ intentions is a crucial aspect of utterance interpretation. Various philosophers, literary theorists and anthropologists criticize this intentional view and assert that speakers'/authors’ intentions do not provide either the starting point for linguistic interpretation or constrain how texts should be understood. Until now, cognitive scientists have not seriously responded to the current challenges regarding intentions in communication. My purpose in this article is (...) to provide just such a response. I briefly describe some of the empirical evidence in cognitive science on the importance of intentions in communication. I then discuss some of the criticisms of the intentional view that have arisen in the humanities and social sciences. Following this, I offer a partial resolution to the intentionalist controversy that recognizes the differing views on the idea of linguistic interpretation. I specifically suggest a way of thinking about linguistic interpretation in terms of the time‐course of understanding that provides a metric for evaluating the role of intentions in communication. This time‐course perspective on linguistic understanding provides for the plurality of ideas that now exist both in cognitive science and in postmodern philosophical thought. (shrink)

We consider two issues relating to WH-questions:(i) when you ask aWH-question you already have a description of the entity you are interested in,namely the description embodied in the question itself. You may evenhave very direct access to the entity – see (1) below.In general, what you want is an alternative description of some item thatyou already know a certain amount about.

In this paper, we claim that the disambiguation ofreferring expressions in discourse can be formulated in terms automatedreasoners can address. Specifically, we show that consistency,informativity and minimality are criteria which (i) can be implementedusing automated reasoning tools and (ii) can be used to disambiguatenoun-noun compounds, metonymy and definite descriptions.

This paper explores principles governing the rational balance among an agent's beliefs, goals, actions, and intentions. Such principles provide specifications for artificial agents, and approximate a theory of human action (as philosophers use the term). By making explicit the conditions under which an agent can drop his goals, i.e., by specifying how the agent is committed to his goals, the formalism captures a number of important properties of intention. Specifically, the formalism provides analyses for Bratman's three characteristic functional roles played (...) by intentions [7, 9], and shows how agents can avoid intending all the foreseen side-effects of what they actually intend. Finally, the analysis shows how intentions can be adopted relative to a background of relevant beliefs and other intentions or goals. By relativizing one agent's intentions in terms of beliefs about another agent's intentions (or beliefs'), we derive a preliminary account of interpersonal commitments. (shrink)

The general aim of this work is to show the importance of the adressee's mind as planned by the author of a speech act or of a norm; in particular, how important are the expected motivations for goal adoption. We show that speech acts differ from one another for the different motivations the speaker is attempting to obtain from the hearer. The description of the participants' social positions is not sufficient. Important conflicts can arise which are not relative to what (...) to do, but to the different motives requested by the speaker. This view is applied to norms, pointing out that what is required by a norm is not only a behaviour but also a mental attitude, and that the prescribed mind might be even more important than the prescribed behaviour. Norms don't want just behavioural conformity, but also that this conformity implies an acknowledgement and a reinforcement of both the authority and the norm itself. Norms ask for submission. Any form of norm is aimed at influencing the addressee by changing his or her mind. (shrink)

This paper is a commentary on the target article by Lokendra Shastri & Venkat Ajjanagadde [S&A]: “From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony” in same issue of the journal, pp.417–451. -/- It puts S&A's temporal-synchrony binding method in a broader context, comments on notions of pointing and other ways of associating information - in both computers and connectionist systems - and mentions types of reasoning that are a challenge to (...) S&A's system (amongst many other connectionist systems, recognizing that S&A's is much more capable as regards reasoning than most other contemporary systems). (shrink)

This project continues our interdisciplinary research into computational and cognitive aspects of narrative comprehension. Our ultimate goal is the development of a computational theory of how humans understand narrative texts. The theory will be informed by joint research from the viewpoints of linguistics, cognitive psychology, the study of language acquisition, literary theory, geography, philosophy, and artificial intelligence. The linguists, literary theorists, and geographers in our group are developing theories of narrative language and spatial understanding that are being tested by the (...) cognitive psychologists and language researchers in our group, and a computational model of a reader of narrative text is being developed by the AI researchers, based in part on these theories and results and in part on research on knowledge representation and reasoning. This proposal describes the knowledge-representation and natural-language-processing issues involved in the computational implementation of the theory; discusses a contrast between communicative and narrative uses of language and of the relation of the narrative text to the story world it describes; investigates linguistic, literary, and hermeneutic dimensions of our research; presents a computational investigation of subjective sentences and reference in narrative; studies children’s acquisition of the ability to take third-person perspective in their own storytelling; describes the psychological validation of various linguistic devices; and examines how readers develop an understanding of the geographical space of a story. This report is a longer version of a project description submitted to NSF. This document, produced in May 2007, is a L ATEX version of Technical Report 89-07 (Buffalo: SUNY Buffalo Department of Computer Science, August 1989), with slightly.. (shrink)

Utterances in situated activity are about the world. Theories and systems normally capture this by assuming references must be resolved to real-world entities in utterance understanding. We describe a number of puzzles and problems for this approach, and propose an alternative semantic representation using discourse relations that link utterances to the nonlinguistic context to capture the context-dependent interpretation of situated utterances. Our approach promises better empirical coverage and more straightforward system building. Substantiating these advantages is work in progress.

This research is concerned with the innate predispositions underlying human intentional communication. Human communication is currently defined as a circular and overt attempt to modify a partner's mental states. This requires each party involved to posse ss the ability to represent and understand the other's mental states, a capability which is commonly referred to as mindreading, or theory of mind (ToM). The relevant experimental literature agrees that no such capability is to be found in the human speci es at least (...) during the first year of life, and possibly later. This paper aims at advancing a solution to this theoretical problem. We propose to consider sharedness as the basis for intentional communication in the infant and to view it as a primitive, i nnate component of her cognitive architecture. Communication can then build upon the mental grounds that the infant takes as shared with her caregivers. We view this capability as a theory of mind in a weak sense.›. (shrink)

From a cognitive perspective, intentional communication may be viewed as an agent's activity overtly aimed at modifying a partner's mental states. According to standard Gricean definitions, this requires each party to be able to ascribe mental states to the other, i.e., to entertain a so-called theory of mind. According to the relevant experimental literature, however, such capability does not appear before the third or fourth birthday; it would follow that children under that age should not be viewed as communicating agents. (...) In order to solve the resulting dilemma, we propose that certain specific components of an agent's cognitive architecture (namely, a peculiar version of sharedness and communicative intention), are necessary and sufficient to explain infant communication in a mentalist framework. We also argue that these components are innate in the human species. (shrink)

This chapter investigates the computational consequences of a broadly Gricean view of language use as intentional activity. In this view, dialogue rests on coordinated reasoning about communicative intentions. The speaker produces each utterance by formulating a suitable communicative intention. The hearer understands it by recognizing the communicative intention behind it. When this coordination is successful, interlocutors succeed in considering the same intentions— that is, the same representations of utterance meaning—as the dialogue proceeds. In this paper, I emphasize that these intentions (...) can be formalized; we can provide abstract but systematic representations that spell out what a speaker is trying to do with an utterance. Such representations describe utterances simultaneously as the product of our knowledge of grammar and as actions chosen for a reason. In particular, they must characterize the speaker’s utterance in grammatical terms, provide the links to the context that the grammar requires, and so arrive at a contribution that the speaker aims to achieve. Because I have implemented this formalism, we can regard it as a possible analysis of conversational processes at the level of computational theory. Nevertheless, this analysis leaves open what the nature of the biological computation involved in inference to intentions is, and what regularities in language use support this computation. (shrink)