This article takes off from Johan van Benthem’s ruminations on the interface between logic and cognitive science in his position paper “Logic and reasoning: Do the facts matter?”. When trying to answer Van Benthem’s question whether logic can be fruitfully combined with psychological experiments, this article focuses on a specific domain of reasoning, namely higher-order social cognition, including attributions such as “Bob knows that Alice knows that he wrote a novel under pseudonym”. For intelligent interaction, it is important that the (...) participants recursively model the mental states of other agents. Otherwise, an international negotiation may fail, even when it has potential for a win-win solution, and in a time-critical rescue mission, a software agent may depend on a teammate’s action that never materializes. First a survey is presented of past and current research on higher-order social cognition, from the various viewpoints of logic, artificial intelligence, and psychology. Do people actually reason about each other’s knowledge in the way proscribed by epistemic logic? And if not, how can logic and cognitive science productively work together to construct more realistic models of human reasoning about other minds? The paper ends with a delineation of possible avenues for future research, aiming to provide a better understanding of higher-order social reasoning. The methodology is based on a combination of experimental research, logic, computational cognitive models, and agent-based evolutionary models. (shrink)

This article proposes a number of models to examine through which mechanisms a population of autonomous agents could arrive at a repertoire of perceptually grounded categories that is sufficiently shared to allow successful communication. The models are inspired by the main approaches to human categorisation being discussed in the literature: nativism, empiricism, and culturalism. Colour is taken as a case study. Although we take no stance on which position is to be accepted as final truth with respect to human categorisation (...) and naming, we do point to theoretical constraints that make each position more or less likely and we make clear suggestions on what the best engineering solution would be. Specifically, we argue that the collective choice of a shared repertoire must integrate multiple constraints, including constraints coming from communication. Key Words: autonomous agents; colour categorisation; colour naming; connectionism; cultural evolution; genetic evolution; memes; origins of language; self-organisation; semiotic dynamics; symbol grounding. (shrink)

Humans and other animals are able not only to coordinate their actions with their current sensorimotor state, but also to imagine, plan and act in view of the future, and to realize distal goals. In this paper we discuss whether or not their future-oriented conducts imply (future-oriented) representations. We illustrate the role played by anticipatory mechanisms in natural and artificial agents, and we propose a notion of representation that is grounded in the agent’s predictive capabilities. Therefore, we argue that the (...) ability that characterizes and defines a true cognitive mind, as opposed to a merely adaptive system, is that of building representations of the non-existent, of what is not currently (yet) true or perceivable, of what is desired. A real mental activity begins when the organism is able to endogenously (i.e. not as the consequence of current perceptual stimuli) produce an internal representation of the world in order to select and guide its conduct goal-directed: the mind serves to coordinate with the future. (shrink)

The development of reasoning systems exploiting expert knowledge from interactions with humans is a non-trivial problem, particularly when considering how the information can be coded in the knowledge representation. For example, in human development, the acquisition of knowledge at one level requires the consolidation of knowledge from lower levels. How is the accumulated experience structured to allow the individual to apply knowledge to new situations, allowing reasoning and adaptation? We investigate how this can be done automatically by an iCub that (...) interacts with humans to acquire knowledge via demonstration. Once consolidated, this knowledge is used in further acquisitions of experience concerning preconditions and consequences of actions. Finally, this knowledge is translated into rules that allow reasoning and planning for novel problem solving, including a Tower of Hanoi scenario. We thus demonstrate proof of concept for an interaction system that uses knowledge acquired from human interactions to reason about new situations. (shrink)

Joint attention is an early-emerging and uniquely human capacity that lies at the foundation of many other capacities of humans, such as language and the understanding of other minds. In this article, I summarize what developmentalists and philosophers have come to find out about joint attention, and I end by stating that two problems or questions of joint attention require additional research: 1) the relation between joint attention and the skills for dyadic sharing or affect exchange in young infants, and (...) 2) the evolution of joint attention. (shrink)

On a widely held characterization, triadic joint attention is the capacity to perceptually attend to an object or event together with another subject. In the last four decades, research in developmental psychology has provided increasing evidence of the crucial role that this capacity plays in socio-cognitive development, early language acquisition, and the development of perspective-taking. Yet, there is a striking discrepancy between the general agreement that joint attention is critical in various domains, and the lack of theoretical consensus on how (...) to account for it. This paper pursues three interrelated aims: (i) it examines the contrast between reductive and non-reductive views of (triadic) joint attention, by bringing into focus the notion of recursive mindreading; (ii) it assembles, advances, and discusses a number of arguments against reductive views; (iii) finally, in dialogue with some prominent non-reductive views, it outlines the case for a non-reductive view that gives pride of place to the idea that co-attenders relate to one another as a ‘you’. (shrink)

Goldstein reported multiple cases of failure to categorise colours in patients that he termed amnesic or anomic aphasics. These patients have a particular difficulty in producing perceptual categories in the absence of other aphasic impairments. We hold that neuropsychological evidence supports the view that the task of colour categorisation is logically impossible without labels.

Whether collective agency is a coherent concept depends on the theory of agency that we choose to adopt. We argue that the enactive theory of agency developed by Barandiaran, Di Paolo and Rohde (2009) provides a principled way of grounding agency in biological organisms. However the importance of biological embodiment for the enactive approach might lead one to be skeptical as to whether artificial systems or collectives of individuals could instantiate genuine agency. To explore this issue we contrast the concept (...) of collective agency with multi-agent systems and multi-system agents, and argue that genuinely collective agents instantiate agency at both the collective level and at the level of the component parts. Developing the enactive model, we propose understanding agency – both at the level of the individual and of the collective – as spectra that are constituted by dimensions that vary across time. Finally, we consider whether collectives that are not merely metaphorically ‘agents’ but rather are genuinely agentive also instantiate subjectivity at the collective level. We propose that investigations using the perceptual crossing paradigm suggest that a shared lived perspective can indeed emerge but this should not be conflated with a collective first-person perspective, for which material integration in a living body may be required. (shrink)

Joint attention is a social-cognitive phenomenon in which two or more agents direct their attention together towards the same object. Definitions range from this rather broad conception to more specific definitions which require that, in addition, attention be directed to the same aspect of that object and that agents need to be mutually aware of their jointly attending. Joint attention is an important coordination mechanism in joint action. The capacity for engaging in joint attention, in particular in the sense of (...) this narrower definition, is frequently taken to indicate the presence of theory of mind in the participating agents, and is also implicated in the development of theory of mind. However, the prominence of sensorimotor components in establishing and sustaining episodes of joint attention — e.g., eye and head movements, pointing and vocalizations — suggests that sensorimotor approaches to social interaction may be well-placed to account for important parts of joint attention without invoking theory-of-mind abilities, and may therefore provide a valuable alternative to approaches emphasizing theory of mind. In particular, sensorimotor accounts may explain aspects of joint attention through the dynamics and regularities in the sensorimotor processes that coordinate the activities of the agents. (shrink)

From playing basketball to ordering at a food counter, we frequently and effortlessly coordinate our attention with others towards a common focus: we look at the ball, or point at a piece of cake. This non-verbal coordination of attention plays a fundamental role in our social lives: it ensures that we refer to the same object, develop a shared language, understand each other’s mental states, and coordinate our actions. Models of joint attention generally attribute this accomplishment to gaze coordination. But (...) are visual attentional mechanisms sufficient to achieve joint attention, in all cases? Besides cases where visual information is missing, we show how combining it with other senses can be helpful, and even necessary to certain uses of joint attention. We explain the two ways in which non-visual cues contribute to joint attention: either as enhancers, when they complement gaze and pointing gestures in order to coordinate joint attention on visible objects, or as modality pointers, when joint attention needs to be shifted away from the whole object to one of its properties, say weight or texture. This multisensory approach to joint attention has important implications for social robotics, clinical diagnostics, pedagogy and theoretical debates on the construction of a shared world. (shrink)