Cognitive representations are typically analysed in terms of content, vehicle and format. While current work on formats appeals to intuitions about external representations, such as words and maps, in this paper we develop a computational view of formats that does not rely on intuitions. In our view, formats are individuated by the computational profiles of vehicles, i.e., the set of constraints that fix the computational transformations vehicles can undergo. The resulting picture is strongly pluralistic, it makes space for a variety (...) of different formats, and is intimately tied to the computational approach to cognition in cognitive science and artificial intelligence. (shrink)

“What is the structure of thought?” is as central a question as any in cognitive science. A classic answer to this question has appealed to a Language of Thought (LoT). We point to emerging research from disparate branches of the field that supports the LoT hypothesis, but also uncovers diversity in LoTs across cognitive systems, stages of development, and species. Our letter formulates open research questions for cognitive science concerning the varieties of rules and representations that underwrite various LoT-based systems (...) and how these variations can help researchers taxonomize cognitive systems. (shrink)

This commentary critically examines the view of the relationship between perception and memory in Ned Block's *The Border Between Seeing and Thinking*. It argues that visual working memory often stores the outputs of perception without altering their formats, allowing online visual perception to access these memory representations in computations that unfold over longer timescales and across eye movements. Since Block concedes that visual working memory representations are not iconic, we should not think of perceptual representations as exclusively iconic either.

It is commonly assumed that images, whether in the world or in the head, do not have a privileged analysis into constituent parts. They are thought to lack the sort of syntactic structure necessary for representing complex contents and entering into sophisticated patterns of inference. I reject this assumption. “Image grammars” are models in computer vision that articulate systematic principles governing the form and content of images. These models are empirically credible and can be construed as literal grammars for images. (...) Images can have rich syntactic structure, though of a markedly different form than sentences in language. (shrink)

Research on concepts has concentrated on the way people apply concepts online, when presented with a stimulus. Just as important, however, is the use of concepts offline, when planning what to do or thinking about what is the case. There is strong evidence that inferences driven by conceptual thought draw heavily on special-purpose resources: sensory, motoric, affective, and evaluative. At the same time, concepts afford general-purpose recombination and support domain-general reasoning processes—phenomena that have long been the focus of philosophers. There (...) is a growing consensus that a theory of concepts must encompass both kinds of process. This book shows how concepts are able to act as an interface between general-purpose reasoning and special-purpose systems. Concept-driven thinking can take advantage of the complementary costs and benefits of each. The book lays out an empirically-based account of the different ways in which thinking with concepts takes us to new conclusions and underpins planning, decision-making, and action. It also spells out three useful implications of the account. First, it allows us to reconstruct the commonplace idea that thinking draws on the meaning of a concept. Second, it offers an insight into how human cognition avoids the frame problem and the complementary, less discussed, ‘if-then problem’ for nested processing dispositions. Third, it shows that metacognition can apply to concepts and concept-driven thinking in various ways. The framework developed in the book elucidates what it is that makes concept-driven thinking an especially powerful cognitive resource. (shrink)

A comprehensive introduction to the Language of Though Hypothesis (LOTH) accessible to general audiences. LOTH is an empirical thesis about thought and thinking. For their explication, it postulates a physically realized system of representations that have a combinatorial syntax (and semantics) such that operations on representations are causally sensitive only to the syntactic properties of representations. According to LOTH, thought is, roughly, the tokening of a representation that has a syntactic (constituent) structure with an appropriate semantics. Thinking thus consists in (...) syntactic operations defined over representations. Most of the arguments for LOTH derive their strength from their ability to explain certain empirical phenomena like productivity, systematicity of thought and thinking. (shrink)

When a piece of fruit is in a bowl, and the bowl is on a table, we appreciate not only the individual objects and their features, but also the relations containment and support, which abstract away from the particular objects involved. Independent representation of roles (e.g., containers vs. supporters) and “fillers” of those roles (e.g., bowls vs. cups, tables vs. chairs) is a core principle of language and higherlevel reasoning. But does such role-filler independence also arise in automatic visual processing? (...) Here, we show that it does, by exploring a surprising error that such independence can produce. In four experiments, participants saw a stream of images containing different objects arranged in forcedynamic relations — e.g., a phone contained in a basket, a marker resting on a garbage can, or a knife sitting in a cup. Participants had to respond to a single target image (e.g., a phone in a basket) within a stream of distractors presented under time constraints. Surprisingly, even though participants completed this task quickly and accurately, they false-alarmed more often to images matching the target’s relational category than to those that did not — even when those images involved completely different objects. In other words, participants searching for a phone in a basket were more likely to mistakenly respond to a knife in a cup than to a marker on a garbage can. Follow-up experiments ruled out strategic responses and also controlled for various confounding image features. We suggest that visual processing represents relations abstractly, in ways that separate roles from fillers. (shrink)

This paper discusses the familiar question of whether expressions of faith or conviction offered by religious believers really express their beliefs, in the standard sense of ‘belief’ used in philosophy and psychology. Some hold that these expressions do not express genuine beliefs because they do not meet the standards of rationality, coherence and integration which govern beliefs. So they must serve some other function. But this picture of ‘genuine belief’ is inadequate, for reasons independent of the phenomenon of religion. Once (...) we get a better picture of belief, we can see that religious beliefs conform to this picture, and that typical expressions of faith really are expressions of belief in the proper sense. (shrink)

It is widely thought that there are limits to how things can perceptually appear to us. For instance, nothing can appear both square and circular, or both pure red and pure blue. Adam Pautz has dubbed such constraints “laws of appearance.” But if the laws of appearance obtain, then what explains them? Here I examine the prospects for an empirical explanation of the laws of appearance. First, I challenge extant empirical explanations that appeal purely to the format of perceptual representation. (...) I then develop a hybrid approach, on which the laws are explained not merely by format, but by two further factors: ecological constraints imposed by our environments, and computational constraints embodied by our perceptual systems. While the hybrid approach implies that the laws of appearance are contingent, I argue that this implication is empirically defensible, since even some of the most intuitively compelling laws have real-world counterexamples. (shrink)

The “binding problem” has been a central question in vision science for some 30 years: When encoding multiple objects or maintaining them in working memory, how are we able to represent the correspondence between a specific feature and its corresponding object correctly? In this letter we argue that the boundaries of this research program in fact extend far beyond vision, and we call for coordinated pursuit across the broader cognitive science community of this central question for cognition, which we dub (...) “Binding Problem 2.0”. (shrink)

Abstract: Research on the nature and varieties of the format of cognitive representations in philosophy and cognitive science have been partly shaped by analogies to external, public representations. In this paper, we argue that relying on such analogies contributes to framing the question of cognitive formats in problematic, potentially counterproductive ways. We show that cognitive and public representations differ in many of their central features, making analogies to public representations ill-suited to improving our understanding of cognitive formats. We illustrate these (...) points by examining two case studies in which analogies to public representations may have had a negative impact on research: the 80’s-90’s debate about compositionality and cognitive architecture between symbolicists and connectionists; and contemporary discussions about the nature of visual demonstratives. Finally, we outline an alternative, computational account of formats that does not share the shortcomings of appeal to public representations. (shrink)

Abstract: Research on the nature and varieties of the format of cognitive representations in philosophy and cognitive science have been partly shaped by analogies to external, public representations. In this paper, we argue that relying on such analogies contributes to framing the question of cognitive formats in problematic, potentially counterproductive ways. We show that cognitive and public representations differ in many of their central features, making analogies to public representations ill-suited to improving our understanding of cognitive formats. We illustrate these (...) points by examining two case studies in which analogies to public representations may have had a negative impact on research: the 80’s-90’s debate about compositionality and cognitive architecture between symbolicists and connectionists; and contemporary discussions about the nature of visual demonstratives. Finally, we outline an alternative, computational account of formats that does not share the shortcomings of appeal to public representations. (shrink)

Engrams—physical memory traces resulting from specific experiences—are the central posits of modern memory science. In this paper, I examine engrams through the lens of the theory of mental files. Integrating evidence from a variety of research programs, I argue that engrams exhibit the core functional properties of mental files. I characterize them as discrete informational structures, formed upon individual experiences of events and causally involved in their subsequent recall. Engrams are plausibly structurally complex in a file-like way, consisting of a (...) stable hippocampal index, which may function as an atomic pointer-like component, and a distributed cortical representation of an event’s properties. As such, they afford transmission of content and referential stability during potential content change. Their deployment is constitutive of the capacity for singular reference in episodically remembering particular previously experienced events. This emerging picture of engrams should engender reasonable optimism about the prospects of causal-representational theories of memory. (shrink)

The astute reviews by Hamlin and by Revencu and Csibra provide compelling arguments and evidence for the early emergence of moral evaluation, communication, and pedagogical learning. I accept these conclusions but not the reviewers' claims that infants' talents in these domains depend on core systems of moral evaluation or pedagogical communication. Instead, I suggest that core knowledge of people as agents and as social beings, together with infants' emerging understanding of their native language, support learning about people as moral agents, (...) moral patients, communicators, and teachers. These issues are open, however, and our competing views invite further testing. (shrink)

We offer philosophical motivations for a method we call Virtual World Cognitive Science (VW CogSci), in which researchers use virtual embodied agents that are embedded in virtual worlds to explore questions in the field of Cognitive Science. We focus on questions about mental and linguistic representation and the ways that such computational modeling can add rigor to philosophical thought experiments, as well as the terminology used in the scientific study of such representations. We find that this method forces researchers to (...) take a god’s-eye view when describing dynamical relationships between entities in minds and entities in an environment in a way that eliminates the need for problematic talk of belief and concept types, such as the belief that cats are silly, and the concept CAT, while preserving belief and concept tokens in individual cognizers’ minds. We conclude with some further key advantages of VW CogSci for the scientific study of mental and linguistic representation and for Cognitive Science more broadly. (shrink)

A typical claim in anti-representationalist approaches to cognition such as ecological psychology or radical embodied cognitive science is that ecological information is sufficient for guiding behavior. According to this view, affordances are immediately perceptually available to the agent (in the so-called “ambient energy array”), so sensory data does not require much further inner processing. As a consequence, mental representations are explanatorily idle: perception is immediate and direct. Here we offer one way to formalize this direct-perception claim and identify some important (...) limits to it. We argue that the claim should be read as saying that successful behavior just implies picking out affordance-related information from the ambient energy array. By relying on the Partial Information Decomposition framework, and more concretely on its development of the notion of synergy, we show that in multimodal perception, where various energy arrays carry affordance-related information, the “just pick out affordance-related information” approach is very inefficient, as it is bound to miss all synergistic components. Efficient multimodal information combination requires transmitting sensory-specific (and not affordance-specific) information to wherever it is that the various information streams are combined. The upshot is that some amount of computation is necessary for efficient affordance reconstruction. (shrink)

Philosophy and Phenomenological Research, EarlyView.

Philosophy and Phenomenological Research, EarlyView.

The dominant practice of AI alignment assumes (1) that preferences are an adequate representation of human values, (2) that human rationality can be understood in terms of maximizing the satisfaction of preferences, and (3) that AI systems should be aligned with the preferences of one or more humans to ensure that they behave safely and in accordance with our values. Whether implicitly followed or explicitly endorsed, these commitments constitute what we term apreferentistapproach to AI alignment. In this paper, we characterize (...) and challenge the preferentist approach, describing conceptual and technical alternatives that are ripe for further research. We first survey the limits of rational choice theory as a descriptive model, explaining how preferences fail to capture the thick semantic content of human values, and how utility representations neglect the possible incommensurability of those values. We then critique the normativity of expected utility theory (EUT) for humans and AI, drawing upon arguments showing how rational agents need not comply with EUT, while highlighting how EUT is silent on which preferences are normatively acceptable. Finally, we argue that these limitations motivate a reframing of the targets of AI alignment: Instead of alignment with the preferences of a human user, developer, or humanity-writ-large, AI systems should be aligned with normative standards appropriate to their social roles, such as the role of a general-purpose assistant. Furthermore, these standards should be negotiated and agreed upon by all relevant stakeholders. On this alternative conception of alignment, a multiplicity of AI systems will be able to serve diverse ends, aligned with normative standards that promote mutual benefit and limit harm despite our plural and divergent values. (shrink)

The theory of mental models and its computer implementations have led to crucial experiments showing that no standard logic—the sentential calculus and all logics that include it—can underlie human reasoning. The theory replaces the logical concept of validity (the conclusion is true in all cases in which the premises are true) with necessity (conclusions describe no more than possibilities to which the premises refer). Many inferences are both necessary and valid. But experiments show that individuals make necessary inferences that are (...) invalid, e.g., Few people ate steak or sole; therefore, few people ate steak. Other crucial experiments show that individuals reject inferences that are not necessary but valid, e.g., He had the anesthetic or felt pain, but not both; therefore, he had the anesthetic or felt pain, or both. Nothing in logic can justify the rejection of a valid inference: a denial of its conclusion is inconsistent with its premises, and inconsistencies yield valid inferences of any conclusions whatsoever including the one denied. So inconsistencies are catastrophic in logic. In contrast, the model theory treats all inferences as defeasible (nonmonotonic), and inconsistencies have the null model, which yields only the null model in conjunction with any other premises. So inconsistences are local. Which allows truth values in natural languages to be much richer than those that occur in the semantics of standard logics; and individuals verify assertions on the basis of both facts and possibilities that did not occur. (shrink)

Twenty-five commentaries raise questions concerning the origins of knowledge, the interplay of iconic and propositional representations in mental life, the architecture of numerical and social cognition, the sources of uniquely human cognitive capacities, and the borders among core knowledge, perception, and thought. They also propose new methods, drawn from the vibrant, interdisciplinary cognitive sciences, for addressing these questions and deepening understanding of infant minds.

What Babies Know (WBK) argues that core knowledge has a unique place in cognitive architecture, between fully perceptual and fully conceptual systems of representation. Here I argue that WBK's core knowledge is on the perception side of the perception/cognition divide. I discuss some implications of this conclusion for the roles language learning might play in transcending core knowledge.

There has been considerable debate among scholars as to whether maps can play an inferential role. The debate has focused on whether maps possess the representational format required for logical transitions. This paper addresses a distinct challenge, namely whether maps can satisfy the taking condition, which has been proposed as a necessary condition for inference. In doing so, the focus of the discussion is slightly shifted by analyzing not only the representational structure of maps but also the rational transitions within (...) them. Given that one of the main reasons for the use of maps is navigation, a dynamic notion of inference is proposed which takes into account practical reasoning. According to this view, logical theoretical inferences are just one type of many different kinds of inferential processes. (shrink)

The annual meeting of the Cognitive Science Society is aimed at basic and applied cognitive science research. The conference hosts the latest theories and data from the world's best cognitive science researchers. Each year, in addition to submitted papers, researchers are invited to highlight some aspect of cognitive science.

In this article, we propose to revisit a debate that began over two decades ago around the question of the naturalization of phenomenology. In particular, we attempt to determine the meaning of this naturalization project in the context of the study of the origin and foundations of geometry. To do so we shall follow the following plan: We begin by briefly reviewing the debate surrounding the possibility of naturalizing phenomenology, and the various conceptual problems involved in this attempt at naturalization. (...) We then turn to the specific object of the article: the genesis of geometrical idealities. First, we review the main theoretical frameworks within the cognitive sciences for a naturalist analysis of the genesis of geometric idealities. Secondly, we show that these approaches are partially theoretically incompatible with the genesis of geometric idealities as conceived by Husserl, and we extract three constraints that should guide any attempt to naturalize it. Finally, we present a program to carry out this naturalization that is based on current research. (shrink)