It is commonly assumed that images, whether in the world or in the head, do not have a privileged analysis into constituent parts. They are thought to lack the sort of syntactic structure necessary for representing complex contents and entering into sophisticated patterns of inference. I reject this assumption. “Image grammars” are models in computer vision that articulate systematic principles governing the form and content of images. These models are empirically credible and can be construed as literal grammars for images. (...) Images can have rich syntactic structure, though of a markedly different form than sentences in language. (shrink)

I argue that analogue mental representations possess a canonical decomposition into privileged constituents from which they compose. I motivate this suggestion, and rebut arguments to the contrary, through reflection on the approximate number system, whose representations are widely expected to have an analogue format. I then argue that arguments for the compositionality and constituent structure of these analogue representations generalize to other analogue mental representations posited in the human mind, such as those in early vision and visual imagery.

The target article attempted to draw connections between broad swaths of evidence by noticing a common thread: Abstract, symbolic, compositional codes, that is, language-of-thoughts (LoTs). Commentators raised concerns about the evidence and offered fascinating extensions to areas we overlooked. Here we respond and highlight the many specific empirical questions to be answered in the next decade and beyond.

The distinction between perception and cognition frames countless debates in philosophy and cognitive science. But what, if anything, does this distinction actually amount to? In this introductory article, we summarize recent work on this question. We first briefly consider the possibility that a perception-cognition border should be eliminated from our scientific ontology, and then introduce and critically examine five positive approaches to marking a perception–cognition border, framed in terms of phenomenology, revisability, modularity, format, and stimulus-dependence.

Mental capacities for perceiving, remembering, thinking, and planning involve the processing of structured mental representations. A compositional semantics of such representations would explain how the content of any given representation is determined by the contents of its constituents and their mode of combination. While many have argued that semantic theories of mental representations would have broad value for understanding the mind, there have been few attempts to develop such theories in a systematic and empirically constrained way. This paper contributes to (...) that end by developing a semantics for a ‘fragment’ of our mental representational system: the visual system’s representations of the bounding contours of objects. At least three distinct kinds of composition are involved in such representations: ‘concatenation’, ‘feature composition’, and ‘contour composition’. I sketch the constraints on and semantics of each of these. This account has three principal payoffs. First, it models a working framework for compositionally ascribing structure and content to perceptual representations, while highlighting core kinds of evidence that bear on such ascriptions. Second, it shows how a compositional semantics of perception can be compatible with holistic, or Gestalt, phenomena, which are often taken to show that the whole percept is ‘other than the sum of its parts’. Finally, the account illuminates the format of a key type of perceptual representation, bringing out the ways in which contour representations exhibit domain-specific form of the sort that is typical of structured icons such as diagrams and maps, in contrast to typical discursive representations of logic and language. (shrink)

How can we argue, from neural facts, that representational states exhibit some specific representational structure? This paper approaches the question through a case study on the priority map-mechanism that underlies our capacity to orient visual attention. Computational models from cognitive neuroscience describe this mechanism as operating over neural topographic structures. These neural structures exhibit the functional profile of topographic representational structure. I argue that this fact warrants attributing topographic structure to the priority map mechanism’s representational states.

In amodal completion the mind in some sense completes the visual perceptual representation of a scene by representing parts of the scene hidden behind other objects. Cognitive science has had a lot to say about how amodal completion occurs but has had little to say about the format of the representations involved and the way in which they represent. Some philosophers hold that amodal completions take the form of sensory imaginings of the occluded portions. This theory poses a puzzle for (...) both philosophy and neuroscience about how the occluded parts are imagined to be located relative to the unoccluded parts. A better theory begins with the observation that for many purposes it is useful to suppose that the mind contains mental models of three-dimensional structure. Visual perceptions and mental images may be conceived as mental models that represent external scenes by virtue of homomorphism and which possess both a deep aspect, representing both visible and occluded three-dimensional structure, and a perspectival aspect, representing only an arrangement of visible surfaces. In these terms we can explain various problem-solving abilities, such as the ability to imagine what a scene will look like from another point of view. Amodal completions can be treated as deep perceptual representations of three-dimensional structure. Thus amodal completions do not consist of mental imagery, but they can be used to generate mental imagery representing how a scene would look from alternative points of view. (shrink)

I argue that results in perception science do not support the claim that there is semantic perception or that typical, unreflective utterance comprehension is a perceptual process. Phenomena discussed include evidence-insensitivity, the Stroop effect, pop-out, and adaptation – as well as how these phenomena might relate to the function, format, and structure of perceptual representations. An emphasis is placed on non-inferential transitions from perceptual to conceptual representations, which are important for debates about the admissible contents of perception more generally.