Quilty-Dunn et al.'s wide-ranging defense of the Language of Thought Hypothesis (LoTH) argues that vision traffics in abstract, structured representational formats. We agree: Vision, like language, is compositional – just as words compose into phrases, many visual representations contain discrete constituents that combine in systematic ways. Here, we amass evidence extending this proposal, and explore its implications for how vision interfaces with the rest of the mind.

Perception solves computationally demanding problems at lightning fast speed. It recovers sophisticated representations of the world from degraded inputs, often in a matter of milliseconds. Any theory of perception must be able to explain how this is possible; in other words, it must be able to explain perception's computational tractability. One of the few attempts to move toward such an explanation has been the information encapsulation hypothesis, which posits that perception can be fast because it keeps computational costs low by (...) forgoing access to information stored in cognition. I argue that we have no compelling reason to believe that encapsulation explains (or even contributes to an explanation of) perceptual tractability, and much reason to doubt it. This is because there exist much deeper computational challenges for perception than information access, and these threaten to make the costs of access irrelevant. If this is right, it undermines a core computational motivation for encapsulation and sends us back to the drawing board for explanations of perceptual tractability. (shrink)

Thepuzzle of cross‐modal shape experienceis the puzzle of reconciling the apparent differences between our visual and haptic experiences of shape with their apparent similarities. This paper proposes that we can resolve the cross‐modal puzzle by reflecting on another puzzle. Thepuzzle of perspectival characterchallenges us to reconcile the variability of shape experience through shifts in perspective with its constancy. An attractive approach to the latter puzzle holds that shape experience is complex, involving bothperspectivalaspects andconstantaspects. I argue here that parallel distinctions between (...) perspectival and constant aspects of shape experience arise in sight and touch, and that perspectival aspects are modality‐specific while at least some constant aspects are constitutively multisensory. I then address a powerful challenge to the idea that aspects of spatial phenomenology are shared cross‐modally. (shrink)

Mental representations remain the central posits of psychology after many decades of scrutiny. However, there is no consensus about the representational format(s) of biological cognition. This paper provides a survey of evidence from computational cognitive psychology, perceptual psychology, developmental psychology, comparative psychology, and social psychology, and concludes that one type of format that routinely crops up is the language-of-thought (LoT). We outline six core properties of LoTs: (i) discrete constituents; (ii) role-filler independence; (iii) predicate–argument structure; (iv) logical operators; (v) inferential (...) promiscuity; and (vi) abstract content. These properties cluster together throughout cognitive science. Bayesian computational modeling, compositional features of object perception, complex infant and animal reasoning, and automatic, intuitive cognition in adults all implicate LoT-like structures. Instead of regarding LoT as a relic of the previous century, researchers in cognitive science and philosophy-of-mind must take seriously the explanatory breadth of LoT-based architectures. We grant that the mind may harbor many formats and architectures, including iconic and associative structures as well as deep-neural-network-like architectures. However, as computational/representational approaches to the mind continue to advance, classical compositional symbolic structures – that is, LoTs – only prove more flexible and well-supported over time. (shrink)

It is a familiar experience to perceive a material object as maintaining a stable shape even though it projects differently shaped images on our retina as we move with respect to it, or as maintaining a stable color throughout changes in the way the object is illuminated. We also perceive sounds as maintaining constant timbre and loudness when the context and the spatial relations between us and the sound source change over time. But where does this perceptual invariance ‘come from’? (...) What is it about our perceptual systems that makes them able to ‘transform’ incoming unstable and fluctuating sensory inputs into generally stable and coherent conscious experiences? And what exactly do we experience as invariant in cases like those described above? There are two main approaches to the Problem of Perceptual Invariance: the Local-Inferential approach and the Global-Structural approach. Although both approaches include an account of the sub-personal perceptual mechanisms ‘stabilizing’ variant and invariant components in incoming sensory stimulation and a proposal regarding the phenomenology of perceptual invariance, in this paper I argue that the latter provides a better solution to the problem overall. (shrink)

We represent shape in both sight and touch, but how do these abilities relate to one another? This issue has been discussed in the context of Molyneux's question of whether someone born blind could, upon being granted sight, identify shapes visually. Some have suggested that we might look to real‐world cases of sight restoration to illuminate the relation between visual and tactual shape representations. Here, I argue that newly sighted perceivers should not be relied on in this way because they (...) are unlikely to form the kinds of shape representations responsible for cross‐modal recognition in normally sighted perceivers. I then argue that the available evidence makes a compelling case for the type identity view, on which the visual and tactual representations responsible for cross‐modal recognition are type‐identical. (shrink)

When we imaginatively picture what might happen, we may take what we imagine to be either realistic or fantastic. A wine glass falling to the floor and shattering is realistic. A wine glass falling and morphing into a bird and flying away is fantastic. What does the distinction consist in? Two important necessary conditions are here defined. The first is a condition on the realistic representation of spatial configuration, grounded in an account of the imagistic representation of spatial configuration. The (...) second is a condition on the manner in which realistic courses of mental imagery may be grounded in remembered perceptions. This is defined in terms of an account of the representation of comparative similarity. This is an open access publication. (shrink)

An ongoing philosophical discussion concerns how various types of mental states fall within broad representational genera—for example, whether perceptual states are “iconic” or “sentential,” “analog” or “digital,” and so on. Here, I examine the grounds for making much more specific claims about how mental states are structured from constituent parts. For example, the state I am in when I perceive the shape of a mountain ridge may have as constituent parts my representations of the shapes of each peak and saddle (...) of the ridge. More specific structural claims of this sort are a guide to how mental states fall within broader representational kinds. Moreover, these claims have significant implications of their own about semantic, functional, and epistemic features of our mental lives. But what are the conditions on a mental state's having one type of constituent structure rather than another? Drawing on explanatory strategies in vision science, I argue that, other things being equal, the constituent structure of a mental state determines what I call its distributional properties—namely, how mental states of that type can, cannot, or must co‐occur with other mental states in a given system. Distributional properties depend critically on and are informative about the underlying structures of mental states, they abstract in important ways from aspects of how mental states are processed, and they can yield significant insights into the variegation of psychological capacities. (shrink)

Perceptual systems respond to proximal stimuli by forming mental representations of distal stimuli. A central goal for the philosophy of perception is to characterize the representations delivered by perceptual systems. It may be that all perceptual representations are in some way proprietarily perceptual and differ from the representational format of thought (Dretske 1981; Carey 2009; Burge 2010; Block ms.). Or it may instead be that perception and cognition always trade in the same code (Prinz 2002; Pylyshyn 2003). This paper rejects (...) both approaches in favor of perceptual pluralism, the thesis that perception delivers a multiplicity of representational formats, some proprietary and some shared with cognition. The argument for perceptual pluralism marshals a wide array of empirical evidence in favor of iconic (i.e., image-like, analog) representations in perception as well as discursive (i.e., language-like, digital) perceptual object representations. (shrink)

Objects are central in visual, auditory, and tactual perception. But what counts as a perceptual object? I address this question via a structural unity schema, which specifies how a collection of parts must be arranged to compose an object for perception. On the theory I propose, perceptual objects are composed of parts that participate in causally sustained regularities. I argue that this theory falls out of a compelling account of the function of object perception, and illustrate its applications to multisensory (...) perception. I also argue that the account avoids problems faced by standard views of visual and auditory objects. (shrink)

When we perceive an object, we perceive the object from a perspective. As a consequence of the perspectival nature of perception, when we perceive, say, a circular coin from different angles, there is a respect in which the coin looks circular throughout, but also a respect in which the coin's appearance changes. More generally, perception of shape and size properties has both a constant aspect—an aspect that remains stable across changes in perspective—and a perspectival aspect—an aspect that changes depending on (...) one's perspective on the object. How should we account for the perspectival aspect of spatial perception? We present a framework within which to discuss the perspectival aspect of perception and put forward three desiderata that any account of the perspectival aspect of perception should satisfy. We discuss views on which the perspectival aspect of perception is analyzed in terms of constitutively mind-dependent appearance properties as well as views on which the perspectival aspect of perception is analyzed in terms of representations of mind-independent perspectival properties. (shrink)

Perception solves computationally demanding problems at lightning fast speed. It recovers sophisticated representations of the world from degraded inputs, often in a matter of milliseconds. Any theory of perception must be able to explain how this is possible; in other words, it must be able to explain perception’s computational tractability. One of the few attempts to move toward such an explanation is the information encapsulation hypothesis, which posits that perception can be fast because it keeps computational costs low by forgoing (...) access to information stored in cognition. I argue that we have no compelling reason to believe that encapsulation explains (or even contributes to an explanation of) perceptual tractability, and much reason to doubt it. This is because there exist much deeper computational challenges for perception than information access, and these threaten to make the costs of access irrelevant. If this is right, it undermines a core computational motivation for encapsulation and sends us back to the drawing board for explanations of perceptual tractability. (shrink)

Perceptual constancy has played a significant role in philosophy of perception. It figures in debates about direct realism, color ontology, and the minimal conditions for perceptual representation. Despite this, there is no general consensus about what constancy is. I argue that an adequate account of constancy must distinguish it from three distinct phenomena: mere sensory stability through proximal change, perceptual categorization of a distal dimension, and stability through irrelevant proximal change. Standard characterizations of constancy fall short in one or more (...) of these respects. I develop an account of constancy that overcomes these problems. The account has two parts: an analysis of constancy mechanisms, and an analysis of the conditions under which a constancy capacity is exercised. I then employ this account to evaluate whether constancy is a necessary condition for perceptual representation, as some have conjectured. I argue that explanatory practice in perceptual psychology fails to support this view. Rather, it fits better with the weaker principle that representation requires specific tracking of a distal dimension. (shrink)

In amodal completion the mind in some sense completes the visual perceptual representation of a scene by representing parts of the scene hidden behind other objects. Cognitive science has had a lot to say about how amodal completion occurs but has had little to say about the format of the representations involved and the way in which they represent. Some philosophers hold that amodal completions take the form of sensory imaginings of the occluded portions. This theory poses a puzzle for (...) both philosophy and neuroscience about how the occluded parts are imagined to be located relative to the unoccluded parts. A better theory begins with the observation that for many purposes it is useful to suppose that the mind contains mental models of three-dimensional structure. Visual perceptions and mental images may be conceived as mental models that represent external scenes by virtue of homomorphism and which possess both a deep aspect, representing both visible and occluded three-dimensional structure, and a perspectival aspect, representing only an arrangement of visible surfaces. In these terms we can explain various problem-solving abilities, such as the ability to imagine what a scene will look like from another point of view. Amodal completions can be treated as deep perceptual representations of three-dimensional structure. Thus amodal completions do not consist of mental imagery, but they can be used to generate mental imagery representing how a scene would look from alternative points of view. (shrink)