Diagrams are a form of spatial representation that supports reasoning and problem solving. Even when diagrams are external, not to mention when there are no external representations, problem solving often calls for internal representations, that is, representations in cognition, of diagrammatic elements and internal perceptions on them. General cognitive architectures—Soar and ACT-R, to name the most prominent—do not have representations and operations to support diagrammatic reasoning. In this article, we examine some requirements for such internal representations and processes in cognitive (...) architectures. We discuss the degree to which DRS, our earlier proposal for such an internal representation for diagrams, meets these requirements. In DRS, the diagrams are not raw images, but a composition of objects that can be individuated and thus symbolized, while, unlike traditional symbols, the referent of the symbol is an object that retains its perceptual essence, namely, its spatiality. This duality provides a way to resolve what anti-imagists thought was a contradiction in mental imagery: the compositionality of mental images that seemed to be unique to symbol systems, and their support of a perceptual experience of images and some types of perception on them. We briefly review the use of DRS to augment Soar and ACT-R with a diagrammatic representation component. We identify issues for further research. (shrink)

This research is published within the project ‘The Logic of Conceivability’, funded by the European Research Council, Grant Number 681404.

The Humean view that conceivability entails possibility can be criticized via input from cognitive psychology. A mainstream view here has it that there are two candidate codings for mental representations (one of them being, according to some, reducible to the other): the linguistic and the pictorial, the difference between the two consisting in the degree of arbitrariness of the representation relation. If the conceivability of P at issue for Humeans involves the having of a linguistic mental representation, then it is (...) easy to show that we can conceive the impossible, for impossibilities can be represented by meaningful bits of language. If the conceivability of P amounts to the pictorial imaginability of a situation verifying P, then the question is whether the imagination at issue works purely qualitatively, that is, only by phenomenological resemblance with the imagined scenario. If so, the range of situations imaginable in this way is too limited to have a significant role in modal epistemology. If not, imagination will involve some arbitrary labeling component, which turns out to be sufficient for imagining the impossible. And if the relevant imagination is neither linguistic nor pictorial, Humeans will appear to resort to some representational magic, until they come up with a theory of a ‘third code’ for mental representations. (shrink)

I address the problem of the distinction between semantic and conceptual representations from general considerations about how to distinguish a representational kind. I consider three different ways of telling representational kinds apart – in terms of structure, processing and content – and I examine if semantic representations may constitute a distinct kind with respect to each of them. I argue that the best options for semantic representation to be regarded as a distinct representational kind with respect to each of the (...) three criteria conflict with each other, since it appears respectively as an atomic representation, as a sort of procedural rule or as a structured complex. (shrink)

I address the problem of the distinction between semantic and conceptual representations from general considerations about how to distinguish a representational kind. I consider three different ways of telling representational kinds apart – in terms of structure, processing and content – and I examine if semantic representations may constitute a distinct kind with respect to each of them. I argue that the best options for semantic representation to be regarded as a distinct representational kind with respect to each of the (...) three criteria conflict with each other, since it appears respectively as an atomic representation, as a sort of procedural rule or as a structured complex. (shrink)

This paper (1) sketches a phenomenological analysis of visual mental imagery; (2) applies this analysis to the mental imagery debate in cognitive science; (3) briefly sketches a neurophenomenological approach to mental imagery; and (4) compares the results of this discussion with Dennett’s heterophenomenology.

Can theories of mental imagery, conscious mental contents, developed within cognitive science throw light on the obscure (but culturally very significant) concept of imagination? Three extant views of mental imagery are considered: quasi‐pictorial, description, and perceptual activity theories. The first two face serious theoretical and empirical difficulties. The third is (for historically contingent reasons) little known, theoretically underdeveloped, and empirically untried, but has real explanatory potential. It rejects the “traditional” symbolic computational view of mental contents, but is compatible with recentsituated (...) cognition and active visionapproaches in robotics. This theory is developed and elucidated. Three related key aspects of imagination (non‐discursiveness, creativity, and seeing as) raise difficulties for the other theories. Perceptual activity theory presents imagery as non‐discursive and relates it closely to seeing as. It is thus well placed to be the basis for a general theory of imagination and its role in creative thought. (shrink)

Perceptual systems respond to proximal stimuli by forming mental representations of distal stimuli. A central goal for the philosophy of perception is to characterize the representations delivered by perceptual systems. It may be that all perceptual representations are in some way proprietarily perceptual and differ from the representational format of thought (Dretske 1981; Carey 2009; Burge 2010; Block ms.). Or it may instead be that perception and cognition always trade in the same code (Prinz 2002; Pylyshyn 2003). This paper rejects (...) both approaches in favor of perceptual pluralism, the thesis that perception delivers a multiplicity of representational formats, some proprietary and some shared with cognition. The argument for perceptual pluralism marshals a wide array of empirical evidence in favor of iconic (i.e., image-like, analog) representations in perception as well as discursive (i.e., language-like, digital) perceptual object representations. (shrink)

This essay examines arguments for and against the proposition that Artificial Intelligence (AI) research makes an important contribution to the understanding of the human mind. A number of recent articles have seemed to question the value of Al ideas in specific domains (e.g., language. mental imagery, problem solving). In the present paper, it is argued that the real disagreement concerns the form of a scientific psychology. The critics of Artificial Intelligence believe that many acceptable psychological theories exist and the important (...) task of the scientist is to show that certain of these theories are true. They criticize AI research because it has not produced theories whose adequacy can be tested by empirical research. The supporters of AI research believe that no adequate psychological theories exist. They claim that the important task is to develop adequate theories and until such theories have been constructed, it is pointless to worry about empirical tests.A number of major arguments attacking and defending AI research are examined in order to illustrate that the real issue is methodological. It is concluded that the present debate is counterproductive since both sides assume that the methodological premise of the other side is wrong without attempting to refute it. A more constructive debate would address directly the more fundamental question of what methods offer the greatest promise of solving the major problems of psychology. (shrink)

The idea that there is a “Number Sense” (Dehaene, 1997) or “Core Knowledge” of number ensconced in a modular processing system (Carey, 2009) has gained popularity as the study of numerical cognition has matured. However, these claims are generally made with little, if any, detailed examination of which modular properties are instantiated in numerical processing. In this article, I aim to rectify this situation by detailing the modular properties on display in numerical cognitive processing. In the process, I review literature (...) from across the cognitive sciences and describe how the evidence reported in these works supports the hypothesis that numerical cognitive processing is modular. I outline the properties that would suffice for deeming a certain processing system a modular processing system. Subsequently, I use behavioral, neuropsychological, philosophical, and anthropological evidence to show that the number module is domain specific, informationally encapsulated, neurally localizable, subject to specific pathological breakdowns, mandatory, fast, and inaccessible at the person level; in other words, I use the evidence to demonstrate that some of our numerical capacity is housed in modular casing. (shrink)

The traditional understanding of analyticity in terms of concept containment is revisited, but with a concept explicitly understood as a certain kind of mental representation and containment being read correspondingly literally. The resulting conception of analyticity avoids much of the vagueness associated with attempts to explicate analyticity in terms of synonymy by moving the locus of discussion from the philosophy of language to the philosophy of mind. The account provided here illustrates some interesting features of representations and explains, at least (...) in part, the special epistemic status of analytic judgments. (shrink)

A person's cognitive map, or knowledge of large‐scale space, is built up from observations gathered as he travels through the environment. It acts as a problem solver to find routes and relative positions, as well as describing the current location. The TOUR model captures the multiple representations that make up the cognitive map, the problem‐solving strategies it uses, and the mechanisms for assimilating new information. The representations have rich collections of states of partial knowledge, which support many of the performance (...) characteristics of common‐sense knowledge. (shrink)

This paper describes an operational computer simulation of visual mental imagery in humans. The structure of the simulation was motivated by results of experiments on how people represent information in, and access information from, visual images. The simulation includes a “surface representation,” which is spatial and quasi‐pictorial, and an underlying “deep representation,” which contains “perceptual” information encoding appearance plus “propositional” information describing facts about an object. The simulation embodies a theory of how surface images are generated from deep representations, and (...) how surface images are processed when one accesses information embedded in them. The simulation also offers an account of various sorts of imagery transformations. (shrink)

Experiences of qualia, subjective sensory-like aspects of stimuli, are central to imagistic representation. Following Raffman , qualia are considered to reflect experiential knowledge distinct from descriptive, abstract, and propositional knowledge; following Jackendoff , objective neural activity is distinguished from subjective experience. It is argued that descriptive physical knowledge does not provide an adequate accounting of qualia, and philosophical scenarios such as the Turing test and the Chinese Room are adapted to demonstrate inadequacies of accounts of cognition that ignore subjective experience. (...) Arguments by Dennett and others that qualia do not exist or that qualia do not provide additional explanatory power are addressed, and it is suggested that consideration of qualia is necessary in order to explain objective behavior. The hypotheses of functional equivalence, second-order isomorphism, and psychophysical complementarity between imagery and perception are discussed, and the ability of analog and schematic models of imagery to account for qualia is examined. (shrink)

A visual imagery task is presented which is beyond the limits of normal human ability, and some of the factors contributing to its difficulty are isolated by comparing the difficulty of related tasks. It is argued that complex objects are assigned hierarchical structural descriptions by being parsed into parts, each of which has its own local system of significant directions. Two quite different schemas for a wire‐frame cube are used to illustrate this theory, and some striking perceptual differences to which (...) they give rise are described. The difficulty of certain mental imagery tasks is shown to depend on which of the alternative structural descriptions of an object is used, and this is interpreted as evidence that structural descriptions are an important component of mental images. Finally, it is argued that analog transformations like mental folding involve changing the values of continuous variables in a structural description. (shrink)

Mental imagery (varieties of which are sometimes colloquially refered to as “visualizing,” “seeing in the mind's eye,” “hearing in the head,” “imagining the feel of,” etc.) is quasi-perceptual experience; it resembles perceptual experience, but occurs in the absence of the appropriate external stimuli. It is also generally understood to bear intentionality (i.e., mental images are always images of something or other), and thereby to function as a form of mental representation. Traditionally, visual mental imagery, the most discussed variety, was thought (...) to be caused by the presence of picturelike representations (mental images) in the mind, soul, or brain, but this is no longer universally accepted. (shrink)

The notion of a "mental representation" is, arguably, in the first instance a theoretical construct of cognitive science. As such, it is a basic concept of the Computational Theory of Mind, according to which cognitive states and processes are constituted by the occurrence, transformation and storage (in the mind/brain) of information-bearing structures (representations) of one kind or another.

Qualitative states are no threat to physicalism. They have a causal effect upon the world in virtue of their qualitative nature. This effect is exploited in biological mechanisms for representing the world. Representation requires differential responsiveness to different perceived properties of things. Qualia are taken to be tagged properties of internal representation models. These properties are properties for-the-organism. Such for-the-organism properties are to be expected in beings which perceive the world and interact with it intelligently. Consciousness presents a problem for (...) science. Human beings are conscious of the world and of themselves. In so far as science has the ambition of explaining everything consciousness is another unexplained phenomenon. However some claim that it is distinctive and different in kind from other problems which science hopes to solve using methods which have been successful up until now. It may indeed be so different that we have to adopt a dualistic metaphysics and accept that there is more to the world than physics knows. In this paper I intend to outline how the physicalist should fight back. (shrink)

Naturalistic thinking and knowing, the tacit, experiential, and intuitive reasoning of everyday interaction, have long been regarded as inferior to formal reason and labeled primitive, fallible, subjective, superstitious, and in some cases ineffable. But, naturalistic thinking is more rational and definable than it appears. It is also relevant to design. Inquiry into the mechanisms of naturalistic thinking and knowledge can bring its resources into focus and enable designers to create better, human-centered designs for use in real-world settings. This article makes (...) a case for the explicit, formal study of implicit, naturalistic thinking within the fields of design. It develops a framework for defining and studying naturalistic thinking and knowledge, for integrating them into design research and practice, and for developing a more integrated, consistent theory of knowledge in design. It will (a) outline historical definitions of knowledge, attitudes toward formal and naturalistic thinking, and the difficulties presented by the co-presence of formal and naturalistic thinking in design, (b) define and contrast formal and naturalistic thinking as two distinct human cognitive systems, (c) demonstrate the importance of naturalistic cognition in formal thinking and real-world judgment, (d) demonstrate methods for researching naturalistic thinking that can be of use in design, and (e) briefly discuss the impact on design theory of admitting naturalistic thinking as valid, systematic, and knowable. (shrink)