The paper analyzes the visual aspect of metaphors, offering a new theory of metaphor that characterizes its syntactic structure, material composition and visuality as its essence. It will accordingly present the metaphorical creating or transfiguring, as well as conceiving or understanding, of one thing as a different one, as a visual ability. It is a predication by means of producing non-conventional compositions – i.e., by compositional, or even aesthetic, means. This definition is aimed to apply to the various (...) kinds of metaphors: conceptual, linguistic, visual, and material. It will thus challenge the definition of metaphor as a conceptual or linguistic phenomenon in nature that is based on its semantic mechanism, broad concepts, and cognitive value. Those definitions have been prevalent since the second half of 20th century, under the influence of the philosophy of language, and later of cognitive studies. (shrink)

In this paper art history and visual studies, the disciplines that study visual culture, are presented as a field whose conjectural paradigm can be used to understand the epistemic problems associated with abduction. In order to do so, significant statements, concepts and arguments from the work of several specialists in this field have been highlighted. Their analysis shows the fruitfulness and potential for understanding the study of visual culture as a field that is interwoven with the assumptions (...) of abductive cognition. (shrink)

Research in vision science, developmental psychology, and the foundations of cognitive science has led some theorists to posit referential mechanisms similar to indices. This hypothesis has been framed within a Fodorian conception of the early vision module. The article shows that this conception is mistaken, for it cannot handle the ‘interface problem’—roughly, how indexing mechanisms relate to higher cognition and conceptual thought. As a result, I reject the inaccessibility of early vision to higher cognition and make some constructive (...) remarks on the perception–cognition interface. -/- 1 The Case for Visual Indices 1.1 Preliminary assumptions 1.2 Transcendental arguments 1.3 Evidence from vision science 2 Visual Indices, Object Files, and Fodorian Modularity 3 The Interface Problem 3.1 Top-down attention and modularity 3.2 Selective attention and information 4 Revising the Indexing Hypothesis 4.1 Revising the perception–cognition interface 4.2 Revising the modularity of early vision 5 Concluding Remarks. (shrink)

Philosophers and psychologists alike have argued recently that relatively abstract beliefs or cognitive categories like those regarding race can influence the perceptual experience of relatively low-level visual features like color or lightness. Some of the proposed best empirical evidence for this claim comes from a series of experiments in which White faces were consistently judged as lighter than equiluminant Black faces, even for racially ambiguous faces that were labeled ‘White’ as opposed to ‘Black’ (Levin and Banaji 2006). The latter (...) result is considered especially indicative of cognitive penetration, based on the reasoning that the relevant distortions were a function of lexical labeling, and hence the effect must have been mediated by categorization at the cognitive level. I argue that this reasoning is flawed, and that the assumptions on which it relies are questionable on both empirical and theoretical grounds. I propose an alternative, low-level explanation of the phenomena, which I argue is empirically more plausible and abductively preferable to the cognitive-penetration account. The upshot is that cognitively impenetrable perceptual systems may be psychologically more plastic and hence philosophically more significant than is nowadays commonly assumed. (shrink)

Cognitive penetration of perception, broadly understood, is the influence that the cognitive system has on a perceptual system. The paper shows a form of cognitive penetration in the visual system which I call ‘architectural’. Architectural cognitive penetration is the process whereby the behaviour or the structure of the perceptual system is influenced by the cognitive system, which consequently may have an impact on the content of the perceptual experience. I scrutinize a study in perceptual learning that provides empirical evidence (...) that cognitive influences in the visual system produce neural reorganization in the primary visual cortex. The type of cognitive penetration can be synchronic and diachronic. (shrink)

Near-death experiences (NDEs) entail complex and structured conscious experience during conditions known to coincide with rapid loss of consciousness often associated with decline or disruption of the neurological correlates currently held to be causative factors of visual imagery and cognition. In this study, 653 NDE reports of cardiac and/or respiratory arrest patients were analyzed for unprompted, spontaneous references to quality of conscious visual imagery and mentation during an NDE. Results indicate that in a majority of NDEs, both (...) figurative and abstract mentation are either preserved or markedly improved during unconsciousness and unresponsiveness in the context of respiratory and cardiac arrests. These findings underscore the call to further study the mechanisms behind the ‘outliving’ of a conscious sense of selfhood and complex, structured visual imagery and cognition during severely deteriorating physiological function—and perhaps especially during clinical death. (shrink)

The Emergic Cognitive Model (ECM) is a unified computational model of visual filling-in based on the Emergic Network architecture. The Emergic Network was designed to help realize systems undergoing continuous change. In this thesis, eight different filling-in phenomena are demonstrated under a regime of continuous eye movement (and under static eye conditions as well). -/- ECM indirectly demonstrates the power of unification inherent with Emergic Networks when cognition is decomposed according to finer-grained functions supporting change. These can interact (...) to raise additional emergent behaviours via cognitive re-use, hence the Emergic prefix throughout. Nevertheless, the model is robust and parameter free. Differential re-use occurs in the nature of model interaction with a particular testing paradigm. -/- ECM has a novel decomposition due to the requirements of handling motion and of supporting unified modelling via finer functional grains. The breadth of phenomenal behaviour covered is largely to lend credence to our novel decomposition. -/- The Emergic Network architecture is a hybrid between classical connectionism and classical computationalism that facilitates the construction of unified cognitive models. It helps cutting up of functionalism into finer-grains distributed over space (by harnessing massive recurrence) and over time (by harnessing continuous change), yet simplifies by using standard computer code to focus on the interaction of information flows. Thus while the structure of the network looks neurocentric, the dynamics are best understood in flowcentric terms. Surprisingly, dynamic system analysis (as usually understood) is not involved. An Emergic Network is engineered much like straightforward software or hardware systems that deal with continuously varying inputs. Ultimately, this thesis addresses the problem of reduction and induction over complex systems, and the Emergic Network architecture is merely a tool to assist in this epistemic endeavour. -/- ECM is strictly a sensory model and apart from perception, yet it is informed by phenomenology. It addresses the attribution problem of how much of a phenomenon is best explained at a sensory level of analysis, rather than at a perceptual one. As the causal information flows are stable under eye movement, we hypothesize that they are the locus of consciousness, howsoever it is ultimately realized. (shrink)

Metacognition is associated with planning, monitoring, evaluating and repairing performance Designers of elearning systems can improve the quality of their environments by explicitly structuring the visual and interactive display of learning contexts to facilitate metacognition. Typically page layout, navigational appearance, visual and interactivity design are not viewed as major factors in metacognition. This is because metacognition tends to be interpreted as a process in the head, rather than an interactive one. It is argued here, that cognition and (...) metacognition are part of a continuum and that both are highly interactive. The tenets of this view are explained by reviewing some of the core assumptions of the situated and distribute approach to cognition and then further elaborated by exploring the notions of active vision, visual complexity, affordance landscape and cue structure. The way visual cues are structured and the way interaction is designed can make an important difference in the ease and effectiveness of cognition and metacognition. Documents that make effective use of markers such as headings, callouts, italics can improve students’ ability to comprehend documents and ‘plan’ the way they review and process content. Interaction can be designed to improve ‘the proximal zone of planning’ – the look ahead and apprehension of what is nearby in activity space that facilitates decisions. This final concept is elaborated in a discussion of how e-newspapers combine effective visual and interactive design to enhance user control over their reading experience. (shrink)

In this paper, I argue that visual attention is cognitively penetrated by intention. I present a detailed account of attention and its neural basis, drawing on a recent computational model of neural modulation during attention: divisive normalization. I argue that intention shifts computations during divisive normalization. The epistemic consequences of attentional bias are discussed.

In the mid-1960s, Soviet computer scientist Mikhail Moiseevich Bongard created sets of visual puzzles where the objective was to spot an easily justifiable difference between two sides of a single image (for instance, white shapes vs black shapes, etc...). The idea was that these puzzles could be used to teach computers the general faculty of abstraction: perhaps by learning to spot the differences between these sorts of images, a computational agent could learn about inference in general. Considered a global (...) expert on Bongard problems, cognitive scientist Harry Foundalis developed the Phaeaco cognitive architecture for his PhD thesis - based on emulating cognition by solving the problems, creating a kind of artificial intelligence. In this paper, the extent to which Foundalis' approach allows for artificial general intelligence (the ability to reproduce a wide range of human abilities, or the goal of cognitive models) will be evaluated - with reference to Daniel Dennett’s reductive theory of mind and Immanuel Kant’s concept of the phenomenon and the noumenon. The point of view presented is that Phaeaco is missing several characteristics of general artificial intelligence. (shrink)

This chapter concerns the cognitive penetration of the visual experience of colour. Alleged cases of cognitively penetrated colour perception are of special import since they concern an uncontroversial type of visual experience. All theorists of perception agree that colour properties figure properly in the content or presentation of visual perception, even though not all parties agree that pine trees or causes or other "high-level" properties can figure properly in visual content or presentation. So an alleged case (...) of this kind does not require controversial commitments regarding the admissible contents of visual perception. The chapter clarifies this theoretical importance , identifying alleged empirical cases of cognitively penetrated colour perception, and then analyzing the implications of such cases for an epistemology of perception. (shrink)

I argue that we sometimes visually perceive the intentions of others. Just as we can see something as blue or as moving to the left, so too can we see someone as intending to evade detection or as aiming to traverse a physical obstacle. I consider the typical subject presented with the Heider and Simmel movie, a widely studied ‘animacy’ stimulus, and I argue that this subject mentally attributes proximal intentions to some of the objects in the movie. I further (...) argue that these attributions are unrevisable in a certain sense and that this result can be used to as part of an argument that these attributions are not post-perceptual thoughts. Finally, I suggest that if these attributions are visual experiences, and more particularly visual illusions, their unrevisability can be satisfyingly explained, by appealing to the mechanisms which underlie visual illusions more generally. (shrink)

Evidence from cognitive science supports the claim that humans and other animals see the world as divided into objects. Although this claim is widely accepted, it remains unclear whether the mechanisms of visual reference have representational content or are directly instantiated in the functional architecture. I put forward a version of the former approach that construes object files as icons for objects. This view is consistent with the evidence that motivates the architectural account, can respond to the key arguments (...) against representational accounts, and has explanatory advantages. I draw general lessons for the philosophy of perception and the naturalization of intentionality. (shrink)

Much attention has recently been paid to the idea, which I label ‘External World Acquaintance’ (EWA), that the phenomenal character of perceptual experience is partially constituted by external features. One motivation for EWA which has received relatively little discussion is its alleged ability to help deal with the ‘Explanatory Gap’ (e.g. Fish 2008, 2009, Langsam 2011, Allen 2016). I provide a reformulation of this general line of thought, which makes clearer how and when EWA could help to explain the specific (...) phenomenal nature of visual experience. In particular, I argue that by focusing on the different kinds of perceptual actions that are available in the case of visual spatial vs. colour perception, we get a natural explanation for why we should expect the specific nature of colour phenomenology to remain less readily intelligible than the specific nature of visual spatial phenomenology. (shrink)

This paper proposes to define metaphor as a visual-material structure, the sphere of which is ontological rather than cognitive or conceptual. It argues that the essence of metaphor, as either an aesthetic or a communicative unit or both, resides in the qualitative dimension and appearance, or even materiality, of the metaphorical medium and its form. The paper thus offers a new theory of metaphor, focusing on the medium of metaphor, which composes and transfigures or reconstructs its target anew: a (...) composition that is prior to understanding or conceptualizing the target. In doing so, the paper presents a formalist ontology of metaphors, established via an externalist account of metaphors, as opposed to the prevailing cognitivist-conceptualist account which I characterize as internalist. The various kinds of metaphor – linguistic, poetic, visual or material – are based on their external structure, rather than an internal-conceptual mechanism of understanding, as assumed by a significant segment of the literature. Visual metaphor, therefore, is the paradigmatic kind of metaphor, the analysis of which can be generalized to other kinds of metaphor. Furthermore, the paper tries to overcome the current discrepancy between the formalist character of the metaphorical medium and the dominance of cognitivist and conceptualist theories of metaphor. Challenging these, I claim that if the identity of metaphor is indeed based on its composition, then it is actually based on its aesthetic qualities. That is to say, not only are there autonomous visual or material metaphors, that are not based on linguistic or conceptual ones, but linguistic and conceptual metaphors are based on visuality: they are enabled by the structural possibilities offered by visual media. (shrink)

Many who suffer from eating disorders claim that they see themselves as “fat”. Despite decades of research into the phenomenon, behavioural evidence has failed to confirm that eating disorders involve visual misperception of own-body size. I illustrate the importance of this phenomenon for our understanding of perceptual processing, outline the challenges involved in experimentally confirming it, and provide solutions to those challenges.

Without doubt, there is a widespread usage of visualisations in science. However, what exactly the _epistemic status_ of these visual representations in science may be remains an open question. In the following, I will argue that at least some scientific visualisations are indispensible for our cognitive processes. My thesis will be that, with regard to the activity of _learning_, visual representations are of relevance in the sense of contributing to the aim of _scientific_ _understanding_. Taking into account that (...) understanding can be regarded as an epistemic desideratum in its own right, I will argue that, at least in some instances, no understanding can be achieved without the aid of visualisations. Consequently, they are of crucial importance in this process. Moreover, to support this thesis we will make use of some findings in educational psychology. (shrink)

This book consists of an edited collection of original essays of the highest academic quality by seasoned experts in their fields of cognitive science. The essays are interdisciplinary, drawing from many of the fields known collectively as “the cognitive sciences.” Topics discussed represent a significant cross-section of the most current and interesting issues in cognitive science. Specific topics include matters regarding machine learning and cognitive architecture, the nature of cognitive content, the relationship of information to cognition, the role of (...) language and communication in cognition, the nature of embodied cognition, selective topics in visual cognition, brain connectivity, computation and simulation, social and technological issues within the cognitive sciences, and significant issues in the history of neuroscience. This book will be of interest to both professional researchers and newer students and graduate students in the fields of cognitive science—including computer science, linguistics, philosophy, psychology and neuroscience. The essays are in English and are designed to be as free as possible of technical jargon and therefore accessible to young scholars and to scholars who are new to the cognitive neurosciences. In addition to several entries by single authors, the book contains several interesting roundtables where researchers contribute answers to a central question presented to those in the focus group on one of the core areas listed above. This exciting approach provides a variety of perspectives from across disciplines on topics of current concern in the cognitive sciences. (shrink)

A set of visual search experiments tested the proposal that focused attention is needed to detect change. Displays were arrays of rectangles, with the target being the item that continually changed its orientation or contrast polarity. Five aspects of performance were examined: linearity of response, processing time, capacity, selectivity, and memory trace. Detection of change was found to be a self-terminating process requiring a time that increased linearly with the number of items in the display. Capacity for orientation was (...) found to be about 5 items, a value comparable to estimates of attentional capacity. Observers were able to filter out both static and dynamic variations in irrelevant properties. Analysis also indicated a memory for previously-attended locations. These results support the hypothesis that the process needed to detect change is much the same as the attentional process needed to detect complex static patterns. Interestingly, the features of orientation and polarity were found to be handled in somewhat different ways. Taken together, these results not only provide evidence that focused attention is needed to see change, but also show that change detection itself can provide new insights into the nature of attentional processing. (shrink)

This chapter critically assesses recent arguments that acquiring the ability to categorize an object as belonging to a certain high-level kind can cause the relevant kind property to be represented in visual phenomenal content. The first two arguments, developed respectively by Susanna Siegel (2010) and Tim Bayne (2009), employ an essentially phenomenological methodology. The third argument, developed by William Fish (2013), by contrast, is supported by an array of psychophysical and neuroscientific findings. I argue that while none of these (...) arguments ultimately proves successful, there is a substantial body of empirical evidence that information originating outside the visual system can nonetheless modulate the way an object’s low-level attributes visually appear. Visual phenomenal content, I show, is not only significantly influenced by crossmodal interactions between vision and other exteroceptive senses such as touch and audition, but also by interactions between vision and non-perceptual systems involved in motor planning and construction of the proprioceptive body-image. (shrink)

Selective access and integration underlie much of our visual experience. This article describes several of the experimental techniques used to investigate these processes, and some of the major results achieved in our understanding of their operation.

The analysis method and paradigm of film have become a controversial topic in the data-driven era. Film, is not only an attractive industry that can achieve filmmakers’ imagination but has become a perfect stimulus to understand human being’s mental activity. The core research in this study is to examine the impact of filmmaking experience and the role of narrative denoters from filmmakers’ construction to audiences’ interpretation. Based on previous studies and integrating cognitive approaches, the thesis re-explores the nature and essence (...) of film and proposes an alternative term - narrative denoter - which can be used as the indication of message exchanging between filmmakers and audiences. Using a released film that has a complete story to do the experiment, this study investigates the relationship between major, film interpretations, event segmentation, and audience’s preference. The result showed that filmmaking experience does not impact the interpretation of film; however the identification of the narrative denoter played an important role in film perception and cognition; apart from these, the audience’s preference did not correlate with film interpretation. With respect to this result, the narrative denoter can be indicator to demonstrate the message transitions from filmmaker to audience. Suggestions were made for future cognitive film studies on using the narrative denoters as a new analysis unit. (shrink)

In this paper I argue that it's possible that the contents of some visual experiences are influenced by the subject's prior beliefs, hopes, suspicions, desires, fears or other mental states, and that this possibility places constraints on the theory of perceptual justification that 'dogmatism' or 'phenomenal conservativism' cannot respect.

In this article, the authors try to answer the following questions: How can an object/instance seen for the first time extend a category or update a concept? How is it possible to determine the reference of a concept that represents a behaviour? In the first case, the authors discuss the learning of inferential linguistic competence used to update a concept through an approach based on prototype theory. In the second case, the authors discuss the learning of referential linguistic competence used (...) to determine the reference of a concept (i.e., determination of an actual behaviour) through an approach based on embodied cognition. The authors show how combining prototype-based and embodied categorization in Wittgenstein’s rule-following praxis (the individual and community dimension), linguistic learning of a concept (inferential competence), and determination of its reference (referential competence) can be traced back to the same model. Keywords Action, Categorization, Embodied Cognition, Embodiment, Linguistic Inferential Competence, Linguistic Referential Competence, Perception, Prototype Theory, Reference, Sign. (shrink)

Pylyshyn restricts cognitively penetrable vision to late vision, whereas he does not make any distinction between different kinds of penetrating cognition. I argue that this approach disconnects early vision content from late vision content and blurs the distinction between the latter and the content of thought. To overcome this problem I suggest that we should not distinguish between different kinds of visual content but instead introduce a restriction on the kind of cognition that can directly penetrate (...) class='Hi'>visual experience. In particular, I suggest that visual experience, unlike thought, is directly penetrated only by practical non-propositional knowledge. I specify this weak cognitive penetrability in anti-representational terms. In particular, I suggest that the dependence of visual content on practical non-propositional knowledge should be conceived as a rational non-inferential relation, for it is in this way that we can account for the distinctive content of visual experience. (shrink)

Geometry defines entities that can be physically realized in space, and our knowledge of abstract geometry may therefore stem from our representations of the physical world. Here, we focus on Euclidean geometry, the geometry historically regarded as “natural”. We examine whether humans possess representations describing visual forms in the same way as Euclidean geometry – i.e., in terms of their shape and size. One hundred and twelve participants from the U.S. (age 3–34 years), and 25 participants from the Amazon (...) (age 5–67 years) were asked to locate geometric deviants in panels of 6 forms of variable orientation. Participants of all ages and from both cultures detected deviant forms defined in terms of shape or size, while only U.S. adults drew distinctions between mirror images (i.e. forms differing in “sense”). Moreover, irrelevant variations of sense did not disrupt the detection of a shape or size deviant, while irrelevant variations of shape or size did. At all ages and in both cultures, participants thus retained the same properties as Euclidean geometry in their analysis of visual forms, even in the absence of formal instruction in geometry. These findings show that representations of planar visual forms provide core intuitions on which humans’ knowledge in Euclidean geometry could possibly be grounded. (shrink)

This paper questions two prima facie plausible claims concerning switching in the presence of ambiguous figures. The first is the claim that reversing is an instantaneous process. The second is the claim that the ability to reverse demonstrates the interpretive, inferential and constructive nature of visual processing. Empirical studies show that optical and cerebral events related to switching protract in time in a way that clashes with its perceived instantaneity. The studies further suggest an alternative theory of reversing: according (...) to such alternative, seeing the same thing in multiple ways is a matter of uncovering what is already present to the senses through visual search. (shrink)

It is argued that the theory of situated cognition together with dynamic systems theory can explain the core of artistic practice and aesthetic experience, and furthermore paves the way for an account of how artist and audience can meet via the artist's work. The production and consumption of art is an embodied practice, firmly based in perception and action, and supported by features of the local, agent-centered and global socio-cultural contexts. Artistic creativity and aesthetic experience equally result from the (...) dynamic interplay between agent and context, allowing for artist and viewer to relate to the artist's work in similar ways. (shrink)

Visual number adaption is a widely accepted phenomenon. This paper advances an alternative explanation for putative cases of the phenomenon. We propose that such cases may simply reflect observers adapting to the items in perceived displays, rather than their numerical quantity. Three experiments motivate consideration of this novel proposal and call into question the evidential basis for received formulations of the number adaptation hypothesis.

The article considers the problem of images and the role they play in our reflection turning to evidence provided by two seemingly very distant theories of mind together with two sorts of corresponding visions: dreams as analyzed by Freud who claimed that they are pictures of our thoughts, and their mechanical counterparts produced by neural networks designed for object recognition and classification. Freud’s theory of dreams has largely been ignored by philosophers interested in cognition, most of whom focused solely (...) on the linguistic incarnation of thoughts, but even though commonly neglected by respectable theories of thinking, dream images may prove to be the key to the black box of thought. As argued in this article, when seen from the right perspective and approached with the right set of questions, oneiric visions yield groundbreaking insights into the mechanism of how concepts and judgments are formed. Support for this conclusion comes from a tradition seemingly remote, if not opposed to psychoanalysis: the mechanical model of the mind conceived by information sciences and embodied in the form of artificial neural nets which mirror the activity of human visual cortex producing visions strikingly similar to those created by the sleeping mind. These purely mechanical, artificial ‘dreams’ constitute byproducts of algorithms designed for object recognition and classification, which, as I shall argue, reveals the true purpose of our own oneiric visual formations. Just like their mechanical counterparts produced by neural networks, condensations and displacements encountered in dreams are in fact visual universals. (shrink)

The paper uses the tools of mereotopology (the theory of parts, wholes and boundaries) to work out the implications of certain analogies between the 'ecological psychology' of J. J Gibson and the phenomenology of Edmund Husserl. It presents an ontological theory of spatial boundaries and of spatially extended entities. By reference to examples from the geographical sphere it is shown that both boundaries and extended entities fall into two broad categories: those which exist independently of our cognitive acts (for example, (...) the planet Earth, its exterior surface); and those which exist only in virtue of such acts (for example: the equator, the North Sea). The visual field, too, can be conceived as an example of an extended entity that is dependent in the sense at issue. The paper suggests extending this analogy by postulating entities which would stand to true judgments as the visual field stands to acts of visual perception. The judgment field is defined more precisely as that complex extended entity which comprehends all entities which are relevant to the truth of a given (true) judgment. The work of cognitive linguists such as Talmy and Langacker, when properly interpreted, can be shown to yield a detailed account of the structures of the judgment fields corresponding to sentences of different sorts. A new sort of correspondence-theoretic definition of truth for sentences of natural language can then be formulated on this basis. (shrink)

Some things look more complex than others. For example, a crenulate and richly organized leaf may seem more complex than a plain stone. What is the nature of this experience—and why do we have it in the first place? Here, we explore how object complexity serves as an efficiently extracted visual signal that the object merits further exploration. We algorithmically generated a library of geometric shapes and determined their complexity by computing the cumulative surprisal of their internal skeletons—essentially quantifying (...) the “amount of information” within each shape—and then used this approach to ask new questions about the perception of complexity. Experiments 1–3 asked what kind of mental process extracts visual complexity: a slow, deliberate, reflective process (as when we decide that an object is expensive or popular) or a fast, effortless, and automatic process (as when we see that an object is big or blue)? We placed simple and complex objects in visual search arrays and discovered that complex objects were easier to find among simple distractors than simple objects are among complex distractors—a classic search asymmetry indicating that complexity is prioritized in visual processing. Next, we explored the function of complexity: Why do we represent object complexity in the first place? Experiments 4–5 asked subjects to study serially presented objects in a self‐paced manner (for a later memory test); subjects dwelled longer on complex objects than simple objects—even when object shape was completely task‐irrelevant—suggesting a connection between visual complexity and exploratory engagement. Finally, Experiment 6 connected these implicit measures of complexity to explicit judgments. Collectively, these findings suggest that visual complexity is extracted efficiently and automatically, and even arouses a kind of “perceptual curiosity” about objects that encourages subsequent attentional engagement. (shrink)

East Asians and Westerners differ in various aspects of perception and cognition. For example, visual memory for East Asians is believed to be more influenced by the contextual aspects of a scene than is the case for Westerners (Masuda & Nisbett, 2001). There are also differences in visual search: for Westerners, search for a long line among short is faster than for short among long, whereas this difference does not appear to hold for East Asians (Ueda et (...) al., submitted). However, it is unclear how these group-level differences originate. To investigate the extent to which they depend upon environment, we tested visual search and visual memory in East Asian immigrants who had lived in Canada for different amounts of time. Recent immigrants were found to exhibit no search asymmetry, unlike Westerners who had spent their lives in Canada. However, immigrants who had lived in Canada for more than two years showed performance comparable to that of Westerners. These differences could not be explained by the general analytic/holistic processing distinction believed to differentiate Westerners and East Asians, since all observers showed a strong holistic tendency for visual recognition. Results instead support the suggestion that exposure to a new environment can significantly affect the particular processes used to perceive a given stimulus. (shrink)

Vision often dominates other perceptual modalities both at the level of experience and at the level of judgment. In the well-known McGurk effect, for example, one’s auditory experience is consistent with the visual stimuli but not the auditory stimuli, and naïve subjects’ judgments follow their experience. Structurally similar effects occur for other modalities (e.g. rubber hand illusions). Given the robustness of this visual dominance, one might not be surprised that visual imagery often dominates imagery in other modalities. (...) One might be surprised, however, that visual imagery often dominates perception in other modalities. This more controversial claim is motivated both by empirical data and by introspection. Some think of perception-perception visual dominance as epistemically good, holding that cases in which visual dominance misleads us (e.g. McGurk and rubber hand illusions) are cases in which the perceptual system resolves conflicts according to principles that are generally reliable. Here, we explore support for the more controversial claim that imagery-perception visual dominance is epistemically good. We suggest that, when the task is richly spatial, requiring for optimal performance the all-at-once identification of macro-spatial and allocentric properties (e.g. identifying the shape or location of a felt or heard object), the visual, whether perception or imagination, should dominate other modalities. Put another way, when identifying objects, one should go and look or, short of that, visually imagine candidate objects, and then follow the visual, even against conflicting perceptions from other modalities. For this broadly-typed category of of cognitive-perceptual task, vision does dominate and it should. (shrink)

Mental representations remain the central posits of psychology after many decades of scrutiny. However, there is no consensus about the representational format(s) of biological cognition. This paper provides a survey of evidence from computational cognitive psychology, perceptual psychology, developmental psychology, comparative psychology, and social psychology, and concludes that one type of format that routinely crops up is the language-of-thought (LoT). We outline six core properties of LoTs: (i) discrete constituents; (ii) role-filler independence; (iii) predicate–argument structure; (iv) logical operators; (v) (...) inferential promiscuity; and (vi) abstract content. These properties cluster together throughout cognitive science. Bayesian computational modeling, compositional features of object perception, complex infant and animal reasoning, and automatic, intuitive cognition in adults all implicate LoT-like structures. Instead of regarding LoT as a relic of the previous century, researchers in cognitive science and philosophy-of-mind must take seriously the explanatory breadth of LoT-based architectures. We grant that the mind may harbor many formats and architectures, including iconic and associative structures as well as deep-neural-network-like architectures. However, as computational/representational approaches to the mind continue to advance, classical compositional symbolic structures – that is, LoTs – only prove more flexible and well-supported over time. (shrink)

One sceptical rejoinder to those who claim that sensory perception is cognitively penetrable is to appeal to the involvement of attention. So, while a phenomenon might initially look like one where, say, a perceiver’s beliefs are influencing her visual experience, another interpretation is that because the perceiver believes and desires as she does, she consequently shifts her spatial attention so as to change what she senses visually. But, the sceptic will urge, this is an entirely familiar phenomenon, and it (...) hardly involves some special or theoretically important cognitive effect on sensory perception. Even supposing that the sceptic is correct about cases that are accurately described in this way, the rejoinder oversimplifies the possible roles that attention may play in mediating cognition and perception. This paper aims to identify these different roles, and by emphasis on empirical research on feature-based and object-based attention. What emerges is a plausible and well- evidenced mental schema that describes attention -mediated cognitive penetration. At the very least, the burden of proof is shifted to the sceptic, as he then must show that there are no mental phenomena involving attention in the more nuanced ways described here. One additional benefit of this analysis is that it illuminates various features of attention and its relation to both cognition and phenomenal consciousness. Therefore the analysis should be of interest to a broad range of theorists of the mind, and not just those invested in the cognitive penetration debate. (shrink)

This special issue on affordances bases on the thesis, that all natural and artificial things inhere affordances that appeal to our cognitive system, and thus invite us to look at them, perceive them, think about them, interpret them, and use them. The concept roots in the studies of the American psychologist James J. Gibson from the 1960s. According to him, "things" offer a certain range of possible activities depending on their form, time patterns, and material qualities, thus becoming part of (...) human-thing-interactions. However, affordances can also be culturally trained. This aspect has been intensively discussed subsequently within different disciplines (e.g., Social Sciences, Design Studies). But only recently has the concept received attention in the field of Visual Culture Studies particularly through archaeological scholarship. (shrink)

Visual analytics (VA) combines the strengths of human and machine intelligence to enable the discovery of interesting patterns in challenging datasets. Historically, most attention has been given to developing the machine component—for example, machine learning or the human-computer interface. However, it is also essential to develop the abilities of the analysts themselves, especially at the beginning of their careers. -/- For the past several years, we at the University of British Columbia (UBC)—with the support of The Boeing Company—have experimented (...) with various ways of preparing undergraduate students for VA. Although inspired by the need to prepare students to become visual analysts, the result turned out to be fairly general in scope, applicable to other analytical approaches, as well as more general research. In hindsight, this makes considerable sense. Although the visual component of VA is necessary, it is insufficient; many analytical activities at the human end involve nonvisual skills, such as effective decision-making and the ability to quickly focus on the relevant parts of a problem. -/- The result of this experimentation is a third-year undergraduate course titled Cognitive Systems 303 (COGS 303) that focuses on “VA unplugged”—that is, on developing investigative abilities prior to training on the VA systems themselves. It was felt that if students focused on developing basic analytical habits of thought prior to learning VA systems, these habits would be reinforced by subsequent practice on “live” systems. (shrink)

Does perceptual consciousness require cognitive access? Ned Block argues that it does not. Central to his case are visual memory experiments that employ post-stimulus cueing—in particular, Sperling's classic partial report studies, change-detection work by Lamme and colleagues, and a recent paper by Bronfman and colleagues that exploits our perception of ‘gist’ properties. We argue contra Block that these experiments do not support his claim. Our reinterpretations differ from previous critics' in challenging as well a longstanding and common view of (...) visual memory as involving declining capacity across a series of stores. We conclude by discussing the relation of probabilistic perceptual representations and phenomenal consciousness. (shrink)

Worldviews are windows to the world. They can be static in referring to visual connotations as suggested by their name, but they can hold a dynamic and genetic view as well. As such, they imply a fundamental cognitive orientation, involving selection, interpretation and interaction with the world. What matters, in this view, is a kind of sense-making or semiotization of the world. -/- The semiotization of the “sonic world”, accordingly, can be approached from different epistemological positions: is music reducible (...) to symbolic labels that function as names, or is it only music when it sounds? And is music to be considered as an artifact that is out there or as something that must be listened to in order to make sense? Rather than joining these discussions, I propose to broaden the focus and to embrace psychological claims as well. Though psychology is not commonly considered as semiotics’ companion theory of truth, there are points of convergence with respect to the hierarchical arrangement of epistemic interactions with the sounds: there is a lower level processing of sensory input (sensation), a somewhat higher level (perception) which involves a first level of sense-making—mostly at a preverbal level—, and a higher level of sense-making which is commonly labeled as cognition. -/- In what follows I will argue for a cumulative model with lower levels not being substituted by higher ones, but with higher levels being superposed on them. Music, in fact, is a sounding art with the richness of it sonorous unfolding as one of its major characteristics. Music processing, therefore, should keep step with the music as it unfolds over time, in a dynamic tension that does justice to the level of sensation as well as to the listener’s continuous epistemic interactions with the sounds. (shrink)

Perceptual and recursion-based faculties have long been recognized to be vital constituents of human (and, in general, animal) cognition. However, certain faculties such as the visual and the linguistic faculty have come to receive far more academic and experimental attention, in recent decades, than other recognized categories of faculties. This paper seeks to highlight the imbalance in these studies and bring into sharper focus the need for further in-depth philosophical treatments of faculties such as especially hearing, touch, and (...) proprioception, besides other faculties such as the olfactory and gustatory ones. It also seeks to bring to bear the debate on the role of qualia in perception and overall in cognition in its thesis of the significance of these other modular faculties for genuine insights into cognition as a (now) technologically expanded domain. (shrink)

The cognitive processing of spatial relations in Euclidean diagrams is central to the diagram-based geometric practice of Euclid's Elements. In this study, we investigate this processing through two dichotomies among spatial relations—metric vs topological and exact vs co-exact—introduced by Manders in his seminal epistemological analysis of Euclid's geometric practice. To this end, we carried out a two-part experiment where participants were asked to judge spatial relations in Euclidean diagrams in a visual half field task design. In the first part, (...) we tested whether the processing of metric vs topological relations yielded the same hemispheric specialization as the processing of coordinate vs categorical relations. In the second part, we investigated the specific performance patterns for the processing of five pairs of exact/co-exact relations, where stimuli for the co-exact relations were divided into three categories depending on their distance from the exact case. Regarding the processing of metric vs topological relations, hemispheric differences were found for only a few of the stimuli used, which may indicate that other processing mechanisms might be at play. Regarding the processing of exact vs co-exact relations, results show that the level of agreement among participants in judging co-exact relations decreases with the distance from the exact case, and this for the five pairs of exact/co-exact relations tested. The philosophical implications of these empirical findings for the epistemological analysis of Euclid's diagram-based geometric practice are spelled out and discussed. (shrink)

Ordinary human perceivers know that visual objects are perceivable from standpoints other than their own. The aim of this paper is to provide an explanation of how perceptual experience equips perceivers with this knowledge. I approach the task by discussing a variety of action-based theories of perception. Some of these theories maintain that standpoint transcendence is required for shape perception. I argue that this standpoint transcendence must take place in the phenomenal present and that it can be explained in (...) terms of the experience of perceivers who jointly attend to an object. Joint perceivers experience objects as being perceived from standpoints other than their own. They operate in what I call “social space”, in which they single out objects by triangulating targets’ locations relative to their co-perceivers’ standpoints on these targets. It is then possible to explain the public character of the objects of individual experience by appeal to what I call “public space”. This is a spatial framework whose locations are presented as standpoints whence joint attention to the target would ensue, were they occupied by co-perceivers. If shape perception requires standpoint transcendence, then shape perceivers operate in public space and are thus capable of singling out targets by triangulating their locations from standpoints other than their own. If it doesn’t, then the introduction of a public spatial framework is an additional step whose introduction explains how perceivers come to experience objects as perceivable from standpoints other than their own. (shrink)

It has been suggested that certain problems may be unsolvable because of the mind's cognitive structure, but we may wonder what problems, and exactly why. The ultimate origin of the universe and the mind-body problem seem to be two such problems. As to why, Colin McGinn has argued that the mind-body problem is unsolvable because any theoretical concepts about the brain will be observation-based and unable to connect to unobservable subjective experience. McGinn's argument suggests a requirement of imagability -- an (...) observation basis -- for physical causal explanation that cannot be met for either of these problems. Acausal descriptions may be possible but not the causal analyses that provide the greatest explanatory satisfaction, a psychological phenomenon that seems tied to the strength of the underlying observation basis but is affected by other factors as well. (shrink)

The question of whether cognition can influence perception has a long history in neuroscience and philosophy. Here, we outline a novel approach to this issue, arguing that it should be viewed within the framework of top-down information-processing. This approach leads to a reversal of the standard explanatory order of the cognitive penetration debate: we suggest studying top-down processing at various levels without preconceptions of perception or cognition. Once a clear picture has emerged about which processes have influences on (...) those at lower levels, we can re-address the extent to which they should be considered perceptual or cognitive. Using top-down processing within the visual system as a model for higher-level influences, we argue that the current evidence indicates clear constraints on top-down influences at all stages of information processing; it does, however, not support the notion of a boundary between specific types of information-processing as proposed by the cognitive impenetrability hypothesis. (shrink)

This article argues for a task-based approach to identifying and individuating cognitive systems. The agent-based extended cognition approach faces a problem of cognitive bloat and has difficulty accommodating both sub-individual cognitive systems ("scaling down") and some supra-individual cognitive systems ("scaling up"). The standard distributed cognition approach can accommodate a wider variety of supra-individual systems but likewise has difficulties with sub-individual systems and faces the problem of cognitive bloat. We develop a task-based variant of distributed cognition designed to (...) scale up and down smoothly while providing a principled means of avoiding cognitive bloat. The advantages of the task-based approach are illustrated by means of two parallel case studies: re-representation in the human visual system and in a biomedical engineering laboratory. (shrink)

According to the well-known Bradley’s Regress argument, one cannot explain the unity of states of affairs by referring to relations combining objects with properties. This argument has been widely discussed within analytic metaphysics, but has not been recognized as relevant for the philosophy of perception. I argue that the mainstream characterization of visual content is threatened by the Bradley’s Regress, and the most influential metaphysical solutions to the regress argument cannot be applied in the context of visual content. (...) However, I show that a proper solution to Bradley’s Regress can be formulated by taking into consideration features of visual content suggested by empirical research in vision science. (shrink)

Is action-guiding vision cognitively penetrable? More specifically, is the visual processing that guides our goal-directed actions sensitive to semantic information from cognitive states? This paper critically examines a recent family of arguments whose aim is to challenge a widespread and influential view in philosophy and cognitive science: the view that action-guiding vision is cognitively impenetrable. I argue, in response, that while there may very well be top–down causal influences on action-guiding vision, they should not be taken to be an (...) instance of cognitive penetration. Assuming otherwise is to assign a computational role to the influencing states that they cannot perform. Although questions about cognitive penetrability are ultimately empirical, the issues addressed in this paper are largely philosophical. The discussion here highlights an important set of considerations that help better understand the relations between cognition, vision, and action. (shrink)

In written and spoken communications, metaphors are often used as an aid to help convey abstract or less tangible concepts. However, the benefits of using visual metaphors in visualization have so far been inconclusive. In this work, we report an empirical study to evaluate hypotheses that visual metaphors may aid memorization, visual search and concept comprehension. One major departure from previous metaphor-related experiments in the literature is that we make use of a dual-task methodology in our experiment. (...) This design offers an abstraction of typical situations where viewers do not have their full attention focused on visualization (e.g., in meetings and classes). The use of the secondary task introduces “divided attention”, and makes the effects of visual metaphors more observable. In addition, it also serves as additional masking in memory-based trials. The results of this study show that visual metaphors can help participants better remember the information depicted in visualization. On the other hand, visual metaphors can have a negative impact on the speed of visual search. The results also show a complex pattern as to the benefits of visual metaphors in helping participants grasp key concepts from visualization. (shrink)

Recent developments in vision science have resulted in several major changes in our understanding of human visual perception. For example, attention no longer appears necessary for "visual intelligence"--a large amount of sophisticated processing can be done without it. Scene perception no longer appears to involve static, general-purpose descriptions, but instead may involve dynamic representations whose content depends on the individual and the task. And vision itself no longer appears to be limited to the production of a conscious "picture"--it (...) may also guide processes outside the conscious awareness of the observer. (shrink)