Speakers’ perception of a visual scene influences the language they use to describe it—which objects they choose to mention and how they characterize the relationships between them. We show that visual complexity can either delay or facilitate description generation, depending on how much disambiguating information is required and how useful the scene's complexity can be in providing, for example, helpful landmarks. To do so, we measure speech onset times, eye gaze, and utterance content in a reference production experiment in which (...) the target object is either unique or non-unique in a visual scene of varying size and complexity. Speakers delay speech onset if the target object is non-unique and requires disambiguation, and we argue that this reflects the cost of deciding on a high-level strategy for describing it. The eye-tracking data demonstrate that these delays increase when speakers are able to conduct an extensive early visual search, implying that when speakers scan too little of the scene early on, they may decide to begin speaking before becoming aware that their description is underspecified. Speakers’ content choices reflect the visual makeup of the scene—the number of distractors present and the availability of useful landmarks. Our results highlight the complex role of visual perception in reference production, showing that speakers can make good use of complexity in ways that reflect their visual processing of the scene. (shrink)

The problem of the richness of visual experience is that of finding principled grounds for claims about how much of the world a person actually sees at any given moment. It is argued that there are suggestive parallels between the two-component analysis of experience defended by Wilfrid Sellars, and certain recently advanced information processing accounts of visual perception. Sellars' later account of experience is examined in detail, and it is argued that there are good reasons in support of the claim (...) that the sensory nonconceptual content of experience can vary independently of conceptual awareness. It is argued that the Sellarsian analysis is not undermined by recent work on change blindness and related phenomena; a model of visual experience developed by Ronald Rensink is shown to be in essential harmony with the framework provided by Sellars, and provides a satisfactory answer to the problem of the richness of visual experience. (shrink)

It is often claimed that pre-attentive vision has an ‘iconic’ format. This is seen to explain pre-attentive vision's characteristically high processing capacity and to make sense of an overlap in the mechanisms of early vision and mental imagery. But what does the iconicity of pre-attentive vision amount to? This paper considers two prominent ways of characterising pre-attentive visual icons and argues that neither is adequate: one approach renders the claim ‘pre-attentive vision is iconic’ empirically false while the other obscures its (...) ability to do the explanatory work, which motivates positing pre-attentive visual icons in the first place. With this noted, I introduce the notion of an ‘Analogue Map’ and argue that it provides a superior characterisation of pre-attentive vision's iconicity. I then argue that this forces a reassessment of debates which have traditionally presupposed the iconicity of pre-attentive vision, emphasising ramifications for the viability of a format-based perception-thought border. (shrink)

This paper contrasts three different schemes of reference relevant to understanding systems of perceptual representation: a location-based system dubbed "feature-placing", a system of "visual indices" referring to things called "proto-objects", and the full sortal-based individuation allowed by a natural language. The first three sections summarize some of the key arguments (in Clark, 2000) to the effect that the early, parallel, and pre-attentive registration of sensory features itself constitutes a simple system of nonconceptual mental representation. In particular, feature integration--perceiving something as (...) being both F and G, where F and G are sensible properties registered in distinct parallel streams--requires a referential apparatus. Section V. reviews some grounds for thinking that at these earliest levels this apparatus is location-based: that it has a direct and nonconceptual means of picking out places. Feature-placing is contrasted with a somewhat more sophisticated system that can identify and track four or five "perceptual objects" or "proto-objects", independently of their location, for as long as they remain perceptible. Such a system is found in Zenon Pylyshyn's fascinating work on "visual indices", in Dana Ballard's notion of deictic codes, and in Kahneman, Treisman, and Wolfe's accounts of systems of evanescent representations they call "object files". Perceptual representation is a layered affair, and I argue that it probably includes both feature-placing and proto-objects. Finally, both nonconceptual systems are contrasted with the full-blooded individuation allowed in a natural language. (shrink)

When viewing a circular coin rotated in depth, it fills an elliptical region of the distal scene. For some, this appears to generate a two-fold experience, in which one sees the coin as simultaneously circular (in light of its 3D shape) and elliptical (in light of its 2D ‘perspectival shape’ or ‘p-shape’). An energetic philosophical debate asks whether the latter p-shapes are genuinely presented in perceptual experience (as ‘perspectivalists’ argue) or if, instead, this appearance is somehow derived or inferred from (...) experience (as ‘anti-perspectivalists’ argue). This debate, however, has largely turned on introspection. In a recent study, Morales, Bax, and Firestone (2020) aim to provide the first empirical test of this question. They asked subjects to find an elliptical coin seen face-on from a search array that also included a circular coin seen either face-on or at an angle. They found that subjects reacted more slowly when the distracting circle was seen at an angle, such that it’s p-shape matched that of the target ellipse. From this, they concluded that the similar p-shape between the ellipse and circle constituted a phenomenal similarity between the two, and thus that perspectivalism is true. We show that these results can also be explained by pre-attentive guidance by unconscious representations (in what follows, just “unconscious pre-attentive guidance”) and that this explanation is at least as plausible as one from phenomenal similarity. Thus, we conclude that the experiment does not support perspectivalism over anti-perspectivalism. (shrink)

Many artists, art critics, and poets suggest that an aesthetic appreciation of artworks may modify our perception of the world, including quotidian things and scenes. I call this Art-to-World, AtW. Focusing on visual artworks, in this paper I articulate an empirically-informed account of AtW that is based on content-related views of aesthetic experience, and on Goodman’s and Elgin’s concept of exemplification. An aesthetic encounter with artworks demands paying attention to its aesthetic, expressive, or design properties that realize its purpose. Attention (...) to these properties make percipients better able to spot them in other entities and scenes as well. The upshot is that an aesthetic commerce with artworks enlarges the scope of what we are able to see and has therefore momentous epistemic consequences. (shrink)

The use and acquisition of knowledge appears to be influenced by what humans pay attention to. Thus, looking at attention will tell us something about the mechanisms involved in knowledge (usage). According to the present review, attention reflects selectivity in information processing and it is not necessarily also reflected in a user’s consciousness, as it is rooted in skill memory or other implicit procedural memory forms–that is, attention is rooted in the necessity of human control of mental operations and actions. (...) The main assumption is that what is true of processing in general is also true of knowledge: Its usage cannot be understood, unless we have the means to study all mechanisms involved, including knowledge hidden from direct introspection and knowledge that participants are not willing to share with interrogators. Reviewing work done in this context, I argue that experimental research on selectivity and bias in human information processing is a promising road to learn about the principles governing knowledge (usage) and to reflect upon them. (shrink)

Some things look more complex than others. For example, a crenulate and richly organized leaf may seem more complex than a plain stone. What is the nature of this experience—and why do we have it in the first place? Here, we explore how object complexity serves as an efficiently extracted visual signal that the object merits further exploration. We algorithmically generated a library of geometric shapes and determined their complexity by computing the cumulative surprisal of their internal skeletons—essentially quantifying the (...) “amount of information” within each shape—and then used this approach to ask new questions about the perception of complexity. Experiments 1–3 asked what kind of mental process extracts visual complexity: a slow, deliberate, reflective process (as when we decide that an object is expensive or popular) or a fast, effortless, and automatic process (as when we see that an object is big or blue)? We placed simple and complex objects in visual search arrays and discovered that complex objects were easier to find among simple distractors than simple objects are among complex distractors—a classic search asymmetry indicating that complexity is prioritized in visual processing. Next, we explored the function of complexity: Why do we represent object complexity in the first place? Experiments 4–5 asked subjects to study serially presented objects in a self‐paced manner (for a later memory test); subjects dwelled longer on complex objects than simple objects—even when object shape was completely task‐irrelevant—suggesting a connection between visual complexity and exploratory engagement. Finally, Experiment 6 connected these implicit measures of complexity to explicit judgments. Collectively, these findings suggest that visual complexity is extracted efficiently and automatically, and even arouses a kind of “perceptual curiosity” about objects that encourages subsequent attentional engagement. (shrink)

Many artists, art critics, and poets suggest that an aesthetic appreciation of artworks may modify our perception of the world, including quotidian things and scenes. I call this Art-to-World, AtW. Focusing on visual artworks, in this paper I articulate an empirically-informed account of AtW that is based on content related views of aesthetic experience, and on Goodman’s and Elgin’s concept of exemplification. An aesthetic encounter with artworks demands paying attention to its aesthetic, expressive, or design properties that realize its purpose. (...) Attention to these properties make percipients better able to spot them in other entities and scenes as well. The upshot is that an aesthetic commerce with artworks enlarges the scope of what we are able to see and has therefore momentous epistemic consequences. (shrink)

Philosophers of perception frequently assume that we see actual states of affairs, or facts. Call this claim factualism. In his book, William Fish suggests that factualism is supported by phenomenological observation as well as by experimental studies on multiple object tracking and dynamic feature-object integration. In this paper, I examine the alleged evidence for factualism, focusing mainly on object detection and tracking. I argue that there is no scientific evidence for factualism. This conclusion has implications for studies on the phenomenology (...) and epistemology of visual perception. (shrink)

When referring to a target object in a visual scene, speakers are assumed to consider certain distractor objects to be more relevant than others. The current research predicts that the way in which speakers come to a set of relevant distractors depends on how they perceive the distance between the objects in the scene. It reports on the results of two language production experiments, in which participants referred to target objects in photo-realistic visual scenes. Experiment 1 manipulated three factors that (...) were expected to affect perceived distractor distance: two manipulations of perceptual grouping (region of space and type similarity), and one of presentation mode (2D vs. 3D). In line with most previous research on visually-grounded reference production, an offline measure of visual attention was taken here: the occurrence of overspecification with color. The results showed effects of region of space and type similarity on overspecification, suggesting that distractors that are perceived as being in the same group as the target are more often considered relevant distractors than distractors in a different group. Experiment 2 verified this suggestion with a direct measure of visual attention, eye tracking, and added a third manipulation of grouping: color similarity. For region of space in particular, the eye movements data indeed showed patterns in the expected direction: distractors within the same region as the target were fixated more often, and longer, than distractors in a different region. Color similarity was found to affect overspecification with color, but not gaze duration or the number of distractor fixations. Also the expected effects of presentation mode (2D vs. 3D) were not convincingly borne out by the data. Taken together, these results provide direct evidence for the close link between scene perception and language production, and indicate that perceptual grouping principles can guide speakers in determining the distractor set during reference production. (shrink)

The sensorimotor theory of vision and visual consciousness is often described as a radical alternative to the computational and connectionist orthodoxy in the study of visual perception. However, it is far from clear whether the theory represents a significant departure from orthodox approaches or whether it is an enrichment of it. In this study, I tackle this issue by focusing on the explanatory structure of the sensorimotor theory. I argue that the standard formulation of the theory subscribes to the same (...) theses of the dynamical hypothesis and that it affords covering-law explanations. This however exposes the theory to the mere description worry and generates a puzzle about the role of representations. I then argue that the sensorimotor theory is compatible with a mechanistic framework, and show how this can overcome the mere description worry and solve the problem of the explanatory role of representations. By doing so, it will be shown that the theory should be understood as an enrichment of the orthodoxy, rather than an alternative. (shrink)

As documented by Darwin 150 years ago, emotion expressed in human faces readily draws our attention and promotes sympathetic emotional reactions. How do such reactions to the expression of emotion affect our goal-directed actions? Despite the substantial advance made in the neural mechanisms of both cognitive control and emotional processing, it is not yet known well how these two systems interact. Here, we studied how emotion expressed in human faces influences cognitive control of conflict processing, spatial selective attention and inhibitory (...) control in particular, using the Eriksen flanker paradigm. In this task, participants viewed displays of a central target face flanked by peripheral faces and were asked to judge the gender of the target face; task-irrelevant emotion expressions were embedded in the target face, the flanking faces, or both. We also monitored how emotion expression affects gender judgment performance while varying the relative timing between the target and flanker faces. As previously reported, we found robust gender congruency effects, namely slower responses to the target faces whose gender was incongruent with that of the flanker faces, when the flankers preceded the target by 0.1 s. When the flankers further advanced the target by 0.3 s, however, the congruency effect vanished in most of the viewing conditions, except for when emotion was expressed only in the flanking faces or when congruent emotion was expressed in the target and flanking faces. These results suggest that emotional saliency can prolong a substantial degree of conflict by diverting bottom-up attention away from the target, and that inhibitory control on task-irrelevant information from flanking stimuli is deterred by the emotional congruency between target and flanking stimuli. (shrink)

The present empirical study investigates limitations of human visual working memory. The experiments of the present work involve the experimental paradigm of change detection using simple geometrical objects in the form of rectangles of different colour, length, and orientation. It can be shown, that a limited performance in the temporary storage of visual information has multiple sources. Limitations of VWM can be attributed to a limited capacity or a limited duration, but also to limitations in retrieval, which so far has (...) found only little attention. Key findings of the present study show, that a capacity limitation cannot be described by a simple and generally valid size of the store. It is in fact generally acknowledged that the capacity limitation of VWM is object-based, which means that the capacity can roughly be determined by the number of visual objects. However, it could be shown that the complexity of the objects has an influence on memory performance: Experimental evidence shows, e.g., that memory performance decreases, when an object is characterized not only by one feature, but by a number of features. The results are explained by increased storage demands for the binding of the features. Other key findings of the present study relate to the process of retrieval of information from VWM. For example, an asymmetric performance pattern could be observed: In a change detection task a memory performance was observed that corresponds to a capacity of 3 - 4 objects. In contrast a drastic decrease of performance corresponding to a capacity of only 1 object was observed, when the task was to find a matching item among changed distractors. These results lead to the idea of a change signal, by which the empirical data can be explained. The change signal is elicited by a local mismatch between the information stored in VSTM and perceptual online information. The retrieval process is efficient, when the change signal can be used in the memory task. However, retrieval is extremely limited, when in the presence of multiple changes a less efficient strategy has to be applied. In the course of the present study, moreover, it became evident that there are various links between VWM processes and visual attention. Visual attention is probably crucial for feature binding in VWM. In retrieval the change signal probably involves mechanisms of visual attention. The present study could, therefore, contribute to a clarification of the relation between VWM and visual attention. (shrink)

In the study of natural language quantification, much recent attention has been devoted to the investigation of verification procedures associated with the proportional quantifier most. The aim of these studies is to go beyond the traditional characterization of the semantics of most, which is confined to explicating its truth-functional and presuppositional content as well as its combinatorial properties, as these aspects underdetermine the correct analysis of most. The present paper contributes to this effort by presenting new experimental evidence in support (...) of a decompositional analysis of most according to which it is a superlative construction built from a gradable predicate many or much and the superlative operator -est. Our evidence comes in the form of verification profiles for sentences like Most of the dots are blue which, we argue, reflect the existence of a superlative reading of most. This notably contrasts with Lidz et al.’s results. To reconcile the two sets of data, we argue, it is necessary to take important differences in task demands into account, which impose limits on the conclusions that can be drawn from these studies. (shrink)

Contextual vocabulary acquisition (CVA) is the deliberate acquisition of a meaning for a word in a text by reasoning from context, where “context” includes: (1) the reader’s “internalization” of the surrounding text, i.e., the reader’s “mental model” of the word’s “textual context” (hereafter, “co-text” [3]) integrated with (2) the reader’s prior knowledge (PK), but it excludes (3) external sources such as dictionaries or people. CVA is what you do when you come across an unfamiliar word in your reading, realize that (...) you don’t know what it means, decide that you need to know what it means in order to understand the passage, but there is no one around to ask, and it is not in the dictionary (or you are too lazy to look it up). In such a case, you can try to figure out its meaning “from context”, i.e., from clues in the co-text together with your prior knowledge. Our computational theory of CVA—implemented in a the SNePS knowledge representation and reasoning system [28]—begins with a stored knowledge base containing SNePS representations of relevant PK, inputs SNePS representations of a passage containing an unfamiliar word, and draws inferences from these two (integrated) information sources. When asked to define the word, definition algorithms deductively search the resulting network for information of the sort that might be found in a dictionary definition, outputting a definition frame whose slots are the kinds of features that a definition might contain (e.g., class membership, properties, actions, spatio-temporal information, etc.) and whose slot-fillers contain information gleaned from the network [6–8,20,23,24]. We are investigating ways to make our system more robust, to embed it in a naturallanguage-processing system, and to incorporate morphological information. Our research group, including reading educators, is also applying our methods to the develop-. (shrink)

The present work is concerned with a phenomenon referred to as contextual cueing. In visual search, if a searched-for target object is consistently encountered within a stable spatial arrangement of distractor objects, detecting the target becomes more efficient over time, relative to non-repeated, random arrangements. This effect is attributed to learned target-distractor spatial associations stored in long-term memory, which expedite visual search. This Thesis investigates four aspects of contextual cueing: Study 1 tackled the implicit-explicit debate of contextual cueing from a (...) new perspective. Previous studies tested explicit access to learned displays by applying a recognition test, asking observers whether they have seen a given display in the previous search task. These tests, however, typically yield mixed findings and there is an on-going controversy whether contextual cueing can be described as an implicit or an explicit effect. The current study applied the new perspective of metacognition to contextual cueing and combined a contextual cueing task with metacognitive ratings about the clarity of the visual experience, either of the display configuration or the target stimulus. Bayesian analysis revealed that there was an effect of repeated context on metacognitive sensitivity for configuration, but not target, ratings. It was concluded that effects of contextual memory on metacognition are content-specific and lead to increased metacognitive access to the display configuration, but not to the target stimulus. The more general implication is that from the perspective of metacognition, contextual cueing can be considered as an explicit effect. Study 2 aimed at testing how explicit knowledge affects memory-guided visual search. Two sets of search displays were shown to participants: explicit and implicit displays. Explicit displays were introduced prior to the search experiment, in a dedicated learning session, and observers should deliberately learn these displays. Implicit displays, on the other hand, were first shown in the search experiment and learning was incidental through repeated exposure to these displays. Contextual cueing arising from explicit and implicit displays was assessed relative to a baseline condition of non-repeated displays. The results showed a standard contextual cueing effect for explicit displays and, interestingly, a negative cueing effect for implicit displays. Recognition performance was above chance for both types of repeated displays; however, it was higher for explicit displays. This pattern of results confirmed – in part – the predictions of a single memory model of attention-moderated associative learning, in which different display types compete for behavior and explicit representations block the retrieval of implicit representations. Study 3 investigates interactions between long-term contextual memory with short-term perceptual hypotheses. Both types of perceptual memory share high similarities with respect to their content, therefore the hypothesis was formulated that they share a common memory resource. In three experiments of interrupted search with repeated and non-repeated displays, it was shown that contextual cueing expedites performance in interrupted search; however, there was no interaction of contextual cueing with the generation or the confirmation of perceptual hypotheses. Rather, the analysis of fixational eye movements showed that long-term memory exerts its influence on search performance upon the first glance of a given display, essentially affecting the starting point of the search process. The behavior of approaching the target stimulus is then a product of generating and confirming perceptual hypotheses with these processes being unaffected by long-term contextual memory. It was concluded that long-term and short-term memory representations of the same search display are independent and exhibit additive effects on search performance. Study 4 is concerned with the effects of reward on perceptual learning. It was argued that rewarding repeated displays in a contextual cueing paradigm leads to an acceleration of the learning effect; however, it was not considered whether reward also has an effect in non-repeated displays. In these displays, at least the target position is kept constant while distractor configurations are random across repetitions. Usually this is done in order to account for target position-specific probability learning in contextual cueing. However, it is possible that probability learning itself is modulated by reward. The current experiment introduced high or low reward to repeated and importantly, also non-repeated displays. It was shown that reward had a huge effect on non-repeated displays, indicating that rewarding certain target positions, irrespective of the distractor layout, facilitates RT performance. Interestingly, reward effects were even larger for non-repeated compared to repeated displays. It was concluded that reward has a strong effect on probability-, and not context learning. (shrink)

Note posted 9 Jun 08 : Modifications made today include a new section on predictive validity, and addition of recently published article and in in-press article, both by Nosek & Hansen, under the "CULTURE VS. PERSON" heading, which replaces a previously listed unpublished ms. of theirs. I continue to encourage all interested to send material that they are willing to be included on this page. Please also to let me know about errors, including faulty links.

This paper proposes an Interface Transparency Thesis concerning how linguistic meanings are related to the cognitive systems that are used to evaluate sentences for truth/falsity: a declarative sentence S is semantically associated with a canonical procedure for determining whether S is true; while this procedure need not be used as a verification strategy, competent speakers are biased towards strategies that directly reflect canonical specifications of truth conditions. Evidence in favor of this hypothesis comes from a psycholinguistic experiment examining adult judgments (...) concerning ‘Most of the dots are blue’. This sentence is true if and only if the number of blue dots exceeds the number of nonblue dots. But this leaves unsettled, e.g., how the second cardinality is specified for purposes of understanding and/or verification: via the nonblue things, given a restriction to the dots, as in ‘|{x: Dot(x) & ~Blue(x)}|’; via the blue things, given the same restriction, and subtraction from the number of dots, as in ‘|{x: Dot(x)}| – |{x: Dot(x) & Blue(x)}|’; or in some other way. Psycholinguistic evidence and psychophysical modeling support the second hypothesis. (shrink)

b>—Several paradigms (e.g. change blindness, inattentional blindness, transsaccadic integra- tion) indicate that observers are often very poor at reporting changes to their visual environment. Such evidence has been used to suggest that the spatio-temporal coherence needed to represent change can only occur in the presence of focused attention. However, those studies almost always rely on explicit reports. It remains a possibility that the visual system can implicitly detect change, but that in the absence of focused attention, the change does not (...) reach awareness and consequently is not reported. To test this possibility, we used a simple change detection paradigm coupled with a speeded orien- tation discrimination task. Even when observers reported being unaware of a change in an item’s orientation, its nal orientation effectively biased their response in the orientation discrimination task. Both in aware and unaware trials, errors were most frequent when the changed item and the probe had incongruent orientations. These results demonstrate that the _nature _of the change can be represented in the absence of awareness. (shrink)

What are the relations between preattentive feature-placing and states of perceptual awareness? For the purposes of this paper, states of "perceptual awareness" are confined to the simplest possible exemplars: states in which one is aware of some aspect of the appearance of something one perceives. Subjective contours are used as an example. Early visual processing seems to employ independent, high-bandwidth, preattentive feature "channels", followed by a selective process that directs selective attention. The mechanisms that yield subjective contours are found very (...) early in this processing. An experiment by Greg Davis and Jon Driver is described; it seems to show that multiple subjective figures can be coded in these preattentive, parallel stages of visual processing. I propose that some of these preattentive states might register the very same differences that, were one aware of them, would be phenomenal differences. Some arguments pro and con on this possibility are assessed. (shrink)

In the visual search paradigm, participants’ task is to detect the presence or absence of a target item, which is presented in an array of distractor items. Usually it is found that performance is dependent on specific properties of the visual display, for example, the number of items to be searched or the similarity between display items. However, recent research has demonstrated that memory mechanisms can also affect search behaviour. Further, it was found that memory mechanisms can, in principle, be (...) either facilitatory or inhibitory, that is, that the processing of the item locations, features, or search objects themselves can be improved or impeded, respectively. This thesis investigated the effects of facilitatory and inhibitory memory mechanisms based on the element positions within the search display; facilitatory memory mechanisms based on the features of the search elements; and inhibitory memory mechanisms based on the search objects themselves. (shrink)