The structure of the brain and the nature of evolution suggest that, despite its uniqueness, language likely depends on brain systems that also subserve other functions. The declarative / procedural model claims that the mental lexicon of memorized word- specific knowledge depends on the largely temporal-lobe substrates of declarative memory, which underlies the storage and use of knowledge of facts and events. The mental grammar, which subserves the rule-governed combination of lexical items into complex representations, depends on a distinct neural (...) system. This system, which is composed of a network of specific frontal, basal - ganglia, parietal and cerebellar structures, underlies procedural memory, which supports the learning and execution of motor and cognitive skills, especially those involving sequences. The functions of the two brain systems, together with their anatomical, physiological and biochemical substrates, lead to specific claims and predictions regarding their roles in language. These predictions are compared with those of other neurocognitive models of language. Empirical evidence is presented from neuroimaging studies of normal language processing, and from developmental and adult- onset disorders. It is argued that this evidence supports the DP model. It is additionally proposed that “ language ” disorders, such as specific language impairment and non-fluent and fluent aphasia, may be profitably viewed as impairments primarily affecting one or the other brain system. Overall, the data suggest a new neurocognitive framework for the study of lexicon and grammar. (shrink)

A key question in studying consciousness is how neural operations in the brain can identify streams of sensory input as belonging to distinct modalities, which contributes to the representation of qualitatively different experiences. The basis for identification of modalities is proposed to be constituted by self-organized comparative operations across a network of unimodal and multimodal sensory areas. However, such network interactions alone cannot answer the question how sensory feature detectors collectively account for an integrated, yet phenomenally differentiated experiential content. This (...) problem turns out to be different from, although related to, the binding problem. It is proposed that the neural correlate of an enriched, multimodal experience is constituted by the attractor state of a dynamic associative network. Within this network, unimodal and multimodal sensory maps continuously interact to influence each other’s attractor state, so that a feature change in one modality results in a fast re-coding of feature information in another modality. In this scheme, feature detection is coded by firing-rate, whereas firing phase codes relational aspects. (shrink)

The aim of this study was to explore the emergence of skilled behaviours, in the form of actions, cognitions and emotions, between professional state level cricket batters and their lesser skilled counterparts. Twenty-two male cricket batsmen (n = 6 state level; n = 8 amateur grade club level, n = 8 junior state representative level) participated in a game scenario training session against right arm pace bowlers (n = 6 amateur senior club). The batsmen were tasked with scoring as many (...) runs as possible during a simulated limited-overs game. The actions, cognitions and emotions of each batsmen were recorded in situ with findings showing differences between state level players and those lesser skilled. State level batsmen played more scoring shots and scored more runs, underpinned by superior bat-ball contact and technical efficiency. Furthermore, the state player’s cognitive evaluations of their own performance differed from junior batters, with more reported strategies based on an external outcome focus, such as where to score runs, rather than a focus on internal processes, such as making technical changes. State level batsmen also reported lower levels of nervousness compared with junior level batsmen. These results highlight the importance of viewing the emergence of skilled behaviour as multi-faceted, rather than simply the acquisition of superior execution and technical proficiency. (shrink)

Time is a fundamental dimension of consciousness. Many studies of the “sense of agency” have investigated whether we attribute actions to ourselves based on a conscious experience of intention occurring prior to action, or based on a reconstruction after the action itself has occurred. Here, we ask the same question about a lower level aspect of action experience, namely awareness of the detailed spatial form of a simple movement. Subjects reached for a target, which unpredictably jumped to the side on (...) some trials. Participants (1) expressed their expectancy of a target shift during the upcoming movement, (2) pointed at the target as quickly and accurately as possible before returning to the start posiment to the target shift if required and (3) reproduced the spatial path of the movement they had just made, as accurately as possible, to give an indication of their awareness of the pointing movement. We analysed the spatial disparity between the initial and the reproduced movements on those with a target shift. A negative disparity value, or undershoot, suggests that motor awareness merely reflects a sluggish record of coordinated motor performance, while a positive value, or overshoot, suggests that participants’ intention to point to the shifting target contributes more to their awareness of action than their actual pointing movement. Undershoot and overshoot thus measure the reconstructive (motoric) and the preconstuctive (intentional) aspects of action awareness, respectively. We found that trials on which subjects strongly expected a target shift showed greater overshoot and less undershoot than trials with lower expectancy. Conscious expectancy therefore strongly influences the experience of the detailed motor parameters of our actions. Further, a delay inserted either between the expectancy judgement and the pointing movement, or between the pointing movement and the reproduction of the movement, had no effect on visuomotor adjustment but strongly influenced action awareness. Delays during either interval boosted undershoots, suggesting increased reliance on a time-limited sensory memory for action. The experience of action is thus strongly influenced by prior thoughts and expectations, but only over a short time period. Thus, awareness of our actions is a dynamic and relatively flexible mixture of what we intend to do, and what our motor system actually does. (shrink)

According to the spreading hypothesis of object-based attention, a subliminal cue that can successfully capture attention to a location within an object should also cause attention to spread throughout the whole cued object and lead to the same-object advantage. Instead, we propose that a subliminal cue favors shifts of attention between objects and strengthens the between-object link, which is coded primarily within the dorsal pathway that governs the visual guidance of action. By adopting the two-rectangle method and using an effective (...) subliminal cue to compare with the classic suprathreshold cue, we found a different result pattern with suprathreshold cues than with subliminal cues. The suprathreshold cue replicated the conventional location and object effects, whereas a subliminal cue led to a different-object advantage with a facilitatory location effect and a same-object advantage with an inhibitory location effect. These results support our consciousness-dependent shifting hypothesis but not the spreading hypothesis. (shrink)

Assistive Device Art derives from the integration of Assistive Technology and Art, involving the mediation of sensorimotor functions and perception from both, psychophysical methods and conceptual mechanics of sensory embodiment. This paper describes the concept of ADA and its origins by observing the phenomena that surround the aesthetics of prosthesis-related art. It also analyzes one case study, the Echolocation Headphones, relating its provenience and performance to this new conceptual and psychophysical approach of tool design. This ADA tool is designed to (...) aid human echolocation. They facilitate the experience of sonic vision, as a way of reflecting and learning about the construct of our spatial perception. Echolocation Headphones are a pair of opaque goggles which disable the participant’s vision. This device emits a focused sound beam which activates the space with directional acoustic reflection, giving the user the ability to navigate and perceive space through audition. The directional properties of parametric sound provide the participant a focal echo, similar to the focal point of vision. This study analyzes the effectiveness of this wearable sensory extension for aiding auditory spatial location in three experiments; optimal sound type and distance for object location, perceptual resolution by just noticeable difference, and goal-directed spatial navigation for open pathway detection, all conducted at the Virtual Reality Lab of the University of Tsukuba, Japan. The Echolocation Headphones have been designed for a diverse participant base. They have both the potential to aid auditory spatial perception for the visually impaired and to train sighted individuals in gaining human echolocation abilities. Furthermore, this Assistive Device artwork instigates participants to contemplate on the plasticity of their sensorimotor architecture. (shrink)

Little is known about distance processing in patients with posterior brain damage. Although many investigators have claimed that distance estimates are normal or abnormal in some of these patients, many of these observations were made informally and the examiners often asked for relative, and not absolute, distance estimates. The present investigation served two purposes. First, we wanted to contrast the use of distance information in peripersonal space for perceptual report as opposed to visuomotor control in our visual form agnosic patient, (...) DF. Second, we wanted to see to what extent her abilities to process distance cues were dependent on binocular vision, in light of Milner et al.'s (1991) observations of preserved stereopsis in DF, and Dijkerman et al.'s (1996) and Marotta et al.'s (1997) observations that her visual guidance of grasping may be particularly dependent on binocular vision of the target. We hypothesized that DF's visuomotor responses would show normal sensitivity to target distance, while her perceptual estimates would not. In the first experiment, we required DF and two age- and sex-matched control subjects to reach out and grasp black cubes placed at varying distances, or to estimate the distance of the cubes from the hand starting position without making a reaching movement. In the second experiment, we required DF and two age-matched control subjects to point as rapidly and accurately as possible to small LED targets which differed in spatial location, under binocular and monocular conditions. The results showed that, relative to the control subjects, DF's grasping movements produced normal peak velocity-distance scaling-when she reached for blocks which varied in depth or pointed to LED targets which were presented at different distances in depth. In contrast, in the cube experiment, her verbal estimates of object distance were poorly scaled, although they improved slightly under the binocular conditions. The results are discussed in terms of current theories of processing streams in extrastriate visual cortex and the distinction between categorical and coordinate spatial processing. (shrink)

Radical Enactivism holds that the best explanation of basic forms of cognition is provided without involving information of any sort. According to this view, the ability to perceive visual affordances should be accounted for in terms of extensional covariations between variables spanning the agent’s body and the environment. Contrary to Radical Enactivism, I argue that the intensional properties of cognition cannot be ignored, and that the way in which an agent represents the world has consequences on the explanation of basic (...) sensorimotor abilities. To support this claim, I show that the perception of visual affordances is not segregated from higher forms of cognition; rather, it is modulated by the agent’s ability to recognize the semantic identity of the visual target. Accordingly, since the semantic recognition of an object involves a way of representing it under a certain description, it can be inferred that the perception of visual affordances cannot be accounted for without considering the intensional properties of cognition. This poses an explanatory issue for Radical Enactivism. (shrink)

This paper proposes how various disciplinary theories of cognition may be combined into a unifying, sub-symbolic, computational theory of cognition. The following theories are considered for integration: psychological theories, including the theory of event coding, event segmentation theory, the theory of anticipatory behavioral control, and concept development; artificial intelligence and machine learning theories, including reinforcement learning and generative artificial neural networks; and theories from theoretical and computational neuroscience, including predictive coding and free energy-based inference. In the light of such a (...) potential unification, it is discussed how abstract cognitive, conceptualized knowledge and understanding may be learned from actively gathered sensorimotor experiences. The unification rests on the free energy-based inference principle, which essentially implies that the brain builds a predictive, generative model of its environment. Neural activity-oriented inference causes the continuous adaptation of the currently active predictive encodings. Neural structure-oriented inference causes the longer term adaptation of the developing generative model as a whole. Finally, active inference strives for maintaining internal homeostasis, causing goal-directed motor behavior. To learn abstract, hierarchical encodings, however, it is proposed that free energy-based inference needs to be enhanced with structural priors, which bias cognitive development towards the formation of particular, behaviorally suitable encoding structures. As a result, it is hypothesized how abstract concepts can develop from, and thus how they are structured by and grounded in, sensorimotor experiences. Moreover, it is sketched-out how symbol-like thought can be generated by a temporarily active set of predictive encodings, which constitute a distributed neural attractor in the form of an interactive free-energy minimum. The activated, interactive network attractor essentially characterizes the semantics of a concept or a concept composition, such as an actual or imagined situation in our environment. Temporal successions of attractors then encode unfolding semantics, which may be generated by a behavioral or mental interaction with an actual or imagined situation in our environment. Implications, further predictions, possible verification and falsifications, as well as potential enhancements into a fully spelled-out unified theory of cognition are discussed at the end of the paper. (shrink)

Modularity in the human brain remains a controversial issue, with disagreement over the nature of the modules that exist, and why, when, and how they emerge. It is a natural assumption that modularity offers some form of computational advantage, and hence evolution by natural selection has translated those advantages into the kind of modular neural structures familiar to cognitive scientists. However, simulations of the evolution of simplified neural systems have shown that, in many cases, it is actually non-modular architectures that (...) are most efficient. In this paper, the relevant issues are discussed and a series of simulations are presented that reveal crucial dependencies on the details of the learning algorithms and tasks that are being modelled, and the importance of taking into account known physical brain constraints, such as the degree of neural connectivity. A pattern is established which provides one explanation of why modularity should emerge reliably across a range of neural processing tasks. (shrink)

Deep learning is currently the most prominent and widely successful method in artificial intelligence. Despite having played an active role in earlier artificial intelligence and neural network research, philosophers have been largely silent on this technology so far. This is remarkable, given that deep learning neural networks have blown past predicted upper limits on artificial intelligence performance—recognizing complex objects in natural photographs and defeating world champions in strategy games as complex as Go and chess—yet there remains no universally accepted explanation (...) as to why they work so well. This article provides an introduction to these networks as well as an opinionated guidebook on the philosophical significance of their structure and achievements. It argues that deep learning neural networks differ importantly in their structure and mathematical properties from the shallower neural networks that were the subject of so much philosophical reflection in the 1980s and 1990s. The article then explores several different explanations for their success and ends by proposing three areas of inquiry that would benefit from future engagement by philosophers of mind and science. (shrink)

Traditionally, philosophers have appealed to the phenomenological similarity between visual experience and visual imagery to support the hypothesis that there is significant overlap between the perceptual and imaginative domains. The current evidence, however, is inconclusive: while evidence from transcranial brain stimulation seems to support this conclusion, neurophysiological evidence from brain lesion studies (e.g., from patients with brain lesions resulting in a loss of mental imagery but not a corresponding loss of perception and vice versa) indicates that there are functional and (...) anatomical dissociations between mental imagery and perception. Assuming that the mental imagery and perception do not overlap, at least, to the extent traditionally assumed, then the question arises as to what exactly mental imagery is and whether it parallels perception by proceeding via several functionally distinct mechanisms. In this review, we argue that even though there may not be a shared mechanism underlying vision for perception and conscious imagery, there is an overlap between the mechanisms underlying vision for action and unconscious visual imagery. On the basis of these findings, we propose a modification of Kosslyn’s model of imagery that accommodates unconscious imagination and explore possible explanations of the quasi-pictorial phenomenology of conscious visual imagery in light of the fact that its underlying neural substrates and mechanisms typically are distinct from those of visual experience. (shrink)

For almost half a century dual-stream advocates have vigorously defended the view that there are two functionally specialized cortical streams of visual processing originating in the primary visual cortex: a ventral, perception-related ‘conscious’ stream and a dorsal, action-related ‘unconscious’ stream. They furthermore maintain that the perceptual and memory systems in the ventral stream are relatively shielded from the action system in the dorsal stream. In recent years, this view has come under scrutiny. Evidence points to two overlapping action pathways: a (...) dorso-dorsal pathway that calculates features of the object to be acted on, and a ventro-dorsal pathway that transmits stored information about skilled object use from the ventral stream to the dorso-dorsal pathway. This evidence suggests that stored information may exert significantly more influence on visually guided action than hitherto assumed. I argue that this, in turn, supports the notion of skilled automatic action that is nonetheless agential. My focus here will be on actions influenced by implicit biases (stereotypes/prejudices). Action that is biased in this way, I argue, is in an important sense intentional and agential. (shrink)

David Milner and Melvyn Goodale’s dissociation hypothesis is commonly taken to state that there are two functionally specialized cortical streams of visual processing originating in striate (V1) cortex: a dorsal, action-related “unconscious” stream and a ventral, perception-related “conscious” stream. As Milner and Goodale acknowledge, findings from blindsight studies suggest a more sophisticated picture that replaces the distinction between unconscious vision for action and conscious vision for perception with a tripartite division between unconscious vision for action, conscious vision for perception, and (...) unconscious vision for perception. The combination excluded by the tripartite division is the possibility of conscious vision for action. But are there good grounds for concluding that there is no conscious vision for action? There is now overwhelming evidence that illusions and perceived size can have a significant effect on action (Bruno & Franz, 2009; Dassonville & Bala, 2004; Franz & Gegenfurtner, 2008; McIntosh & Lashley, 2008). There is also suggestive evidence that any sophisticated visual behavior requires collaboration between the two visual streams at every stage of the process (Schenk & McIntosh, 2010). I nonetheless want to make a case for the tripartite division between unconscious vision for action, conscious vision for perception, and unconscious vision for perception. My aim here is not to refute the evidence showing that conscious vision can affect action but rather to argue (a) that we cannot gain cognitive access to action-guiding dorsal stream representations, and (b) that these representations do not correlate with phenomenal consciousness. This vindicates the semi-conservative view that the dissociation hypothesis is best understood as a tripartite division. (shrink)

Blindsight and vision for action seem to be exemplars of unconscious visual processes. However, researchers have recently argued that blindsight is not really a kind of uncon- scious vision but is rather severely degraded conscious vision. Morten Overgaard and col- leagues have recently developed new methods for measuring the visibility of visual stimuli. Studies using these methods show that reported clarity of visual stimuli correlates with accuracy in both normal individuals and blindsight patients. Vision for action has also come under (...) scrutiny. Recent findings seem to show that information processed by the dor- sal stream for online action contributes to visual awareness. Some interpret these results as showing that some dorsal stream processes are conscious visual processes (e.g., Gallese, 2007; Jacob & Jeannerod, 2003). The aim of this paper is to provide new support for the more traditional view that blindsight and vision for action are genuinely unconscious per- ceptual processes. I argue that individuals with blindsight do not have access to the kind of purely qualitative color and size information which normal individuals do. So, even though people with blindsight have a kind of cognitive consciousness, visual information process- ing in blindsight patients is not associated with a distinctly visual phenomenology. I argue further that while dorsal stream processing seems to contribute to visual awareness, only information processed by the early dorsal stream (V1, V2, and V3) is broadcast to working memory. Information processed by later parts of the dorsal stream (the parietal lobe) never reaches working memory and hence does not correlate with phenomenal awareness. I con- clude that both blindsight and vision for action are genuinely unconscious visual processes. (shrink)

The paper starts out by distinguishing two closely related hypotheses about extended cognition. According to the strong hypothesis, there are no intrinsic representations in the brain. This is a version of the extended-mind view defended by Andy Clark and Richard Menary. On the weak hypothesis, there are intrinsic representations in the brain but some types of cognition, knowledge or memory are constituted by particular types of external devices or environmental factors that extend beyond the skull and perhaps beyond the skin. (...) This type of view was defended, for example, by Andy Clark and David Chalmers. After drawing this distinction and clarifying the notions of causal influence and constitution, I defend the second weaker hypothesis with respect to procedural knowledge and knowledge of action and show why this sort of view supports what we might call a ‘situationist-friendly virtue epistemology’. (shrink)

Neuropsychological findings used to motivate the "two visual systems" hypothesis have been taken to endanger a pair of widely accepted claims about spatial representation in conscious visual experience. The first is the claim that visual experience represents 3-D space around the perceiver using an egocentric frame of reference. The second is the claim that there is a constitutive link between the spatial contents of visual experience and the perceiver's bodily actions. In this paper, I review and assess three main sources (...) of evidence for the two visual systems hypothesis. I argue that the best interpretation of the evidence is in fact consistent with both claims. I conclude with some brief remarks on the relation between visual consciousness and rational agency. (shrink)

It is natural to assume that the fine-grained and highly accurate spatial information present in visual experience is often used to guide our bodily actions. Yet this assumption has been challenged by proponents of the Two Visual Systems Hypothesis , according to which visuomotor programming is the responsibility of a “zombie” processing stream whose sources of bottom-up spatial information are entirely non-conscious . In many formulations of TVSH, the role of conscious vision in action is limited to “recognizing objects, selecting (...) targets for action, and determining what kinds of action, broadly speaking, to perform” . Our aim in this study is to show that the available evidence not only fails to support this dichotomous view but actually reveals a significant role for conscious vision in motor programming, especially for actions that require deliberate attention. (shrink)

Consciousness is a mongrel concept: there are a number of very different "consciousnesses." Phenomenal consciousness is experience; the phenomenally conscious aspect of a state is what it is like to be in that state. The mark of access-consciousness, by contrast, is availability for use in reasoning and rationally guiding speech and action. These concepts are often partly or totally conflated, with bad results. This target article uses as an example a form of reasoning about a function of "consciousness" based on (...) the phenomenon of blindsight. Some information about stimuli in the blind field is represented in the brains of blindsight patients, as shown by their correct "guesses," but they cannot harness this information in the service of action, and this is said to show that a function of phenomenal consciousness is somehow to enable information represented in the brain to guide action. But stimuli in the blind field are BOTH access-unconscious and phenomenally unconscious. The fallacy is: an obvious function of the machinery of access-consciousness is illicitly transferred to phenomenal consciousness. (shrink)

Attention plays a role in demonstrative thought: It sets the targets. Visual experience also plays a role. I argue here that it makes visual information available for use in the voluntary control of focal attention. To do so I use both introspection and neurophysiological evidence from projections between areas of attentional control and neural correlates of consciousness. Campbell and Smithies also identify roles for experience, but they further argue that only experience can play those roles. In contrast, I argue that (...) experience is not the only way in which visual information could be accessed for the voluntary control of attention. (shrink)

Emerging demonstrations of the malleability of distance perception in affective situations require an organizing structure. These effects can be predicted by approach and avoidance orientation. Approach reduces perceptions of distance; avoidance exaggerates perceptions of distance. Moreover, hedonic valence, motivational intensity, and perceiver arousal cannot alone serve as organizing principles. Organizing the literature based on approach and avoidance can reconcile seeming inconsistent effects in the literature, and offers these motives as psychological mechanisms by which affective situations predict perceptions of distance. Moreover, (...) this perspective complements functional models of perception claiming perceptions of distance serve adaptive responding, and in so doing suggests why perceptions of distance respond to affective situations. This review contributes to the building of a broader theory of motivated distance perception. (shrink)