Defined as vicarious sensorimotor experiencing, mental imagery is a powerful source of aesthetic enjoyment in everyday life and, reportedly, one of the commonest things readers remember about literary narratives in the long term. Furthermore, it is positively correlated with other dimensions of reader response, most notably with emotion. Until recent decades, however, the phenomenon of mental imagery has been largely overlooked by modern literary scholarship. As an attempt to strengthen the status of mental imagery within the literary and, more generally, (...) aesthetic discipline, this dissertation proposes an analysis positioned at a confluence of literary theory and the cognitive sciences, especially the emergent research framework of embodied cognition. Questions asked throughout the dissertation include the following: a) What are the basic varieties of mental imagery in the reading of literary narrative? b) By what contents or narrative strategies are they most likely to be prompted? c) What is it like to experience a mental image of a particular variety? d) What are its psychophysiological underpinnings? e) How does a mental image of a particular variety relate to perception? f) How does it relate to higher-order meaning-making? Four prototypical imagery varieties are distinguished on the basis of two variables with two values each (referential vs. verbal domain; inner vs. outer stance). Gradual transitions and in-between imagery varieties are acknowledged. The imagery typology and related hypotheses are grounded in introspection but carefully supported with indirect empirical evidence and, whenever possible, formulated so as to facilitate direct validation. (shrink)

Embodied theories of language postulate that language meaning is stored in modality-specific brain areas generally involved in perception and action in the real world. However, the temporal dynamics of the interaction between modality-specific information and lexical-semantic processing remain unclear. We investigated the relative timing at which two types of modality-specific information (action-based and visual-form information) contribute to lexical-semantic comprehension. To this end, we applied a behavioral priming paradigm in which prime and target words were related with respect to (1) action (...) features, (2) visual features, or (3) semantically associative information. Using a Go/No-Go lexical decision task, priming effects were measured across four different inter-stimulus intervals (ISI = 100, 250, 400, and 1000 ms) to determine the relative time course of the different features. Notably, action priming effects were found in ISIs of 100, 250, and 1000 ms whereas a visual priming effect was seen only in the ISI of 1000 ms. Importantly, our data suggest that features follow different time courses of activation during word recognition. In this regard, feature activation is dynamic, measurable in specific time windows but not in others. Thus the current study (1) demonstrates how multiple ISIs can be used within an experiment to help chart the time course of feature activation and (2) provides new evidence for embodied theories of language. (shrink)

The extended mind view and the embodied-grounded view of cognition and language are typically considered as rather independent perspectives. In this paper we propose a possible integration of the two views and support it proposing the idea of “Words As social Tools” (WAT). In this respect, we will propose that words, also due to their social and public character, can be conceived as quasi-external devices that extend our cognition. Moreover, words function like tools in that they enlarge the bodily space (...) of action thus modifying our sense of body. To support our proposal, we review the relevant literature on tool-use and on words as tools and report recent evidence indicating that word use leads to an extension of space close to the body. In addition, we outline a model of the neural processes that may underpin bodily space extension via word use and may reflect possible effects on cognition of the use of words as external means. We also discuss how reconciling the two perspectives can help to overcome the limitations they encounter if considered independently. (shrink)

Western science claims to provide unique, objective information about the world. This is supported by the observation that peoples across cultures will agree upon a common description of the physical world. Further, the use of scientific instruments and mathematics is claimed to enable the objectification of science. In this work, carried out by reviewing the scientific literature, the above claims are disputed systematically by evaluating the definition of physical reality and the scientific method, showing that empiricism relies ultimately upon the (...) human senses for the evaluation of scientific theories and that measuring instruments cannot replace the human sensory system. Nativist and constructivist theories of human sensory development are reviewed, and it is shown that nativist claims of core conceptual knowledge cannot be supported by the findings in the literature, which shows that perception does not simply arise from a process of maturation. Instead, sensory function requires a long process of learning through interactions with the environment. To more rigorously define physical reality and systematically evaluate the stability of perception, and thus the basis of empiricism, the development of the method of dimension analysis is reviewed. It is shown that this methodology, relied upon for the mathematical analysis of physical quantities, is itself based upon empiricism, and that all of physical reality can be described in terms of the three fundamental dimensions of mass, length and time. Hereafter the sensory modalities that inform us about these three dimensions are systematically evaluated. The following careful analysis of neuronal plasticity in these modalities shows that all the relevant senses acquire from the environment the capacity to apprehend physical reality. It is concluded that physical reality is acquired rather than given innately, and leads to the position that science cannot provide unique results. Rather, those it can provide are sufficient for a particular environmental setting. (shrink)

Centuries ago, Descartes and Locke initiated a foundational debate in epistemology over the relationship between knowledge, on the one hand, and practical factors, on the other. Descartes claimed that knowledge and practice are fundamentally separate. Locke claimed that knowledge and practice are fundamentally united. After a period of dormancy, their disagreement has reignited on the contemporary scene. Latter-day Lockeans claim that knowledge itself is essentially connected to, and perhaps even constituted by, practical factors such as how much is at stake, (...) how important the situation is, or how one should act. Latter-day Cartesians claim, by contrast, that knowledge is entirely constituted by truth-related factors such as truth, belief, and evidence. Each side has supported its case with claims about patterns in ordinary behavior and knowledge judgments. Lockeans argue that these patterns are best explained by positing a fundamental and direct link between knowledge and practical factors. Cartesians argue that the patterns can be equally well explained by positing an indirect link, entirely mediated by the traditional factors of truth, belief, and evidence, thereby rendering the Lockean hypothesis unnecessary. We argue that Cartesians are right about some practical factors, in particular stakes and how important a situation is, which have, at best, a modest indirect relationship to knowledge. However, Lockeans are right about actionability: whether a person should pursue a course of action is unquestionably very powerfully and directly connected to knowledge. (shrink)

According to the predictive coding theory of cognition , brains are predictive machines that use perception and action to minimize prediction error, i.e. the discrepancy between bottom–up, externally-generated sensory signals and top–down, internally-generated sensory predictions. Many consider PCT to have an explanatory scope that is unparalleled in contemporary cognitive science and see in it a framework that could potentially provide us with a unified account of cognition. It is also commonly assumed that PCT is a representational theory of sorts, in (...) the sense that it postulates that our cognitive contact with the world is mediated by internal representations. However, the exact sense in which PCT is representational remains unclear; neither is it clear that it deserves such status—that is, whether it really invokes structures that are truly and nontrivially representational in nature. In the present article, I argue that the representational pretensions of PCT are completely justified. This is because the theory postulates cognitive structures—namely action-guiding, detachable, structural models that afford representational error detection—that play genuinely representational functions within the cognitive system. (shrink)

The topic is characterized by a highly interdisciplinary approach to the issue of action and language integration. Such an approach, combining computational models and cognitive robotics experiments with neuroscience, psychology, philosophy, and linguistic approaches, can be a powerful means that can help researchers disentangle ambiguous issues, provide better and clearer definitions, and formulate clearer predictions on the links between action and language. In the introduction we briefly describe the papers and discuss the challenges they pose to future research. We identify (...) four important phenomena the papers address and discuss in light of empirical and computational evidence: (a) the role played not only by sensorimotor and emotional information but also of natural language in conceptual representation; (b) the contextual dependency and high flexibility of the interaction between action, concepts, and language; (c) the involvement of the mirror neuron system in action and language processing; (d) the way in which the integration between action and language can be addressed by developmental robotics and Human-Robot Interaction. (shrink)

The mental representation of one’s own body does not necessarily correspond to the physical body. For instance, a dissociation between perceived and actual reach-ability has been shown, that is, individuals perceive that they can reach objects that are out of grasp. We presented participants with 3D pictures of objects located at four different distances, namely near-reaching space, actual-reaching space, perceived-reaching space and non-reaching space. Immediately after they were presented with function, manipulation, observation or pointing verbs and were required to judge (...) if the verb was compatible with the object.Participants were faster with function and manipulation verbs than with observation and pointing verbs. Strikingly, with both function and manipulation verbs participants were faster when objects were presented in actual than the perceived reaching space. These findings suggest that our knowledge of the world is implicitly built online through behaviour, and is not necessarily reflected in explicit estimates or conscious representations. (shrink)

Drawing on research in narrative theory and literary aesthetics, text and discourse processing, phenomenology and the experimental cognitive sciences, this paper outlines an embodied theory of presence in the reading of literary narrative. Contrary to common assumptions, it is argued that there is no straightforward relation between the degree of detail in spatial description on one hand, and the vividness of spatial imagery and presence on the other. It is also argued that presence arises from a first-person, enactive process of (...) sensorimotor simulation/ resonance, rather than from mere visualizing from the perspective of a passive, third-person observer. In sections 1 to 3, an inter-theoretical argument is presented, proposing that presence may be effectively cued by explicit references to object -directed bodily movement. In section 4, an attempt is made at explaining which ways of embedding such references in the narrative may be particularly productive at eliciting presence. (shrink)

In this paper, I oppose the common assumption that visual descriptions in prose fiction are imageable by virtue of perceptual mimesis. Based on introspection as well as convergent support from cognitive science and other disciplines, I argue that visual description (and the mental imagery it elicits), unlike narrative (and the mental imagery it elicits), often stands in no positive relation to perceptual mimesis because it lacks a structural counterpart in perceptual experience. I present an alternative way of defining the kind (...) of mental imagery elicited by visual descriptions, and propose a number of text variables underlying the imageability or non-imageability of any such description. (shrink)

We propose a view of embodied representations that is alternative to both symbolic/linguistic approaches and purely sensorimotor views of cognition, and can account for procedural and declarative knowledge manipulation. In accordance with recent evidence in cognitive neuroscience and psychology, we argue that anticipatory and simulative mechanisms, which arose during evolution for action control and not for cognition, determined the first form of representational content and were exapted for increasingly sophisticated cognitive uses. In particular, procedural and declarative forms of knowledge can (...) be explained, respectively, in terms of on-line sensorimotor anticipation and off-line simulations of potential actions, which can give access to tacit knowledge and make it explicit. That is, mechanisms that evolved for the on-line prediction of the consequences of one's own actions (i.e. forward models) determine a (procedural) form of representation, and became exapted for off-line use. They can therefore be used to produce (declarative) knowledge of the world, by running a simulation of the action that would produce the relevant information. We conclude by discussing how embodied representations afford a form of internal manipulation that can be described as internalized situated action. (shrink)

The purpose of this paper is to defend a conception of language that does not rely on linguistic meanings, and use it to address the Sorites and Liar paradoxes.

In his novel Remembrance of Things Past, Marcel Proust argues that conventional descriptions of the phenomenology of consciousness are incomplete because they focus too much on the highly-salient sensory information that dominates each moment of awareness and ignore the network of associations that lies in the background. In this paper, I explicate Proust’s theory of conscious experience and show how it leads him directly to a theory of aesthetic perception. Proust’s division of awareness into two components roughly corresponds to William (...) James’ division of the stream of thought into a “nucleus” and “fringe.” Proust argues that the function of art is to evoke the underlying associative network indirectly in the mind of the observer by using carefully chosen sensory surfaces to control the stream of thought. I propose a possible neural basis for this Proustian/Jamesian phenomenology, and argue that the general principles of Proustian aesthetics can be applied to all forms of art. I conclude that a scientific theory of art should follow in a straightforward manner from a scientific theory of consciousness. (shrink)

The debate between the amodal and the grounded views of cognition seems to be stuck. Their only substantial disagreement is about the vehicle or format of concepts. Amodal theorists reject the grounded claim that concepts are couched in the same modality-specific format as representations in sensory systems. The problem is that there is no clear characterization of format or its neural correlate. In order to make the disagreement empirically meaningful and move forward in the discussion we need a neurocognitive criterion (...) for representational format. I argue that efficient coding models in computational neuroscience can be used to characterize modal codes: These are codes which satisfy special informational demands imposed by sensory tasks. Additionally, I examine recent studies on neural coding and argue that although they do not provide conclusive evidence for either the grounded or the amodal views, they can be used to determine what predictions these approaches can make and what experimental and theoretical developments would be required to settle the debate. (shrink)

This paper disputes the notion, endorsed by much of narrative theory, that the reading of literary narrative is functionally analogous to an act of communication, where communication stands for the transfer of thought and conceptual information. The paper offers a basic typology of the sensorimotor effects of reading, which fall outside such a narrowly communication-based model of literary narrative. A main typological distinction is drawn between those sensorimotor effects pertaining to the narrative qua verbal utterance (verbal presence) and those sensorimotor (...) effects pertaining to the imaginary physical world(s) of the story (direct presence). While verbal presence refers to the reader's vicarious perception of the voices of narrators and characters, direct presence refers to the emulated sensorimotor experience of the imaginary worlds that the narrators' and characters' utterances refer to. The paper further elaborates on how, by which kinds of narrative content and structure, direct presence may be prompted. The final section addresses some of the observational and historical caveats that must be attached to any theoretical inquiry made into the sensorimotor effects of reading. As a preliminary for further research, a few ideas about the model's potential for empirical validation are put forward. A brief, tentative history of the sensorimotor benefits of literary narrative reading is then outlined. (shrink)

The peripersonal space is an adaptive and flexible interface between the body and the environment that fulfills a dual-motor function: preparing the body for voluntary object-oriented actions to interact with incentive stimuli and preparing the body for defensive responses when facing potentially harmful stimuli. In this position article, we provide arguments for the sensorimotor rooting of the peripersonal space representation and highlight the variables that contribute to its flexible and adaptive characteristics. We also demonstrate that peripersonal space represents a mediation (...) zone between the body and the environment contributing to not only the control of goal-directed actions but also the organization of social life. The whole of the data presented and discussed led us to the proposal of a new theoretical framework linking the peripersonal action space and the interpersonal social space and we highlight how this theoretical framework can account for social behaviors in populations with socio-emotional deficits. (shrink)

Participants in the cognitive phenomenology debate have proceeded by (a) proposing a bifurcation of theoretical options into inflationary and non-inflationary theories, and then (b) providing arguments for/against one of these theories. I suggest that this method has failed to illuminate the commonalities and differences among conscious intentional states of different types, in the absence of a theory of the structure of these states. I propose such a theory. In perception, phenomenal-intentional properties combine with somatosensory properties to form P-I property clusters (...) that serve as phenomenal modes of presentations of particulars. In imagination, somatosensory properties are replaced with phenomenal-intentional properties whose intentional objects are somatosensory properties, thus resulting in imaginative facsimiles of perceptual P-I property clusters. Such structures can then be used as phenomenal prototypes that pick out individuals and kinds. Sets of such prototypes constitute a subject’s conception of individuals and kinds. Combined with a few additional elements, these imaginative P-I property clusters serve as the building-blocks of conscious cognitive states. Different ways of carving up theoretical space classify my theory either as inflationary or as non-inflationary. I conclude that the theory is anti-inflationary in letter but inflationary in spirit. (shrink)

Studies based on the Contemporary Theory of Metaphor (Lakoff & Johnson, 1980, 1999) usually identify conceptual metaphors by analysing linguistic expressions and creating a post hoc interpretation of the findings. This method has been questioned for a variety of reasons, including its circularity (Müller, 2008), lack of falsifiability (Vervaeke & Kennedy, 1996, 2004), and lack of predictive power (Ritchie, 2003). It has been argued that CTM requires additional constraints to improve its applicability for empirical research (Gibbs, 2011; Ritchie, 2003). This (...) paper sets out to propose additional methodological structure to CTM, a theory of conceptual metaphor in which much of abstract thought is generated by metaphorical mapping from embodied experience (Ruiz de Mendoza Ibáñez & Pérez Hernández, 2011). Introducing Objectification Theory defined by Szwedek (2002, 2007, 2011) ameliorates a number of methodological issues in CTM. First, the embodiment claim of CTM in its current form cannot be empirically proven incorrect (Vervaeke & Kennedy, 2004) as any mapping within it is possible (although only some actually happen). Objectification introduces pre-metaphorical structure of the kind suggested by Glucksberg (2001), constraining source and target domain selection, predicting which mappings are more likely to happen. Second, while many claim that metaphors trace back to a literal concept based on embodied physical experience (Gibbs, Costa Lima, & Francozo, 2004), it is unclear what criteria are used to define „physical”. Metaphorical domains are often described using the terms „abstract” and „concrete”, Objectification proposes objective criteria for deciding whether a concept is experientially grounded. Finally, Objectification provides grounds for introducing a hierarchical framework for metaphor typology, preventing post-hoc addition of metaphor types if and when suitable for the explanation of a phenomenon; thus increasing the consistency of the CTM framework, both internally and with other cognitive science disciplines. This thesis focuses on providing evidence for Objectification Theory and identifying its applications in metaphor and gesture research. (shrink)

The study of human intelligence was once dominated by symbolic approaches, but over the last 30 years an alternative approach has arisen. Symbols and processes that operate on them are often seen today as approximate characterizations of the emergent consequences of sub- or nonsymbolic processes, and a wide range of constructs in cognitive science can be understood as emergents. These include representational constructs (units, structures, rules), architectural constructs (central executive, declarative memory), and developmental processes and outcomes (stages, sensitive periods, neurocognitive (...) modules, developmental disorders). The greatest achievements of human cognition may be largely emergent phenomena. It remains a challenge for the future to learn more about how these greatest achievements arise and to emulate them in artificial systems. (shrink)

Although cognitive scientists have learned a lot about concepts, their findings have yet to be organized in a coherent theoretical framework. In addition, after twenty years of controversy, there is little sign that philosophers and psychologists are converging toward an agreement about the very nature of concepts. Doing without Concepts (Machery 2009) attempts to remedy this state of affairs. In this article, I review the main points and arguments developed at greater length in Doing without Concepts.

According to a posteriori physicalism, phenomenal properties are physical properties, despite the unbridgeable cognitive gap that holds between phenomenal concepts and physical concepts. Current debates about a posteriori physicalism turn on what I call “the perspicuity principle”: it is impossible for a suitably astute cognizer to possess concepts of a certain sort—viz., narrow concepts—without being able to tell whether the referents of those concepts are the same or different. The perspicuity principle tends to strike a posteriori physicalists as implausibly rationalistic; (...) further, a posteriori physicalists maintain that even if the principle is applicable to many narrow concepts, phenomenal concepts have unique features that render them inferentially isolated from other narrow concepts ). I argue, on the contrary, that the case for the perspicuity principle is quite strong. Moreover, not only have versions of the PCS repeatedly failed, likely, all versions will, given the strange combination of lucidity and opacity that the PCS has to juggle. I conclude that a posteriori physicalists currently lack a principled objection to classic anti-physicalist arguments. (shrink)

Over the past 15 years, there have been two increasingly popular approaches to the study of meaning in cognitive science. One, based on theories of embodied cognition, treats meaning as a simulation of perceptual and motor states. An alternative approach treats meaning as a consequence of the statistical distribution of words across spoken and written language. On the surface, these appear to be opposing scientific paradigms. In this review, we aim to show how recent cross-disciplinary developments have done much to (...) reconcile these two approaches. The foundation to these developments has been the recognition that intralinguistic distributional and sensory-motor data are interdependent. We describe recent work in philosophy, psychology, cognitive neuroscience, and computational modeling that are all based on or consistent with this conclusion. We conclude by considering some possible directions for future research that arise as a consequence of these developments. (shrink)

Contemporary semantic theories can be classified along two dimensions: (i) the way and time-course in which contextual factors influence sentence truth-conditions; and (ii) whether and to what extent comprehension involves sensory, motor and emotional processes. In order to explore this theoretical space, our ERP study investigates the time-course of the interaction between the lexically specified telic component of a noun (the function of the object to which the noun refers to, e.g., a funnel is generally used to pour liquids into (...) containers) and an ad-hoc affordance contextually induced by the situation described in the discourse. We found that, if preceded by a neutral discourse context, a verb incongruent with the noun’s telic component as in “She uses the funnel to hang her coat” elicited an enhanced N400 compared to a congruent verb as in “She uses the funnel to pour water into a container”. However, if the situation introduced in the preceding discourse induced a new function for the object as an ad-hoc affordance (e.g., the funnel is glued to the wall and the agent wants to hang the coat), we observed a crossing-over regarding the direction of the N400 effect: comparing the ad-hoc affordance-inducing context with the neutral context, the N400 for the incongruent verb was significantly reduced, whereas the N400 for the congruent verb was significantly enhanced. We explain these results as a consequence of the incorporation of the contextually triggered ad-hoc affordance into the meaning of the noun. Combining these results with an analysis of semantic similarity values between test sentences and contexts, we argue that one possibility is that the incorporation of an ad-hoc affordance may be explained on the basis of the mental simulation of concurrent motor information. (shrink)

Thirty years ago, grounded cognition had roots in philosophy, perception, cognitive linguistics, psycholinguistics, cognitive psychology, and cognitive neuropsychology. During the next 20 years, grounded cognition continued developing in these areas, and it also took new forms in robotics, cognitive ecology, cognitive neuroscience, and developmental psychology. In the past 10 years, research on grounded cognition has grown rapidly, especially in cognitive neuroscience, social neuroscience, cognitive psychology, social psychology, and developmental psychology. Currently, grounded cognition appears to be achieving increased acceptance throughout cognitive (...) science, shifting from relatively minor status to increasing importance. Nevertheless, researchers wonder whether grounded mechanisms lie at the heart of the cognitive system or are peripheral to classic symbolic mechanisms. Although grounded cognition is currently dominated by demonstration experiments in the absence of well-developed theories, the area is likely to become increasingly theory driven over the next 30 years. Another likely development is the increased incorporation of grounding mechanisms into cognitive architectures and into accounts of classic cognitive phenomena. As this incorporation occurs, much functionality of these architectures and phenomena is likely to remain, along with many original mechanisms. Future theories of grounded cognition are likely to be heavily influenced by both cognitive neuroscience and social neuroscience, and also by developmental science and robotics. Aspects from the three major perspectives in cognitive science—classic symbolic architectures, statistical/dynamical systems, and grounded cognition—will probably be integrated increasingly in future theories, each capturing indispensable aspects of intelligence. (shrink)

This work represents an interdisciplinary attempt at the development of a-- scientific theory of norms and normativity. Normativity, understood in its most general interpretation as value determinations and prescriptions, has traditionally been troublesome to account by science and difficult to “place” within a scientific worldview. Such an accomplishment is attempted by the joining in conversation of two bodies of literature. The first of these is Steve Fuller’s naturalist epistemology and the second corresponds to the situated study of cognition, along with (...) the epistemologies that have resulted from their findings. These two bodies of literature constitute the most radically naturalist attempts at developing a viable frame of epistemological and/or normative reference within their respective fields. (shrink)

Foraging for coherence is a pragmatist philosophy of the brain. It is a philosophy anchored to objects and instrumental in understanding the brain. Our age is dominated by neuroscience. A critical common sense underlies inquiry including that of neuroscience. Thus a pragmatist orientation to neuroscience is about foraging for coherence; not overselling neuroscience. Foraging for coherence is the search for adaptation – diverse epistemic orientation tied ideally to learning about oneself, one’s nature, and one’s history in the context of learning (...) about the brain. Neuroscience is about us: Our desires, habits, styles of reason, human vulnerability, and abuse. The language of the neuron, or the gene, or the systems does not replace the discussion about us as the person, in the social and historical context. (shrink)

Artefacts are usually understood in contrast with natural kinds and conceived as a unitary kind. Here we propose that there is in fact a variety of artefacts: from the more concrete to the more abstract ones. Moreover, not every artefact is able to fulfil its function thanks to its physical properties: Some artefacts, particularly what we call “institutional” artefacts, are symbolic in nature and require a system of rules to exist and to fulfil their function. Adopting a standard method to (...) measure conceptual representation (the property generation task), we have experimentally explored how humans conceptualise these different kinds of artefacts. Results indicate that institutional artefacts are typically opposed to social objects, while being more similar to standard artefacts, be they abstract or concrete. (shrink)

We advance a theory of inductive reasoning based on similarity, and test it on arguments involving mammal categories. To measure similarity, we quantified the overlap of neural activation in left Brodmann area 19 and the left ventral temporal cortex in response to pictures of different categories; the choice of of these regions is motivated by previous literature. The theory was tested against probability judgments for 40 arguments generated from 9 mammal categories and a common predicate. The results are interpreted in (...) the context of Hume’s thesis relating similarity to inductive inference. (shrink)