Recent advances in neuroimaging technologies have rendered multimodal analysis of operators’ cognitive processes in complex task settings and environments increasingly more practical. In this exploratory study, we utilized optical brain imaging and mobile eye tracking technologies to investigate the behavioral and neurophysiological differences among expert and novice operators while they operated a human-machine interface in normal and adverse conditions. In congruence with related work, we observed that experts tended to have lower prefrontal oxygenation and exhibit gaze patterns that are (...) better aligned with the optimal task sequence with shorter fixation durations as compared to novices. These trends reached statistical significance only in the adverse condition where the operators were prompted with an unexpected error message. Comparisons between hemodynamic and gaze measures before and after the error message indicated that experts’ neurophysiological response to the error involved a systematic increase in bilateral dorsolateral prefrontal cortex (dlPFC) activity accompanied with an increase in fixation durations, which suggests a shift in their attentional state, possibly from routine process execution to problem detection and resolution. The novices’ response was not as strong as that of experts, including a slight increase only in the left dlPFC with a decreasing trend in fixation durations, which is indicative of visual search behavior for possible cues to make sense of the unanticipated situation. A linear discriminant analysis model capitalizing on the covariance structure among hemodynamic and eye movement measures could distinguish experts from novices with 91% accuracy. Despite the small sample size, the performance of the linear discriminant analysis combining eye fixation and dorsolateral oxygenation measures before and after an unexpected event suggests that multimodal approaches may be fruitful for distinguishing novice and expert performance in similar neuroergonomic applications in the field. (shrink)

Recent advances in neuroimaging technologies have rendered multimodal analysis of operators’ cognitive processes in complex task settings and environments increasingly more practical. In this exploratory study, we utilized optical brain imaging and mobile eye tracking technologies to investigate the behavioral and neurophysiological differences among expert and novice operators while they operated a human-machine interface in normal and adverse conditions. In congruence with related work, we observed that experts tended to have lower prefrontal oxygenation and exhibit gaze patterns that are (...) better aligned with the optimal task sequence with shorter fixation durations as compared to novices. These trends reached statistical significance only in the adverse condition where the operators were prompted with an unexpected error message. Comparisons between hemodynamic and gaze measures before and after the error message indicated that experts’ neurophysiological response to the error involved a systematic increase in bilateral dorsolateral prefrontal cortex (dlPFC) activity accompanied with an increase in fixation durations, which suggests a shift in their attentional state, possibly from routine process execution to problem detection and resolution. The novices’ response was not as strong as that of experts, including a slight increase only in the left dlPFC with a decreasing trend in fixation durations, which is indicative of visual search behavior for possible cues to make sense of the unanticipated situation. A linear discriminant analysis model capitalizing on the covariance structure among hemodynamic and eye movement measures could distinguish experts from novices with 91% accuracy. Despite the small sample size, the performance of the linear discriminant analysis combining eye fixation and dorsolateral oxygenation measures before and after an unexpected event suggests that multimodal approaches may be fruitful for distinguishing novice and expert performance in similar neuroergonomic applications in the field. (shrink)

From the perspective of distributed cognition I will stress how abduction is essentially multimodal, in that both data and hypotheses can have a full range of verbal and sensory representations, involving words, sights, images, smells, etc., but also kinesthetic – related to the ability to sense the position and location and orientation and movement of the body and its parts – and motor experiences and other feelings such as pain, and thus all sensory modalities. The presence of kinesthetic (...) and motor aspects demonstrates that abductive reasoning can be manipulative. We can also see, in this regard, how implicit factors take part in the abductive procedure, which consequently acquires the character of a kind of “thinking through doing”. This paper further describes 1) the fact that hypotheses in science can be built through different cognitive mediators and so they can also model the same cognitive aspect in different ways; how they can be carriers/ producers of knowledge in a multimodal way; 2) the problem of the possible non-explanatory and instrumental nature of abductive reasoning and the analysis of the consequences for induction; 3) the role of manipulative abduction in building new evidence/ experiments and how they trigger smart inductive inferences. (shrink)

In this paper I develop a novel account of the phenomenality of language by focusing on characteristics of perceived speech. I explore the extent to which the spoken word can be said to have a horizonal structure similar to that of spatiotemporal objects: our perception of each is informed by habitual associations and expectations formed through past experiences of the object or word and other associated objects and experiences. Specifically, the horizonal structure of speech in use can fruitfully be compared (...) to that of a tool in use. The comparison suggests an account of our linguistic faculty as continuous with more foundational faculties of perception and action. I provide empirical corroboration of this account by drawing on recent neuroimaging studies of the multimodal, sensorimotor bases of speech comprehension. I then discuss how such an understanding of our linguistic ability helps advocates of embodied, non-representationalist accounts of cognition respond to a common objection. Critics grant that embodied approaches may be adequate to account for lower-level, online modes of cognition, such as perception and action, which directly engage their object. But they question whether such approaches can “scale up” to higher modes of cognition, such as imagination, memory, thought, and language, which can entertain absent, non-existent, or abstract objects. By providing a plausible account of the continuity of lower cognition and language-involving cognition, my approach responds to this objection, at least where language is concerned. (shrink)

Jesse Prinz (2004) argues that emotional feelings (“state emotions”) can by themselves perceptually represent significant organism-environment relations. I object to this view mainly on the grounds that (1) it does not rule out the at least equally plausible view that emotional feelings are non-representational sensory registrations rather than perceptions, as Tyler Burge (2010) draws the distinction, and (2) perception of a relation requires perception of at least one of the relation’s relata, but an emotional feeling by itself perceives neither the (...) subject’s environment, nor in many cases the relevant subject itself. I then explore two ways in which emotional feelings as non-perceptual sensory registrations might still contribute to significant relation representation when associated with representations of the subject and/or its environment. After briefly discussing some difficulties presented by a multimodal, sensory-perceptual view of such representation, I argue in favor of a “cognitive recognition theory” that holds that significant relation instances are represented during emotion occurrences via applications of emotion-type concepts to "incoming" emotional feelings and their associated mental states. (shrink)

A typical claim in anti-representationalist approaches to cognition such as ecological psychology or radical embodied cognitive science is that ecological information is sufficient for guiding behavior. According to this view, affordances are immediately perceptually available to the agent (in the so-called “ambient energy array”), so sensory data does not require much further inner processing. As a consequence, mental representations are explanatorily idle: perception is immediate and direct. Here we offer one way to formalize this direct-perception claim and identify some (...) important limits to it. We argue that the claim should be read as saying that successful behavior just implies picking out affordance-related information from the ambient energy array. By relying on the Partial Information Decomposition framework, and more concretely on its development of the notion of synergy, we show that in multimodal perception, where various energy arrays carry affordance-related information, the “just pick out affordance-related information” approach is very inefficient, as it is bound to miss all synergistic components. Efficient multimodal information combination requires transmitting sensory-specific (and not affordance-specific) information to wherever it is that the various information streams are combined. The upshot is that some amount of computation is necessary for efficient affordance reconstruction. (shrink)

Human language, hominin tool production modes, and multimodal communications systems of primates and other animals are currently well-studied for how they display compositionality or combinatoriality. In all cases, the former is defined as a kind of hierarchical nesting and the latter as a lack thereof. In this article, I extend research on combinatoriality and compositionality further to investigations of everyday primate skills. Daily locomotion modes as well as behaviors associated with subsistence practices, hygiene, or body modification rely on the (...) hierarchical nesting of different behavioral and cognitive actions into complex skills. I introduce a scheme which uses hierarchical organization to differentiate combinatorial from compositional skills. Combinatorial skills are defined either as aggregational or linearly hierarchical depending on whether the skill occurs momentarily in space or unfolds sequentially over time. Compositional skills are defined either as nested or interactionally hierarchical depending on whether the skill results in new constructs or in new interactions between existing constructs. The methodology I propose combines epistemological hierarchy theory with data from primatological field research and experimental and comparative psychological research and provides a means to integrate current constructionist and extended views on cognition and action with older research on behavioral logics in psychology and operational chain thinking in anthropology. The approach furthermore synchronizes with ongoing research on teleonomy, intentionality, and creativity. -/- . (shrink)

This report highlights and explores five questions which arose from the workshop on perceptual learning and perceptual recognition at the University of Toronto, Mississauga on May 10th and 11th, 2012: 1. How should we demarcate perceptual learning from perceptual development? 2. What are the origins of multimodal associations? 3. Does our representation of time provide an amodal framework for multi-sensory integration? 4. What counts as cognitive penetration? 5. How can philosophers and psychologists most fruitfully collaborate?

In this review of Hutto and Myin's Radicalizing Enactivism, I question the adequacy of a non-representational theory of mind. I argue first that such a theory cannot differentiate cognition from other bodily engagements such as wrestling with an opponent. Second, I question whether the simple robots constructed by Rodney Brooks are adequate as models of multimodal organisms. Last, I argue that Hutto and Myin pay very little attention to how semantically interacting representations are needed to give an account (...) of choice and action. (shrink)

Scholarly opinions vary on what language is, how it evolved, and from where or what it evolved. Long considered uniquely human, today scholars argue for evolutionary continuity between human language and animal communication systems. But while it is generally recognized that language is an evolving communication system, scholars continue to debate from which species language evolved, and what behavioral and cognitive features are the precursors to human language. To understand the nature of protolanguage, some look for homologs in gene functionality, (...) brain areas, or anatomical structures such as the supralaryngeal vocal tract; others point toward primates, their gestural, vocal, multimodal, and in later evolving hominins also their pantomimic communication systems; and still others draw parallels between the musicality that characterizes language and the pitch found in the numerous sounds produced by animals. Accordingly, protolanguage theories today are multiple and diverse, and protolanguages might have also been diverse. This special issue on Evolving (Proto)Language/s for Lingua bundles several of the protolanguage theories that were put forward at the sixth edition of the Ways to Protolanguage conference series, held at the Calouste Gulbenkian Foundation in Lisbon, in 2019. Not aimed at surveying all the different ways there are to conceptualize, study, and model protolanguage/s, this issue provides interested readers with good overviews on the role played in current theorizing on protolanguage/s by (paleo)anthropology, genetics, physiology, developmental, evolutionary, ecological, and pragmatic research lines. (shrink)

There is converging evidence that high doses of hallucinogenic drugs can produce significant alterations of self-experience, described as the dissolution of the sense of self and the loss of boundaries between self and world. This article discusses the relevance of this phenomenon, known as “drug-induced ego dissolution (DIED)”, for cognitive neuroscience, psychology and philosophy of mind. Data from self-report questionnaires suggest that three neuropharmacological classes of drugs can induce ego dissolution: classical psychedelics, dissociative anesthetics and agonists of the kappa opioid (...) receptor (KOR). While these substances act on different neurotransmitter receptors, they all produce strong subjective effects that can be compared to the symptoms of acute psychosis, including ego dissolution. It has been suggested that neuroimaging of DIED can indirectly shed light on the neural correlates of the self. While this line of inquiry is promising, its results must be interpreted with caution. First, neural correlates of ego dissolution might reveal the necessary neurophysiological conditions for the maintenance of the sense of self, but it is more doubtful that this method can reveal its minimally sufficient conditions. Second, it is necessary to define the relevant notion of self at play in the phenomenon of DIED. This article suggests that DIED consists in the disruption of subpersonal processes underlying the “minimal” or “embodied” self, i.e., the basic experience of being a self rooted in multimodal integration of self-related stimuli. This hypothesis is consistent with Bayesian models of phenomenal selfhood, according to which the subjective structure of conscious experience ultimately results from the optimization of predictions in perception and action. Finally, it is argued that DIED is also of particular interest for philosophy of mind. On the one hand, it challenges theories according to which consciousness always involves self-awareness. On the other hand, it suggests that ordinary conscious experience might involve a minimal kind of self-awareness rooted in multisensory processing, which is what appears to fade away during DIED. (shrink)

Perceptual processes, in particular modular processes, have long been understood as being mandatory. But exactly what mandatoriness amounts to is left to intuition. This paper identifies a crucial ambiguity in the notion of mandatoriness. Discussions of mandatory processes have run together notions of automaticity and ballisticity. Teasing apart these notions creates an important tool for the modularist's toolbox. Different putatively modular processes appear to differ in their kinds of mandatoriness. Separating out the automatic from the ballistic can help the modularist (...) diagnose and explain away some putative counterexamples to multimodal and central modules, thereby helping us to better evaluate the evidentiary status of modularity theory. (shrink)

Recent research into the nature of self in artificial and biological systems raises interest in a uniquely determining immutable sense of self, a “metaphysical ‘I’” associated with inviolable personal values and moral convictions that remain constant in the face of environmental change, distinguished from an object “me” that changes with its environment. Complementary research portrays processes associated with self as multimodal routines selectively enacted on the basis of contextual cues informing predictive self or world models, with the notion of (...) the constant, per-vasive and invariant sense of self associated with a multistable attractor set aiming to ensure personal integrity against threat of disintegrative change. This paper proposes that an immutable sense of self emerges as a global attractor which can be described as a project ideal self-situation embodied in frontal medial processes during more or less normal adolescent development, and that thereafter serves to orient agency in the more or less free development of embodied potentials over the life course in effort to realize project conditions, phenomenally identified with the felt pull towards this end as purpose of and source of meaning in life. So oriented, life-long self-development aims to embody solutions to problems at different timescales depending on this embodied purpose, ultimately in the service of evolutionary processes securing organism populations against threats of disintegrative change over timespans far beyond that of the individual. After characterizing the target sense of self, research circling this target is briefly surveyed. Self as global project and developmental neural correlates are proposed. Then, the paper discusses some implications for research in biological and artificial systems. Building from earlier work in cognitive neurorobotics, discussion affirms the value of reinforcement rituals including prayer in metaphysical self-development, considers implications for value alignment and rights associated with free will in the context of artificial intelligence and robot religion, and concludes by emphasizing the importance of self-development toward project ideals as source of meaning in life in the current social-political environment. (shrink)

Brand image constitutes one of the most salient, over-defined, heavily explored and multifariously operationalized conceptual constructs in marketing theory and practice. In this Chapter, definitions of brand image that have been offered by marketing scholars will be critically addressed in the context of a culturally oriented discussion, informed by the semiotic notion of iconicity. This cultural bend, in conjunction with the concept’s semiotic contextualization, are expected both to dispel terminological confusions in the either inter-changeable or fuzzily differentiated employment of such (...) terms as brand image, symbol, icon, as well as to address the function of brand image at a deeper level than a mere construct to be operationalized in quantitative studies of purchase drivers. This shift in focus is coupled with a critical turn from the cogito-centric view of the consuming subject through the cognitivist lens of the AI metaphor as decision-making centre at the origin of largely conscious meaning-making, in favor of a psychoanalytically informed approach that considers figurativity as an essential process whereby brand image is formed. In these terms, brand image will be intimately linked to brand images as figurative multimodal expressive units and rhetorical tropes, as figurative syntax, that are responsible for shaping an idiolectal brand language, as well as to distinctive levels of iconicity as textual condition of possibility of a brand language. In order to understand the role of iconicity as fundamental condition of brand textuality, rather than just a procedure for spawning brand images, the discussion is contextualized in a wider framework involving the culturally situated source of brand images, how they become correlated with brand image concepts and how correlations between brand images and brand image result in brand knowledge structures (Keller 1998). This opening up of the discussion on iconicity is enacted against the background of what I call the Brand Imaginarium which involves: (i) a critical engagement with the dominant cognitivist perspective in branding research that prioritizes individual memory in brand knowledge formation, through a cultural branding lens that involves two additional types of memory, viz. communicative and cultural (ii) a critical engagement with the cognitivist perspective on brand knowledge formation that prioritizes conscious processing of stimuli (as ‘brute facts’, rather than as already semiotized expressive units) in a cognitive mechanism from which the faculty of imagination has been expelled, by restoring the importance of imagination in brand knowledge formation, and, concomitantly, by showing that the highly figurative language of brands may not be researched thoroughly unless imagination is posited anew as processing correlate (iii) the adoption of an expansionist approach to the role of the imaginary in brand knowledge formation, from cognitive (or psychic) faculty, to a more sociologically inclined process of inter-subjective mirroring, and concomitantly as imaginary social significations (Castoriades 1985) that are shared by culturally conditioned and habituated subjects that engage in meaningful cultural practices, rather than individual processing monads. (shrink)

The topic of this dissertation is the nature of linguistic competence, the capacity to understand and produce sentences of natural language. I defend the empiricist account of linguistic competence embedded in the connectionist cognitive science. This strand of cognitive science has been opposed to the traditional symbolic cognitive science, coupled with transformational-generative grammar, which was committed to nativism due to the view that human cognition, including language capacity, should be construed in terms of symbolic representations and hardwired rules. Similarly, (...) linguistic competence in this framework was regarded as being innate, rule-governed, domain-specific, and fundamentally different from performance, i.e., idiosyncrasies and factors governing linguistic behavior. I analyze state-of-the-art connectionist, deep learning models of natural language processing, most notably large language models, to see what they can tell us about linguistic competence. Deep learning is a statistical technique for the classification of patterns through which artificial intelligence researchers train artificial neural networks containing multiple layers that crunch a gargantuan amount of textual and/or visual data. I argue that these models suggest that linguistic competence should be construed as stochastic, pattern-based, and stemming from domain-general mechanisms. Moreover, I distinguish syntactic from semantic competence, and I show for each the ramifications of the endorsement of a connectionist research program as opposed to the traditional symbolic cognitive science and transformational-generative grammar. I provide a unifying front, consisting of usage-based theories, a construction grammar approach, and an embodied approach to cognition to show that the more multimodal and diverse models are in terms of architectural features and training data, the stronger the case is for the connectionist linguistic competence. I also propose to discard the competence vs. performance distinction as theoretically inferior so that a novel and integrative account of linguistic competence originating in connectionism and empiricism that I propose and defend in the dissertation could be put forward in scientific and philosophical literature. (shrink)

The first premise of Schellenberg’s particularity argument reads, “If a subject S perceives a particular α, then S discriminates and singles out α” (2018: 25). But this is false if seeing a ganzfeld is possible (i.e., a homogeneous field without any particulars to discriminate). In response, Schellenberg argues that seeing a ganzfeld is impossible by appealing to the ganzfeld effect (viz. hallucinatory experiences caused by ganzfeld exposure) exclusively as a ‘sense of blindness’. I present two challenges for this line of (...) reasoning. The first concerns the need to account for the long delay before blindness is reported (if it is reported at all) and the second concerns the need to be consistent with potential causes of ganzfeld hallucinations (in general, not exclusive to the sense of blindness). I show how Schellenberg’s particularity argument can meet the first challenge but struggles to meet the second. I present evidence based on considerations related to sensory deprivation and that follow from the predictive processing theory of cognition, which describes seeing a ganzfeld as the cause of ganzfeld hallucinations. If correct, this means that you can see a homogeneous field, and thus we ought to be skeptical of the soundness of Schellenberg’s particularity argument. I conclude with a possible strategy for rehabilitating the particularity argument that reconceptualizes perceptual experience as fundamentally multimodal, constituted by both exteroceptive and interoceptive sensation. (shrink)

Philosophical discussions of Molyneux's problem within contemporary philosophy of mind tend to characterize the problem as primarily concerned with the role innately known principles, amodal spatial concepts, and rational cognitive faculties play in our perceptual lives. Indeed, for broadly similar reasons, rationalists have generally advocated an affirmative answer, while empiricists have generally advocated a negative one, to the question Molyneux posed after presenting his famous thought experiment. This historical characterization of the dialectic, however, somewhat obscures the role Molyneux's problem has (...) played in spawning debates within the empiricist tradition. Fortunately, the differences between various empiricist accounts have been widely recognized and discussed among historians of philosophy working on the topic. The focus of the present essay is to develop an interpretation of John Locke's views on Molyneux's problem that best coheres with his other views on human understanding as well as with the predominant scientific opinion about the nature of perception during the period in which he lived. (shrink)

The predictive coding (PC) theory of attention identifies attention with the optimization of the precision weighting of prediction error. Here we provide some challenges for this identification. On the one hand, the precision weighting of prediction error is too broad a phenomenon to be identified with attention because such weighting plays a central role in multimodal integration. Cases of crossmodal illusions such as the rubber hand illusion and the McGurk effect involve the differential precision weighting of prediction error, yet (...) attention does not shift as one would predict. On the other hand, the precision weighting of prediction error is too narrow a phenomenon to be identified with attention, because it cannot accommodate the full range of attentional phenomena. We review criticisms that PC cannot account for volitional attention and affect-biased attention, and we propose that it may not be able to account for feature-based and intellectual attention. (shrink)

This report highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011: 1. What is the relationship between the unity of consciousness and sensory integration? 2. Are some of the basic units of consciousness multimodal? 3. How should we model the unity of consciousness? 4. Is the mechanism of sensory integration spatio-temporal? 5. How Should We Study Experience, Given Unity Relations?

The premise of this paper is that there are three distinct and hierarchical ‘categories of knowledge’ (Pharoah 2018). The first of these is physiological knowledge which is acquired over generations through the interaction between replicating lineages and the environment. This interaction facilitates the evolution of me-aningful physiological structures, forms, functions, and qualitative ascriptions. Second, there is phenomenal knowledge which is qualified by the utilisation of real-time experience to effect an individuated spatiotemporal subjective perspective. This capability requires sophisticated cognitive capabilities. Conceptual (...) knowledge is the third category and constitutes a network of abstracted principles about the spatiotemporal and phenomenal world of experience. From this starting premise, I argue that human knowledge can still be viewed as impove-rished because of the absence of the next category which has not yet emerged. I suggest that this category will be apparent when a fuller understanding is acquired concerning the dynamic nature of concept construction and structuring. This will demand a transdisciplinary and multimodal approach. (shrink)

In our everyday interactions we easily and effortlessly perceive emotions in others’ facial expressions and bodily behavior. How do we do that? Philosophers and psychologists have long argued about the fundamentals of emotion perception and the debate is far from settled. While some insist on the sufficiency of the morphological information contained in facial expressions, others construe the objects of emotion perception as more complex, comprising multimodal information such as touch, tone of voice, body postures, and so on. Others, (...) in turn, have gone so far as to deny that there is a pre-given object in emotion perception in the first place, so that processes of emotion perception must be conceptualized as emergent and co-constructed phenomena in contexts of social interaction. The purpose of this paper is to argue that John Dewey’s pragmatist theory of emotions can help us make significant theoretical advancements in the understanding of emotion perception, according to which emotions are coordinated modes of behavior that we enact with others in the contexts of social interactions. In this picture, perceiving emotions is a matter of participating in a joint activity of socio- affective coordination. This theory allows us to apprehend important insights about emotion perception that appear in these contemporary debates, while at the same time avoiding their pitfalls. (shrink)

In crossmodal identification, a subject token identifies an item perceived in one sensory modality with an item perceived in another sensory modality. Does crossmodal identification always occur in cognition, or does crossmodal identification sometimes take place in perception? This paper argues that crossmodal identification occurs in cognition, and not in perception. Nevertheless, multisensory perception is not unalive to crossmodal identity. Experimental evidence demonstrates that perception is differentially sensitive to the identity of individuals presented to distinct senses. Such sensitivity (...) enhances recognition and improves action. This approach relies on distinguishing crossmodal identification from perceiving crossmodal identity. Perception registers crossmodal identity, but crossmodal identification as such belongs to thought. (shrink)

In this short paper, I outline four philosophical arguments concerning the objects we perceive. These arguments build up to the conclusion that the objects of perceptual experience are material objects. I then show that the first three of these arguments parallel important psychological positions in vision science. Thus, (1) the notion of object used in Logical Atomism resembles the concept as it is defined in the Feature Integration Theory of Treisman and Gelade (1980). But (2) Frank Jackson's (1975) Many-Property Problem (...) leads to a substrate-quality structure for visual experience that corresponds to the structure of attended experience in Feature Integration Theory. A third philosophical argument (3) concerns the perception of movement. This argument culminates in the proposition that perceptual features are seen as belonging to material objects. There is a close resemblance between these objects and those of Zenon Pylyshyn's (1980) FINSTs. Finally, (4) I argue that material objects are the only substrates of multimodal perceptual experience. Perceptual psychology has yet to investigate this structure. (shrink)

It is often assumed that neural representation, with content that is in principle detachable from the flow of natural-factive information, is necessary to perceptually experience an object. In this paper we present and discuss two cases challenging this assumption. We take them to show that it is possible to experience an object with which you are interacting through your sensory systems without those systems constructing a representation of the object. The first example is viewing nearby medium-sized groups of objects. The (...) second is hearing objects through misbound sounds. These cases bring out two different ways object representation can fail while object experience persists, suggesting that object experience requires only that the object be revealed through sensory information, not full-blown representation. Constructing object representations is one way sensory systems reveal objects, but it is not the only way. Object representation in neural sensory systems is relatively demanding, rare, and fragile; object experience is relatively easy, pervasive, and robust. We conclude that even minimal forms of neural phenomenal internalism are false. (shrink)

Just as AI has moved away from classical AI, human-computer interaction (HCI) must move away from what I call ‘good old fashioned HCI’ to ‘new HCI’ – it must become a part of cognitive systems research where HCI is one case of the interaction of intelligent agents (we now know that interaction is essential for intelligent agents anyway). For such interaction, we cannot just ‘analyze the data’, but we must assume intentions in the other, and I suggest these are largely (...) recognized through resistance to carrying out one’s own intentions. This does not require fully cognitive agents but can start at a very basic level. New HCI integrates into cognitive systems research and designs intentional systems that provide resistance to the human agent. (shrink)

The aim of this paper is to argue that our experience of artworks is normally multimodal. It is the result of perceptual processing in more than one sense modality. In other words, multimodal experience of art is not the exception; it is the rule. I use the example of music in order to demonstrate the various ways in which the visual sense modality influences the auditory processing of music and conclude that this should make us look more closely (...) at our practices of engaging with artworks. (shrink)

This research article examines the potential of multimodal techniques in promoting inclusive practices in the English language classroom, delving into the multidisciplinary fields of English Language Teaching (ELT) and inclusive education. This study intends to investigate how multimodal resources, such as visual aids, technology, and creative activities, may be effectively integrated to meet the various learning needs of students using a pedagogical lens. This paper examines the theoretical underpinnings and practical implications of using multimodal approaches in ELT (...) settings, shedding light on their potential to promote inclusivity, engagement, and language acquisition among learners with diverse abilities and backgrounds. It does this through a thorough literature review and analysis of pedagogical frameworks. (shrink)

YouTube has been implicated in the transformation of users into extremists and conspiracy theorists. The alleged mechanism for this radicalizing process is YouTube’s recommender system, which is optimized to amplify and promote clips that users are likely to watch through to the end. YouTube optimizes for watch-through for economic reasons: people who watch a video through to the end are likely to then watch the next recommended video as well, which means that more advertisements can be served to them. This (...) is a seemingly innocuous design choice, but it has a troubling side-effect. Critics of YouTube have alleged that the recommender system tends to recommend extremist content and conspiracy theories, as such videos are especially likely to capture and keep users’ attention. To date, the problem of radicalization via the YouTube recommender system has been a matter of speculation. The current study represents the first systematic, pre-registered attempt to establish whether and to what extent the recommender system tends to promote such content. We begin by contextualizing our study in the framework of technological seduction. Next, we explain our methodology. After that, we present our results, which are consistent with the radicalization hypothesis. Finally, we discuss our findings, as well as directions for future research and recommendations for users, industry, and policy-makers. (shrink)

The study of animal cognition raises profound questions about the minds of animals and philosophy of mind itself. Aristotle argued that humans are the only animal to laugh, but in recent experiments rats have also been shown to laugh. In other experiments, dogs have been shown to respond appropriately to over two hundred words in human language. In this introduction to the philosophy of animal minds Kristin Andrews introduces and assesses the essential topics, problems and debates as they cut (...) across animal cognition and philosophy of mind. She addresses the following key topics: what is cognition, and what is it to have a mind? What questions should we ask to determine whether behaviour has a cognitive basis? the science of animal minds explained: ethology, behaviourist psychology, and cognitive ethology rationality in animals animal consciousness: what does research into pain and the emotions reveal? What can empirical evidence about animal behaviour tell us about philosophical theories of consciousness? does animal cognition involve belief and concepts; do animals have a ‘Language of Thought’? animal communication other minds: do animals attribute ‘mindedness’ to other creatures? moral reasoning and ethical behaviour in animals animal cognition and memory. Extensive use of empirical examples and case studies is made throughout the book. These include Cheney and Seyfarth’s ververt monkey research, Thorndike’s cat puzzle boxes, Jensen’s research into humans and chimpanzees and the ultimatum game, Pankseep and Burgdorf’s research on rat laughter, and Clayton and Emery’s research on memory in scrub-jays. Additional features such as chapter summaries, annotated further reading and a glossary make this an indispensable introduction to those teaching philosophy of mind, animal cognition. It will also be an excellent resource for those in fields such as ethology, biology and psychology. (shrink)

It is common to characterize pain with touch-related terms, like ‘cutting’, ‘pressing’, ‘sharp’, and ‘pulsing’, or temperature-related terms, like ‘hot’ or ‘burning’. This suggests that many pains are phenomenally multimodal because they are experienced as having some tactile-like or thermal-like character. The goal of this chapter is to investigate the structure of phenomenally multimodal pain experiences. It is argued that the usual accounts of multimodal structure proposed in investigations regarding exteroceptive experiences cannot be plausibly applied to (...) class='Hi'>multimodal experiences of pain. Instead, an alternative framework is proposed which characterizes the structure of tactile-like and thermal-like pains by referring to the notion of crossmodal correspondences. (shrink)

That about sums up what is wrong with Clark's view.

ABSTRACT Cognitive penetrability refers to the possibility that perceptual experiences are influenced by our beliefs, expectations, emotions, or other personal-level mental states. In this paper, I focus on the epistemological implication of cognitive penetration, and examine how, exactly, aetiologies matter to the justificatory power of perceptual experiences. I examine a prominent theory, according to which some cognitively penetrated perceptual experiences are like conclusions of bad inferences. Whereas one version of this theory is psychologically implausible, the other version has sceptical consequences. (...) In the second half of the paper, I suggest an alternative theory, drawing on recent empirical research on imagining-perception interaction and the epistemology of imagining. (shrink)

ABSTRACTSilencing is a practice that disrupts linguistic and communicative acts, but its relationship to knowledge and justice is not fully understood. Prior models of epistemic injustice tend to c...

The concepts expressed by social role terms such as artist and scientist are unique in that they seem to allow two independent criteria for categorization, one of which is inherently normative. This study presents and tests an account of the content and structure of the normative dimension of these “dual character concepts.” Experiment 1 suggests that the normative dimension of a social role concept represents the commitment to fulfill the idealized basic function associated with the role. Background information can affect (...) which basic function is associated with each social role. However, Experiment 2 indicates that the normative dimension always represents the relevant commitment as an end in itself. We argue that social role concepts represent the commitments to basic functions because that information is crucial to predict the future social roles and role-dependent behavior of others. (shrink)

This paper presents an analytical framework for analyzing how multimodal resources of emotion expression are semiotically materialized in discursive interactions specific to political discourse. Interested in how political personae are emotionally constructed through multimodal meaning-making practices, our analysis model assumes an interdisciplinary perspective, which integrates facial expression analysis – using FaceReader™ software –, the theory of emotional arcs and bodily actions (hand gestures) analysis that express emotions, in the analytical framework of multimodality. The results show how the (...) class='Hi'>multimodal choices that political actors make during discursive interactions allow them to build their political brand and make connections with the audience on an emotional level. (shrink)

Experimental research suggests that people draw a moral distinction between bad outcomes brought about as a means versus a side effect (or byproduct). Such findings have informed multiple psychological and philosophical debates about moral cognition, including its computational structure, its sensitivity to the famous Doctrine of Double Effect, its reliability, and its status as a universal and innate mental module akin to universal grammar. But some studies have failed to replicate the means/byproduct effect especially in the absence of other (...) factors, such as personal contact. So we aimed to determine how robust the means/byproduct effect is by conducting a meta-analysis of both published and unpublished studies (k = 101; 24,058 participants). We found that while there is an overall small difference between moral judgments of means and byproducts (standardized mean difference = 0.87, 95% CI 0.67 – 1.06; standardized mean change = 0.57, 95% CI 0.44 – 0.69; log odds ratio = 1.59, 95% CI 1.15 – 2.02), the mean effect size is primarily moderated by whether the outcome is brought about by personal contact, which typically involves the use of personal force. (shrink)

Kant’s views on animals have received much attention in recent years. According to some, Kant attributed the capacity for objective perceptual awareness to non-human animals, even though he denied that they have concepts. This position is difficult to square with a conceptualist reading of Kant, according to which objective perceptual awareness requires concepts. Others take Kant’s views on animals to imply that the mental life of animals is a blooming, buzzing confusion. In this article I provide a historical reconstruction of (...) Kant’s views on animals, relating them to eighteenth-century debates on animal cognition. I reconstruct the views of Buffon and Reimarus and show that (i) both Buffon and Reimarus adopted a conceptualist position, according to which concepts structure the cognitive experience of adult humans, and (ii) that both described the mental life of animals as a blooming, buzzing confusion. Kant’s position, I argue, is virtually identical to that of Reimarus. Hence Kant’s views on animals support a conceptualist reading of Kant. The article further articulates the historical antecedents of the Kantian idea that concepts structure human cognitive experience and provides a novel account of how the ideas of similarity and difference were conceptualized in eighteenth-century debates on animal cognition. (shrink)

Human aesthetic practices show a sensitivity to the ways that the appearance of an artefact manifests skills and other qualities of the maker. We investigate a possible origin for this kind of sensibility, locating it in the need for co-ordination of skill-transmission in the Acheulean stone tool culture. We argue that our narrative supports the idea that Acheulian agents were aesthetic agents. In line with this we offer what may seem an absurd comparison: between the Acheulian and the Quattrocento. In (...) making it we display some hidden richness in what counts as an aesthetic response to an artefact. We conclude with a brief review of rival explanations—biological and/or cultural—of how this skills-based sensibility became a regular feature of human aesthetic practices. (shrink)

I argue that in addressing worries about the validity and reliability of implicit measures of social cognition, theorists should draw on research concerning “entitativity perception.” In brief, an aggregate of people is perceived as highly “entitative” when its members exhibit a certain sort of unity. For example, think of the difference between the aggregate of people waiting in line at a bank versus a tight-knit group of friends: The latter seems more “groupy” than the former. I start by arguing (...) that entitativity perception modulates the activation of implicit biases and stereotypes. I then argue that recognizing this modulatory role will help researchers to address concerns surrounding the validity and reliability of implicit measures. (shrink)

Analysis of grip force signals tailored to hand and finger movement evolution and changes in grip force control during task execution provide unprecedented functional insight into somatosensory cognition. Somatosensory cognition is a basis of our ability to manipulate, move, and transform objects of the physical world around us, to recognize them on the basis of touch alone, and to grasp them with the right amount of force for lifting and manipulating them. Recent technology has permitted the wireless monitoring (...) of grip force signals recorded from biosensors in the palm of the human hand to track and trace human grip forces deployed in cognitive tasks executed under conditions of variable sensory (visual, auditory) input. Non-invasive multi-finger grip force sensor technology can be exploited to explore functional interactions between somatosensory brain mechanisms and motor control, in particular during learning a cognitive task where the planning and strategic execution of hand movements is essential. Sensorial and cognitive processes underlying manual skills and/or hand-specific (dominant versus non-dominant hand) behaviors can be studied in a variety of contexts by probing selected measurement loci in the fingers and palm of the human hand. Thousands of sensor data recorded from multiple spatial locations can be approached statistically to breathe functional sense into the forces measured under specific task constraints. Grip force patterns in individual performance profiling may reveal the evolution of grip force control as a direct result of cognitive changes during task learning. Grip forces can be functionally mapped to from-global-to-local coding principles in brain networks governing somatosensory processes for motor control in cognitive tasks leading to a specific task expertise or skill. Under the light of a comprehensive overview of recent discoveries into the functional significance of human grip force variations, perspectives for future studies in cognition, in particular the cognitive control of strategic and task relevant hand movements in complex real-world precision task, are pointed out. (shrink)

Compatibilism is the view that determinism is compatible with acting freely and being morally responsible. Incompatibilism is the opposite view. It is often claimed that compatibilism or incompatibilism is a natural part of ordinary social cognition. That is, it is often claimed that patterns in our everyday social judgments reveal an implicit commitment to either compatibilism or incompatibilism. This paper reports five experiments designed to identify such patterns. The results support a nuanced hybrid account: The central tendencies in ordinary (...) social cognition are compatibilism about moral responsibility, compatibilism about positive moral accountability, neither compatibilism nor incompatibilism about negative moral accountability, compatibilism about choice for actions with positive outcomes, and incompatibilism about choice for actions with negative or neutral outcomes. (shrink)

In this paper, I argue that embodied cognition, like many other research traditions in cognitive science, offers mostly fallible research heuristics rather than grand principles true of all cognitive processing. To illustrate this claim, I discuss Aizawa’s rebuttal of embodied and enactive accounts of vision. While Aizawa’s argument is sound against a strong reading of the enactive account, it does not undermine the way embodied cognition proceeds, because the claim he attacks is one of fallible heuristics. These heuristics (...) may be helpful in developing models of cognition in an interdisciplinary fashion. I briefly discuss the issue of whether this fallibility actually makes embodied cognition vulnerable to charges of being untestable or non-scientific. I also stress that the historical approach to this research tradition suggests that embodied cognition is not poised to become a grand unified theory of cognition. (shrink)

3 Abstract This paper is about modeling morality, with a proposal as to the best 4 way to do it. There is the small problem, however, in continuing disagreements 5 over what morality actually is, and so what is worth modeling. This paper resolves 6 this problem around an understanding of the purpose of a moral model, and from 7 this purpose approaches the best way to model morality.

This is an excerpt from a report that highlights and explores five questions which arose from the workshop on perceptual learning and perceptual recognition at the University of Toronto, Mississauga on May 10th and 11th, 2012. This excerpt explores the question: What are the origins of multimodal associations?

While there has been significant philosophical debate on whether nonlinguistic animals can possess conceptual capabilities, less time has been devoted to considering 'talking' animals, such as parrots. When they are discussed, their capabilities are often downplayed as mere mimicry. The most explicit philosophical example of this can be seen in Brandom's frequent comparisons of parrots and thermostats. Brandom argues that because parrots (like thermostats) cannot grasp the implicit inferential connections between concepts, their vocal articulations do not actually have any conceptual (...) content. In contrast, I argue that Pepperberg's work with Alex (and other African grey parrots) provides evidence that the vocal articulations of at least some parrots have conceptual content. Using Frege's insight that numbers assert something about a concept, I argue that Alex's ability to answer the question "How many?" depended upon a prior grasp of conceptual content. Developing this claim, I argue that Alex's arithmetical abilities show that he was capable of using numbers as both concepts and objects. Frege's theoretical insight and Pepperberg's empirical work provide reason to reconsider the capabilities of parrots, as well as what sorts of tasks provide evidence for conceptual content. (shrink)

Analysing several characteristic mathematical models: natural and real numbers, Euclidean geometry, group theory, and set theory, I argue that a mathematical model in its final form is a junction of a set of axioms and an internal partial interpretation of the corresponding language. It follows from the analysis that (i) mathematical objects do not exist in the external world: they are our internally imagined objects, some of which, at least approximately, we can realize or represent; (ii) mathematical truths are not (...) truths about the external world but specifications (formulations) of mathematical conceptions; (iii) mathematics is first and foremost our imagined tool by which, with certain assumptions about its applicability, we explore nature and synthesize our rational cognition of it. (shrink)

My goal in this paper is to show that Kant’s prohibition on certain kinds of knowledge of things-in-themselves is motivated less by his anti-soporific encounter with Hume than by his new view of the distinction between “real” and “logical” modality, a view that developed out of his reflection on the rationalist tradition in which he was trained. In brief: at some point in the 1770’s, Kant came to hold that a necessary condition on knowing a proposition is that one be (...) able to prove that all the items it refers to are either really possible or really impossible. Most propositions about things-in-themselves, in turns out, cannot meet this condition. I conclude by suggesting that the best interpretation of this modal condition is as a kind of coherentist constraint. (shrink)

The option of being ‘spiritual but not religious’ deserves much more philosophical attention. That is the aim here, taking the work of Robert Solomon as a starting point, with focus on the particular issues around viewing life as gift. This requires analysis of ‘existential gratitude’ to show that there can be gratitude for things without gratitude to someone for providing things, and also closer attention to the role that metaphor plays in cognition. I consider two main concerns with gift (...) and gratitude thinking, that the nonreligious justification is too instrumentalist in its approach and that viewing life as gift, whether in a religious or nonreligious way, is simply too optimistic. (shrink)