This paper presents an analytical framework for analyzing how multimodal resources of emotion expression are semiotically materialized in discursive interactions specific to political discourse. Interested in how political personae are emotionally constructed through multimodal meaning-making practices, our analysis model assumes an interdisciplinary perspective, which integrates facial expression analysis – using FaceReader™ software –, the theory of emotional arcs and bodily actions (hand gestures) analysis that express emotions, in the analytical framework of multimodality. The results show how (...) the multimodal choices that political actors make during discursive interactions allow them to build their political brand and make connections with the audience on an emotional level. (shrink)

The analysis of multimodal argumentation in advertising is a crucial and problematic area of research. While its importance is growing in a time characterized by images and pictorial messages, the methods used for interpreting and reconstructing the structure of arguments expressed through verbal and visual means capture only isolated dimensions of this complex phenomenon. This paper intends to propose and illustrate a methodology for the reconstruction and analysis of “double-mode” arguments in advertisements, combining the instruments developed in social semiotics, (...) pragmatics, and argumentation theory. An advertisement is processed through a five-step path. The analysis of its context, text genre, and images leads to a first representation of the messages that it encodes both pictorially and verbally (step 1). These first semantic representations are further enriched by including their polyphonic articulations and presuppositions (step 2), their explicatures (step 3), and their dialogical functions and illocutionary forces (step 4). These pragmatic steps retrieve the commitment structure of the ad, which allows a further argument analysis conducted through argumentation schemes (step 5). (shrink)

The aim of this paper is to propose a new approach in the form of multimodality as a semiotic method that can be used by marketers and semioticians to induce online flow, a psychological state, on a brand website. First, we refer to multimodality as a semiotic analysis that can be used for a better optimization of semiotic resource sets in meaning-making, and we distinguish it from another similar concept: multimedia. Second, after a critical literature review, we address the flow (...) construct - a state of mind sometimes experienced by people who are deeply involved and immersed in some event, object or activity. Previous quantitative studies show a correlation between online flow experience and other variables such as design, content, sound and layout that are suggested to be its antecedents. In our study, these flow antecedents are viewed as sets of signs or modes that can be orchestrated in order to create different levels of perceived challenge for brand website users. We consider that multimodality can be used for a better optimization of these various meanings as expressed by modes that are "essentially different in nature" (Bateman, 2008, p.54). Also, we refer to the online marketing outcomes of the online flow experience, in order to outline its importance and its implications in the online environment. The main conclusion of our paper is that multimodality can be used by scholars and practitioners as a premise to induce online flow on a brand website, by optimizing the sets of signs or modes. Originality – our contribution consists of an interdisciplinary approach. We use concepts from semiotics, positive psychology, and online marketing for a better understanding of how marketers and semioticians can positively influence online customer behaviour. (shrink)

This paper explores how Wundt’s and Bühler’s respective conceptions of gestural expression have implications for how each conceives of what, in broad terms, may be understood as a ‘grammar of gestures’: that is, the rules for the formation and performance of gestures with and without speech. Unlike previous scholarship that has looked at the relationship of Wundt and Bühler, the aim here will be to give particular attention to the relevance of their respective accounts for current philosophical and linguistic (...) research on gesture. Building off of Bühler, we can offer an alternative to the psychologistic and solipsistic model of gestural expression that can be found in Wundt and that seems to be resurgent today in work by McNeil and others. Via Bühler’s notions of diacrisis and of the underlying functions that guide human communication, we propose an understanding of the relationship between gestures and speech that aims to render accurately both the highly contextualised and the highly structured conditions of their mutual employment. (shrink)

Brand image constitutes one of the most salient, over-defined, heavily explored and multifariously operationalized conceptual constructs in marketing theory and practice. In this Chapter, definitions of brand image that have been offered by marketing scholars will be critically addressed in the context of a culturally oriented discussion, informed by the semiotic notion of iconicity. This cultural bend, in conjunction with the concept’s semiotic contextualization, are expected both to dispel terminological confusions in the either inter-changeable or fuzzily differentiated employment of such (...) terms as brand image, symbol, icon, as well as to address the function of brand image at a deeper level than a mere construct to be operationalized in quantitative studies of purchase drivers. This shift in focus is coupled with a critical turn from the cogito-centric view of the consuming subject through the cognitivist lens of the AI metaphor as decision-making centre at the origin of largely conscious meaning-making, in favor of a psychoanalytically informed approach that considers figurativity as an essential process whereby brand image is formed. In these terms, brand image will be intimately linked to brand images as figurative multimodal expressive units and rhetorical tropes, as figurative syntax, that are responsible for shaping an idiolectal brand language, as well as to distinctive levels of iconicity as textual condition of possibility of a brand language. In order to understand the role of iconicity as fundamental condition of brand textuality, rather than just a procedure for spawning brand images, the discussion is contextualized in a wider framework involving the culturally situated source of brand images, how they become correlated with brand image concepts and how correlations between brand images and brand image result in brand knowledge structures (Keller 1998). This opening up of the discussion on iconicity is enacted against the background of what I call the Brand Imaginarium which involves: (i) a critical engagement with the dominant cognitivist perspective in branding research that prioritizes individual memory in brand knowledge formation, through a cultural branding lens that involves two additional types of memory, viz. communicative and cultural (ii) a critical engagement with the cognitivist perspective on brand knowledge formation that prioritizes conscious processing of stimuli (as ‘brute facts’, rather than as already semiotized expressive units) in a cognitive mechanism from which the faculty of imagination has been expelled, by restoring the importance of imagination in brand knowledge formation, and, concomitantly, by showing that the highly figurative language of brands may not be researched thoroughly unless imagination is posited anew as processing correlate (iii) the adoption of an expansionist approach to the role of the imaginary in brand knowledge formation, from cognitive (or psychic) faculty, to a more sociologically inclined process of inter-subjective mirroring, and concomitantly as imaginary social significations (Castoriades 1985) that are shared by culturally conditioned and habituated subjects that engage in meaningful cultural practices, rather than individual processing monads. (shrink)

The emerging crealectic frame posits that there are three complementary and effectual domains of intelligence, namely analytic, dialectic, and crealectic, being alternatively or complementarily used in human interactions with the world. The focus of crealectic intelligence is the relative possibilization and local realization of absolute possibility, the becoming real, biological, and social of creation. This multimodal externalization and asymptotic unification of a cosmological flux expresses itself via three realms of possibilization: physical, psychological, and philosophical. But the philosophical possible is (...) not merely abstract; it originates a generative process of exteriorizations, interiorizations, dissolutions, and unifications transforming the possible into realities. The term “crealectics,” coined by philosopher and author Luis de Miranda, is a compound of “Creal” and of two possible suffixes: “logos” or “ektos”. The ontological core of crealectics, the Creal, is the immanent process of creation understood as a ubiquitous stream of absolute possibility exteriorizing itself. For a crealectician, philosophy is not the mere logical analysis of truth conditions, but the self-questioning enterprise of thought regarding its own possibilizing and world-making power. (shrink)

We investigate an enrichment of the propositional modal language L with a "universal" modality ■ having semantics x ⊧ ■φ iff ∀y(y ⊧ φ), and a countable set of "names" - a special kind of propositional variables ranging over singleton sets of worlds. The obtained language ℒ $_{c}$ proves to have a great expressive power. It is equivalent with respect to modal definability to another enrichment ℒ(⍯) of ℒ, where ⍯ is an additional modality with the semantics x ⊧ ⍯φ (...) iff Vy(y ≠ x → y ⊧ φ). Model-theoretic characterizations of modal definability in these languages are obtained. Further we consider deductive systems in ℒ $_{c}$ . Strong completeness of the normal ℒ $_{c}$ logics is proved with respect to models in which all worlds are named. Every ℒ $_{c}$ -logic axiomatized by formulae containing only names (but not propositional variables) is proved to be strongly frame-complete. Problems concerning transfer of properties ([in]completeness, filtration, finite model property etc.) from ℒ to ℒ $_{c}$ are discussed. Finally, further perspectives for names in multimodal environment are briefly sketched. (shrink)

Within contemporary philosophy of perception, it is commonly claimed that flavour experiences are paradigmatic examples of multimodal perceptual experiences. In fact, virtually any sensory system, including vision and audition, is believed to influence how we experience flavours. However, there is a strong intuition, often expressed in these works, that not all of these sensory systems make an equal contribution to the phenomenology of flavour experiences. More specifically, it seems that the activities of some sensory systems are constitutive for flavour (...) perception while others merely influence how we experience flavours. This paper aims to answer the question regarding the constitutive factors of flavour perception in a twofold way. First, a theoretical framework is developed, relying on debates regarding constitutivity in analytic metaphysics and philosophy of science, which defines the stronger and weaker senses in which the activities of sensory systems may be constitutive for flavour perception. Second, relying on empirical results in flavour science, the constitutive status of activities related to distinct sensory systems in the context of flavour perception is investigated. (shrink)

Moore’s Paradox is a test case for any formal theory of belief. In Knowledge and Belief, Hintikka developed a multimodal logic for statements that express sentences containing the epistemic notions of knowledge and belief. His account purports to offer an explanation of the paradox. In this paper I argue that Hintikka’s interpretation of one of the doxastic operators is philosophically problematic and leads to an unnecessarily strong logical system. I offer a weaker alternative that captures in a more accurate (...) way our logical intuitions about the notion of belief without sacrificing the possibility of providing an explanation for problematic cases such as Moore’s Paradox. (shrink)

As historically acknowledged in the Reasoning about Actions and Change community, intuitiveness of a logical domain description cannot be fully automated. Moreover, like any other logical theory, action theories may also evolve, and thus knowledge engineers need revision methods to help in accommodating new incoming information about the behavior of actions in an adequate manner. The present work is about changing action domain descriptions in multimodal logic. Its contribution is threefold: first we revisit the semantics of action theory contraction (...) proposed in previous work, giving more robust operators that express minimal change based on a notion of distance between Kripke-models. Second we give algorithms for syntactical action theory contraction and establish their correctness with respect to our semantics for those action theories that satisfy a principle of modularity investigated in previous work. Since modularity can be ensured for every action theory and, as we show here, needs to be computed at most once during the evolution of a domain description, it does not represent a limitation at all to the method here studied. Finally we state AGM-like postulates for action theory contraction and assess the behavior of our operators with respect to them. Moreover, we also address the revision counterpart of action theory change, showing that it benefits from our semantics for contraction. (shrink)

In our everyday interactions we easily and effortlessly perceive emotions in others’ facial expressions and bodily behavior. How do we do that? Philosophers and psychologists have long argued about the fundamentals of emotion perception and the debate is far from settled. While some insist on the sufficiency of the morphological information contained in facial expressions, others construe the objects of emotion perception as more complex, comprising multimodal information such as touch, tone of voice, body postures, and so on. Others, (...) in turn, have gone so far as to deny that there is a pre-given object in emotion perception in the first place, so that processes of emotion perception must be conceptualized as emergent and co-constructed phenomena in contexts of social interaction. The purpose of this paper is to argue that John Dewey’s pragmatist theory of emotions can help us make significant theoretical advancements in the understanding of emotion perception, according to which emotions are coordinated modes of behavior that we enact with others in the contexts of social interactions. In this picture, perceiving emotions is a matter of participating in a joint activity of socio- affective coordination. This theory allows us to apprehend important insights about emotion perception that appear in these contemporary debates, while at the same time avoiding their pitfalls. (shrink)

This research article examines the potential of multimodal techniques in promoting inclusive practices in the English language classroom, delving into the multidisciplinary fields of English Language Teaching (ELT) and inclusive education. This study intends to investigate how multimodal resources, such as visual aids, technology, and creative activities, may be effectively integrated to meet the various learning needs of students using a pedagogical lens. This paper examines the theoretical underpinnings and practical implications of using multimodal approaches in ELT (...) settings, shedding light on their potential to promote inclusivity, engagement, and language acquisition among learners with diverse abilities and backgrounds. It does this through a thorough literature review and analysis of pedagogical frameworks. (shrink)

It is common to characterize pain with touch-related terms, like ‘cutting’, ‘pressing’, ‘sharp’, and ‘pulsing’, or temperature-related terms, like ‘hot’ or ‘burning’. This suggests that many pains are phenomenally multimodal because they are experienced as having some tactile-like or thermal-like character. The goal of this chapter is to investigate the structure of phenomenally multimodal pain experiences. It is argued that the usual accounts of multimodal structure proposed in investigations regarding exteroceptive experiences cannot be plausibly applied to (...) class='Hi'>multimodal experiences of pain. Instead, an alternative framework is proposed which characterizes the structure of tactile-like and thermal-like pains by referring to the notion of crossmodal correspondences. (shrink)

The aim of this paper is to argue that our experience of artworks is normally multimodal. It is the result of perceptual processing in more than one sense modality. In other words, multimodal experience of art is not the exception; it is the rule. I use the example of music in order to demonstrate the various ways in which the visual sense modality influences the auditory processing of music and conclude that this should make us look more closely (...) at our practices of engaging with artworks. (shrink)

What is the correct procedure for determining the contents of perception? Philosophers tackling this question increasingly rely on empirically-oriented procedures in order to reach an answer. I argue that this constitutes an improvement over the armchair methodology constitutive of phenomenal contrast cases, but that there is a crucial respect in which current empirical procedures remain limited: they are unimodal in nature, wrongly treating the senses as isolatable faculties. I thus have two aims: first, to motivate a reorientation of the admissible (...) contents debate into a multimodal framework, charting its various significances. The second is to explore whether any experimental studies of multimodal perception support a so-called Liberal (or ‘high-level’ or ‘rich’) account of perception’s admissible contents. I conclude that the McGurk effect and the ventriloquist effect are both explicable without the postulation of high-level content, but that at least one multimodal experimental paradigm may necessitate such content: the rubber hand illusion. One upshot of this argument is that Conservatives who claim that the Liberal view intolerably broadens the scope of perceptual illusions, particularly from the perspective of perceptual psychology, should pursue other arguments against that view. (shrink)

Expressivism’s central idea is that normative sentences bear the same relation to non-cognitive attitudes that ordinary descriptive sentences bear to beliefs: the expression relation. Allan Gibbard teIls us that “that words express judgments will be accepted by almost everyone” - the distinctive contribution of expressivism, his claim goes, is only a view about what kind of judgments words express. But not every account of the expression relation is equally suitable for the expressivist’s purposes. In fact, what I argue (...) in this paper, considering four possible accounts of expression, is that how suitable each account is for the expressivist’s purpose varies in proportion to how controversial it is. So Gibbard is wrong - if expression is to get expressivism off the ground, then it will be enormously controversial whether words do express judgments. And thus expressivism is committed to strong claims about the semantics of non-normative language. (shrink)

From the perspective of distributed cognition I will stress how abduction is essentially multimodal, in that both data and hypotheses can have a full range of verbal and sensory representations, involving words, sights, images, smells, etc., but also kinesthetic – related to the ability to sense the position and location and orientation and movement of the body and its parts – and motor experiences and other feelings such as pain, and thus all sensory modalities. The presence of kinesthetic and (...) motor aspects demonstrates that abductive reasoning can be manipulative. We can also see, in this regard, how implicit factors take part in the abductive procedure, which consequently acquires the character of a kind of “thinking through doing”. This paper further describes 1) the fact that hypotheses in science can be built through different cognitive mediators and so they can also model the same cognitive aspect in different ways; how they can be carriers/ producers of knowledge in a multimodal way; 2) the problem of the possible non-explanatory and instrumental nature of abductive reasoning and the analysis of the consequences for induction; 3) the role of manipulative abduction in building new evidence/ experiments and how they trigger smart inductive inferences. (shrink)

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: Are some of the basic units of consciousness multimodal?

This is an excerpt from a report that highlights and explores five questions which arose from the workshop on perceptual learning and perceptual recognition at the University of Toronto, Mississauga on May 10th and 11th, 2012. This excerpt explores the question: What are the origins of multimodal associations?

With a Call for Essays, the special issue Multimodality sought contributions that accept not only the material but also the body-bound dependence of media perception and understanding. To this end, contributions were included that shed light on both the structural and signifying potential of artistic works through multimodal analysis. Particular attention was paid to contributions that clarify how the structural features - the modes - of the arts, their perception, and their signifying potential in terms of content are interrelated (...) and how they are to be understood in communicative and thus socioculturally relevant terms. Thus, in addition to neuroscientific contributions, those from cultural anthropology, art history, image and art studies, and literary studies were included. -/- Articles -/- 8 Martina Sauer and Christiane Wagner - Introduction -/- 11 Giada Lombardi and Giuseppe Di Cesare - From Neuroscience to Art: The Role of ‘Vitality Forms’ in the Investigation of Multimodality -/- 25 Martina Sauer - Abstract - Affective – Multimodal: Interaction between Medium and Perception of Moving Images from the Viewpoint of Cassirer’s, Langer’s and Krois’ Embodiment Theories -/- 49 Göran Sonesson - The Secrets of Plastic Language Revealed: Multimodality, Polysemiosis, and Iconicity -/- 71 Natalia Igl - Making Sense of the Material: Multisensory Reader Involvement in Contemporary Multimodal Novels -/- 87 J. Philippe Thompson - Art is All: Proust’s Life Lessons Through Perception and Art -/- 107 Hans Dieter Huber - Philippe Parreno and the Exhibition as a Multimodal Aesthetic Experience -/- 135 Jörg U. Lensing - The Performing Human Being in a Media Interaction Space: Multi- and intermodal productions by the Düsseldorf Theater der Klänge (Theatre of Sounds) . (shrink)

According to an influential view about directed expressive duties (e.g., duties to express gratitude to benefactors, remorse to victims, forgiveness to wrongdoers), these duties do not have rights as their correlates, because they are not demandable and enforceable. The chapter argues that this view is mistaken. Like other directed duties, directed expressive duties are demandable and enforceable. While this does not entail that these duties have rights as their correlates, it does create a strong presumption of this being the case. (...) This shifts the burden of proof from those who hold that expressive duties correlate with rights to those who deny it. (shrink)

Both patients and clinicians frequently report problems around communicating and assessing pain. Patients express dissatisfaction with their doctors and doctors often find exchanges with chronic pain patients difficult and frustrating. This chapter thus asks how we could improve pain communication and thereby enhance outcomes for chronic pain patients. We argue that improving matters will require a better appreciation of the complex meaning of pain terms and of the variability and flexibility in how individuals think about pain. We start by examining (...) the various accounts of the meaning of pain terms that have been suggested within philosophy and suggest that, while each of the accounts captures something important about our use of pain terms, none is completely satisfactory. We propose that pain terms should be viewed as communicating complex meanings, which may change across different communicative contexts, and this in turn suggests that we should view our ordinary thought about pain as similarly complex. We then sketch what a view taking seriously this variability in meaning and thought might look like, which we call the “polyeidic” view. According to this view, individuals tacitly occupy divergent stances across a range of different dimensions of pain, with one agent, for instance, thinking of pain in a much more “bodycentric” kind of way, while another thinks of pain in a much more "mindcentric” way. The polyeidic view attempts to expand the multidimensionality recognised in, e.g., biopsychosocial models in two directions: first, it holds that the standard triumvirate— dividing sensory/cognitive/affective factors— needs to be enriched in order to capture important distinctions within the social and psychological dimensions. Second, the polyeidic view attempts to explain (at least in part) why modulation of experience by these social and psychological factors is possible in the first place. It does so by arguing that because the folk concept of pain is complex, different weightings of the different parts of the concept can modulate pain experience in a variety of ways. Finally, we argue that adopting a polyeidic approach to the meaning of pain would have a range of measurable clinical outcomes. (shrink)

Mental imagery is early perceptual processing that is not triggered by corresponding sensory stimulation in the relevant sense modality. Multimodal mental imagery is early perceptual processing that is triggered by sensory stimulation in a different sense modality. For example, when early visual or tactile processing is triggered by auditory sensory stimulation, this amounts to multimodal mental imagery. Pulling together philosophy, psychology and neuroscience, I will argue in this paper that multimodal mental imagery plays a crucial role in (...) our engagement with musical works. Engagement with musical works is normally a multimodal phenomenon, where we get input from a number of sense modalities. But even if we screen out any input that is not auditory, multimodal mental imagery will still play an important role that musicians and composers often actively rely on. (shrink)

Expressions of emotion pose a serious challenge to the view that we perceive other people’s emotions directly. If we must perceive expressions in order to perceive emotions, then it is only ever the expressions that we are directly aware of, not emotions themselves. This paper develops a new response to this challenge by drawing an analogy between expressions of emotion and perceptual media. It is through illumination and sound, the paradigmatic examples of perceptual media, that we can see and hear (...) objects around us. Instead of screening these objects from view, however, they enable our perception while being transparent to us. With reference to perceptual constancy and transparency, I show how expressions show up in our experience of emotions in a surprisingly similar way. Given this, we can understand expressions as the media _through_ which we perceive emotions and overcome the above challenge to an otherwise attractive view. (shrink)

Everyday media consumption leaves no doubt that the perception of moving images from various media is characterized by experience and understanding. Corresponding research in this field has shown that the stimulus patterns flooding in on us are not only processed mentally, but also bodily. Building on this, the following study argues that incoming stimuli are processed not only visually, but multimodally, with all senses, and moreover affectively. The classical binding of a sensory organ to a medium, on whose delimitation the (...) common understanding of multimodality is based, is thus abolished. Can arguments for this assumption be found? Building on the research of cultural anthropologist Ernst Cassirer and his successors, the two American philosophers Susanne K. Langer and John M. Krois, and supported by research from the life sciences in which, in parallel, the arts also play an important role in understanding image formation, as in the work of Heinz Werner and, following on from this, in the more recent research of the child psychologist Daniel N. Stern in collaboration with mirror neuron research by the group of neuroscientists around Giacomo Rizzolatti in Parma, justifications for this will be provided. What the multimodal processing of film images is concretely based on will finally be made clear by means of an exemplary analysis of a video film by the Swiss artist Pipilotti Rist. It aims to prove, that the prerequisites for the thesis can only lie in the fact, that both the modes of perception (visual, tactile, auditory, olfactory, gustatory) as well as the medially conditioned modes of image formation are based on non-discursive, formal-abstract structures that are also processed affectively. At the same time, the analysis thus shows how the selection and composition of the vital experienced forms can provide information about the socio-culturally shaped self-image of the producer and the viewer. (shrink)

It has been repeatedly suggested that synesthesia is intricately connected with unusual ways of exercising one’s mental imagery, although it is not always entirely clear what the exact connection is. My aim is to show that all forms of synesthesia are forms of (often very different kinds of) mental imagery and, further, if we consider synesthesia to be a form of mental imagery, we get significant explanatory benefits, especially concerning less central cases of synesthesia where the inducer is not sensory (...) stimulation. (shrink)

Kaplan (1999) argued that a different dimension of expressive meaning (“use-conditional”, as opposed to truth-conditional) is required to characterize the meaning of pejoratives, including slurs and racial epithets. Elaborating on this, writers have argued that the expressive meaning of pejoratives and slurs is either a conventional implicature (Potts 2007) or a presupposition (Macià 2002 and 2014, Schlenker 2007, Cepollaro and Stojanovic 2016). We argue that an expressive presuppositional theory accounts well for the data, but that expressive presuppositions are not just (...) propositions to be added to a common ground. We hold that expressives, including pejoratives and slurs, make requirements on a contextual record governed by sui generis norms specific to affective attitudes and their expressions. (shrink)

I argue for the possibility of an extremely intimate connection between the emotional content of the music and the emotional state of the person who produces that music. Under certain specified conditions, the music may not just influence, but also partially constitute the musician’s emotional state.

The concept of expression in the arts is Janus-faced. On the one hand expression is an author-centered notion: many Romantic poets, painters, and musicians thought of themselves as pouring our or ex-pressing their own emotions in their artworks. And on the other hand, expression is an audience-centered notion, the communication of what is expressed by an author to members of an audience. Typically the word “expression” is used for the author-centered aspect of expression as a (...) whole, and the word “expressiveness” is used for the audience-centered aspect, and I shall keep to this usage. In this paper I shall argue that although expression is closely related to expressiveness, the two concepts are distinct and, in particular, expressiveness cannot be analyzed in terms of expression, as has been recently suggested by Stephen Davies and Jerrold Levinson. Nonetheless, the richest examples of expression in the arts involve both expression and expressiveness. (shrink)

This paper proposes a semantics for free choice permission that explains both the non-classical behavior of modals and disjunction in sentences used to grant permission, and their classical behavior under negation. It also explains why permissions can expire when new information comes in and why free choice arises even when modals scope under disjunction. On the proposed approach, deontic modals update preference orderings, and connectives operate on these updates rather than propositions. The success of this approach stems from its capacity (...) to capture the difference between expressing the preferences that give rise to permissions and conveying propositions about those preferences. (shrink)

Many philosophers favour the simple knowledge account of assertion, which says you may assert something only if you know it. The simple account is true but importantly incomplete. I defend a more informative thesis, namely, that you may assert something only if your assertion expresses knowledge. I call this 'the express knowledge account of assertion', which I argue better handles a wider range of cases while at the same time explaining the simple knowledge account's appeal. §1 introduces some new data (...) that a knowledge account of assertion well explains. §2 explains the simple knowledge account's advantage over two of its main competitors. §3 presents a problem for the simple account and offers a solution, which is to adopt the express knowledge account. §4 encapsulates the case for the express knowledge account, and offers a unifying vision for the epistemology of belief and assertion. §5 answers an objection. §6 briefly sums up. Even those who ultimately reject my conclusion can still benefit from the new data presented in §1, and learn an important lesson from the problem discussed in §3, which demonstrates a general constraint on an acceptable account of the norm of assertion. (shrink)

Recent advances in neuroimaging technologies have rendered multimodal analysis of operators’ cognitive processes in complex task settings and environments increasingly more practical. In this exploratory study, we utilized optical brain imaging and mobile eye tracking technologies to investigate the behavioral and neurophysiological differences among expert and novice operators while they operated a human-machine interface in normal and adverse conditions. In congruence with related work, we observed that experts tended to have lower prefrontal oxygenation and exhibit gaze patterns that are (...) better aligned with the optimal task sequence with shorter fixation durations as compared to novices. These trends reached statistical significance only in the adverse condition where the operators were prompted with an unexpected error message. Comparisons between hemodynamic and gaze measures before and after the error message indicated that experts’ neurophysiological response to the error involved a systematic increase in bilateral dorsolateral prefrontal cortex (dlPFC) activity accompanied with an increase in fixation durations, which suggests a shift in their attentional state, possibly from routine process execution to problem detection and resolution. The novices’ response was not as strong as that of experts, including a slight increase only in the left dlPFC with a decreasing trend in fixation durations, which is indicative of visual search behavior for possible cues to make sense of the unanticipated situation. A linear discriminant analysis model capitalizing on the covariance structure among hemodynamic and eye movement measures could distinguish experts from novices with 91% accuracy. Despite the small sample size, the performance of the linear discriminant analysis combining eye fixation and dorsolateral oxygenation measures before and after an unexpected event suggests that multimodal approaches may be fruitful for distinguishing novice and expert performance in similar neuroergonomic applications in the field. (shrink)

Is it true that there is an analogy between modes of creation and such of perception? Respective to the cultural anthropological research of Ernst Cassirer, Susanne K. Langer and John M. Krois and by the analysis of a tape of the Swiss video-artist Pipilotti Rist this initial thesis of Formal Aesthetics shall be supported. - I - -/- Lässt sich die Behauptung stützen, dass zwischen Gestaltungsweisen und Wahrnehmungsweisen eine Analogie besteht? Aufbauend auf den kulturanthropologischen Forschungen von Ernst Cassirer, Susanne K. (...) Langer und John M. Krois sowie der Analyse eines Tapes der Schweizer Videokünstlerin Pipilotti Rist gilt es diese ursprünglich von der formalen Ästhetik aufgeworfene These zu untermauern. (shrink)

In this paper, the aim is to explore how there can be a role for expression of affect in illocution, drawing upon some ideas about expression put forward by Karl Bühler. In a first part of the paper, I map some active discussions and open questions surrounding phenomena that seem to involve “expression of affect”. Second, I home in on a smaller piece of that larger puzzle; namely, a consideration of how there may be non-conventional expression (...) of affect. I provide some examples of what I take that to involve and set out some premises for approaching it. In a third section, I motivate such an interest by pointing to a question in speech act theory concerning ‘force conventionalism’. This is whether and how illocution can be performed non-conventionally—that is, whether (at least some) utterances can be communicated with illocutionary force without need of convention. I propose that where expression of affect may occur non-conventionally, it may in turn constitute one important route through which at least some kinds of illocution are achieved. In the fourth part of the paper, I sketch an account of such non-conventional expression of affect for the purposes of illocution, by exploring a broadly Bühlerian account of some affects; namely, that some affects are teleological in character, that coordinations may be involved in their satisfactional states, and that uptake of the expressed affect constitutes one subset of such satisfactional states. That exposition points to the contemporary relevance of the “action theory of expression” proposed by Bühler. (shrink)

Many philosophers hold that punishment has an expressive dimension. Advocates of expressive theories have different views about what makes punishment expressive, what kinds of mental states and what kinds of claims are, or legitimately can be expressed in punishment, and to what kind of audience or recipients, if any, punishment might express whatever it expresses. I shall argue that in order to assess the plausibility of an expressivist approach to justifying punishment we need to pay careful attention to whether the (...) things which punishment is supposed to express are aimed at an audience. For the ability of any version of expressivism to withstand two important challenges, which I call the harsh treatment challenge’ and the ‘publicity challenge’ respectively. will depend on the way it answers them. The first of these challenges has received considerable discussion in the literature on expressive theories of punishment; the second considerably less. This is unfortunate. For careful consideration of the publicity challenge should lead us to favor a version of the expressive theory which has been under-discussed: the view on which punishment has an intended audience, and on which the audience is society at large, rather than—as on the most popular version of that view—the criminal. Furthermore, this view turns out to be better equipped to meet the harsh treatment challenge, and to be so precisely because of the way in which it meets the publicity challenge. (shrink)

Recent advances in neuroimaging technologies have rendered multimodal analysis of operators’ cognitive processes in complex task settings and environments increasingly more practical. In this exploratory study, we utilized optical brain imaging and mobile eye tracking technologies to investigate the behavioral and neurophysiological differences among expert and novice operators while they operated a human-machine interface in normal and adverse conditions. In congruence with related work, we observed that experts tended to have lower prefrontal oxygenation and exhibit gaze patterns that are (...) better aligned with the optimal task sequence with shorter fixation durations as compared to novices. These trends reached statistical significance only in the adverse condition where the operators were prompted with an unexpected error message. Comparisons between hemodynamic and gaze measures before and after the error message indicated that experts’ neurophysiological response to the error involved a systematic increase in bilateral dorsolateral prefrontal cortex (dlPFC) activity accompanied with an increase in fixation durations, which suggests a shift in their attentional state, possibly from routine process execution to problem detection and resolution. The novices’ response was not as strong as that of experts, including a slight increase only in the left dlPFC with a decreasing trend in fixation durations, which is indicative of visual search behavior for possible cues to make sense of the unanticipated situation. A linear discriminant analysis model capitalizing on the covariance structure among hemodynamic and eye movement measures could distinguish experts from novices with 91% accuracy. Despite the small sample size, the performance of the linear discriminant analysis combining eye fixation and dorsolateral oxygenation measures before and after an unexpected event suggests that multimodal approaches may be fruitful for distinguishing novice and expert performance in similar neuroergonomic applications in the field. (shrink)

Critics have argued that human-controlled avatar interactions fail to facilitate the kinds of expressivity and social understanding afforded by our physical bodies. We identify three claims meant to justify the supposed expressive limits of avatar interactions compared to our physical interactions. First, “The Limited Expressivity Claim”: avatars have a more limited expressive range than our physical bodies. Second, “The Inputted Expressivity Claim”: any expressive avatarial behaviour must be deliberately inputted by the user. Third, “The Decoding Claim”: users must infer or (...) figure out the expressive meaning of human-controlled avatars’ behaviour through cognitively onerous processes. With the aim of critically assessing all three claims, we analyze data collected through observations of and interviews with expert players of the avatar-based video game League of Legends. Focusing on Daniel Stern’s (2010) notion of vitality, we analyze the participants’ descriptions of seeing and interacting with other avatars during performance. Our analysis shows that the informants experience human-based avatarial interactions as qualitatively different than interactions with bots, that the informants see the movements of other players’ avatars as having different expressive styles, and that the informants actively use and manipulate this avatarial expressivity during performance. The results of our analysis, we argue, provide reasons for loosening or resisting the three claims concerning the limits of avatarial expressivity. (shrink)

In this paper, I argue that hate speech expresses hate, and answer some objections to expressivist views. First, I briefly comment on some limitations of pragmatic accounts of harmful speech. I then present an expressive-normative view of derogatory discourse according to which it is expressive of an affective state by presupposing it. A linguistic act expressive of an affective state inherits the normativity that is constitutive of that state, as directed to its intentional object. If the act is successful, it (...) updates the conversational context with the normative appraisal conditions of the affective state presupposed. I argue that this model can be applied to hate speech. I rely on current research on the psychology of hate to identify the appraisal conditions, action tendencies, and motivational goals characteristic of hate. The account supplements other pragmatic accounts of hate speech. (shrink)

I describe a phenomenon that has not yet been described in the epistemology literature. I label this phenomenon expression-style exclusion. Expression-style exclusion is an example of how s...

Ordinarily when someone tells us something about her beliefs, desires or intentions, we presume she is right. According to standard views, this deferential trust is justified on the basis of certain epistemic properties of her assertion. In this paper, I offer a non-epistemic account of deference. I first motivate the account by noting two asymmetries between the kind of deference we show psychological self-ascriptions and the kind we grant to epistemic experts more generally. I then propose a novel agency-based account (...) of deference. Drawing on recent work on self-knowledge, I argue that a person normally has a distinctive type of cognitive agency; specifically she is able to constitute her psychological attitudes by making judgments about what they ought to be. I then argue that a speaker expresses this agentive authority when she self-ascribes a psychological attitude and this is what justifies deferentially trusting what she says. Because the notion of expression plays a central role in this account, I contrast it with recent neo-expressivist theories. (shrink)

When an agent’s motivation is sensitive to how his supervisor thinks about the agent’s competence, the supervisor has to take into account both informational and expressive contents of her message to the agent. This paper shows that the supervisor can credibly express her trust in the agent’s ability only by being un- clear about what to do. Suggesting what to do, i.e., “directives,” could reveal the supervisor’s “distrust” and reduce the agent’s equilibrium effort level even though it provides useful information (...) about the decision environment. There is also an equilibrium in which directives are neutral in expressive content. However, it is shown that neologism proofness favors equilibria in which directives are double- edged swords. (shrink)

This chapter argues that Gilbert Ryle’s account of misleading expressions, which is rightly considered a milestone in the history of analytic philosophy, is continuous with Brentano’s. Not only did they identify roughly the same classes of misleading expressions, but their analyses are driven by a form of ontological parsimony which sharply contrasts with rival views in the Brentano School, like those of Meinong and Husserl. Section 1 suggests that Ryle and Brentano share a similar notion of analysis. Section 2 spells (...) out the notion of misleading expression by means of the surface-grammar/truth-conditions distinction, which I argue is implicit in their accounts. Section 3 zooms in on a specific class of misleading expressions, namely expressions about ficta. Finally, Section 4 draws the consequences of what precedes for a correct understanding of the notion of meaning. (shrink)

Some philosophers (Duff, Hampton) conceive of punishment as a way of communicating a message to the punished and argue that this communicative function justifies the harm of punishment. I object to communicative theories because punishment seems intuitively justified in cases in which it fails as a method of communication. Punishment fails as communication when the punished ignores the intended message or fails to understand it. Among those most likely to ignore or fail to understand the message of punishment are the (...) most hardened criminals, whom we typically think are appropriate targets of punishment. I suggest that an alternative justificatory strategy, one that focuses not on the successful receipt of the message of punishment by the wrongdoer but on the expression of condemnation by the community, is not subject to the same worry. The norms of successful expression are more easily met than those of communication, so that expressing condemnation toward a criminal might be justified even if he is unreceptive in the face of the expression. (shrink)

The U.S. election in November 2016 raised and amplified doubts about first-past-the-post (“plurality rule”) electoral systems. Arguments against plurality rule and for alternatives like preferential voting tend to be consequentialist: it is argued that systems like preferential voting produce different, better outcomes. After briefly noting why the consequentialist case against plurality rule is more complex and contentious than it first appears, I offer an expressive alternative: plurality rule produces actual or apparent dilemmas for voters in ways that are morally objectionable, (...) and avoidable under preferential voting systems. This expressive case against plurality rule is both simpler and more ecumenical than its consequentialist counterpart, and it provides strong reasons to prefer alternatives to plurality rule. Moreover, it suggests a distinct way of evaluating different alternatives like preferential voting. (shrink)

Scientific research is constrained by limited resources, so it is imperative that it be conducted efficiently. This paper introduces the notion of epistemic expression, a kind of representation that expedites the solution of research problems. Epistemic expressions are representations that (i) contain information in a way that enables more reliable information to place the most stringent constraints on possible solutions and (ii) make new information readily extractible by biasing the search through that space. I illustrate these conditions using historical (...) and contemporary examples of biomolecular structure determination. Then, I argue that the notion of epistemic expression parts ways with pragmatic accounts of scientific representation and an understanding of models as artifacts, neither of which require models to accurately represent. Explicating epistemic expression thus fills a gap in our understanding of scientific practice, extending Morrison and Morgan's (1999) conception of models as investigative instruments. (shrink)

We can know some things about each others' mental lives. The view that some of this knowledge is genuinely perceptual is getting traction. But the idea that we can see any of each others' mental states themselves - the Simple Perceptual Hypothesis - remains unpopular. Very often the view that we can perceptually know, for example, that James is angry, is thought to depend either on our awareness of James' expression or on the way James appears - versions of (...) what I call the Expressive Hypothesis. The Expressive Hypothesis is intuitive. But in this chapter I argue that it does not allow us to do away with the thought that we sometimes perceive people's mental states. I take my arguments to provide some tentative support for the Simple Perceptual Hypothesis. (shrink)

A speaker’s use of a sentence does more than contribute a content to a conversation. It also expresses the speaker’s attitude. This essay is about which attitude or attitudes are expressed by using an interrogative sentence to ask a question. With reference to eight lines of data about how questions are circulated in conversation, it is argued that a desire to know the question’s answer(s) is expressed.