The aim of this paper is to demonstrate the applicability of multivariate mapping techniques to the exploration of the rhetorical semiotic brand image structure of ad films. By drawing on correspondence analysis and multidimensional scaling, two techniques that are amply used in corpus linguistics and in marketing research, but also on the data reduction technique of factor analysis, it will be displayed how a set of nuclear semes and classemes or an intended semic structure that underlies ad filmic discursive (...) structures may be projected alongside rhetorical figures by its internal stakeholders (i.e., a brand management team, an account planning team or a marketing research team) with view to attaining differential brand associations. The illustration of the exploratory analytical methods takes place by recourse to a corpus of 62 ad filmic texts from 13 sub-brands of the 3 major brands in the UK cereals market and 321 ad filmic segments that resulted from the segmentation procedure. This paper seeks to contribute to advancements in the brand image and advertising rhetoric research streams by addressing distinctive modes of advertising rhetorical configuration at the level of the ad filmic text (as against print ads where the bulk of research on advertising rhetoric has concentrated), and moreover on a segment-by-segment level, rather than treating the ad film as a standalone unit of analysis, by adopting a multimodal outlook to advertising configurations that takes into account not only the verbal or the visual mode, but also interactions among modes, by adopting a product category-specific approach to advertising/brand textuality that draws on rhetorical semiotics and by employing exploratory statistical methods against the background of content analytic output. (shrink)

Brand Equity Planning with Structuralist Rhetorical Semiotics furnishes an innovative conceptual model and methodology for brand equity planning, with view to addressing a crucial gap in the marketing and semiotic literatures concerning how advertising multimodal textual elements may be transformed into brand associations, with an emphasis on rhetorical relata as modes of connectivity between a brand’s surface and depth grammar. The scope of this project is inter-disciplinary, spanning research areas such as brand equity, structuralist semiotics, (...) textual semiotics, visual and film semiotics, multimodal rhetoric, film theory, psychoanalysis. The proposed connectionist conceptual model of the brand trajectory of signification is operationalized through a methodological framework that encompasses a structuralist semiotic interpretative approach to the textual formation of brand equity, supported by quantitative content analysis with the aid of the software Atlas.ti and the application of multivariate mapping techniques. (shrink)

The aim of this paper is to outline a methodological framework for brand equity planning with structuralist rhetorical semiotics. By drawing on the connectionistconceptual model of the brand generative trajectory of signification it will be displayed in a stepwise fashion how a set of nuclear semes and classemes or anintended semic structure that underlies manifest discursive structures may be projected by its internal stakeholders with view to attaining differential brand associations. The suggested methodological framework focuses on the strength (...) and uniqueness of brand associations as integral aspects of a brand’s equity structure and comprises a set of calculi that aim at addressing from a brand textuality point of view how associations may be systematically linked to their key sources with an emphasis on the ad filmic text. The propounded methodology is exemplified by recourse to a corpus of ad filmic texts from the major brand players in the UK cereals market. The argumentative thrust is intent on demonstrating that structuralist rhetorical semiotics is not only useful for analysing/interpreting brand texts, but, moreover, for constructing and for managing them over time. This demonstration is deployed by adopting a synchronic/diachronic and intra--filmic/inter--filmic approach to the formation of brand associations that make up a projected brand equity structure, in the context of embedded product category dynamics. (shrink)

Semiotics has been making progressively inroads into marketing research over the past thirty years. Despite the amply demonstrated conceptual appeal and empirical pertinence of semiotic perspectives in various marketing research streams, spanning consumer research, brand communications, branding and consumer cultural studies, there has been a marked deficit in terms of consolidating semiotic brand-related research under a coherent disciplinary umbrella with identifiable boundaries and research agenda. -/- The Handbook of Brand Semiotics furnishes a compass for the perplexed, a set (...) of anchors for the inquisitive and a solid corpus for scholars, while highlighting the conceptual richness and methodological diversity of semiotic perspectives. -/- Written by a team of expert scholars in various semiotics and branding related fields, such as John A. Bateman, David Machin, Xavier Ruiz Collantes, Kay L. O’Halloran, Dario Mangano, George Rossolatos, Merce Oliva, Per Ledin, Gianfranco Marrone, Francesco Mangiapane, Jennie Mazur, Carlos Scolari, Ilaria Ventura, and edited by George Rossolatos, Chief Editor of the International Journal of Marketing Semiotics, the Handbook is intended as a point of reference for researchers who wish to enter the ‘House of Brand Semiotics’ and explore its marvels. -/- The Handbook of Brand Semiotics, actively geared towards an inter-disciplinary dialogue between perspectives from marketing and semiotics, features the state-of-the-art, but also offers directions for future research in key streams, such as: -/- · Analyzing and designing brand language across media · Brand image, brand symbols, brand icons vs. iconicity · The contribution of semiotics to transmedia storytelling · Narrativity and rhetorical approaches to branding · Semiotic roadmap for designing brand identity · Semiotic roadmap for designing logos and packaging · Sociosemiotic accounts of building brand identity online · Multimodality and Multimodal critical discourse analysis · Challenging the omnipotence of cognitivism in brand- related research · Semiotics and (inter)cultural branding · Brand equity semiotics Comparative readings of structuralist, Peircean and sociosemiotic approaches to brandcomms . (shrink)

This paper presents an analytical framework for analyzing how multimodal resources of emotion expression are semiotically materialized in discursive interactions specific to political discourse. Interested in how political personae are emotionally constructed through multimodal meaning-making practices, our analysis model assumes an interdisciplinary perspective, which integrates facial expression analysis – using FaceReader™ software –, the theory of emotional arcs and bodily actions (hand gestures) analysis that express emotions, in the analytical framework of multimodality. The results show how the (...) class='Hi'>multimodal choices that political actors make during discursive interactions allow them to build their political brand and make connections with the audience on an emotional level. (shrink)

Brand image constitutes one of the most salient, over-defined, heavily explored and multifariously operationalized conceptual constructs in marketing theory and practice. In this Chapter, definitions of brand image that have been offered by marketing scholars will be critically addressed in the context of a culturally oriented discussion, informed by the semiotic notion of iconicity. This cultural bend, in conjunction with the concept’s semiotic contextualization, are expected both to dispel terminological confusions in the either inter-changeable or fuzzily differentiated employment of such (...) terms as brand image, symbol, icon, as well as to address the function of brand image at a deeper level than a mere construct to be operationalized in quantitative studies of purchase drivers. This shift in focus is coupled with a critical turn from the cogito-centric view of the consuming subject through the cognitivist lens of the AI metaphor as decision-making centre at the origin of largely conscious meaning-making, in favor of a psychoanalytically informed approach that considers figurativity as an essential process whereby brand image is formed. In these terms, brand image will be intimately linked to brand images as figurative multimodal expressive units and rhetorical tropes, as figurative syntax, that are responsible for shaping an idiolectal brand language, as well as to distinctive levels of iconicity as textual condition of possibility of a brand language. In order to understand the role of iconicity as fundamental condition of brand textuality, rather than just a procedure for spawning brand images, the discussion is contextualized in a wider framework involving the culturally situated source of brand images, how they become correlated with brand image concepts and how correlations between brand images and brand image result in brand knowledge structures (Keller 1998). This opening up of the discussion on iconicity is enacted against the background of what I call the Brand Imaginarium which involves: (i) a critical engagement with the dominant cognitivist perspective in branding research that prioritizes individual memory in brand knowledge formation, through a cultural branding lens that involves two additional types of memory, viz. communicative and cultural (ii) a critical engagement with the cognitivist perspective on brand knowledge formation that prioritizes conscious processing of stimuli (as ‘brute facts’, rather than as already semiotized expressive units) in a cognitive mechanism from which the faculty of imagination has been expelled, by restoring the importance of imagination in brand knowledge formation, and, concomitantly, by showing that the highly figurative language of brands may not be researched thoroughly unless imagination is posited anew as processing correlate (iii) the adoption of an expansionist approach to the role of the imaginary in brand knowledge formation, from cognitive (or psychic) faculty, to a more sociologically inclined process of inter-subjective mirroring, and concomitantly as imaginary social significations (Castoriades 1985) that are shared by culturally conditioned and habituated subjects that engage in meaningful cultural practices, rather than individual processing monads. (shrink)

The cultural consumption research landscape of the 21st century is marked by an increasing cross-disciplinary fermentation. At the same time, cultural theory and analysis have been marked by successive ‘inter-’ turns, most notably with regard to the Big Four: multimodality (or intermodality), interdiscursivity, transmediality (or intermediality), and intertextuality. This book offers an outline of interdiscursivity as an integrative platform for accommodating these notions. To this end, a call for a return to Foucault is issued via a critical engagement with the (...) so-called practice-turn. This re-turn does not seek to reconstitute venerably Foucauldianism, but to theorize ‘inters-’ as vanishing points that challenge the integrity of discrete cultural orders in non-convergent manners. The propounded interdiscursivity approach is offered as a reading strategy that permeates the contemporary cultural consumption phenomena that are scrutinized in this book, against a pan-consumptivist framework. By drawing on qualitative and mixed methods research designs, facilitated by CAQDAS software, the empirical studies that are hosted here span a vivid array of topics that are directly relevant to both traditional and new media researchers, such as the consumption of ideologies in Web 2.0 social movements, the ability of micro-celebrities to act as cultural game-changers, the post-loyalty abjective consumption ethos. The theoretically novel approaches on offer are coupled with methodological innovations in areas such as user-generated content, artists’ branding, and experiential consumption. (shrink)

The aim of this paper is to propose a new approach in the form of multimodality as a semiotic method that can be used by marketers and semioticians to induce online flow, a psychological state, on a brand website. First, we refer to multimodality as a semiotic analysis that can be used for a better optimization of semiotic resource sets in meaning-making, and we distinguish it from another similar concept: multimedia. Second, after a critical literature review, we address the flow (...) construct - a state of mind sometimes experienced by people who are deeply involved and immersed in some event, object or activity. Previous quantitative studies show a correlation between online flow experience and other variables such as design, content, sound and layout that are suggested to be its antecedents. In our study, these flow antecedents are viewed as sets of signs or modes that can be orchestrated in order to create different levels of perceived challenge for brand website users. We consider that multimodality can be used for a better optimization of these various meanings as expressed by modes that are "essentially different in nature" (Bateman, 2008, p.54). Also, we refer to the online marketing outcomes of the online flow experience, in order to outline its importance and its implications in the online environment. The main conclusion of our paper is that multimodality can be used by scholars and practitioners as a premise to induce online flow on a brand website, by optimizing the sets of signs or modes. Originality – our contribution consists of an interdisciplinary approach. We use concepts from semiotics, positive psychology, and online marketing for a better understanding of how marketers and semioticians can positively influence online customer behaviour. (shrink)

The analysis of multimodal argumentation in advertising is a crucial and problematic area of research. While its importance is growing in a time characterized by images and pictorial messages, the methods used for interpreting and reconstructing the structure of arguments expressed through verbal and visual means capture only isolated dimensions of this complex phenomenon. This paper intends to propose and illustrate a methodology for the reconstruction and analysis of “double-mode” arguments in advertisements, combining the instruments developed in social (...) class='Hi'>semiotics, pragmatics, and argumentation theory. An advertisement is processed through a five-step path. The analysis of its context, text genre, and images leads to a first representation of the messages that it encodes both pictorially and verbally (step 1). These first semantic representations are further enriched by including their polyphonic articulations and presuppositions (step 2), their explicatures (step 3), and their dialogical functions and illocutionary forces (step 4). These pragmatic steps retrieve the commitment structure of the ad, which allows a further argument analysis conducted through argumentation schemes (step 5). (shrink)

A comprehensive account of Peirce's third branch of semiotic--universal or speculative rhetoric. The article places Peirce's work in the context of the rhetorical tradition. Unlike the direction that analytic and positivist philosophy took, Peirce does not separate logic and rhetoric. Instead Peirce uses his novel theory of rhetoric to show how logic and scientific investigation is tied to a cooperative community of inquiry.

With a Call for Essays, the special issue Multimodality sought contributions that accept not only the material but also the body-bound dependence of media perception and understanding. To this end, contributions were included that shed light on both the structural and signifying potential of artistic works through multimodal analysis. Particular attention was paid to contributions that clarify how the structural features - the modes - of the arts, their perception, and their signifying potential in terms of content are interrelated (...) and how they are to be understood in communicative and thus socioculturally relevant terms. Thus, in addition to neuroscientific contributions, those from cultural anthropology, art history, image and art studies, and literary studies were included. -/- Articles -/- 8 Martina Sauer and Christiane Wagner - Introduction -/- 11 Giada Lombardi and Giuseppe Di Cesare - From Neuroscience to Art: The Role of ‘Vitality Forms’ in the Investigation of Multimodality -/- 25 Martina Sauer - Abstract - Affective – Multimodal: Interaction between Medium and Perception of Moving Images from the Viewpoint of Cassirer’s, Langer’s and Krois’ Embodiment Theories -/- 49 Göran Sonesson - The Secrets of Plastic Language Revealed: Multimodality, Polysemiosis, and Iconicity -/- 71 Natalia Igl - Making Sense of the Material: Multisensory Reader Involvement in Contemporary Multimodal Novels -/- 87 J. Philippe Thompson - Art is All: Proust’s Life Lessons Through Perception and Art -/- 107 Hans Dieter Huber - Philippe Parreno and the Exhibition as a Multimodal Aesthetic Experience -/- 135 Jörg U. Lensing - The Performing Human Being in a Media Interaction Space: Multi- and intermodal productions by the Düsseldorf Theater der Klänge (Theatre of Sounds) . (shrink)

In lieu of an abstract, here is a brief excerpt of the content: There is an abundance of scholarship on John Dewey. Dewey's writings are vast, so scholars try to find the crux that connects their many themes into a distinctive vision for philosophy and life. Many claim that the democratic way of life is the center of Dewey's philosophical vision. Others claim that Dewey's response to Darwin was the impetus for a philosophical experimentalism that could envision a better life (...) by responding to the needs in an age of modern industry. Some claim that the crux is a dynamic and non-mechanistic naturalism that Dewey develops to critically undo the dualisms of tradition, most especially the distinction between nature and culture. There has even been an effort to interpret each of these themes within Dewey's theory about the conditions for aesthetics in life, the life of art within an experience, and an experience of life as art. Arguably, no strategy is more preferable than another because each is plausible. Each plausibly selects a crux that connects the many themes across an array of writings, since Dewey's philosophy is multimodal by design and shuns reductionism for pluralism. Even amidst plurality, through many modes of activity and existence, each of these themes and all of Dewey's writings have a concern for meaning in life and how life is a process of meaning-making. And yet, meaning, for Dewey, is irreducible to verbal or written language and is made by more than propositions, but extends beyond the divide of nature and culture to potentially encompass all of life and life's processes. This expansive conception of meaning has more in common with semiotics, especially those of Charles Sanders Peirce, than any philosophy of language. And yet almost no scholar has sought to semiotically interpret Dewey's philosophy as a whole. Perhaps, though, Dewey's multimodal and pluralistic vision for philosophy and life also has a semiotic crux that intersects with the others in ways that are fundamentally important. There are scholars who have dealt with semiotic themes or insights with implications for semiotics in Dewey's writings. None have sought to semiotically interpret Dewey's philosophy as a whole, or, as a consequence, to chronologically survey Dewey's writings to determine if there is a conceivably Deweyan approach to semiotics that might contrast with or contribute to the more dominant approaches. There is a reason scholars may not have sought a Deweyan approach to semiotics. Dewey did not have an explicit theory of semiotics. There is no attempt to devise a doctrine of signs in Dewey's writings. Never did Dewey try to classify the fundamental types of sign, analyze the relations of signification by which they differ, or methodically explain how the logic of signification works. This contrasts sharply with Charles Sanders Peirce. Peirce has an explicit theory of semiotics that divides the fundamental types of sign into icons, indices, and symbols by their distinct relations of signification that are at work in the logic of inference by the categories. During his second year at Johns Hopkins, Dewey was actually Peirce's student in a class on logic. This already suggests the possibility of influence. Dewey's writings around 1883 even espouse the central thesis of Peirce's semiotics. All signs, however else their significations may differ, are triadic relations for both Peirce and Dewey. Whether and how far Peirce's logic was an influence on Dewey at Johns... (shrink)

What is the difference between a game and life? Is the game really ending when we go back to our everyday activities? Or could The Sims video game not be a good representation of our existence? It is with these questions in mind that I decided to explore the interdependence that exists between our everyday cultural reality and the rhetoric manifesting itself in video games. This paper introduces some of the key concepts used in the semiotics of video games (...) and attempts to articulate them in a single frame. It is a short introduction to storyworlds, procedural rhetoric and gamespace. (shrink)

This paper analyzes transduction as an action of transposing information from one mode to another within the communication process and its implications in terms of meaning and coherence of a multimodal message. First, I discuss the multimodal method and its conjunction with some key concepts such as: sign, meaning, mode, transduction. Secondly, I approach transduction as an essential method of translating messages across the media variety, describing my interdisciplinary approach – that brings together semiotics and communications – (...) and proposing a framework of explanation for transduction in the field of advertising. Drawing from a previous model (Culache 2015), I illustrate the way transduction takes place and identify its meaning-making issues while introducing the concept of ‘dominant mode.’. (shrink)

The cultural practice of flirtation has been multifariously scrutinized in various disciplines including sociology, psychology, psychoanalysis and literary studies. This paper frames the field of flirtation in Bourdieuian terms, while focusing narrowly on the semiotic economy that is defining of this cultural field. Moreover, seduction, as a uniquely varied form of discourse that is responsible for producing the cultural field of flirtation, is posited as the missing link for understanding why flirtation may be a peculiar case of non-habitus, contrary to (...) the received notion of cultural field as set of goaloriented practices and actionable habituses. This argument is pursued by highlighting the endemic traits of ambivalence and constant reversibility of signs or multimodal semiotic constellations in the discourse of seduction, while seeking to demonstrate that seduction, and by implication the cultural field of flirtation, does not necessarily partake of a teleological framework that is geared towards the consummation of sexual desire. This thesis is illustrated by recourse to a scene from the blockbuster ‘Hitch’. (shrink)

Note: This draft was updated on November 10, 2020. Discussing federal statutes, Justice Scalia tells us that “[t]he stark reality is that the only thing that one can say for sure was agreed to by both houses and the president (on signing the bill) is the text of the statute. The rest is legal fiction." How should we take this claim? If we take "text" to mean the printed text, that text without more is just a series of marks. If (...) instead we take "text" (as we must) to refer to something off the page such as the "meaning" of the series of marks at issue, what is that meaning and how do we know that all the legislators "agreed" on that "meaning"? In seeking answers here, we necessarily delve into semiotics (i.e., the “general theory of signs”) by noting that meaningful ink marks ("signifiers) signify a meaning beyond themselves (the "signified.") Thus, understanding how signs function is integral to lawyers' textual and linguistic analysis. Additionally, as this article demonstrates, legal analysis and rhetoric are much impoverished if lawyers ignore nonverbal signs such as icons, indices, and nonverbal symbols. In providing a broad overview of semiotics for lawyers, this article thus (1) begins with a general definition of signs and the related notion of intentionality. It then turns to, among other things, (2) the structure and concomitants of signs in more detail (including the signifier and the signified), (3) the possible correlations of the signifier and the signified that generate signs of interest to lawyers such as the index, the icon, and the symbol; (5) the expansion of legal rhetoric through use of the index, the icon, and the non-verbal as well as the verbal symbol, (6) the nature of various semiotic acts in public and private law (including assertives, commissives, directives, and verdictives); (7) the interpretation and construction of semiotic acts (including contracts as commissives and legislation as directives); (8) the role of speaker or reader meaning in the interpretation and construction of semiotic acts; (9) the semiotics of meaning, time, and the fixation of meaning debate; (10) the impact of signifier drift; (11) the distinction between sense and understanding; and (12) some brief reflections on semiotics and the First Amendment. This article also provides an Appendix of further terms and concepts useful to lawyers in their explorations of semiotics. (shrink)

Writing and genre scholarship has become increasingly attuned to how various nontextual features of written genres contribute to the kinds of social actions that the genres perform and to the activities that they mediate. Even though scholars have proposed different ways to account for nontextual features of genres, such attempts often remain undertheorized. By bringing together Writing, Activity, and Genre Research, and Multimodal Interaction Analysis, the authors propose a conceptual framework for multimodal activity-based analysis of genres, or (...) class='Hi'>Multimodal Writing, Activity, and Genre (MWAG) analysis. Furthermore, by drawing on previous studies of the laboratory notebook (lab book) genre, the article discusses the rhetorical action the genre performs and its role in mediating knowledge construction activities in science. The authors provide an illustrative example of the MWAG analysis of an emergent scientist’s lab book and discuss its contributions to his increasing participation in medical physics. The study contributes to the development of a theoretically informed analytical framework for integrative multimodal and rhetorical genre analysis, while illustrating how the proposed framework can lead to the insights into the sociorhetorical roles multimodal genres play in mediating such activities as knowledge construction and disciplinary enculturation. (shrink)

Making Sense of Messages Making Sense of Messages, now in its second edition, retains the apprenticeship approach which facilitates effectively learning the complex content and skills of rhetorical theory and criticism. A new chapter on “The Rhetoric of Ignorance” provides needed theory and examples that help students deal with the new rhetorical landscape marked by such discursive complexities as “fake news,” “whataboutism,” and denial of science that creates rather than reduces uncertainty in public argument. A new chapter, “Curating (...) and Analyzing Multimodal Mediated Rhetoric,” deals with problems of media criticism in the digital age. It provides theory, models of application, and commentary that help novice critics understand and rnindfully practice criticism that leads to insight, not mere opinion. Throughout the book, extended and updated examples and commentaries are designed to promote “novice—to—expert” agency in students. This textbook is ideal for introductory courses in contemporary rhetoric, rhetorical criticism, and critical analysis of mass media. Mark Stoner is Professor Emeritus of Communication Studies University, Sacramento. at California State. (shrink)

The paper aims at disclosing the process of writer identity enactive construal in narrative writing. Three constituent parts of identity discoursal construction in the narrative are social semiotics as a reflection of the social environment, cultural identity theory as the embodiment of cultural choices and preferences, and pragmatics (Charles S. Peirce). The following research questions have been formulated: (1) What is the nature of identity construction? (2) What rhetorical factors influence identity construal in narrative discourse? By providing a (...) step-by-step analysis of thematic structure, the paper conducts a discourse analysis of narrative episodes in terms of Agent, Process, and Medium triad (Halliday, 1973), reflecting the mechanisms of reader’s manipulation with information as a dynamic semiotic process of interpretation, limited by a final interpretant. (shrink)

Commas can splice our sentences, and shift their connotations. Our mixed modes for hyphens compound our words as well as confuse them—even dash them to pieces. In written language, how can we know we are asking a question unless we use the proper punctuation? Punctuation is vital to how we communicate. Whether in speech or prose, we punctuate our thoughts. In this sense, we may classify punctuation among what John Wesley calls “God’s many providences” in the sermon “The One Thing (...) Needful” (1733): “designed either to wean us from what is not, or to unite us to what is worthy of our affection. Are they pleasing? Then they are designed to lift up our hearts to the Parent of all good. Are they painful?” Wesley again answers rhetorically, “Then they are means of rooting out those passions that forcibly withhold us from [God]” (§II.4). Indeed, punctuation espouses varied ‘pleasing’ and/or ‘pleasant’ responses. Rather than merely forcing the point that our punctuation carries meaning—either in addition to or against that which we otherwise intend—I want to suggest that the poetry, prose, and other linguistic media/mediums within our liturgies innately possess meaning(s) which we have the opportunity to punctuate (i.e., ‘consecrate’ or ‘sanctify’) as faith communities or else surrender to the individualisms of our so-called (post)modern preferential interpretations: our proverbial run-on sentence protracting philosophical discussions amid this (in)definite period of change we acutely sense but struggle to describe. We are not God’s grammar police. For our part, however, faith communities and their leaders can and must more dutifully approach the task of shaping the nature, meaning, and purpose of our liturgies as truly corporate worship, not as mere collections of thoughts, words, and actions expressed by individuals more or less simultaneously. (shrink)

Charles S. Peirce’s semiotics uniquely divides signs into: i) symbols, which pick out their objects by arbitrary convention or habit, ii) indices, which pick out their objects by unmediated ‘pointing’, and iii) icons, which pick out their objects by resembling them (as Peirce put it: an icon’s parts are related in the same way that the objects represented by those parts are themselves related). Thus representing structure is one of the icon’s greatest strengths. It is argued that the implications (...) of scaffolding education iconically are profound: for providing learners with a navigable road-map of a subject matter, for enabling them to see further connections of their own in what is taught, and for supporting meaningful active learning. Potential objections that iconic teaching is excessively entertaining and overly susceptible to misleading rhetorical manipulation are addressed. (shrink)

In this paper, translation engages not only with metaphors, but the ‘consistent multiplicity’ (Alliez & Feher 1986: 41) of figures of speech that intersemiotically animate Australian artist Brett Whiteley’s (1939-92) verbal and pictorial language. The aim is to address some ‘formative questions […] concerning language, medium and meaning’ (Harrison 2004: 5) by studying the rhetoric devices featuring in two texts: a letter written by Whiteley to his mother in 1979, and the painting Art, life and the other thing (1978). The (...) letter and the painting intersect in a series of hypertextual links, and map language nomadism across words and images. The comparative analysis of Whiteley’s painting and letter displays that the translating process is deeply influenced and sometimes completely transformed by the concurrence of heterogeneous elements. Pictures and words relate to each other: when translation enters, the text is completed. (shrink)

This thesis is concerned with the ways in which meaning is generically mediated in the novel. In particular it addresses the productive diversity of meanings generated by critical interpretation and asks how, given this diversity, comprehension and consensus might be possible. I argue that the construction of subject, object, space and time is achieved in the novel through different manifestations of four key metaphors: voice, view, setting and event. These metaphors supply meanings that rely on a common experience of embodiment. (...) Embodiment supplies the basis for an intersubjectively established consensus which identifies subjects and objects in terms that correspond to the semiotic, syntagmatic and semantic uses of metaphor. I begin by surveying and reviewing certain constructionist accounts of language and meaning in order to establish the importance of metaphor in conveying meaning in rhetorical, rather than linguistic, terms. I then discuss two examples of continental philosophy on speech: Derrida on voice and Foucault on discourse. I demonstrate how meaning is rhetorically constructed according to the use to which metaphors are put—whether they denote formal, semantic, or functional aspects of meaning—through an explication of Foucault’s theory, reserving Derrida’s grammatology for my analysis of the stabilisation of meaning in the theory of certain narratologists (Gérard Genette and Marie-Laure Ryan). Voice and view are key terms in literary theory, and I examine refinements to these metaphors in Genette and Ryan. The insistence of these narratologists on restricting the rhetorical dimension of meaning undermines the value of the literary work, prompting me to argue for a relaxing of such constraints. I read Peter Carey’s True History of the Kelly Gang for its uses of voice and point of view, many of which expose the limitations of the narratological approach. This is a theoretical thesis, which engages a wide range of perspectives—constructionist, deconstructionist, sociological and structuralist—together with their various accounts of language, metaphor, speech and meaning. In terms of sociological approaches to genre and discourse, I employ the chronotope as a critical tool, examining it in the context of the theme of the country house to demonstrate the role of two of my key metaphors, setting and event, which are important for the construction of space and time in abstract terms. Focusing on novels by Jane Austen, Virginia Woolf, and Kazuo Ishiguro, in which the country house defines the space and the temporality through which thematic and “material” elements are mediated, I reveal how the chronotope supplies an overarching coherence that unites thought and event in narrative. My readings of these novels describe a theory that is concerned with the rhetorical capacities of genre rather than with taxonomic constructions of form. To this end I argue that the metaphorical dimensions of narrative—voice, view, setting and event—be loosely drawn, according to the acknowledged mutability of genre. I also emphasise the constructive effect of metaphor whilst according it a rhetorical versatility consistent with the mutability and instability of genre as a semiotic tool, concluding that consensus is achieved in our readings of novels through the form’s reliance on these four key metaphors of embodiment. These metaphors have ordinary, everyday, widespread usage beyond narrative theory; in appreciating their rhetorical value, it must be noted nonetheless that any confusion that ensues is productive, for it results in the diversities of meaning and form celebrated in the literary work. (shrink)

What is the class of possible semiotic systems? What kinds of systems could count as such systems? The human mind is naturally considered the prototypical semiotic system. During years of research in semiotics the class has been broadened to include i.e. living systems like animals, or even plants. It is suggested in the literature on artificial intelligence that artificial agents are typical examples of symbol-processing entities. It also seems that semiotic processes are in fact cognitive processes. In consequence, it (...) is natural to ask the question about the relation between semiotic studies and research on artificial cognitive systems within cognitive science. Consequently, my main question concerns the problem of inclusion or exclusion from the semiotic spectrum at least some artificial systems. I would like to consider some arguments against the possibility of artificial semiotic systems and I will try to repeal them. Then I will present an existing natural-language using agent of the SNePS system and interpret it in terms of Peircean theory of signs. I would like also to show that some properties of semiotic systems in Peircean sense could be also found in a discussed artificial system. Finally, I will have some remarks on the status of semiotics in general. (shrink)

This article contributes to the debate on the relationship between marketing and propaganda through an analysis of social marketing as a mode of governing in permanent campaigning. The working hypothesis is that social marketing operations are agitational rather than propagandistic. The conceptual approach stems from a comparison of propaganda and marketing with Fordist and post-Fordist modes of production and governance. The research into the role of agitation involves an empirical study of the UK government campaign against benefit fraud, the most (...) expensive of its kind. Using a combination of methodologies, the political context is framed through a discourse analysis that charts the historical emergence of the problem of benefit fraud and the material effects of this discourse on welfare spending allocation, content analysis is used to identify correspondences between different newspapers’ rhetoric and policy under different governments, and semiotic analysis helps to decode the message of the campaign against benefit fraud, as it relates to the overall government’s strategy on this issue. The study offers insights into the political strategy of the government of New Labour between 1997 and 2010 and its resort to agitational techniques, exposing the limitations of government marketing and public relations in the context of an overall crisis of its political legitimacy, in both economic and political terms. (shrink)

Even if one sees the law as “a self-contained system of legal reasoning” from which we deduce “neutral,” non-political conclusions from “general principles and analogies among cases and doctrines” (including formalist claims that judges simply call “balls and strikes” like umpires in a baseball game), one should still consider certain characteristics of the party making such deductions or calling such “balls and strikes.” [Relevant citations to quoted language are in the Article.] If such decision maker has questionable motivations, lacks proper (...) perspective, does not grasp the flexibility in the concepts in play, does not grasp the restraints on concepts in play, does not follow the proper processes involved, and lacks the detail, courage, and tenacity needed to reach the proper “deduction” or “call,” on the face of things the formalist, too, should have reason to re-examine any “deduction” or “call” by such party. Thus, even the formalist should not deny the critical role of virtue when examining legal analysis, a role belying the notion of law as a "self-contained system of legal reasoning." -/- This Article thus explores basic freedoms and restraints applicable to legal analysis and the role that virtue plays in balancing such freedoms and restraints. Such exploration covers: (i) the origin, nature, and purpose of concepts and categories used in legal analysis; (ii) the experiential nature of the meaning of such concepts and categories used in legal analysis; (iii) the freedoms and restraints applicable to such concepts and categories as a result of either experience or of the concepts or categories themselves; (iv) how workable notions of virtue rightly balance such freedoms and restraints in legal analysis; (v) the distinction between such virtue and skill; (vi) reconceiving the analytically virtuous mean as a proper balance between such applicable freedoms and restraints; and (vii) defining and surveying the particular virtues that lead us to such proper balance and thus to good legal analysis. My hope is that lawyers and law schools in their curricula will follow such explorations as well in a quest to better understand legal analysis and how to teach and perform it well. (shrink)

The main goal of the paper is to present a putative role of consciousness in language capacity. The paper contrasts the two approaches characteristic for cognitive semiotics and cognitive science. Language is treated as a mental phenomenon and a cognitive faculty. The analysis of language activity is based on the Chalmers’ distinction between the two forms of consciousness: phenomenal and psychological. The approach is seen as an alternative to phenomenological analyses typical for cognitive semiotics. Further, a cognitive model (...) of the language faculty is described. The model is implemented in SNePS/GLAIR architecture and based on GATN grammar and semantic networks as a representation formalism. The model - reflecting traditionally distinguished linguistic structures - consists of phonological, syntactic, and semantic modules. I claim that the most important role in the phenomenon of language is played by psychological consciousness. Phenomenal consciousness accompanies various stages of language functioning, but is not indispensable in explanations of the language faculty. (shrink)

Traditional medical Artificial Intelligence models, approved for clinical use, restrict themselves to single-modal data e.g. images only, limiting their applicability in the complex, multimodal environment of medical diagnosis and treatment. Multimodal Transformer Models in healthcare can effectively process and interpret diverse data forms such as text, images, and structured data. They have demonstrated impressive performance on standard benchmarks like USLME question banks and continue to improve with scale. However, the adoption of these advanced AI models is not without (...) challenges. While multimodal deep learning models like Transformers offer promising advancements in healthcare, their integration requires careful consideration of the accompanying ethical and environmental challenges. (shrink)

The aim of this paper is to argue that our experience of artworks is normally multimodal. It is the result of perceptual processing in more than one sense modality. In other words, multimodal experience of art is not the exception; it is the rule. I use the example of music in order to demonstrate the various ways in which the visual sense modality influences the auditory processing of music and conclude that this should make us look more closely (...) at our practices of engaging with artworks. (shrink)

This research article examines the potential of multimodal techniques in promoting inclusive practices in the English language classroom, delving into the multidisciplinary fields of English Language Teaching (ELT) and inclusive education. This study intends to investigate how multimodal resources, such as visual aids, technology, and creative activities, may be effectively integrated to meet the various learning needs of students using a pedagogical lens. This paper examines the theoretical underpinnings and practical implications of using multimodal approaches in ELT (...) settings, shedding light on their potential to promote inclusivity, engagement, and language acquisition among learners with diverse abilities and backgrounds. It does this through a thorough literature review and analysis of pedagogical frameworks. (shrink)

It is common to characterize pain with touch-related terms, like ‘cutting’, ‘pressing’, ‘sharp’, and ‘pulsing’, or temperature-related terms, like ‘hot’ or ‘burning’. This suggests that many pains are phenomenally multimodal because they are experienced as having some tactile-like or thermal-like character. The goal of this chapter is to investigate the structure of phenomenally multimodal pain experiences. It is argued that the usual accounts of multimodal structure proposed in investigations regarding exteroceptive experiences cannot be plausibly applied to (...) class='Hi'>multimodal experiences of pain. Instead, an alternative framework is proposed which characterizes the structure of tactile-like and thermal-like pains by referring to the notion of crossmodal correspondences. (shrink)

In this article, I attempt to describe how certain theoretical constructions of semiotics could be applied in educational theoretical work. First I introduce meaning as a basic concept of semiotics, thus also touching on concepts such as action, competence and causality. I am then able to define learning as a change of competences, and also refer to the pedagogical concept of learning i.e. Bildung, which can be roughly defined as valuable human learning. I then take up the problem (...) of education as pedagogical direction and communication. Finally, I conclude with some considerations on the famous Greimassian semiotic square. (shrink)

From the perspective of distributed cognition I will stress how abduction is essentially multimodal, in that both data and hypotheses can have a full range of verbal and sensory representations, involving words, sights, images, smells, etc., but also kinesthetic – related to the ability to sense the position and location and orientation and movement of the body and its parts – and motor experiences and other feelings such as pain, and thus all sensory modalities. The presence of kinesthetic and (...) motor aspects demonstrates that abductive reasoning can be manipulative. We can also see, in this regard, how implicit factors take part in the abductive procedure, which consequently acquires the character of a kind of “thinking through doing”. This paper further describes 1) the fact that hypotheses in science can be built through different cognitive mediators and so they can also model the same cognitive aspect in different ways; how they can be carriers/ producers of knowledge in a multimodal way; 2) the problem of the possible non-explanatory and instrumental nature of abductive reasoning and the analysis of the consequences for induction; 3) the role of manipulative abduction in building new evidence/ experiments and how they trigger smart inductive inferences. (shrink)

What is the correct procedure for determining the contents of perception? Philosophers tackling this question increasingly rely on empirically-oriented procedures in order to reach an answer. I argue that this constitutes an improvement over the armchair methodology constitutive of phenomenal contrast cases, but that there is a crucial respect in which current empirical procedures remain limited: they are unimodal in nature, wrongly treating the senses as isolatable faculties. I thus have two aims: first, to motivate a reorientation of the admissible (...) contents debate into a multimodal framework, charting its various significances. The second is to explore whether any experimental studies of multimodal perception support a so-called Liberal (or ‘high-level’ or ‘rich’) account of perception’s admissible contents. I conclude that the McGurk effect and the ventriloquist effect are both explicable without the postulation of high-level content, but that at least one multimodal experimental paradigm may necessitate such content: the rubber hand illusion. One upshot of this argument is that Conservatives who claim that the Liberal view intolerably broadens the scope of perceptual illusions, particularly from the perspective of perceptual psychology, should pursue other arguments against that view. (shrink)

In this reply to James H. Fetzer’s “Minds and Machines: Limits to Simulations of Thought and Action”, I argue that computationalism should not be the view that (human) cognition is computation, but that it should be the view that cognition (simpliciter) is computable. It follows that computationalism can be true even if (human) cognition is not the result of computations in the brain. I also argue that, if semiotic systems are systems that interpret signs, then both humans and computers are (...) semiotic systems. Finally, I suggest that minds can be considered as virtual machines implemented in certain semiotic systems, primarily the brain, but also AI computers. In doing so, I take issue with Fetzer’s arguments to the contrary. (shrink)

This article demonstrates how a new reading of Rilke’s poetry can provide a basis for comparing and contrasting the aesthetic approach to art and the language-based approach that foregrounds the role of metaphor and materiality in literary production. Lessing’s Laocoön is discussed in terms of an implied dialogue between painting and poetry, which, however, acquires a different valence when the Fifth of Rilke’s 'Duino Elegies' suggests that poetry itself functions as a ‘metaphorical hypoicon’ allowing for shared meanings. My concluding remarks (...) emphasize the importance of the performing self to a complete understanding of Rilke’s semiotic potential. (shrink)

This paper employs a technical framework that integrates physical, historical, semiotic, and structuralist analyses to conduct a semiotic deconstruction of the "Thinker Man" statue. The study systematically examines the statue’s scale, materiality, and form, situating it within a mental health hospital to explore themes of resilience and legacy. Key signifiers are analyzed to uncover meanings related to contemplation and psychological strength, while structuralist methods highlight the interdependencies among these elements. Drawing a superficial analogy to state space representation from control systems (...) and dynamics, the interactions of semiotic components are modeled to illustrate the statue’s comprehensive significance. This analysis was conducted as a midterm assignment under the guidance of Ayşe Deniz Hakyemez in the Textual Analysis and Argumentation class. (shrink)

The central focus of this paper is the disjunction between the findings of climate science in revealing the threat of global warming and the failure to act appropriately to these warnings. The development of climate science can be illuminated through the perspective provided by Peircian semiotics, but efforts to account for its success as a science and its failure to convince people to act accordingly indicate the need to supplement Peirce’s ideas. The more significant gaps, it is argued, call (...) for the integration of major new ideas. It will be argued that Peirce should be viewed as a Schellingian philosopher, and it will then be shown how this facilitates integration into his philosophy of concepts developed by other philosophers and theorists within this tradition. In particular, Bourdieu’s concepts of the ‘habitus’ and ‘field’ will be integrated with Peirce’s semiotics and used to analyse the achievements and failures of climate science. It will be suggested that the resulting synthesis can augment Peirce’s evolutionary cosmology and so provide a better basis for comprehending and responding to the situation within which we find ourselves. (shrink)

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: Are some of the basic units of consciousness multimodal?

Given that charges of anti-Semitism, racism, and the like continue to be potent weapons of moral and intellectual critique in our culture, it is important that we work toward a clear understanding about just what sorts of conduct and circumstances constitute these moral offenses. In particular, can criticism of a state (such as Israel), or other social or political institution or organization (such as the NAACP), ever amount to anti-Semitism, racism, or other bigotry against the people represented by or associated (...) with it, even if no explicit denigration of them occurs? That a renowned scholar of rhetoric and philosophy takes up the challenge of answering such a question would seem to be cause for optimism, but the recent attempt by Judith Butler turns out to be subverted by faulty logic and blatant misreading. As a result, it obfuscates the issue, and wrongly suggests that expressive acts cannot be blameworthy on grounds of bigotry if they are not intentionally designed to serve such purposes. (shrink)

Introduction: Clinical practice guidelines (CPGs) are an important source of justification for clinical decisions in modern evidence-based practice. Yet, we have given little attention to how they argue their evidence. In particular, how do CPGs argue for treatment with long-term medications that are increasingly prescribed to older patients? Approach and rationale: I selected six disease-specific guidelines recommending treatment with five of the medication classes most commonly prescribed for seniors in Ontario, Canada. I considered the stated aims of these CPGs and (...) the techniques employed towards those aims. Finally, I reconstructed and logically analysed the arguments supporting recommendations for pharmacotherapy. Analysis: The primary function of CPGs is rhetorical, or persuasive, and their means of persuasion include both a display of their credibility and their argumentation. Arguments supporting pharmacotherapy recommendations for the target population follow a common inductive pattern: statistical generalization from randomized controlled trial (RCT) and meta-analysis evidence. Two of the CPGs also argue their treatment recommendations for older patients in this style, while three fail to justify pharmacotherapy specifically for the older population. Discussion: The arguments analysed lack the auxiliary assumptions that would warrant making a generalization about the clinical effectiveness of medications for the older population. Guidelines reason using simple induction, while ignoring important inferential gaps. Future guidelines should aspire to be well-reasoned rather than simply evidence-based; argue from a plurality of evidence; be wary of hasty inductions; appropriately limit the scope of their recommendations; and avoid making law-like, prescriptive generalizations. (shrink)

This article offers a historical perspective on the emergence of narrative as a major area of research, with a sampling of the range of possible approaches. Key early figures, including Propp, Levi-Strauss, the French structuralists (Greimas in particular), and the linguist Labov are discussed. It aims to provide a framework in which some key concepts can be examined, in particular the term narrativity, which regards narrative as a semiotic structure that transcends the verbal domain. The work of Metz in cinema (...) is discussed. Another area is painting; it is noted that the conjunction of the notion of narrative with painting has a long history. (shrink)

This is an excerpt from a report that highlights and explores five questions which arose from the workshop on perceptual learning and perceptual recognition at the University of Toronto, Mississauga on May 10th and 11th, 2012. This excerpt explores the question: What are the origins of multimodal associations?

This review-article deals with Duvall's book 'Faulkner's Marginal Couples' and evaluates his claim that his approach is 'primarily structuralist, with a special debt to the narrative semiotics of Greimas.' There is also a discussion of general issues in narrative semiotics not tied to any one researcher's approach.

One of Plato’s aims in the Phaedrus seems to be to outline an ‘ideal’ form of rhetoric. But it is unclear exactly what the ‘true’ rhetorician really looks like, and what exactly his methods are. More broadly, just how does Plato see the relation between rhetoric and philosophy? I argue, in light of Plato’s epistemology, that the “true craft (techne) of rhetoric” which he describes in the Phaedrus is a regulative, but also an unattainable ideal. Consequently, the mythical palinode in (...) the dialogue is not (as some have claimed) an example of the true techne—and indeed it could not be. But neither is dialectic. Rather, dialectic is the closest approximation of the true techne of rhetoric which can be had; that is to say, dialectic is the best and highest kind of psychagogia (a ‘leading of the soul through words’). Plato’s purpose in describing the “true techne of rhetoric”, then, is not to reform or to rehabilitate rhetoric, but to urge us to abandon it in favor of the philosophical life. One implication of this is that Plato is just as hostile toward rhetoric as he is in the Gorgias. (shrink)

Mental imagery is early perceptual processing that is not triggered by corresponding sensory stimulation in the relevant sense modality. Multimodal mental imagery is early perceptual processing that is triggered by sensory stimulation in a different sense modality. For example, when early visual or tactile processing is triggered by auditory sensory stimulation, this amounts to multimodal mental imagery. Pulling together philosophy, psychology and neuroscience, I will argue in this paper that multimodal mental imagery plays a crucial role in (...) our engagement with musical works. Engagement with musical works is normally a multimodal phenomenon, where we get input from a number of sense modalities. But even if we screen out any input that is not auditory, multimodal mental imagery will still play an important role that musicians and composers often actively rely on. (shrink)

The ways in which the Aristotelian sciences are related to each other has been discussed in the literature, with some focus on the subalternate sciences. While it is acknowledged that Aristotle, and Plato as well, was concerned as well with how the arts were related to one another, less attention has been paid to Aristotle's views on relationships among the arts. In this paper, I argue that Aristotle's account of the subalternate sciences helps shed light on how Aristotle saw the (...) art of rhetoric relating to dialectic and politics. Initial motivation for comparing rhetoric with the subalternate sciences is Aristotle's use of the language of boundary transgression, germane to the Posterior Analytics, when discussing rhetoric’s boundaries, as well as the language of "over" and "under" found in APo. First, I discuss three passages in Rhetoric Book I and argue that Garver's (1988) account cannot be correct. Second, I look to the subalternate sciences, especially focusing on optics and the distinction between "unqualified" optics and mathematical optics. Third, I discuss rhetoric's dependence on both dialectic and politics. (shrink)

Terms loaded with informational connotations are often employed to refer to genes and their dynamics. Indeed, genes are usually perceived by biologists as basically ‘the carriers of hereditary information.’ Nevertheless, a number of researchers consider such talk as inadequate and ‘just metaphorical,’ thus expressing a skepticism about the use of the term ‘information’ and its derivatives in biology as a natural science. First, because the meaning of that term in biology is not as precise as it is, for instance, in (...) the mathematical theory of communication. Second, because it seems to refer to a purported semantic property of genes without theoretically clarifying if any genuinely intrinsic semantics is involved. Biosemiotics, a field that attempts to analyze biological systems as semiotic systems, makes it possible to advance in the understanding of the concept of information in biology. From the perspective of Peircean biosemiotics, we develop here an account of genes as signs, including a detailed analysis of two fundamental processes in the genetic information system (transcription and protein synthesis) that have not been made so far in this field of research. Furthermore, we propose here an account of information based on Peircean semiotics and apply it to our analysis of transcription and protein synthesis. (shrink)