There is a growing research interest in the value of participative arts-based strategies for enhancing wellbeing amongst adults living with dementia. One such intervention, centred around literature, is the group activity called Shared Reading. The purpose of this case study of weekly Shared Reading sessions of poetry in a care home in Merseyside is to investigate instances of how participants with mild to moderate dementia collaborate in processes of meaning-making that allow them shared experiences of being moved by poetry. An (...) under-thematised aspect of psychological wellbeing is the capacity for being moved and for sharing such moments. This article addresses the following question: how can the specific multimodality of the text in the Shared Reading model help to bring about such experiences? Using Stern’s concepts of Now Moments and Moments of Meeting, this case study discusses various instances of unpredictable, surprising and spontaneous intersubjective moments between participant and poem, participant and reader leader, participant and staff, participant and relative. (shrink)

Both biosemiotics and evolutionary epistemology are concerned with how knowledge evolves. (Applied) Evolutionary Epistemology thereby focuses on identifying the units, levels, and mechanisms or processes that underlie the evolutionary development of knowing and knowledge, while biosemiotics places emphasis on the study of how signs underlie the development of meaning. We compare the two schools of thought and analyze how in delineating their research program, biosemiotics runs into several problems that are overcome by evolutionary epistemologists. For one, by emphasizing signs, biosemiotics (...) needs to delineate a semiotic threshold, which is a problem not encountered by evolutionary epistemologists. Instead, the latter recognizes that all organisms are knowers that evolve knowledge, which they recognize to extend toward phenomena produced by organisms such as behavior, cognition, language, culture, science, and technology. Secondly, biosemiotics attempts at continuing adaptationist notions on how organisms relate to their environment, while especially Applied Evolutionary Epistemology comes to redefine the nature of the organism–environment relationship in such a way that it recognizes the spatiotemporal boundedness of existence, which in turn makes adaptationist accounts obsolete. (shrink)

This paper discusses how theories of definition and probabilistic theories of categorization could help distinguish between translation and adaptation, and eventually between translation and adaptation studies. Part I suggests readopting the common parlance definition of “translation” as the accurate rendition of the meaning of a verbal expression in another natural language, and “adaptation” as change that leads to better fit. Readopting these common parlance definitions entails categorical implications. The author discusses three parameters: whereas “translation” represents an invariance-oriented, semiotically invested, cross-lingual (...) phenomenon, “adaptation” refers to a variance-oriented phenomenon, which is not semiotically invested, and entails better fit. Part II discusses how theories of categorization could help distinguish between TS and LFAS. The study of the disciplinarization of knowledge involves epistemic and socio-political conditioners. This section concludes that medium specificity, i.e., the linguistic versus lit-film paradigm, plays a major role in separating TS from LFAS. Another player that deserves more attention is the Romantic as opposed to the Classicist value system. (shrink)

This thesis contextualises academic writing in EAP (English for Academic Purposes) and subjects it to an interdisciplinary (educational and philosophical) analysis in order to argue that what makes writing academic are its socio-academic practices and values, not its conventional forms. In rejecting dominant discourses that frame academic writing as a transferable skill which can be reduced to conventional forms, I show that academic writings are varied and evolve alongside changing writer agencies and textual environments. This accounts for the emergence of (...) a diverse academic writing landscape that enacts diverse socio-academic practices and that does not reduce writing to predictable static surface features. My methodology resists traditional disciplinary classifications and is in line with the reflective and interpretative approaches associated with the humanities. Rather than ‘filling a gap’ in academic writing research, I challenge writing conventions in EAP by questioning assumptions. This is because EAP is influential in shaping discourses about academic writing and, as such, it must not mislead students and practitioners about the evolving purposes, forms and possibilities for academic expression. The thesis is divided into three parts, each containing two chapters. Part 1 is concerned with explaining what academic writing is in EAP and how EAP can misrepresent it. Part 2 delves into the history of writing and literacy to tease out the ideologies shaping writing practices. Part 3 proposes a model based on philosophical theories of mind and sociology that lays the foundation for a macro theory of academic writing and a future writing pedagogy. The model re-imagines academic writing as an affordance within a non-linear, emergent and complex social open system. This system can be referred to as an organic unity and requires a shift from conceiving writing as a ‘transferable skill’. When re-imagined as an affordance, change and diversity in academic writing practices become possible. (shrink)

This paper reconsiders semiotic modelling in light of recent scholarship on Charles Peirce, particularly regarding his concept of proposition. Conceived in the vein of Peirce’s phenomenological categories as well as of his taxonomy of signs, semiotic modelling has mostly been thought of as ascending from simple, basic sign types to complex ones. This constitutes the backbone of most currently accepted semiotic modelling theories and entails the further acceptance of an unexamined a priori coherence between complexity of cognition and complexity of (...) signification. Following recent readings of Peirce’s post-1900 semiotic, we engage in a discussion as to what are the limits of this approach. From Stjernfelt’s conception of the dicisign in nature, we derive a perspective that affords understanding the practice of modelling as a reciprocal interplay between decomposition of complexity and recombination into further complexity. This discussion is facilitated by the recent extrapolation of the constructivist concept of scaffolding in biosemiotics research. Cognition, we argue, begins with a fundamental irritation of trying to make sense of a structure that is more complex than what can directly be derived from experience and, in so doing, urges meaning-seeking processes. The yet unknown object is decomposed into more tangible objects and is subsequently reassembled from these more manageable conceptions of the object. In support of our argument, we discuss the notions of semiotic competences and resources in light of such a naturalized account of meaning-making. (shrink)

To a greater extent than in other technical domains, research and progress in Artificial Intelligence has always been entwined with the fictional. Its language echoes strongly with other forms of cultural narratives, such as fairytales, myth and religion. In this essay we present varied examples that illustrate how these analogies have guided not only readings of the AI enterprise by commentators outside the community but also inspired AI researchers themselves. Owing to their influence, we pay particular attention to the similarities (...) between religious language and the way in which the potential advent of greater than human intelligence is presented contemporarily. We then move on to the role that fiction, science fiction most of all, has historically played and is still playing in the discussion of AI by influencing researchers and the public, shifting the weights of different scenarios in our collectively perceived probability space. We sum up by arguing that the lore surrounding AI research, ancient and modern, points to the ancestral and shared human motivations that drive researchers in their pursuit and fascinate humanity at large. These points of narrative entanglement where AI meets the wider culture should serve to amplify the call to engage ourselves with the discussion of the potential destination of this technology. (shrink)

This paper proposes a methodological synthesis in order to study multimodal media discourse and argumentation in the context of the so-called ‘refugee crisis’ in Greece. It follows the framework of Multimodal Critical Discourse Analysis, integrating this with argumentation studies, with a particular emphasis on the analysis of inference. Our data come from the Greek newspapers Kathimerini and Ta Nea. We contend that the proposed methodological synergy enables scrutiny of (a) racist conceptualizations cultivated by the representation of migrants and refugees in (...) headlines and photographs in newspaper articles along with (b) the argumentative potential that is implicitly sustained in these multimodal representations. (shrink)

In this paper we explore quarantining as a more ethical method for delimiting the spread of Hate Speech via online social media platforms. Currently, companies like Facebook, Twitter, and Google generally respondreactivelyto such material: offensive messages that have already been posted are reviewed by human moderators if complaints from users are received. The offensive posts are onlysubsequentlyremoved if the complaints are upheld; therefore, they still cause the recipients psychological harm. In addition, this approach has frequently been criticised for delimiting freedom (...) of expression, since it requires the service providers to elaborate and implement censorship regimes. In the last few years, an emerging generation of automatic Hate Speech detection systems has started to offer new strategies for dealing with this particular kind of offensive online material. Anticipating the future efficacy of such systems, the present article advocates an approach to online Hate Speech detection that is analogous to the quarantining of malicious computer software. If a given post is automatically classified as being harmful in a reliable manner, then it can be temporarily quarantined, and the direct recipients can receive an alert, which protects them from the harmful content in the first instance. The quarantining framework is an example of more ethical online safety technology that can be extended to the handling of Hate Speech. Crucially, it provides flexible options for obtaining a more justifiable balance between freedom of expression and appropriate censorship. (shrink)

Firstly, this paper aims to analyze how verbal and visual modes contribute to build two basic components of cartoons: the referenced situation and the fictional situation. Secondly, it aims to unravel the semiotics of this discursive genre by offering a fine-grained picture of modal variations and continuities of the rhetorical resources deployed, by means of which the fictional situation is displayed. The corpus is composed of 50 multimodal cartoons chosen by cartoonists of 22 nationalities as the most representative of their (...) work in the frame of a wide questionnaire. Category analysis and non-parametric statistics were applied. We identified and fleshed out four different types of modal functioning of resources: visual preference, verbal preference, modal flexibility, and genuine multimodal functioning. Even if visual and multimodal metaphor were often in charge of transferring meaning from fiction to the referenced situation, results show that other resources such as antithesis, irony, and syllepsis can become the key resources of cartoons. Findings highlight the multilayered functioning of cartoons, among which plastic features can play a significant role, and provide further evidence in favor of the hyperdetermination of humor hypothesis proposed by Attardo. (shrink)

This article, taking a social semiotic approach, analyses two pieces of music written, shared and exalted by two pre-1945 European fascist movements – the German NSDAP and the British Union of Fascists. These movements, both political and cultural, employed mythologies of unity, common identity and purpose in order to elide the realities of social distinction and political–economic inequalities between bourgeois and proletarian groups in capitalist societies. Visually and inter-personally, the fascist cultural project communicated a machine-like certainty about a vision for (...) a new society based on discipline, conformity and the might of the nation. In this article, we are interested in the ways that these very same discourses are also communicated through sound and music in two songs: The Horst Wessel Lied and the BUF marching song, two songs that used the same melody. We analyse the discourses communicated by the semiotic choices made in melody, arrangements, sound qualities, rhythms as well as in lyrics. The article first identifies some of the underlying semiotic resources for meaning making in sound and then shows how these are used in order to communicate specific ideas, values and attitudes. (shrink)

Intersemiotic translation (IT) was defined by Roman Jakobson (The Translation Studies Reader, Routledge, London, p. 114, 2000) as “transmutation of signs”—“an interpretation of verbal signs by means of signs of nonverbal sign systems.” Despite its theoretical relevance, and in spite of the frequency in which it is practiced, the phenomenon remains virtually unexplored in terms of conceptual modeling, especially from a semiotic perspective. Our approach is based on two premises: (i) IT is fundamentally a semiotic operation process (semiosis) and (ii) (...) IT is a deeply iconic-dependent process. We exemplify our approach by means of literature to dance IT and we explore some implications for the development of a general model of IT. (shrink)

The problem analysed in this paper is whether we can gain knowledge by using valid inferences, and how we can explain this process from a model-theoretic perspective. According to the paradox of inference (Cohen & Nagel 1936/1998, 173), it is logically impossible for an inference to be both valid and its conclusion to possess novelty with respect to the premises. I argue in this paper that valid inference has an epistemic significance, i.e., it can be used by an agent to (...) enlarge his knowledge, and this significance can be accounted in model-theoretic terms. I will argue first that the paradox is based on an equivocation, namely, it arises because logical containment, i.e., logical implication, is identified with epistemological containment, i.e., the knowledge of the premises entails the knowledge of the conclusion. Second, I will argue that a truth-conditional theory of meaning has the necessary resources to explain the epistemic significance of valid inferences. I will explain this epistemic significance starting from Carnap’s semantic theory of meaning and Tarski’s notion of satisfaction. In this way I will counter (Prawitz 2012b)’s claim that a truth-conditional theory of meaning is not able to account the legitimacy of valid inferences, i.e., their epistemic significance. (shrink)

Name der Zeitschrift: Semiotica Jahrgang: 2015 Heft: 207 Seiten: 657-673.

Argumentation is a cognitive category. Texts cannot be said to be argumentation, nor can argumentation be said to lie in texts. This is an almost trivial semiotic point of departure, but it is quite relevant nevertheless. In this contribution, three reasons are developed to emphasize and to articulate the semiotic component of argumentation to show that it is a crucial element that cannot be disregarded. Two of these reasons are mentioned only in passing as other contributions in this volume deal (...) with them more substantially. The third reason, being that argumentation requires an exchange of discourse worlds and that consequently the mimetic construction of these discourse worlds is part of the argumentation, is discussed in some detail in this paper. It will be argued that a lack of attention for the mimetics of argumentation is regrettable, both theoretically and practically. Focusing on the mimetics raises questions concerning the dominant ‘propositional’ format of argumentation assumed to be essential for argumentative assessment. (shrink)

This paper considers the extent to which the earliest stages of learning about systems of inscription requires not just individual mental effort, but effort that is distributed across a wide physical and intellectual environment. It is particularly concerned with how children under the age of three learn about notational systems, including writing, and examines parallels with the evolution of written systems. It considers the position that children gain knowledge incrementally over the early months and years of life, supported by a (...) commonly accepted view that learning is a mental activity in which knowledge accumulates hierarchically in the minds of individual children, starting with smallest parts of the system. The paper presents evidence to the contrary, suggesting that the early learning of inscriptional systems is associated not just with individual minds, but with social and cultural cognition that is dispersed across minds, bodies, tools, and material environments. It presents data and evidence from a small study of the sign-making of children under the age of three that indicates that children of this age already use notations purposefully in the construction of signs that are intentional, multimodal, and unbounded, and that already have features associated with conventional systems of inscription. In their early sign-making they use certain underlying principles of symbolic reference associated with conventional systems, including the use of ‘generic’ structures derived from social, bodily, and material experience. Central to this process are networks of interactions between co-participants, tools, materials, and the physical environment. (shrink)

Framed within the broader theoretical context of social semiotics, we attempt to show how university students communicate using a variety of unique means, in particular social contexts. We privilege Pennycook and Otsuji’s semiotic assemblages, Jimaima and Simungala’s semiotic creativity, and the notion of semiotic economy as critical ingredients that conspire to give rise to the unique and complex coinages and innovations constituting students’ repertoires. We argue that, born out of creativity, the students’ repertoires are semiotically and economically charged discourses that (...) generate extended narratives such that more is realized with less. We show that this reality undoubtedly constitutes a multi-semiotic meaning-making endeavor that enacts and sustains students’ imagined and lived experiences in real sociocultural, historical, and political spaces in the multilingual landscapes of university campuses. (shrink)

Multi-modal metaphor is a new perspective in metaphor research developed in modern times. Beyond the metaphor research of language, it combines text, image, sound, and other modes and provides new insights and perspectives for metaphor research. Food advertisements often combine sound, images, and other forms to promote the products and increase consumers’ desire to buy, and they often contain metaphors of multiple modes. However, under the perspective of cross-cultural research, when the same food brand is advertised in different countries, the (...) multi-modal metaphors are varied to appeal to different audiences. This article compares food advertisements in China and in the U.S. from the perspective of multi-modal metaphors, and analyzes the varied applications arising from different cultural influences. The research may act as a reference for advertising strategies on cross-cultural occasions. (shrink)

This paper presents an analytical framework for analyzing how multimodal resources of emotion expression are semiotically materialized in discursive interactions specific to political discourse. Interested in how political personae are emotionally constructed through multimodal meaning-making practices, our analysis model assumes an interdisciplinary perspective, which integrates facial expression analysis – using FaceReader™ software –, the theory of emotional arcs and bodily actions (hand gestures) analysis that express emotions, in the analytical framework of multimodality. The results show how the multimodal choices that (...) political actors make during discursive interactions allow them to build their political brand and make connections with the audience on an emotional level. (shrink)

The aim of this article is to explore website interactivity as discourse. Whereas the use of writing, images and layout in web design has been explored extensively, interactivity, that is, interactions between a web user and the website system, remains an underdeveloped area of discourse studies. To analyze interactivity as discourse, the article uses data from a research project on offline and online shopping for electronics, viewing the offline-online relationship as recontextualization in the sense that webshop interactivity represents and transforms (...) in-store shopping actions. Using a methodology that combines analytical framework for interactive sites and approach to discourse analysis, the article maps cursor resources and interactive webshop features as actions and compares them to the actions that constitute in-store shopping. On this basis, the article offers reflections on how interactivity plays a defining role in the digital resemiotization of social practices. (shrink)

Instagram serves as a powerful instrument for youth socialization, self-expression, and self-performance in visual online spaces. Using social semiotics and multimodal discourse analysis, this study examines the potential ideological meanings and implications of selfie-shooting and sharing on Instagram on young adults’ self-concept. A corpus of 110 questionnaires, including almost 85 captioned selfies, was surveyed as multimodal utterances. In doing so, this study argues that selfies can create young adults’ split-selves while constructing their multiple personas in visual online spaces. This marks (...) the significance of viewing selfie-creators not only as authors of their selfies, but rather as viewers of a three-fold self: an ideal-self, a projected-self, and an internal-self, to negotiate social and power relationships, while (re)positioning observer-observed roles. This study claims originality in unraveling how young adults use visual and textual mediated communication to represent and perform their split-selves. It suggests that selfie-shooting-sharing has become a key self-performance tactic and behavior in online cultures. Therefore, young adults deploy selfies and captions to posit a redefinition of certain social values, such as aesthetics and freedom, while deploying their selfies and captions. Challenging certain orthodox social allegiances, they conceive wildness, messiness, and exuberance as emerging neo-aesthetics components of appeal. This study contributes to the literature on personal visual communication with insights on how Egyptian young adults perform their self-concept via the semiotic practice of selfie-shooting-sharing. (shrink)

The aim of this paper is to propose a new approach in the form of multimodality as a semiotic method that can be used by marketers and semioticians to induce online flow, a psychological state, on a brand website. First, we refer to multimodality as a semiotic analysis that can be used for a better optimization of semiotic resource sets in meaning-making, and we distinguish it from another similar concept: multimedia. Second, after a critical literature review, we address the flow (...) construct - a state of mind sometimes experienced by people who are deeply involved and immersed in some event, object or activity. Previous quantitative studies show a correlation between online flow experience and other variables such as design, content, sound and layout that are suggested to be its antecedents. In our study, these flow antecedents are viewed as sets of signs or modes that can be orchestrated in order to create different levels of perceived challenge for brand website users. We consider that multimodality can be used for a better optimization of these various meanings as expressed by modes that are "essentially different in nature" (Bateman, 2008, p.54). Also, we refer to the online marketing outcomes of the online flow experience, in order to outline its importance and its implications in the online environment. The main conclusion of our paper is that multimodality can be used by scholars and practitioners as a premise to induce online flow on a brand website, by optimizing the sets of signs or modes. Originality – our contribution consists of an interdisciplinary approach. We use concepts from semiotics, positive psychology, and online marketing for a better understanding of how marketers and semioticians can positively influence online customer behaviour. (shrink)

Fugue and chaos are used in their contemporary meaning. Elements of the fugue, albeit a ‎small number of universals, will be demonstrated in the area of visual and verbal colors. ‎Chaos dominates the internet, fashion, and everyday life. The visual and verbal colors are ‎differentiated and their communicative potential is indicated alongside the diachronic changes. The prototypes of colors are the interface between visual and verbal colors.‎.

The introduction claims that there might exist an evolutionary bridge from possible genres in nature to human cultural genres. A sub-hypothesis is that basic life-conditions, partly common for animals and humans, in the long run can generate so-called life-genres. To investigate such hypotheses a framework of interrelated key communicational concepts is outlined in the second, main part. Four levels are suggested. Signs are seen as elements in utterances. Further, sufficiently similar utterances can be perceived as kinds of utterances or genres. (...) Genres are kinds of communication in a species' life-world. Utterance and genre are the framework’s key concepts. Both are seen as products and processes and as constituted by five reciprocal aspects: form, content, act, time, and space, the necessary elements to initiate and interpret communication. A model illustrates this integrative principle. Part three dwells with the idea of life-genres, and part four exemplifies and problematises how a chimpanzee’s ‘begging’ for meat, a fish’s nest-making, and kinds of birdsongs, could be seen as possible life-genres. The last, short part gives a brief summary, highlights challenges, and reflects over the framework’s relevance for biosemiotics. (shrink)

Name der Zeitschrift: Semiotica Jahrgang: 2018 Heft: 220 Seiten: 41-67.

During the last decade, one source of debate in argumentation theory has been the notion that there are different modes of arguing that need to be distinguished when analyzing and evaluating arguments. Visual argument is often cited as a paradigm example. This paper discusses the ways in which it and modes of arguing that invoke non-verbal sounds, smells, tactile sensations, music and other non-verbal entities may be defined and conceptualized. Though some attempts to construct a ‘multimodal’ theory of argument are (...) criticized, it advocates for an argumentation theory that makes room for visual arguing and for other non-verbal modes that have not been explored in depth. In the process, the paper provides a method for identifying the structure of multimodal arguments and argues that adding modes to our theoretical tool box is an important step toward a comprehensive account of argument. (shrink)

A variety of semiotic resources makes the construction of scientific knowledge possible and meaning-making resources are conveyed by certain semiotic modes. Next, numerous studies have demonstrated the pedagogical importance of gestures in the demonstration of scientific knowledge in the classroom. Drawing on social semiotic systemic functional theory and legitimation code theory, this study explores the types and the role of gestures in the semiotic construction of scientific knowledge in pedagogic semiosis and their pedagogical values for the meaning-making of science content. (...) With this aim, a gesture observation protocol (GOP) is developed to annotate and analyze data. Two science lectures, which are broadcast remotely for middle school students including gifted students, are observed. Systemic Functional Multimodal Discourse Analysis (SF-MDA) method is employed to analyze and evaluate data. Results demonstrated that the deployment of gestures that contributes to the construction of scientific knowledge is low and deployed gestures mostly do not have pedagogical value. It is recommended that teachers should be more conscious and educated about deploying gestures to present scientific knowledge efficiently. (shrink)

Intersemiotic projection is one of the most common configurations in the knowledge construction process of academic comics. Although previous studies address some general features of intersemiotic projection, further research on interdependency relations of intersemiotic projection is needed in order to map out the whole system. This study, based on the social-semiotic approach to multimodal studies, proposes a systemic framework of image-text paratactic and hypotactic projection in academic comics. This framework identifies three sub-categories of paratactic projection and hypotactic projection, respectively: Emergent, (...) Adjoined, Sequential, Compound, Subsumed, and Fused. The use of these projection configurations contributes to the realization of the communicative purposes of academic comics to evidence, exemplify, emphasize, explain, elaborate, and visualize the discussed knowledge. This research attempts not only to contribute to the theoretical development of multimodality from the social-semiotic perspective by refining and enlarging the multimodal hypotactic projection framework but also to provide an effective and applicable tool for comics analysis. (shrink)

The expression ‘Fake News’ inside Internet memes engenders significant online virulence, possibly heralding an iconoclastic emergence of weaponized propaganda for assaulting agencies reared on public trust. Internet memes are multimodal artifacts featuring ideological singularities designed for ‘flash’ consumption, often composed by numerous voices echoing popular, online culture. This study proposes that ‘Fake News’ Internet memes are weaponized iconoclastic multimodal propaganda discourse and attempts to delineate them as such by asking: What power relations and ideologies do Internet memes featuring the expression (...) ‘fake news’ harbor? How might those manifestations qualify as WIMP discourse? A multimodal critical discourse analysis of a small pool of ‘fake news’ Internet memes drawn from four popular social media websites revealed what agencies were often targeted and from what political canons they likely emerged. Findings indicate that many Internet memes featuring ‘fake news’ are specifically directed, revealing an underlying hazard that WIMP discourse could diminish democratic processes while influencing online trajectories of public discourse. (shrink)

ABSTRACTPayday loans constitute one of the most rapidly expanding and controversial forms of consumer lending today. Payday lending – the selling of high-interest, short-term credit – has thrived following the decline of the traditional high street banking system and the reluctance of many mainstream credit services, following the 2007/2008 Global Financial Crisis, to lend to low-income earners. This study examines the website of the industry leader in the UK, Wonga, a payday lender which recently rebranded and relaunched itself after being (...) embroiled in a series of financial scandals. Our analysis centres on the new Wonga website, the gateway to its financial services, and identifies three inter-related discursive strategies through which the lender, in the wake of its financial misconduct, seeks to present itself as a reputable financial service provider, namely by constructing the empowered and responsible borrower, destigmatising both its service provision and its prospective customers, the payday borrower, and minimising the consequences and risks associated with payday borrowing. Collectively, these strategies constitute an artful response by Wonga to the changing legislative and socioeconomic contexts in which it and other payday lenders now operate, permitting it to continue marketing and selling its high-interest rate financial services. (shrink)

ABSTRACTHow self-evident is a colonial rationality today? This paper begins by tracing a ‘text trajectory’ about nineteenth century imperialism and colonialism through several educational spaces: curricular guidelines, textbook, teachers’ reflections on history education, material discursive classroom interactions and pupils’ communication about the topic. In a first step, we observe how entrenched and common sensical a great-power discourse about imperialism and colonialism is in current educational practices. We suggest that pupils ‘hyperstate’ a discursive position on colonialism which appears shocking when stated (...) explicitly, but which is already subtly entextualised in curricular and media discourse. However, in a second step, the analysis orients to the molecular lines and foldings, the unexpected intra-connections and unplanned ‘lines of flight’. In this way, the apparent stability of the colonial rationality begins to wobble. The memory practices enacted by pupils, curricula, teachers, authors and the material affordances of textbooks repeat entrenched colonial hierarchies and racisms, ‘and also’ exceed any overly simple understanding of how colonial rationality plays out in contemporary discourse. (shrink)

This paper considers the ways that concepts such as social justice and law were used as semiotic objects-in-tension by a group of five US undergraduates considering law school to make sense of their ideas about entering the discourse communities and communities of practice associated with being a lawyer. This group was made up of undergraduate women who had completed a summer residency program sponsored by the Law School Admissions Council to increase enrollment of students from under-represented groups. Of the five (...) participants, two were US-born; the others immigrated to the US as teenagers; each was aware of her position as multiply marginalized, by gender as well as other factors, including refugee or immigrant status, religious affiliation, sexual identity, and/or association with “at risk” labeling. Data analyzed reflect a 3-year study of their changing perceptions of their relationships to law school discourse communities, using text, interviews, individual video narratives, and informal, face-to-face group meetings. A sociolinguistic approach to multimodal discourse analysis is used to examine the ways that the women, each in a unique way, articulated an increased investment in direct and embodied engagement, lived experience, and personal testimony—not as supplements to doing/being a lawyer, but as necessary and expected practices therein. Over time and through various modalities, they used their vantage point from outside the dominant discourse communities of law to stage social critique and to contest the binary logic and normative criteria that forge the boundaries of exclusion from and inclusion in these communities. Specifically, they resemiotized notions of being a lawyer from the margins in ways that demanded a more fluid and polysemous interpretation of what it means to do ethically rigorous social justice work—hence reworking the relationships between justice and the law and widening the semiotic potential of their own future work. Particularly significant are the ways that semiotic trajectories progressed from an emphasis on what Halliday identifies as textual functions of language to interpersonal and ideational functions. Such a trajectory away from entextualization suggests that voices and perspectives from the margins may be using those imaginary margins tactically as sites from which to contest the boundaries that define whose voices count within the legal system and to contest normative limits on semiotic potentialities for lawyers working toward more just social futures. (shrink)

This paper addresses the question how to analyze multimodal public discourse in such a way that the resulting reconstruction of the rhetor’s accountability either obliges the rhetor to acknowledge the argumentative reconstruction as valid or to refute its validity in a meta-discussion. This is a challenge for discourse theory as well as for argument theory because multimodal discourse seems far removed from the ‘standard’ propositional format of an argument. We argue that multimodal discourse should be analyzed as a coherent and (...) relevant discourse, assuming the possibility of instant interactions between all modes. We introduce a method that allows us to account for an argumentative reconstruction in a systematic way. We illustrate our method by analyzing the ABC news item titled Hu Jintao Visit: Economics and Panda Bears of January 20, 2011, holding ABC news as a rhetor accountable for several far reaching standpoints that are implied in the multimodal format. (shrink)

This article presents a fresh perspective on the interplay among visual, verbal, and auditory modalities, positing that these modalities, as semogenic resources, compete to express dynamic meanings. The theoretical paradigm emphasizes that whether a modality or an element within a modality gets or loses semantic status, it will elicit an additional layer of social meaning to depict a comprehensive picture of a story together with an explicit semiotic meaning. The article adopts a qualitative method to analyze the data, which are (...) drawn from The Good Wife and My Roommate is a Gumiho and annotated in ELAN 6.3. It was found that modal competition can shed light on the dynamic meaning-making processes in semiotic and societal orientations. Modal competition may distort space and time of different stories, and reconstruct a different discursive spatio-temporal dimension in the TV world. It can diversify the dynamic orientations from New to Given in visual, verbal, and auditory texts of multimodal discourses to tell stories. Modal competition provides a lens to understand the multidimensional reality and to appreciate the aesthetics of a modern TV series. (shrink)

This article approaches sensory modalities as semiotically active factors and organizing principles in meaning-making. The focus will be on the special case where modalities mismatch in film – i.e., the soundtrack and visuals present contradictory meanings. The conflict can be characterized by the concept of synthesis that emerges in theories of Eisenstein, Barthes, Jakobson, Lotman, and cognitivists. The artistic functions of such synthesis will be discussed with the help of examples from selected feature films. In the first place, conflicting modalities (...) are inspected in the light of Juri Lotmanʼs theory of two incompatible, but still complementary languages that make up a mechanism for generating new information. In addition, the prospects of evaluating modality conflicts will be touched upon, dismissing synchrony and redundancy as the scale parameters, but acknowledging Lotmanʼs model of space as a primary modeling system that is capable of representing semantic conflicts. (shrink)

This study develops a biosemiotic framework for a descriptive phenomenology. We incorporate the set utterance-genre-lifeworld in biosemiotic theory by paralleling it with the Peircean-Uexküllean notions of sign, habit, and Umwelt (respectively). This framework for empirical semiotic studies aims to complement the concepts of affordance and scaffold, as applied in studies on learning.The paper also contributes to bridging Bakhtinian-Hallidayian-Habermasian views on utterance, genre, and lifeworld with biosemiotics. We exploit the possibility that biosemiotics offers to bring together hermeneutic and phenomenological analysis. We (...) relate these views to integrated levels in a systemic framework for communication. Signs are seen as inter-dependent construction elements in utterances. Repeated use of utterances in shifting contexts generates shared recognizable kinds of communication, or genres. ‘Life-genre’ is used in a zoo-communication context, to avoid anthropocentrism. Life-genre serves animals’ life-functions. Genres make up a systemic network of communicational resources, along with the related concepts of event, affordance, and scaffold. Utterance, genre, and lifeworld have five aspects, constituting an integrative approach to communication: form, content, act, time, and space. Semiosis and positioning are processes that connect aspects and levels. Levels, aspects, and processes make up the framework as a system.While biosemiotics supports a phenomenological notion of life-genre, in turn, this notion also contributes to the development of the former, bridging a gap between organisms’ sign experience on a micro-level and organisms’ phenomenal lifeworld/Umwelt. Comparisons of lifeworld and Umwelt reveal that, although not identical, these are sufficiently similar to be perceived as an overall macro-level for signs and communication. Starting from a construal of utterance and genre as dynamic, dialogical, and reciprocal, genre is positioned as meso-level, mediating between signs in utterances and the lifeworld/Umwelt level. We propose genres, understood as semiotic scaffoldings built through affordances, as an analytical concept to capture meso-level phenomena. Scaffolding is determined by both ongoing events and (pre-)available genres. Events are manifestations of these scaffolding processes.Identifying animal and educational communication as two particularly relevant fields for future applications, we compare key socio-semiotic concepts to the notions of sign, habit, and Umwelt. The notions affordance and scaffolding are particularly important to think of learning as continuous with adaptation.An overall aim is to broaden as well as finetune semiotic phenomenology as a platform for empirical analyses of communication. We conclude by exemplifying and summarizing how the framework facilitates this. (shrink)

This article demonstrates the broad applicability of the concept of symbol in human communication, beyond but including verbal language. The starting point is Charles Sanders Peirce’s understanding of symbolicity as signification grounded on habits. The goal is to be able to conceptualize mediality in general and media interrelations, particularly in relation to symbolicity. Informed by a multimodal view on media, the author provides a systematic overview of symbolicity within the context of communication among human minds structured around two crossing parameters: (...) symbols being limited or widespread among people and symbols not being part of or being part of systems – languages. Based on this overview, I clarify the role of culture in language notions and conceptualize language in relation to mediality. I also suggest a way of more precisely describing similarities and differences between languages and media types, without either conflating or totally separating the two concepts. Finally, I investigate how the dependence of language and media type conceptions on culture affects the idea of intermediality. Together, these investigations and conceptualizations promote a more comprehensive understanding of symbolicity in general and a deeper knowledge of the role of symbolicity in human communication, including verbal language, and intermedial relations involving all kinds of different media types. (shrink)

This study shows how three Chilean media construct in their discourse the social actor ‘secondary students’, in a multimodal way. It focuses on the representation of Televisión Nacional de Chile (also known as TVN), El Dínamo and El Ciudadano of this social group which is often suppressed suppressed from the media sphere. It is a qualitative study with a social semiotic approach, following the guidelines of Visual Grammar and the typology of representation of social actors by van Leeuwen (2003). The (...) corpus comprised 15 multimodal texts of 2018 compiled from internet sites, which constitute a semiotic chain of a news event about education. The results suggest that TVN creates the meaning of an ‘aggressor student’, El Dínamo as a ‘student to be reformed’; whereas El Ciudadano, represents him as a social actor who is an ‘active participant’. (shrink)

Journal Name: Semiotica Issue: Ahead of print.

Spain has become a country receiving immigrants in the last years. The majority of the items of news related to immigration that appear in the press exhibit negative characteristics. The main purpose of this article is to observe the linguistic and visual representation of Sub-Saharan immigrants in a sample of the Spanish press in order to answer the following research questions: how are Sub-Saharan immigrants portrayed linguistically and visually in the given press? What are the implications of the choices in (...) language and images? The researcher collected all the pieces of news related to Sub-Saharan immigrants in the three most popular Spanish newspapers, i.e. El País, ABC and El Mundo from 1 June 2011 to 31 March 2013. Visual grammar and critical discourse analysis will be used in order to deconstruct the visual and linguistic representation of such immigrants. In addition, van Leeuwen's [2008 Discourse and practice. New tools for critical discourse analysis. Oxford: Oxford University Press.] classification of social actors will be used in the analysis. The analysis demonstrates that the representation of Sub-Saharan immigrants displays the following characteristics: they are represented as vulnerable, lacking autonomy, as victims, etc. This representation does not contribute to the fact that the autochthonous population favours the integration of immigrants into the socio-economic structure, exercising the same rights as the Spanish population. (shrink)

The use of words to label concepts is a weak point in CMT but one which is little discussed. This article considers the relative merits of image and writing as semiotic modes for identifying conceptual metaphor domains and whether image can offer an alternative to target is source formulae. It reports on an experiment in which MA translation students draw composite drawings to represent orientational metaphoric aspects of a UK government press release. Conventional metaphoric language deriving from the orientational metaphors, (...) especially good is up/bad is down, plays a significant role across this text, forming a “metaphor chain” pattern. The drawings and post-task interviews with the participants reveal details of the internal structure of the source domain up and how it is conceptualized. Particularly of note is the strong horizontal forward aspect of orientation which emerges when the written text is represented pictorially. The article demonstrates how drawing can be used as a tool in metaphor-led discourse analysis. (shrink)

We aim to contribute to recent situational approaches to the study of interpersonal violence by elaborating the concept of trajectories. Trajectories are communicative processes in which antagonists act upon each other’s bodily and verbal actions to project a direction for the interaction to take, which is then (con) tested in the exchanges that follow. We use the notion of trajectories to gain insight in how participants turn an antagonistic situation into a violent encounter, which we contrast to interactionist and micro-sociological (...) understandings. Using ethnomethodological and conversation analytical tools, we detail the trajectories of three violent encounters, captured on phone camera recordings to answer the question how verbal and bodily exchanges project physical violence. Methodologically, our contribution shows how bodily actions can be studied in visual data. Our cases show how antagonists move the interaction toward violence by creating a metaconflict revolving around the conditions under which the interaction will become a physical confrontation; what we call the contested projection of violence. We conclude that the concept of trajectories offers a useful analytical tool to detail the shifts and turns of the interactive process—notably it’s bodily dimensions— that characterize antagonism and violence. Substantially, our analysis raises questions about conceptualizations of the emotional dynamics (notably the role of dominance) of violence, as proposed by earlier micro-sociological and interactionist work. We therefore suggest that future studies engage with these issues in more detail and in larger datasets. (shrink)

While symbolic colour use has always played a conspicuous role in science research and education, the use of colour in historic diagrams remains a lacuna in the history of science. Investigating the colour use in diagrams often means uncovering a whole cosmology that is not otherwise explicit in the diagram itself. The periodic table is a salient and iconic example of non-mimetic colour use in science. Andreas von Antropoff's (1924) rectangular table of recurrent rainbow colours is famous, as are Alcindo (...) Flores Cabral's (1949) application of colour in his round snail form, using the RGB scheme, and Mazurs's (1967) pine tree system, consisting of warm and cold colours that he attributed to specific groups of elements—an attribution that we can relate back to humoralism and alchemy. From the first periodic tables in the 19th century, individual researchers have used different colour regimes. While standardization may play an obvious role in chemistry and its diagrams, all the more impressive is the anarchistic use of colour in the various diagrams which continue to be created. This article focuses on periodic tables in chemical journals and text books, and explores and compares the development of colour codes found in the few existing polychrome diagrams from the 1920s to the 1970s. (shrink)