Intersemiotic translation (IT) was defined by Roman Jakobson (The Translation Studies Reader, Routledge, London, p. 114, 2000) as “transmutation of signs”—“an interpretation of verbal signs by means of signs of nonverbal sign systems.” Despite its theoretical relevance, and in spite of the frequency in which it is practiced, the phenomenon remains virtually unexplored in terms of conceptual modeling, especially from a semiotic perspective. Our approach is based on two premises: (i) IT is fundamentally a semiotic operation process (semiosis) and (ii) (...) IT is a deeply iconic-dependent process. We exemplify our approach by means of literature to dance IT and we explore some implications for the development of a general model of IT. (shrink)

How does a picture teach a viewer to look at it, understand it, and make meaning?. “Cross-mediality and narrative textual form: A semiotic snalysis of the lexical and visual signs and codes of the picture bnook.” Semiotica, 118 : 1–70 and Peter Pericles Trifonas.. “Texts and images.” In International handbook of semiotics, Vols. 1&2, edited by Peter Pericles Trifonas. The Netherlands: Springer. Pp. 1139–1154.) The suggestion for a pictorial grammar has been derived from the fact that pictures have no unique (...) visual metalanguage and therefore require recourse to language as an instrument for pictorial analysis. The lexical-visual relationship in a text is more complex than is suggested in the question. Proponents for the semiotic autonomy of pictures have objected that the commentaries of crossmedial contexts have not asserted the semiotic priority of the lexical over the visual message. ‘Is an autonomous semiotics of visual perception possible, or does the semiotic analysis of pictorial text always require recourse to the model of language?’. (shrink)

In the sense of phenomenology, actions are special cases of acts of consciousness. Within semiotics, first Jan Mukařovský and then A. J. Greimas have established, in different terms, a distinction between instrumental actions and actions which carry their meaning in themselves. But this is insufficient to account for the variety of actions which comprises everything from the creation of artefacts, dance, sporting events, theatre, rituals, and much else. Already those actions mentioned relate in different ways to instrumentality and intrinsic meaning, (...) as well as to iconicity and plasticity. In this paper, I will be particularly concerned with dancing, especially classical ballet, trying to delimit it from sporting events and theatre. Apart from the sign function and the spectacular function, I will notably have recourse to what I have elsewhere term secondary iconicity as well as to plasticity. In the process, I hope to be able to throw some light also on the nature of sport, by comparing and contrasting it to dance, as well as to the theatre as well as, more incidentally, to some other types of action. In a wider perspective, my ambition is to contribute to a general inquiry into the semiosis of actions. (shrink)

Material Engagement Theory is currently driving a conceptual change in the archaeology of mind. Drawing upon the dictates of enactivism and active externalism, it specifically calls for a radical reconceptualization of mind and material culture. Unpersuaded by the common assumption that cognition is brain-bound, Malafouris argues in favour of a process ontology that situates thinking in action. In granting ontological primacy to material engagement, MET seeks to illuminate the emergence of human ways of thinking through the practical effects of the (...) material world. Considering that this is a characteristic example of a pragmatic take on cognition, this contemporary theoretical platform appears to share a lot with pragmatism. As of late, scholars working at the intersection of philosophy, semiotics, and cognitive science have made important steps towards the rapprochement between pragmatism and externalism. Looking to contribute to this growing corpus of work, the present paper focuses on MET’s relation to the pragmatism of Peirce, Dewey, and Mead. Having elsewhere recognized the overlap and complementarity between Malafouris’ and Peirce’s theories in particular, I developed a pragmatic and enactive theory of cognitive semiotics that is suitably geared to trace the nature, emergence, and evolution of material signs. Therefore, besides noting some obvious historical connections, I hereby aim to establish the theoretical backdrop upon which this composite theory is supposed to function, while also exploring new potential avenues. Given that this cognitive semiotic framework can be seen as a pragmatic extension of Malafouris’ enactivist approach to archaeology, the current paper delves into MET’s theoretical underpinnings, seeking to complement its working hypotheses and concepts with philosophical notions and ideas advanced long ago. This synthesis ultimately concludes with a call for the reconceptualization of ‘representation’ as a heuristic concept. (shrink)

What is the most important reason for using Computer Vision methods in humanities research? In this article, I argue that the use of numerical representation and data analysis methods offers a new language for describing cultural artifacts, experiences and dynamics. The human languages such as English or Russian that developed rather recently in human evolution are not good at capturing analog properties of human sensorial and cultural experiences. These limitations become particularly worrying if we want to compare thousands, millions or (...) billions of artifacts—i.e. to study contemporary media and cultures at their new twenty-first century scale. When we instead use numerical measurements of image properties standard in Computer Vision, we can better capture details of a single artifact as well as visual differences between a number of artifacts–even if they are very small. The examples of visual dimensions that numbers can capture better then languages include color, shape, texture, contours, composition, and visual characteristics of represented faces, bodies and objects. The methods of finding structures and relationships in large numerical datasets developed in statistics and machine learning allow us to extend this analysis to very big datasets of cultural objects. Equally importantly, numerical image features used in Computer Vision also give us a new language to represent gradual and continuous temporal changes—something which natural languages are also bad at. This applies to both single artworks such as a film or a dance piece and also to changes in visual characteristics in millions of artifacts over decades or centuries. (shrink)

Journal Name: Semiotica Issue: Ahead of print.

In the domain of evolutionary cognitive archaeology, the early body ornaments from the Middle Stone Age/Palaeolithic are generally treated as mere by-products of an evolved brain-bound cognitive architecture selected to cope with looming social problems. Such adaptive artefacts are therefore taken to have been but passive means of broadcasting a priori envisaged meanings, essentially playing a neutral role for the human mind. In contrast to this epiphenomenalist view of material culture, postphenomenology and the Material Engagement Theory have been making a (...) case for the active role of artefacts on the count that they can actually shape and restructure the human mind. By bringing these dissenting voices together, the paper at hand employs an enactive way of thinking in order to challenge the epiphenomenalist take on early body ornaments. In fact, two variants of enactivism are presented, each advancing a unique explanation of how the engagement of early humans with body ornaments transformed their minds along the two postphenomenological categories of embodied and hermeneutic cognition. Our theoretical frameworks specifically seek to explore how early beadworks could have scaffolded the creation of semiotic categories and the development of cognitive processes. Despite relying on inherently different premises, both theories suggest that beads fostered the emergence of an epistemic apparatus which thoroughly transformed the way humans engaged with the world. Having concurred on the ornaments’ transformative effects, we ultimately conclude that the epiphenomenalist paradigm best be replaced with an enactive approach grounded on the dictates of postphenomenology and the MET. (shrink)

This three-part publication series presents the epistemological processes and outcomes of an international arts-based research project titled Big Blue Ball : Pictures, people, place. The project uses the creative function to investigate the nature of meaning-making. In particular, through collaborative engagement with adversity of cultures, it explores the significance of creativity and creative practice in setting up sites for shared understanding in a contemporary and globally interactive world. The project was developed and carried out by Donna Wright during her PhD (...) Candidature at Southern Cross University, Lismore, Australia, between 2004 and 2007. Making use of practice-led research strategies, and drawing on creative arts practice, the project has exploited the inherent capacity of the creative function to support innovation. The project design offers a new model of intertextual processes of creativity that opens up spaces for intercultural negotiation, by linking spatial conceptions and processes for semiotic mediations, to multiple, interconnected mediums for the production and reception of new information. This in turn provides a context in which to support knowledge discovery that may facilitate intercultural awareness and understanding. (shrink)

Journal Name: Semiotica - Journal of the International Association for Semiotic Studies / Revue de l'Association Internationale de Sémiotique Volume: 2014 Issue: 198 Pages: 205-240.

Practically all theories of iconicity are denunciations of its subject matter (for example, those of Goodman, Bierman and the early Eco). My own theory of iconicity was developed in order to save a particular kind of iconicity, pictoriality, from such criticism. In this interest, I distinguished pure iconicity, iconic ground, and iconic sign, on one hand, and primary and secondary iconic signs, on the other hand. Since then, however, several things have happened. The conceptual tools that I created to explain (...) pictoriality have been shown by others to be relevant to linguistic iconicity. On the other hand, semioticians with points of departure different from mine have identified mimicry as it is commonly found in the animal world as a species of iconicity. In the evolutionary semiotics of Deacon, iconicity is referred to in such a general way that it seems to be emptied of all content, while in the variety invented by Donald the term mimesis is used for a particular phase in the evolution of iconic meaning. The aim of this article is to consider to what extent the extension of iconicity theory to new domains will necessitate the development of new models. (shrink)