How does sign language compare with gesture, on the one hand, and spoken language on the other? Sign was once viewed as nothing more than a system of pictorial gestures without linguistic structure. More recently, researchers have argued that sign is no different from spoken language, with all of the same linguistic structures. The pendulum is currently swinging back toward the view that sign is gestural, or at least has gestural components. The goal of this review is to elucidate the (...) relationships among sign language, gesture, and spoken language. We do so by taking a close look not only at how sign has been studied over the past 50 years, but also at how the spontaneous gestures that accompany speech have been studied. We conclude that signers gesture just as speakers do. Both produce imagistic gestures along with more categorical signs or words. Because at present it is difficult to tell where sign stops and gesture begins, we suggest that sign should not be compared with speech alone but should be compared with speech-plus-gesture. Although it might be easier (and, in some cases, preferable) to blur the distinction between sign and gesture, we argue that distinguishing between sign (or speech) and gesture is essential to predict certain types of learning and allows us to understand the conditions under which gesture takes on properties of sign, and speech takes on properties of gesture. We end by calling for new technology that may help us better calibrate the borders between sign and gesture. (shrink)

We argue that a formal semantics for music can be developed, although it will be based on very different principles from linguistic semantics and will yield less precise inferences. Our framework has the following tenets: Music cognition is continuous with normal auditory cognition. In both cases, the semantic content derived from an auditory percept can be identified with the set of inferences it licenses on its causal sources, analyzed in appropriately abstract ways. What is special about music semantics is that (...) it aggregates inferences based on normal auditory cognition with further inferences drawn on the basis of the behavior of voices in tonal pitch space. This makes it possible to define an inferential semantics but also a truth-conditional semantics for music. In particular, a voice undergoing a musical movement m is true of an object undergoing a series of events e just in case there is a certain structure-preserving map between m and e. Aspects of musical syntax might be derivable on semantic grounds from an event mereology, which also explains some cases in which tree structures are inadequate for music. Intentions and emotions may be attributed at several levels, and we speculate on possible explanations of the special relation between music and emotions. (shrink)

In dynamic theories of presupposition, a trigger pp′ with presupposition p and at-issue component p′ comes with a requirement that p should be entailed by the local context of pp′. We argue that some co-speech gestures should be analyzed within a presuppositional framework, but with a twist: an expression p co-occurring with a co-speech gesture G with content g comes with the requirement that the local context of p should guarantee that p entails g; we call such assertion-dependent presuppositions ‘cosuppositions’. (...) We show that this analysis can be combined with earlier theories of local contexts to account for complex patterns of gesture projection in quantified and in attitudinal contexts, and we compare our account to two potential alternatives: one based on supervaluations, and one, due to Cornelia Ebert, that treats co-speech gestures as supplements. We argue that the latter is correct, but for ‘post-speech’ gestures, rather than for co-speech gestures. (shrink)

This introduction aims to familiarize readers with basic dimensions of variation among pictorial and diagrammatic representations, as we understand them, in order to serve as a backdrop to the articles in this volume. Instead of trying to canvas the vast range of representational kinds, we focus on a few important axes of difference, and a small handful of illustrative examples. We begin in Section 1 with background: the distinction between pictures and diagrams, the concept of systems of representation, and that (...) of the properties of usage associated with signs. In Section 2 we illustrate these ideas with a case study of diagrammatic representation: the evolution from Euler diagrams to Venn diagrams. Section 3 is correspondingly devoted to pictorial representation, illustrated by the comparison between parallel and linear perspective drawing. We conclude with open questions, and then briefly summarize the articles to follow. (shrink)

Sometimes form-meaning mappings in language are not arbitrary, but iconic: they depict what they represent. Incorporating iconic elements of language into a compositional semantics faces a number of challenges in formal frameworks as evidenced by the lengthy literature in linguistics and philosophy on quotation/direct speech, which iconically portrays the words of another in the form that they were used. This paper compares the well-studied type of iconicity found with verbs of quotation with another form of iconicity common in sign languages: (...) classifier predicates. I argue that these two types of verbal iconicity can, and should, incorporate their iconic elements in the same way using event modification via the notion of a context dependent demonstration. This unified formal account of quotation and classifier predicates predicts that a language might use the same strategy for conveying both, and I argue that this is the case with role shift in American Sign Language. Role shift is used to report others’ language and thoughts as well as their actions, and recently has been argued to provide evidence in favor of Kaplanian “monstrous” indexical expressions. By reimagining role shift as involving either quotation for language demonstrations or “body classifier” predicates for action demonstrations, the proposed account eliminates one major argument for these monsters coming from sign languages. Throughout this paper, sign languages provide a fruitful perspective for studying quotation and other forms of iconicity in natural language due to their lack of a commonly used writing system which is otherwise often mistaken as primary data instead of speech, the rich existing literature on iconicity within sign language linguistics, and the ability of role shift to overtly mark the scope of a language report. In this view, written language is merely a special case of a more general phenomenon of sign and speech demonstration, which accounts more accurately for natural language data by permitting more strict or loose verbatim interpretations of demonstrations through the context dependent pragmatics. (shrink)

We argue that formal linguistic theory, properly extended, can provide a unifying framework for diverse phenomena beyond traditional linguistic objects. We display applications to pictorial meanings, visual narratives, music, dance, animal communication, and, more abstractly, to logical and non-logical concepts in the ‘language of thought’ and reasoning. In many of these cases, a careful analysis reveals that classic linguistic notions are pervasive across these domains, such as for instance the constituency (or grouping) core principle of syntax, the use of logical (...) variables (for object tracking), or the variety of inference types investigated in semantics/pragmatics. The aim of this overview is to show how the application of formal linguistic concepts and methodology to non-linguistic objects yields non-trivial insights, thus opening the possibility of a general, precise theory of signs. (An appendix, found in the online supplements to this article, surveys applications of Super Linguistics to animal communication.). (shrink)

ASL can express plurals by repeating a noun, in an unpunctuated fashion, in different parts of signing space. We argue that this construction may come with a rich iconic component: the geometric arrangement of the repetitions provides information about the arrangement of the denoted plurality; in addition, the number and speed of the repetitions provide information about the size of the denoted plurality. Interestingly, the shape of the repetitions may introduce a new singular discourse referent when a vertex can be (...) inferred to denote a singular object. Thus one may point towards the first or last iteration of a horizontal repetition of BOOK to denote the left- or right-edge of the corresponding row. This yields a remarkable interaction between iconic semantics and standard logical semantics. We show that our analysis extends to ‘punctuated’ repetitions, which involve clearly individuated iterations of a singular noun. While these may initially look like coordinated indefinites, they are better handled by the same iconic framework as plural, unpunctuated repetitions. Some repetition-based mass terms also give rise to iconic effects, and to different readings depending on whether the repetition is continuous, unpunctuated, or punctuated. Our analysis highlights the need for a formal semantics with iconicity to study the integration of such iconic and logical conditions. It also raises a question: can similar facts be found in spoken language when gestures are taken into account? We suggest that several effects can be replicated, especially when one considers examples involving ‘pro-speech gestures’. (shrink)

Sign languages are known to display the same general grammatical properties as spoken languages, but also to make greater use of iconic mechanisms. In Schlenker et al.’s ‘Iconic Variables’ :91–149, 2013), it was argued that loci can have an iconic semantics, in the sense that certain geometric relations among loci are preserved by the interpretation function. Here we ask whether plural and height specifications of loci display the formal behavior of phi-features in remaining uninterpreted in focus- and ellipsis-constructions. Data from (...) ASL and LSF show that plural and height specifications may indeed remain uninterpreted in these constructions; furthermore, there are cases in which a single high locus is construed iconically and left uninterpreted in the course of ellipsis resolution. We argue that our data are compatible with two theories. According to the Strong View, plural and height specifications of loci display exactly the behavior of spoken language features. According to the Weak View, our data just show that plural and height specifications share the behavior of features and other non-assertive elements in being separable from the referential terms they specify. Our LSF data are compatible with the Weak View; our ASL data might provide support for the Strong View. While our aim is merely to open the debate about the featural status of iconic specifications, the question is of some importance: if features are innate and primitive elements of grammar, and if some of them have an intrinsically geometric semantics, the signed modality might play a greater role than is usually thought at the very core of Universal Grammar. (shrink)

We argue that formal linguistic theory, properly extended, can provide a unifying framework for diverse phenomena beyond traditional linguistic objects. We display applications to pictorial meanings, visual narratives, music, dance, animal communication, and, more abstractly, to logical and non-logical concepts in the ‘language of thought’ and reasoning. In many of these cases, a careful analysis reveals that classic linguistic notions are pervasive across these domains, such as for instance the constituency (or grouping) core principle of syntax, the use of logical (...) variables (for object tracking), or the variety of inference types investigated in semantics/pragmatics. The aim of this overview is to show how the application of formal linguistic concepts and methodology to non-linguistic objects yields non-trivial insights, thus opening the possibility of a general, precise theory of signs. (An appendix, found in the online supplements to this article, surveys applications of Super Linguistics to animal communication.). (shrink)

In several sign languages, plurals can be realized with unpunctuated or punctuated repetitions of a noun, with different semantic implications; similar repetition-based plurals have been described in some homesigns and silent gestures. Unpunctuated repetitions often get approximate ‘at least’ readings while punctuated repetitions typically correspond to ‘exactly’ readings. The prevalence of these mechanisms could be thought to be a case in which Universal Grammar does not just specify the abstract properties of grammatical elements, but also their phonological realization, at least (...) in the visual modality. We explore an alternative in which punctuated and unpunctuated repetitions arise from general properties of iconic representations. On an empirical level, we argue that in ASL, punctuated and unpunctuated repetitions are unlikely to be an exclusively grammatical mechanism, as they can be found with purely iconic representations. On a theoretical level, we argue for a modular account with three components. First, repetition-based plurals can create a simplified pictorial representation. Second, unpunctuated repetitions give rise to pictorial vagueness, resolved by way of quantification over precisifications. Third, a pragmatic process involving strategic reasoning maps these vague representations onto a set of candidate linguistic meanings, including some ‘at least’ plural readings that are best expressed by unpunctuated repetitions. (shrink)