Depictive expressions of thought predate written language by thousands of years. They have evolved in communities through a kind of informal user testing that has refined them. Analyzing common visual communications reveals consistencies that illuminate how people think as well as guide design; the process can be brought into the laboratory and accelerated. Like language, visual communications abstract and schematize; unlike language, they use properties of the page (e.g., proximity and place: center, horizontal/up–down, vertical/left–right) and the marks on it (e.g., (...) dots, lines, arrows, boxes, blobs, likenesses, symbols) to convey meanings. The visual expressions of these meanings (e.g., individual, category, order, relation, correspondence, continuum, hierarchy) have analogs in language, gesture, and especially in the patterns that are created when people design the world around them, arranging things into piles and rows and hierarchies and arrays, spatial-abstraction-action interconnections termed spractions. The designed world is a diagram. (shrink)

Depiction is the form of representation distinctive of figurative paintings, drawings, and photographs. Accounts of depiction attempt to specify the relation something must bear to an object in order to depict it. Resemblance accounts hold that the notion of resemblance is necessary to the specification of this relation. Several difficulties with such analyses have led many philosophers to reject the possibility of an adequate resemblance account of depiction. This essay outlines these difficulties and argues that current resemblance accounts succumb to (...) them. It then develops an alternative resemblance account, drawing on Grice's account of nonnatural meaning and its role in determining sentence meaning to argue that something depicts an object if it bears intention-based resemblances to the object that jointly capture its overall appearance. In addition to solving the metaphysical problem of what it is for something to depict an object, this account also sheds significant light on the epistemological issue of how we are able to work out that something depicts an object. This essay argues that our ability to work out that something depicts an object results from both our more general ability to identify intentions from the products of communicative behavior and our knowledge of stylistic conventions. This account avoids the difficulties that face rival attempts to analyze depiction in terms of resemblance. It also clarifies and explains the features that distinguish depictive from nondepictive representation. (shrink)

The emergence of human communication systems is typically investigated via 2 approaches with complementary strengths and weaknesses: naturalistic studies and computer simulations. This study was conducted with a method that combines these approaches. Pairs of participants played video games requiring communication. Members of a pair were physically separated but exchanged graphic signals through a medium that prevented the use of standard symbols (e.g., letters). Communication systems emerged and developed rapidly during the games, integrating the use of explicit signs with information (...) implicitly available to players and silent behavior‐coordinating procedures. The systems that emerged suggest 3 conclusions: (a) signs originate from different mappings; (b) sign systems develop parsimoniously; (c) sign forms are perceptually distinct, easy to produce, and tolerant to variations. (shrink)

This paper compares two explanations of the process by which human communication systems evolve: iterated learning and social collaboration. It then reports an experiment testing the social collaboration account. Participants engaged in a graphical communication task either as a member of a community, where they interacted with seven different partners drawn from the same pool, or as a member of an isolated pair, where they interacted with the same partner across the same number of games. Participants’ horizontal, pair‐wise interactions led (...) “bottom up” to the creation of an effective and efficient shared sign system in the community condition. Furthermore, the community‐evolved sign systems were as effective and efficient as the local sign systems developed by isolated pairs. Finally, and as predicted by a social collaboration account, and not by an iterated learning account, interaction was critical to the creation of shared sign systems, with different isolated pairs establishing different local sign systems and different communities establishing different global sign systems. (shrink)

The emergence of shared symbol systems is considered to be a pivotal moment in human evolution and human development. These changes are normally explained by reference to changes in people's internal cognitive processes. We present 2 experiments which provide evidence that changes in the external, collaborative processes that people use to communicate can also affect the structure and organization of symbol systems independently of cognitive change. We propose that mutual‐modifiability—opportunities for people to edit or manipulate each other's contributions—is a key (...) constraint on the emergence of complex symbol systems. We discuss the implications for models of language development and the origins of compositionality. (shrink)

It has been suggested that iconic graphical signs evolve into symbolic graphical signs through repeated usage. This article reports a series of interactive graphical communication experiments using a ‘pictionary’ task to establish the conditions under which the evolution might occur. Experiment 1 rules out a simple repetition based account in favor of an account that requires feedback and interaction between communicators. Experiment 2 shows how the degree of interaction affects the evolution of signs according to a process of grounding. Experiment (...) 3 confirms the prediction that those not involved directly in the interaction have trouble interpreting the graphical signs produced in Experiment 1. On the basis of these results, this article argues that icons evolve into symbols as a consequence of the systematic shift in the locus of information from the sign to the users' memory of the sign's usage supported by an interactive grounding process. (shrink)