The purpose of this study is to examine how trends in the use of images in modern life science journals have changed since the spread of computer-based visual and imaging technology. To this end, a new classification system was constructed to analyze how the graphics of a scientific journal have changed over the years. The focus was on one international peer-reviewed journal in life sciences, Cell, which was founded in 1974, whereby 1725 figures and 160 tables from the research articles (...) in Cell were sampled. The unit of classification was defined as a graphic and the figures and tables were divided into 5952 graphics. These graphics were further classified into hierarchical categories, and the data in each category were aggregated every five years. The following categories were observed: data graphics, explanation graphics, and hybrid graphics. Data graphics increased by more than sixfold between 1974 and 2014, and some types of data graphics including mechanical reproduction images and bar charts displayed notable changes. The representation of explanatory graphics changed from hand-painted illustrations to diagrams of Bezier-curves. It is suggested that in addition to the development of experimental technologies such as fluorescent microscopy and big data analysis, continuously evolving application software for image creation and researchers’ motivation to convince reviewers and editors have influenced these changes. (shrink)

When interpreting the meanings of visual features in information visualizations, observers have expectations about how visual features map onto concepts (inferred mappings.) In this study, we examined whether aspects of inferred mappings that have been previously identified for colormap data visualizations generalize to a different type of visualization, Venn diagrams. Venn diagrams offer an interesting test case because empirical evidence about the nature of inferred mappings for colormaps suggests that established conventions for Venn diagrams are counterintuitive. Venn diagrams represent classes (...) using overlapping circles and express logical relationships between those classes by shading out regions to encode the concept of non-existence, or none. We propose that people do not simply expect shading to signify non-existence, but rather they expect regions that appear as holes to signify non-existence (the hole hypothesis.) The appearance of a hole depends on perceptual properties in the diagram in relation to its background. Across three experiments, results supported the hole hypothesis, underscoring the importance of configural processing for interpreting the meanings of visual features in information visualizations. (shrink)

This introduction aims to familiarize readers with basic dimensions of variation among pictorial and diagrammatic representations, as we understand them, in order to serve as a backdrop to the articles in this volume. Instead of trying to canvas the vast range of representational kinds, we focus on a few important axes of difference, and a small handful of illustrative examples. We begin in Section 1 with background: the distinction between pictures and diagrams, the concept of systems of representation, and that (...) of the properties of usage associated with signs. In Section 2 we illustrate these ideas with a case study of diagrammatic representation: the evolution from Euler diagrams to Venn diagrams. Section 3 is correspondingly devoted to pictorial representation, illustrated by the comparison between parallel and linear perspective drawing. We conclude with open questions, and then briefly summarize the articles to follow. (shrink)

Some have suggested that images can be arguments. Images can certainly bolster the acceptability of individual premises. We worry, though, that the static nature of images prevents them from ever playing a genuinely argumentative role. To show this, we call attention to a dilemma. The conclusion of a visual argument will either be explicit or implicit. If a visual argument includes its conclusion, then that conclusion must be demarcated from the premise or otherwise the argument will beg the question. If (...) a visual argument does not include its conclusion, then the premises on display must license that specific conclusion and not its opposite, in accordance with some demonstrable rationale. We show how major examples from the literature fail to escape this dilemma. Drawing inspiration from the graphical logic of C. S. Peirce, we suggest instead that images can be manipulated in a way that overcomes the dilemma. Diagrammatic reasoning can take one stepwise from an initial visual layout to a conclusion—thereby providing a principled rationale that bars opposite conclusions—and the visual inscription of this correct conclusion can come afterward in time—thereby distinguishing the conclusion from the premises. Even though this practical application of Peirce’s logical ideas to informal contexts requires that one make adjustments, we believe it points to a dynamic conception of visual argumentation that will prove more fertile in the long run. (shrink)

Source: Author: Ombor Pereowei Garrick, Ombor Elizabeth Oshuare, Adumene Sidum This study provides a framework to holistically assess the level of passengers' satisfaction for a given ferry service based on the dominant Design/Operational, Passengers Care/Safety/Security and Environmental categorical factors that define the ferry service operations and influence passengers' satisfaction. A test case carried out for a ferry service offered by a boat operator in the Warri wharf yields a Passengers' Satisfaction Index of 3.84, indicating that the ferry service is in (...) the range of dissatisfactory and moderately satisfactory, which is in good agreement with popular opinions that the service offered by that operator does not satisfy most of the passengers' expectations. The results of the test case proved that the framework reliably and realistically predicts the level of satisfaction the passengers derived from the various segments that define the service offered by a boat operator. This study will assist passengers make informed decision about the choice of operators to patronize. It will also guide operators and regulators to identify and improve those areas of the ferry service that are pertinent to the successful operation of the ferry business. ]]>. (shrink)

We contend that diagrams are tools not only for communication but also for supporting the reasoning of biologists. In the mechanistic research that is characteristic of biology, diagrams delineate the phenomenon to be explained, display explanatory relations, and show the organized parts and operations of the mechanism proposed as responsible for the phenomenon. Both phenomenon diagrams and explanatory relations diagrams, employing graphs or other formats, facilitate applying visual processing to the detection of relevant patterns. Mechanism diagrams guide reasoning about how (...) the parts and operations work together to produce the phenomenon and what experiments need to be done to improve on the existing account. We examine how these functions are served by diagrams in circadian rhythm research. (shrink)

A widespread opinion holds that norms and codes of conduct as such can only be established via words, that is, in some lexical form. This perspective can be criticized: some norms produced by human acts are not word-based at all. For example, many norms are actually conveyed through graphics (e. g. road signs and land-use maps), sounds (e. g. the referee’s whistle), a silent gesture (the traffic warden’s signal to halt). In this article, we will focus on the norms that (...) are created by means of drawings and can be termed “drawn norms” or “graphical norms.” Specifically, we will inquire into the phenomenon of graphical norms with particular regard to traffic signs and land-use plans, and we will discuss the philosophical and legal problems to which these phenomena give rise. (shrink)

Production and comprehension have long been viewed as inseparable components of language. The study of vision, by contrast, has centered almost exclusively on comprehension. Here we investigate drawing—the most basic form of visual production. How do we convey concepts in visual form, and how does refining this skill, in turn, affect recognition? We developed an online platform for collecting large amounts of drawing and recognition data, and applied a deep convolutional neural network model of visual cortex trained only on natural (...) images to explore the hypothesis that drawing recruits the same abstract feature representations that support natural visual object recognition. Consistent with this hypothesis, higher layers of this model captured the abstract features of both drawings and natural images most important for recognition, and people learning to produce more recognizable drawings of objects exhibited enhanced recognition of those objects. These findings could explain why drawing is so effective for communicating visual concepts, they suggest novel approaches for evaluating and refining conceptual knowledge, and they highlight the potential of deep networks for understanding human learning. (shrink)

Biologists often hypothesize mechanisms to explai phenomena. Our interest is how their understanding of the phenomena and mechanisms develops as they construct diagrams to communicate their claims. We present two case studies in which scientists integrate various data to create a single diagram to communicate their major conclusions in a research publication. In both cases, the history of revisions suggests that scientists' initial drafts encode biases and oversights that are only gradually overcome through prolonged, reflective re-design. To account for this, (...) we suggest that scientists only develop a unitary understanding of their results through their attempts to communicate them. (shrink)

People frequently gesture when problem-solving, particularly on tasks that require spatial transformation. Gesture often facilitates task performance by interacting with internal mental representations, but how this process works is not well understood. We investigated this question by exploring the case of mental abacus, a technique in which users not only imagine moving beads on an abacus to compute sums, but also produce movements in gestures that accompany the calculations. Because the content of MA is transparent and readily manipulated, the task (...) offers a unique window onto how gestures interface with mental representations. We find that the size and number of MA gestures reflect the length and difficulty of math problems. Also, by selectively interfering with aspects of gesture, we find that participants perform significantly worse on MA under motor interference, but that perceptual feedback is not critical for success on the task. We conclude that premotor processes involved in the planning of gestures are critical to mental representation in MA. (shrink)

We explore the crucial role of diagrams in scientific reasoning, especially reasoning directed at developing mechanistic explanations of biological phenomena. We offer a case study focusing on one research project that resulted in a published paper advancing a new understanding of the mechanism by which the central circadian oscillator in Synechococcus elongatus controls gene expression. By examining how the diagrams prepared for the paper developed over the course of multiple drafts, we show how the process of generating a new explanation (...) vitally involved the development and integration of multiple versions of different types of diagrams, and how reasoning about the mechanism proceeded in tandem with the development of the diagrams used to represent it. (shrink)

Diagrams have distinctive characteristics that make them an effective medium for communicating research findings, but they are even more impressive as tools for scientific reasoning. Focusing on circadian rhythm research in biology to explore these roles, we examine diagrammatic formats that have been devised to identify and illuminate circadian phenomena and to develop and modify mechanistic explanations of these phenomena.

Production and comprehension have long been viewed as inseparable components of language. The study of vision, by contrast, has centered almost exclusively on comprehension. Here we investigate drawing—the most basic form of visual production. How do we convey concepts in visual form, and how does refining this skill, in turn, affect recognition? We developed an online platform for collecting large amounts of drawing and recognition data, and applied a deep convolutional neural network model of visual cortex trained only on natural (...) images to explore the hypothesis that drawing recruits the same abstract feature representations that support natural visual object recognition. Consistent with this hypothesis, higher layers of this model captured the abstract features of both drawings and natural images most important for recognition, and people learning to produce more recognizable drawings of objects exhibited enhanced recognition of those objects. These findings could explain why drawing is so effective for communicating visual concepts, they suggest novel approaches for evaluating and refining conceptual knowledge, and they highlight the potential of deep networks for understanding human learning. (shrink)

Analogy researchers do not often examine gesture, and gesture researchers do not often borrow ideas from the study of analogy. One borrowable idea from the world of analogy is the importance of distinguishing between attributes and relations. Gentner observed that some metaphors highlight attributes and others highlight relations, and called the latter analogies. Mirroring this logic, we observe that some metaphoric gestures represent attributes and others represent relations, and propose to call the latter analogical gestures. We provide examples of such (...) analogical gestures and show how they relate to the categories of iconic and metaphoric gestures described previously. Analogical gestures represent different types of relations and different degrees of relational complexity, and sometimes cohere into larger analogical models. Treating analogical gestures as a distinct phenomenon prompts new questions and predictions, and illustrates one way that the study of gesture and the study of analogy can be mutually informative. (shrink)

When thought overwhelms the mind, the mind puts it into the world, notably in diagrams and gestures.Both use space and arrays of elements, depictive and non-depictive, to convey ideas, concrete and abstract,clear and sketchy. The arrays and the non-depictive elements like boxes and arrows serve to showrelationships and organizations, thematic, categorical, and more. on paper, in the air, in the diagrammedworld. Human actions organize space to convey abstractions: spraction.

The imagery we adopt when recalling the personal past may involve different perspectives. In many cases, we remember the past event from our original point of view. In some cases, however, we remember the past event from an external “observer” perspective and view ourselves in the remembered scene. Are such observer perspective images genuine memories? Are they accurate representations of the personal past? This chapter focuses on such observer perspectives in memory, and outlines and examines proposals about the nature of (...) such imagery. (shrink)

Our earliest tools are our bodies. Our hands raise and turn and toss and carry and push and pull, our legs walk and climb and kick allowing us to move and act in the world and to create the multitude of artifacts that improve our lives. The list of actions made by our hands and feet and other parts of our bodies is long. What is more remarkable is we turn those actions in the world into actions on thought through (...) gestures, language, and graphics, thereby creating cognitive tools that expand the mind. The focus here is gesture; gestures transform actions on perceptible objects to actions on imagined thoughts, carrying meaning with them rapidly, precisely, and directly. We review evidence showing that gestures enhance our own thinking and change the thought of others. We illustrate the power of gestures in studies showing that gestures uniquely change conceptions of time, from sequential to simultaneous, from sequential to cyclical, and from a perspective embedded in a timeline to an external perspective looking on a timeline, and by so doing obviate the ambiguities of an embedded perspective. We draw parallels between representations in gesture and in graphics; both use marks or actions arrayed in space to communicate more immediately than symbolic language. (shrink)

In many fields of biology, both the phenomena to be explained and the mechanisms proposed to explain them are commonly presented in diagrams. Our interest is in how scientists construct such diagrams. Researchers begin with evidence, typically developed experimentally and presented in data graphs. To arrive at a robust diagram of the phenomenon or the mechanism, they must integrate a variety of data to construct a single, coherent representation. This process often begins as the researchers create a first sketch, and (...) it continues over an extended period as they revise the sketch until they arrive at a diagram they find acceptable. We illustrate this process by examining the sketches developed in the course of two research projects directed at understanding the generation of circadian rhythms in cyanobacteria. One identified a new aspect of the phenomenon itself, whereas the other aimed to develop a new mechanistic account. In both cases, the research resulted in a paper in which the conclusion was presented in a diagram that the authors deemed adequate to convey it. These diagrams violate some of the normative “cognitive design principles” advanced by cognitive scientists as constraints on successful visual communication. We suggest that scientists’ sketching is instead governed by norms of success that are broadly explanatory: conveying the phenomenon or mechanism. (shrink)

Integrative and naturalistic philosophy of mind can both learn from and contribute to the contemporary cognitive sciences of dreaming. Two related phenomena concerning self‐representation in dreams demonstrate the need to bring disparate fields together. In most dreams, the protagonist or dream self who experiences and actively participates in dream events is or represents the dreamer: but in an intriguing minority of cases, self‐representation in dreams is displaced, disrupted, or even absent. Working from dream reports in established databanks, we examine two (...) key forms of polymorphism of self‐representation: dreams (or dream episodes) in which I take an external visuospatial perspective on myself, and those in which I take someone else's perspective on events. In remembering my past experiences or imagining future or possible experiences when awake, I sometimes see myself from an external or ‘observer’ perspective. By relating the issue of perspective in dreams to established research traditions in the study of memory and imagery, and noting the flexibility of perspective in dreams, we identify new lines of enquiry. In other dreams, the dreamer does not appear to figure at all, and the first person perspective on dream events is occupied by someone else, some other person or character. We call these puzzling cases ‘vicarious dreams’ and assess some potential ways to make sense of them. Questions about self‐representation and perspectives in dreams are intriguing in their own right and pose empirical and conceptual problems about the nature of self‐representation with implications beyond the case of dreaming. (shrink)

In this paper the role of images in argumentative settings is analyzed from a cognitive angle. In particular, the proposal of this paper is to see visual argumentation as a specific form of extended and distributed cognition. In order to develop this idea, some of Wittgenstein’s insights are used to put evidence produced by research on temporal-spatial reasoning processes into philosophical perspective. Some contemporary argumentative analyses of visual argumentation are also discussed using commercial and political examples. The paper finishes with (...) the notion of collective minds in order to specify the general idea of arguing with images as extended cognition. (shrink)

The ArgumentIn 1787 an anonymous student of the Perth Academy spent countless hours transforming his rough classroom notes into a beautifully inscribed notebook. Though this was an everyday practice for many Enlightenment students, extant notebooks of this nature are extremely rare and we know very little about how middle class children learned to inscribe and visualize knowledge on paper. This essay addresses this lacuna by using recently located student notebooks, drawings, and marginalia alongside textbooks and instructional literature to identify the (...) graphic tools and skills that were taught to Scottish children in early modern classrooms. I show that, in addition to learning the facts of the curriculum, students participated in educational routines that enabled them to learn how to visually package knowledge into accessible figures and patterns of information, thereby making acts of inscription and visualization meaningful tools that benefitted both the self and society. (shrink)

Space—an essential dimension of our life—is analyzable from different viewpoints, which often gives rise to contrasting conceptualizations. Perceptual analyses shed light on the intrinsic anisotropy and deformations of perceived space, raising the issue of which geometry may be able to represent perceptual space. Pictorial drawings and painting have been relevant sources of information about the nature of living and perceived space. Although the geometry of perceptual space is still in its infancy, contributions are beginning to appear. This special issue contributes (...) to the development of the geometry of perceptual space. (shrink)