Pictorial representations such as diagrams and figures are widely used in scientific literature for explanatory and descriptive purposes. The intuitive nature of pictorial representations coupled with texts foster a better understanding of the objects of study. Biological mechanisms and processes can be clearly illustrated and grasped in pictures. I argue that pictorial representations describe biological phenomena by telling stories. I elaborate on the role of narrative structures of pictures in the frontier research using a case study in immunology. I articulate (...) that pictures with an inherent narrative structure are crucial in biological sciences. (shrink)

The possibility of ideography is an empirical question. Prior examples of graphic codes do not provide compelling evidence for the infeasibility of ideography, because they fail to satisfy essential cognitive requirements that have only recently been revealed by studies of representational systems in cognitive science. Design criteria derived from cognitive principles suggest how effective graphic codes may be engineered.

Does recent work in the cognitive sciences have any implications for theories or methods employed within the philosophy of science itself? The answer to this question depends first on one’s conception of the philosophy of science and then on the nature of work being done in the various different fields comprising the cognitive sciences. For example, one might think of the philosophy of science as being an autonomous discipline that is both logically and epistemologically prior to any empirical inquiry. If (...) the cognitive sciences are empirical sciences, then research in the cognitive sciences could not have any significant implications for the philosophy of science. And that would be the end of the matter. Logical Empiricism is now typically understood as having exemplified this point of view.More specifically, Logical Empiricism took it for granted (i) that scientific knowledge should be understood as ideally having the structure of a formal logical calculus, and (ii) that the empirical warrant for scientific claims is given by directly observed data together with formal rules which determine the weight of the evidence for or against the particular claims in question. (shrink)

Emily Thomas's seminal book The Meaning of Travel has brought the philosophy of travel back into the public eye in recent years. Thomas has shown that the topic of travel can be approached from numerous different perspectives, ranging from the historical to the conceptual‐analytical, to the political or even social‐philosophical perspectives. This article introduces another perspective, which Thomas only indirectly addresses, namely the argumentation‐theoretical perspective. It is notable that contemporary philosophy of travel lacks the nineteenth‐century approach of using diagrams and (...) maps to examine arguments for and against travel. Since this approach starts with Schopenhauer, we first introduce his argument maps, discuss their advantages and disadvantages, and argue that a modified version is suitable to visualize and analyze arguments for and against traveling as presented in Thomas's work. (shrink)

One of the critical issues in the philosophy of science is to understand scientific knowledge. This paper proposes a novel approach to the study of reflection on science, called “cognitive metascience”. In particular, it offers a new understanding of scientific knowledge as constituted by various kinds of scientific representations, framed as cognitive artifacts. It introduces a novel functional taxonomy of cognitive artifacts prevalent in scientific practice, covering a huge diversity of their formats, vehicles, and functions. As a consequence, toolboxes, conceptual (...) frameworks, theories, models, and individual hypotheses can be understood as artifacts supporting our cognitive performance. It is also shown that by empirically studying how artifacts function, we may discover hitherto undiscussed virtues and vices of these scientific representations. This paper relies on the use of language technology to analyze scientific discourse empirically, which allows us to uncover the metascientific views of researchers. This, in turn, can become part of normative considerations concerning virtues and vices of cognitive artifacts. (shrink)

One of the main challenges for computational legal research is drawing up innovative heuristics to derive actionable knowledge from legal documents. While a large part of the research has been so far devoted to the extraction of purely legal information, less attention has been paid to seeking out in the texts the clues of more complex entities: legally relevant facts whose detection requires to link and interpret, as a unified whole, legal information and results of empirical analyses. This paper presents (...) an ongoing research that points in this direction, trying to devise new ways to support public prosecutors in assessing the dangerousness of individuals and groups under investigation, an activity that precisely relies on the cross-sectional evaluation of legal and empirical data. A knowledge mining strategy will be outlined that lines up, into a single metaheuristic model, information extraction, network-based inference, machine learning and visual analytics. We will focus, in particular, on the integration of graph-based inference and machine learning methods used both to support classification tasks and to explore new forms of man-machine cooperation. Experiments made involving public prosecutors from the Italian Anti-Mafia Investigation Directorate and using data from real investigations have not only shown the potentialities of our approach but also offered an opportunity to reflect on the role we could assign to AI when thinking about the future of legal science and practice. (shrink)

Over the last century, there have been considerable variations in the frequency of use and types of diagrams used in mathematical publications. In order to track these changes, we developed a method enabling large-scale quantitative analysis of mathematical publications to investigate the number and types of diagrams published in three leading mathematical journals in the period from 1885 to 2015. The results show that diagrams were relatively common at the beginning of the period under investigation. However, beginning in 1910, they (...) were almost completely unused for about four decades before reappearing in the 1950s. The diagrams from the 1950s, however, were of a different type than those used earlier in the century. We see this change in publication practice as a clear indication that the formalist ideology has influenced mathematicians’ choice of representations. Although this could be seen as a minor stylistic aspect of mathematics, we argue that mathematicians’ representational practice is deeply connected to their cognitive practice and to the contentual development of the discipline. These changes in publication style therefore indicate more fundamental changes in the period under consideration. (shrink)

When interpreting the meanings of visual features in information visualizations, observers have expectations about how visual features map onto concepts (inferred mappings.) In this study, we examined whether aspects of inferred mappings that have been previously identified for colormap data visualizations generalize to a different type of visualization, Venn diagrams. Venn diagrams offer an interesting test case because empirical evidence about the nature of inferred mappings for colormaps suggests that established conventions for Venn diagrams are counterintuitive. Venn diagrams represent classes (...) using overlapping circles and express logical relationships between those classes by shading out regions to encode the concept of non-existence, or none. We propose that people do not simply expect shading to signify non-existence, but rather they expect regions that appear as holes to signify non-existence (the hole hypothesis.) The appearance of a hole depends on perceptual properties in the diagram in relation to its background. Across three experiments, results supported the hole hypothesis, underscoring the importance of configural processing for interpreting the meanings of visual features in information visualizations. (shrink)

Cognition is both empowered and limited by representations. The matrix lens model explicates tasks that are based on frequency counts, conditional probabilities, and binary contingencies in a general fashion. Based on a structural analysis of such tasks, the model links several problems and semantic domains and provides a new perspective on representational accounts of cognition that recognizes representational isomorphs as opportunities, rather than as problems. The shared structural construct of a 2 × 2 matrix supports a set of generic tasks (...) and semantic mappings that provide a unifying framework for understanding problems and defining scientific measures. Our model's key explanatory mechanism is the adoption of particular perspectives on a 2 × 2 matrix that categorizes the frequency counts of cases by some condition, treatment, risk, or outcome factor. By the selective steps of filtering, framing, and focusing on specific aspects, the measures used in various semantic domains negotiate distinct trade-offs between abstraction and specialization. As a consequence, the transparent communication of such measures must explicate the perspectives encapsulated in their derivation. To demonstrate the explanatory scope of our model, we use it to clarify theoretical debates on biases and facilitation effects in Bayesian reasoning and to integrate the scientific measures from various semantic domains within a unifying framework. A better understanding of problem structures, representational transparency, and the role of perspectives in the scientific process yields both theoretical insights and practical applications. (shrink)

Since the emergence of our species at least, natural selection based on genetic variation has been replaced by culture as the major driving force in human evolution. It has made us what we are today, by ratcheting up cultural innovations, promoting new cognitive skills, rewiring brain networks, and even shifting gene distributions. Adopting an evolutionary perspective can therefore be highly informative for cognitive science in several ways: It encourages us to ask grand questions about the origins and ramifications of our (...) cognitive abilities; it equips us with the means to investigate, explain, and understand key dimensions of cognition; and it allows us to recognize the continued and ubiquitous workings of culture and evolution in everyday instances of cognitive behavior. Taking advantage of this reorientation presupposes a shift in focus, though, from human cognition as a general, homogenous phenomenon to the appreciation of cultural diversity in cognition as an invaluable source of data. (shrink)

An important function of scientific diagrams is to identify causal relationships. This commonly relies on contrasts that highlight the effects of specific difference-makers. However, causal contrast diagrams are not an obvious and easy to recognize category because they appear in many guises. In this paper, four case studies are presented to examine how causal contrast diagrams appear in a wide range of scientific reports, from experimental to observational and even purely theoretical studies. It is shown that causal contrasts can be (...) expressed in starkly different formats, including photographs of complexly visualized macromolecules as well as line graphs, bar graphs, or plots of state spaces. Despite surface differences, however, there is a measure of conceptual unity among such diagrams. In empirical studies they generally serve not only to infer and communicate specific causal claims, but also as evidence for them. The key data of some studies is given nowhere except in the diagrams. Many diagrams show multiple causal contrasts in order to demonstrate both that an effect exists and that the effect is specific -- that is, to narrowly circumscribe the phenomenon to be explained. In a large range of scientific reports, causal contrast diagrams reflect the core epistemic claims of the researchers. (shrink)

The recent discussion on scientific representation has focused on models and their relationship to the real world. It has been assumed that models give us knowledge because they represent their supposed real target systems. However, here agreement among philosophers of science has tended to end as they have presented widely different views on how representation should be understood. I will argue that the traditional representational approach is too limiting as regards the epistemic value of modelling given the focus on the (...) relationship between a single model and its supposed target system, and the neglect of the actual representational means with which scientists construct models. I therefore suggest an alternative account of models as epistemic tools. This amounts to regarding them as concrete artefacts that are built by specific representational means and are constrained by their design in such a way that they facilitate the study of certain scientific questions, and learning from them by means of construction and manipulation. (shrink)

Models such as the simple pendulum, isolated populations, and perfectly rational agents, play a central role in theorising. It is now widely acknowledged that a study of scientific representation should focus on the role of such imaginary entities in scientists’ reasoning. However, the question is most of the time cast as follows: How can fictional or abstract entities represent the phenomena? In this paper, I show that this question is not well posed. First, I clarify the notion of representation, and (...) I emphasise the importance of what I call the “format” of a representation for the inferences agents can draw from it. Then, I show that the very same model can be presented under different formats, which do not enable scientists to perform the same inferences. Assuming that the main function of a representation is to allow one to draw predictions and explanations of the phenomena by reasoning with it, I conclude that imaginary models in abstracto are not used as representations: scientists always reason with formatted representations. Therefore, the problem of scientific representation does not lie in the relationship of imaginary entities with real systems. One should rather focus on the variety of the formats that are used in scientific practice. (shrink)

This paper explores the question of what makes diagrammatic representations effective for human logical reasoning, focusing on how Euler diagrams support syllogistic reasoning. It is widely held that diagrammatic representations aid intuitive understanding of logical reasoning. In the psychological literature, however, it is still controversial whether and how Euler diagrams can aid untrained people to successfully conduct logical reasoning such as set-theoretic and syllogistic reasoning. To challenge the negative view, we build on the findings of modern diagrammatic logic and introduce (...) an Euler-style diagrammatic representation system that is designed to avoid problems inherent to a traditional version of Euler diagrams. It is hypothesized that Euler diagrams are effective not only in interpreting sentential premises but also in reasoning about semantic structures implicit in given sentences. To test the hypothesis, we compared Euler diagrams with other types of diagrams having different syntactic or semantic properties. Experiment compared the difference in performance between syllogistic reasoning with Euler diagrams and Venn diagrams. Additional analysis examined the case of a linear variant of Euler diagrams, in which set-relationships are represented by one-dimensional lines. The experimental results provide evidence supporting our hypothesis. It is argued that the efficacy of diagrams in supporting syllogistic reasoning crucially depends on the way they represent the relational information contained in categorical sentences. (shrink)

Novel computational representations, such as simulation models of complex systems and video games for scientific discovery, are dramatically changing the way discoveries emerge in science and engineering. The cognitive roles played by such computational representations in discovery are not well understood. We present a theoretical analysis of the cognitive roles such representations play, based on an ethnographic study of the building of computational models in a systems biology laboratory. Specifically, we focus on a case of model-building by an engineer that (...) led to a remarkable discovery in basic bioscience. Accounting for such discoveries requires a distributed cognition analysis, as DC focuses on the roles played by external representations in cognitive processes. However, DC analyses by and large have not examined scientific discovery, and they mostly focus on memory offloading, particularly how the use of existing external representations changes the nature of cognitive tasks. In contrast, we study discovery processes and argue that discoveries emerge from the processes of building the computational representation. The building process integrates manipulations in imagination and in the representation, creating a coupled cognitive system of model and modeler, where the model is incorporated into the modeler's imagination. This account extends DC significantly, and we present some of the theoretical and application implications of this extended account. (shrink)

We contend that diagrams are tools not only for communication but also for supporting the reasoning of biologists. In the mechanistic research that is characteristic of biology, diagrams delineate the phenomenon to be explained, display explanatory relations, and show the organized parts and operations of the mechanism proposed as responsible for the phenomenon. Both phenomenon diagrams and explanatory relations diagrams, employing graphs or other formats, facilitate applying visual processing to the detection of relevant patterns. Mechanism diagrams guide reasoning about how (...) the parts and operations work together to produce the phenomenon and what experiments need to be done to improve on the existing account. We examine how these functions are served by diagrams in circadian rhythm research. (shrink)

We discuss external and internal graphical and linguistic representational systems. We argue that a cognitive theory of peoples' reasoning performance must account for (a) the logical equivalence of inferences expressed in graphical and linguistic form, and (b) the implementational differences that affect facility of inference. Our theory proposes that graphical representation limit abstraction and thereby aid “processibility”. We discuss the ideas of specificity and abstraction, and their cognitive relevance. Empirical support both comes from tasks which involve the manipulation of external (...) graphics and tasks that do not. For the former, we take Euler's (1772) circles, provide a novel computational reconstruction, show how it captures abstractions, and contrast it with earlier construals and with Johnson‐Laird's (1983) mental models representations. We demonstrate equivalence of the graphical Euler system, and the nongraphical mental models system. For tasks not involving manipulation of external graphics, we discuss text comprehension, and the mental performance of syllogisms. By positing an internal system with the same specificity as Euler's circles, we cover the mental models data, and generate new empirical predictions. Finally, we consider how the architecture of working memory explains why such specific representations are relatively easy to store. (shrink)

This article proposes a theoretical framework for external representation based problem solving. The Tic‐Tac‐Toe and its isomorphs are used to illustrate the procedures of the framework as a methodology and test the predictions of the framework as a functional model. Experimental results show that the behavior in the Tic‐Tac‐Toe is determined by the directly available information in external and internal representations in terms of perceptual and cognitive biases, regardless of whether the biases are consistent with, inconsistent with, or irrelevant to (...) the task. It is shown that external representations are not merely inputs and stimuli to the internal mind and that they have much more important functions than mere memory aids. A representational determinism is suggested—the form of a representation determines what information can be perceived, what processes can be activated, and what structures can be discovered from the specific representation. (shrink)

Diagrams are a form of spatial representation that supports reasoning and problem solving. Even when diagrams are external, not to mention when there are no external representations, problem solving often calls for internal representations, that is, representations in cognition, of diagrammatic elements and internal perceptions on them. General cognitive architectures—Soar and ACT-R, to name the most prominent—do not have representations and operations to support diagrammatic reasoning. In this article, we examine some requirements for such internal representations and processes in cognitive (...) architectures. We discuss the degree to which DRS, our earlier proposal for such an internal representation for diagrams, meets these requirements. In DRS, the diagrams are not raw images, but a composition of objects that can be individuated and thus symbolized, while, unlike traditional symbols, the referent of the symbol is an object that retains its perceptual essence, namely, its spatiality. This duality provides a way to resolve what anti-imagists thought was a contradiction in mental imagery: the compositionality of mental images that seemed to be unique to symbol systems, and their support of a perceptual experience of images and some types of perception on them. We briefly review the use of DRS to augment Soar and ACT-R with a diagrammatic representation component. We identify issues for further research. (shrink)

This paper reports on objectivity and knowledge production in the process of submitting, revising, and publishing an experimental research article in cognitive neuroscience. The review process, as part of scientific practice, is of particular interest, since it puts the research team in direct dialog with a larger scientific community concerned with fMRI evidence. By bringing this often ‘black‐boxed’ dimension of the manuscript’s production into the picture, I illustrate the role that the visual brain representations played in the practice of scientific (...) fact production. This allows me to point out how the knowledge is constructed through seeing, and how the showing of the fact through images bears traits of the scientific culture of which it is part. (shrink)

Depictive expressions of thought predate written language by thousands of years. They have evolved in communities through a kind of informal user testing that has refined them. Analyzing common visual communications reveals consistencies that illuminate how people think as well as guide design; the process can be brought into the laboratory and accelerated. Like language, visual communications abstract and schematize; unlike language, they use properties of the page (e.g., proximity and place: center, horizontal/up–down, vertical/left–right) and the marks on it (e.g., (...) dots, lines, arrows, boxes, blobs, likenesses, symbols) to convey meanings. The visual expressions of these meanings (e.g., individual, category, order, relation, correspondence, continuum, hierarchy) have analogs in language, gesture, and especially in the patterns that are created when people design the world around them, arranging things into piles and rows and hierarchies and arrays, spatial-abstraction-action interconnections termed spractions. The designed world is a diagram. (shrink)

This experiment investigated the effect of format (line vs. bar), viewers’ familiarity with variables, and viewers’ graphicacy (graphical literacy) skills on the comprehension of multivariate (three variable) data presented in graphs. Fifty-five undergraduates provided written descriptions of data for a set of 14 line or bar graphs, half of which depicted variables familiar to the population and half of which depicted variables unfamiliar to the population. Participants then took a test of graphicacy skills. As predicted, the format influenced viewers’ interpretations (...) of data. Specifically, viewers were more likely to describe x–y interactions when viewing line graphs than when viewing bar graphs, and they were more likely to describe main effects and “z–y” (the variable in the legend) interactions when viewing bar graphs than when viewing line graphs. Familiarity of data presented and individuals’ graphicacy skills interacted with the influence of graph format. Specifically, viewers were most likely to generate inferences only when they had high graphicacy skills, the data were familiar and thus the information inferred was expected, and the format supported those inferences. Implications for multivariate data display are discussed. (shrink)

Problems concerning scientists’ uses of representations have received quite a bit of attention recently. The focus has been on how such representations get their contents and on just what those contents are. Less attention has been paid to what makes certain kinds of scientific representations different from one another and thus well suited to this or that epistemic end. This article considers the latter question with particular focus on the distinction between images and graphs on the one hand and descriptions (...) and related representations on the other. *Received January 2008; revised September 2009. †To contact the author, please write to: Department of Philosophy, Dartmouth College, Hanover, NH 03755; e‐mail: [email protected]. (shrink)

The objective of this essay is to provide the beginning of a principled classification of some of the ways space is intelligently used. Studies of planning have typically focused on the temporal ordering of action, leaving as unaddressed questions of where to lay down instruments, ingredients, work-in-progress, and the like. But, in having a body, we are spatially located creatures: we must always be facing some direction, have only certain objects in view, be within reach of certain others. How we (...) manage the spatial arrangement of items around us is not an afterthought: it is an integral part of the way we think, plan, and behave. The proposed classification has three main categories: spatial arrangements that simplify choice; spatial arrangements that simplify perception; and spatial dynamics that simplify internal computation. The data for such a classification is drawn from videos of cooking, assembly and packing, everyday observations in supermarkets, workshops and playrooms, and experimental studies of subjects playing Tetris, the computer game. This study, therefore, focuses on interactive processes in the medium and short term: on how agents set up their workplace for particular tasks, and how they continuously manage that workplace. (shrink)

Robustness has long been recognized as an important parameter for evaluating game-theoretic results, but talk of ‘robustness’ generally remains vague. What we offer here is a graphic measure for a particular kind of robustness (‘matrix robustness’), using a three-dimensional display of the universe of 2 × 2 game theory. In such a measure specific games appear as specific volumes (Prisoner’s Dilemma, Stag Hunt, etc.), allowing a graphic image of the extent of particular game-theoretic effects in terms of those games. The (...) measure also allows for an easy comparison between different effects in terms of matrix robustness. Here we use the measure to compare the robustness of Tit for Tat’s well-known success in spatialized games (Axelrod, R. (1984). The evolution of cooperation . New York: Basic Books; Grim, P. et al. (1998). The philosophical computer: Exploratory essays in philosophical computer modeling . Cambridge, Mass: MIT Press) with the robustness of a recent game-theoretic model of the contact hypothesis regarding prejudice reduction (Grim et al. 2005. Public Affairs Quarterly, 19 , 95–125). (shrink)

We discuss external and internal graphical and linguistic representational systems. We argue that a cognitive theory of peoples' reasoning performance must account for (a) the logical equivalence of inferences expressed in graphical and linguistic form; and (b) the implementational differences that affect facility of inference. Our theory proposes that graphical representations limit abstraction and thereby aid processibility. We discuss the ideas of specificity and abstraction, and their cognitive relevance. Empirical support comes from tasks (i) involving and (ii) not involving the (...) manipulation of external graphics. For (i), we take Euler's Circles, provide a novel computational reconstruction, show how it captures abstractions, and contrast it with earlier construals, and with Mental Models' representations. We demonstrate equivalence of the graphical Euler system, and the non-graphical Mental Models system. For (ii), we discuss text comprehension, and the mental performance of syllogisms. By positing an internal system with the same specificity as Euler's Circles we cover the Mental Models data, and generate new empirical predictions. Finally, we consider how the architecture of working memory explains why such specific representations are relatively easy to store. (shrink)

Most of us create and use a panoply of non-sentential representations throughout our ordinary lives: we regularly use maps to navigate, charts to keep track of complex patterns of data, and diagrams to visualize logical and causal relations among states of affairs. But philosophers typically pay little attention to such representations, focusing almost exclusively on language instead. In particular, when theorizing about the mind, many philosophers assume that there is a very tight mapping between language and thought. Some analyze utterances (...) as the outer vocalizations of inner thoughts (e.g. Grice 1957, Devitt 2005), while others treat thought as a form of inner speech (e.g. Sellars 1956/1997, Carruthers 2002). But even philosophers who take no stand on the relative priority of language and thought still tend to individuate mental states in terms of the sentences we use to ascribe them. Indeed, Dummett (1993) claims that it is constitutive of analytic philosophy that it approaches the mind by way of language. In many ways, this linguistic model is salutary. Our thoughts are often intimately intertwined with their linguistic expression, and public language does provide a comparatively tractable proxy for, and a window into, the messier realm of thought. However, an exclusive focus on thought as it is expressed in language threatens to leave other sorts of thought unexplained, or even to blind us to their possibility. In particular, many cognitive ethologists and psychologists find it useful to talk about humans, chimpanzees, birds, rats, and even bees as employing cognitive maps. We need to make sense of this way of talking about minds as well as more familiar sentential descriptions. In what follows, I investigate the theoretical and practical possibility of non-sentential thought. Ultimately, I am most interested in the contours of distinctively human thought: what forms does human thought take, and how do those different forms interact? How does human thought compare with that of other animals? In this essay, however, I focus on a narrower and more basic theoretical question: could thought occur in maps? Many philosophers are convinced that in some important sense, thought per se must be language-like.. (shrink)

Thought experiments, models, diagrams, computer simulations, and metaphors can all be understood as tools of the imagination. While these devices are usually treated separately in philosophy of science, this paper provides a unified account according to which tools of the imagination are epistemically good insofar as they improve scientific imaginings. Improving scientific imagining is characterized in terms of epistemological consequences: more improvement means better consequences. A distinction is then drawn between tools being good in retrospect, at the time, and in (...) general. In retrospect, tools are evaluated straightforwardly in terms of the quality of their consequences. At the cutting edge, tools are evaluated positively insofar as there is reason to believe that using them will have good consequences. Lastly, tools can be generally good, insofar as their use encourages the development of epistemic virtues, which are good because they have good epistemic consequences. (shrink)

In silicio design plays a fundamental role in the endeavour to synthesise biological systems. In particular, computer-aided design software enables users to manage the complexity of biological entities that is connected to their construction and reconfiguration. The software’s graphical user interface bridges the gap between the machine-readable data on the algorithmic subface of the computer and its human-amenable surface represented by standardised diagrammatic elements. Notations like the Systems Biology Graphical Notation , together with interactive operations such as drag & drop, (...) allow the user to visually design and simulate synthetic systems as ‘bio-algorithmic signs’. Finally, the digital programming process should be extended to the wet lab to manufacture the designed synthetic biological systems. By exploring the different ‘faces’ of synthetic biology, I argue that in particular computer-aided design is pushing the idea to automatically produce de novo objects. Multifaceted software processes serve mutually aesthetic, epistemic and performative purposes by simultaneously black-boxing and bridging different data sources, experimental operations and community-wide standards. So far, synthetic biology is mainly a product of digital media technologies that structurally mimic the epistemological challenge to take both qualitative as well as quantitative aspects of biological systems into account in order to understand and produce new and functional entities. (shrink)

Constraints and dependencies among the elements of embodied cognition form patterns or microstrategies of interactive behavior. Hard constraints determine which microstrategies are possible. Soft constraints determine which of the possible microstrategies are most likely to be selected. When selection is non-deliberate or automatic the least effort microstrategy is chosen. In calculating the effort required to execute a microstrategy each of the three types of operations, memory retrieval, perception, and action, are given equal weight; that is, perceptual-motor activity does not have (...) a privileged status with respect to memory. Soft constraints can work contrary to the designer's intentions by making the access of perfect knowledge in-the-world more effortful than the access of imperfect knowledge in-the-head. These implications of soft constraints are tested in two experiments. In experiment 1 we varied the perceptual-motor effort of accessing knowledge in-the-world as well as the effort of retrieving items from memory. In experiment 2 we replicated one of the experiment 1 conditions to collect eye movement data. The results suggest that milliseconds matter. Soft constraints lead to a reliance on knowledge in-the-head even when the absolute difference in perceptual-motor versus memory retrieval effort is small, and even when relying on memory leads to a higher error rate and lower performance. We discuss the implications of soft constraints for routine interactive behavior, accounts of embodied cognition, and tool and interface design. (shrink)

The domain of numbers provides a paradigmatic case for investigating interactions of culture, language, and cognition: Numerical competencies are considered a core domain of knowledge, and yet the development of specifically human abilities presupposes cultural and linguistic input by way of counting sequences. These sequences constitute systems with distinct structural properties, the cross-linguistic variability of which has implications for number representation and processing. Such representational effects are scrutinized for two types of verbal numeration systems—general and object-specific ones—that were in parallel (...) use in several Oceanic languages. The analysis indicates that the object-specific systems outperform the general systems with respect to counting and mental arithmetic, largely due to their regular and more compact representation. What these findings reveal on cognitive diversity, how the conjectures involved speak to more general issues in cognitive science, and how the approach taken here might help to bridge the gap between anthropology and other cognitive sciences is discussed in the conclusion. (shrink)

External representations play a crucial role in learning. At the same time, cognitive load theory suggests that the possibility of learning depends on limited resources of the working memory and on cognitive load imposed by instructional design and representation tools. Both these observations motivate a critical look at Computer-Supported Argument Visualization tools that are supposed to facilitate learning. This paper uses cognitive load theory to compare the cognitive efficacy of RationaleTM 2 and AGORA.

In practice, scientists must convey data in a “representational style”. Various authors seek to explain the epistemic role of scientific visual representation in terms of formal conventions. Goodman also tends to dismiss the epistemic relevance of human cognition. My position is that visual conventions are nonarbitrary, in that they play to scientists’ cognitive abilities and limitations. My account draws on Perini's formal analysis, scientific case studies, and empirical literature on global pattern detection in neurotypicals, autistics, and dyslexics.

We present a general cognitive architecture that tightly integrates symbolic, spatial, and visual representations. A key means to achieving this integration is allowing cognition to move freely between these modes, using mental imagery. The specific components and their integration are motivated by results from psychology, as well as the need for developing a functional and efficient implementation. We discuss functional benefits that result from the combination of multiple content-based representations and the specialized processing units associated with them. Instantiating this theory, (...) we then discuss the architectural components and processes, and illustrate the resulting functional advantages in two spatially and visually rich domains. The theory is then compared to other prominent approaches in the area. (shrink)

Our concern is in explaining how and why models give us useful knowledge. We argue that if we are to understand how models function in the actual scientific practice the representational approach to models proves either misleading or too minimal. We propose turning from the representational approach to the artefactual, which implies also a new unit of analysis: the activity of modelling. Modelling, we suggest, could be approached as a specific practice in which concrete artefacts, i.e., models, are constructed with (...) the help of specific representational means and used in various ways, for example, for the purposes of scientific reasoning, theory construction and design of experiments and other artefacts. Furthermore, in this activity of modelling the model construction is intertwined with the construction of new phenomena, theoretical principles and new scientific concepts. We will illustrate these claims by studying the construction of the ideal heat engine by Sadi Carnot. (shrink)

How do vague notions about how one might understand certain physical phenomena get transformed into scientific concepts such as “field”, “quark”, and “gene”? Philosophers of as disparate views as Reichenbach and Feyerabend have held that the process through which scientific concepts emerge is not a reasoned process. In a manner completely mysterious and unanalyzable, scientific concepts emerge fully grown, like Athena from the head of Zeus. However, when one examines actual cases of concept formation in science, a different picture can (...) be painted: Scientific concepts do not pop out of heads, but are constructed in response to specific problems by utilizing methods appropriate to the solution of the problem. Thus, as with other aspects of the scientific enterprise, concept formation is a problem-solving process that involves the application of systematic procedures in the attempt to solve specific problems. It is a reasoned process. (shrink)

The goal of this study was to explore two accounts for why sketching during learning from text is helpful: sketching acts like other constructive strategies such as self-explanation because it helps learners to identify relevant information and generate inferences; or that in addition to these general effects, sketching has more specific benefits due to the pictorial representation that is constructed. Seventy-three seventh-graders were first taught how to either create sketches or self-explain while studying science texts. During a subsequent learning phase, (...) all students were asked to read an expository text about the greenhouse effect. Finally, they were asked to write down everything they remembered and then answer transfer questions. Strategy quality during learning was assessed as the number of key concepts that had either been sketched or mentioned in the self-explanations. The results showed that at an overall performance level there were only marginal group differences. However, a more in-depth analysis revealed that whereas no group differences emerged for students implementing either strategy poorly, the sketching group clearly outperformed the self-explanation group for students who applied the strategies with higher quality. Furthermore, higher sketching quality was strongly related to better learning outcomes. Thus, the study's results are more in line with the second account: Sketching can have a beneficial effect on learning above and beyond generating written explanations; at least, if well deployed. (shrink)

Mechanical systems have structural organizations—parts, and their relations—and functional organizations—temporal, dynamic, and causal processes—which can be explained using text or diagrams. Two experiments illustrate the role of arrows in diagrams of mechanical systems. In Experiment 1, people described diagrams with or without arrows, interpreting diagrams without arrows as conveying structural information and diagrams with arrows as conveying functional information. In Experiment 2, people produced sketches of mechanical systems from structural or functional descriptions. People spontaneously used arrows to indicate functional processes (...) in diagrams. Arrows can play a powerful role in augmenting structural diagrams to convey dynamic, causal, or functional information. (shrink)