The objective of this paper is to characterize the rich interplay between automatic and cognitive control processes that we propose is the hallmark of skill, in contrast to habit, and what accounts for its flexibility. We argue that this interplay isn't entirely hierarchical and static, but rather heterarchical and dynamic. We further argue that it crucially depends on the acquisition of detailed and well-structured action representations and internal models, as well as the concomitant development of metacontrol processes that can be (...) used to shape and balance it. (shrink)

This is a piece written for interdisciplinary audiences and contains very little philosophy. It looks into whether, or in what sense, pains and pleasures are emotions.

Human behavior is the joint product of (i) contingencies of survival responsible for natural selection, and (ii) contingencies of reinforcement responsible for the repertoires of individuals, including (iii) the special contingencies maintained by an evolved social environment. Selection by consequences is a causal mode found only in living things, or in machines made by living things. It was first recognized in natural selection: Reproduction, a first consequence, led to the evolution of cells, organs, and organisms reproducing themselves under increasingly diverse (...) conditions. The behavior functioned well, however, only under conditions similar to those under which it was selected.Reproduction under a wider range of consequences became possible with the evolution of processes through which organisms acquired behavior appropriate to novel environments. One of these, operant conditioning, is a second kind of selection by consequences: New responses could be strengthened by events which followed them. When the selecting consequences are the same, operant conditioning and natural selection work together redundantly. But because a species which quickly acquires behavior appropriate to an environment has less need for an innate repertoire, operant conditioning could replace as well as supplement the natural selection of behavior.Social behavior is within easy range of natural selection, because other members are one of the most stable features of the environment of a species. The human species presumably became more social when its vocal musculature came under operant control. Verbal behavior greatly increased the importance of a third kind of selection by consequences, the evolution of social environments or cultures. The effect on the group, and not the reinforcing consequences for individual members, is responsible for the evolution of culture. (shrink)

The sense of agency is a basic feature of our subjective experience. Experimental studies usually focus on either its attributional aspects or on its motoric aspects. Here, we combine both aspects and focus on the subjective experience of the time between action and effect. Previous studies [Haggard, P., Aschersleben, G., Gehrke, J., & Prinz, W.. Action, binding and awareness. In W. Prinz, & B. Hommel, Common mechanisms in perception and action: Attention and performance. Oxford: Oxford University Press] have shown a (...) temporal attraction in the perceived times of actions and effects, but did directly not study the relation between them. In three experiments, time estimates of an interval between an action and its subsequent sensory effect were obtained. The actions were either voluntary key press actions performed by the participant or kinematically identical movements applied passively to the finger. The effects were either auditory or visual events or a passive movement induced to another finger. The results first indicated a shortening of the interval between one’s own voluntary action and a subsequent effect, relative to passive movement conditions. Second, intervals initiated by observed movements, either of another person or of an inanimate object, were always perceived like those involving passive movements of one’s own body, and never like those involving active movements. Third, this binding effect was comparable for auditory, somatic and visual effects of action. Our results provide the first direct evidence that agency involves a generalisable relation between actions and their consequences, and is triggered by efferent motor commands. (shrink)

I consider how complex logical operations might self-assemble in a signalling-game context via composition of simpler underlying dispositions. On the one hand, agents may take advantage of pre-evolved dispositions; on the other hand, they may co-evolve dispositions as they simultaneously learn to combine them to display more complex behaviour. In either case, the evolution of complex logical operations can be more efficient than evolving such capacities from scratch. Showing how complex phenomena like these might evolve provides an additional path to (...) the possibility of evolving more or less rich notions of compositionality. This helps provide another facet of the evolutionary story of how sufficiently rich, human-level cognitive or linguistic capacities may arise from simpler precursors. 1Signalling and Self-assembly2Simple Unary Logic Games3Composing Unary Functions for Binary Inputs 3.1Utilizing pre-evolved dispositions3.2Co-evolving logical dispositions3.3Learning appropriate outputs3.4Taking account of the full state-space of unary games3.5Role-free composition4Discussion 4.1Efficacy and efficiency of learning complex dispositions4.2Other binary operations4.3To infinity and beyond5Conclusion. (shrink)

The way people come to report private stimulation (e.g., feeling states) arising within their own bodies is not well understood. Although the Darwinian assumption of biological continuity has been the basis of extensive animal modeling for many human biological and behavioral phenomena, few have attempted to model human communication based on private stimulation. This target article discusses such an animal model using concepts and methods derived from the study of discriminative stimulus effects of drugs and recent research on interanimal communication. (...) We discuss how humans acquire the capacity to identify and report private stimulation and we analyze intra- and interspecies differences in neurochemical mechanisms for transducing interoceptive stimuli, enzymatic and other metabolic factors, learning ability, and discrimination learning histories and their relation to psychiatric and developmental disabilities. (shrink)

Theories of rational decision making often abstract away from computational and other resource limitations faced by real agents. An alternative approach known as resource rationality puts such matters front and center, grounding choice and decision in the rational use of finite resources. Anticipated by earlier work in economics and in computer science, this approach has recently seen rapid development and application in the cognitive sciences. Here, the theory of rationality plays a dual role, both as a framework for normative assessment (...) and as a source of scientific hypotheses about how mental processes in fact work. The latter project, often called rational analysis, depends for its success on a fine-grained characterization of the computational problem facing a decision maker, which may in turn depend on realistic assumptions about what the relevant agent is like. As a consequence, resource rationality involves a delicate, but often fruitful interplay between the normative and the descriptive. (shrink)

In the recent history of psychology and cognitive neuroscience, the notion of habit has been reduced to a stimulus-triggered response probability correlation. In this paper we use a computational model to present an alternative theoretical view (with some philosophical implications), where habits are seen as self-maintaining patterns of behavior that share properties in common with self-maintaining biological processes, and that inhabit a complex ecological context, including the presence and influence of other habits. Far from mechanical automatisms, this organismic and self-organizing (...) concept of habit can overcome the dominating atomistic and statistical conceptions, and the high temporal resolution effects of situatedness, embodiment and sensorimotor loops emerge as playing a more central, subtle and complex role in the organization of behavior. The model is based on a novel “iterant deformable sensorimotor medium” (IDSM), designed such that trajectories taken through sensorimotor-space increase the likelihood that in the future, similar trajectories will be taken. We couple the IDSM to sensors and motors of a simulated body and environment and show that under certain conditions, the IDSM forms self-maintaining patterns of activity that operate across the IDSM, the body, and the environment. We present various environments and the resulting habits that form in them. The model acts as an abstraction of habits at a much needed sensorimotor “meso-scale” between microscopic neuron-based models and macroscopic descriptions of behavior. Finally, we discuss how this model and extensions of it can help us understand aspects of behavioral self-organization, historicity and autonomy that remain out of the scope of contemporary representationalist frameworks. (shrink)

Studies of animal culture have not normally included a consideration of cetaceans. However, with several long-term field studies now maturing, this situation should change. Animal culture is generally studied by either investigating transmission mechanisms experimentally, or observing patterns of behavioural variation in wild populations that cannot be explained by either genetic or environmental factors. Taking this second, ethnographic, approach, there is good evidence for cultural transmission in several cetacean species. However, only the bottlenose dolphin (Tursiops) has been shown experimentally to (...) possess sophisticated social learning abilities, including vocal and motor imitation; other species have not been studied. There is observational evidence for imitation and teaching in killer whales. For cetaceans and other large, wide-ranging animals, excessive reliance on experimental data for evidence of culture is not productive; we favour the ethnographic approach. The complex and stable vocal and behavioural cultures of sympatric groups of killer whales (Orcinus orca) appear to have no parallel outside humans, and represent an independent evolution of cultural faculties. The wide movements of cetaceans, the greater variability of the marine environment over large temporal scales relative to that on land, and the stable matrilineal social groups of some species are potentially important factors in the evolution of cetacean culture. There have been suggestions of gene-culture coevolution in cetaceans, and culture may be implicated in some unusual behavioural and life-history traits of whales and dolphins. We hope to stimulate discussion and research on culture in these animals. (shrink)

I introduce an extension of the Lewis-Skyrms signaling game, analysed from a dynamical perspective via simple reinforcement learning. In Lewis’ (Convention, Blackwell, Oxford, 1969) conception of a signaling game, salience is offered as an explanation for how individuals may come to agree upon a linguistic convention. Skyrms (Signals: evolution, learning & information, Oxford University Press, Oxford, 2010a) offers a dynamic explanation of how signaling conventions might arise presupposing no salience whatsoever. The extension of the atomic signaling game examined here—which I (...) will refer to as a salience game—introduces a variable parameter into the atomic signaling game which allows for degrees of salience, thus filling in the continuum between Skyrms’ and Lewis’ models. The model does not presuppose any salience at the outset, but illustrates a process by which accidentally evolved salience is amplified, to the benefit of the players. It is shown that increasing degrees of salience allow populations to avoid sub-optimal pooling equilibria and to coordinate upon conventions more quickly. (shrink)

A popular goal in psychological science is to understand human cognition and behavior in the ‘real-world.’ In contrast, researchers have typically conducted their research in experimental research settings, a.k.a. the ‘psychologist’s laboratory.’ Critics have often questioned whether psychology’s laboratory experiments permit generalizable results. This is known as the ‘real-world or the lab’-dilemma. To bridge the gap between lab and life, many researchers have called for experiments with more ‘ecological validity’ to ensure that experiments more closely resemble and generalize to the (...) ‘real-world.’ However, researchers seldom explain what they mean with this term, nor how more ecological validity should be achieved. In our opinion, the popular concept of ecological validity is ill-formed, lacks specificity, and falls short of addressing the problem of generalizability. To move beyond the ‘real-world or the lab’-dilemma, we believe that researchers in psychological science should always specify the particular context of cognitive and behavioral functioning in which they are interested, instead of advocating that experiments should be more ‘ecologically valid’ in order to generalize to the ‘real-world.’ We believe this will be a more constructive way to uncover the context-specific and context-generic principles of cognition and behavior. (shrink)

Basic affects reflect the diversity of satisfactions and discomforts that are inherited tools for living from our ancestral past. Affects are neurobiologically-ingrained potentials of the nervous system, which are triggered, moulded and refined by life experiences. Cognitive, information- processing approaches and computational metaphors cannot penetrate foundational affective processes. Animal models allow us to empirically analyse the large-scale neural ensembles that generate emotional-action dynamics that are critically important for creating emotional feelings. Such approaches offer robust neuro-epistemological strategies to decode the fundamental (...) nature of affects in all mammals, including humans, but they remain to be widely implemented. Here I summarize how we can develop a cross-species affective neuroscience that probes the neural nature of emotional affective states by studying the instinctual emotional apparatus of the mammalian body and brain. Affective feelings and emotional actions may reflect the dynamics of the primal viscero-somatic homunculus of SELF-representation. (shrink)

Biosemiotics deals with the processes of signs in all dimensions of nature. Semiosis is the primary form of intelligence. Intelligent behaviour becomes immediately understandable in this approach because semiosis combines causality with the triadic structure of the semiotic sign. Intelligence is a process created in a given context. In the course of evolution organisms have learned to create increasingly sophisticated internal representations of external state. Semiosis is the precursor of the emergence of a feature we consider intelligence. Biosemiotics also draws (...) attention to the distributed intelligence, which relies on external semiotic scaffoldings as much as on the subject’s abilities and knowledge. (shrink)

This paper applies the theoretical criteria laid out by D’Arms et al. to various aspects of evolutionary models of signalling. The question that D’Arms et al. seek to answer can be formulated as follows: Are the models that we use to explain the phenomena in question conceptually adequate? The conceptual adequacy question relates the formal aspects of the model to those aspects of the natural world that the model is supposed to capture. Moreover, this paper extends the analysis of D’Arms (...) et al. by asking the following additional question: Are the models that we use sufficient to explain the phenomena in question? The sufficiency question asks what formal resources are minimally required for the model to get the right results most of the time. (shrink)

Brandom’s inferentialism offers, in many ways, a radically new approach to old issues in semantics and the theory of intentionality. But, in one respect at least, it clings tenaciously to the mainstream philosophical tradition of the middle years of the twentieth century. Against the theory’s natural tendencies, Brandom aligns it with the ’linguistic turn’ that philosophy took in the middle of the last century by insisting, in the face of considerable opposing evidence, that intentionality is the preserve of those who (...) can offer and ask for reasons and thus of language users alone. In this paper, I argue that there is no good reason for giving inferentialism a linguistic twist, and that, in doing so, Brandom is forced to make claims which are implausible in themselves and lead him, in the attempt to mitigate them, to a number of doubtful expedients. (shrink)

Maximization theory, which is borrowed from economics, provides techniques for predicing the behavior of animals - including humans. A theoretical behavioral space is constructed in which each point represents a given combination of various behavioral alternatives. With two alternatives - behavior A and behavior B - each point within the space represents a certain amount of time spent performing behavior A and a certain amount of time spent performing behavior B. A particular environmental situation can be described as a constraint (...) on available points (a circumscribed area) within the space. Maximization theory assumes that animals always choose the available point with the highest numerical value. The task of maximization theory is to assign to points in the behavioral space values that remain constant across various environmental situations; as those situations change, the point actually chosen is always the one with the highest assigned value. (shrink)

By the late 1990s, several converging trends in economics, psychology, and neuroscience had set the stage for the birth of a new scientific field known as “neuroeconomics”. Without the availability of an extensive variety of experimental designs for dealing with individual and social decision-making provided by experimental economics and psychology, many neuroeconomics studies could not have been developed. At the same time, without the significant progress made in neuroscience for grasping and understanding brain functioning, neuroeconomics would have never seen the (...) light of day. The paper is an overview of the main significant advances in the knowledge of brain functioning by neuroscience that have contributed to the emergence of neuroeconomics and its rise over the past two decades. These advances are grouped over three non-independent topics referred to as the “emo-rational” brain, “social” brain, and “computational” brain. For each topic, it emphasizes findings considered as critical to the birth and development of neuroeconomics while highlighting some of prominent questions about which knowledge should be improved by future research. In parallel, it shows that the boundaries between neuroeconomics and several recent sub-fields of cognitive neuroscience, such as affective, social, and more generally, decision neuroscience, are rather porous. (shrink)

Causal reasoning is one of our most central cognitive competencies, enabling us to adapt to our world. Causal knowledge allows us to predict future events, or diagnose the causes of observed facts. We plan actions and solve problems using knowledge about cause-effect relations. Without our ability to discover and empirically test causal theories, we would not have made progress in various empirical sciences. In the past decades, the important role of causal knowledge has been discovered in many areas of cognitive (...) psychology. Despite the ubiquity of causal reasoning, textbooks of cognitive psychology have neglected this growing field. The goal of The Oxford Handbook of Causal Reasoning is to fill this gap. The handbook brings together the leading researchers in the field of causal reasoning and offers state-of-the-art presentations of theories and research. It provides introductions of competing theories of causal reasoning, and discusses its role in various cognitive functions and domains. The final section presents research from neighboring fields. 1. Causal Reasoning: An Introduction Michael R. Waldmann Part I: Theories of Causal Cognition 2. Associative Accounts of Causal Cognition Mike E. Le Pelley, Oren Griffiths, and Tom Beesley 3. Rules of Causal Judgment: Mapping Statistical Information Onto Causal Beliefs José C. Perales, Andrés Catena, Antonio Cándido, and Antonio Maldonado 4. The Inferential Reasoning Theory of Causal Learning: Toward a Multi- Process Propositional Account Yannick Boddez, Jan De Houwer, and Tom Beckers 5. Causal Invariance as an Essential Constraint for Creating a Causal Representation of the World: Generalizing the Invariance of Causal Power Patricia W. Cheng and Hongjing Lu 6. The Acquisition and Use of Causal Structure Knowledge Benjamin Margolin Rottman 7. Formalizing Prior Knowledge in Causal Induction Thomas L. Griffiths 8. Causal Mechanisms Samuel G. B. Johnson and Woo-kyoung Ahn 9. Force Dynamics and Causation Phillip Wolff and Robert Thorstad 10. Mental Models and Causation P. N. Johnson- Laird and Sangeet S. Khemlani 11. Pseudocontingencies Klaus Fiedler and Florian Kutzner 12. Singular Causation David Danks 13. Cognitive Neuroscience of Causal Reasoning Joachim T. Operskalski and Aron K. Barbey Part II: Basic Cognitive Functions 14. Visual Impressions of Causality Peter White 15. Goal-Directed Actions Bernhard Hommel 16. Planning and Control Magda Osman 17. Reinforcement Learning and Causal Models Samuel J. Gershman 18. Causation and the Probability of Causal Conditionals David E. Over 19. Causal Models and Conditional Reasoning Mike Oaksford and Nick Chater 20. Concepts as Causal Models: Categorization Bob Rehder 21. Concepts as Causal Models: Induction Bob Rehder 22. Causal Explanation Tania Lombrozo and Nadya Vasilyeva 23. Diagnostic Reasoning Björn Meder and Ralf Mayrhofer 24. Inferring Causal Relations by Analogy Keith J. Holyoak and Hee-Seung Lee 25. Causal Argument Ulrike Hahn, Roland Bluhm, and Frank Zenker 26. Causality in Decision- Making York Hagmayer and Philip M. Fernbach Part III: Domains of Causal Reasoning 27. Intuitive Theories Tobias Gerstenberg and Joshua B. Tenenbaum 28. Space, Time, and Causality Marc J. Buehner 29. Causation in Legal and Moral Reasoning David A. Lagnado and Tobias Gerstenberg 30. The Role of Causal Knowledge in Reasoning About Mental Disorders Woo-kyoung Ahn, Nancy S. Kim, and Matthew S. Lebowitz 31. Causality and Causal Reasoning in Natural Language Torgrim Solstad and Oliver Bott 32. Social Attribution and Explanation Denis Hilton Part IV: Development, Phylogeny, and Culture 33. The Development of Causal Reasoning Paul Muentener and Elizabeth Bonawitz 34. Causal Reasoning in Non-Human Animals Christian Schloegl and Julia Fischer 35. Causal Cognition and Culture Andrea Bender, Sieghard Beller, and Douglas L. Medin. (shrink)

The concept of creativity is a central one in folk psychological explanation and has long been prominent in philosophical debates about the nature of art, genius, and the imagination. The scientific investigation of creativity in humans is also well established, and there has been increasing interest in the question of whether the concept can be rigorously applied to non-human animals. In this paper, I argue that such applications face serious challenges of both a conceptual and methodological character, reflecting deep controversies (...) within both philosophy and psychology concerning how to define and apply the concept of creativity. After providing a brief review of some of the leading theories of creativity and discussing some of the strongest putative cases of creative intelligence in non-human animals, I examine some of the more worrisome difficulties faced by attempts to use these theories to answer the question of whether animals are truly creative. I conclude by examining how we might overcome them, and suggest that one approach worth taking seriously is to adopt what I term a Strong Rejectionist view of creativity, eschewing use of the term entirely in the scientific study of comparative cognition. (shrink)

To function well in an unpredictable environment using unreliable components, a system must have a high degree of robustness. Robustness is fundamental to biological systems and is an objective in the design of engineered systems such as airplane engines and buildings. Cognitive systems, like biological and engineered systems, exist within variable environments. This raises the question, how do cognitive systems achieve similarly high degrees of robustness? The aim of this study was to identify a set of mechanisms that enhance robustness (...) in cognitive systems. We identify three mechanisms that enhance robustness in biological and engineered systems: system control, redundancy, and adaptability. After surveying the psychological literature for evidence of these mechanisms, we provide simulations illustrating how each contributes to robust cognition in a different psychological domain: psychomotor vigilance, semantic memory, and strategy selection. These simulations highlight features of a mathematical approach for quantifying robustness, and they provide concrete examples of mechanisms for robust cognition. (shrink)

Neuroeconomics is the newest of the economic sciences with a focus on how the embodied human brain interacts with its institutional and social environment to make economic decisions. This paper presents an overview of neuroeconomics methods and reviews a number of results in this emerging field of study.

Despite the fact that animal behavior involves a particularly powerful form of niche construction, few researchers have considered how the environmental impact of behavior may feed back to influence the evolution of the cognitive underpinnings of behavior. I explore a model that explicitly incorporates niche construction while tracking cognitive evolution. Agents and their stimuli are modeled as coevolving populations. The agents are born with “weights” attached to behaviors in a repertoire. Further, these agents are able to change these weights based (...) on previous success and an inherited learning parameter. Both the agent and the stimulus receive payoffs through a behavioral interaction . The behaving agent exhibits niche construction through its effects on stimuli , which can feed back to influence the value of different cognitive strategies. Here I focus on two forms of niche construction: the stimulus and responding agent have common interests and the stimulus and agent have dissimilar interests . The form of niche construction qualitatively affects cognitive evolution . Given a mutualism between the stimulus and responding agent, rapid learning and “fixed” behavioral distributions evolve. Given an antagonism between the stimulus and agent, slower learning and “flexible” behavioral distributions evolve. I discuss these results in light of findings from the fields of ethology, psychology, and evolutionary ecology. (shrink)

La ciencia cognitiva ha evolucionado bastante y, en la actualidad, ha logrado generar grandes cambios en el pensamiento filosófico que, referido al ámbito científico, nos permite indagar respecto al proceso de generar ciencia y conocer mejor cómo ocurre la elección de teorías científicas; algo que por mucho tiempo fue entendido por los filósofos como un proceso puramente racional, en el que no había cabida para las emociones, pero ahora podemos decir que esto ha cambiado significativamente, dándole a los científicos su (...) lugar como seres humanos más que como entidades lógicas. (shrink)

Despite countless anecdotes and the historical significance of insight as a problem solving mechanism, its nature has long remained elusive. The conscious experience of insight is notoriously difficult to trace in non-verbal animals. Although studying insight has presented a significant challenge even to neurobiology and psychology, human neuroimaging studies have cleared the theoretical landscape, as they have begun to reveal the underlying mechanisms. The study of insight in non-human animals has, in contrast, remained limited to innovative adjustments to experimental designs (...) within the classical approach of judging cognitive processes in animals, based on task performance. This leaves no apparent possibility of ending debates from different interpretations emerging from conflicting schools of thought. We believe that comparative cognition has thus much to gain by embracing advances from neuroscience and human cognitive psychology. We will review literature on insight and discuss the consequences of these findings to comparative cognition. (shrink)