Recent work in cognitive and computational neuroscience depicts human brains as devices that minimize prediction error signals: signals that encode the difference between actual and expected sensory stimulations. This raises a series of puzzles whose common theme concerns a potential misfit between this bedrock informationtheoretic vision and familiar facts about the attractions of the unexpected. We humans often seem to actively seek out surprising events, deliberately harvesting novel and exciting streams of sensory stimulation. Conversely, we often experience some wellexpected sensations (...) as unpleasant and to-be-avoided. In this paper, I explore several core and variant forms of this puzzle, using them to display multiple interacting elements that together deliver a satisfying solution. That solution requires us to go beyond the discussion of simple information-theoretic imperatives and to recognize the essential role of species-specific prestructuring, epistemic foraging, and cultural practices in shaping the restless, curious, novelty-seeking human mind. (shrink)

Ryan Tonkens has issued a seemingly impossible challenge, to articulate a comprehensive ethical framework within which artificial moral agents satisfy a Kantian inspired recipe—"rational" and "free"—while also satisfying perceived prerogatives of machine ethicists to facilitate the creation of AMAs that are perfectly and not merely reliably ethical. This series of papers meets this challenge by landscaping traditional moral theory in resolution of a comprehensive account of moral agency. The first paper established the challenge and set out autonomy in Aristotelian terms. (...) The present paper interprets Kantian moral theory on the basis of the preceding introduction, argues contra Tonkens that an engineer does not violate the categorical imperative in creating Kantian AMAs, and proposes that a Kantian AMA is not only a possible goal for Machine ethics research, but a necessary one. (shrink)

In this essay we aim to present some considerations regarding a minimal but concrete notion of agency and goal-directed behavior that are useful for characterizing biological systems at different scales. These considerations are a particular perspective, bringing together concepts from dynamical systems, combinatorial problem-solving, and connectionist learning with an emphasis on the relationship between parts and wholes. This perspective affords some ways to think about agents that are concrete and quantifiable, and relevant to some important biological issues. Instead of advocating (...) for a strict definition of minimally agential characteristics, we focus on how (even for a modest notion of agency) the agency of a system can be more than the sum of the agency of its parts. We quantify this in terms of the problem-solving competency of a system with respect to resolution of the frustrations between its parts. This requires goal-directed behavior in the sense of delayed gratification, i.e., taking dynamical trajectories that forego short-term gains (or sustain short-term stress or frustration) in favor of long-term gains. In order for this competency to belong to the system (rather than to its parts or given by its construction or design), it can involve distributed systemic knowledge that is acquired through experience, i.e., changes in the organization of the relationships among its parts (without presupposing a system-level reward function for such changes). This conception of agency helps us think about the ways in which cells, organisms, and perhaps other biological scales, can be agential (i.e., more agential than their parts) in a quantifiable sense, without denying that the behavior of the whole depends on the behaviors of the parts in their current organization. (shrink)

The target article “Thinking Through Other Minds” (TTOM) offered an account of the distinctively human capacity to acquire cultural knowledge, norms, and practices. To this end, we leveraged recent ideas from theoretical neurobiology to understand the human mind in social and cultural contexts. Our aim was bothsynthetic– building an integrative model adequate to account for key features of cultural learning and adaptation; andprescriptive– showing how the tools developed to explain brain dynamics can be applied to the emergence of social and (...) cultural ecologies of mind. In this reply to commentators, we address key issues, including: (1) refining the concept of culture to show how TTOM and the free-energy principle (FEP) can capture essential elements of human adaptation and functioning; (2) addressing cognition as an embodied, enactive, affective process involving cultural affordances; (3) clarifying the significance of the FEP formalism related to entropy minimization, Bayesian inference, Markov blankets, and enactivist views; (4) developing empirical tests and applications of the TTOM model; (5) incorporating cultural diversity and context at the level of intra-cultural variation, individual differences, and the transition to digital niches; and (6) considering some implications for psychiatry. The commentators’ critiques and suggestions point to useful refinements and applications of the model. In ongoing collaborations, we are exploring how to augment the theory with affective valence, take into account individual differences and historicity, and apply the model to specific domains including epistemic bias. (shrink)

Current theories propose that our sense of curiosity is determined by the learning progress or information gain that our cognitive system expects to make. However, few studies have explicitly tried to quantify subjective information gain and link it to measures of curiosity. Here, we asked people to report their curiosity about the intrinsically engaging perceptual ‘puzzles’ known as Mooney images, and to report on the strength of their aha experience upon revealing the solution image (curiosity relief). We also asked our (...) participants (279) to make a guess concerning the solution of the image, and used the distribution of these guesses to compute the crowdsourced semantic entropy (or ambiguity) of the images, as a measure of the potential for information gain. Our results confirm that curiosity and, even more so, aha experience is substantially associated with this semantic information gain measure. These findings support the expected information gain theory of curiosity and suggest that the aha experience or intrinsic reward is driven by the actual information gain. In an unannounced memory part, we also established that the often reported influence of curiosity on memory is fully mediated by the aha experience or curiosity relief. We discuss the implications of our results for the burgeoning fields of curiosity and psychoaesthetics. (shrink)

Recurrent, unvarying, and seemingly purposeless patterns of action and cognition are part of normal development, but also feature prominently in several neuropsychiatric conditions. Repetitive stereotyped behaviors can be viewed as exaggerated forms of learned habits and frequently correlate with alterations in motor, limbic, and associative basal ganglia circuits. However, it is still unclear how altered basal ganglia feedback signals actually relate to the phenomenological variability of RSBs. Why do behaviorally overlapping phenomena sometimes require different treatment approaches−for example, sensory shielding strategies (...) versus exposure therapy for autism and obsessive-compulsive disorder, respectively? Certain clues may be found in recent models of basal ganglia function that extend well beyond action selection and motivational control, and have implications for sensorimotor integration, prediction, learning under uncertainty, as well as aesthetic learning. In this paper, we systematically compare three exemplary conditions with basal ganglia involvement, obsessive-compulsive disorder, Parkinson’s disease, and autism spectrum conditions, to gain a new understanding of RSBs. We integrate clinical observations and neuroanatomical and neurophysiological alterations with accounts employing the predictive processing framework. Based on this review, we suggest that basal ganglia feedback plays a central role in preconditioning cortical networks to anticipate self-generated, movement-related perception. In this way, basal ganglia feedback appears ideally situated to adjust the salience of sensory signals through precision weighting of new sensory information, relative to the precision of predictions based on prior generated models. Accordingly, behavioral policies may preferentially rely on new data versus existing knowledge, in a spectrum spanning between novelty and stability. RSBs may then represent compensatory or reactive responses, respectively, at the opposite ends of this spectrum. This view places an important role of aesthetic learning on basal ganglia feedback, may account for observed changes in creativity and aesthetic experience in basal ganglia disorders, is empirically testable, and may inform creative art therapies in conditions characterized by stereotyped behaviors. (shrink)

Predictive processing theories are increasingly popular in philosophy of mind; such process theories often gain support from the Free Energy Principle —a normative principle for adaptive self-organized systems. Yet there is a current and much discussed debate about conflicting philosophical interpretations of FEP, e.g., representational versus non-representational. Here we argue that these different interpretations depend on implicit assumptions about what qualifies as representational. We deploy the Free Energy Principle instrumentally to distinguish four main notions of representation, which focus on organizational, (...) structural, content-related and functional aspects, respectively. The various ways that these different aspects matter in arriving at representational or non-representational interpretations of the Free Energy Principle are discussed. We also discuss how the Free Energy Principle may be seen as a unified view where terms that traditionally belong to different ontologies—e.g., notions of model and expectation versus notions of autopoiesis and synchronization—can be harmonized. However, rather than attempting to settle the representationalist versus non-representationalist debate and reveal something about what representations are simpliciter, this paper demonstrates how the Free Energy Principle may be used to reveal something about those partaking in the debate; namely, what our hidden assumptions about what representations are—assumptions that act as sometimes antithetical starting points in this persistent philosophical debate. (shrink)

The surprise minimization principle has been applied to explain various cognitive processes in humans. Originally describing perceptual and active inference, the framework has been applied to different types of decision making including long-term policies, utility maximization and exploration. This analysis extends the application of surprise minimization to a multi-agent setup and shows how it can explain the emergence of social rules and cooperation. We further show that in social decision-making and political policy design, surprise minimization is superior in many aspects (...) to the classical approach of maximizing utility. Surprise minimization shows directly what value freedom of choice can have for social agents and why, depending on the context, they enter into cooperation, agree on social rules, or do nothing of the kind. (shrink)

At least two distinct modeling frameworks contribute to the view that mind and brain are Bayesian: Bayesian Rational Analysis (BRA) and Hierarchical Predictive Coding (HPC). What is the relative contribution of each, and how exactly do they relate? In order to answer this question, we compare the way in which these two modeling frameworks address different levels of analysis within Marr’s tripartite conception of explanation in cognitive science. Whereas BRA answers questions at the computational level only, many HPC-theorists answer questions (...) at the computational, algorithmic, and implementational levels simultaneously. Given that all three levels of analysis need to be addressed in order to explain a behavioral or cognitive phenomenon, HPC seems to deliver more complete explanations. Nevertheless, BRA is well-suited for providing a solution to the dark room problem, a major theoretical obstacle for HPC. A combination of the two approaches also combines the benefits of an embodied-externalistic approach to resolving the dark room problem with the idea of a persisting evidentiary border beyond which matters are out of cognitive reach. For this reason, the development of explanations spanning all three Marrian levels within the general Bayesian approach may require combining the BRA and HPC modeling frameworks. (shrink)

Perceiving an armchair prepares us to sit. Reading the first line in a text prepares us to read it. This article proposes that the affordance construct used to explain reactive potentiation of behavior similarly applies to reactive potentiation of cognitive actions. It defends furthermore that, in both cases, affordance-sensings do not only apply to selective (dis)engagement, but also to the revision and the termination of actions. In the first section, characteristics of environmental affordance-sensings such as directness, stability, action potentiation, valence, (...) and phenomenology are reexamined in light of contemporary cognitive science. In the second section, it is proposed that cognitive affordance-sensings can also be characterized along these dimensions. Called “metacognitive feelings” in the metacognitive literature, their function is to select, engage, revise and post-evaluate cognitive actions. A third section discusses alternative views, and responds to objections. (shrink)

The aim of this paper is to present the ontic approach to the normativity of cognitive functions and mechanisms, which is directly related to the understanding of biological normativity in terms of normative mechanisms. This approach assumes the hypothesis that cognitive processes contain a certain normative component independent of external attributions and researchers’ beliefs. This component consists of specific cognitive mechanisms, which I call normative. I argue that a mechanism is normative when it constitutes given actions or behaviors of a (...) system. More precisely, it means that, on the one hand, it is their constitutive cause, and on the other hand, it determines a certain field of possibilities from which the system, guided by its own goals, preferences, environmental constraints, etc., chooses the appropriate action or behavior according to a given situation. The background for the analyses presented here is the predictive processing framework, in which it can be shown that at least some of the predictive mechanisms are in fact normative mechanisms. I refer here to the existence of a motivational relation which determines the normative dependence of the agent’s actions due to specific predictions and environmental constraints. (shrink)

In experimental cognitive psychology, objects of inquiry are typically operationalized with psychological tasks. When interpreting results from such tasks, we focus primarily on behavioral measures such as reaction times and accuracy rather than experiences – i.e., phenomenology – associated with the task, and posit that the tasks elicit the desired cognitive phenomenon. Evaluating whether the tasks indeed elicit the desired phenomenon can be facilitated by understanding the experience during task performance. In this paper we explore the breadth of experiences that (...) are elicited by and accompany task performance using in-depth phenomenological and qualitative methodology to gather subjective reports during the performance of a visuo-spatial change detection task. Thirty-one participants were asked to remember either colors, orientations or positions of the presented stimuli and recall them after a short delay. Qualitative reports revealed rich experiential landscapes associated with the task-performance, suggesting a distinction between two broad classes of experience: phenomena at the front of consciousness and background feelings. The former includes cognitive strategies and aspects of metacognition, whereas the latter include more difficult-to-detect aspects of experience that comprise the overall sense of experience. We focus primarily on the background feelings, since strategies of task-performance to a large extent map onto previously identified cognitive processes and discuss the methodological implications of our findings. (shrink)

This article proposes how theatre, as a site of expert adult imaginative play, provides a unique window into how E-cognition can advance our understanding of imagination as a lifelong practice. I characterize theatrical activity as highly developed actions and strategies for wielding bodies, objects, and environments as imaginative practice. Through an enactively based case study of the play _Provenance_ by Autopoetics ( 2018 ), I reveal how creation and performance processes literally and epistemically engineer novel niches for the spectator. This (...) case study investigates how _Provenance_’s recurring theatrical device of newspaper manipulation constitutes a cognitive device for an affordance-oriented and predictive spectator. As I track the priorities and processes of these longstanding play development and performance techniques informed by the theatrical tradition of Jacques Lecoq (1921–1999), I suggest how concepts such as affordances, affordance spaces, predictive engagement, and the free energy principle are apt conceptual tools for understanding how these practices engender imaginative encounters. I follow this analysis by suggesting, via the free energy principle’s conception of “models,” that there may be cognitive consequences to the possible changes experienced by the spectator that exceed theatrical experience. I conclude this discussion by pointing toward how my 4-E inflected insights on the imaginative practices of _Provenance_ may be applicable to imagination and pretense in other arenas not just behind but also beyond the footlights. (shrink)

According to the free energy principle biological agents resist a tendency to disorder in their interactions with a dynamically changing environment by keeping themselves in sensory and physiological states that are expected given their embodiment and the niche they inhabit :127–138, 2010. doi: 10.1038/nrn2787). Why would a biological agent that aims at minimising uncertainty in its encounters with the world ever be motivated to seek out novelty? Novelty for such an agent would arrive in the form of sensory and physiological (...) states that are unexpected. Such an agent ought therefore to avoid novel and surprising interactions with the world one might think. Yet humans and many other animals find play and other forms of novelty-seeking and exploration hugely rewarding. How can this be understood in frameworks for studying the mind that emphasise prediction error minimisation? This problem has been taken up in recent research concerned with epistemic action—actions an agent engages in to reduce uncertainty. However that work leaves two questions unanswered, which it is the aim of our paper to address. First, no account has been given yet of why it should feel good to the agent to engage the world playfully and with curiosity. Second an appeal is made to precision-estimation to explain epistemic action, yet it remains unclear how precision-weighting works in action more generally, or active inference. We argue that an answer to both questions may lie in the bodily states of an agent that track the rate at which free energy is being reduced. The recent literature on the predictive brain has connected the valence of emotional experiences to the rate of change in the reduction of prediction error :e1003094, 2013. doi: 10.1371/journal.pcbi.1003094; Van de Cruys, in Metzinger and Wiese Philosophy and predictive processing, vol 24, MIND Group, Frankfurt am Main, 2017. doi: 10.15502/9783958573253). In this literature valenced emotional experiences are hypothesised to be identical with changes in the rate at which prediction error is reduced. Experiences are negatively valenced when overall prediction error increases and are positively valenced when the sum of prediction errors decrease. We offer an ecological-enactive interpretation of the concept of valence and its connection to rate of change of prediction error. We show how rate of change should be understood in terms of embodied states of affordance-related action readiness. We then go on to apply this ecological-enactive account of error dynamics to provide an answer to the first question we have raised: It may explain why it should feel good to an agent to be curious and playful. Our ecological-enactive account also allows us to show how error dynamics may provide an answer to the second question we have raised regarding how precision-weighting works in active inference. An agent that is sensitive to rates of error reduction can tune precision on the fly. We show how this ability to tune precision on the go can allow agents to develop skills for adapting better and better to the unexpected, and search out opportunities for resolving uncertainty and progressing in its learning. (shrink)

Curiosity and creativity are central pillars of human growth and invention. Although they have been studied extensively in isolation, the relationship between them has not yet been established. We propose that both curiosity and creativity emanate from the same mechanism of novelty seeking. We first present a synthesis showing that curiosity and creativity are affected similarly by a number of key cognitive faculties such as memory, cognitive control, attention, and reward. We then review empirical evidence from neuroscience research, indicating that (...) the same brain regions are involved in both curiosity and creativity, focusing on the interplay between three major brain networks: the default mode network, the salience network, and the executive control network. After substantiating the link between curiosity and creativity, we propose a novelty-seeking model (NSM) that underlies them and suggests that the manifestation of the NSM is governed by one's state of mind. (shrink)

People who habituate to stress show a repetition-induced response attenuation—neuroendocrine, cardiovascular, neuroenergetic, and emotional—when exposed to a threatening environment. But the exact dynamics underlying stress habituation remain obscure. The free energy principle offers a unifying account of self-organising systems such as the human brain. In this paper, we elaborate on how stress habituation can be explained and modelled using the free energy principle. We introduce habituation priors that encode the agent’s tendency for stress habituation and incorporate them in the agent’s (...) decision-making process. Using differently shaped goal priors—that encode the agent’s goal preferences—we illustrate, in two examples, the optimising behaviour of agents. We show that habituation minimises free energy by reducing the precision of goal preferences. Reducing the precision of goal priors means that the agent accepts adverse states. Acceptance or tolerance of adverse outcomes may explain why habituation causes people to exhibit an attenuation of the stress response. Given that stress habituation occurs in brain regions where goal priors are encoded, i.e., in the ventromedial prefrontal cortex and that these priors are encoded as sufficient statistics of probability distributions, our approach seems plausible from an anatomical-functional and neuro-statistical point of view. The ensuing formal and generalisable account—based on the free energy principle—further motivate our novel treatment of stress habituation. Our analysis suggests that stress habituation has far-reaching consequences, protecting against the harmful effects of toxic stress, but on the other hand making the acceptability of precarious living conditions and the development of the obese type 2 diabetes mellitus phenotype more likely. (shrink)

In recent years, scientists have increasingly taken to investigate the predictive nature of cognition. We argue that prediction relies on abstraction, and thus theories of predictive cognition need an explicit theory of abstract representation. We propose such a theory of the abstract representational capacities that allow humans to transcend the “here-and-now.” Consistent with the predictive cognition literature, we suggest that the representational substrates of the mind are built as ahierarchy, ranging from the concrete to the abstract; however, we argue that (...) there are qualitative differences between elements along this hierarchy, generating meaningful, often unacknowledged,diversity.Echoing views from philosophy, we suggest that the representational hierarchy can be parsed into:modality-specificrepresentations, instantiated on perceptual similarity;multimodalrepresentations, instantiated primarily on the discovery of spatiotemporal contiguity; andcategoricalrepresentations, instantiated primarily on social interaction. These elements serve as the building blocks ofcomplex structures discussed in cognitive psychology (e.g., episodes, scripts) and are the inputs for mental representations that behave like functions, typically discussed in linguistics (i.e.,predicators). We support our argument for representational diversity by explaining how the elements in our ontology are all required to account for humans’ predictive cognition (e.g., in subserving logic-based prediction; in optimizing the trade-off between accurate and detailed predictions) and by examining how the neuroscientific evidence coheres with our account. In doing so, we provide a testable model of the neural bases of conceptual cognition and highlight several important implications to research on self-projection, reinforcement learning, and predictive-processing models of psychopathology. (shrink)

We distinguish between three philosophical views on the neuroscience of predictive models: predictive coding, predictive processing and predictive engagement. We examine the concept of active inference under each model and then ask how this concept informs discussions of social cognition. In this context we consider Frith and Friston’s proposal for a neural hermeneutics, and we explore the alternative model of enactivist hermeneutics.

The Free Energy Principle (FEP) states that all biological self-organizing systems must minimize variational free energy. The acceptance of this principle has given rise to a popular and far-reaching theoretical and empirical approach to the study of the brain and living organisms. Despite the popularity of the FEP approach, little discussion has ensued about its ontological status and implications. By understanding physicalism as an interdisciplinary research program that aims to offer compositional explanations of mental phenomena, this paper articulates what it (...) would mean for the FEP approach to be part of research program physicalism and to corroborate a physicalist outlook. In doing so, this paper contributes both to philosophical discussions regarding the FEP approach and to the literature on physicalism. It does the former by explicating the metaphysical standing of the FEP approach. It does the latter by showing how cutting-edge research in the empirical sciences of the mind can inform our attitudes regarding physicalism. (shrink)

This third paper locates the synthetic neurorobotics research reviewed in the second paper in terms of themes introduced in the first paper. It begins with biological non-reductionism as understood by Searle. It emphasizes the role of synthetic neurorobotics studies in accessing the dynamic structure essential to consciousness with a focus on system criticality and self, develops a distinction between simulated and formal consciousness based on this emphasis, reviews Tani and colleagues' work in light of this distinction, and ends by forecasting (...) the increasing importance of synthetic neurorobotics studies for cognitive science and philosophy of mind going forward, finally in regards to most- and myth-consciousness. (shrink)