According to the free energy principle biological agents resist a tendency to disorder in their interactions with a dynamically changing environment by keeping themselves in sensory and physiological states that are expected given their embodiment and the niche they inhabit :127–138, 2010. doi: 10.1038/nrn2787). Why would a biological agent that aims at minimising uncertainty in its encounters with the world ever be motivated to seek out novelty? Novelty for such an agent would arrive in the form of sensory and physiological (...) states that are unexpected. Such an agent ought therefore to avoid novel and surprising interactions with the world one might think. Yet humans and many other animals find play and other forms of novelty-seeking and exploration hugely rewarding. How can this be understood in frameworks for studying the mind that emphasise prediction error minimisation? This problem has been taken up in recent research concerned with epistemic action—actions an agent engages in to reduce uncertainty. However that work leaves two questions unanswered, which it is the aim of our paper to address. First, no account has been given yet of why it should feel good to the agent to engage the world playfully and with curiosity. Second an appeal is made to precision-estimation to explain epistemic action, yet it remains unclear how precision-weighting works in action more generally, or active inference. We argue that an answer to both questions may lie in the bodily states of an agent that track the rate at which free energy is being reduced. The recent literature on the predictive brain has connected the valence of emotional experiences to the rate of change in the reduction of prediction error :e1003094, 2013. doi: 10.1371/journal.pcbi.1003094; Van de Cruys, in Metzinger and Wiese Philosophy and predictive processing, vol 24, MIND Group, Frankfurt am Main, 2017. doi: 10.15502/9783958573253). In this literature valenced emotional experiences are hypothesised to be identical with changes in the rate at which prediction error is reduced. Experiences are negatively valenced when overall prediction error increases and are positively valenced when the sum of prediction errors decrease. We offer an ecological-enactive interpretation of the concept of valence and its connection to rate of change of prediction error. We show how rate of change should be understood in terms of embodied states of affordance-related action readiness. We then go on to apply this ecological-enactive account of error dynamics to provide an answer to the first question we have raised: It may explain why it should feel good to an agent to be curious and playful. Our ecological-enactive account also allows us to show how error dynamics may provide an answer to the second question we have raised regarding how precision-weighting works in active inference. An agent that is sensitive to rates of error reduction can tune precision on the fly. We show how this ability to tune precision on the go can allow agents to develop skills for adapting better and better to the unexpected, and search out opportunities for resolving uncertainty and progressing in its learning. (shrink)

Infants' own activities create and actively select their learning experiences. Here we review recent models of embodied information seeking and curiosity-driven learning and show that these mechanisms have deep implications for development and evolution. We discuss how these mechanisms yield self-organized epigenesis with emergent ordered behavioral and cognitive developmental stages. We describe a robotic experiment that explored the hypothesis that progress in learning, in and for itself, generates intrinsic rewards: The robot learners probabilistically selected experiences according to their potential for (...) reducing uncertainty. In these experiments, curiosity-driven learning led the robot learner to successively discover object affordances and vocal interaction with its peers. We explain how a learning curriculum adapted to the current constraints of the learning system automatically formed, constraining learning and shaping the developmental trajectory. The observed trajectories in the robot experiment share many properties with those in infant development, including a mixture of regularities and diversities in the developmental patterns. Finally, we argue that such emergent developmental structures can guide and constrain evolution, in particular with regard to the origins of language. (shrink)

Drawing from field theory, Gestalt therapy conceives psychological suffering and psychotherapy as two intentional field phenomena, where unprocessed and chaotic experiences seek the opportunity to emerge and be assimilated through the contact between the patient and the therapist (i.e., the intentionality of contacting). This therapeutic approach is based on the therapist’s aesthetic experience of his/her embodied presence in the flow of the healing process because (1) the perception of beauty can provide the therapist with feedback on the assimilation of unprocessed (...) experiences; (2) the therapist’s attentional focus on intrinsic aesthetic diagnostic criteria can facilitate the modification of rigid psychopathological fields by supporting the openness to novel experiences. The aim of the present manuscript is to review recent evidence from psychophysiology, neuroaesthetic research, and neurocomputational models of cognition, such as the free energy principle (FEP), which support the notion of the therapeutic potential of aesthetic sensibility in Gestalt psychotherapy. Drawing from neuroimaging data, psychophysiology and recent neurocognitive accounts of aesthetic perception, we propose a novel interpretation of the sense of beauty as a self-generated reward motivating us to assimilate an ever-greater spectrum of sensory and affective states in our predictive representation of ourselves and the world and supporting the intentionality of contact. Expecting beauty, in the psychotherapeutic encounter, can help therapists tolerate uncertainty avoiding impulsive behaviours and to stay tuned to the process of change. (shrink)

Autonomous lifelong development and learning are fundamental capabilities of humans, differentiating them from current deep learning systems. However, other branches of artificial intelligence have designed crucial ingredients towards autonomous learning: curiosity and intrinsic motivation, social learning and natural interaction with peers, and embodiment. These mechanisms guide exploration and autonomous choice of goals, and integrating them with deep learning opens stimulating perspectives.

We propose a cognitive and neurobiological model by which curiosity regulates affective memory, by positively biasing memory encoding through the promotion of emotion regulation. We begin with a brief overview of curiosity's observed emotional effects. Then we introduce three prominent models of affective memory encoding to suggest that the dopaminergic modulation of encoding associated with curiosity may positively bias memory processes. We situate the role of curiosity role in emotion regulation relative to its promotion of abstract thinking and cognitive flexibility. (...) We then identify the neural processes associated with abstraction and flexibility observed in the left inferior frontal gyrus, the dorsal anterior cingulate cortex, and the lateral prefrontal cortex as the neurobiological mechanisms underlying our framework. (shrink)

Curiosity and creativity are expressions of the trade-off between leveraging that with which we are familiar or seeking out novelty. Through the computational lens of reinforcement learning, we describe how formulating the value of information seeking and generation via their complementary effects on planning horizons formally captures a range of solutions to striking this balance.

Curiosity and creativity are central pillars of human growth and invention. Although they have been studied extensively in isolation, the relationship between them has not yet been established. We propose that both curiosity and creativity emanate from the same mechanism of novelty seeking. We first present a synthesis showing that curiosity and creativity are affected similarly by a number of key cognitive faculties such as memory, cognitive control, attention, and reward. We then review empirical evidence from neuroscience research, indicating that (...) the same brain regions are involved in both curiosity and creativity, focusing on the interplay between three major brain networks: the default mode network, the salience network, and the executive control network. After substantiating the link between curiosity and creativity, we propose a novelty-seeking model (NSM) that underlies them and suggests that the manifestation of the NSM is governed by one's state of mind. (shrink)

Current treatments for chronic pain have limited benefit. We describe a resilience intervention for individuals with chronic pain which is based on a model of viewing chronic pain as dysregulated homeostasis and which seeks to restore homeostatic self-regulation using strategies exemplified by survivors of extreme environments. The intervention is expected to have broad effects on well-being and positive emotional health, to improve cognitive functions, and to reduce pain symptoms thus helping to transform the suffering of pain into self-growth. A total (...) of 88 Veterans completed the pre-assessment and were randomly assigned to either the treatment intervention or control. Fifty-eight Veterans completed pre- and post-testing. The intervention covered resilience strengths organized into four modules: engagement, social relatedness, transformation of pain and building a good life. A broad set of standardized, well validated measures were used to assess three domains of functioning: health and well-being, symptoms, and cognitive functions. Two-way Analysis of Variance was used to detect group and time differences. Broadly, results indicated significant intervention and time effects across multiple domains: Pain decreased in present severity [F = 5.02, p < 0.05, η2p = 0.08], total pain over six domains [F = 14.52, p < 0.01, η2p = 0.21], and pain interference [F = 6.82, p < 0.05, η2p = 0.11]; Affect improved in pain-related negative affect [F = 7.44, p < 0.01, η2p = 0.12], fear [F = 7.70, p < 0.01, η2p = 0.12], and distress [F = 10.87, p < 0.01, η2p = 0.16]; Well-being increased in pain mobility [F = 5.45, p < 0.05, η2p = 0.09], vitality [F = 4.54, p < 0.05, η2p = 0.07], and emotional well-being [F = 5.53, p < 0.05, η2p = 0.09] Mental health symptoms and the cognitive functioning domain did not reveal significant effects. This resilience intervention based on homeostatic self-regulation and survival strategies of survivors of extreme external environments may provide additional sociopsychobiological tools for treating individuals with chronic pain that may extend beyond treating pain symptoms to improving emotional well-being and self-growth.Clinical Trial Registration: Registered with ClinicalTrials.gov. (shrink)

This paper develops a model of choice with an agent that is capable of experiencing curiosity using Loewenstein’s :75–98, 1994) information gap interpretation of curiosity. We then proceed to determine the restrictions on choice behaviour implied by the model in two choice environments: no discovery—where the Decision-Maker does not have the opportunity to learn—and discovery—where she is afforded such an opportunity. These restrictions can be applied by an observer to determine if a Decision-Maker’s choices align with the model.

What are the origins of ownership as a conceptual domain? By combining experimental evidence from cognitive science, a theoretical proposal from developmental psychology, and the computational framework of reinforcement learning, I argue that ownership concepts can develop as a by-product of our curiosity-based exploration and become grounded via our experience of control in physical and social environments.

Imaginary worlds are extremely successful. The most popular fictions produced in the last few decades contain such a fictional world. They can be found in all fictional media, from novels (e.g., Lord of The Rings and Harry Potter) to films (e.g., Star Wars and Avatar), video games (e.g., The Legend of Zelda and Final Fantasy), graphic novels (e.g., One Piece and Naruto), and TV series (e.g., Star Trek and Game of Thrones), and they date as far back as ancient literature (...) (e.g., the Cyclops Islands in The Odyssey, 850 BCE). Why such a success? Why so much attention devoted to non-existent worlds? In this paper, we propose that imaginary worlds co-opt our preferences for exploration, which have evolved in humans and nonhuman animals alike, to propel individuals toward new environments and new sources of reward. Humans would find imaginary worlds very attractive for the very same reasons, and under the same circumstances, as they are lured by unfamiliar environments in real life. After reviewing research on exploratory preferences in behavioral ecology, environmental esthetics, neuroscience, and evolutionary and developmental psychology, we focus on the sources of their variability across time and space, which we argue can account for the variability of the cultural preference for imaginary worlds. This hypothesis can, therefore, explain the way imaginary worlds evolved culturally, their shape and content, their recent striking success, and their distribution across time and populations. (shrink)

The recognition and incorporation of evidence-based neuroscientific concepts into creative arts therapeutic knowledge and practice seem valuable and advantageous for the purpose of integration and professional development. Moreover, exhilarating insights from the field of neuroscience coincide with the nature, conceptualization, goals, and methods of Creative Arts Therapies, enabling comprehensive understandings of the clinical landscape, from a translational perspective. This paper contextualizes and discusses dynamic brain functions that have been suggested to lie at the heart of intra- and inter-personal processes. Touching (...) upon fundamental aspects of the self and self-other interaction, the state-of-the-art neuroscientific-informed views will shed light on mechanisms of the embodied, predictive and relational brain. The conceptual analysis introduces and interweaves the following contemporary perspectives of brain function: firstly, the grounding of mental activity in the lived, bodily experience will be delineated; secondly, the enactive account of internal models, or generative predictive representations, shaped by experience, will be defined and extensively deliberated; and thirdly, the interpersonal simulation and synchronization mechanisms that support empathy and mentalization will be thoroughly considered. Throughout the paper, the cross-talks between the brain and the body, within the brain through functionally connected neural networks and in the context of agent-environment dynamics, will be addressed. These communicative patterns will be elaborated on to unfold psychophysiological linkage, as well as psychopathological shifts, concluding with the neuroplastic change associated with the formulation of CATs. The manuscript suggests an integrative view of the brain-body-mind in contexts relevant to the therapeutic potential of the expressive creative arts and the main avenues by which neuroscience may ground, enlighten and enrich the clinical psychotherapeutic practice. (shrink)

Existing behavioral, neuropsychological and functional neuroimaging data suggest that at least two major cognitive strategies are used for new word learning: fast mapping via context-dependent inference and explicit encoding via direct instruction. However, these distinctions remain debated at both behavioral and neurophysiological levels, not least due to confounds related to diverging experimental settings. Furthermore, the neural dynamics underpinning these two putative processes remain poorly understood. To tackle this, we designed a paradigm presenting 20 new spoken words in association with pictures (...) in either FM or EE settings, closely matched for auditory and visual features and overall task demands. We tested word acquisition using a range of behavioral measures as well as passive event-related potential responses, an established measure of word memory trace activation, and compared brain activity elicited by novel FM and EE words before and after the learning session. Behavioral data obtained in free recall, recognition and semantic word-picture matching tasks indicated successful acquisition of new words after just 10 exposures. Crucially, we found no behavioral evidence of different acquisition outcomes between FM and EE learning. ERP data, which exhibited the main response peaks at ~170, 250, and 520 ms, also indicated successful learning, with statistically different responses between novel and familiar words present only before, but not after the training, suggesting rapid formation of new neural memory circuits matching in activation those for previously known words. Furthermore, already at the earliest peak, we found different topographic distributions for the two learning types, with left-lateralized FM dynamics, suggestive of core language system involvement, and more diffuse activity for EE items, possibly suggesting the role of attention/executive control network. A similar effect also manifested later, at ~520 ms. Our data suggest that while both EE and FM learning can be successful for rapid word acquisition at the behavioral level, the diverging electrophysiological patterns suggest a dissociation between the neural systems underpinning these learning strategies. (shrink)

Studies of primate cognition have conclusively shown that humans and apes share a range of basic cognitive abilities. As a corollary, these same studies have also focussed attention on what makes humans unique, and on when and how specifically human cognitive skills evolved. There is widespread agreement that a major distinguishing feature of the human mind is its capacity for causal reasoning. This paper argues that causal cognition originated with the use made of indirect natural signs by early hominins forced (...) to adapt to variable late Miocene and early Pliocene environments; that early hominins evolved an innate tendency to search for such signs and infer their causes; that causal inference required the existence of incipient working memory; and that causal relationships were stored through being integrated into spatial maps to create increasingly complex causal models of the world. (shrink)

Current theories propose that our sense of curiosity is determined by the learning progress or information gain that our cognitive system expects to make. However, few studies have explicitly tried to quantify subjective information gain and link it to measures of curiosity. Here, we asked people to report their curiosity about the intrinsically engaging perceptual ‘puzzles’ known as Mooney images, and to report on the strength of their aha experience upon revealing the solution image (curiosity relief). We also asked our (...) participants (279) to make a guess concerning the solution of the image, and used the distribution of these guesses to compute the crowdsourced semantic entropy (or ambiguity) of the images, as a measure of the potential for information gain. Our results confirm that curiosity and, even more so, aha experience is substantially associated with this semantic information gain measure. These findings support the expected information gain theory of curiosity and suggest that the aha experience or intrinsic reward is driven by the actual information gain. In an unannounced memory part, we also established that the often reported influence of curiosity on memory is fully mediated by the aha experience or curiosity relief. We discuss the implications of our results for the burgeoning fields of curiosity and psychoaesthetics. (shrink)

To the extent that the performance of embodied and situated cognitive agents is predicated on fore- thought;such agents must remember; and learn from; the past to predict the future. In complex; non-stationaryenvironments; such learning is facilitated by an intrinsic motivation to seek novelty. A significant part of anagent’s identity is thus constituted by its remembered distilled cumulative life experience; which the agent isdriven to constantly expand. The combination of the drive to novelty with practical limits on memorycapacity posits a problem. (...) On the one hand; because novelty seekers are unhappy when bored; merelyreliving past positive experiences soon loses its appeal: happiness can only be attained sporadically; via anopen-ended pursuit of new experience. On the other hand; because the experiencer’s memory is finite;longevity and continued novelty; taken together; imply eventual loss of at least some of the stored content;and with it a disruption of the constructed identity. In this essay; I examine the biobehavioral and cognitive-computational circumstances that give rise to this problem and explore its implications for the humancondition. (shrink)

The effects of striatal dopamine (DA) on behavior have been widely investigated over the past decades, with “phasic” burst firings considered as the key expression of a reward prediction error responsible for reinforcement learning. Less well studied is “tonic” DA, where putative functions include the idea that it is a regulator of vigor, incentive salience, disposition to exert an effort and a modulator of approach strategies. We present a model combining tonic and phasic DA to show how different outflows triggered (...) by either intrinsically or extrinsically motivating stimuli dynamically affect the basal ganglia by impacting on a selection process this system performs on its cortical input. The model, which has been tested on the simulated humanoid robot iCub interacting with a mechatronic board, shows the putative functions ascribed to DA emerging from the combination of a standard computational mechanism coupled to a differential sensitivity to the presence of DA across the striatum. (shrink)

The human ability to flexibly discover alternatives without fixating on a known solution supports a variety of human creative activities. Previous research has shown that people who discover an alternative procedure relax their attentional bias to information regarding the known solutions just prior to the discovery. This study examined whether the difference in the distribution of attention between the finders and non-finders of the alternative procedure is observed from the phase of solving the problem using the trained procedure. We evaluated (...) the characteristics of the finders' distribution of attention in situations where problem solving using a trained procedure was successful. This aspect has been little examined in previous research. Our study obtained empirical evidence for the fact that, compared to non-finders, finders pay more attention to information unrelated to the trained procedure acquired through knowledge and experience, even time when using a trained procedure. We also confirmed that this difference does not exist from the beginning of the task, but emerges during repeated use of familiar procedures. These findings indicate that in order to find an alternative procedure, one should not only divert attention from a familiar procedure just before the discovery but also pay a certain amount of attention to information unrelated to the familiar procedure even when the familiar procedure is functioning well. (shrink)

Curiosity motivates the search for missing information, driving learning, scientific discovery, and innovation. Yet, identifying that there is a gap in one's knowledge is itself a critical step, and may demand that one formulate a question to precisely express what is missing. Our work captures the integral role of self‐generated questions during the acquisition of new information, which we refer to as active‐curiosity‐driven learning. We tested active‐curiosity‐driven learning using our “Curiosity Question & Answer Task” paradigm, where participants (N=135) were asked (...) to generate questions in response to novel, incomplete factual statements and provided the opportunity to forage for answers. We also introduce new measures of question quality that express how well questions capture stimulus and foraging information. We hypothesized that active question asking should influence behavior across the stages of our task by increasing the probability that participants express curiosity, forage for answers, and remember what they had thereby discovered. We found that individuals who asked a high number of quality questions experienced elevated curiosity, were more likely to pursue missing information that was semantically related to their questions, and more likely to retain the information on a later cued recall test. Additional analyses revealed that curiosity played a predominant role in motivating participants to forage for missing information, and that both curiosity and satisfaction with the acquired information boosted memory recall. Overall, our results suggest that asking questions enhances the value of missing information, with important implications for learning and discovery of all forms. (shrink)