How do humans manage to keep track of a gradually changing object or person as the same persisting individual despite the fact that the extraction of information about this individual must often rely on heterogeneous information sources and heterogeneous tracking methods? The article introduces the Empirical Tracking of Individuals theory to address this problem. This theory proposes an analysis of the concept of integrated tracking, which refers to the capacity to acquire, store, and update information about the identity and location (...) of individuals in our environment. It hypothesizes that certain functions of attention are a key to explaining how the cognitive flexibility of the human mind overcomes the heterogeneity of sources and methods in integrated tracking. At least two premises lend support to this hypothesis. First, heterogeneity of tracking sources is overcome by the combination of information from multiple perceptual modalities and a phenomenon of multisensory 'transparency'. Second, heterogeneity of tracking sources and methods may also be overcome by inferences that combine information across domains to acquire reasons to believe propositions about the target's location and identity. (shrink)

I aim to show that perception depends counterfactually on the action we want to perform. Perception is not all-purpose: what we want to do does influence what we see. After clarifying how this claim is different from the one at stake in the cognitive penetrability debate and what counterfactual dependence means in my claim, I will give a two-step argument: one’s perceptual attention depends counterfactually on one’s intention to perform an action and one’s perceptual processing depends counterfactually on one’s perceptual (...) attention. If we put these claims together, what we get is that one’s perceptual processing depends counterfactually on one’s intention to perform an action. (shrink)

Studies that compare human and animal behaviour suspend prejudices about mind, body and their relation, by approaching thinking in terms of behaviour. Yet comparative approaches typically engage another prejudice, motivated by human social and bodily experience: taking the lone animal as the unit of comparison. This prejudice informs Heidegger’s and Merleau-Ponty’s comparative studies, and conceals something important: that animals moving as a group in an environment can develop new sorts of “sense.” The study of animal group-life suggests a new way (...) of thinking about the creation of sense, about the body, the brain, and the relation between thinking and nature. (shrink)

A version of the inverted spectrum thought experiment that disconfirms functionalism for the case of humans’ color experiences has typically been thought to require a certain kind of balancing act. What one needs, it has typically been thought, is a mapping of color experiences onto other color experiences that preserves the similarity and difference relationships among those experiences and the aspects of perceived colors underlying those similarities and differences. However, there are good reasons for being suspicious about whether that is (...) possible when the palette of color experiences is that available to humans with normal vision. The new version of the thought experiment constructed here doesn’t depend on preserving those relationships. I argue that there is a coherent, metaphysically possible scenario in which two human color experiences—any two—can be seen to be functionally equivalent. The upshot is that functionalism fails for all human color experiences. (shrink)

Ecological and sensorimotor theories of perception build on the notion of action-dependent invariants as the basic structures underlying perceptual capacities. In this paper we contrast the assumptions these theories make on the nature of perceptual information modulated by action. By focusing on the question, how movement specifies perceptual information, we show that ecological and sensorimotor theories endorse substantially different views about the role of action in perception. In particular we argue that ecological invariants are characterized with reference to transformations produced (...) in the sensory array by movement: such invariants are transformation-specific but do not imply motor-specificity. In contrast, sensorimotor theories assume that perceptual invariants are intrinsically tied to specific movements. We show that this difference leads to different empirical predictions and we submit that the distinction between motor equivalence and motor-specificity needs further clarification in order to provide a more constrained account of action/perception relations. (shrink)

Recent work on skin-brain thesis suggests the possibility of empirical evidence that empiricism is false. It implies that early animals need no traditional sensory receptors to be engaged in cognitive activity. The neural structure required to coordinate extensive sheets of contractile tissue for motility provides the starting point for a new multicellular organized form of sensing. Moving a body by muscle contraction provides the basis for a multicellular organization that is sensitive to external surface structure at the scale of the (...) animal body. In other words, the nervous system first evolved for action, not for receiving sensory input. Thus, sensory input is not required for minimal cognition; only action is. The whole body of an organism, in particular its highly specific animal sensorimotor organization, reflects the bodily and environmental spatiotemporal structure. The skin-brain thesis suggests that, in contrast to empiricist claims that cognition is constituted by sensory systems, cognition may be also constituted by action-oriented feedback mechanisms. Instead of positing the reflex arc as the elementary building block of nervous systems, it proposes that endogenous motor activity is crucial for cognitive processes. In the paper, I discuss the issue whether the skin-brain thesis and its supporting evidence can be really used to overthrow the main tenet of empiricism empirically, by pointing out to cognizing agents that fail to have any sensory apparatus. (shrink)

The debate between the defenders of explanatory unification and explanatory pluralism has been ongoing from the beginning of cognitive science and is one of the central themes of its philosophy. Does cognitive science need a grand unifying theory? Should explanatory pluralism be embraced instead? Or maybe local integrative efforts are needed? What are the advantages of explanatory unification as compared to the benefits of explanatory pluralism? These questions, among others, are addressed in this Synthese’s special issue. In the introductory paper, (...) we discuss the background of the questions, distinguishing integrative theorizing from building unified theories. On the one hand, integrative efforts involve collaboration between various disciplines, fields, approaches, or theories. These efforts could even be quite temporary, without establishing any long-term institutionalized fields or disciplines, but could also contribute to developing new interfield theories. On the other hand, unification can rely on developing complete theories of mechanisms and representations underlying all cognition, as Newell’s “unified theories of cognition”, or may appeal to grand principles, as predictive coding. Here, we also show that unification in contemporary cognitive science goes beyond reductive unity, and may involve various forms of joint efforts and division of explanatory labor. This conclusion is one of the themes present in the content of contributions constituting the special issue. (shrink)

Jerry Fodor has consistently cited the persistence of illusions--especially the M.

Following on from ecological theories of perception, such as the one proposed by [Gibson, J. J. . The senses considered as perceptual systems. Boston: Houghton Mifflin] this paper reviews the literature on the multisensory interactions underlying the perception of flavor in order to determine the extent to which it is really appropriate to consider flavor perception as a distinct perceptual system. We propose that the multisensory perception of flavor may be indicative of the fact that the taxonomy currently used to (...) define our senses is simply not appropriate. According to the view outlined here, the act of eating allows the different qualities of foodstuffs to be combined into unified percepts; and flavor can be used as a term to describe the combination of tastes, smells, trigeminal, and tactile sensations as well as the visual and auditory cues, that we perceive when tasting food. (shrink)

I can be wrong about things I seem to perceive; the conditions might lead me to be mistaken about them. Since I can't rule out the possibility that the conditions are misleading, I can't be sure that I am perceiving this thing in my hand correctly. But suppose that I am able to examine it actively—handling it, looking closer, shining a light on it, and so on. Then, my level of uncertainty goes down; in the limit it is eliminated entirely. (...) Of course, I might be mistaken because I am a brain in a vat, or because some other sceptical scenario obtains. But sceptical scenarios apply not just to this thing in my hand, but to everything all at once. Define "empirical certainty" as the absence of the kind of doubt that spreads to all empirical states of affairs. Sensory exploration, or active examination, can in principle lead to empirical certainty. (shrink)

We reflect upon quantification in biology in two ways. First, from a sensory scientific perspective, we address theories and methods for studying sensation, perception, and cognition. Sensory science concerns action of the human senses, which are not passive receivers but operate in an active and fundamental way for human beings in various social and environmental contexts. In the past one could only handle one-to-one relationships within a univariate framework. Today we have tools to capture complexity closer to real world situations. (...) Thus, the second perspective is rooted in multivariate thinking and modeling tools. Relying mainly on soft modeling-exploratory methods, such as partial least squares regression, we claim that quantification in sensory biology in the future should be met with a dialectic view that simultaneously exploits the two perspectives. (shrink)

Various kinds of observations show that the ability of human beings to both consciously relive past events – episodic memory – and conceive future events, entails an active process of construction. This construction process also underpins many other important aspects of conscious human life, such as perceptions, language and conscious thinking. This article provides an explanation of what makes the constructive process possible and how it works. The process mainly relies on attentional activity, which has a discrete and periodic nature, (...) and working memory, which allows for the combination of discrete attentional operations. An explanation is also provided of how past and future events are constructed. (shrink)

: In this paper I approach the problem of the boundaries and location of consciousness in a strictly physicalist way. I start with the debate on extended cognition, pointing to two unresolved issues: the ontological status of cognition and the fallacy of the center. I then propose using identity to single out the physical basis of consciousness. As a tentative solution, I consider Mind-Object Identity and compare it with other identity theories of mind. Keywords: Extended Mind; Spread Mind; Enactivism; Cognition; (...) Consciousness; Mind-Object Identity; Identity I confini e la localizzazione della coscienza secondo le teorie dell’identità Riassunto: In questo lavoro tratterò il problema dei confini e della localizzazione della coscienza in termini strettamente fisicalisti. Prenderò le mosse dal dibattito sulla cognizione estesa, portando l’attenzione su due questioni irrisolte: lo status ontologico della cognizione e la fallacia del centro. Proporrò quindi di usare l’identità per individuare la base fisica della coscienza. Come possibile soluzione, prenderò in considerazione la Mind-Object Identity, confrontandola con oltre teorie dell’identità della mente. Parole chiave: Mente estesa; Mente diffusa; Enattivimo; Cognizione; Coscienza; Mind-Object Identity; Identità. (shrink)

This article deals with mechanisms conceived as composed of entities and activities. In response to many perplexities about the nature of activities, a number of arguments are developed concerning their epistemic and ontological status. Some questions concerning the relations between cause and causal explanation and mechanisms are also addressed.

People believe that perception is reliable and that what they perceive reflects objective reality. On this view, we perceive a red circle because there is something out there that is a red circle. It is also commonly believed that perceptual reliability is threatened if what we see is allowed to be influenced by what we know or expect. I argue that although human perception is often highly consistent and stable, it is difficult to evaluate its reliability because when it comes (...) to perception, it is unclear how one could establish a fact of the matter. An alternative to thinking of perception as being in the business of truth, is thinking of it as being in the business of transducing sensory energy into a form useful for guiding adaptive behavior. On this position, perception ought to be richly influenced by some types of knowledge insofar as this knowledge can aid in the construction of useful representations from sensory input. (shrink)

Embodied cognitive theories predict that linguistic conceptual representations are grounded and continually represented in real world, sensorimotor experiences. However, there is an on-going debate on whether this also holds for abstract concepts. Grammar is the archetype of abstract knowledge, and therefore constitutes a test case against embodied theories of language representation. Former studies have largely focussed on lexical-level embodied representations. In the present study we take the grounding-by-modality idea a step further by using reaction time (RT) data from the linguistic (...) processing of nominal classifiers in Chinese. We take advantage of an independent body of research, which shows that attention in hand space is biased. Specifically, objects near the hand consistently yield shorter RTs as a function of readiness for action on graspable objects within reaching space, and the same biased attention inhibits attentional disengagement. We predicted that this attention bias would equally apply to the graspable object classifier but not to the big object classifier. Chinese speakers (N = 22) judged grammatical congruency of classifier-noun combinations in two conditions: graspable object classifier and big object classifier. We found that RTs for the graspable object classifier were significantly faster in congruent combinations, and significantly slower in incongruent combinations, than the big object classifier. There was no main effect on grammatical violations, but rather an interaction effect of classifier type. Thus, we demonstrate here grammatical category- specific effects pertaining to the semantic content and by extension the visual and tactile modality of acquisition underlying the acquisition of these categories. We conclude that abstract grammatical categories are subjected to the same mechanisms as general cognitive and neurophysiological processes and may therefore be grounded. (shrink)

In two recent papers, I introduced the idea of embodied Rilkean movement knowledge and perception into the current philosophical debate on sports knowledge. In this paper, I offer a new analysis of how embodied movement knowledge and perception help us to identify and define movement consciousness. I develop a phenomenological account of embodied movement consciousness and show how it is closely linked to self-consciousness by generating anticipations and affordances that implicate pre-reflective self-awareness. I also expand Rowlands’ Rilkean memory notion to (...) include affective phenomenological properties that rely on the constitutive fault-lines between bodily material sensations and the ingrained recollections they are based on. From this perspective, embodied movement consciousness comprises empirical sensations that phenomenologically unfold as physical acts grounded in materiality. (shrink)

There seem to be good reasons to think that there must be body representations or some kind of body content required for riding a bike or grabbing a cup of coffee. However, when I ride a bike or grab a cup of coffee, am I just representing the bike and the cup? Or am I actually also representing my body and bodily movements? The thesis of this paper is that the body not only figures in the content that guides everyday (...) activities but that it must. How is this possible? Exactly what elements of the subject’s body can be said to figure in this content? I will proceed in three steps: in the first, I bring together the conceptual resources that seem to be required; in the second, I discuss a couple of proposals about how to link the notion of affordance and the topic of bodily representations, arguing that they are misguided; finally, I propose a view according to which the body’s physical and spatial properties are an unavoidable part of the content that guides everyday activities. (shrink)

There are two competing conceptions of the nature and domain of ecological science in the popular and academic literature, an orthodox conception and a more expansive conception. The orthodox conception conceives ecology as a natural biological science distinct from the human social sciences. The more expansive conception views ecology as a science whose domain properly spans both the natural and social sciences. On the more expansive conception, non-traditional ecological disciplines such as ecological psychology , ecological anthropology and ecological economics may (...) legitimately be regarded as sub-disciplines of ecology, and the practitioners of such disciplines as ecologists. The orthodox-expansionist issue is significant both for the practice of ecology and for the self-identity of the philosophy of ecology. I argue in favour of the expansionist conception of ecology on general conceptual grounds, and by developing the case for one particular non-traditional ecological discipline, ecological psychology. (shrink)

Perception is a central means by which we come to represent and be aware of particulars in the world. I argue that an adequate account of perception must distinguish between what one perceives and what one's perceptual experience is of or about. Through capacities for visual completion, one can be visually aware of particular parts of a scene that one nevertheless does not see. Seeing corresponds to a basic, but not exhaustive, way in which one can be visually aware of (...) an item. I discuss how the relation between seeing and visual awareness should be explicated within a representational account of the mind. Visual awareness of an item involves a primitive kind of reference: one is visually aware of an item when one's visual perceptual state succeeds in referring to that particular item and functions to represent it accurately. Seeing, by contrast, requires more than successful visual reference. Seeing depends additionally on meta-semantic facts about how visual reference happens to be fixed. The notions of seeing and of visual reference are both indispensable to an account of perception, but they are to be characterized at different levels of representational explanation. (shrink)

Shepard has supposed that the mind is stocked with innate knowledge of the world and that this knowledge figures prominently in the way we see the world. According to him, this internal knowledge is the legacy of a process of internalization; a process of natural selection over the evolutionary history of the species. Shepard has developed his proposal most fully in his analysis of the relation between kinematic geometry and the shape of the motion path in apparent motion displays. We (...) argue that Shepard has made a case for applying the principles of kinematic geometry to the perception of motion, but that he has not made the case for injecting these principles into the mind of the percipient. We offer a more modest interpretation of his important findings: that kinematic geometry may be a model of apparent motion. Inasmuch as our recommended interpretation does not lodge geometry in the mind of the percipient, the motivation of positing internalization, a process that moves kinematic geometry into the mind, is obviated. In our conclusion, we suggest that cognitive psychologists, in their embrace of internal mental universals and internalization may have been seduced by the siren call of metaphor. Key Words: apparent motion; imagery; internalization; inverse projection problem; kinematic geometry; measurement; metaphors of mind. (shrink)

In this paper we offer a theory of cross-modal objects. To begin, we discuss two kinds of linkages between vision and audition. The first is a duality. The the visual system detects and identifies surfaces ; the auditory system detects and identifies sources . Surfaces are illuminated by sources of light; sound is reflected off surfaces. However, the visual system discounts sources and the auditory system discounts surfaces. These and similar considerations lead to the Theory of Indispensable Attributes that states (...) the conditions for the formation of gestalts in the two modalities. The second linkage involves the formation of audiovisual objects, integrated cross-modal experiences. We describe research that reveals the role of cross-modal causality in the formation of such objects. These experiments use the canonical example of a causal link between vision and audition: a visible impact that causes a percussive sound. (shrink)

This paper is an exploration of how we do things with music—that is, the way that we use music as an esthetic technology to enact micro-practices of emotion regulation, communicative expression, identity construction, and interpersonal coordination that drive core aspects of our emotional and social existence. The main thesis is: from birth, music is directly perceived as an affordance-laden structure. Music, I argue, affords a sonic world, an exploratory space or nested acoustic environment that further affords possibilities for, among other (...) things, (1) emotion regulation and (2) social coordination. When we do things with music, we are engaged in the work of creating and cultivating the self, as well as creating and cultivating a shared world that we inhabit with others. I develop this thesis by first introducing the notion of a musical affordance . Next, I look at how emotional affordances in music are exploited to construct and regulate emotions. I summon empirical research on neonate music therapy to argue that this is something we emerge from the womb knowing how to do. I then look at social affordances in music, arguing that joint attention to social affordances in music alters how music is both perceived and appropriated by joint attenders within social listening contexts. In support, I describe the experience of listening to and engaging with music in a live concert setting. Thinking of music as an affordance-laden structure thus reaffirms the crucial role that music plays in constructing and regulating emotional and social experiences in everyday life. (shrink)

Human decision making shows systematic simplifications and deviations from the tenets of rationality (‘heuristics’) that may lead to suboptimal decisional outcomes (‘cognitive biases’). There are currently three prevailing theoretical perspectives on the origin of heuristics and cognitive biases: a cognitive-psychological, an ecological and an evolutionary perspective. However, these perspectives are mainly descriptive and none of them provides an overall explanatory framework for the underlying mechanisms of cognitive biases. To enhance our understanding of cognitive heuristics and biases we propose a neural (...) network framework for cognitive biases, which explains why our brain systematically tends to default to heuristic (‘Type 1’) decision making. We argue that many cognitive biases arise from intrinsic brain mechanisms that are fundamental for the working of biological neural networks. In order to substantiate our viewpoint, we discern and explain four basic neural network principles: (1) Association, (2) Compatibility (3) Retainment, and (4) Focus. These principles are inherent to (all) neural networks which were originally optimized to perform concrete biological, perceptual, and motor functions. They form the basis for our inclinations to associate and combine (unrelated) information, to prioritize information that is compatible with our present state (such as knowledge, opinions and expectations), to retain given information that sometimes could better be ignored, and to focus on dominant information while ignoring relevant information that is not directly activated. The supposed mechanisms are complementary and not mutually exclusive. For different cognitive biases they may all contribute in varying degrees to distortion of information. The present viewpoint not only complements the earlier three viewpoints, but also provides a unifying and binding framework for many cognitive bias phenomena. (shrink)

I consider the geometrical structure of the apparent visual field. Although the optics of vision is well understood, the nature of visual awareness remains largely in the dark. A famous attempt at a formal description of the apparent visual field was by Helmholtz, in the late nineteenth century. It purportedly explains the phenomenon of the subjective curvatures often reported when viewing objectively straight lines of great extent. I consider the general problem, and suggest an alternative formal account. On phenomenological grounds (...) the very existence of a coherent geometry may be doubted. Yet, although seemingly an academic question, the issue has very real consequences. The two models I consider here may approximately apply to certain visual modes. The nature of such visual modes is discussed. (shrink)

Summary In the current cognitive theory of music, concepts of Gestalt psychology are referred to in various ways. For example, neurocognitive models of music perception address the formation of auditory Gestalts as a stage in the formation of meaning. However, this view runs counter to central premises of Gestalt psychology of Carl Stumpf’s school, which precisely did not describe Gestalts as synthesized phenomena. Nevertheless, it is argued here, borrowing from Gestalt concepts can promote current non-reductionist positions. They conceptualize musical perception (...) not in the ways of information theory, but of phenomenology and action theory. Here the theory of affordance developed by J.J. Gibson in close collaboration with his wife Eleanor J. Gibson stands out. It was explicitly introduced into musicological research by Eric Clarke, but without reference to its Gestalt psychological roots. The article explores theories of musical affordance with the help of further methodological tools, which can be assigned to the philosophical schools of direct realism and constructivism. They open up the possibility of a non-cognitivist and non-representational perspective on musical perception. It turns out that Gestalt psychological concepts also have a catalytic effect on the expansion of our understanding of musical perception in this constellation, although this connection has hardly been visible so far. (shrink)

Cognition has traditionally been understood in terms of internal mental representations, and computational operations carried out on internal mental representations. Radical approaches propose to reconceive cognition in terms of agent-environment dynamics. An outstanding challenge for such a philosophical project is how to scale-up from perception and action to cases of what is typically called ‘higher-order’ cognition such as linguistic thought, the case we focus on in this paper. Perception and action are naturally described in terms of agent-environment dynamics, but can (...) a person’s thoughts about absent, abstract or counterfactual states of affairs also be accounted for in such terms? We argue such a question will seem pressing so long as one fails to appreciate how richly resourceful the human ecological niche is in terms of the affordances it provides. The explanatory work that is supposedly done by mental representations in a philosophical analysis of cognition, can instead be done by looking outside of the head to the environment structured by sociomaterial practices, and the affordances it makes available. Once one recognizes how much of the human ecological niche has become structured by activities of talking and writing, this should take away at least some of the motivation for understanding linguistic thinking in terms of content-bearing internal representations. We’ll argue that people can think about absent, abstract or counterfactual because of their skills for engaging with what we will call “enlanguaged affordances”. We make use of the phenomenological analysis of speech in Merleau-Ponty to show how the multiple affordances an individual is ready to engage with in a particular situation will typically include enlanguaged affordances. (shrink)

The assumption that psychological states and processes are computational in character pervades much of cognitive science, what many call the computational theory of mind. In addition to occupying a central place in cognitive science, the computational theory of mind has also had a second life supporting “individualism”, the view that psychological states should be taxonomized so as to supervene only on the intrinsic, physical properties of individuals. One response to individualism has been to raise the prospect of “wide computational systems”, (...) in which some computational units are instantiated outside the individual. “Wide computationalism” attempts to sever the link between individualism and computational psychology by enlarging the concept of computation. However, in spite of its potential interest to cognitive science, wide computationalism has received little attention in philosophy of mind and cognitive science. This paper aims to revisit the prospect of wide computationalism. It is argued that by appropriating a mechanistic conception of computation wide computationalism can overcome several issues that plague initial formulations. The aim is to show that cognitive science has overlooked an important and viable option in computational psychology. The paper marshals empirical support and responds to possible objections. (shrink)

It remains a standing problem how and why the first nervous systems evolved. Molecular and genomic information is now rapidly accumulating but the macroscopic organization and functioning of early nervous systems remains unclear. To explore potential evolutionary options, a coordination centered view is discussed that diverges from a standard input–output view on early nervous systems. The scenario involved, the skin brain thesis, stresses the need to coordinate muscle-based motility at a very early stage. This paper addresses how this scenario with (...) its focus on coordination also deals with sensory aspects. It will be argued that the neural structure required to coordinate extensive sheets of contractile tissue for motility provides the starting point for a new multicellular organized form of sensing. Moving a body by muscle contraction provides the basis for a multicellular organization that is sensitive to external surface structure at the scale of the animal body. Instead of thinking about early nervous systems as being connected to the environment merely through input and output, the implication developed here is that early nervous systems provide the foundation for a highly specific animal sensorimotor organization in which neural activity directly reflects bodily and environmental spatiotemporal structure. While the SBT diverges from the input–output view, it is closely linked to and supported by ongoing work on embodied approaches to intelligence to which it adds a new interpretation of animal embodiment and sensorimotor organization. (shrink)

This phenomenological-psychological study aims at discovering the essential constituents involved in congenitally blind people's spatial experiences. Nine congenitally blind persons took part in this study. The data were made up of half structured (thorough) interviews. The analysis of the data yielded the following three comprehension forms of spatiality; (i) Comprehension in terms of image-experience; (ii) Comprehension in terms of notions; (iii) Comprehension in terms of knowledge.Comprehension in terms of image experience is the form which is most concretely and clearly experienced. (...) It is important to notice, that this kind of image experience is not synonymous with a visually based image experience — a fact which is discussed in the article. The following three features, which are to be understood as a description of what characterizes congenitally blind people's image experience, are presented; (i) Experience of the whole; (ii) Synthesizing/Harmonizing; (iii) Spontanous presentation of the whole. Furthermore, comprehension in terms of image experience is made up of the following four constituents, which aim at specifying the conditions for the possibility of having an image experience; (i) The image experience is based on tactile experiences; (ii) The inner horizon of the object has to be limited in order for the tactile sense to constitute an image experience; (iii) The person must have reached a certain degree of familiarity with the object; (iv) The importance of the emotional investment in the object. (shrink)

What makes video games unique as an audiovisual medium is not just that they are interactive, but that this interactivity is rule bound and goal oriented. This means that player experience, including experience of the music, is somehow shaped or structured by these characteristics. Because of its emphasis on action in perception, James Gibson’s ecological approach to psychology—particularly his concept of affordances—is well suited to theorise the role of music in player experience. In a game, players perceive the environment and (...) gameplay situations in terms of the goal-oriented actions they afford. Nondiegetic music, not tied to any place in the digital game world, can play a unique role in the structuring of these affordances. Through a series of case studies, I will show that music creates and structures situations both in the game environment (such as the appearance of enemies in Unreal) and beyond the game environment (such as the death of an avatar and the restart of a level in Super Mario Bros.). (shrink)