I argue for the role of reinforcement learning in the philosophy of mind. To start, I make several assumptions about the nature of reinforcement learning and its instantiation in minds like ours. I then review some of the contributions of reinforcement learning methods have made across the so-called 'decision sciences.' Finally, I show how principles from reinforcement learning can shape philosophical debates regarding the nature of perception and characterisations of desire.

In their paper 'Reward is enough', Silver et al conjecture that the creation of sufficiently good reinforcement learning (RL) agents is a path to artificial general intelligence (AGI). We consider one aspect of intelligence Silver et al did not consider in their paper, namely, that aspect of intelligence involved in designing RL agents. If that is within human reach, then it should also be within AGI's reach. This raises the question: is there an RL environment which incentivises RL agents (...) to design RL agents? (shrink)

Philosophers of science have offered different accounts of what it means for one scientific theory to reduce to another. I propose a more or less friendly amendment to Kenneth Schaffner’s “General Reduction-Replacement” model of scientific unification. Schaffner interprets scientific unification broadly in terms of a continuum from theory reduction to theory replacement. As such, his account leaves no place on its continuum for type irreducible and irreplaceable theories. The same is true for other accounts that incorporate Schaffner's continuum, for example, (...) those developed by Paul Churchland, Clifford Hooker, and John Bickle. Yet I believe a more general account of scientific unification should include type irreducible and irreplaceable theories in an account of their partial reduction, specifically, when there is a reduction of their tokens. Thus I propose a “Reduction-Reception-Replacement” model wherein type irreducible and irreplaceable theories are accepted or received for the purpose of unifying domains of particulars. I also suggest a link between this kind of token reduction and mechanistic explanation. (shrink)

After generalizing the Archimedean property of real numbers in such a way as to make it adaptable to non-numeric structures, we demonstrate that the real numbers cannot be used to accurately measure non-Archimedean structures. We argue that, since an agent with Artificial General Intelligence (AGI) should have no problem engaging in tasks that inherently involve non-Archimedean rewards, and since traditional reinforcement learning rewards are real numbers, therefore traditional reinforcement learning probably will not lead to AGI. We indicate two (...) possible ways traditional reinforcement learning could be altered to remove this roadblock. (shrink)

Identity politics has been critiqued in various ways. One central problem—the Reinforcement Problem—claims that identity politics reinforces groups rooted in oppression thereby undermining its own liberatory aims. Here I consider two versions of the problem—one psychological and one metaphysical. I defang the first by drawing on work in social psychology. I then argue that careful consideration of the metaphysics of social groups and of the practice of identity politics provides resources to dissolve the second version. Identity politics involves the (...) creation or transformation of groups in ways that do not succumb to the metaphysical Reinforcement Problem. (shrink)

We consider an extended notion of reinforcement learning in which the environment can simulate the agent and base its outputs on the agent's hypothetical behavior. Since good performance usually requires paying attention to whatever things the environment's outputs are based on, we argue that for an agent to achieve on-average good performance across many such extended environments, it is necessary for the agent to self-reflect. Thus weighted-average performance over the space of all suitably well-behaved extended environments could be considered (...) a way of measuring how self-reflective an agent is. We give examples of extended environments and introduce a simple transformation which experimentally seems to increase some standard RL agents' performance in a certain type of extended environment. (shrink)

Background Men with antisocial personality disorder show lifelong abnormalities in adaptive decision making guided by the weighing up of reward and punishment information. Among men with antisocial personality disorder, modifi cation of the behaviour of those with additional diagnoses of psychopathy seems particularly resistant to punishment. Methods We did a case-control functional MRI (fMRI) study in 50 men, of whom 12 were violent off enders with antisocial personality disorder and psychopathy, 20 were violent off enders with antisocial personality disorder but (...) not psychopathy, and 18 were healthy non-off enders. We used fMRI to measure brain activation associated with the representation of punishment or reward information during an event-related probabilistic response-reversal task, assessed with standard general linear-model-based analysis. Findings Offenders with antisocial personality disorder and psychopathy displayed discrete regions of increased activation in the posterior cingulate cortex and anterior insula in response to punished errors during the task reversal phase, and decreased activation to all correct rewarded responses in the superior temporal cortex. This finding was in contrast to results for off enders without psychopathy and healthy non-off enders. Interpretation Punishment prediction error signalling in off enders with antisocial personality disorder and psychopathy was highly atypical. This finding challenges the widely held view that such men are simply characterised by diminished neural sensitivity to punishment. Instead, this fi nding indicates altered organisation of the information processing system responsible for reinforcement learning and appropriate decision making. This difference between violent offenders with antisocial personality disorder with and without psychopathy has implications for the causes of these disorders and for treatment approaches. (shrink)

Success semantics holds, roughly, that what it is for a state of an agent to be a belief that P is for it to be disposed to combine with her desires to cause behaviour that would fulfill those desires if P. J. T. Whyte supplements this with an account of the contents of an agent's “basic desires” to provide an attractive naturalistic theory of mental content. We argue that Whyte's strategy can avoid the objections raised against it by restricting “basic (...) desires” to sensory inclinations that cause us to do things independently of our beliefs about their contents. -/- La sémantique du succès soutient, en gros, que ce qu'il faut pour qu'un état d'un agent soit une croyance en P, c'est que cet état soit disposé à se combiner avec ses désirs pour provoquer un comportement qui répondrait à ces désirs si P. J. T. Whyte complète cela par un compte-rendu du contenu des « désirs de base » d'un agent pour fournir une théorie naturaliste attrayante du contenu mental. Nous soutenons que la stratégie de Whyte peut éviter les objections qui lui sont faites en restreignant les « désirs de base » aux inclinations sensorielles qui nous font agir indépendamment de nos croyances sur leur contenu. (shrink)

This paper will provide information about the concrete brand produced in the factory for the prefabricated elements and the comparison of the results given by the test of resistance to compression and the results of the test of the hammer impact of the sclerometer. The idea and the need to conduct this study arose for 2 main reasons: first, from the poor results often obtained from sclerometer impact to the elements in the field, despite the compression resistance test with cubic (...) samples taken in the concrete cast and the carrot test directly on the element assembled in the building provides good results. Secondly, to have a connection between the values of the concrete brand resulting from the pressure resistance test with a press performed in the laboratory and the impact test with the sclerometer hammer which is often performed in the field under different conditions. The sclerometer impact tests will be performed on each cube sample before it is broken, in the press, and the sclerometer impact tests will be performed on the concrete elements from which the cube sample was taken on the day that this sample will be destroyed. The predicted results are relatively close values related to the age between14th day and the 28th day of the concrete maturity, as determined by the manual of the sclerometer that the study is going to use, and other values for the other days (1, 3,7,14,28). But in fact, just like in the field tests done before, it is noticed that the results obtained from the blows with the sclerometer hammer are weak. The aim of the paper is to find a logical connection between the results of these 2 types of tests. This study will contain information on the composition of the concrete produced in the IXHEM SHPK factory (ltd) located in Durres-Albania, the brands of concrete on different days for different elements, and the comparison of the results between the 2 methods mentioned above. (shrink)

Abstract: Polystyrene/waste tires composites were prepared in this study by incorporating small particles of waste tires into polydisperse commercial polystyrene (PS) in a melt-mixing method. The dynamic mechanical properties of PS and PS/composite were studied using ARES-Rheometer under nitrogen atmosphere in parallel plate geometry with diameter 8 mm. The measurements were carried out over a wide range of temperatures ranged from 120°C to 220°C and frequencies from 100 to 0.1 radians per second. The shear compliance of PS composite were studied (...) and compared with those of unfilled PS. The shear compliance were studied and evaluated. Where the values of J' at  = 0.06 radians/s are 110-4 and 5.310-5 Pa-1 for PS and PS composite, respectively At  = 0.1 radians/s the addition of the rubber alters the value of J'' from 1.610-4 to 8.410-5 Pa-1. That means the stability of PS is enhanced by the incorporation of the rubber. (shrink)

Abstract: In this work, polystyrene/waste tires composites were prepared by incorporating of waste tires into polydisperse commercial polystyrene in a melt-mixing method. The rheological characterization of PS and PS/composite have been studied and compared. These properties were studied using ARES-Rheometer under nitrogen atmosphere in parallel plate geometry with diameter 8 mm. The measurements are carried out over a wide range of temperatures ranged from 120°C to 220°C and frequencies from 100 to 0.1 radians per second. The complex modulus (G*) were (...) evaluated and compared with those of unfilled PS. The dynamic mechanical properties and stability at elevated temperatures were found to increase with the addition of waste tires to PS as confirmed by the results. The results showed that the value of G* at  = 1.0 radian/s is 1.8104 and 4.4104 Pa for PS and PS/waste tires, respectively. This difference rises at low frequencies-branch to be the value of G* at  = 0.06 radian/s is 8.8102 and 7.8103 Pa for PS and PS/waste tires, respectively. Generally G* increases by the addition of rubber as filler for PS . (shrink)

We present a game mechanic called pseudo-visibility for games inhabited by non-player characters (NPCs) driven by reinforcement learning (RL). NPCs are incentivized to pretend they cannot see pseudo-visible players: the training environment simulates an NPC to determine how the NPC would act if the pseudo-visible player were invisible, and penalizes the NPC for acting differently. NPCs are thereby trained to selectively ignore pseudo-visible players, except when they judge that the reaction penalty is an acceptable tradeoff (e.g., a guard might (...) accept the penalty in order to protect a treasure because losing the treasure would hurt even more). We describe an RL agent transformation which allows RL agents that would not otherwise do so to perform some limited self-reflection to learn the training environments in question. (shrink)

Because culture plays a role in determining the aesthetic merit of a work of art, intrinsically similar works can have different aesthetic merit when assessed in different cultures. This paper argues that a form of aesthetic hedonism is best placed to account for this relativity of aesthetic value. This form of hedonism is based on a functional account of aesthetic pleasure, according to which it motivates and enables mental engagement with artworks, and an account of pleasure-learning, in which it reinforces (...) the appreciation of culture specific ways of engaging with art. (shrink)

In modern, culturally-heterogeneous societies, inefficiency of communication of important moral concepts is often evidenced by asymmetrical moral judgements and hypocritical behaviour, especially in our increasingly compartmentalised social landscapes [Rozuel 2011]. This raises the question of how to present target audiences with some (perhaps novel) moral concept, like an ethical dimension of one’s ecological attitude, in a way which would resonate with them, and be conducive to a coherent moral stance, decreasing action-observer biases. We analyse this problem by introducing a formal (...) moral inconsistency framework. We consider the ways in which the aforementioned problem might be tackled in existing cognitive science of morality (CSM) nativist frameworks, and, secondly, we investigate it from the perspective of moral learning, finally proposing the notion of moral dimensionality of a representation in the context of model-based reinforcement learning, as a useful conceptual tool for studying the problem. (shrink)

Mathematicians and software developers use the word "function" very differently, and yet, sometimes, things that are in practice implemented using the software developer's "function", are mathematically formalized using the mathematician's "function". This mismatch can lead to inaccurate formalisms. We consider a special case of this meta-problem. Various kinds of agents might, in actual practice, make use of private memory, reading and writing to a memory-bank invisible to the ambient environment. In some sense, we humans do this when we silently subvocalize (...) thoughts about the actions we are taking (at least when the environment we're in is too primitive to probe the contents of our brains). Mathematical function formalizations of agents often ignore this ability. We show that in a general agent-environment framework (of which reinforcement learning is a special case), in a technical sense, such private memories do not enable qualitatively different agent behavior. (shrink)

Curiosity is evident in humans of all sorts from early infancy, and it has also been said to appear in a wide range of other animals, including monkeys, birds, rats, and octopuses. The classical definition of curiosity as an intrinsic desire for knowledge may seem inapplicable to animal curiosity: one might wonder how and indeed whether a rat could have such a fancy desire. Even if rats must learn many things to survive, one might expect their learning must be driven (...) by simpler incentives, such as hunger. One might also wonder what proximal signals could guide animals towards knowledge itself, or how something as abstract as knowledge could ever be a motivational target for an unreflective animal. Taking a cue from recent work in reinforcement learning, I argue that surprise functions as a reward signal for the curious animal, and then show how this amounts to a desire for knowledge gain, where knowledge is conceived of as a cognitive adaptation to reality. This adaptation results in a mental state whose existence depends essentially on the truth of its contents, a factive mental state. Curious creatures benefit from an interaction between the prediction-error correction processes of basic learning and the active surprise-seeking force of their curiosity. This internally adversarial interaction accelerates knowledge gain in ways that are very helpful for agents with the restrictions of biological creatures, in environments with the complexity of our natural world. (shrink)

Inspired by recent progress in multi-agent Reinforcement Learning (RL), in this work we examine the collective intelligent behaviour of theoretical universal agents by introducing a weighted mixture operation. Given a weighted set of agents, their weighted mixture is a new agent whose expected total reward in any environment is the corresponding weighted average of the original agents' expected total rewards in that environment. Thus, if RL agent intelligence is quantified in terms of performance across environments, the weighted mixture's intelligence (...) is the weighted average of the original agents' intelligences. This operation enables various interesting new theorems that shed light on the geometry of RL agent intelligence, namely: results about symmetries, convex agent-sets, and local extrema. We also show that any RL agent intelligence measure based on average performance across environments, subject to certain weak technical conditions, is identical (up to a constant factor) to performance within a single environment dependent on said intelligence measure. (shrink)

I propose that the successes and contributions of reinforcement learning urge us to see the mind in a new light, namely, to recognise that the mind is fundamentally evaluative in nature.

Where do values live in thought? A straightforward answer is that we (or our brains) make decisions using explicit value representations which are our values. Recent work applying reinforcement learning to decision-making and planning suggests that more specifically, we may represent both the instrumental expected value of actions as well as the intrinsic reward of outcomes. In this paper, I argue that identifying value with either of these representations is incomplete. For agents such as humans and other animals, there (...) is another place where reward can be located in thought: the division of the space of possibilities or ‘state space’. (shrink)

In this paper, I examine Reinforcement Learning modelling practice in psychiatry, in the context of alcohol use disorders. I argue that the epistemic roles RL currently plays in the development of psychiatric classification and search for explanations of clinically relevant phenomena are best appreciated in terms of Chang’s account of epistemic iteration, and by distinguishing mechanistic and aetiological modes of computational explanation.

This paper aims to contribute to the existing literature on normative cognition by providing a lineage explanation of human social norm psychology. This approach builds upon theories of goal-directed behavioral control in the reinforcement learning and control literature, arguing that this form of control defines an important class of intentional normative mental states that are instrumental in nature. I defend the view that great ape capacities for instrumental reasoning and our capacity (or family of capacities) for shared intentionality coadapted (...) to each other and argue that the evolution of this capacity has allowed the representation of social norms and the emergence of our capacity for normative guidance. (shrink)

This study is done in order to find the factor of depression among the college student in Malaysia. Depression among the college student are increasing as it come from many factor. This study used behavioural theory as the foundations theories for the model development. The study involved 406 respondents, selected through google form responses involving all the university students around Malaysia. A structured questionnaire was used for data collection. All variables were measured through scales previously used by other researchers. In (...) behavioural theory, state that depression people precisely those who do not know how to cope with the fact that they are no longer receiving positive reinforcement like they before. Results shows the data analysis described that respondents having a financial problem where did not what how to differentiate between wants and need with the overall mean (M=2.51) and students always spend their money on uncertain things. (shrink)

I reinforce my defense of permissivism about the rationality of doxastic attitudes on the face of a certain body of evidence against criticism published in this journal by Anantharaman. After making some conceptual clarifications, I manage to show that at least one of my original arguments pro-permissivism is left unscathed by Anantharaman's points.

Negation often reinforces problematic habits of othering, but rethinking negation can make good on feminist hopes for logic as a transformative space for inclusion. As Plumwood argues in her 1993 paper, not all uses of negation in the context of social identity are inherently problematic, but the widespread implicit use of classical negation has limited our options with respect to representing difference, ultimately reinforcing dualisms that essentialize social differences in problematic ways. In response to these limitations, I take inspiration from (...) Dembroff’s recent work on the metaphysics of genderqueer identity to build models of social identity using the Heyting-Brouwer logic developed by Rauszer in her 1974 paper. Ultimately, I argue that these models demonstrate both how classical negation reinforces problematic habits of othering and how alternative forms of negation can transform our treatment of social identity altogether. (shrink)

The simulation hypothesis can reinforce a cynical dismissal of human potential. This attitude can allow online platform designers to rationalize employing manipulative neuromarketing techniques to control user decisions. We point to cognitive boosting techniques at both user and designer levels to build critical reflection and mindfulness.

Recent conversation has blurred two very different social epistemic phenomena: echo chambers and epistemic bubbles. Members of epistemic bubbles merely lack exposure to relevant information and arguments. Members of echo chambers, on the other hand, have been brought to systematically distrust all outside sources. In epistemic bubbles, other voices are not heard; in echo chambers, other voices are actively undermined. It is crucial to keep these phenomena distinct. First, echo chambers can explain the post-truth phenomena in a way that epistemic (...) bubbles cannot. Second, each type of structure requires a distinct intervention. Mere exposure to evidence can shatter an epistemic bubble, but may actually reinforce an echo chamber. Finally, echo chambers are much harder to escape. Once in their grip, an agent may act with epistemic virtue, but social context will pervert those actions. Escape from an echo chamber may require a radical rebooting of one's belief system. (shrink)

The paper remains and reinforces a viewpoint that science and religion (theology) are methodologically and epistemologically independent. However, it also suggests that this independence can be overcome if a "third party" is taken into account, that is - philosophy. Such possibility seems to follow from the thesis of incommensurability and the thesis of underdetermination formulated and analyzed in current philosophy of science.

In this paper, I argue that echo chambers pose a problem for moral progress because of their threat to moral reasoning. I argue for two theses about the epistemology of moral progress: (1) the practical utility thesis: moral reasoning plays an important role in improving moral judgments, and (2) the conflictive social reasoning thesis: the kind of moral reasoning that is important for moral progress involves social reasoning with disputants. Without some conflict, human beings will naturally reason in a biased (...) and otherwise poor manner. Thus, good reasoning must be social so that reasoners who disagree can keep each other in check. These two theses explain why echo chambers are a problem for moral progress. I argue that echo chambers isolate individuals from reasoning with those they disagree with. This is because echo chambers act as a mechanism for discrediting those outside the chamber. If this is true, then the members of an echo chamber will only reason with those who agree with them. The result is that echo chamber members won't reason according to the conflictive social reasoning thesis. Reasoning will only reinforce their existing echoed beliefs rather than improve them. (shrink)

In the trust-health relationship, how trusting other people in society may promote good health is a topic often examined. However, the other direction of influence – how health may affect trust – has not been well explored. In order to investigate this possible effect, we employed Bayesian Mindsponge Framework (BMF) analytics to go deeper into the information processing mechanisms underlying the expressions of trust. Conducting Bayesian analysis on a dataset of 1237 residents from Cali, Colombia, we found that general health (...) status is positively associated with generalized trust, but recent experiences of illnesses/injuries have a negative moderating effect. Personalized trust is largely unchanged across different general health conditions, but the trust level becomes higher with recent experiences of illnesses/injuries. Psychophysiological mechanisms of increasing information filtering intensity toward unfamiliar sources during a vulnerable state of health is a plausible explanation of found patterns in generalized trust. Because established personal relationships are reinforced information channels, personalized trust is not affected as much. Rather, the results suggest that people may rely even more on loved ones when they are in bad health conditions. This exploratory study shows that the trust-health relationship can be examined from a different angle that may provide new insights. (shrink)

In this paper, we defend two main claims. The first is a moderate claim: we have a negative duty to not use binary gender-specific pronouns he or she to refer to genderqueer individuals. We defend this with an argument by analogy. It was gravely wrong for Mark Latham to refer to Catherine McGregor, a transgender woman, using the pronoun he; we argue that such cases of misgendering are morally analogous to referring to Angel Haze, who identifies as genderqueer, as he (...) or she. The second is a radical claim: we have a negative duty to not use any gender-specific pronouns to refer to anyone, regardless of their gender identity. We offer three arguments in favor of this claim (which appeal to concerns about inegalitarianism and risk, invasions of privacy, and reinforcing essentialist ideologies). We also show why the radical claim is compatible with the moderate claim. Before concluding, we examine common concerns about incorporating either they or a neologism such as ze as a third-person singular gender-neutral pronoun. These concerns, we argue, do not provide sufficient reason to reject either the moderate or radical claim. (shrink)

The paper brings a challenge to Cartesian dualism, while introducing some under-explored manuscript remarks from Wittgenstein’s middle period, which are methodologically and thematically akin to some passages from Merleau-Ponty’s early period. Cartesian dualism relegates pain to mental awareness and location to bodily extension, thus rendering common localizations of pain throughout the body as unintelligible ascriptions. Wittgenstein’s and Merleau-Ponty’s attempts at doing justice to common localizations of pain are mutually illuminating. In their light, Cartesian dualism turns out to involve an objectification (...) and a deappropriation of one’s body. Moreover, Wittgenstein’s unveiling a heterogeneous multiplicity of corporeal spaces (e.g. visual-space, tactile-space, feeling-space) rehabilitates the view, reinforced by Merleau-Ponty, that corporeal pain is intimately related to corporeal localization, while corporeal space is not part of the physical space of things. (shrink)

This paper will suggest that the work Alfred North Whitehead provides a fruitful resource for understanding the philosophical development and validity of scientific concepts through an analysis of their socio-historical location. The paper will address two key elements of Whitehead?s thought. One element is "The Bifurcation of Nature" and the paper traces the influence that this conceptual compromise has had on philosophy and science through its reinforcement of the division between the natural and the social sciences. The second element (...) is the status of abstraction in thought and existence. The article will outline Whitehead?s argument that it is necessary to pay attention to the social environment which both enables and inhibits thought if historical epistemology is to develop novel yet analytically strong concepts. (shrink)

This article explores the metaphor of Science as provider of sharp images of our environment, using the epistemological framework of Objective Cognitive Constructivism. These sharp images are conveyed by precise scientific hypotheses that, in turn, are encoded by mathematical equations. Furthermore, this article describes how such knowledge is pro-duced by a cyclic and recursive development, perfection and reinforcement process, leading to the emergence of eigen-solutions characterized by the four essential properties of precision, stability, separability and composability. Finally, this article (...) discusses the role played by ontology and metaphysics in the scientific production process, and in which sense the resulting knowledge can be considered objective. (shrink)

Nihilism, Nietzsche and the Doppelganger Problem Was Nietzsche a nihilist? Yes, because, like J. L. Mackie, he was an error-theorist about morality, including the elitist morality to which he himself subscribed. But he was variously a diagnostician, an opponent and a survivor of certain other kinds of nihilism. Schacht argues that Nietzsche cannot have been an error theorist, since meta-ethical nihilism is inconsistent with the moral commitment that Nietzsche displayed. Schacht’s exegetical argument parallels the substantive argument (advocated in recent years (...) by Wright and Blackburn) that Mackie’s error theory can’t be true because if it were, we would have to give up morality or give up moralizing. I answer this argument with a little bit of help from Nietzsche. I then pose a problem, the Doppelganger Problem, for the meta-ethical nihilism that I attribute to Mackie and Nietzsche. (If A is a moral proposition then not-A is a moral proposition: hence not all moral propositions can be false.) I solve the problem by reformulating the error theory and also deal with a variant of the problem, the Reinforced Doppelganger, glancing at a famous paper of Ronald Dworkin’s. Thus, whatever its demerits, the error theory, is not self-refuting, nor does it require us to give up morality. (shrink)

I propose to study one problem for epistemic dependence on experts: how to locate experts on what I will call cognitive islands. Cognitive islands are those domains for knowledge in which expertise is required to evaluate other experts. They exist under two conditions: first, that there is no test for expertise available to the inexpert; and second, that the domain is not linked to another domain with such a test. Cognitive islands are the places where we have the fewest resources (...) for evaluating experts, which makes our expert dependences particularly risky. -/- Some have argued that cognitive islands lead to the complete unusability of expert testimony: that anybody who needs expert advice on a cognitive island will be entirely unable to find it. I argue against this radical form of pessimism, but propose a more moderate alternative. I demonstrate that we have some resources for finding experts on cognitive islands, but that cognitive islands leave us vulnerable to an epistemic trap which I will call runaway echo chambers. In a runaway echo chamber, our inexpertise may lead us to pick out bad experts, which will simply reinforce our mistaken beliefs and sensibilities. (shrink)

On analogy with testimony, I define a notion of a scientific theory’s lacking or having candor, in a testing situation, according to whether the theory under test is probabilistically relevant to the processes in the test procedures, and thereby to the reliability of test outcomes. I argue that this property identifies what is distinctive about those theories that Karl Popper denounced as exhibiting “reinforced dogmatism” through their self-protective behavior (e.g., psychoanalysis, Hegelianism, Marxism). I explore whether lack of candor interferes with (...) the testing of theories, and conclude that (1) our default attitude toward theories that lack candor in a given test should be suspicion, but (2) the circumstance that a theory lacks candor in a testing situation does not preclude obtaining independent evidence for the auxiliary assumptions to which the theory is probabilistically relevant, and thereby eliminating the problem that lack of candor creates. Thus, Popper was right to think that lack of candor is a bad thing, but wrong to conclude that candor is a criterion of the scientificity of a theory. Seeing this requires recognition of some differences between intuitive relevance and probabilistic relevance, and proper appreciation of the notion of screening off and of the fact that probabilistic relevance is not transitive. (shrink)

Many realists argue that present scientific theories will not follow the fate of past scientific theories because the former are more successful than the latter. Critics object that realists need to show that present theories have reached the level of success that warrants their truth. I reply that the special theory of relativity has been repeatedly reinforced by unconceived scientific methods, so it will be reinforced by infinitely many unconceived scientific methods. This argument for the special theory of relativity overcomes (...) the critics’ objection, and has advantages over the no-miracle argument and the selective induction for it. (shrink)

I give an account of the structure of “oppressive double binds,” the double binds that exist in virtue of oppression. I explain how these double binds both are a product of and serve to reinforce o...

I explain and motivate the shutdown problem: the problem of creating artificial agents that (1) shut down when a shutdown button is pressed, (2) don’t try to prevent or cause the pressing of the shutdown button, and (3) otherwise pursue goals competently. I then propose a solution: train agents to have incomplete preferences. Specifically, I propose that we train agents to lack a preference between every pair of different-length trajectories. I suggest a way to train such agents using reinforcement (...) learning: we give the agent lower reward for repeatedly choosing same-length trajectories. (shrink)

Complex environmental problems require well-researched policies that integrate knowledge from both the natural and social sciences. Epistemic differences can impede interdisciplinary collaboration, as shown by debates between conservation biologists and anthropologists who are working to preserve biological diversity and support economic development in central Africa. Disciplinary differences with regard to 1) facts, 2) rigor, 3) causal explanation, and 4) research goals reinforce each other, such that early decisions about how to define concepts or which methods to adopt may tilt research (...) design and data interpretation toward one discipline’s epistemological framework. If one of the contributing fields imposes a solution to an epistemic problem, this sets the stage for what I call disciplinary capture. Avoiding disciplinary capture requires clear communication between collaborators, but beyond this it also requires that collaborators craft research questions and innovate research designs which are different from the inherited epistemological frameworks of contributing disciplines. (shrink)

We present a theory of human artistic experience and the neural mechanisms that mediate it. Any theory of art has to ideally have three components. The logic of art: whether there are universal rules or principles; The evolutionary rationale: why did these rules evolve and why do they have the form that they do; What is the brain circuitry involved? Our paper begins with a quest for artistic universals and proposes a list of ‘Eight laws of artistic experience’ -- a (...) set of heuristics that artists either consciously or unconsciously deploy to optimally titillate the visual areas of the brain. One of these principles is a psychological phenomenon called the peak shift effect: If a rat is rewarded for discriminating a rectangle from a square, it will respond even more vigorously to a rectangle that is longer and skinnier that the prototype. We suggest that this principle explains not only caricatures, but many other aspects of art. Example: An evocative sketch of a female nude may be one which selectively accentuates those feminine form-attributes that allow one to discriminate it from a male figure; a Boucher, a Van Gogh, or a Monet may be a caricature in ‘colour space’ rather than form space. Even abstract art may employ ‘supernormal’ stimuli to excite form areas in the brain more strongly than natural stimuli. Second, we suggest that grouping is a very basic principle. The different extrastriate visual areas may have evolved specifically to extract correlations in different domains , and discovering and linking multiple features into unitary clusters -- objects -- is facilitated and reinforced by direct connections from these areas to limbic structures. In general, when object-like entities are partially discerned at any stage in the visual hierarchy, messages are sent back to earlier stages to alert them to certain locations or features in order to look for additional evidence for the object . Finally, given constraints on allocation of attentional resources, art is most appealing if it produces heightened activity in a single dimension rather than redundant activation of multiple modules. This idea may help explain the effectiveness of outline drawings and sketches, the savant syndrome in autists, and the sudden emergence of artistic talent in fronto-temporal dementia. In addition to these three basic principles we propose five others, constituting a total of ‘eight laws of aesthetic experience’. (shrink)

That parthood is a transitive relation is among the most basic principles of classical mereology. Alas, it is also very controversial. In a recent paper, Ingvar Johansson has put forward a novel diagnosis of the problem, along with a corresponding solution. The diagnosis is on the right track, I argue, but the solution is misleading. And once the pieces are properly put together, we end up with a reinforcement of the standard defense of transitivity on behalf of classical mereology.

Tackling climate change is one of the most demanding challenges of humanity in the 21st century. Still, the efforts to mitigate the current environmental crisis do not seem enough to deal with the increased existential risks for the human and other species. Persson and Savulescu have proposed that our evolutionarily forged moral psychology is one of the impediments to facing as enormous a problem as global warming. They suggested that if we want to address properly some of the most pressing (...) problems that cause catastrophic harm to our existence, we should enhance our moral behavior by biomedical means. The objective of this paper is, precisely, to reflect on whether a Moral Bio-Enhancement (henceforth MBE) program would be a viable option to confront the climate emergency. To meet this goal, I will propose the Ultimate Mostropic (hereafter UM) thought experiment, a hypothetical situation where we have already discovered the UM, an available, safe (without any deleterious secondary effects), extremely cheap and effective pill to enhance our cognitive, affective and motivational abilities related to morality. After briefly presenting the main argument of Persson and Savulescu regarding MBE and climate change, I will point out some of the difficulties that make MBE a daunting but exciting philosophical and scientific debate. In order to overcome these complications, I will describe the UM thought experiment, which involves two scenarios of the MBE program: (a) the state-driven, compulsory and universal enterprise, and (b) the initiative of voluntary individuals. I will show that the shortcomings of MBE programs through the UM in both scenarios make Persson and Savulescu’s proposal a not appealing pathway to mitigate climate change. In the final section, I will suggest that an inaccurate attribution of responsibilities underlies their proposal and that the collective inaction problem should be redirected primarily through a reinforcement of the political nature of the solutions. (shrink)

A widely cited roadblock to bridging ecological psychology and enactivism is that the former identifies with realism and the latter identifies with constructivism, which critics charge is subjectivist. A pragmatic reading, however, suggests non-mental forms of constructivism that simultaneously fit core tenets of enactivism and ecological realism. After advancing a pragmatic version of enactive constructivism that does not obviate realism, I reinforce the position with an empirical illustration: Physarum polycephalum (a slime mold), a communal unicellular organism that leaves slime trails (...) that form chemical barriers that it avoids in foraging explorations. Here, environmental building and sensorimotor engagement are part of the same process with P. polycephalum coordinating around self-created, affordance-bearing geographies, which nonetheless exist independently in ways described by ecological realists. For ecological psychologists, affordances are values, meaning values are external to the perceiver. I argue that agent-enacted values have the same status and thus do not obviate ecological realism or generate subjectivism. The constructivist-realist debate organizes around the emphasis that enactivists and ecological theorists respectively place on the inner constitution of organisms vs. the structure of environments. Building on alimentary themes introduced in the P. polycephalum example and also in Gibson’s work, I go on to consider how environment, brain, visceral systems, and even bacteria within them enter perceptual loops. This highlights almost unfathomable degrees of mutually modulating internal and external synchronization. It also shows instances in which internal conditions alter worldly configurations and invert values, in Gibson’s sense of the term, albeit without implying subjectivism. My aim is to cut across the somatic focus of enactive constructivism and the external environment-oriented emphasis of ecological realism and show that enactivism can enrich ecological accounts of value. (shrink)

This paper presents a new account of aesthetic pleasure, according to which it is a distinct psychological structure marked by a characteristic self-reinforcing motivation. Pleasure figures in the appreciation of an object in two ways: In the short run, when we are in contact with particular artefacts on particular occasions, aesthetic pleasure motivates engagement and keeps it running smoothly—it may do this despite the fact that the object we engagement is aversive in some ways. Over longer periods, it plays a (...) critical role in shaping how we engage with objects to get this kind of pleasure from them. This account is yoked to a broadly functional understanding of art: it is not the nature of the object that makes it art, but the nature of the response that it is designed to elicit. The view does not, however, rest on individual psychology alone, as some other functional accounts do. Crucially, it is argued that shared cultural context is a key determinant of the pleasure we derive from aesthetic artefacts. The pleasure of art is always communal and communicative. (shrink)

Epistemic Courage is a timely and thought-provoking exploration of the ethics of belief, which shows why epistemology is no mere academic abstraction - the question of what to believe couldn't be more urgent. Jonathan Ichikawa argues that a skeptical, negative bias about belief is connected to a conservative bias that reinforces the status quo.

To address the rising concern that algorithmic decision-making may reinforce discriminatory biases, researchers have proposed many notions of fairness and corresponding mathematical formalizations. Each of these notions is often presented as a one-size-fits-all, absolute condition; however, in reality, the practical and ethical trade-offs are unavoidable and more complex. We introduce a new approach that considers fairness—not as a binary, absolute mathematical condition—but rather, as a relational notion in comparison to alternative decisionmaking processes. Using US mortgage lending as an example use (...) case, we discuss the ethical foundations of each definition of fairness and demonstrate that our proposed methodology more closely captures the ethical trade-offs of the decision-maker, as well as forcing a more explicit representation of which values and objectives are prioritised. (shrink)

Numbers are concepts whose content, structure, and organization are influenced by the material forms used to represent and manipulate them. Indeed, as argued here, it is the inclusion of multiple forms (distributed objects, fingers, single- and two-dimensional forms like pebbles and abaci, and written notations) that is the mechanism of numerical elaboration. Further, variety in employed forms explains at least part of the synchronic and diachronic variability that exists between and within cultural number systems. Material forms also impart characteristics like (...) linearity that may persist in the form of knowledge and behaviors, ultimately yielding numerical concepts that are irreducible to and functionally independent of any particular form. Material devices used to represent and manipulate numbers also interact with language in ways that reinforce or contrast different aspects of numerical cognition. Not only does this interaction potentially explain some of the unique aspects of numerical language, it suggests that the two are complementary but ultimately distinct means of accessing numerical intuitions and insights. The potential inclusion of materiality in contemporary research in numerical cognition is advocated, both for its explanatory power, as well as its influence on psychological, behavioral, and linguistic aspects of numerical cognition. (shrink)

Interactions between an intelligent software agent and a human user are ubiquitous in everyday situations such as access to information, entertainment, and purchases. In such interactions, the ISA mediates the user’s access to the content, or controls some other aspect of the user experience, and is not designed to be neutral about outcomes of user choices. Like human users, ISAs are driven by goals, make autonomous decisions, and can learn from experience. Using ideas from bounded rationality, we frame these interactions (...) as instances of an ISA whose reward depends on actions performed by the user. Such agents benefit by steering the user’s behaviour towards outcomes that maximise the ISA’s utility, which may or may not be aligned with that of the user. Video games, news recommendation aggregation engines, and fitness trackers can all be instances of this general case. Our analysis facilitates distinguishing various subcases of interaction, as well as second-order effects that might include the possibility for adaptive interfaces to induce behavioural addiction, and/or change in user belief. We present these types of interaction within a conceptual framework, and review current examples of persuasive technologies and the issues that arise from their use. We argue that the nature of the feedback commonly used by learning agents to update their models and subsequent decisions could steer the behaviour of human users away from what benefits them, and in a direction that can undermine autonomy and cause further disparity between actions and goals as exemplified by addictive and compulsive behaviour. We discuss some of the ethical, social and legal implications of this technology and argue that it can sometimes exploit and reinforce weaknesses in human beings. (shrink)

This paper considers issues raised by Elizabeth Anderson’s recent critique of the position she terms ‘luck egalitarianism’. It is maintained that luck egalitarianism, once clarified and elaborated in certain regards, remains the strongest egalitarian stance. Anderson’s arguments that luck egalitarians abandon both the negligent and prudent dependent caretakers fails to account for the moderate positions open to luck egalitarians and overemphasizes their commitment to unregulated market choices. The claim that luck egalitarianism insults citizens by redistributing on the grounds of paternalistic (...) beliefs, pity and envy, and by making intrusive and stigmatizing judgments of responsibility, fails accurately to characterize the luck egalitarian’s rationale for redistribution and relies upon luck egalitarians being insensitive to the danger of stigmatization. The luck egalitarian position is reinforced by the fact that Anderson’s favoured conception of equality, ‘democratic equality’, is counterintuitively indifferent to all unchosen inequalities, including intergenerational inequalities, once bare social minima are met. (shrink)