Can an agent's intelligence level be negative? We extend the Legg-Hutter agent-environment framework to include punishments and argue for an affirmative answer to that question. We show that if the background encodings and Universal Turing Machine (UTM) admit certain Kolmogorov complexity symmetries, then the resulting Legg-Hutter intelligence measure is symmetric about the origin. In particular, this implies reward-ignoring agents have Legg-Hutter intelligence 0 according to such UTMs.

Recent philosophical work has praised the reward structure of science, while recent empirical work has shown that many scientific results may not be reproducible. I argue that the reward structure of science incentivizes scientists to focus on speed and impact at the expense of the reproducibility of their work, thus contributing to the so-called reproducibility crisis. I use a rational choice model to identify a set of sufficient conditions for this problem to arise, and I argue that these (...) conditions plausibly apply to a wide range of research situations. Currently proposed solutions will not fully address this problem. Philosophical commentators should temper their optimism about the reward structure of science. (shrink)

In this paper, we raise and discuss a puzzle about the relationships among goods, reasons, and deontic status. Suppose you have it within your power to give someone something they would enjoy. The following claims seem platitudinous: you can use this power to reward whatever kind of option you want, thereby making that option better and generating a reason for that person to perform it; this reason is then weighed alongside and against the other reasons at play; and altogether, (...) the reasons determine the deontic statuses of that person’s options. We show, however, that in a certain class of cases at least one of these apparent platitudes must be false. In particular, we show that in a certain kind of case wrongfulness cannot be rewarded. In some cases, if one tries to reward wrongfulness, something surprising must go awry: either what you attempt to give as a reward would not, in fact, be good, or it would not generate a reason, or it would have a surprising effect on the deontic status of the relevant options. The upshot is that the relationships among goods, reasons, and deontic status are complicated in ways that have not previously been remarked. (shrink)

This paper employs a case study from the history of neuroscience—brain reward function—to scrutinize the inductive argument for the so-called ‘Heuristic Identity Theory’ (HIT). The case fails to support HIT, illustrating why other case studies previously thought to provide empirical support for HIT also fold under scrutiny. After distinguishing two different ways of understanding the types of identity claims presupposed by HIT and considering other conceptual problems, we conclude that HIT is not an alternative to the traditional identity theory (...) so much as a relabeling of previously discussed strategies for mechanistic discovery. (shrink)

Traditionally, Kantian ethics has been thought hostile to agents' well-being. Recent commentators have rightly called this view into question, but they do not push their challenge far enough. For they leave in place a fundamental assumption on which the traditional view rests, viz., that happiness is all there is to well-being. This assumption is important, since, combined with Kant’s rationalism about morality and empiricism about happiness, it implies that morality and well-being are at best extrinsically related. Since morality can only (...) make our lives go well by making us happy, and since morality can only make us happy by influencing our sensibility, morality is not its own reward--not really. It is simply the condition for some separate benefit. Drawing on Kant’s underappreciated discussion of self-contentment, an intellectual analog of happiness, I reconstruct an alternative account of morality’s relation to well-being. Morality does make our lives go well--and so is its own reward--not because it makes us happy but because it makes us self-contented. (shrink)

Purpose - The aim of this research was to investigate the effect of transformational leadership and transactional contingent reward as complementary, but distinct, forms of leadership on facets of organizational identification via the perception of innovation and goal organizational values. Design/methodology/approach – Three studies were carried out implementing either a measurement of mediation or experimental-causal-chain design to test for the hypothesized effects. Findings - The measurement of mediation study showed that transformational leadership had a positive direct and indirect effect, (...) via innovation value orientation, on cognitive identification, whereas transactional contingent reward was more strongly related to affective, rather than cognitive, identification, and goal orientation was a mediator of their link. The findings of the two experimental-causal-chain studies further supported the hypothesized effects. Transformational leadership was found to lead subordinates to perceive the culture as more innovative compared to transactional contingent reward, whereas transactional contingent reward led employees to perceive the culture as more goal, than innovation, oriented. Finally, innovation, compared to goal, value orientation increased cognitive identification, while goal orientation facilitated affective, rather than cognitive, identification. Implications - The practical implications involve the development of strategies organizations can apply, such as leadership training programs, to strengthen their ties with their employees, which, in turn, may have a positive impact on in-role, as well as extra-role, behaviors. Originality/Value – The originality of this research concerns the identification of distinct mechanisms explaining the effect of transformational leadership and transactional contingent reward on cognitive and affective identification applying an organizational culture perspective and a combination of measurement and causal mediation designs. (shrink)

This article evaluates the effects of two types of rewards (performance-contingent versus engagement-contingent) on self-regulation, intrinsic motivation and creativity. Forty-two undergraduate students were randomly assigned to three conditions; i.e. a performance-contingent reward group, an engagement-contingent reward group and a control group. Results provide little support for the negative effects of performance rewards on motivational components. However, they do indicate that participants in the engagement-contingent reward group and the control group achieved higher rated creativity than participants in the (...) performance-contingent reward group. Alternative explanations for this finding are discussed. (shrink)

I propose and articulate a novel theory of desire, called the Revised Reward Theory. As the name suggests, the theory is based—and expands—on Arpaly and Schroeder’s (2014) Reward Theory of Desire. The initial Reward Theory identifies desires with states of the reward learning system such that for an organism to desire some P is for its reward system to treat P as a reward upon receipt. The Revised Reward Theory identifies desires with a (...) different state of the same system, such that for an organism to desire some P is for its reward system to expect or predict that P will be rewarding (roughly) prior to receipt. The difference amounts to equating desires with what we ultimately find rewarding or satisfying versus those that underlie our motivations to obtain that which we take ourselves to desire. I argue that the structure of the reward system is incompatible with the original Reward Theory but compatible with the Revised Reward Theory. I demonstrate that this difference has important philosophical implications. I focus on moral responsibility and demonstrate Arpaly and Schroeder’s argument, that addiction can mitigate moral responsibility, turns on this precise difference. Arpaly, Schroeder, and I all ascribe to a meta-theory called ‘natural kindism’ which identifies mental kinds with neurocognitive kinds. This discussion, in addition to defending a theory of desire, is intended to act as a proof of concept for natural kindism as offering a powerful framework for relating empirical results to philosophical issues. (shrink)

Willingness and readiness of people to do their jobs are among the key factors of a successful enterprise. In XXI century intellectual human labour is gaining unprecedented value and is being developed actively. The demand for intellectual labour calls forth an increasing number of jobs and professions that require an extensive preparation, a large number of working places, high level of integration of joint human efforts, growth of social welfare. These trends are becoming ever more pervasive and are spreading widely (...) in service industries, and that explains the rapid development of the latter when compared to the traditional areas of human activity. In its turn, it heightens the need for staff in service companies, supported by significant personnel turnover and a certain shortage of skilled professionals. These circumstances determine the need for developing a new concept of fostering staff motivation at the enterprises in the sphere of services. In order to reach the stated purpose while conducting our research into tourism and hospitality industry, as well as retail chains, we have examined the problems that arise in the process of staff motivation, and studied the foreign practice of motivating staff in hotels. The obtained analysis results enabled us to work out practical recommendations on improvement of the mechanism of tangible and intangible rewards in service companies, which are based on external and internal motivational factors. Additional attention in the article is paid to the statement that financial incentives should be based on key performance indicators (KPI). We give a detailed consideration to the classification of internal motivation incentives of the staff according to the terms of their realization, and give a schematic representation of the performance dynamics of the internal motivation model in service businesses. (shrink)

Worldwide 1.2 million people are dying from kidney failure each year, and in the USA alone, approximately 100 000 people are currently on the waiting list for a kidney transplant. One possible solution to the kidney shortage is for governments to pay donors for one of their healthy kidneys and distribute these kidneys according to need. There are, however, compelling objections to this government-monopsony model. To avoid these objections, I propose a small adjustment to the model. I suggest we (...) class='Hi'>reward kidney sellers with both money and a ceremony that celebrates their noble act. They should, in other words, receive a prize rather than a price. (shrink)

The reward system of science is the priority rule. The first scientist making a new discovery is rewarded with prestige, while second runners get little or nothing. Michael Strevens, following Philip Kitcher, defends this reward system, arguing that it incentivizes an efficient division of cognitive labor. I argue that this assessment depends on strong implicit assumptions about the replicability of findings. I question these assumptions on the basis of metascientific evidence and argue that the priority rule systematically discourages (...) replication. My analysis leads us to qualify Kitcher and Strevens’s contention that a priority-based reward system is normatively desirable for science. (shrink)

Philosophy &Public Affairs, Volume 51, Issue 4, Page 373-412, Fall 2023.

In dialogues ranging from the Symposium to the Timaeus, Plato appears to propose that the philosopher’s grasp of the forms may confer immortality upon him. Whatever can Plato mean in making such a claim? What does he take immortality to consist in, such that it could constitute a reward for philosophical enlightenment? And how is this proposal compatible with Plato’s insistence throughout his corpus that all soul, not just philosophical soul, is immortal? In this chapter, I pursue these questions (...) by applying the distinction between general and earned immortality to the Phaedo and the Symposium. I argue that, while Plato attributes general immortality to all soul in the Phaedo, in the Affinity Argument, he proposes that the philosopher’s soul can achieve earned immortality through contemplating forms. It is this form of immortality that Plato claims is unavailable to humankind in the flux passage of the Symposium. At the same time, in the ascent passage, he holds out the possibility – albeit with significant reservations – that the philosopher’s soul may transcend its humanity and achieve earned immortality through its communion with the form. (shrink)

Most work in neo-Aristotelian virtue ethics begins by supposing that the virtues are the traits of character that make us good people. Secondary questions, then, include whether, why, and in what ways the virtues are good for the people who have them. This essay is an argument that the neo-Aristotelian approach is upside down. If, instead, we begin by asking what collection of character traits are good for us---that is, what collection of traits are most likely to promote our own (...) well-being---we find a collection of traits a lot like the traditional slate of virtues. This suggests an egoistic theory of the virtues: the virtues just are those traits of character that reliably promote the well-being of their possessor. In addition to making the positive case for character egoism, I defend it from anticipated objections. I argue that character egoism doesn't inherit the problems of ethical egoism, and conclude by offering character-egoist accounts of two virtues traditionally thought to be fundamentally other-regarding: honesty and justice. (shrink)

Interpreting others' actions is essential for understanding the intentions and goals in social interactions. Activity in the motor cortex is evoked when we see another person performing actions, which can also be influenced by the intentions and context of the observed action. No study has directly explored the influence of reward and punishment on motor cortex activity when observing others' actions, which is likely to have substantial relevance in different social contexts. In this experiment, EEG was recorded while participants (...) watched movie clips of a person performing actions that led to a monetary reward, loss or no change for the observer. Using the EEG mu rhythm as an index of motor resonance, our results demonstrate that observation of rewarding actions produce significantly greater motor cortex activity than punishing or neutral actions, with punishing actions producing greater activity than neutral ones. In addition, the dynamic change in the mu rhythm over sensorimotor cortex is modulated by reward and punishment, with punishing actions producing a prolonged suppression. These findings demonstrate that the associated reward value of an observed action may be crucial in determining the strength of the representation of the action in the observer's brain. Consequently, reward and punishment is likely to drive observational learning through changes in the action observation network, and may also influence how we interpret, understand, engage in and empathize with others' actions in social interaction. (shrink)

Abstract: Many scholars and practitioners are concerned with understanding how and when to motivate individuals to be more creative. We argue that the conflicting ideas may be due to differences between findings towards reward conditions and the situation in which rewards has to be offered. Hence, it is vital to portray in this study that motivating employees to be creative is important for many firms. Amount of literature shows that employee performance can be encouraged by extrinsic and intrinsic rewards (...) in their everyday tasks. This paper, therefore, investigates these kinds of rewards and shows its effectiveness in attracting creative performance. It concluded by arguing that, human behaviors are stimulated by extrinsic motivations attained from works, which are capable to fulfill innate parts of individuals. Similarly, a person is intrinsically motivated when he or she found that the work is able to fulfill his or her psychological needs for the significant experience. (shrink)

Learning mathematics through distance education can be challenging, with the “logical” and “rewarding” nature proving difficult to measure. This article aimed to articulate an argument explaining the “logical” and “rewarding” nature of online mathematics learning, elucidating their causal factors. Existing data from the literature that involving students at Visayas State University, Philippines, were utilized in this study. The study used statistical measures to capture descriptions from the data, and quantile regression analysis was employed to forecast the predictors of the logicality (...) and rewarding nature of learning mathematics at a distance. Results indicate that learning mathematics in the new normal is perceived as “logical” and moderately “rewarding”. The regression and correlation analyses revealed a significant positive association between the perceived “logical” nature and the rewarding experience of learning mathematics. The constructed statistical models depicted that the determinants of logicality in learning mathematics include family income, money spent on the internet, learning environment, household size, social status, and health. Moreover, causal factors such as family income, money spent on the internet, learning environment, leisure activities, social status, and health significantly determine the rewarding nature of learning mathematics online. Conclusively, institution must support college students with their online learning needs. Furthermore, mathematics instructors should create lively and exciting online discussions that boost their logical thinking. Providing problem-solving task that are intrinsically rewarding can contribute to a more fulfilling learning experience. (shrink)

The Human Genome Project is regarded by many as one of the major scientific achievements in recent science history, a large-scale endeavour that is changing the way in which biomedical research is done and expected, moreover, to yield considerable benefit for society. Thus, since the completion of the human genome sequencing effort, a debate has emerged over the question whether this effort merits to be awarded a Nobel Prize and if so, who should be the one to receive it, as (...) no more than three individuals can be selected. In this article, the HGP is taken as a case study to consider the ethical question to what extent it is still possible, in an era of big science, of large-scale consortia and global team work, to acknowledge and reward individual contributions to important breakthroughs in biomedical fields. Is it still viable to single out individuals for their decisive contributions in order to reward them in a fair and convincing way? Whereas the concept of the Nobel prize as such seems to reflect an archetypical view of scientists as solitary researchers who, at a certain point in their careers, make their one decisive discovery, this vision has proven to be problematic from the very outset. Already during the first decade of the Nobel era, Ivan Pavlov was denied the Prize several times before finally receiving it, on the basis of the argument that he had been active as a research manager rather than as a researcher himself. The question then is whether, in the case of the HGP, a research effort that involved the contributions of hundreds or even thousands of researchers worldwide, it is still possible to “individualise” the Prize? The “HGP Nobel Prize problem” is regarded as an exemplary issue in current research ethics, highlighting a number of quandaries and trends involved in contemporary life science research practices more broadly. (shrink)

After the belief in Allah and in the necessities of His religion, the first of our duties towards Him is to learn our responsibilities as an ‘abd [servant] and worshipping according to His will. Worship is to do what Allah commands and not to do what He prohibits. Worship is legislated by Allah and His Prophet. Thus, the unity and solidarity in worship is achieved. Some reasons and causes for worships are known however the main purpose of worshipping is to (...) serve Allah. Not all the worships are bound with a standard reward scale. Allah has put some standard reward scales as a result of His grace and blessings on His servants. The most common of these is ten-to-one. Worships like az-Zakah [obligatory charity] and as-Sadaqa [voluntary charity] are given seven hundreds -to-one or more reward. Iḥyaʾ Laylat al-Qadr (keeping vigil in that night) is equal to worshipping in a thousand months. In addition, there are unlimited and uncounted blessings in this World and in the hereafter. Also the reward of the worships (like prayer, fasting, giving charity and pilgrimage) is determined by Allah and is subjected to special reward scales. He is who determines the worships and their rewards. One of the greatest blessings of Allah to His slaves is Tawbah [repentance from sins] which means a chance for human beings to make themselves forgiven. Also there is ar-Riya’ [showing off, insincerity] which annuls the worship and limits its reward to this World only. (shrink)

In their paper 'Reward is enough', Silver et al conjecture that the creation of sufficiently good reinforcement learning (RL) agents is a path to artificial general intelligence (AGI). We consider one aspect of intelligence Silver et al did not consider in their paper, namely, that aspect of intelligence involved in designing RL agents. If that is within human reach, then it should also be within AGI's reach. This raises the question: is there an RL environment which incentivises RL agents (...) to design RL agents? (shrink)

The nucleus accumbens orchestrates processes related to reward and pleasure, including the addictive consequences of repeated reward (e.g., drug addiction and compulsive gambling) and the accompanying feelings of craving and anhedonia. The neurotransmitters dopamine and endogenous opiates play interactive roles in these processes. They are released by natural rewards (i.e., food, water, sex, money, play, etc.) and are released or mimicked by drugs of abuse. Repeated drug use induces conditioned down-regulation of these neurotransmitters, thus causing painful suppression of (...) everyday pleasure. As with many spiritual traditions, Buddhism provides strong advice against the pursuit of worldly pleasures to attain the ‘‘good life.’’ In contrast, many forms of meditation give rise to an immense and abiding joy. Most of these practices involve ‘‘stilling the mind,’’ whereby all content-laden thought (e.g., fantasies, daydreams, plans) ceases, and the mind enters a state of openness, formlessness, clarity, and bliss. This can be explained by the Buddhist suggestion that almost all of our everyday thoughts are a form of addiction. It follows that if we turn off this internal ‘‘gossip of ego,’’ we will find relief from the biochemical dopamine/opiate down-regulation, which is, perhaps, the perpetual concomitant of our daily rumination. (shrink)

When an organization is born, a leader is required to steer it to success. It is the leader whose leadership can make or break the organization. What is leadership in actuality? It is the attitude and manner through which one provides direction to implement plans and achieve goals by way of a tremendous amount of motivation which he pours into the hearts and minds of his people. This was found by Kurt Lewin (1939) who led a group of researchers to (...) identify various manners and styles of leadership. "This early study has been very influential and established three major leadership styles.” (Lewin, LIippit, White,1939). (shrink)

Courtesy of its free energy formulation, the hierarchical predictive processing theory of the brain (PTB) is often claimed to be a grand unifying theory. To test this claim, we examine a central case: activity of mesocorticolimbic dopaminergic (DA) systems. After reviewing the three most prominent hypotheses of DA activity—the anhedonia, incentive salience, and reward prediction error hypotheses—we conclude that the evidence currently vindicates explanatory pluralism. This vindication implies that the grand unifying claims of advocates of PTB are unwarranted. More (...) generally, we suggest that the form of scientific progress in the cognitive sciences is unlikely to be a single overarching grand unifying theory. (shrink)

Recent advances in natural language processing have given rise to a new kind of AI architecture: the language agent. By repeatedly calling an LLM to perform a variety of cognitive tasks, language agents are able to function autonomously to pursue goals specified in natural language and stored in a human-readable format. Because of their architecture, language agents exhibit behavior that is predictable according to the laws of folk psychology: they function as though they have desires and beliefs, and then make (...) and update plans to pursue their desires given their beliefs. We argue that the rise of language agents significantly reduces the probability of an existential catastrophe due to loss of control over an AGI. This is because the probability of such an existential catastrophe is proportional to the difficulty of aligning AGI systems, and language agents significantly reduce that difficulty. In particular, language agents help to resolve three important issues related to aligning AIs: reward misspecification, goal misgeneralization, and uninterpretability. (shrink)

Desire has not been at the center of recent preoccupations in the philosophy of mind. Consequently, the literature settled into several dogmas. The first part of this introduction presents these dogmas and invites readers to scrutinize them. The main dogma is that desires are motivational states. This approach contrasts with the other dominant conception: desires are positive evaluations. But there are at least four other dogmas: the world should conform to our desires (world-to-mind direction of fit), desires involve a positive (...) evaluation (the “guise of the good”), we cannot desire what we think is actual (the “death of desire” principle), and, in neuroscience, the idea that the reward system is the key to understanding desire. The second part of the introduction summarizes the contributions to this volume. The hope is to contribute to the emergence of a fruitful debate on this neglected, albeit crucial, aspect of the mind. (shrink)

This essay presents a point of view for looking at `free will', with the purpose of interpreting where exactly the freedom lies. For, freedom is what we mean by it. It compares the exercise of free will with the making of inferences, which usually is predominantly inductive in nature. The making of inference and the exercise of free will, both draw upon psychological resources that define our ‘selves’. I examine the constitution of the self of an individual, especially the involvement (...) of personal beliefs, personal memories, affects, emotions, and the hugely important psychological value-system, all of which distinguish the self of one individual from that of another. The foundational position that adopted in this essay is that all psychological processes are correlated with corresponding ones involving large scale neural aggregates in the brain, communicating with one another through wavelike modes of excitation and de-excitation. Of central relevance is the value-network around which the affect system is organized, the latter, in turn, being the axis around which is assembled the self, with all its emotional correlates. The self is a complex system. I include a brief outline of what complexity consists of. In reality all systems are complex, for complexity is ubiquitous, and certain parts of nature appear to us to be ‘simple’ only in certain specific contexts. It is in this background that the issue of determinism is viewed in this essay. Instead of looking at determinism as a grand principle entrenched in nature independent of our interpretation of it, I look at our ability to explain and to predict events and phenomena around us, which is made possible by the existence of causal links running in a complex course that set up correlations between diverse parts of nature, in this way putting the stamp of necessity on these events. However, the complexity of systems limits our ability to explain and to predict to within certain horizons defined by contexts. Our ability to explain and predict in matters relating to acts of free will is similarly limited by the operations of the self that remain hidden from our own awareness. The aspects of necessity and determinism appear to us in the form of reason and rationality that explain and predict only within a limited horizon, while the rest depends on the complex operation of self-linked psychological resources, where the latter appear as contingent in the context of the exercise of free will. The hallmark of complex systems is the existence of amplifying factors that operate as destabilizing ones, along with inhibiting or stabilizing factors as well that generally limit the destabilizing influences to local occurrences, while preserving the global integrity of a system. This complex interplay of destabilizing and stabilizing influences lead to the possibility of an enormous number of distinct modes of behavior that appear as emergent phenomena in complex systems. Looking at the particular case of the self of an individual that guide her actions and thoughts, it is the operation of our emotions, built around the psychological value-system, that provide for the amplifying and inhibiting factors mentioned above. The operation of these self-linked factors stamps our actions and thoughts as contingent ones that do not fit with our concepts of reason and rationality. And this is what provides the basis of our idea of free will. Free will is not ‘free’ in virtue of exemption from causal links running through all our self-based processes - ones that remain hidden from our awareness, but is free of what is perceived to be ‘reason and rationality’ based on knowledge and the common pool of beliefs and principles associated with a shared world-view. When we speak of the choice involved in an act of exercise of free will what we actually refer to is the commonly observed fact that various different individuals of a similar disposition respond differently when placed under similar circumstances. In other words, free will is ‘free’ precisely because it is not subject to constraints of a commonly accepted and shared set of principles, beliefs, and values. While it is possible that, in an exercise of free will, the self-linked psychological resources are brought into action when a number of alternatives are presented to the self by the operation of the ingredients of a commonly shared world-view, it seems likely that, that set of alternatives is not of primary relevance in the final response that the mind produces, since the latter is primarily a product of the operation of the self-based psychological resources. What is of greater relevance here is the operation of emotion-driven processes, guided by the psychological value-system based on the activity of the so-called reward-punishment network in the brain. These processes lead the individual to a response that appears to be free from the shackles of determinism precisely because their mechanisms, which are hidden from us, do not conform to commonly accepted and shared rules and principles. In contrast, inductive inference is a process that is based on the ‘cognitive face’ of self, where the self-based psychological resources play a supportive role to the commonly shared world-view of an individual. There is never any freedom from the all-pervading causal links representing correlations among all objects, entities, and events in nature. In the midst of all this, the closest thing to freedom that we can have in our life comes with self-examination and self-improvement. The possibility of self-examination appears in the form of specific conjunctions between our complex self-processes and the ceaseless changes of scenario in our external world. This actually makes the emergent phenomenon of self-examination a matter of chance, but one that keeps on appearing again and again in our life. Once realized, self examination creates possibilities that would not be there in the absence of it, and these possibilities include the enhancement of further self-enrichment and further diversity in the exercise of our free will. (shrink)

In order to improve our understanding of the components that reflect functionally important processes during reward anticipation and consumption, we used principle components analyses (PCA) to separate and quantify averaged ERP data obtained from each stage of a modified monetary incentive delay (MID) task. Although a small number of recent ERP studies have reported that reward and loss cues potentiate ERPs during anticipation, action preparation, and consummatory stages of reward processing, these findings are inconsistent due to temporal (...) and spatial overlap between the relevant electrophysiological components. Our results show three components following cue presentation are sensitive to incentive cues (N1, P3a, P3b). In contrast to previous research, reward‐related enhancement occurred only in the P3b, with earlier components more sensitive to break‐even and loss cues. During feedback anticipation, we observed a lateralized centroparietal negativity that was sensitive to response hand but not cue type. We also show that use of PCA on ERPs reflecting reward consumption successfully separates the reward positivity from the independently modulated feedback‐P3. Last, we observe for the first time a new reward consumption component: a late negativity distributed over the left frontal pole. This component appears to be sensitive to response hand, especially in the context of monetary gain. These results illustrate that the time course and sensitivities of electrophysiological activity that follows incentive cues do not follow a simple heuristic in which reward incentive cues produce enhanced activity at all stages and substages. (shrink)

Psychoneural reductionists sometimes claim that sufficient amounts of lower-level explanatory achievement preclude further contributions from higher-level psychological research. Ostensibly, with nothing left to do, the effect of such preclusion on psychological explanation is extinction. Reductionist arguments for preclusion have recently involved a reorientation within the philosophical foundations of neuroscience---namely, away from the philosophical foundations and toward the neuroscience. In this chapter, I review a successful reductive explanation of an aspect of reward function in terms of dopaminergic operations of the (...) mesocorticolimbic system in order to demonstrate why preclusion/extinction claims are dubious. (shrink)

In this paper I argue that, although Kant argues that morality is independent of God (and hence, agrees with the Euthyphro), and rejects Divine Command Theory (or Theological Voluntarism), he believes that all moral duties are also the commands of God, who is a moral being, and who is morally required to punish those who transgress the moral law: "God’s justice is the precise allocation of punishments and rewards in accordance with men’s good or bad behavior." However, since we lack (...) a strict proof of God's existence, we can still fulfill our duties from the motive of duty. if we did know that God exists, then this would undermine our pure moral motivation to do our duty, since we would have an even stronger interest in pleasing God through our good conduct. The effect of undermining our pure moral motivation would be to make us less eligible for divine reward, since God rewards us for doing our duty from the motive of duty. (shrink)

One of the more exotic and mysterious features of Leibniz’s later philosophical writings is the harmony between the kingdom of nature and the kingdom of grace. In this paper I show that this harmony is not a single doctrine, but rather a compilation of two doctrines, namely (1) that the order of nature makes possible the rewards and punishments of rational souls, and (2) that the rewards and punishments of rational souls are administered naturally. I argue that the harmony is (...) best considered as Leibniz’s distinctive collation, development, and rebranding of these doctrines, which were not themselves unique to Leibniz, nor uncommon in the seventeenth century. There follows a detailed examination of various concrete examples of the harmony in operation, from which I show that it is essentially the culmination of Leibniz’s lifelong thinking about divine justice. (shrink)

We are considered to be highly evolved conscious beings, but if we look at ourselves, do we actually feel that we are there; wise men or Homo sapiens as we call ourselves? In today’s world, reward based conditioning forms our contemporary culture that deeply defines how we look at life and how we intuitively perceive our consciousness. Presently, acquisitions are our priority and we behave as narcissistic conditioned puppets and let governments and corporations rule our lives. We are hypocrites (...) that can see, but behave blind; blinded within the realms of our short-termed thrills, joys and beliefs. Augmenting logical questioning and logical conditioning is the only way we can come out of this state that cannot be done individually, it has to be a collective effort. This paper is an attempt to understand our very own evolved consciousness and its relation to the current world with the true meaning of our existence, where we seek to understand it from a logical sense. (shrink)

Meritocracy claims to reward the meritorious with more resources, thereby achieving social efficiency and justice in a level playground. This article argues that the rise of meritocracy in a society is the institutional consequence of adopting progressive humanism, an ideal-type worldview that advocates the harmonious co-realization of individual achievement and social contribution. However, meritocracy is a self-defeating illusion because, even in a level playground, it only rewards conspicuous and wasteful display of ‘merit’ rather than genuine contributions to society. Similar (...) to the promise of an afterlife to Catholicism, the illusion of meritocracy constitutes an indispensable theodicy to progressive humanism. For societies holding such worldviews, meritocracy is a necessary illusion that cannot be dispelled by institutional reforms or political movements. (shrink)

Allocation of very scarce medical interventions such as organs and vaccines is a persistent ethical challenge. We evaluate eight simple allocation principles that can be classified into four categories: treating people equally, favouring the worst-off, maximising total benefits, and promoting and rewarding social usefulness. No single principle is sufficient to incorporate all morally relevant considerations and therefore individual principles must be combined into multiprinciple allocation systems. We evaluate three systems: the United Network for Organ Sharing points systems, quality-adjusted life-years, and (...) disability-adjusted life-years. We recommend an alternative system—the complete lives system—which prioritises younger people who have not yet lived a complete life, and also incorporates prognosis, save the most lives, lottery, and instrumental value principles. (shrink)

Should priority in the allocation of organs be given to those who have previously donated or declared their willingness to do so? This article examines the Israeli priority rule in light of two prominent critiques of priority rules, pertaining to failure to reciprocate and unfairness. The scope and content of these critiques are interpreted from the perspective of equality of opportunity. Because the Israeli priority rule may be reasonably criticized for unfairness and failing to reward certain behaviors, the article (...) develops an adjusted priority rule, which removes and adjust the elements in the Israeli priority rule deemed problematic. However, such a priority rule is complex to the extent that it may fail to increase donation rates and furthermore introduce new concerns of fairness, as the better off may be better able to navigate the complex adjusted priority rule. (shrink)

What is common knowledge? According to the dominant iterative model, a group of people commonly knows that p if and only if they each individually know that p, and they furthermore each know that they each know that p, and so on to infinity. According to the integrative model proposed in this paper, a group commonly knows that p when its members are united in a state of mind of the type whose contents must be true. Epistemic integration within a (...) group is enabled by symmetrical signalling processes such as eye contact. In conversational dyads, symmetrical processing operates on pairs of signals produced by the two sides in a familiar format: speakers generate content for joint attention in main channel communication, and addressees evaluate that content in backchannel communication. Processes of reinforcement learning shape our pairwise signalling, driving the accumulation of common knowledge, both in response to extrinsic reward for coordinated action, and in response to the intrinsic reward of curiosity. Where the iterative model caps the epistemic performance of the group at the level of its weakest member, the integrative model of common knowledge shows how groups working together can outperform their strongest member working alone. (shrink)

What makes a person's life meaningful? Thaddeus Metz offers a new answer to an ancient question which has recently returned to the philosophical agenda. He proceeds by examining what, if anything, all the conditions that make a life meaningful have in common. The outcome of this process is a philosophical theory of meaning in life. He starts by evaluating existing theories in terms of the classic triad of the good, the true, and the beautiful. He considers whether meaning in life (...) might be about such principles as fulfilling God's purpose, obtaining reward in an afterlife for having been virtuous, being attracted to what merits attraction, leaving the world a better place, connecting to organic unity, or transcending oneself by connecting to what is extensive. He argues that no extant principle satisfactorily accounts for the three-fold significance of morality, enquiry, and creativity, and that the most promising theory is a fresh one according to which meaning in life is a matter of intelligence contoured toward fundamental conditions of human existence. (shrink)

Tracking and goal setting are popular approaches in the personal health and fitness industry. In this paper we use a similar approach to assist users in their journey for a more sustainable lifestyle, starting with food. We employ Action Design Research (ADR) methodology to develop an application and subsequently propose design principles for developing blockchain-based applications for assisting users on their path to eating environmentally friendly food. The path to a sustainable lifestyle can be hard as individuals often do not (...) realize their personal impact towards achieving a net zero carbon future. To address this shortcoming, this study conducts an ADR experiment to create affordances for users to learn, create impact and realize that they are not alone in this journey thus motivating users to a sustainable lifestyle. The design principles that emerged from the project are design for categories and labels, design for measuring collective impact, and design for rewards and redemption. (shrink)

In this opinionated review, I draw attention to some of the contributions reinforcement learning can make to questions in the philosophy of mind. In particular, I highlight reinforcement learning's foundational emphasis on the role of reward in agent learning, and canvass two ways in which the framework may advance our understanding of perception and motivation.

Where do values live in thought? A straightforward answer is that we (or our brains) make decisions using explicit value representations which are our values. Recent work applying reinforcement learning to decision-making and planning suggests that more specifically, we may represent both the instrumental expected value of actions as well as the intrinsic reward of outcomes. In this paper, I argue that identifying value with either of these representations is incomplete. For agents such as humans and other animals, there (...) is another place where reward can be located in thought: the division of the space of possibilities or ‘state space’. (shrink)

Hohwy et al.’s (2008) model of binocular rivalry (BR) is taken as a classic illustration of predictive coding’s explanatory power. I revisit the account and show that it cannot explain the role of reward in BR. I then consider a more recent version of Bayesian model averaging, which recasts the role of reward in (BR) in terms of optimism bias. If we accept this account, however, then we must reconsider our conception of perception. On this latter view, I (...) argue, organisms engage in what amounts to policy-driven, motivated perception. (shrink)

Virtue ethics has many times been suggested as a promising recipe for the construction of artificial moral agents due to its emphasis on moral character and learning. However, given the complex nature of the theory, hardly any work has de facto attempted to implement the core tenets of virtue ethics in moral machines. The main goal of this paper is to demonstrate how virtue ethics can be taken all the way from theory to machine implementation. To achieve this goal, we (...) critically explore the possibilities and challenges for virtue ethics from a computational perspective. Drawing on previous conceptual and technical work, we outline a version of artificial virtue based on moral functionalism, connectionist bottom–up learning, and eudaimonic reward. We then describe how core features of the outlined theory can be interpreted in terms of functionality, which in turn informs the design of components necessary for virtuous cognition. Finally, we present a comprehensive framework for the technical development of artificial virtuous agents and discuss how they can be implemented in moral environments. (shrink)

Interactions between an intelligent software agent and a human user are ubiquitous in everyday situations such as access to information, entertainment, and purchases. In such interactions, the ISA mediates the user’s access to the content, or controls some other aspect of the user experience, and is not designed to be neutral about outcomes of user choices. Like human users, ISAs are driven by goals, make autonomous decisions, and can learn from experience. Using ideas from bounded rationality, we frame these interactions (...) as instances of an ISA whose reward depends on actions performed by the user. Such agents benefit by steering the user’s behaviour towards outcomes that maximise the ISA’s utility, which may or may not be aligned with that of the user. Video games, news recommendation aggregation engines, and fitness trackers can all be instances of this general case. Our analysis facilitates distinguishing various subcases of interaction, as well as second-order effects that might include the possibility for adaptive interfaces to induce behavioural addiction, and/or change in user belief. We present these types of interaction within a conceptual framework, and review current examples of persuasive technologies and the issues that arise from their use. We argue that the nature of the feedback commonly used by learning agents to update their models and subsequent decisions could steer the behaviour of human users away from what benefits them, and in a direction that can undermine autonomy and cause further disparity between actions and goals as exemplified by addictive and compulsive behaviour. We discuss some of the ethical, social and legal implications of this technology and argue that it can sometimes exploit and reinforce weaknesses in human beings. (shrink)

It has recently been argued that metal’s ‘heaviness’ is conceptually inarticulable. I argue, on the contrary, that ‘heaviness’ is a matter of inaccessibility—the ‘something more’ that makes metal ‘heavy’ is actually something less: less auditory processing fluency. Like profound literature, metal resists, but also invites and rewards, interpretation. I argue that understanding ‘heaviness’ in terms of auditory processing fluency allows us to make sense of a number of otherwise puzzling features of the music, and to articulate a unifying gestalt for (...) the genre. (shrink)

We present a theory of human artistic experience and the neural mechanisms that mediate it. Any theory of art has to ideally have three components. The logic of art: whether there are universal rules or principles; The evolutionary rationale: why did these rules evolve and why do they have the form that they do; What is the brain circuitry involved? Our paper begins with a quest for artistic universals and proposes a list of ‘Eight laws of artistic experience’ -- a (...) set of heuristics that artists either consciously or unconsciously deploy to optimally titillate the visual areas of the brain. One of these principles is a psychological phenomenon called the peak shift effect: If a rat is rewarded for discriminating a rectangle from a square, it will respond even more vigorously to a rectangle that is longer and skinnier that the prototype. We suggest that this principle explains not only caricatures, but many other aspects of art. Example: An evocative sketch of a female nude may be one which selectively accentuates those feminine form-attributes that allow one to discriminate it from a male figure; a Boucher, a Van Gogh, or a Monet may be a caricature in ‘colour space’ rather than form space. Even abstract art may employ ‘supernormal’ stimuli to excite form areas in the brain more strongly than natural stimuli. Second, we suggest that grouping is a very basic principle. The different extrastriate visual areas may have evolved specifically to extract correlations in different domains , and discovering and linking multiple features into unitary clusters -- objects -- is facilitated and reinforced by direct connections from these areas to limbic structures. In general, when object-like entities are partially discerned at any stage in the visual hierarchy, messages are sent back to earlier stages to alert them to certain locations or features in order to look for additional evidence for the object . Finally, given constraints on allocation of attentional resources, art is most appealing if it produces heightened activity in a single dimension rather than redundant activation of multiple modules. This idea may help explain the effectiveness of outline drawings and sketches, the savant syndrome in autists, and the sudden emergence of artistic talent in fronto-temporal dementia. In addition to these three basic principles we propose five others, constituting a total of ‘eight laws of aesthetic experience’. (shrink)

Many recent AI systems take inspiration from biological episodic memory. Here, we ask how these ‘episodic-inspired’ AI systems might inform our understanding of biological episodic memory. We discuss work showing that these systems implement some key features of episodic memory whilst differing in important respects, and appear to enjoy behavioural advantages in the domains of strategic decision-making, fast learning, navigation, exploration and acting over temporal distance. We propose that these systems could be used to evaluate competing theories of episodic memory’s (...) operations and function. However, further work is needed to validate them as models of episodic memory and isolate the contributions of their memory systems to their behaviour. More immediately, we propose that these systems have a role to play in directing episodic memory research by highlighting novel or neglected hypotheses as pursuit-worthy. In this vein, we propose that the evidence reviewed here highlights two pursuit-worthy hypotheses about episodic memory’s function: that it plays a role in planning that is independent of future-oriented simulation, and that it is adaptive in virtue of its contributions to fast learning in novel, sparse-reward environments. (shrink)

Socrates has an implicit argument for his afterlife story that concludes the Gorgias, with two key premises. One is at 527a-c, where he summarizes the ethical position he has been arguing for through most of the dialogue, regarding the intrinsic goodness of justice, the intrinsic badness of injustice, and the desirability of rehabilitative punishments. The second occurs at 507e-508a, where Socrates asserts that the universe is held together by justice. This argument explains why Socrates regards his story as a logos, (...) not merely a muthos. It also helps us understand the nature of the rewards and punishments in his story. (shrink)

Some worry that advanced artificial agents may resist being shut down. The Incomplete Preferences Proposal (IPP) is an idea for ensuring that doesn't happen. A key part of the IPP is using a novel 'Discounted REward for Same-Length Trajectories (DREST)' reward function to train agents to (1) pursue goals effectively conditional on each trajectory-length (be 'USEFUL'), and (2) choose stochastically between different trajectory-lengths (be 'NEUTRAL' about trajectory-lengths). In this paper, we propose evaluation metrics for USEFULNESS and NEUTRALITY. We (...) use a DREST reward function to train simple agents to navigate gridworlds, and we find that these agents learn to be USEFUL and NEUTRAL. Our results thus suggest that DREST reward functions could also train advanced agents to be USEFUL and NEUTRAL, and thereby make these advanced agents useful and shutdownable. (shrink)

I explain and motivate the shutdown problem: the problem of creating artificial agents that (1) shut down when a shutdown button is pressed, (2) don’t try to prevent or cause the pressing of the shutdown button, and (3) otherwise pursue goals competently. I then propose a solution: train agents to have incomplete preferences. Specifically, I propose that we train agents to lack a preference between every pair of different-length trajectories. I suggest a way to train such agents using reinforcement learning: (...) we give the agent lower reward for repeatedly choosing same-length trajectories. (shrink)

In a well-known paper, Nick Bostrom presents a confrontation between a fictionalised Blaise Pascal and a mysterious mugger. The mugger persuades Pascal to hand over his wallet by exploiting Pascal's commitment to expected utility maximisation. He does so by offering Pascal an astronomically high reward such that, despite Pascal's low credence in the mugger's truthfulness, the expected utility of accepting the mugging is higher than rejecting it. In this article, I present another sort of high value, low credence mugging. (...) This time, the mugger utilises research on existential risk and the long-term potential of humanity to exploit Pascal's expected-utility-maximising descendant. This mugging is more insidious than Bostrom's original as it relies on plausible facts about the long-term future, as well as realistic credences about how our everyday actions could, albeit with infinitesimally low likelihood, affect the future of humanity. (shrink)

Like American politics, the academic debate over justice is polarized, with almost all theories of justice falling within one of two traditions: egalitarianism and libertarianism. This book provides an alternative to the partisan standoff by focusing not on equality or liberty, but on the idea that we should give people the things that they deserve. Mulligan argues that a just society is a meritocracy, in which equal opportunity prevails and social goods are distributed strictly on the basis of merit. That (...) gives citizens their just deserts. In addition to its novel conceptual approach, meritocracy is distinctive from existing work in two ways. First, it is grounded in research on how people actually think about justice. Empirical research reveals that people don't think that social goods should be distributed equally. Nor do they dismiss the idea of social justice. Across ideological and cultural lines, people want rewards to reflect merit. Second, the book discusses hot-button political issues and makes concrete policy recommendations. These issues include anti-meritocratic bias against women and racial minorities and the United States’ widening economic inequality. Justice and the Meritocratic State offers a new theory of justice and provides solutions to our most vexing social and economic problems. It will be of keen interest to philosophers, economists, and political theorists. (shrink)