The past 15 years occasioned an extraordinary blossoming of research into the cognitive and affective mechanisms that support moral judgment and behavior. This growth in our understanding of moral mechanisms overshadowed a crucial and complementary question, however: How are they learned? As this special issue of the journal Cognition attests, a new crop of research into moral learning has now firmly taken root. This new literature draws on recent advances in formal methods developed in other domains, such as Bayesian inference, (...) reinforcement learning and other machine learning techniques. Meanwhile, it also demonstrates how learning and deciding in a social domain—and especially in the moral domain—sometimes involves specialized cognitive systems. We review the contributions to this special issue and situate them within the broader contemporary literature. Our review focuses on how we learn moral values and moral rules, how we learn about personal moral character and relationships, and the philosophical implications of these emerging models. (shrink)

Implicit cognition is cognition that happens automatically and (typically) non-consciously. In moral psychology, implicit cognition is almost always understood in terms of dual process models of moral judgment. In this chapter, we address the question whether implicit moral judgment is usefully cashed out in terms of automatic (“type 1”) processes, and what the limitations of this approach are. Our chapter has six sections. In (1), we provide a brief overview of dual process models of domain-general (moral and non-moral) cognition. (2) (...) reviews a recent debate regarding the soundness of dual process models to begin with. Section (3) is about dual process accounts of moral judgment specifically. The last three sections then survey attempts to go beyond a simplistic automatic/controlled (“type 2”) distinction in conceptualizing implicit moral cognition. Recently, three main theoretical approaches have emerged, which all revolve around the questions whether type 2 processing can successfully penetrate implicit moral cognition. First, rational learning approaches highlight how episodes of moral learning can feed back into and shape our moral intuitions (4). Second, so-called triple process models suggest that automatic cognitive outputs can under certain circumstances be reined in by reflective cognition (5). Finally, recent evidence shows that moral reasoning is not as impotent as earlier developments in empirical moral psychology claimed to demonstrate (6). (shrink)

The study of ethical decision-making has made significant advances, particularly with regard to the ways in which different types of processing are implicated. In recent decades, much of this advancement has been driven by the influence of dual-process theories of cognition. Unfortunately, the wealth of findings in this context can be confusing for management scholars and practitioners who desire to know how best to encourage ethical behavior. While some studies suggest that deliberate reflection leads to more ethical behavior, other studies (...) find, in contrast, that intuitive decision-making leads to more ethical results. The goal of this integrative conceptual review is to help make sense of such apparently contradictory findings by identifying the moderating influences that lead to more versus less ethical decisions, whether they are made via intuitive or deliberative processes. Based on our integrative review of moderators from different disciplines and eras, we develop a taxonomy that can aid researchers in the task of identifying when similar constructs have been studied under different names. We organize our findings concerning these influences in accordance with four emergent moderator categories—psychological, situational, social, and physiological. This work helps us identify patterns of moderating factors across both intuitive and deliberative ethical decision-making, gaps that suggest future research directions and practical implications. (shrink)

The moral psychologist Joshua Greene has proposed a number of arguments for the normative significance of empirical research and for the unreliability of deontological intuitions. For these arguments, much hinges on the combination of various components of Greene's research – namely the dual-process theory of moral judgement, ‘personalness’ as a factor in moral decision-making, and his functional understanding of deontology and consequentialism. Incorporating these components, I reconstruct three distinct arguments and show that the Personalness Argument for the claim that empirical (...) research can advance normative ethics and the Combined Argument against deontology are both sound and interesting in themselves. They do not, however, cast doubt on traditional deontology or reserve a specific role for neuroscience. The Indirect Route argument overcomes some of the other arguments’ limitations. It is, however, invalid. I conclude by pointing out the broader philosophical relevance of Greene's arguments as shedding light on second-order morality. (shrink)

Extended Reality (XR) systems, such as Virtual Reality (VR) and Augmented Reality (AR), provide a digital simulation either of a complete environment, or of particular objects within the real world. Today, XR is used in a wide variety of settings, including gaming, design, engineering, and the military. In addition, XR has been introduced into psychology, cognitive sciences and biomedicine for both basic research as well as diagnosing or treating neurological and psychiatric disorders. In the context of XR, the simulated ‘reality’ (...) can be controlled and people may safely learn to cope with their feelings and behavior. XR also enables to simulate environments that cannot easily be accessed or created otherwise. Therefore, Extended Reality systems are thought to be a promising tool in the resocialization of criminal offenders, more specifically for purposes of risk assessment and treatment of forensic patients. Employing XR in forensic settings raises ethical and legal intricacies which are not raised in case of most other healthcare applications. Whereas a variety of normative issues of XR have been discussed in the context of medicine and consumer usage, the debate on XR in forensic settings is, as yet, straggling. By discussing two general arguments in favor of employing XR in criminal justice, and two arguments calling for caution in this regard, the present paper aims to broaden the current ethical and legal debate on XR applications to their use in the resocialization of criminal offenders, mainly focusing on forensic patients. (shrink)

Recently, Joshua Greene has argued that we need a metamorality to solve moral problems for which evolution has not prepared us. The metamorality that he proposes is a utilitarian account that he calls deep pragmatism. Deep pragmatism is supposed to arbitrate when the values espoused by different groups clash. To date, no systematic appraisal of this argument for a metamorality exists. We reconstruct Greene’s case for deep pragmatism as a metamorality and consider three lines of objection to it. We argue (...) that, in the end, only one of these objections seriously threatens Greene’s position. Greene has to commit to the nonexistence of moral truth in order for his argument for the need of a metamorality to get off the ground. This, however, leads to a tension in his overall argument for deep pragmatism: ultimately, it casts his rejection of antiutilitarian moral intuitions into doubt. (shrink)

There has been a longstanding controversy in research as to whether moral judgment is the result of an analytical or an intuitive process. Today, researchers increasingly recognize that moral judgments can be the result of both intuition and analysis, and that the two paths can lead to different results. This raises the question as to which of the two processes leads to a better moral judgment. The article develops a typology of moral problems depending on their moral uncertainty and moral (...) equivocality and links the derived types with analysis and intuition effectiveness. The typology considers four types of moral problems: compliance problems (low uncertainty, low equivocality), professional ethics problems (high uncertainty, low equivocality), conformity problems (low uncertainty, high equivocality) and ethical dilemmas (high uncertainty, high equivocality). The article argues that compliance and professional ethics problems are best solved analytically, whereas intuition is assumed to be more suitable for conformity problems and ethical dilemmas. Moreover, the article shows that it is not sufficient to contrast intuition with analysis alone. The higher the moral uncertainty, the more important the interplay of intuition and analysis becomes in making moral judgments. (shrink)

Brain death has been accepted worldwide medically and legally as the biological state of death of the organism. Nevertheless, the literature has described persistent problems with this acceptance ever since brain death was described. Many of these problems are not widely known or properly understood by much of the medical community. Here we aim to clarify these issues, based on the two intractable problems in the brain death debates. First, the metaphysical problem: there is no reason that withstands critical scrutiny (...) to believe that BD is the state of biological death of the human organism. Second, the epistemic problem: there is no way currently to diagnose the state of BD, the irreversible loss of all brain functions, using clinical tests and ancillary tests, given potential confounders to testing. We discuss these problems and their main objections and conclude that these problems are intractable in that there has been no acceptable solution offered other than bare assertions of an ‘operational definition’ of death. We present possible ways to move forward that accept both the metaphysical problem - that BD is not biological death of the human organism - and the epistemic problem - that as currently diagnosed, BD is a devastating neurological state where recovery of sentience is very unlikely, but not a confirmed state of irreversible loss of all [critical] brain functions. We argue that the best solution is to abandon the dead donor rule, thus allowing vital organ donation from patients currently diagnosed as BD, assuming appropriate changes are made to the consent process and to laws about killing. (shrink)

Research on ‘moral learning’ examines the roles of domain-general processes, such as Bayesian inference and reinforcement learning, in the development of moral beliefs and values. Alert to the power of these processes, and equipped with both the analytic resources of philosophy and the empirical methods of psychology, ‘moral learners’ are ideally placed to discover the contributions of nature, nurture and culture to moral development. However, I argue that to achieve these objectives research on moral learning needs to overcome nativist bias, (...) and distinguish two kinds of social learning: learning from and learning about. An agent learns from others when there is transfer of competence—what the learner learns is similar to, and causally dependent on, what the model knows. When an agent learns about the social world there is no transfer of competence—observable features of other agents are just the content of what-is-learned. Even learning from does not require explicit instruction. A novice can learn from an expert who is ‘leaking’ her morality in the form of emotionally charged behaviour or involuntary use of vocabulary. To the extent that moral development depends on learning from other agents, there is the potential for cultural selection of moral beliefs and values. (shrink)

Joshua Greene’s dual process account contends that deontological moral judgments are the result of intuitions that are automatic, emotional and arational. Deontological intuitions cannot be trusted, Greene argues, because they are arationally acquired and deployed. However, the empirical evidence taken to support this view is methodologically flawed and does not support the utilitarianism-rational and deontology-emotional links that dual process theorists postulate. Instead, the available evidence supports a social domain account of moral development, in which the acquisition of moral intuitions is (...) a rational process. That is, one acquires moral intuitions through repeated exposure to and reasoned engagement with moral information. The deployment of moral intuitions is not arational merely because it is not easily open to introspection. Indeed, if introspection were the sine qua non of rationality, then it would follow that the deployment of consequentialist intuitions is also arational. Although deontological intuitions are not infallible, the infirmities of deontological intuitions are equally shared by utilitarian intuitions. Thus, contrary to Greene’s recommendation, one need not abandon her deontological moral intuitions. Instead, intuitions – be they deontological or consequentialist – can be useful tools to guide moral reasoning. (shrink)

De Neys makes a compelling case that the sacrificial moral dilemmas do not elicit competing “fast and slow” processes. But are there even two processes? Or just two intuitions? There remains strong evidence, most notably from lesion studies, that sacrificial dilemmas engage distinct cognitive processes generating conflicting emotional and rational responses. The dual-process theory gets much right, but needs revision.

In principle, all patients deserve to receive optimal medical treatment equally. However, in situations in which there is scarcity of time or resources, medical treatment must be prioritized based on a triage. The conventional guidelines of medical triage mandate that treatment should be provided based solely on medical necessity regardless of any non-medical value-oriented considerations (“worst-first”). This study empirically examined the influence of value-oriented considerations on medical triage decision–making. Participants were asked to prioritize medical treatment relating to four case scenarios (...) of an emergency situation resulting from a car collision. The cases differ by situational characteristics pertaining to the at-fault driver, which were related to culpability attribution. In three case scenarios most participants gave priority to the most severely injured individual, unless the less severely injured individual was their brother. Nevertheless, in the aftermath of a vehicle-ramming terror attack most participants prioritized the less severely injured individual (“victim-first”). Our findings indicate that when caregivers are presented with concrete highly conflictual triage situations their choices may be based on value-oriented considerations related to contextual characteristics of the emergency situation. Philosophical and practical ramifications of our findings are discussed. (shrink)

Classic accounts of the evolution of human cooperation conceive emotions as automatic and uncontrollable impulses toward prosocial behavior. I argue that this view of emotion is incorrect, but that classic accounts of the evolution of human cooperation can benefit from an alternative view. The social and moral emotions are not untamed passions, but carefully cultivated and regulated states, which promote cooperation only if they develop properly in childhood and then are actively managed in adulthood. I argue that part and parcel (...) of the normal development of human emotion is the development of emotion regulation skills, or abilities to intervene on and manage one’s emotions in real time. I then argue that unmanaged emotions – or emotions that evade an individual’s control – tend to discourage cooperation, while managed emotions – or emotions that are brought under control – tend to encourage it. Finally, I argue that the cultivation of emotion regulation skills allows social and moral emotions to continue to promote cooperation, even though the world that many humans inhabit today is radically different from the world in which these emotions first evolved. (shrink)

In his article “Beyond Point-and-Shoot Morality,” Joshua Greene argues that the empirical findings of cognitive neuroscience have implications for ethics. Specifically, he contends that we ought to trust our manual, conscious reasoning system more than our automatic, emotional system when confronting unfamiliar problems; and because cognitive neuroscience has shown that consequentialist judgments are generated by the manual system and deontological judgments are generated by the automatic system, we ought to trust the former more than the latter when facing unfamiliar moral (...) problems. In the present article, I analyze one of the premises of Greene’s argument. In particular, I ask what exactly an unfamiliar problem is and whether moral problems can be classified as unfamiliar. After exploring several different possible interpretations of familiarity and unfamiliarity, I conclude that the concepts are too problematic to be philosophically compelling, and thus should be abandoned. (shrink)

Journal of Political Philosophy, EarlyView.

Journal of Political Philosophy, EarlyView.

We are all guided by thousands of norms, but how did our capacity for normative cognition evolve? I propose there is a deep but neglected link between normative cognition and practical skill. In modern humans, complex motor skills and craft skills, such as toolmaking, are guided by internally represented norms of correct performance. Moreover, it is plausible that core components of human normative cognition evolved as a solution to the distinctive problems of transmitting complex motor skills and craft skills, especially (...) skills related to toolmaking, through social learning. If this is correct, the expansion of the normative domain beyond technique to encompass more abstract norms of fairness, reciprocity, ritual and kinship involved the elaboration of a basic platform for the guidance of skilled action by technical norms. This article motivates and defends this “skill hypothesis” for the origin of normative cognition and sets out various ways in which it could be empirically tested. (shrink)

According to the dual-process account of moral judgment, deontological and utilitarian judgments stem from two different cognitive systems. Deontological judgments are effortless, intuitive and emotion-driven, whereas utilitarian judgments are effortful, reasoned and dispassionate. The most notable evidence for dual-process theory comes from neuroimaging studies by Joshua Greene and colleagues. Greene has suggested that these empirical findings undermine deontology and support utilitarianism. It has been pointed out, however, that the most promising interpretation of his argument does not make use of the (...) empirical findings. In this paper, I engage with recent attempts by Greene to vindicate the moral significance of dual-process theory and the supporting neuroscientific findings. I consider their potential moral significance with regard to three aspects of Greene’s case against deontology: the argument from morally irrelevant factors, the functionalist argument and the argument from confabulation. I conclude that Greene fails to demonstrate how neuroscience and dual-process theory in general can advance moral theorizing. (shrink)

Abstract: Artificial Morality is a new, emerging interdisciplinary field that centres around the idea of creating artificial moral agents, or AMAs, by implementing moral competence in artificial systems. AMAs are ought to be autonomous agents capable of socially correct judgements and ethically functional behaviour. This request for moral machines comes from the changes in everyday practice, where artificial systems are being frequently used in a variety of situations from home help and elderly care purposes to banking and court algorithms. It (...) is therefore important to create reliable and responsible machines based on the same ethical principles that society demands from people. New challenges in creating such agents appear. There are philosophical questions about a machine’s potential to be an agent, or mora l agent, in the first place. Then comes the problem of social acceptance of such machines, regardless of their theoretic agency status. As a result of efforts to resolve this problem, there are insinuations of needed additional psychological (emotional and cogn itive) competence in cold moral machines. What makes this endeavour of developing AMAs even harder is the complexity of the technical, engineering aspect of their creation. Implementation approaches such as top- down, bottom-up and hybrid approach aim to find the best way of developing fully moral agents, but they encounter their own problems throughout this effort. (shrink)

In this thesis, I argue that many identification intuitions, such as one that helps you identify the authorship of a painting you are seeing for the first time, fall under the class of experience-based intuitions. Such identification intuitions cannot arise without intuition generating systems (IGSs) that are shaped by experiences accumulated during one’s life. On my view, experience-based intuitions are produced by domain-general learning systems of hierarchical abstraction which may be modeled by deep convolutional neural networks. Owing to the mechanism (...) of such IGSs, the reliability of experience-based intuition X depends on the quality of the experiences underlying the IGS which produces X. Lastly, I suggest that insofar as some philosophical thought experiments elicit experience-based identification intuitions, we can use the case method to glean information about our experiences as well as uncover certain conceptual commitments. (shrink)

Intuitively, we judge that our responsibility has more to do with what we do than what we omit to do, and that it extends more to intended effects than to side-effects of our deeds. These intuitions have been expressed in our tradition through two principles: the doctrine of acts and omissions and the doctrine of double effect. Jonathan Glover acknowledges that these two principles are important, but believes that it is eventually better to discard them and, instead, to stick to (...) the consequentialist view that our responsibility extends equally to all the consequences of our behavior. I first examine Glover’s objections against the two principles and then present Joshua Greene’s research on the neuropsychology of moral judgment. These rest heavily on our reactions to certain moral dilemmas, in particular the trolley problem, and have recourse to neuroimaging. Greene’s conclusions go in the same direction as Glover’s more conceptual arguments. However, both authors share a common philosophical view, i.e., consequentialism. Thus, in a last section I consider some difficulties that this moral view encounters, and with the aid of other neuropsychological studies, I conclude that it is not judicious to put aside the intentions of an agent. (shrink)