In developing artificial intelligence (AI), researchers often benchmark against human performance as a measure of progress. Is this kind of comparison possible for moral cognition? Given that human moral judgment often hinges on intangible properties like “intention” which may have no natural analog in artificial agents, it may prove difficult to design a “like‐for‐like” comparison between the moral behavior of artificial and human agents. What would a measure of moral behavior for both humans and AI look like? We unravel the (...) complexity of this question by discussing examples within reinforcement learning and generative AI, and we examine how the puzzle of evaluating artificial agents' moral cognition remains open for further investigation within cognitive science. (shrink)

This paper assesses two accounts of what it means to have a moral responsibility. According to the desert account, moral responsibility amounts to deserving credit or blame for doing or failing to do things. According to an alternative theory, the demand account, moral responsibility amounts to being subject to a moral requirement, such as an obligation or duty. On this account, moral responsibility identifies the presence of a moral demand that may or may not be accompanied by desert. Experiments are (...) conducted to test these accounts in ordinary moral judgment. Results indicate that moral judgment has both a demand and a desert function, that responsibility can pattern with the demand function, and that responsibilities are attributed without blame, criticism, or punishment when several determinants of moral judgment, such as conscious awareness, intention, belief, and neurodeterminism are manipulated. Results also suggest that having a responsibility is distinguished from being responsible for something, that the latter can pattern with the desert function, and that paradoxically, one can have a responsibility that one is not responsible for. These findings advance our understanding of moral responsibility, the processes underlying moral judgment in moral psychology, and conceptual clarity in moral philosophy. (shrink)

Coordinating competing interests can be difficult. Because law regulates human behavior, it is a candidate mechanism for creating coordination in the face of societal disagreement. We argue that findings from moral psy- chology are necessary to understand why law can effectively resolve co- occurring conflicts related to punishment and group membership. First, we discuss heterogeneity in punitive thought, focusing on punishment within the United States legal system. Though the law exerts a weak influence on punitive ideologies before punishment occurs, we (...) argue that it effectively coordinates perceptions of individuals who have already been punished. Next, we discuss intergroup conflict, which often co-occurs with disagree- ments related to punishment and represents a related domain where coor- dination can be difficult to achieve. Here, we underscore how insights from moral psychology can promote equality via the law. These examples demonstrate how contributions from moral psychology are necessary to understand the connection between social cognition and law. (shrink)

The standard way to test alternative descriptive theories of moral judgment is by asking subjects to evaluate (amongst others) sacrificial dilemmas, where acting classifies as a utilitarian moral judgment and not acting classifies as a deontological moral judgment. Previous research uncovered many situational factors that alter subject’s moral judgments without affecting which type of action utilitarianism or deontology would recommend. This literature review provides a systematic analysis of the experimental literature on the influence of situational factors on moral judgments in (...) sacrificial dilemmas. It analyses 53 articles in detail and reports mean effect sizes, as well as operationalizations, for 36 situational factors that significantly influence moral judgment. Moreover, the review discusses how the impact of situational factors relates to a dual process theory of moral judgment. It supports the view that utilitarian judgments are driven by controlled cognitive processes and shows that the drivers of deontological judgments depend on valence. (shrink)

The dominant theory of the evolution of moral cognition across a variety of fields is that moral cognition is a biological adaptation to foster social cooperation. This chapter argues, to the contrary, that moral cognition is likely an evolutionary exaptation: a form of cognition where neurobiological capacities selected for in our evolutionary history for a variety of different reasons—many unrelated to social cooperation—were put to a new, prosocial use after the fact through individual rationality, learning, and the development and transmission (...) of social norms. This chapter begins with a brief overview of the emerging behavioral neuroscience of moral cognition. It then outlines a novel theory of moral cognition that I have previously argued explains these findings better than alternatives. Finally, it shows how the evidence for this theory of moral cognition and human evolutionary history together suggest that moral cognition is likely not a biological adaptation. Instead, like reading sheet music or riding a bicycle, moral cognition is something that individuals learn to do—in this case, in response to sociocultural norms created in our ancestral history and passed down through the ages to enable cooperative living. (shrink)

We chart how neuroscience and philosophy have together advanced our understanding of moral judgment with implications for when it goes well or poorly. The field initially focused on brain areas associated with reason versus emotion in the moral evaluations of sacrificial dilemmas. But new threads of research have studied a wider range of moral evaluations and how they relate to models of brain development and learning. By weaving these threads together, we are developing a better understanding of the neurobiology of (...) moral judgment in adulthood and to some extent in childhood and adolescence. Combined with rigorous evidence from psychology and careful philosophical analysis, neuroscientific evidence can even help shed light on the extent of moral knowledge and on ways to promote healthy moral development. (shrink)

Adults' judgments regarding punishment can have important social ramifications. However, the origins of these judgments remain unclear. Using the legal system as an example domain in which people receive punishment, the current work employed two complementary approaches to examine how punishment-related concepts emerge. Study 1 tested both 6- to 8-year-olds and adults to ascertain which components of “end-state” pun- ishment concepts emerge early in development and remain stable over time, and which components of pun- ishment concepts change with age. Children, (...) like adults, agreed with and spontaneously generated behavioral explanations for incarceration. However, children were more likely than adults to attribute incarceration to internal characteristics. Neither children nor adults reported that incarceration stems from societal-level factors such as poverty. Study 2 built on the results of Study 1 by probing the extent to which early punishment-related concepts in the legal domain emerge from a specific form of social experience—namely, parental incarceration. Children of incarcerated parents, like children whose parents were not incarcerated, were more likely to re- ference internal and behavioral factors than societal factors when discussing why people come into contact with the justice system. Taken together, these studies clarify how punishment-related concepts arise and therefore contribute to theories of moral psychology, social cognitive development, and criminal justice. (shrink)

Research has documented that individuals consider outcomes, intentions, and transgressor negligence when making morally relevant judgments (Nobes, Panagiotaki, & Engelhardt, 2017). However, less is known about whether individuals attend to both victim and transgressor negligence in their evaluations. The current study measured 3‐ to 6‐year‐olds (N = 70), 7‐ to 12‐year‐olds (N = 54), and adults' (N = 97, ages 18–25 years) moral judgments about scenarios in which an accidental transgression occurred involving property damage or physical harm. Participants were either (...) assigned to conditions where the victim or the transgressor was negligent. Results revealed attention to negligence among all participants across a range of different moral judgment measures (including acceptability judgments, punishment judgments, and attributions of blame), with age‐related increases in attention to negligence evident. Results provide novel evidence that children and adults consider not just outcomes and intentions, but also the role of negligence in both victims and transgressors, when making social decisions. (shrink)

Consider a binary afterlife, wherein some people go to Heaven, others to Hell, and nobody goes to both. Would such a system be just? Theodore Sider argues: no. For, any possible criterion of determining where people go will involve treating very similar individuals very differently. Here, I argue that this point has deep and underappreciated implications for moral philosophy. The argument proceeds by analogy: many ethical theories make a sharp and practically significant distinction between persons and non-persons. Yet, just like (...) in the binary afterlife, this involves treating very similar individuals very differently. I propose two ways out. The first is to deny that such theories are strictly speaking true, but to claim that it is practically best if people adopt them. The second is to modify such theories so as to allow for continuous variation in the scope and strength of the moral obligations arising from personhood. (shrink)

Gender, age, and culturally specific beliefs are often considered relevant to observed variation in social interactions. At present, however, the scientific literature is mixed with respect to the significance of these factors in guiding moral judgments. In this study, we explore the role of each of these factors in moral judgment by presenting the results of a web-based study of Eastern (i.e., Russia) and Western (i.e., USA, UK, Canada) subjects, male and female, and young and old. Participants ( n = (...) 659) responded to hypothetical moral scenarios describing situations where sacrificing one life resulted in saving five others. Though men and women from both types of cultures judged (1) harms caused by action as less permissible than harms caused by omission, (2) means-based harms as less permissible than side-effects, and (3) harms caused by contact as less permissible than by non-contact, men in both cultures delivered more utilitarian judgments (save the five, sacrifice one) than women. Moreover, men from Western cultures were more utilitarian than Russian men, with no differences observed for women. In both cultures, older participants delivered less utilitarian judgments than younger participants. These results suggest that certain core principles may mediate moral judgments across different societies, implying some degree of universality, while also allowing a limited range of variation due to sociocultural factors. (shrink)

This is a draft of my chapter on Negligence for the forthcoming Oxford Handbook in Moral Psychology. It discusses philosophical, psychological, and legal approaches to the attribution of culpability in cases of negligent wrongdoing.

Both mindreading and stereotyping are forms of social cognition that play a pervasive role in our everyday lives, yet too little attention has been paid to the question of how these two processes are related. This paper offers a theory of the influence of stereotyping on mental-state attribution that draws on hierarchical predictive coding accounts of action prediction. It is argued that the key to understanding the relation between stereotyping and mindreading lies in the fact that stereotypes centrally involve character-trait (...) attributions, which play a systematic role in the action–prediction hierarchy. On this view, when we apply a stereotype to an individual, we rapidly attribute to her a cluster of generic character traits on the basis of her perceived social group membership. These traits are then used to make inferences about that individual’s likely beliefs and desires, which in turn inform inferences about her behavior. (shrink)

Individuals tend to judge bad side effects as more intentional than good side effects (the Knobe or side- effect effect). Here, we assessed how widespread these findings are by testing eleven adult cohorts of eight highly contrasted cultures on their attributions of intentional action as well as ratings of blame and praise. We found limited generalizability of the original side-effect effect, and even a reversal of the effect in two rural, traditional cultures (Samoa and Vanuatu) where participants were more likely (...) to judge the good side effect as intentional. Three follow-up experiments indicate that this reversal of the side-effect effect is not due to semantics and may be linked to the perception of the status of the protagonist. These results highlight the importance of factoring cultural context in our understanding of moral cognition. (shrink)

The omission effect, first described by Spranca and colleagues, has since been extensively studied and repeatedly confirmed. All else being equal, most people judge it to be morally worse to actively bring about a negative event than to passively allow that event to happen. In this paper, we provide new experimental data that challenges previous studies of the omission effect both methodologically and philosophically. We argue that previous studies have failed to control for the equivalence of rules that are violated (...) by actions and omissions. Once equivalent norms are introduced, our results show that the omission effect is eliminated, even if the negative outcome of the behavior is foreseen and intended by the agent. We show that the omission effect does not constitute a basic, moral disposition but occurs exclusively in complex moral situations. Building on these empirical results, we cast doubt onto two influential explanations of the omission effect, the Causal Relevance Hypothesis and the Overgeneralization Hypothesis, and provide a novel explanation of the phenomenon. Furthermore, we discuss various ramifications of the interplay between our understanding of omissions and legal systems. (shrink)

Could animals behave morally if they can’t mindread? Does morality require mindreading capacities? Moral psychologists believe mindreading is contingently involved in moral judgements. Moral philosophers argue that moral behaviour necessarily requires the possession of mindreading capacities. In this paper, I argue that, while the former may be right, the latter are mistaken. Using the example of empathy, I show that animals with no mindreading capacities could behave on the basis of emotions that possess an identifiable moral content. Therefore, at least (...) one type of moral motivation does not require mindreading. This means that, a priori, non-mindreading animals can be moral. (shrink)

Humans have a strong sense of who should be punished, when, and how. Many features of these intuitions are consistent with a simple adaptive model: Punishment evolved as a mechanism to teach social partners how to behave in future interactions. Yet, it is clear that punishment as practiced in modern contexts transcends any biologically evolved mechanism; it also depends on cultural institutions including the criminal justice system and many smaller analogs in churches, corporations, clubs, classrooms, and so on. These institutions (...) can be thought of as a kind of ‘exaptation’: a culturally evolved set of norms that exploits biologically evolved intuitions about when punishment is deserved in order to achieve cooperative benefits for social groups. (shrink)

A traditional idea is that moral judgment involves more than calculating the consequences of actions; it also requires an assessment of the agent's intentions, the act's nature, and whether the agent uses another person as a means to her ends. I survey experimental developments suggesting that ordinary people often tacitly reason in terms of such deontological rules. It's now unclear whether we should posit a traditional form of the doctrine of double effect. However, further research suggests that a range of (...) non-consequentialist factors influence moral judgment, including intentions, commissions, personal harm, and agent-centered commitments. Many, if not all, such factors appear to affect how involved the agent is in bringing about an outcome. (shrink)

When making a moral judgment, people largely care about two factors: Who did it (causal responsibility), and did they intend to (intention)? Since Piaget's seminal studies, we have known that as children mature, they gradually place greater emphasis on intention, and less on mere bad outcomes, when making moral judgments. Today, we know that this developmental shift has several signature properties. Recently, it has been shown that when adults make moral judgments under cognitive load, they exhibit a pattern similar to (...) young children; that is, their judgments become notably more outcome based. Here, we show that all of the same signature properties that accompany the outcome‐to‐intent shift in childhood characterize the “intent‐to‐outcome” shift obtained under cognitive load in adults. These findings hold important implications for current theories of moral judgment. (shrink)

In resultant moral luck, blame and punishment seem intuitively to depend on downstream effects of a person’s action that are beyond his or her control. Some skeptics argue that we should override our intuitions about moral luck and reform our practices. Other skeptics attempt to explain away apparent cases of moral luck as epistemic artifacts. I argue, to the contrary, that moral luck is real—that people are genuinely responsible for some things beyond their control. A partially consequentialist theory of responsibility (...) justifies moral luck. But this justification is no mere rationalization of the status quo. Recent experimental and evolutionary work on punishment and learning suggests that the very same reasons that justify moral luck have also shaped the evolution of our luck-sensitive moral practices. (shrink)

In two independent yet complementary studies, the current research explored the developmental changes of young children’s conceptualization of learning, focusing the role of knowledge change and learning intention, and its association with their developing theory of mind ability. In study 1, 75 children between 48 and 86 months of age judged whether a character with or without a genuine knowledge change had learned. The results showed that younger children randomly attributed learning between genuine knowledge change and accidental coincidence that did (...) not involve knowledge change. Children’s learning judgments in familiar contexts improved with age and correlated with their ToM understanding. However, the correlation was no longer significant once age was held constant. Another sample of 72 children aged between 40 and 90 months participated in study 2, where children were asked to judge whether the story protagonists intended to learn and whether they eventually learned. The results suggested that children over-attributed learning intention to discovery and implicit learning. Stories with conflict between the learning intention and outcome appeared to be most challenging for children. Children’s intention judgment was correlated with their ToM understanding, and ToM marginally predicted intention judgment when the effect of age was accounted for. The implication of the findings for school readiness was discussed. Training studies and longitudinal designs in the future are warranted to better understand the relation between ToM development and children’s learning understanding. (shrink)

Research on children's developing moral cognition has mostly focused on their evaluation of, and reasoning about, others' intrinsically harmful (non-)verbal actions (e.g., hitting, lying). But assertions may have morally relevant (intended or unintended) consequences, too. For instance, if someone wrongly claims that “This water is clean!”, such an incorrect representation of reality may have harmful consequences to others. In two experiments, we investigated preschoolers' evaluation of others' morally relevant factual claims. In Experiment 1, children witnessed a puppet making incorrect assertions (...) that would lead to harm or to no harm. In Experiment 2, incorrect assertions would always lead to harm, but the puppet either intended the harm to occur or not. Children evaluated the puppet’s factual claim more negatively when they anticipated harmful versus harmless consequences (Experiment 1) and when the puppet’s intention was bad versus good over and above harmful consequences (Experiment 2). These findings suggest that preschoolers’ normative understanding is not limited to evaluating others’ intrinsically harmful transgressions, but also entails an appreciation of the morally relevant consequences of, and intentions underlying, others’ factual claims. (shrink)

Psychologists and neuroscientists have recently been unearthing the unconscious processes that give rise to moral intuitions and emotions. According to skeptics like Joshua Greene, what has been found casts doubt on many of our moral beliefs. However, a new approach in moral psychology develops a learning-theoretic framework that has been successfully applied in a number of other domains. This framework suggests that model-based learning shapes intuitions and emotions. Model-based learning explains how moral thought and feeling are attuned to local material (...) and social conditions. Philosophers can draw on these explanations, in some cases, in order to vindicate episodes of moral change. Explanations can support justifications by showing that they are not mere rationalizations. In addition, philosophical justifications are a fertile source for empirical hypotheses about the rational learning mechanisms that shape moral intuitions and emotions. (shrink)

ABSTRACTThe judgment of blame was studied in a group of 28 teenagers, 14 with Asperger syndrome and 14 typically developed. Teenagers in each group were matched by age, cognitive development and academic level. They were presented with 12 short vignettes in which they had to judge an action according to the intent of the actor, the consequences of the action and the seriousness of the situation. Results showed a significant difference in the patterns of judgment of both groups. The AS (...) group judged the action according to the physical consequence of the action more than the intent of the actor; the opposite was observed with the control group. In addition, the AS teenagers were less capable than the control group of grading injury to a person when apportioning blame especially when they were not familiar with the social situations. This result suggests that the judgement of the seriousness of the outcome of the social interactio... (shrink)

Human cooperation and group living are based on societies in which individuals not only care about their own interests but share common norms and values – such as morality and prosocial behavior. As early as the 18th century, Immanuel Kant postulated autonomy as the key to human morality. Kant explained that a rational agent with a free will would necessarily make moral – not immoral – decisions. However, the fundamental question of how moral behavior acquires normative weight remains unresolved until (...) the present day, especially when moral behavior entails personal costs for the individual. This dissertation builds on Kant’s thesis and aims to investigate important building blocks of moral autonomy at preschool age. Therefore, children’s own prosocial decisions as well as their normative and descriptive expectations about others’ prosocial actions are assessed and linked to fundamental underlying mechanisms such as cultural learning and collective intentionality. Study 1 assessed whether preschoolers enforce agreed-upon prosocial ver-sus selfish sharing norms in a group dictator game. Three- and 5-year-old children and two hand puppets had the opportunity to agree on how to distribute re-sources between themselves and a group of passive recipients. The findings sug-gest that preschoolers understand prosocial, but not selfish, agreements as binding even though prosocial sharing norms are associated with personal costs. Study Set 2 assessed in two experiments whether observed choice increases the children’s own prosocial sharing behavior. In Experiment 1, children observed an adult model who was provided with costly choice, non-costly choice, or no choice. As a next step, children were given the opportunity to decide how many stickers they would like to share with a sad animal puppet. Experiment 2 aimed to investigate possible age effects. The study design was reduced to condition and, a second test trial was added. Taken together, the results of Study Set 2 suggest that 5-year-old’s prosocial sharing behavior increases when previously having observed someone who intentionally acts prosocially at a personal cost. Study 3 investigated preschoolers’ descriptive expectations about the causal agent of prosocial and selfish actions, based on agents’ prior history of voluntary versus involuntary prosocial behavior. The results show that children at the age of 5.5 years use information about the circumstances and intentions of previous actions to generate descriptive expectations about other’s future prosocial behavior. From 4 years of age, children distinguish between an agent who shares voluntarily and an agent who shares only involuntarily. Taken together, this dissertation shows that preschool aged children infer and enforce prosocial – but not selfish – sharing norms. They engage in prosocial sharing which is affected by observed choice and they form descriptive expectations about others tendency to behave prosocial or selfish on the base of knowledge about the agents prosocial versus selfish intentions. (shrink)