The psychological and neurobiological processes underlying moral judgement have been the focus of many recent empirical studies1–11. Of central interest is whether emotions play a causal role in moral judgement, and, in parallel, how emotion-related areas of the brain contribute to moral judgement. Here we show that six patients with focal bilateral damage to the ventromedial prefrontal cortex (VMPC), a brain region necessary for the normal generation of emotions and, in particular, social emotions12–14, produce an abnor- mally ‘utilitarian’ pattern of (...) judgements on moral dilemmas that pit compelling considerations of aggregate welfare against highly emotionally aversive behaviours (for example, having to sacrifice one person’s life to save a number of other lives)7,8. In contrast, the VMPC patients’ judgements were normal in other classes of moral dilemmas. These findings indicate that, for a selective set of moral dilemmas, the VMPC is critical for normal judgements of right and wrong. The findings support a necessary role for emotion in the generation of those judgements. (shrink)

: To what extent do moral judgments depend on conscious reasoning from explicitly understood principles? We address this question by investigating one particular moral principle, the principle of the double effect. Using web-based technology, we collected a large data set on individuals’ responses to a series of moral dilemmas, asking when harm to innocent others is permissible. Each moral dilemma presented a choice between action and inaction, both resulting in lives saved and lives lost. Results showed that: patterns of moral (...) judgments were consistent with the principle of double effect and showed little variation across differences in gender, age, educational level, ethnicity, religion or national affiliation and a majority of subjects failed to provide justifications that could account for their judgments. These results indicate that the principle of the double effect may be operative in our moral judgments but not open to conscious introspection. We discuss these results in light of current psychological theories of moral cognition, emphasizing the need to consider the unconscious appraisal system that mentally represents the causal and intentional properties of human action. (shrink)

A two-systems model of moral judgment proposed by Joshua Greene holds that deontological moral judgments (those based on simple rules concerning action) are often primary and intuitive, and these intuitive judgments must be overridden by reflection in order to yield utilitarian (consequence-based) responses. For example, one dilemma asks whether it is right to push a man onto a track in order to stop a trolley that is heading for five others. Those who favor pushing, the utilitarian response, usually take longer (...) to respond than those who oppose pushing. Greene's model assumes an asymmetry between the processes leading to different responses. We consider an alternative model based on the assumption of symmetric conflict between two response tendencies. By this model, moral dilemmas differ in the "difficulty" of giving a utilitarian response and subjects differ in the "ability" (tendency) to give such responses. (We could just as easily define ability in terms of deontological responses, as the model treats the responses symmetrically.) We thus make an analogy between moral dilemmas and tests of cognitive ability, and we apply the Rasch model, developed for the latter, to estimate the ability-difficulty difference for each dilemma for each subject. We apply this approach to five data sets collected for other purposes by three of the co-authors. Response time (RT), including yes and no responses, is longest when difficulty and ability match, because the subject is indifferent between the two responses, which also have the same RT at this point. When we consider yes/no responses, RT is longest when the model predicts that the response is improbable. Subjects with low ability take longer on the "easier" dilemmas, and vice versa. (shrink)

Here, in textbook style, is a concise biological account of the evolution of morality. It addresses morality on three levels: moral outcomes (behavioral genetics), moral motivation or intent (psychology and neurology), and moral systems (sociality). The rationale for teaching this material is addressed in Allchin (2009). Classroom resources (including accompanying images and video links) and a discussion of teaching strategies are provided online at: http://EvolutionOfMorality.net.

Research on moral judgment has been dominated by rationalist models, in which moral judgment is thought to be caused by moral reasoning. The author gives 4 reasons for considering the hypothesis that moral reasoning does not cause moral judgment; rather, moral reasoning is usually a post hoc construction, generated after a judgment has been reached. The social intuitionist model is presented as an alternative to rationalist models. The model is a social model in that it deemphasizes the private reasoning done (...) by individuals and emphasizes instead the importance of social and cultural influences. The model is an intuitionist model in that it states that moral judgment is generally the result of quick, automatic evaluations (intuitions). The model is more consistent than rationalist models with recent findings in social, cultural, evolutionary, and biological psychology, as well as in anthropology and primatology. (shrink)

This article explicates the interaction between implicit and explicit processes in skill learning, in contrast to the tendency of researchers to study each type in isolation. It highlights various effects of the interaction on learning (including synergy effects). The authors argue for an integrated model of skill learning that takes into account both implicit and explicit processes. Moreover, they argue for a bottom-up approach (first learning implicit knowledge and then explicit knowledge) in the integrated model. A variety of qualitative data (...) can be accounted for by the approach. A computational model, CLARION, is then used to simulate a range of quantitative data. The results demonstrate the plausibility of the model, which provides a new perspective on skill learning. (PsycINFO Database Record (c) 2012 APA, all rights reserved). (shrink)

��Is moral judgment accomplished by intuition or conscious reasoning? An answer demands a detailed account of the moral principles in question. We investigated three principles that guide moral judgments: (a) Harm caused by action is worse than harm caused by omission, (b) harm intended as the means to a goal is worse than harm foreseen as the side effect of a goal, and (c) harm involving physical contact with the victim is worse than harm involving no physical contact. Asking whether (...) these principles are invoked to explain moral judgments, we found that subjects generally appealed to the first and third principles in their justifications, but not to the second. This finding has significance for methods and theories of moral psychology: The moral principles used in judgment must be directly compared with those articulated in justification, and doing so shows that some moral principles are available to conscious reasoning whereas others are not. (shrink)

‘Particularism’ and ‘generalism’ refer to families of positions in the philosophy of moral reasoning, with the former playing down the importance of principles, rules or standards, and the latter stressing their importance. Part of the debate has taken an empirical turn, and this turn has implications for AI research and the philosophy of cognitive modeling. In this paper, Jonathan Dancy’s approach to particularism (arguably one of the best known and most radical approaches) is questioned both on logical and empirical grounds. (...) Doubts are raised over whether Dancy’s brand of particularism can adequately explain the graded nature of similarity assessments in analogical arguments. Also, simple recurrent neural network models of moral case classification are presented and discussed. This is done to raise concerns about Dancy’s suggestion that neural networks can help us to understand how we could classify situations in a way that is compatible with his particularism. Throughout, the idea of a surveyable standard—one with restricted length and complexity—plays a key role. Analogical arguments are taken to involve multidimensional similarity assessments, and surveyable contributory standards are taken to be attempts to articulate the dimensions of similarity that may exist between cases. This work will be of relevance both to those who have interests in computationally modeling human moral cognition and to those who are interested in how such models may or may not improve our philosophical understanding of such cognition. (shrink)

This paper presents a skill learning model CLARION. Different from existing models of mostly high-level skill learning that use a top-down approach (that is, turning declarative knowledge into procedural knowledge through practice), we adopt a bottom-up approach toward low-level skill learning, where procedural knowledge develops first and declarative knowledge develops later. Our model is formed by integrating connectionist, reinforcement, and symbolic learning methods to perform on-line reactive learning. It adopts a two-level dual-representation framework (Sun, 1995), with a combination of localist (...) and distributed representation. We compare the model with human data in a minefield navigation task, demonstrating some match between the model and human data in several respects. (shrink)

I examine the phenomenon of implicit learning, the process by which knowledge about the rule-governed complexities of the stimulus environment is acquired independently of conscious attempts to do so. Our research with the two seemingly disparate experimental paradigms of synthetic grammar learning and probability learning, is reviewed and integrated with other approaches to the general problem of unconscious cognition. The conclusions reached are as follows: Implicit learning produces a tacit knowledge base that is abstract and representative of the structure of (...) the environment; such knowledge is optimally acquired independently of conscious efforts to learn; and it can be used implicitly to solve problems and make accurate decisions about novel stimulus circumstances. Various epistemological issues and related problems such as intuition, neuroclinical disorders of learning and memory, and the relationship of evolutionary processes to cognitive science are also discussed. (shrink)

Traditional theories of moral development emphasize the role of controlled cognition in mature moral judgment, while a more recent trend emphasizes intuitive and emotional processes. Here we test a dual-process theory synthesizing these perspectives. More specifically, our theory associates utilitarian moral judgment (approving of harmful actions that maximize good consequences) with controlled cognitive processes and associates non-utilitarian moral judgment with automatic emotional responses. Consistent with this theory, we find that a cognitive load manipulation selectively interferes with utilitarian judgment. This interference (...) effect provides direct evidence for the influence of controlled cognitive processes in moral judgment, and utilitarian moral judgment more specifically. (shrink)

We report the results of two experiments that show that participants rely on both emotion and reason in moral judgments. Experiment 1 showed that when participants were primed to communicate feelings, they provided emotive justifications not only for personal dilemmas, e.g., pushing a man from a bridge that will result in his death but save the lives of five others, but also for impersonal dilemmas, e.g., hitting a switch on a runaway train that will result in the death of one (...) man but save the lives of five others; when they were primed to communicate thoughts, they provided non-emotive justifications for both personal and impersonal dilemmas. Experiment 2 showed that participants read about a protagonist's emotions more quickly when the protagonist was faced with a personal dilemma than an impersonal one, but they read about the protagonist's decision to act or not act equally quickly for personal and impersonal dilemmas. (shrink)

Recent developments, both in the cognitive sciences and in world events, bring special emphasis to the study of morality. The cognitive sciences, spanning neurology, psychology, and computational intelligence, offer substantial ad- vances in understanding the origins and purposes of morality. Meanwhile, world events urge the timely synthesis of these insights with traditional ac- counts that can be easily assimilated and practically employed to augment moral judgment, both to solve current problems and to direct future action. The object of the following (...) paper is to present such a synthesis in the form of a model of moral cognition, the ACTWith model of conscience. The purpose of the model is twofold. One, the ACTWith model is intended to shed light on personal moral dispositions, and to provide a tool for actual human moral agents in the refinement of their moral lives. As such, it relies on the power of personal introspection, bolstered by the careful study of moral exemplars available to all persons in all cultures in the form of literary or religious fig- ures, if not in the form of contemporary peers and especially leadership. Two, the ACTWith model is intended as a minimum architecture for fully func- tional artificial morality. As such, it is essentially amodal, implementation non-specific and is developed in the form of an information processing control system. There are given as few hard points in this system as necessary for moral function, and these are themselves taken from review of actual human cognitive processes, thereby intentionally capturing as closely as possible what is expected of moral action and reaction by human beings. Only in satisfying these untutored intuitions should an artificial agent ever be properly regarded as moral, at least in the general population of existing moral agents. Thus, the ACTWith model is intended as a guide both for individual moral develop- ment and for the development of artificial moral agents as future technology permits. (shrink)

In some cases people judge it morally acceptable to sacrifice one person’s life in order to save several other lives, while in other similar cases they make the opposite judgment. Researchers have identified two general factors that may explain this phenomenon at the stimulus level: (1) the agent’s intention (i.e. whether the harmful event is intended as a means or merely foreseen as a side-effect) and (2) whether the agent harms the victim in a manner that is relatively “direct” or (...) “personal”. Here we integrate these two classes of findings. Two experiments examine a novel personalness/directness factor that we call personal force, present when the force that directly impacts the victim is generated by the agent’s muscles (e.g., in pushing). Experiments 1a and b demonstrate the influence of personal force on moral judgment, distinguishing it from physical contact and spatial proximity. Experiments 2a and b demonstrate an interaction between personal force and intention, whereby the effect of personal force depends entirely on intention. These studies also introduce a method for controlling for people’s real-world expectations in decisions involving potentially unrealistic hypothetical dilemmas. (shrink)

Various social animal species have been noted to inhibit aggressive attacks when a conspecific displays submission cues. Blair (1993) has suggested that humans possess a functionally similar mechanism which mediates the suppression of aggression in the context of distress cues. He has suggested that this mechanism is a prerequisite for the development of the moral/conventional distinction; the consistently observed distinction in subject's judgments between moral and conventional transgressions. Psychopaths may lack this violence inhibitor. A causal model is developed showing how (...) the lack of this mechanism would explain the core behavioural symptoms associated with the psychopathic disorder. A prediction of such a causal model would be that psychopaths should fail to make the moral/conventional distinction. This prediction was confirmed. The implication of this finding for other theories of morality is discussed. (shrink)

New paradigms in the psychology of reasoning have included a consideration for general contextual factors that may impact on the reasoning process, including individuals’ goals and motivations. We suggest that emotions are one such important contextual factor that influences reasoning. The classic literature on thinking and reasoning has typically ignored the possible influence of emotion, except to consider it a source of disruption. We review findings from studies where participants were asked to reason about personally relevant emotional experiences such as (...) sexual abuse, war, and terrorist attacks. While some findings are consistent with the view that incidental emotions have a deleterious effect on reasoning, a number of findings also suggest a beneficial impact of emotion. For instance, veterans reasoned more logically about combat-related syllogisms than structurally identical syllogisms with neutral contents; victims of sexual abuse reporting more negative emotions following the events also reasoned more logically on abuse-related contents, relative to neutral contents. This may be associated with integral emotions, when the affective reaction is relevant to the semantic contents reasoned about. We propose that the positive impact of integral emotions on reasoning can be explained by increased utility of problem content and increased utility of reasoning. (shrink)

According to Joshua Greene’s influential dual process model of moral judgment, different modes of processing are associated with distinct moral outputs: automatic processing with deontological judgment, and controlled processing with utilitarian judgment. This paper aims to clarify and assess Greene’s model. I argue that the proposed tie between process and content is based on a misinterpretation of the evidence, and that the supposed evidence for controlled processing in utilitarian judgment is actually likely to reflect generic deliberation which, ironically, is incompatible (...) with a utilitarian outlook. This alternative proposal is further supported by the results of a recent neuroimaging study we have done. (shrink)

To what extent do moral judgments depend on conscious reasoning from explicitly understood principles? We address this question by investigating one particular moral principle, the principle of the double effect. Using web-based technology, we collected a large data set on individuals' responses to a series of moral dilemmas, asking when harm to innocent others is permissible. Each moral dilemma presented a choice between action and inaction, both resulting in lives saved and lives lost. Results showed that: (1) patterns of moral (...) judgments were consistent with the principle of double effect and showed little variation across differences in gender, age, educational level, ethnicity, religion or national affiliation (within the limited range of our sample population) and (2) a majority of subjects failed to provide justifications that could account for their judgments. These results indicate that the principle of the double effect may be operative in our moral judgments but not open to conscious introspection. We discuss these results in light of current psychological theories of moral cognition, emphasizing the need to consider the unconscious appraisal system that mentally represents the causal and intentional properties of human action. (shrink)

Psychopathy is a personality disorder frequently associated with immoral behaviors. Previous behavioral studies on the influence of psychopathy on moral decision have yielded contradictory results, possibly because they focused either on judgment (abstract evaluation) or on choice of hypothetical action, two processes that may rely on different mechanisms. In this study, we explored the influence of the level of psychopathic traits on judgment and choice of hypothetical action during moral dilemma evaluation. A population of 102 students completed a questionnaire with (...) ten moral dilemmas and nine non-moral dilemmas. The task included questions targeting both judgment (“Is it acceptable to … in order to …?”) and choice of hypothetical action (“Would you … in order to …?”). The level of psychopathic traits of each participant was evaluated with the Levenson Self-Report Psychopathy (LSRP) scale. Logistic regression fitted with the generalized estimating equations method analyses were conducted using responses to the judgment and choice tasks as the dependent variables and psychopathy scores as predictor. Results show that a high level of psychopathic traits, and more specifically those related to affective deficit, predicted a greater proportion of utilitarian responses for the choice but not for the judgment question. There was no first-order interaction between the level of psychopathic traits and other potential predictors. The relation between a high level of psychopathic traits and increased utilitarianism in choice of action but not in moral judgment may explain the contradictory results of previous studies where these two processes were not contrasted. It also gives further support to the hypothesis that choice of action endorsement and abstract judgment during moral dilemma evaluation are partially distinct neural and psychological processes. We propose that this distinction should be better taken into account in the evaluation of psychopathic behaviors. (shrink)

Several scholars have recognized the limitations of theories of moral reasoning in explaining moral behavior. They have argued that moral behavior may also be influenced by moral identity, or how central morality is to one’s sense of self. This idea has been supported by findings that people who exemplify moral behavior tend to place more importance on moral traits when defining their self-concepts (Colby & Damon, 1995). This paper takes the next step of examining individual variation in a construct highly (...) associated with immoral behavior — psychopathy. In Study 1, we test the hypothesis that individuals with a greater degree of psychopathic traits have a weaker moral identity. Within a large online sample, we found that individuals who scored higher on a measure of psychopathic traits were less likely to base their self-concepts on moral traits. In Study 2, we test whether this reduced sense of moral identity can be attributed to differences in moral judgment, which is another factor that could influence immoral behavior. Our results indicated that the reduced sense of moral identity among more psychopathic individuals was independent of variation in moral judgment. These results suggest that individuals with psychopathic traits may display immoral behavior partially because they do not construe their personal identities in moral terms. (shrink)

Recent theorizing about the cognitive underpinnings of dilemmatic moral judgment has equated slow, deliberative thinking with the utilitarian disposition and fast, automatic thinking with the deontological disposition. However, evidence for the reflective utilitarian hypothesis—the hypothesized link between utilitarian judgment and individual differences in the capacity for rational reflection has been inconsistent and difficult to interpret in light of several design flaws. In two studies aimed at addressing some of the flaws, we found robust evidence for a reflective minimalist hypothesis—high CRT (...) performers’ tendency to regard utility-optimizing acts as largely a matter of personal prerogative, permissible both to perform and to leave undone. This relationship between CRT and the “minimalist” orientation remained intact after controlling for age, sex, trait affect, social desirability, and educational attainment. No significant association was found between CRT and the strict utilitarian response pattern or CRT and the strict deontological response pattern, nor did we find any significant association between CRT and willingness to act in the utility-optimizing manner. However, we found an inverse association between empathic concern and a willingness to act in the utility-optimizing manner, but there was no comparable association between empathic concern and the deontological judgment pattern. Theoretical, methodological, and normative implications of the findings are discussed. (shrink)

This article proposes a unified framework for understanding creative problem solving, namely, the explicit–implicit interaction theory. This new theory of creative problem solving constitutes an attempt at providing a more unified explanation of relevant phenomena (in part by reinterpreting/integrating various fragmentary existing theories of incubation and insight). The explicit–implicit interaction theory relies mainly on 5 basic principles, namely, (a) the coexistence of and the difference between explicit and implicit knowledge, (b) the simultaneous involvement of implicit and explicit processes in most (...) tasks, (c) the redundant representation of explicit and implicit knowledge, (d) the integration of the results of explicit and implicit processing, and (e) the iterative (and possibly bidirectional) processing. A computational implementation of the theory is developed based on the CLARION cognitive architecture and applied to the simulation of relevant human data. This work represents an initial step in the development of process-based theories of creativity encompassing incubation, insight, and various other related.. (shrink)

First Published in 1999. Routledge is an imprint of Taylor & Francis, an informa company.

The goal of this research is to understand the interaction of implicit and explicit psychological processes in dealing with emotional distractions and meta-cognitive control of such distractions. The questions are how emotional and meta-cognitive processes can be separated into implicit and explicit components, and how such a separation can be utilized to improve self-regulation of emotion, which can have significant theoretical and practical implications.

This paper discusses essential motivational representations necessary for a comprehensive computational cognitive architecture. It hypothesizes the need for implicit drive representations, as well as explicit goal representations. Drive representations consist of primary drives — both low-level primary drives (concerned mostly with basic physiological needs) and high-level primary drives (concerned more with social needs), as well as derived (secondary) drives. On the basis of drives, explicit goals may be generated on the fly during an agent’s interaction with various situations. These motivational (...) representations help to make cognitive architectural models more comprehensive and provide deeper explanations of psychological processes. This work represents a step forward in making computational cognitive architectures better reflections of the human mind and all its motivational complexity and intricacy. (shrink)

People often judge it unacceptable to directly harm a person, even when this is necessary to produce an overall positive outcome, such as saving five other lives. We demonstrate that similar judgments arise when people consider damage to owned objects. In two experiments, participants considered dilemmas where saving five inanimate objects required destroying one. Participants judged this unacceptable when it required violating another’s ownership rights, but not otherwise. They also judged that sacrificing another’s object was less acceptable as a means (...) than as a side-effect; judgments did not depend on whether property damage involved personal force. These findings inform theories of moral decision-making. They show that utilitarian judgment can be decreased without physical harm to persons, and without personal force. The findings also show that the distinction between means and side-effects influences the acceptability of damaging objects, and that ownership impacts utilitarian moral judgment. (shrink)

We created paired moral dilemmas with minimal contrasts in wording, a research strategy that has been advocated as a way to empirically establish principles operative in a domain‐specific moral psychology. However, the candidate “principles” we tested were not derived from work in moral philosophy, but rather from work in the areas of consumer choice and risk perception. Participants were paradoxically less likely to choose an action that sacrifices one life to save others when they were asked to provide more reasons (...) for doing so (Experiment 1), and their willingness to sacrifice lives depended not only on how many lives would be saved, but on the number of lives at risk (Experiment 2). The latter effect was also found in a within‐subjects design (Experiment 3). These findings suggest caution in the use of artificial dilemmas as a key testbed for revealing principled bases for moral judgment. (shrink)