When faced with a dilemma between believing what is supported by an impartial assessment of the evidence (e.g., that one's friend is guilty of a crime) and believing what would better fulfill a moral obligation (e.g., that the friend is innocent), people often believe in line with the latter. But is this how people think beliefs ought to be formed? We addressed this question across three studies and found that, across a diverse set of everyday situations, people treat moral considerations (...) as legitimate grounds for believing propositions that are unsupported by objective, evidence-based reasoning. We further document two ways in which moral considerations affect how people evaluate others' beliefs. First, the moral value of a belief affects the evidential threshold required to believe, such that morally beneficial beliefs demand less evidence than morally risky beliefs. Second, people sometimes treat the moral value of a belief as an independent justification for belief, and on that basis, sometimes prescribe evidentially poor beliefs to others. Together these results show that, in the folk ethics of belief, morality can justify and demand motivated reasoning. (shrink)

Rational choice theory enjoys unprecedented popularity and influence in the behavioral and social sciences, but it generates intractable problems when applied to socially interactive decisions. In individual decisions, instrumental rationality is defined in terms of expected utility maximization. This becomes problematic in interactive decisions, when individuals have only partial control over the outcomes, because expected utility maximization is undefined in the absence of assumptions about how the other participants will behave. Game theory therefore incorporates not only rationality but also common (...) knowledge assumptions, enabling players to anticipate their co-players' strategies. Under these assumptions, disparate anomalies emerge. Instrumental rationality, conventionally interpreted, fails to explain intuitively obvious features of human interaction, yields predictions starkly at variance with experimental findings, and breaks down completely in certain cases. In particular, focal point selection in pure coordination games is inexplicable, though it is easily achieved in practice; the intuitively compelling payoff-dominance principle lacks rational justification; rationality in social dilemmas is self-defeating; a key solution concept for cooperative coalition games is frequently inapplicable; and rational choice in certain sequential games generates contradictions. In experiments, human players behave more cooperatively and receive higher payoffs than strict rationality would permit. Orthodox conceptions of rationality are evidently internally deficient and inadequate for explaining human interaction. Psychological game theory, based on nonstandard assumptions, is required to solve these problems, and some suggestions along these lines have already been put forward. Key Words: backward induction; Centipede game; common knowledge; cooperation; epistemic reasoning; game theory; payoff dominance; pure coordination game; rational choice theory; social dilemma. (shrink)

The construct of moral intensity, proposed by Jones (1991), was used to predict the extent to which individuals were able to recognize moral issues. We tested for the effects of the six dimensions of moral intensity: social consensus, proximity, concentration of effect, probability of effect, temporal immediacy and magnitude of consequences. A scenario-based study, conducted among business individuals in Singapore, revealed that social consensus and magnitude of consequences influenced the recognition of moral issues. The study provided evidence for the effects (...) of temporal immediacy. There was marginal support for the impact of proximity and probability of effect but no evidence that concentration of effect influenced recognition of moral issues. The paper concludes with a discussion of the implications of these results for researchers and organisational practitioners. (shrink)

Does the most common response given by participants presented with Tversky and Kahneman’s famous taxi cab problem amount to a violation of Bayes’ theorem? In other words, do they fall victim to so-called base-rate fallacy? In the present paper, following an earlier suggestion by Crupi and Girotto, we will identify the logical arguments underlying both the original diagnosis of irrationality in this reasoning task under uncertainty and a number of objections that have been raised against such a diagnosis. This will (...) enable us to show firstly that, contrary to the dismissive arguments recently put forward by Elqayam and Evans, empirical evidence turns out to be quite useful in addressing questions of this kind. Therefore, it can make a significant contribution to moving the base-rate fallacy controversy forward. Secondly, the available empirical evidence (though limited and sometimes inconclusive) seems to support the charge of irrationality levelled against the majority of participants presented with the taxi cab problem, and hence suggests that base-rate neglect is a real fallacy − that is the conclusion of our analysis. (shrink)

Cognitive developmental evidence is sometimes conscripted to support ''naturalized epistemology'' arguments to the effect that a general epistemic stance leads children to build theory-like accounts of underlying properties of kinds. A review of the evidence suggests that what prompts conceptual acquisition is not a general epistemic stance but a series of category-specific intuitive principles that constitute an evolved ''natural metaphysics''. This consists in a system of categories and category-specific inferential processes founded on definite biases in prototype formation. Evidence for this (...) system provides a better understanding of the limited ''plasticity'' of ontological commitments as well as a computationally plausible account of their initial state, avoiding ambiguities about innateness. This may provide a starting point for a ''naturalized epistemology'' that takes into account evolved properties of human conceptual structures. (shrink)

Cognitive developmental evidence is sometimes conscripted to support ''naturalized epistemology'' arguments to the effect that a general epistemic stance leads children to build theory-like accounts of underlying properties of kinds. A review of the evidence suggests that what prompts conceptual acquisition is not a general epistemic stance but a series of category-specific intuitive principles that constitute an evolved ''natural metaphysics''. This consists in a system of categories and category-specific inferential processes founded on definite biases in prototype formation. Evidence for this (...) system provides a better understanding of the limited ''plasticity'' of ontological commitments as well as a computationally plausible account of their initial state, avoiding ambiguities about innateness. This may provide a starting point for a ''naturalized epistemology'' that takes into account evolved properties of human conceptual structures. (shrink)

The tendency to neglect base-rates in judgment under uncertainty may be as Barbey & Sloman (B&S) suggest, but it is neither inevitable (as they document; see also Koehler 1996) nor unique. Here we would like to point out another line of evidence connecting ecological rationality to dual processes, the failure of individuals to appropriately judge cumulative probability.

The phenomenon of base-rate neglect has elicited much debate. One arena of debate concerns how people make judgments under conditions of uncertainty. Another more controversial arena concerns human rationality. In this target article, we attempt to unpack the perspectives in the literature on both kinds of issues and evaluate their ability to explain existing data and their conceptual coherence. From this evaluation we conclude that the best account of the data should be framed in terms of a dual-process model of (...) judgment, which attributes base-rate neglect to associative judgment strategies that fail to adequately represent the set structure of the problem. Base-rate neglect is reduced when problems are presented in a format that affords accurate representation in terms of nested sets of individuals. (shrink)

The commentaries indicate a general agreement that one source of reduction of base-rate neglect involves making structural relations among relevant sets transparent. There is much less agreement, however, that this entails dual systems of reasoning. In this response, we make the case for our perspective on dual systems. We compare and contrast our view to the natural frequency hypothesis as formulated in the commentaries.

We propose a critique ofnormativism, defined as the idea that human thinking reflects a normative system against which it should be measured and judged. We analyze the methodological problems associated with normativism, proposing that it invites the controversial “is-ought” inference, much contested in the philosophical literature. This problem is triggered when there are competing normative accounts (the arbitration problem), as empirical evidence can help arbitrate between descriptive theories, but not between normative systems. Drawing on linguistics as a model, we propose (...) that a clear distinction between normative systems and competence theories is essential, arguing that equating them invites an “is-ought” inference: to wit, supporting normative “ought” theories with empirical “is” evidence. We analyze in detail two research programmes with normativist features – Oaksford and Chater's rational analysis and Stanovich and West's individual differences approach – demonstrating how, in each case, equating norm and competence leads to an is-ought inference. Normativism triggers a host of research biases in the psychology of reasoning and decision making: focusing on untrained participants and novel problems, analyzing psychological processes in terms of their normative correlates, and neglecting philosophically significant paradigms when they do not supply clear standards for normative judgement. For example, in a dual-process framework, normativism can lead to a fallacious “ought-is” inference, in which normative responses are taken as diagnostic of analytic reasoning. We propose that little can be gained from normativism that cannot be achieved by descriptivist computational-level analysis, illustrating our position with Hypothetical Thinking Theory and the theory of the suppositional conditional. We conclude that descriptivism is a viable option, and that theories of higher mental processing would be better off freed from normative considerations. (shrink)

This chapter explores a way in which visual processing may involve innate constraints and attempts to show how such processing overcomes one enduring challenge to nativism. In particular, many challenges to nativist theories in other areas of cognitive psychology have focused on the later development of such abilities, and have argued that such development is in conflict with innate origins. Innateness, in these contexts, is seen as antidevelopmental, associated instead with static processes and principles. In contrast, certain perceptual models demonstrate (...) how the very same mental processes can both be innately specified and yet develop richly in response to experience with the environment. This process is entirely unmysterious, as shown in certain formal theories of visual perception, including those that appeal to spontaneous endogenous stimulation and those based on Bayesian inference. (shrink)

This commentary focuses on the parts of psychological game theory dealing with preference, as illustrated by team reasoning, and supports the conclusion that these theoretical notions do not contribute above and beyond existing theory in understanding social interaction. In particular, psychology and games are already bridged by a comprehensive, formal, and inherently psychological theory, interdependence theory (Kelley & Thibaut 1978; Kelley et al. 2003), which has been demonstrated to account for a wide variety of social interaction phenomena.

In this response, we clarify several misunderstandings of the understanding/acceptance principle and defend our specific operationalization of that principle. We reiterate the importance of addressing the problem of rational task construal and we elaborate the notion of computational limitations contained in our target article. Our concept of thinking dispositions as variable intentional-level styles of epistemic and behavioral regulation is explained, as is its relation to the rationality debate. Many of the suggestions of the commentators for elaborating two-process models are easily (...) integrated into our generic dual-process account. We further explicate how we view the relation between System 1 and System 2 and evolutionary and normative rationality. We clarify our attempt to fuse the contributions of the cognitive ecologists with the insights of the original heuristics and biases researchers. (shrink)

We propose a coherence account of the conjunction fallacy applicable to both of its two paradigms. We compare our account with a recent proposal by Tentori et al. : 235–255, 2013) that attempts to generalize earlier confirmation accounts. Their model works better than its predecessors in some respects, but it exhibits only a shallow form of generality and is unsatisfactory in other ways as well: it is strained, complex, and untestable as it stands. Our coherence account inherits the strength of (...) the confirmation account, but in addition to being applicable to both paradigms, it is natural, simple, and readily testable. It thus constitutes the next natural step for Bayesian theorizing about the conjunction fallacy. (shrink)

In criminal trials, evidence often involves a degree of uncertainty and decision-making includes moving from the initial presumption of innocence to inference about guilt based on that evidence. The jurors’ ability to combine evidence and make accurate intuitive probabilistic judgments underpins this process. Previous research has shown that errors in probabilistic reasoning can be explained by a misalignment of the evidence presented with the intuitive causal models that people construct. This has been explored in abstract and context-free situations. However, less (...) is known about how people interpret evidence in context-rich situations such as legal cases. The present study examined participants’ intuitive probabilistic reasoning in legal contexts and assessed how people’s causal models underlie the process of belief updating in the light of new evidence. The study assessed whether participants update beliefs in line with Bayesian norms and if errors in belief updating can be explained by the causal structures underpinning the evidence integration process. The study was based on a recent case in England where a couple was accused of intentionally harming their baby but was eventually exonerated because the child’s symptoms were found to be caused by a rare blood disorder. Participants were presented with a range of evidence, one piece at a time, including physical evidence and reports from experts. Participants made probability judgments about the abuse and disorder as causes of the child’s symptoms. Subjective probability judgments were compared against Bayesian norms. The causal models constructed by participants were also elicited. Results showed that overall participants revised their beliefs appropriately in the right direction based on evidence. However, this revision was done without exact Bayesian computation and errors were observed in estimating the weight of evidence. Errors in probabilistic judgments were partly accounted for, by differences in the causal models representing the evidence. Our findings suggest that understanding causal models that guide people’s judgments may help shed light on errors made in evidence integration and potentially identify ways to address accuracy in judgment. (shrink)

This paper is about the differences between probabilities and beliefs and why reasoning should not always conform to probability laws. Probability is defined in terms of urn models from which probability laws can be derived. This means that probabilities are expressed in rational numbers, they suppose the existence of veridical representations and, when viewed as parts of a probability model, they are determined by a restricted set of variables. Moreover, probabilities are subjective, in that they apply to classes of events (...) that have been deemed (by someone) to be equivalent, rather than to unique events. Beliefs on the other hand are multifaceted, interconnected with all other beliefs, and inexpressible in their entirety. It will be argued that there are not sufficient rational numbers to characterise beliefs by probabilities and that the idea of a veridical set of beliefs is questionable. The concept of a complete probability model based on Fisher's notion of identifiable subsets is outlined. It is argued that to be complete a model must be known to be true. This can never be the case because whatever a person supposes to be true must be potentially modifiable in the light of new information. Thus to infer that an individual's probability estimate is biased it is necessary not only to show that the estimate differs from that given by a probability model, but also to assume that this model is complete, and completeness is not empirically verifiable. It follows that probability models and Bayes theorem are not necessarily appropriate standards for people's probability judgements. The quality of a probability model depends on how reasonable it is to treat some existing uncertainty as if it were equivalent to that in a particular urn model and this cannot be determined empirically. Bias can be demonstrated in estimates of proportions of finite populations such as in the false consensus effect. However the modification of beliefs by ad hoc methods like Tversky and Kahneman's heuristics can be justified, even though this results in biased judgements. This is because of pragmatic factors such as the cost of obtaining and taking account of additional information which are not included even in a complete probability model. Finally, an analogy is drawn between probability models and geometric figures. Both idealisations are useful but qualitatively inadequate characterisations of nature. A difference between the two is that the size of any error can be limited in the case of the geometric figure in a way that is not possible in a probability model. (shrink)

A poor understanding of probability may lead people to misinterpret every day coincidences and form anomalistic beliefs. We investigated the relationship between anomalistic beli...

In 1955, Egon Brunswik presented a paper in which he argued that neglect of the environment and over emphasis of the organism was the major downfall of cognitive psychology. His critiques have largely been ignored and research is discussed that demonstrates the same organismic- asymmetry Brunswik detailed in 1955. This research is discussed in attribution terms since experimental psychologists make behavioral attributions. This organismic-asymmetry has resulted in a body of research that is guilty of the fundamental attribution error. Brunswik's theory (...) of representative design, proposed to address organismic-asymmetry, is discussed and contrasted with calls for ecological validity. Although calls for ecological validity are well intentioned, they lack any systematic theory of the environment and fall significantly short of Brunswik's ideal. 2012 APA, all rights reserved). (shrink)

We tested models of base rate “neglect” using a novel paradigm. Participants judged the probability that a hypothetical person belonged to one of two categories on the basis of either a personality description alone or the personality description and a base rate probability. When base rates and descriptions were congruent, judgments in the BR condition were higher and more uniform than those in the NoBR condition. In contrast, base rates had a polarizing effect on judgments when they were incongruent with (...) the descriptions, such that estimates were either consistent with the base rates or discrepant with them. These data suggest that the form of base rate use is context dependent. In addition, judgments made under instructions to respond intuitively were influenced by the base rates and took the same length of time in the two conditions. These data suggest that the use of base rates is routine and effortless and that base rate “neglect” is really a mixture of two strategies, one that is informed primarily by the base rate and the other by the personality description. (shrink)

How can we study bounded rationality? We answer this question by proposing rational task analysis —a systematic approach that prevents experimental researchers from drawing premature conclusions regarding the rationality of agents. RTA is a methodology and perspective that is anchored in the notion of bounded rationality and aids in the unbiased interpretation of results and the design of more conclusive experimental paradigms. RTA focuses on concrete tasks as the primary interface between agents and environments and requires explicating essential task elements, (...) specifying rational norms, and bracketing the range of possible performance, before contrasting various benchmarks with actual performance. After describing RTA’s core components we illustrate its use in three case studies that examine human memory updating, multitasking behavior, and melioration. We discuss RTA’s characteristic elements and limitations by comparing it to related approaches. We conclude that RTA provides a useful tool to render the study of bounded rationality more transparent and less prone to theoretical confusion. (shrink)

Cognition is both empowered and limited by representations. The matrix lens model explicates tasks that are based on frequency counts, conditional probabilities, and binary contingencies in a general fashion. Based on a structural analysis of such tasks, the model links several problems and semantic domains and provides a new perspective on representational accounts of cognition that recognizes representational isomorphs as opportunities, rather than as problems. The shared structural construct of a 2 × 2 matrix supports a set of generic tasks (...) and semantic mappings that provide a unifying framework for understanding problems and defining scientific measures. Our model's key explanatory mechanism is the adoption of particular perspectives on a 2 × 2 matrix that categorizes the frequency counts of cases by some condition, treatment, risk, or outcome factor. By the selective steps of filtering, framing, and focusing on specific aspects, the measures used in various semantic domains negotiate distinct trade-offs between abstraction and specialization. As a consequence, the transparent communication of such measures must explicate the perspectives encapsulated in their derivation. To demonstrate the explanatory scope of our model, we use it to clarify theoretical debates on biases and facilitation effects in Bayesian reasoning and to integrate the scientific measures from various semantic domains within a unifying framework. A better understanding of problem structures, representational transparency, and the role of perspectives in the scientific process yields both theoretical insights and practical applications. (shrink)

We introduce an expected-value theory of linguistic modality that makes reference to expected utility and a likelihood-based confirmation measure for deontics and epistemics, respectively. The account is a probabilistic semantics for deontics and epistemics, yet it proposes that deontics and epistemics share a common core modal semantics, as in traditional possible-worlds analysis of modality. We argue that this account is not only theoretically advantageous, but also has far-reaching empirical consequences. In particular, we predict modal versions of reasoning fallacies from the (...) heuristics and biases literature. Additionally, we derive the modal semantics in an entirely transparent manner, as it is based on the compositional semantics of Korean modal expressions that are morphosyntactically decomposed into a conditional and an evaluative predicate. (shrink)

Consistent with Barbey & Sloman (B&S), it is proposed that performance on Bayesian inference tasks is well explained by nested sets theory (NST). However, contrary to those authors' view, it is proposed that NST does better by dispelling with dual-systems assumptions. This article examines why, and sketches out a series of NST's core principles, which were not previously defined.

An experiment was conducted to test the effectiveness of brief instruction in information structuring (i.e., representing and integrating information) for improving the coherence of probability judgments and binary choices among intelligence analysts. Forty-three analysts were presented with comparable sets of Bayesian judgment problems before and immediately after instruction. After instruction, analysts’ probability judgments were more coherent (i.e., more additive and compliant with Bayes theorem). Instruction also improved the coherence of binary choices regarding category membership: after instruction, subjects were more likely (...) to invariably choose the category to which they assigned the higher probability of a target’s membership. The research provides a rare example of evidence-based validation of effectiveness in instruction to improve the statistical assessment skills of intelligence analysts. Such instruction could also be used to improve the assessment quality of other types of experts who are required to integrate statistical information or make probabilistic assessments. (shrink)

ABSTRACTResearch has established that human thinking is often biased by intuitive judgement. The base-rate neglect effect provides such an example, so named because people often support their decisions in stereotypical individuating information, neglecting base-rates. Here, we test the hypothesis that reasoners acknowledge information provided by base-rates and may use individuating information in support of a “rational” decision process. Results from four experiments show that “base-rate neglecting” occurs when participants acknowledge sample distributions; participants who prefer individuating over base-rate information perceive base-rates (...) as less diagnostic and are more confident in their individuating-based responses; and that posterior probabilities predict more individuating-based responses for individuating-preference participants. However, data also show a deeper form of base-rate neglect: even when some partic... (shrink)

This paper addresses and rejects claims that one can demonstrate experimentally that most untutored subjects are systematically and incurably irrational in their probability judgements and in some deductive reasoning tasks. From within a strongly subjectivist theory of probability, it develops the notions of resiliency —a measure of stability of judgements—and robustness —a measure of expected stability. It then becomes possible to understand subjects' behaviour in the Wason selection task, in examples which have been claimed to involve a 'base-rate fallacy', in (...) appearing to ignore laws of large numbers and to overestimate their own success rate as entirely rational: a matter of combining first-order probability assignments with judgements about the robustness of those assignments. (shrink)

Implicit bias results from living in a society structured by race. Tamar Gendler has drawn attention to several epistemic costs of implicit bias and concludes that paying some costs is unavoidable. In this paper, we reconstruct Gendler’s argument and argue that the epistemic costs she highlights can be avoided. Though epistemic agents encode discriminatory information from the environment, not all encoded information is activated. Agents can construct local epistemic environments that do not activate biasing representations, effectively avoiding the consequences of (...) activation. We conclude that changing our local environments provides a way to avoid paying implicit bias’s epistemic costs. (shrink)

The experimental research paradigm lies at the core of empirical psychology. New data analytical and computational tools continually enrich its methodological arsenal, while the paradigm’s mission remains the testing of theoretical predictions and causal explanations. Predictions regarding experimental results necessarily point to the future. Once the data are collected, the causal inferences refer to a hypothesis now lying in the past. The experimental paradigm is not designed to permit strong inferences about particular incidents that occurred before predictions were made. In (...) contrast, historical research and scholarship in other humanities focus on this backward direction of inference. The disconnect between forward-looking experimental psychology and backward-looking historical (i.e., narrative) psychology is a challenge in the postmodern era, which can be addressed. To illustrate this possibility, I discuss three historical case studies in light of theory and research in contemporary psychology. (shrink)

Barbey & Sloman (B&S) advocate a dual-process (two-system) approach by comparing it with an alternative perspective (ecological rationality), claiming that the latter is unwarranted. Rejecting this alternative approach cannot serve as sufficient evidence for the viability of the former.

The work presented here investigates the process by which one group of individuals solves the problem of detecting deceptions created by other agents. A field experiment was conducted in which twenty-four auditors (partners in international public accounting firms) were asked to review four cases describing real companies that, unknown to the auditors, had perpetrated financial frauds. While many of the auditors failed to detect the manipulations in the cases, a small number of auditors were consistently successful. Since the detection of (...) frauds occurs infrequently in the work of a given auditor, we explain success by the application of powerful heuristics gained from experience with deceptions in everyday life. These heuristics implement a variation of Dennett's intentional stance strategy, which is based on interpreting detected inconsistencies in the light of the Deceiver's (i.e., management's) goals and possible actions. We explain failure to detect deception by means of perturbations (bugs) in the domain knowledge of accounting needed to apply these heuristics to the specific context of financial statement fraud. We test our theory by showing that a computational model of fraud detection that employs the proposed heuristics successfully detects frauds in the cases given to the auditors. We then modify the model by introducing perturbations based on the errors made by each of the auditors in the four cases. The resulting models account for 84 of the 96 observations (i.e., 24 auditors × four cases) in our data. (shrink)