A fact of life for farmers, hunter-gatherers, and fishermen in the rural parts of the world are that crops fail, wild resources become scarce, and winds discourage fishing. In this article we approach subsistence risk from the perspective of "coexistence thinking," the simultaneous application of natural and supernatural causal models to explain subsistence success and failure. In southwestern Madagascar, the ecological world is characterized by extreme variability and unpredictability, and the cosmological world is characterized by anxiety about supernatural dangers. Ecological (...) and cosmological causes seem to point to different risk minimizing strategies: to avoid losses from drought, flood, or heavy winds, one should diversify activities and be flexible; but to avoid losses caused by disrespected spirits one should narrow one's range of behaviors to follow the code of taboos and offerings. We address this paradox by investigating whether southwestern Malagasy understand natural and supernatural causes as occupying separate, contradictory explanatory systems (target dependence), whether they make no categorical distinction between natural and supernatural forces and combine them within a single explanatory system (synthetic thinking), or whether they have separate natural and supernatural categories of causes that are integrated into one explanatory system so that supernatural forces drive natural forces (integrative thinking). Results from three field studies suggest that (a) informants explain why crops, prey, and market activities succeed or fail with reference to natural causal forces like rainfall and pests, (b) they explain why individual persons experience success or failure primarily with supernatural factors like God and ancestors, and (c) they understand supernatural forces as driving natural forces, so that ecology and cosmology represent distinct sets of causes within a single explanatory framework. We expect that future cross-cultural analyses may find that this form of "integrative thinking" is common in unpredictable environments and is a cognitive strategy that accompanies economic diversification. (shrink)

Commentators agree that simple conclusions about a general base rate fallacy are not appropriate. It is more constructive to identify conditions under which base rates are differentially weighted. Commentators also agree that improving the ecological validity of the research is desirable, although this is less important to those interested exclusively in psychological processes. The philosophers and ecologists among the commentators offer a kinder perspective on base rate reasoning than the psychologists. My own perspective is that the interesting questions (both psychological (...) and normative/prescriptive) are best answered through empirical studies that use real-world performance standards. (shrink)

We have been oversold on the base rate fallacy in probabilistic judgment from an empirical, normative, and methodological standpoint. At the empirical level, a thorough examination of the base rate literature (including the famous lawyer–engineer problem) does not support the conventional wisdom that people routinely ignore base rates. Quite the contrary, the literature shows that base rates are almost always used and that their degree of use depends on task structure and representation. Specifically, base rates play a relatively larger role (...) in tasks where base rates are implicitly learned or can be represented in frequentist terms. Base rates are also used more when they are reliable and relatively more diagnostic than available individuating information. At the normative level, the base rate fallacy should be rejected because few tasks map unambiguously into the narrow framework that is held up as the standard of good decision making. Mechanical applications of Bayes's theorem to identify performance errors are inappropriate when (1) key assumptions of the model are either unchecked or grossly violated, and (2) no attempt is made to identify the decision maker's goals, values, and task assumptions. Methodologically, the current approach is criticized for its failure to consider how the ambiguous, unreliable, and unstable base rates of the real world are and should be used. Where decision makers' assumptions and goals vary, and where performance criteria are complex, the traditional Bayesian standard is insufficient. Even where predictive accuracy is the goal in commonly defined problems, there may be situations (e.g., informationally redundant environments) in which base rates can be ignored with impunity. A more ecologically valid research program is called for. This program should emphasize the development of prescriptive theory in rich, realistic decision environments. (shrink)

Base rates have no necessary relation to judgments that are not themselves probabilities. There is no logical imperative, for instance, that behavioral base rates must affect causal attributions or that base rate information should affect judgments of legal liability. Decision theorists should be cautious in arguing that base rates place normative constraints on judgments of anything other than posterior probabilities.

Abstract(1) The miscitations of seminal experiments in the base rate literature adds to the existing database of systematic miscitations of wellknown psychological experiments. These miscitations may be caused by a process of reconstructive remembering. (2) Representative design should be the methodological core of Koehler's call for ecologically valid research. This approach can benefit both basic and applied research.

Koehler's summary and critique of research on the base rate fallacy is cogent and persuasive. However, he may have overstated the case, and his suggestions for future research may be too restrictive. We agree that methodological approaches to this topic should be broadened, but we argue that experimental laboratory research and the Bayesian normative standard are useful and should not be abandoned.

This commentary presents a self-assessment inventory that will allow readers to determine their own attitude toward the base rate fallacy and its literature. The inventory is scientifically valid but not Medicare/Medicaid reimbursable.

When base rates are learned and used in an experiential manner subjects show better base rate use, perhaps because the implicit learning system is engaged. A causal framework in which base rates are relevant might also be necessary. Humans might thus perform better on more ecologically valid tasks, which are likely to contain those three components.

Base rates are vital in predicting violent criminal recidivism. However, both lay people given simulated prediction tasks and professionals milking real life predictions appear insensitive to variations in the base rate of violent recidivism. Although there are techniques to help decision makers attend to base rates, increased decision accuracy is better sought in improved actuarial models as opposed to improved clinicians.

Consistent with Koehler's position, we propose a generalization of the base rate fallacy and earlier conservatism literatures. In studies using both traditional tasks and new tasks based on ecologically valid base rates, our subjects typically underweight individuating information at least as much as they underweight base rates. The implications of cue consistency for averaging heuristics are discussed.

Koehler is right that base rate information is used, to various degrees, both in laboratory tasks and in everyday life. However, it is not time to turn our backs on laboratory tasks and focus solely on ecologically valid decision making. Tightly controlled experimental data are still needed to understandhowbase rate information is used, and how this varies among groups.

Any instance (i.e., event, behavior, trait) belongs to infinitely many reference classes, hence there are infinitely many base rates from which to choose. People clearly do not entertain all possible reference classes, however, so something must be limiting the search space. We suggest some possible mechanisms that determine which reference class is evoked for the purpose of judgment and decision.

The fallacy beneath the base rate fallacy is that we know what a base rate is. We talk as if base rates and individuating information were two different kinds of information. From a Bayesian perspective, however, the only difference between base rate and individuating information is – which comes first.

Koehler is right to argue for more nuanced interpretation of base rate anomalies. These anomalies are best understood in relation to a broader class of cognitive anomalies, which are important for theory and practice. Recognizing a need for more nuanced analysis should not be taken as a license for treating the effects as “explained away.”.

Koehler's target article attempts a balanced view of the relevance of knowledge of base rates to judgments of subjective or credal probability, but he is not sensitive enough to the difference between requiring and permitting the equation of probability judgments with base rates, the interaction between precision of base rate and reference class information, and the possibility of indeterminate probability judgment.

Two distinct issues are sometimes confused in the base rate literature: Why do people make logical mistakes in the assessment of probabilities? and why do subjects not use base rates the way experimenters do? The latter problem may often reflect differences in an implicit reference class rather than a disinclination to update a base rate by Bayes' theorem. Also important are considerations concerning the interaction of several potentially relevant base rates.

The underutilization of base rates is a consistent finding. The strong claim that base rates are ignored has been rejected and this needs no further emphasis. Following the path of “normal science,” research examines the conditions predicting changes in the degree of underutilization. A scientific revolution that might dethrone the heuristics and biases paradigm is not in sight.

Koehler's call for a reanalysis of the base rate fallacy is particularly important in the applied domain of accounting, since base rate data appear to be an important input for many accounting tasks. In this commentary I discuss the use of base rates in accounting and explain why more flexible standards of performance are important when judging the use of base rates.

This commentary discusses three points: (1) The implications of the fact that it is rational to ignore base rates if probabilities are estimated by frequencies from samples without missing data (natural sampling); (2) second order probabilities distributions are a plausible way to model imprecise probabilities; and (3) Bayesian networks represent a normative reference for multi-cue models of probabilistic inference.

Failure to consider base rate is regarded as potentially hazardous, mainly because its consideration is assumed to be determined solely by P(H/D), the probability of the individuating data if the hypothesis is true, and not at all by P(D/˜H), the probability if the hypothesis is false. However, when P(D/˜H) is unconfounded from P(D/H), it turns out to be the stronger determinant of base rate consideration.

Setting the two hypotheses of complete neglect and full use of base rates against each other is inappropriate. The proper question concerns the degree to which base rates are used (or neglected), and under what conditions. We outline alternative approaches and recommend regression analysis. Koehler's conclusion that we have been oversold on the base rate fallacy seems to be premature.

A recent study showed physicians' reasoning about a realistic case to be ignorant of base rate. It also showed physicians interpreting information pertinent to base rate differently, depending on whether it was presented early or late in the case. Although these adult reasoners might do better if given hints through talk of relative frequencies, this would not prove that they had no problem of base rate neglect.

The environment in which humans evolved is strongly and positively autocorrelated in space and time. Probabilistic judgments based on the assumption of independence may not yield evolutionarily adaptive behavior. A number of “faults” of human reasoning are not faulty under fuzzy arithmetic, a nonprobabilistic calculus of reasoning under uncertainty that may be closer to that underlying human decision making.

In contrast to traditional research on base-rate neglect, an ecologically-oriented research program would analyze the correspondence between cognitive algorithms and the nature of information in the environment. Bayesian computations turn out to be simpler when information is represented in frequency formats as opposed to the probability formats used in previous research. Frequency formats often enable even uninstructed subjects to perform Bayesian reasoning.

The base rate literature has an opposite twin in the social psychological literature on stereotypes, which concludes that people use their preexisting beliefs about probabilistic category attributes too much, rather than not enough. This ironic discrepancy arises because beliefs about category attributes enhance accuracy when the beliefs are accurate and diminish accuracy when they are not. To determine the accuracy of base rate/stereotype beliefs requires research that addresses specific content.

Abstract(1) There is enough contradictory evidence regarding the role of base rates in category learning to confirm the nonexistence of biases in such learning. (2) It is not always possible to activate statistical reasoning through frequentist representation. (3) It is necessary to use the concept of systematic processing in reconsidering the published work on biases.

The important question is how people process probabilistic information, not whether they process it in accordance with a normative model that we never should have expected them to be capable of following. Experience is not the cure, as widely thought, to problems with utilizing base rate information.

This volume reflects the development and theoretical foundation of a new paradigm for critical thinking based on inquiry. The field of critical thinking, as manifested in the Informal Logic movement, developed primarily as a response to the inadequacies of formalism to represent actual argumentative practice and to provide useful argumentative skills to students. Because of this, the primary focus of the field has been on informal arguments rather than formal reasoning. Yet the formalist history of the field is still evident (...) in its emphasis, with respect to both theory and pedagogy, on the structure and evaluation of individual, de-contextualized arguments. It is our view that such a view of critical thinking is excessively narrow and limited, failing to provide an understanding of argumentation as largely a matter of comparative evaluation of a variety of contending positions and arguments with the goal of reaching a reasoned judgment on an issue. As a consequence, traditional critical thinking instruction is problematic in failing to provide the reasoning skills that students need in order to accomplish this goal. Instead, the goal of critical thinking instruction has been seen largely as a defensive one: of learning to not fall prey to invalid, inadequate, or fallacious arguments. (shrink)

I argue for a soft compatibilist theory of free will, i.e., such that free will is compatible with both determinism and indeterminism, directly opposite hard incompatibilism, which holds free will incompatible both with determinism and indeterminism. My intuitions in this book are primarily based on an analysis of meditation, but my arguments are highly syncretic, deriving from many fields, including behaviorism, psychology, conditioning and deconditioning theory, philosophy of language, philosophy of mind, simulation theory, etc. I offer a causal/functional analysis of (...) meta-mental control, or 'metacausality', cashed out in counterfactual terms, to solve what I call the easy problem of free will. (shrink)

The public is largely innumerate, making systematic mistakes in estimating some politically relevant facts, such as the share of foreign-born citizens. In two-step or multistep flow models, such mistakes could be corrected if better-informed citizens were able to convince their peers, in particular by using good arguments citing reliable sources. In six experiments, we find two issues that dampen the potential power of this two-step flow process. First, even though participants were more convinced by good than by poor arguments, many (...) did not change their minds, even when confronted with good arguments. Second, participants are not inclined to spontaneously generate arguments that cite reliable sources, even when they have just been influenced by such arguments. Both issues should put a significant brake in the spread of political numeracy through the two-step flow process, in particular in non-dialogic contexts. (shrink)

According to normative decision theory there exists a principle of procedure invariance which states that a decision maker's preference order should remain the same, independently of which response mode is used. For example, the decision maker should express the same preference independently of whether he or she has to judge or decide. Nevertheless, previous research in behavioral decision making has suggested that judgments and choices yield different preference orders in both the risky and the riskless domain. In the latter, the (...) prominence effect has been demonstrated. The main purpose of the present series of experiments was to test cognitive explanations which account for the prominence effect. One of the explanations provided a psychological account based primarily on decision-strategy compatibility. Two other explanations built on information structuring approaches. In the first one, the general idea was that decision makers differentiate between alternatives by value and belief restructuring. In the second approach, violations of invariance were assumed to be attributed to the information structure of the task which in many cases demand problem simplification. A prominence effect was in most experiments found for both choices and preference ratings. This finding spöke against the strategy compatibility explanation. Instead, the different forms of cognitive restructuring provided a better account. However, none of these provided a single explanation. Yet, the structure compatibility explanation appeared to be the more viable one, in particular of the relation between experimentäl manipulations and response mode outcomes. The predictions of the value-belief restructuring explanation, on the other hand, seemed to be more valid for the prominence effect found in choice than for preference ratings. (shrink)

Hoyningen-Huene develops an account of what science is, distinguishing it from common sense. According to Hoyningen-Huene, the key distinguishing feature is that science is more systematic. He identifies nine ways in which science is more systematic than common sense. I compare Hoyningen-Huene’s view to a view I refer to as the “Continuity Thesis.” The Continuity Thesis states that scientific knowledge is just an extension of common sense. This thesis is associated with Quine, Planck, and others. I argue that Hoyningen-Huene ultimately (...) rejects the Continuity Thesis, and I present further evidence to show that the Continuity Thesis is false. I also argue that it is the systematicity of science that ultimately grounds the epistemic authority of science. Hoyningen-Huene thus draws attention to an important feature of science that explains the place of science in contemporary society. (shrink)

Words such as selfish and altruistic that describe conduct toward self and others are notoriously ambiguous in everyday language. I argue that the ambiguity is caused, in part, by the coexistence of multiple belief systems that use the same words in different ways. Each belief system is a relatively coherent linguistic entity that provides a guide for human behavior. It is therefore a functional entity with design features that dictate specific word meaning. Since different belief systems guide human behavior in (...) different directions, specific word meanings cannot be maintained across belief systems. Other sources of linguistic ambiguity include i) functional ambiguity that increases the effectiveness of a belief system, ii) ambiguity between belief systems that are functionally identical but historically distinct, and iii) active interference between belief systems. I illustrate these points with a natural history study of the word selfish and related words in everyday language. In general, language and the thought that it represents should be studied in the same way that ecologists study multi-species communities. (shrink)