According to Aristotle, humans are the rational animal. The borderline between rationality and irrationality is fundamental to many aspects of human life including the law, mental health, and language interpretation. But what is it to be rational? One answer, deeply embedded in the Western intellectual tradition since ancient Greece, is that rationality concerns reasoning according to the rules of logic – the formal theory that specifies the inferential connections that hold with certainty between propositions. Piaget viewed logical reasoning as defining (...) the end-point of cognitive development; and contemporary psychology of reasoning has focussed on comparing human reasoning against logical standards. (shrink)

Human cognition requires coping with a complex and uncertain world. This suggests that dealing with uncertainty may be the central challenge for human reasoning. In Bayesian Rationality we argue that probability theory, the calculus of uncertainty, is the right framework in which to understand everyday reasoning. We also argue that probability theory explains behavior, even on experimental tasks that have been designed to probe people's logical reasoning abilities. Most commentators agree on the centrality of uncertainty; some suggest that there is (...) a residual role for logic in understanding reasoning; and others put forward alternative formalisms for uncertain reasoning, or raise specific technical, methodological, or empirical challenges. In responding to these points, we aim to clarify the scope and limits of probability and logic in cognitive science; explore the meaning of the explanation of cognition; and re-evaluate the empirical case for Bayesian rationality. (shrink)

Severity of Test (SoT) is an alternative to Popper's logical falsification that solves a number of problems of the logical view. It was presented by Popper himself in 1963. SoT is a less sophisticated probabilistic model of hypothesis testing than Oaksford & Chater's (O&C's) information gain model, but it has a number of striking similarities. Moreover, it captures the intuition of everyday hypothesis testing.

Four experiments investigated the effects of probability manipulations on the indicative four card selection task (Wason, 1966, 1968). All looked at the effects of high and low probability antecedents (p) and consequents (q) on participants' data selections when determining the truth or falsity of a conditional rule, if p then q . Experiments 1 and 2 also manipulated believability. In Experiment 1, 128 participants performed the task using rules with varied contents pretested for probability of occurrence. Probabilistic effects were observed (...) which were partly consistent with some probabilistic accounts but not with non-probabilistic approaches to selection task performance. No effects of believability were observed, a finding replicated in Experiment 2 which used 80 participants with standardised and familiar contents. Some effects in this experiment appeared inconsistent with existing probabilistic approaches. To avoid possible effects of content, Experiments 3 (48 participants) and 4 (20 participants) used abstract material. Both experiments revealed probabilistic effects. In the Discussion we examine the compatibility of these results with the various models of selection task performance. (shrink)

Oaksford and Chater (1994) proposed to analyse the Wason selection task as an inductive instead of a deductive task. Applying Bayesian statistics, they concluded that the cards that participants tend to select are those with the highest expected information gain. Therefore, their choices seem rational from the perspective of optimal data selection. We tested a central prediction from the theory in three experiments: card selection frequencies should be sensitive to the subjective probability of occurrence for individual cards. In Experiment 1, (...) expected frequencies of the p- and the q-card were manipulated independently by concepts referring to large vs. small sets. Although the manipulation had an effect on card selection frequencies, there was only a weak correlation between the predicted and the observed patterns. In the second experiment, relative frequencies of individual cards were manipulated more directly by explicit frequency information. In addition, participants estimated probabilities for the four logical cases and of the conditional statement itself. The experimental manipulations strongly affected the probability estimates, but were completely unrelated to card selections. This result was replicated in a third experiment. We conclude that our data provide little support for optimal data selection theory. (shrink)

Reasoning about social groups and their associated markers was investigated as a particular case of human reasoning about cue-category relationships. Assertions that reasoning involving cues and associated categories elicits specific probabilistic assumptions are supported by the results of three experiments. This phenomenon remains intact across the use of categorical syllogisms, conditional syllogisms, and the use of social groups that vary in their perceived cohesiveness, or entitativity. Implications are discussed for various theories of reasoning, and additional aspects of social group/coalitional reasoning (...) are also discussed. (shrink)

The authors outline a theory of conditionals of the form If A then C and If A then possibly C. The 2 sorts of conditional have separate core meanings that refer to sets of possibilities. Knowledge, pragmatics, and semantics can modulate these meanings. Modulation can add information about temporal and other relations between antecedent and consequent. It can also prevent the construction of possibilities to yield 10 distinct sets of possibilities to which conditionals can refer. The mental representation of a (...) conditional normally makes explicit only the possibilities in which its antecedent is true, yielding other possibilities implicitly. Reasoners tend to focus on the explicit possibilities. The theory predicts the major phenomena of understanding and reasoning with conditionals. (shrink)

It is a commonplace that contemplation of an imaginary particular may have cognitive and motivational effects that differ from those evoked by an abstract description of an otherwise similar state of affairs. In his Treatise on Human Nature, Hume ([1739] 1978) writes forcefully of this.

Rational analysis (Anderson 1990, 1991a) is an empiricalprogram of attempting to explain why the cognitive system isadaptive, with respect to its goals and the structure of itsenvironment. We argue that rational analysis has two importantimplications for philosophical debate concerning rationality. First,rational analysis provides a model for the relationship betweenformal principles of rationality (such as probability or decisiontheory) and everyday rationality, in the sense of successfulthought and action in daily life. Second, applying the program ofrational analysis to research on human reasoning (...) leads to a radicalreinterpretation of empirical results which are typically viewed asdemonstrating human irrationality. (shrink)

Participants attempted to solve a modified version of Wason's selection task. Variables were: sizes of the sets referenced by a specified assertion, form of the assertion, thematic content of the assertion, and the need for sampling or not. In Experiment 1, participants were given enough information to determine the truth or falsity of the specified assertion with certainty; in Experiment 2, they had to rely on sampling and could not determine the assertion's truth or falsity with certainty. Performance was better (...) in Experiment 1 than in Experiment 2, but in both cases much better than what is typically obtained with the conventional selection task. The results support the hypothesis that performance of the selection task is sensitive to the sizes of the sets involved, add credence to the conclusion that framing the task in a thematically meaningful way can facilitate performance, and demonstrate that facilitation does not require deontic reasoning or a well-known convention being involved. The relationship between expressed confidence and level of performance is consistent with other studies showing the former to be a good predictor of the latter. (shrink)

Two experiments using a realistic version of the selection task examined the relationship between participants' probability estimates of finding a counter example and their selections. Experiment 1 used everyday categories in the context of a scenario to determine whether or not the number of instances in a category affected the estimated probability of a counter-example. Experiment 2 modified the scenario in order to alter participants' estimates of finding a specific counter-example. Unlike Kirby 1994a, but consistent with his proposals, both studies (...) showed that probability estimates significantly predicted selection. Overall results point to the value of understanding selections in terms of their subjective expected utility. (shrink)

In this paper we argue that it is often adaptive to use one's background beliefs when interpreting information that, from a normative point of view, is incomplete. In both of the experiments reported here participants were presented with an item possessing two features and were asked to judge, in the light of some evidence concerning the features, to which of two categories it was more likely that the item belonged. It was found that when participants received evidence relevant to just (...) one of these hypothesised categories they used their background beliefs to interpret this information. In Experiment 2, on the other hand, participants behaved in a broadly Bayesian manner when the evidence they received constituted a completed likelihood ratio. We discuss the circumstances under which participants, when making their judgements, consider the alternative hypothesis. We conclude with a discussion of the implications of our results for an understanding of hypothesis testing, belief revision, and categorisation. (shrink)

Yama (2001) has presented an ingenious series of experiments in which he attempts to separate two accounts in the literature of the cause of "matching bias" in conditional reasoning. One account is that the bias arises from the way in which people process negations and the other is that it is due to the larger set sizes associated with negative propositions, rather than negation per se . Yama's experiments show influences of both negation and set size, from which he concludes (...) that both factors contribute to the matching bias that is normally observed. In this note, it is argued that this conclusion is at odds with other findings in the literature, particularly those investigating implicit negation as the cause of the bias. Introducing explicit negations has been shown to remove matching bias completely and not partially, as Yama's account must predict. A possible reconciliation is proposed in terms of subtle contextual differences introduced by Yama's experiments. (shrink)

Individual differences in performance on a variety of selection tasks were examined in three studies employing over 800 participants. Nondeontic tasks were solved disproportionately by individuals of higher cognitive ability. In contrast, responses on two deontic tasks that have shown robust performance facilitationthe Drinking-age Problem and the Sears Problem-were unrelated to cognitive ability. Performance on deontic and nondeontic tasks was consistently associated. Individuals in the correct/correct cell of the bivariate performance matrix were over-represented. That is, individuals giving the modal response (...) on a nondeontic task (P and Q) were significantly less likely to give the modal response on a deontic task (P and not-Q) than were individuals who made the non-modal P and not-Q selection on nondeontic problems. The implications of the results are discussed within the heuristic-analytic framework of Evans (1996; Evans & Over, 1996) and the optimal data selection model of Oaksford and Chater (1994). (shrink)

Cummins (this issue) puts the case for an innate module for deontic reasoning. We argue that this case is not persuasive. First, we claim that Cummins’evolutionary arguments are neutral regarding whether deontic reasoning is learned or innate. Second, we argue that task differences between deontic and indicative reasoning explain many of the phenomena that Cummins takes as evidence for a deontic module. Third, we argue against the suggestion that deontic reasoning is superior to indicative reasoning, either in adults or children. (...) Finally, we re‐evaluate Cummins’interpretation of differences in children's performance on deontic and indicative versions of Wason's selection task. (shrink)

In his commentary, Oaksford makes two main claims: (1) that the externalisation method used by Green, Over, and Pyne (1997) enforces the correlation observed between probability estimates and selection, and (2) that these estimates support the prediction of a downward revision of P(p) when P(p) > P(q). In this reply, we rebut claim 1 by describing the instructions more comprehensively, and claim 2 by reiterating the importance of making certain theoretical distinctions which Oaksford does not make. Our interest is the (...) psychological process of reaching decision: externalisation methods provide a means of exploring this process and of assessing the value of Bayesian approaches. (shrink)

It has been reported as a robust effect that people are likely to select a matching case in the Wason selection task. For example, they usually select the 5 case, in the Wason selection task with the conditional "if an E, then a not-5". This was explained by the matching bias account that people are likely to regard a matching case as relevant to the truth of the conditional (Evans, 1998). However, because a positive concept usually constructs a smaller set (...) than its negative one does (a rarity assumption), it is more effective to get information on the truth of the conditional in a positive set than in a negative set. Thus the optimal data selection account can also explain the effect. The set size of Q and matching by introducing negation were manipulated independently in four experiments. From the results it was inferred that the so-called matching bias was an amalgam of two different cognitive components-relevance judgement by matching and optimal data selection. (shrink)

Hempel's paradox of the ravens has to do with the question of what constitutes confirmation from a logical point of view; Wason 's selection task has been used extensively to investigate how people go about attempting to confirm or disconfirm conditional claims. This paper presents an argument that the paradox is resolved, and that people's typical performance in the selection task can be explained, by consideration of what constitutes an effective strategy for seeking evidence of the tenability of universal or (...) conditional claims in everyday life. (shrink)

Green, Over, and Pyne's (1997) paper (hereafter referred to as ''GOP") seems to provide a novel approach to examining probabilistic effects in Wason's selection task. However, in this comment, it is argued that their chosen experimental paradigm confounds most of their results. The task demands of the externalisation procedure (Green, 1995) enforce a correlation between card selections and the probability of finding a counterexample, which was the main finding of GOP's experiments. Consequently GOP cannot argue that their data support Kirby's (...) (1994) proposal that people's normal strategy in the selection task is to seek falsifying evidence. Despite this methodological problem, effects of the probability of the antecedent ( p ) of a conditional rule, if p then q , predicted by Kirby (1994) and by Oaksford and Chater (1994) were observed, although they were inconsistent between Experiments 1 and 2. Moreover, the probability estimates that GOP collected, which are not vulnerable to that methodological criticism, do support the idea that when P ( p ) > P ( q ), participants revise P ( p ) down as suggested by Oaksford and Chater (1994). (shrink)

Two experiments are reported that employed think-aloud methods to test predictions concerning relevance effects and rationalisation processes derivable from Evans' (1996) heuristic-analytic theory of the selection task. Evans' account proposes that card selections are triggered by relevance-determining heuristics, with analytic processing serving merely to rationalise heuristically cued decisions. As such, selected cards should be associated with more references to both their facing and their hidden sides than rejected cards, which are not subjected to analytic rationalisation. Experiment 1 used a standard (...) selection-task paradigm, with negative components permuted through abstract conditional rules. Support was found for all heuristic-analytic predictions. This evidence was shown to be robust in Experiment 2, where "select - don't select" decisions were enforced for all cards. Both experiments also clarify the role played by secondary heuristics in cueing the consideration of hidden card values during rationalisation. We suggest that whilst Evans' heuristic-analytic model and Oaksford and Chater's (e.g., 2003) optimal data selection model can provide compelling accounts of our protocol findings, the mental models theory fares less well as an explanation of our full dataset. (shrink)

Modern logic provides accounts of both interpretation and derivation which work together to provide abstract frameworks for modelling the sensitivity of human reasoning to task, context and content. Cognitive theories have underplayed the importance of interpretative processes. We illustrate, using Wason's [Q. J. Exp. Psychol. 20 (1968) 273] selection task, how better empirical cognitive investigations and theories can be built directly on logical accounts when this imbalance is redressed. Subjects quite reasonably experience great difficulty in assigning logical form to descriptively (...) interpreted rules in this task and materials, though not to deontically interpreted ones. The main empirical contrasts in reasoning performance are precisely between these interpretations, so better semantic theory can explain the main empirical effects. However, a more adequate notion of logical form than that typically employed in the psychology of reasoning is required, and we offer a richer alternative. Prima facie evidence that subjects do in fact experience the predicted difficulties in interpreting descriptive materials is provided by analyses of socratic tutoring dialogues. Experimental verification that these difficulties do in fact affect subjects' performance in the standard task is provided by six novel experimental conditions each designed to test different aspects of the semantic predictions. The results bear out the predictions. The semantic distinction between descriptive and deontic rules interacts with the task specifics to provide powerful generalisations about reasoning which surface in detailed explanations of many disparate observations. We conclude that semantic analyses have more direct benefits for psychological investigation than is usually credited, and conversely, that the extraordinary pragmatic circumstances of psychological experiments yield much thought provoking data for semantic analysis. © 2004 Cognitive Science Society, Inc. All rights reserved.Subjects quite reasonably experience great difficulty in assigning logical form to descriptively interpreted rules in this task and materials, though not to deontically interpreted ones. The main empirical contracts in reasoning performance are precisely between these interpretatins, so better semantic theory can explain the main empirical effects. Howevers, a more adequate nation of logical from than that typically employed in the psychology of reasoning in required, and we offer a richer alternative.Prima facie evidence that subjects do in fact experience the predicted difficulties in interpreting descriptive materials is provided by analyses of socratic tutoring dialogues. Experimental verification that these difficulties do in fact affect subjects' performance in the standard task is provided by six novel experimental conditions each designed to test different aspects of the semantic predications.The resluts bear out the predictions. The semantic distinction between descriptive and deontic rules interacts with the task specifics to provide powerful generalisations about reasoning which surface in detailed explanations of many disparate observations. We conclude that semantic analyses have more direct benefits for psychological investigation than is usually credited, and conversely, that the extraordinary pragmatic circumstances of psychological experiments yield much thought provoking data for semantic analysis. (shrink)

Three experiments investigated the contrasting predictions of the evolutionary and decision-theoretic approaches to deontic reasoning. Two experiments embedded a hazard management (HM) rule in a social contract scenario that should lead to competition between innate modules. A 3rd experiment used a pure HM task. Threatening material was also introduced into the antecedent, p, of a deontic rule, if p then must q. According to the evolutionary approach, more HM responses (Cosmides & Tooby, 2000) are predicted when p is threatening, whereas (...) decision theory predicts fewer. All 3 experiments were consistent with decision theory. Other theories are discussed, and it is concluded that they cannot account for the behavior observed in these experiments. (shrink)