Bayesian approaches to human cognition have been extensively advocated in the last decades, but sharp objections have been raised too within cognitive science. In this paper, we outline a diagnosis of what has gone wrong with the prevalent strand of Bayesian cognitive science (here labelled pure Bayesian cognitive science), relying on selected illustrations from the psychology of reasoning and tools from the philosophy of science. Bayesians’ reliance on so-called method of rational analysis is a key point of our discussion. We (...) tentatively conclude on a constructive note, though: an appropriately modified variant of Bayesian cognitive science can still be coherently pursued, as some scholars have noted. (shrink)

This essay addresses the methodology of philosophy of science and illustrates how formal and empirical methods can be fruitfully combined. Special emphasis is given to the application of experimental methods to confirmation theory and to recent work on the conjunction fallacy, a key topic in the rationality debate arising from research in cognitive psychology. Several other issue can be studied in this way. In the concluding section, a brief outline is provided of three further examples.

It has been reported as a robust effect that people are likely to select a matching case in the Wason selection task. For example, they usually select the 5 case, in the Wason selection task with the conditional "if an E, then a not-5". This was explained by the matching bias account that people are likely to regard a matching case as relevant to the truth of the conditional (Evans, 1998). However, because a positive concept usually constructs a smaller set (...) than its negative one does (a rarity assumption), it is more effective to get information on the truth of the conditional in a positive set than in a negative set. Thus the optimal data selection account can also explain the effect. The set size of Q and matching by introducing negation were manipulated independently in four experiments. From the results it was inferred that the so-called matching bias was an amalgam of two different cognitive components-relevance judgement by matching and optimal data selection. (shrink)

In two experiments, we investigated the relationship between confidence and accuracy in syllogistic reasoning. Participants judged the validity of conclusions and provided confidence ratings twice for each problem: once quickly and again after further deliberation. Correlations between confidence and accuracy were small or nonexistent. In addition, confidence and accuracy were mediated by different variables. Confidence judgments appeared to reflect external cues, so that confidence was greater when the participants were allowed additional time to think about the problem, as well as (...) when the conclusion was either believable or unbelievable, rather than neutral. In contrast, accuracy changed little as a function of the amount of time available and did not differ for believable and neutral problems. These data support a model in which initial decisions are made quickly, on the basis of heuristic cues, and analytic processes are used to justify or rationalize the earlier decision. (shrink)

Severity of Test (SoT) is an alternative to Popper's logical falsification that solves a number of problems of the logical view. It was presented by Popper himself in 1963. SoT is a less sophisticated probabilistic model of hypothesis testing than Oaksford & Chater's (O&C's) information gain model, but it has a number of striking similarities. Moreover, it captures the intuition of everyday hypothesis testing.

Oaksford and Chater (1994) proposed to analyse the Wason selection task as an inductive instead of a deductive task. Applying Bayesian statistics, they concluded that the cards that participants tend to select are those with the highest expected information gain. Therefore, their choices seem rational from the perspective of optimal data selection. We tested a central prediction from the theory in three experiments: card selection frequencies should be sensitive to the subjective probability of occurrence for individual cards. In Experiment 1, (...) expected frequencies of the p- and the q-card were manipulated independently by concepts referring to large vs. small sets. Although the manipulation had an effect on card selection frequencies, there was only a weak correlation between the predicted and the observed patterns. In the second experiment, relative frequencies of individual cards were manipulated more directly by explicit frequency information. In addition, participants estimated probabilities for the four logical cases and of the conditional statement itself. The experimental manipulations strongly affected the probability estimates, but were completely unrelated to card selections. This result was replicated in a third experiment. We conclude that our data provide little support for optimal data selection theory. (shrink)

A recent development in the cognitive science of reasoning has been the emergence of a probabilistic approach to the behaviour observed on ostensibly logical tasks. According to this approach the errors and biases documented on these tasks occur because people import their everyday uncertain reasoning strategies into the laboratory. Consequently participants' apparently irrational behaviour is the result of comparing it with an inappropriate logical standard. In this article, we contrast the probabilistic approach with other approaches to explaining rationality, and then (...) show how it has been applied to three main areas of logical reasoning: conditional inference, Wason's selection task and syllogistic reasoning. (shrink)

Human cognition requires coping with a complex and uncertain world. This suggests that dealing with uncertainty may be the central challenge for human reasoning. In Bayesian Rationality we argue that probability theory, the calculus of uncertainty, is the right framework in which to understand everyday reasoning. We also argue that probability theory explains behavior, even on experimental tasks that have been designed to probe people's logical reasoning abilities. Most commentators agree on the centrality of uncertainty; some suggest that there is (...) a residual role for logic in understanding reasoning; and others put forward alternative formalisms for uncertain reasoning, or raise specific technical, methodological, or empirical challenges. In responding to these points, we aim to clarify the scope and limits of probability and logic in cognitive science; explore the meaning of the explanation of cognition; and re-evaluate the empirical case for Bayesian rationality. (shrink)

Four experiments investigated the effects of probability manipulations on the indicative four card selection task (Wason, 1966, 1968). All looked at the effects of high and low probability antecedents (p) and consequents (q) on participants' data selections when determining the truth or falsity of a conditional rule, if p then q . Experiments 1 and 2 also manipulated believability. In Experiment 1, 128 participants performed the task using rules with varied contents pretested for probability of occurrence. Probabilistic effects were observed (...) which were partly consistent with some probabilistic accounts but not with non-probabilistic approaches to selection task performance. No effects of believability were observed, a finding replicated in Experiment 2 which used 80 participants with standardised and familiar contents. Some effects in this experiment appeared inconsistent with existing probabilistic approaches. To avoid possible effects of content, Experiments 3 (48 participants) and 4 (20 participants) used abstract material. Both experiments revealed probabilistic effects. In the Discussion we examine the compatibility of these results with the various models of selection task performance. (shrink)

According to Aristotle, humans are the rational animal. The borderline between rationality and irrationality is fundamental to many aspects of human life including the law, mental health, and language interpretation. But what is it to be rational? One answer, deeply embedded in the Western intellectual tradition since ancient Greece, is that rationality concerns reasoning according to the rules of logic – the formal theory that specifies the inferential connections that hold with certainty between propositions. Piaget viewed logical reasoning as defining (...) the end-point of cognitive development; and contemporary psychology of reasoning has focussed on comparing human reasoning against logical standards. (shrink)

This paper addresses the apparent mismatch between the normative and descriptive literatures in the cognitive science of conditional reasoning. Descriptive psychological theories still regard material implication as the normative theory of the conditional. However, over the last 20 years in the philosophy of language and logic the idea that material implication can account for everyday indicative conditionals has been subject to severe criticism. The majority view is now apparently in favour of a subjective conditional probability interpretation. A comparative model fitting (...) exercise is presented that shows that a conditional probability model can explain as much of the data on abstract indicative conditional reasoning tasks as psychological theories that supplement material implication with various rationally unjustified processing assumptions. Consequently, when people are asked to solve laboratory reasoning tasks, they can be seen as simply generalising their everyday probabilistic reasoning strategies to this novel context. (shrink)

Participants attempted to solve a modified version of Wason's selection task. Variables were: sizes of the sets referenced by a specified assertion, form of the assertion, thematic content of the assertion, and the need for sampling or not. In Experiment 1, participants were given enough information to determine the truth or falsity of the specified assertion with certainty; in Experiment 2, they had to rely on sampling and could not determine the assertion's truth or falsity with certainty. Performance was better (...) in Experiment 1 than in Experiment 2, but in both cases much better than what is typically obtained with the conventional selection task. The results support the hypothesis that performance of the selection task is sensitive to the sizes of the sets involved, add credence to the conclusion that framing the task in a thematically meaningful way can facilitate performance, and demonstrate that facilitation does not require deontic reasoning or a well-known convention being involved. The relationship between expressed confidence and level of performance is consistent with other studies showing the former to be a good predictor of the latter. (shrink)

This paper addresses the apparent mismatch between the normative and descriptive literatures in the cognitive science of conditional reasoning. Descriptive psychological theories still regard material implication as the normative theory of the conditional. However, over the last 20 years in the philosophy of language and logic the idea that material implication can account for everyday indicative conditionals has been subject to severe criticism. The majority view is now apparently in favour of a subjective conditional probability interpretation. A comparative model fitting (...) exercise is presented that shows that a conditional probability model can explain as much of the data on abstract indicative conditional reasoning tasks as psychological theories that supplement material implication with various rationally unjustified processing assumptions. Consequently, when people are asked to solve laboratory reasoning tasks, they can be seen as simply generalising their everyday probabilistic reasoning strategies to this novel context. (shrink)

The authors outline a theory of conditionals of the form If A then C and If A then possibly C. The 2 sorts of conditional have separate core meanings that refer to sets of possibilities. Knowledge, pragmatics, and semantics can modulate these meanings. Modulation can add information about temporal and other relations between antecedent and consequent. It can also prevent the construction of possibilities to yield 10 distinct sets of possibilities to which conditionals can refer. The mental representation of a (...) conditional normally makes explicit only the possibilities in which its antecedent is true, yielding other possibilities implicitly. Reasoners tend to focus on the explicit possibilities. The theory predicts the major phenomena of understanding and reasoning with conditionals. (shrink)

In this article, 41 models of covariation detection from 2 × 2 contingency tables were evaluated against past data in the literature and against data from new experiments. A new model was also included based on a limiting case of the normative phi‐coefficient under an extreme rarity assumption, which has been shown to be an important factor in covariation detection (McKenzie & Mikkelsen, 2007) and data selection (Hattori, 2002; Oaksford & Chater, 1994, 2003). The results were supportive of the new (...) model. To investigate its explanatory adequacy, a rational analysis using two computer simulations was conducted. These simulations revealed the environmental conditions and the memory restrictions under which the new model best approximates the normative model of covariation detection in these tasks. They thus demonstrated the adaptive rationality of the new model. (shrink)

Two experiments using a realistic version of the selection task examined the relationship between participants' probability estimates of finding a counter example and their selections. Experiment 1 used everyday categories in the context of a scenario to determine whether or not the number of instances in a category affected the estimated probability of a counter-example. Experiment 2 modified the scenario in order to alter participants' estimates of finding a specific counter-example. Unlike Kirby 1994a, but consistent with his proposals, both studies (...) showed that probability estimates significantly predicted selection. Overall results point to the value of understanding selections in terms of their subjective expected utility. (shrink)

The (recent, Bayesian) cognitive science literature on The Wason Task (WT) has been modeled largely after the (not-so-recent, Bayesian) philosophy of science literature on The Paradox of Confirmation (POC). In this paper, we apply some insights from more recent Bayesian approaches to the (POC) to analogous models of (WT). This involves, first, retracing the history of the (POC), and, then, reexamining the (WT) with these historico-philosophical insights in mind.

Yama (2001) has presented an ingenious series of experiments in which he attempts to separate two accounts in the literature of the cause of "matching bias" in conditional reasoning. One account is that the bias arises from the way in which people process negations and the other is that it is due to the larger set sizes associated with negative propositions, rather than negation per se . Yama's experiments show influences of both negation and set size, from which he concludes (...) that both factors contribute to the matching bias that is normally observed. In this note, it is argued that this conclusion is at odds with other findings in the literature, particularly those investigating implicit negation as the cause of the bias. Introducing explicit negations has been shown to remove matching bias completely and not partially, as Yama's account must predict. A possible reconciliation is proposed in terms of subtle contextual differences introduced by Yama's experiments. (shrink)

Individual differences in performance on a variety of selection tasks were examined in three studies employing over 800 participants. Nondeontic tasks were solved disproportionately by individuals of higher cognitive ability. In contrast, responses on two deontic tasks that have shown robust performance facilitationthe Drinking-age Problem and the Sears Problem-were unrelated to cognitive ability. Performance on deontic and nondeontic tasks was consistently associated. Individuals in the correct/correct cell of the bivariate performance matrix were over-represented. That is, individuals giving the modal response (...) on a nondeontic task (P and Q) were significantly less likely to give the modal response on a deontic task (P and not-Q) than were individuals who made the non-modal P and not-Q selection on nondeontic problems. The implications of the results are discussed within the heuristic-analytic framework of Evans (1996; Evans & Over, 1996) and the optimal data selection model of Oaksford and Chater (1994). (shrink)