The Cognitive Reflection Test is a widely used measure of the degree to which individuals override an intuitive response and engage in reflection. For both theoretical and practical reasons, it is widely taken to assess an important component of rational thought. In this paper, I will argue that while doing well on the CRT requires valuable cognitive capacities and dispositions, doing badly does not always indicate a lack of such capacities and dispositions. The CRT, I argue, offers respondents implicit (but (...) misleading) testimony: some of those who do badly do so due to a stronger disposition to defer to testimony. Since deference is not irrational, those who do badly need not be irrational, not even in part. (shrink)

Both scientists and children make important structural discoveries, yet their computational underpinnings are not well understood. Structure discovery has previously been formalized as probabilistic inference about the right structural form—where form could be a tree, ring, chain, grid, etc.. Although this approach can learn intuitive organizations, including a tree for animals and a ring for the color circle, it assumes a strong inductive bias that considers only these particular forms, and each form is explicitly provided as initial knowledge. Here we (...) introduce a new computational model of how organizing structure can be discovered, utilizing a broad hypothesis space with a preference for sparse connectivity. Given that the inductive bias is more general, the model's initial knowledge shows little qualitative resemblance to some of the discoveries it supports. As a consequence, the model can also learn complex structures for domains that lack intuitive description, as well as predict human property induction judgments without explicit structural forms. By allowing form to emerge from sparsity, our approach clarifies how both the richness and flexibility of human conceptual organization can coexist. (shrink)

Dual-process theories of conditional reasoning predict that relationships among four basic logical forms, and to intellectual ability and thinking predictions, are most evident when conflict arises between experiential and analytic processing (e.g., Stanovich & West, 2000). To test these predictions, 210 undergraduates were presented with conditionals for which the consequents were either weakly or strongly associated with alternative antecedents (i.e., WA and SA problems, respectively). Consistent with predictions, modus ponens inferences were not related to inferences on the uncertain forms (affirmation (...) of the consequent, denial of the antecedent). On WA problems, modus tollens, affirmation of the consequent, and denial of the antecedent were related to each other and to verbal ability. Modus ponens was linked to verbal ability only when disabling conditions were activated. In accord with the predictions of Stanovich and West (2000), on most problems, thinking dispositions predicted variance in inferences independently from verbal ability. We argue that a largely automatic experiential processing system governs performance on modus ponens, unless disablers are activated. Consciously controlled analytic processing predominates on the uncertain forms and, under some conditions, on modus tollens. (shrink)

This paper addresses a common challenge with computational cognitive models: identifying parameter values that are both theoretically plausible and generate predictions that match well with empirical data. While computational models can offer deep explanations of cognition, they are computationally complex and often out of reach of traditional parameter fitting methods. Weak methodology may lead to premature rejection of valid models or to acceptance of models that might otherwise be falsified. Mathematically robust fitting methods are, therefore, essential to the progress of (...) computational modeling in cognitive science. In this article, we investigate the capability and role of modern fitting methods—including Bayesian optimization and approximate Bayesian computation—and contrast them to some more commonly used methods: grid search and Nelder–Mead optimization. Our investigation consists of a reanalysis of the fitting of two previous computational models: an Adaptive Control of Thought—Rational model of skill acquisition and a computational rationality model of visual search. The results contrast the efficiency and informativeness of the methods. A key advantage of the Bayesian methods is the ability to estimate the uncertainty of fitted parameter values. We conclude that approximate Bayesian computation is (a) efficient, (b) informative, and (c) offers a path to reproducible results. (shrink)

An experiment is reported which tests for positive confirmation bias in a setting in which individuals choose what information to buy, prior to making a decision. The design – an adaptation of Wason's selection task – reveals the use that subjects make of information after buying it. Strong evidence of positive confirmation bias, in both information acquisition and information use, is found; and this bias is found to be robust to experience. It is suggested that the bias results from a (...) pattern of reasoning which, although producing sub-optimal decisions, is internally coherent and which is self-reinforcing. (shrink)

The prominence of Bayesian modeling of cognition has increased recently largely because of mathematical advances in specifying and deriving predictions from complex probabilistic models. Much of this research aims to demonstrate that cognitive behavior can be explained from rational principles alone, without recourse to psychological or neurological processes and representations. We note commonalities between this rational approach and other movements in psychology – namely, Behaviorism and evolutionary psychology – that set aside mechanistic explanations or make use of optimality assumptions. Through (...) these comparisons, we identify a number of challenges that limit the rational program's potential contribution to psychological theory. Specifically, rational Bayesian models are significantly unconstrained, both because they are uninformed by a wide range of process-level data and because their assumptions about the environment are generally not grounded in empirical measurement. The psychological implications of most Bayesian models are also unclear. Bayesian inference itself is conceptually trivial, but strong assumptions are often embedded in the hypothesis sets and the approximation algorithms used to derive model predictions, without a clear delineation between psychological commitments and implementational details. Comparing multiple Bayesian models of the same task is rare, as is the realization that many Bayesian models recapitulate existing (mechanistic level) theories. Despite the expressive power of current Bayesian models, we argue they must be developed in conjunction with mechanistic considerations to offer substantive explanations of cognition. We lay out several means for such an integration, which take into account the representations on which Bayesian inference operates, as well as the algorithms and heuristics that carry it out. We argue this unification will better facilitate lasting contributions to psychological theory, avoiding the pitfalls that have plagued previous theoretical movements. (shrink)

Knauff and Gazzo Castañeda (this issue) critique the "new paradigm" – a framework that replaces logic with probabilities – on the grounds that there existed no "old” paradigm for it to supplant. Their position is supported by the large numbers of theories that theorists developed to explain the Wason selection task, syllogisms, and other tasks. We propose some measures to inhibit such facile theorizing, which threatens the viability of cognitive science. We show that robust results exist contrary to the new (...) paradigm, and that it is unable to account for other results. (shrink)

This paper describes Peirce's systems of logic diagrams, focusing on the so-called ''existential'' graphs, which are equivalent to the first-order predicate calculus. It analyses their implications for the nature of mental representations, particularly mental models with which they have many characteristics in common. The graphs are intended to be iconic, i.e., to have a structure analogous to the structure of what they represent. They have emergent logical consequences and a single graph can capture all the different ways in which a (...) possibility can occur. Mental models share these properties. But, as the graphs show, certain aspects of propositions cannot be represented in an iconic or visualisable way. They include negation, and the representation of possibilities qua possibilities, which both require representations that do not depend on a perceptual modality. Peirce took his graphs to reveal the fundamental operations of reasoning, and the paper concludes with an analysis of different hypotheses about these operations. (shrink)

The authors outline a theory of conditionals of the form If A then C and If A then possibly C. The 2 sorts of conditional have separate core meanings that refer to sets of possibilities. Knowledge, pragmatics, and semantics can modulate these meanings. Modulation can add information about temporal and other relations between antecedent and consequent. It can also prevent the construction of possibilities to yield 10 distinct sets of possibilities to which conditionals can refer. The mental representation of a (...) conditional normally makes explicit only the possibilities in which its antecedent is true, yielding other possibilities implicitly. Reasoners tend to focus on the explicit possibilities. The theory predicts the major phenomena of understanding and reasoning with conditionals. (shrink)

Utility maximization is a key element of a number of theoretical approaches to explaining human behavior. Among these approaches are rational analysis, ideal observer theory, and signal detection theory. While some examples of these approaches define the utility maximization problem with little reference to the bounds imposed by the organism, others start with, and emphasize approaches in which bounds imposed by the information processing architecture are considered as an explicit part of the utility maximization problem. These latter approaches are the (...) topic of this issue of the journal. (shrink)

It is known that, on average, people adapt their choice of memory strategy to the subjective utility of interaction. What is not known is whether an individual's choices are boundedly optimal. Two experiments are reported that test the hypothesis that an individual's decisions about the distribution of remembering between internal and external resources are boundedly optimal where optimality is defined relative to experience, cognitive constraints, and reward. The theory makes predictions that are tested against data, not fitted to it. The (...) experiments use a no-choice/choice utility learning paradigm where the no-choice phase is used to elicit a profile of each participant's performance across the strategy space and the choice phase is used to test predicted choices within this space. They show that the majority of individuals select strategies that are boundedly optimal. Further, individual differences in what people choose to do are successfully predicted by the analysis. Two issues are discussed: the performance of the minority of participants who did not find boundedly optimal adaptations, and the possibility that individuals anticipate what, with practice, will become a bounded optimal strategy, rather than what is boundedly optimal during training. (shrink)

Almaatouq et al.'s prescription for more integrative experimental designs is welcome but does not address an equally important problem: Lack of adequate theories. We highlight two features theories ought to satisfy: “Well-specified” and “grounded.” We discuss the importance of these features, some positive exemplars, and the complementarity between the target article's prescriptions and improved theorizing.

The new paradigm in the psychology of reasoning draws on Bayesian formal frameworks, and some advocates of the new paradigm think of these formal frameworks as providing a computational-level theory of rational human inference. I argue that Bayesian theories should not be seen as providing a computational-level theory of rational human inference, where by “Bayesian theories” I mean theories that claim that all rational credal states are probabilistically coherent and that rational adjustments of degrees of belief in the light of (...) new evidence must be in accordance with some sort of conditionalization. The problems with the view I am criticizing can best be seen when we look at chains of inferences, rather than single-step inferences. Chains of inferences have been neglected almost entirely within the new paradigm. (shrink)

Taking a Darwinian approach, we propose that people reason to detect free-riders on the Wason Selection task with the sharing-rule; If one receives the resource, one is an in-group member (standard), or If one is an in-group member, one receives the resource (switched). As predicted, taking the resource-provider's perspective, both undergraduates and children (11 to 12 years old) checked for the existence of out-group members taking undeserved resource. Changing the perspective to that of the resource-recipient did not alter the selection (...) pattern in undergraduates, although the prediction was that another type of free-riding -failure to share by resource-provider- would be checked as well. However, by removing confounding factors in the materials, both undergraduates and children checked for both types of free-riding, which fully supports the prediction. These results indicate that the sharing-rule elicits a thematic content effect that cannot be explained by preceding deontic reasoning theories. (shrink)

Causal induction in the real world often has to be quick and efficient as well as accurate. We propose that people use two different frames to achieve these goals. The A-frame consists of heuristic processes that presuppose rarity and can detect causally relevant factors quickly. The B-frame consists of analytic processes that can be highly accurate in detecting actual causes. Our dual frame theory implies that several factors affect whether people use the A-frame or the B-frame in causal induction: among (...) these are symmetrical negation, intervention and commitment. This theory is tested and sustained in two experiments. The results also provide broad support for dual process accounts of human thinking in general. (shrink)

In this article, 41 models of covariation detection from 2 × 2 contingency tables were evaluated against past data in the literature and against data from new experiments. A new model was also included based on a limiting case of the normative phi‐coefficient under an extreme rarity assumption, which has been shown to be an important factor in covariation detection (McKenzie & Mikkelsen, 2007) and data selection (Hattori, 2002; Oaksford & Chater, 1994, 2003). The results were supportive of the new (...) model. To investigate its explanatory adequacy, a rational analysis using two computer simulations was conducted. These simulations revealed the environmental conditions and the memory restrictions under which the new model best approximates the normative model of covariation detection in these tasks. They thus demonstrated the adaptive rationality of the new model. (shrink)

Topics in Cognitive Science, Volume 14, Issue 3, Page 550-573, July 2022.

Does reasoning occur on the Wason selection task, or are card selections determined purely on the basis of heuristic processes? To answer this question two relevance-based theories of reasoning are compared: (1) the theory of Evans (1984, 1989; Evans & Over, 1996), which takes the heuristic viewpoint, and (2) the theory of Sperber, Cara, and Girotto (1995), which takes the reasoning viewpoint. In three experiments, the effect of removing matching cards from the selection task array is examined. It is argued (...) that the Sperber et al. theory makes clearer predictions about the results of these manipulations, which are confirmed, and that the Evans theory can only accommodate them if it allows the operation of reasoning processes. The results are also discussed in relation to Roth's (1979) account of the selection task, mental models theory, and information gain theory. (shrink)

Mental models theorists have proposed that reasoners tend to focus on what is explicit in their mental models, and that certain debiasing procedures can induce them to direct their attention to other relevant information. For instance, Green and Larking 1995; also Green, 1995a facilitated performance on the Wason selection task by inducing participants to consider counterexamples to the conditional rule. However, these authors acknowledged that one aspect of their data might require some modification to the mental models theory. This research (...) is discussed here, and it is suggested that the results may be better accommodated by mental inference rules theory than by mental models theory. (shrink)

Bayesian probability has recently been proposed as a normative theory of argumentation. In this article, we provide a Bayesian formalisation of the ad Hitlerum argument, as a special case of the ad hominem argument. Across three experiments, we demonstrate that people's evaluation of the argument is sensitive to probabilistic factors deemed relevant on a Bayesian formalisation. Moreover, we provide the first parameter-free quantitative evidence in favour of the Bayesian approach to argumentation. Quantitative Bayesian prescriptions were derived from participants' stated subjective (...) probabilities (Experiments 1 and 2), as well as from frequency information explicitly provided in the experiment (Experiment 3). Participants' stated evaluations of the convincingness of the argument were well matched to these prescriptions. (shrink)

Normative theories provide essential tools for understanding behaviour, not just for reasoning, judgement, and decision-making, but many other areas of cognition as well; and their utility extends to the development of process theories. Furthermore, the way these tools are used has nothing to do with the is-ought fallacy. There therefore seems no basis for the claim that research would be better off without them.

(2013). Rational argument, rational inference. Argument & Computation: Vol. 4, Formal Models of Reasoning in Cognitive Psychology, pp. 21-35. doi: 10.1080/19462166.2012.689327.

Argumentation is pervasive in everyday life. Understanding what makes a strong argument is therefore of both theoretical and practical interest. One factor that seems intuitively important to the strength of an argument is the reliability of the source providing it. Whilst traditional approaches to argument evaluation are silent on this issue, the Bayesian approach to argumentation (Hahn & Oaksford, 2007) is able to capture important aspects of source reliability. In particular, the Bayesian approach predicts that argument content and source reliability (...) should interact to determine argument strength. In this paper, we outline the approach and then demonstrate the importance of source reliability in two empirical studies. These experiments show the multiplicative relationship between the content and the source of the argument predicted by the Bayesian framework. (shrink)

In this paper, it is argued that the most fruitful approach to developing normative models of argument quality is one that combines the argumentation scheme approach with Bayesian argumentation. Three sample argumentation schemes from the literature are discussed: the argument from sign, the argument from expert opinion, and the appeal to popular opinion. Limitations of the scheme-based treatment of these argument forms are identified and it is shown how a Bayesian perspective may help to overcome these. At the same time, (...) the contributions of the standard scheme-based approach are highlighted, and it is argued that only a combination of the insights of different traditions will yield a complete normative theory of argument quality. (shrink)

In this article, we argue for the general importance of normative theories of argument strength. We also provide some evidence based on our recent work on the fallacies as to why Bayesian probability might, in fact, be able to supply such an account. In the remainder of the article we discuss the general characteristics that make a specifically Bayesian approach desirable, and critically evaluate putative flaws of Bayesian probability that have been raised in the argumentation literature.

People are adept at inferring novel causal relations, even from only a few observations. Prior knowledge about the probability of encountering causal relations of various types and the nature of the mechanisms relating causes and effects plays a crucial role in these inferences. We test a formal account of how this knowledge can be used and acquired, based on analyzing causal induction as Bayesian inference. Five studies explored the predictions of this account with adults and 4-year-olds, using tasks in which (...) participants learned about the causal properties of a set of objects. The studies varied the two factors that our Bayesian approach predicted should be relevant to causal induction: the prior probability with which causal relations exist, and the assumption of a deterministic or a probabilistic relation between cause and effect. Adults’ judgments (Experiments 1, 2, and 4) were in close correspondence with the quantitative predictions of the model, and children’s judgments (Experiments 3 and 5) agreed qualitatively with this account. (shrink)

Two experiments using a realistic version of the selection task examined the relationship between participants' probability estimates of finding a counter example and their selections. Experiment 1 used everyday categories in the context of a scenario to determine whether or not the number of instances in a category affected the estimated probability of a counter-example. Experiment 2 modified the scenario in order to alter participants' estimates of finding a specific counter-example. Unlike Kirby 1994a, but consistent with his proposals, both studies (...) showed that probability estimates significantly predicted selection. Overall results point to the value of understanding selections in terms of their subjective expected utility. (shrink)

Inferences about spatial, temporal, and other relations are ubiquitous. This article presents a novel model-based theory of such reasoning. The theory depends on 5 principles. The structure of mental models is iconic as far as possible. The logical consequences of relations emerge from models constructed from the meanings of the relations and from knowledge. Individuals tend to construct only a single, typical model. They spontaneously develop their own strategies for relational reasoning. Regardless of strategy, the difficulty of an inference depends (...) on the process of integration of the information from separate premises, the number of entities that have to be integrated to form a model, and the depth of the relation. The article describes computer implementations of the theory and presents experimental results corroborating its main principle. (shrink)

Normative theories can be useful in developing descriptive theories, as when normative subjective expected utility theory is used to develop descriptive rational choice theory and behavioral game theory. “Ought” questions are also the essence of theories of moral reasoning, a domain of higher mental processing that could not survive without normative considerations.

It is a commonplace that contemplation of an imaginary particular may have cognitive and motivational effects that differ from those evoked by an abstract description of an otherwise similar state of affairs. In his Treatise on Human Nature, Hume ([1739] 1978) writes forcefully of this.

Metaphors of mind and their elaboration into models serve a crucial explanatory role in psychology. In this article, an attempt is made to describe how biology and engineering provide the predominant metaphors for contemporary psychology. A contrast between the discursive and descriptive functions of metaphor use in theory construction serves as a platform for deliberation upon the pragmatic consequences of models derived therefrom. The conclusion contains reflections upon the possibility of an integrative interdisciplinary psychology.

The (recent, Bayesian) cognitive science literature on The Wason Task (WT) has been modeled largely after the (not-so-recent, Bayesian) philosophy of science literature on The Paradox of Confirmation (POC). In this paper, we apply some insights from more recent Bayesian approaches to the (POC) to analogous models of (WT). This involves, first, retracing the history of the (POC), and, then, reexamining the (WT) with these historico-philosophical insights in mind.

The (recent, Bayesian) cognitive science literature on the Wason Task (WT) has been modeled largely after the (not-so-recent, Bayesian) philosophy of science literature on the Paradox of Confirmation (POC). In this paper, we apply some insights from more recent Bayesian approaches to the (POC) to analogous models of (WT). This involves, first, retracing the history of the (POC), and, then, re-examining the (WT) with these historico-philosophical insights in mind.