The psychology of reasoning uses norms to categorize responses to reasoning tasks as correct or incorrect in order to interpret the responses and compare them across reasoning tasks. This raises the arbitration problem: any number of norms can be used to evaluate the responses to any reasoning task and there doesn’t seem to be a principled way to arbitrate among them. Elqayam and Evans have argued that this problem is insoluble, so they call for the psychology of reasoning to dispense (...) with norms entirely. Alternatively, Stupple and Ball have argued that norms must be used, but the arbitration problem should be solved by favouring norms that are sensitive to the context, constraints, and goals of human reasoning. In this paper, I argue that the design of reasoning tasks requires the selection of norms that are indifferent to the factors that influence human responses to the tasks—which aren’t knowable during the task design phase, before the task has been given to human subjects. Moreover, I argue that the arbitration problem is easily dissolved: any well-designed task will contain instructions that implicitly or explicitly specify a single determinate norm, which specifies what would count as a solution to the task—independently of the context, constraints, and goals of human reasoning. Finally, I argue that discouraging the use of these a priori task norms may impair the design of novel reasoning tasks. (shrink)

One of the most famous problems in the decision-making literature is the “bat and a ball” problem from the cognitive reflection test (CRT; Frederick, 2005). The problem goes as follows: „A bat and...

Recent work in cognitive modelling has found that most of the data that has been cited as evidence for the dual-process theory (DPT) of reasoning is best explained by non-linear, “monotonic” one-process models (Stephens et al., 2018, 2019). In this paper, I consider an important caveat of this research: it uses models that are committed to unrealistic assumptions about how effectively task conditions can isolate Type-1 and Type-2 reasoning. To avoid this caveat, I develop a coordinated theoretical, experimental, and modelling (...) strategy to better test DPT. First, I propose that Type-1 and Type-2 reasoning are defined as reasoning that precedes and follows metacognitive control, respectively. Second, I argue that reasoning that precedes and follows metacognitive control can be effectively isolated using debiasing paradigms that manipulate metacognitive heuristics (e.g., processing fluency) to prevent or trigger metacognitive control, respectively. Third, I argue that monotonic modelling can allow us to decisively test DPT only when we use them to analyse data from this particular kind of debiasing paradigm. (shrink)

A key component of the susceptibility to cognitive biases is the ability to monitor for conflict between intuitively cued “heuristic” answers and logical principles. While there is evidence that pe...

I present a critical discussion of dual-process theories of reasoning and decision making with particular attention to the nature and role of Type 2 processes. The original theory proposed...

Dual process models of higher cognition have become very influential in the cognitive sciences. The popular Default-Interventionist model has long favoured a serial view on the interaction between...

The dual-process model of cognition but most especially its reflective component, system 2 processing, shows strong conceptual links with critical thinking. In fact, the salient characteristics of system 2 processing are so strikingly close to that of critical thinking, that it is tempting to claim that critical thinking is system 2 processing, no more and no less. In this article, I consider the two sides of that claim: Does critical thinking always require system 2 processing? And does system 2 processing (...) always result in critical thinking? I argue that it is plausible and helpful to consider that critical thinking requires system 2 processing. In particular, this assumption can provide interesting insights and benchmarks for critical thinking education. On the other hand, I show that system 2 processing can result in a range of outcomes which are either contradictory with critical thinking, or of debatable social desirability—which suggests that there is more to critical thinking than mere system 2 processing, and more to system 2 processing than just critical thinking. (shrink)

The feeling of error (FOE) is the subjective experience that something went wrong during a reasoning or calculation task. The main goal of the present study was to assess the accuracy of the FOE in the context of mental mathematical calculation. We used the number bisection task (NBT) to evoke this metacognitive feeling and assessed it by asking participants if they felt they have committed an error after solving the task. In the NBT participants have to determine whether the number (...) presented in the middle of a triplet corresponds to the arithmetic mean of the two outer numbers (e.g., 07_16_25) with a Yes/No answer. Our results show that FOE reports were strongly correlated with arithmetic errors and numerical properties of the NBT, suggesting that the FOE accurately represents the error. This finding indicates that even very fast metacognitive feelings are reliable when it comes to evaluating one’s own mental performance. Moreover, our results suggest that the occurrence of FOEs is determined by the fluency with which each triplet was solved and the post-decision evaluation processes that occurred after the NBT was solved. Additionally, we asked participants to report their confidence in the given answer for the cases where they did not report FOEs. Participants reported less confidence for the (objectively) incorrect answers than for the (objectively) correct ones, suggesting that in cases where they did not have a conscious FOE they still were able to implicitly detect their errors. Remarkably, confidence was also determined by the fluency of the NBT. (shrink)

ABSTRACTThe general assumption that people fail to notice discrepancy between their answer and the normative answer in the conjunction fallacy task has been challenged by the theory of Logical Intuition. This theory suggests that people can detect the conflict between the heuristic and normative answers even if they do not always manage to inhibit their intuitive choice. This theory gained support from the finding that people report lower levels of confidence in their choice after they commit the conjunction fallacy compared (...) to when their answer is not in conflict with logic. In four experiments we asked the participants to give probability estimations to the options of the conflict and no-conflict versions of the tasks in the original set-up of the experiment or in a three-option design. We found that participants perceive probabilities for the options of the conflict version less similar than for the no-conflict version. As people are less confident when choosing between more similar options, this simil.. (shrink)

The finding that people tend to prefer logically valid conclusions over invalid ones is known in the literature as the logic‐liking effect and has traditionally been interpreted as evidence for the notion of so‐called logical intuitions. Results of more recent empirical studies investigating conditional and categorical syllogisms suggest, however, that previous instances of the logic‐liking effect can be accounted for by a confound in terms of surface‐feature atmosphere. But the true nature of this atmosphere effect has so far remained largely (...) elusive. Here, we address this issue and introduce two variants of disjunctive syllogisms that enable us to deconfound validity, possibility of the conclusion, and surface‐feature atmosphere, which has been impossible with simple disjunctive syllogisms used in earlier studies. Three experiments, in which participants were asked to provide liking and logic ratings for these arguments, revealed that the logic‐liking effect in disjunctive syllogisms can be explained by an atmosphere confound in combination with implied demand to consider logicality when judging likability. We also observed a strong atmosphere effect in logic ratings over and above an effect of logical validity per se. Furthermore, atmosphere effects appear to be induced only by specific surface features, namely those that are ecologically valid, if fallible, predictors for logicality. We conclude that acquired atmosphere heuristics provide proxies for logical validity that reasoners often take at face value. A comparison of the present results with previous findings from experiments that focused on conditional and categorical syllogisms additionally indicates that these atmosphere heuristics are used irrespective of an argument's complexity. (shrink)

The 34 commentaries on the target article span a broad range of interesting issues. I have organized my reply around five major themes that seemed to emerge: Remarks about the generalizability of the empirical findings, links with other models, necessary extensions, the utility of dual-process models, and more specific points. This allows me to clarify possible misconceptions and identify avenues for further advancement.

The logical intuition hypothesis proposes a difference in the strength between logical and heuristic intuitions. The labels of logical and heuristic intuitions are exclusive to conventional reasoning research. This paper reports the result of testing intuition strength using the dot-probe methodology in a novel multiplication paradigm. Here, “logical intuition” and “heuristic intuition” were relabeled as “weaker intuition” (-1 × 5 = 5) and “stronger intuition” (1 × 5 = 5), respectively, to assess the assumptions about the difference in the strength (...) of “Chinese multiplication mnemonics” intuitions. The dot-probe paradigm was utilized in the following experiments to measure attentional bias. This was assessed by calculating the difference in reaction time between incongruent (the target location is opposite to the probe location) and congruent (the target location is the same as the probe location) conditions. Experiment 1 found attentional bias directed attention to the correct answer for both weaker and stronger intuitions. Experiment 2 replicated and extended Experiment 1 with a secondary task to manipulate high and low cognitive loads. Consequently, stronger intuitions were unaffected by cognitive load and participants were biased toward the correct answer, whereas attentional bias for weaker intuitions only occurred in low load conditions. These results revealed that although both intuitions can guide attention, stronger intuition may guide attention bias in a high-load situation due to its robust automation. Our findings extend the logical intuition hypothesis that proposes a difference in the automated strengths of intuitions to mathematical and analytic thinking. (shrink)

ABSTRACTHumans are cognitive misers because their basic tendency is to default to processing mechanisms of low computational expense. Such a tendency leads to suboptimal outcomes in certain types of hostile environments. The theoretical inferences made from correct and incorrect responding on heuristics and biases tasks have been overly simplified, however. The framework developed here traces the complexities inherent in these tasks by identifying five processing states that are possible in most heuristics and biases tasks. The framework also identifies three possible (...) processing defects: inadequately learned mindware; failure to detect the necessity of overriding the miserly response; and failure to sustain the override process once initiated. An important insight gained from using the framework is that degree of mindware instantiation is strongly related to the probability of successful detection and override. Thus, errors on such tasks cannot be unambiguously attributed to miserly processing – and corre... (shrink)

The Monty Hall Dilemma (MHD) is a two-step decision problem involving counterintuitive conditional probabilities. The first choice is made among three equally probable options, whereas the second choice takes place after the elimination of one of the non-selected options which does not hide the prize. Differing from most Bayesian problems, statistical information in the MHD has to be inferred, either by learning outcome probabilities or by reasoning from the presented sequence of events. This often leads to suboptimal decisions and erroneous (...) probability judgments. Specifically, decision makers commonly develop a wrong intuition that final probabilities are equally distributed, together with a preference for their first choice. Several studies have shown that repeated practice enhances sensitivity to the different reward probabilities, but does not facilitate correct Bayesian reasoning. However, modest improvements in probability judgments have been observed after guided explanations. To explain these dissociations, the present review focuses on two types of causes producing the observed biases: Emotional-based choice biases and cognitive limitations in understanding probabilistic information. Among the latter, we identify a crucial cause for the universal difficulty in overcoming the equiprobability illusion: Incomplete representation of prior and conditional probabilities. We conclude that repeated practice and/or high incentives can be effective for overcoming choice biases, but promoting an adequate partitioning of possibilities seems to be necessary for overcoming cognitive illusions and improving Bayesian reasoning. (shrink)

Although reasoning has been characterized as the essence of our being, it is often prone to cognitive biases. Decades of research in the reasoning and decision making fields have shown that when fa...

Dual-process theories of the mind emphasize how reasoning is an interplay between intuitive and reflective thinking. This paper aims to understand how the two types of processing interact in the moral domain. According to a ‘default-interventionist’ model of moral reasoning intuition and reflection are conflicting cognitions: intuitive thinking would elicit heuristic and deontological responses, whereas reflection would favour utilitarian judgements. However, the evidence for the default interventionist view is inconclusive and challenged by a growing amount of counterevidence in recent years. (...) The recent empirical findings favour an interdependent rather than conflicting view of the two types of information processing in the moral domain. In this view, which I call dual-process reflective equilibrium, intuition and reflection cooperate in moral reasoning to reach a reflective goal, which is supposedly normative justification. In sum, on the one hand, the scope of moral intuitions extends to selecting relevant information and calling for reflection whenever a problem presents conflicting aspects; on the other hand, the purpose of moral reflection is to rationalize pre-reflective intuitions to provide articulated and accessible reasons. (shrink)

An underlying assumption of default-interventionist dual-process theory (DI-DPT) of reasoning is that humans tend to act as cognitive misers. Although miserly cognitive processing occurs when indiv...

We conducted a thorough investigation of the impact of representativeness on reasoning and metacognitive processes by employing the Linda problem. In congruent versions, the more representative res...

It is well established that beliefs provide powerful cues that influence reasoning. Over the last decade research has revealed that judgments based upon logical structure may also pre-empt deliberative reasoning. Evidence for ‘intuitive logic’ has been claimed using a range of measures (i.e. confidence ratings or latency of response on conflict problems). However, it is unclear how well such measures genuinely reflect logical intuition. In this paper we introduce a new method designed to test for evidence of intuitive logic. In (...) two experiments participants were asked to make random judgments about the logical validity of a series of simple and complex syllogistic arguments. For simple arguments there was an effect of logical validity on random responding, which was absent for complex arguments. These findings provide a novel demonstration that people are intuitively sensitive to logical structure. (shrink)

Three experiments explored the effects of word problem cueing on debiasing versions of the bat-and-ball problem. In the experimental condition order, participants solved a simpler isomorphic version of the problem prior to solving a standard version that, critically, had the same item-and-dollar amounts. Conversely, in the control condition order, participants solved the standard version prior to solving the isomorph. Across the first 2 experiments, participants cued with the isomorph were more likely to correctly solve the standard version of the problem. (...) In the third experiment, this cueing effect was not replicated, but importantly cued participants were more likely to correctly solve the standard version of the problem with other item-and-dollar amounts, indicating near transfer. Far transfer was evident in faster response times to other problems in the Cognitive Reflection Test following practice. Along with providing converging evidence for the cueing account, these results are consistent with recent attentional debiasing findings. (shrink)

A novel problem or task may seem difficult at first, but with enough practice, it can become easy and routine. Practice and the process of learning is often accompanied by some mild cognitive uneas...

ABSTRACTIn order to explain the effects found in the heuristics and biases literature, dual-process theories of reasoning claim that human reasoning is of two kinds: Type-1 processing is fast, automatic, and associative, while Type-2 reasoning is slow, controlled, and rule based. If human reasoning is so divided, it would have important consequences for morality, epistemology, and philosophy of mind. Although dual-process theorists have typically argued for their position by way of an inference to the best explanation, they have generally failed (...) to consider alternative hypotheses. Worse still, it is unclear how we might test dual-process theories. In this article, I offer a one-system theory, which I call the Sound-Board Account of Reasoning, according to which there is one reasoning system which is flexible, allowing the properties used to distinguished Type-1 and Type-2 reasoning to cross-cut one another. I empirically distinguish my theory from the two dominant versions of dual-process theory (parallel... (shrink)

RESUMEN El artículo analiza el experimento de A. Pennycook et al., a fin de ampliar el alcance de sus hipótesis y las estrategias para contrastarlas, de modo que contemplen no solo factores cognitivos, sino también aspectos pragmáticos y contextuales implicados en la receptividad al bullshit. Se utiliza el experimento como ejemplo de las asunciones normativas implícitas en las investigaciones descriptivas de psicología y filosofía experimental, ya que, al contrastar hipótesis sobre las intuiciones filosóficas de sentido común, los investigadores parten de (...) supuestos axiológicos sobre la corrección de las respuestas y la fiabilidad de los procesos cognitivos implicados. ABSTRACT The article analyzes the experiment carried out by A. Pennycook et al., in order to expand the scope of its hypotheses and the strategies to contrast them, in such a way that, beyond cognitive contexts, they also take into account the pragmatic and contextual aspects involved in bullshit receptivity. The experiment is used as an example of the normative assumptions implicit in the descriptive research projects of experimental psychology and philosophy, given that when researchers contrast hypotheses regarding common sense philosophical intuitions, they start out from axiological assumptions with respect to the correction of answers and the reliability of the cognitive process involved. (shrink)