Individuals’ propensity not to override the first answer that comes to mind is thought to be a crucial cause behind many failures in reasoning. In the present study, we aimed to explore the strategies used and the abilities employed when individuals solve the cognitive reflection test, the most widely used measure of this tendency. Alongside individual differences measures, protocol analysis was employed to unfold the steps of the reasoning process in solving the CRT. This exploration revealed that there are several (...) ways people solve or fail the test. Importantly, 77% of the cases in which reasoners gave the correct final answer in our protocol analysis, they started their response with the correct answer or with a line of thought which led to the correct answer. We also found that 39% of the incorrect responders reflected on their first response. The findings indicate that the suppression of the first answer may not be the only crucial feature of reflectivity in the CRT and that the lack of relevant knowledge is a prominent cause of the reasoning errors. Additionally, we confirmed that the CRT is a multi-faceted construct: both numeracy and reflectivity account for performance. The results can help to better apprehend the “whys and whens” of the decision errors in heuristics and biases tasks and to further refine existing explanatory models. (shrink)

This paper presents 59 new studies (N = 72,310) which focus primarily on the “bat and ball problem.” It documents our attempts to understand the determinants of the erroneous intuition, our exploration of ways to stimulate reflection, and our discovery that the erroneous intuition often survives whatever further reflection can be induced. Our investigation helps inform conceptions of dual process models, as “system 1” processes often appear to override or corrupt “system 2” processes. Many choose to uphold their intuition, even (...) when directly confronted with simple arithmetic that contradicts it – especially if the intuition is approximately correct. (shrink)

Research on implicit conflict detection suggests that people are sensitive to violations of logical principles. When they make reasoning errors, their epistemic radar presumably detects an anomaly....

ABSTRACTResearch has established that human thinking is often biased by intuitive judgement. The base-rate neglect effect provides such an example, so named because people often support their decisions in stereotypical individuating information, neglecting base-rates. Here, we test the hypothesis that reasoners acknowledge information provided by base-rates and may use individuating information in support of a “rational” decision process. Results from four experiments show that “base-rate neglecting” occurs when participants acknowledge sample distributions; participants who prefer individuating over base-rate information perceive base-rates (...) as less diagnostic and are more confident in their individuating-based responses; and that posterior probabilities predict more individuating-based responses for individuating-preference participants. However, data also show a deeper form of base-rate neglect: even when some partic... (shrink)

Three experiments explored the effects of word problem cueing on debiasing versions of the bat-and-ball problem. In the experimental condition order, participants solved a simpler isomorphic version of the problem prior to solving a standard version that, critically, had the same item-and-dollar amounts. Conversely, in the control condition order, participants solved the standard version prior to solving the isomorph. Across the first 2 experiments, participants cued with the isomorph were more likely to correctly solve the standard version of the problem. (...) In the third experiment, this cueing effect was not replicated, but importantly cued participants were more likely to correctly solve the standard version of the problem with other item-and-dollar amounts, indicating near transfer. Far transfer was evident in faster response times to other problems in the Cognitive Reflection Test following practice. Along with providing converging evidence for the cueing account, these results are consistent with recent attentional debiasing findings. (shrink)