The Cognitive Reflection Test (CRT; Frederick, 2005) is designed to measure the tendency to override a prepotent response alternative that is incorrect and to engage in further reflection that leads to the correct response. It is a prime measure of the miserly information processing posited by most dual process theories. The original three-item test may be becoming known to potential participants, however. We examined a four-item version that could serve as a substitute for the original. Our data show that it (...) displays a.58 correlation with the original version and that it has very similar relationships with cognitive ability, various thinking dispositions, and with several other rational thinking tasks. Combining the two versions into a seven-item test resulted in a measure of miserly processing with substantial reliability (.72). The seven-item version was a strong independent predictor of performance on rational thinking tasks after the variance accounted for by cognitive ability and thinking dispositions had been partialled out. (shrink)

Dual Process Theories of reasoning posit that judgments are mediated by both fast, automatic processes and more deliberate, analytic ones. A critical, but unanswered question concerns the issue of monitoring and control: When do reasoners rely on the first, intuitive output and when do they engage more effortful thinking? We hypothesised that initial, intuitive answers are accompanied by a metacognitive experience, called the Feeling of Rightness, which can signal when additional analysis is needed. In separate experiments, reasoners completed one of (...) four tasks: conditional reasoning, a three-term variant of conditional reasoning, problems used to measure base rate neglect, or a syllogistic reasoning task. For each task, participants were instructed to provide an initial, intuitive response to the problem along with an assessment of the rightness of that answer. They were then allowed as much time as needed to reconsider their initial answer and provide a final answer. In each experiment, we observed a robust relationship between the FOR and two measures of analytic thinking: low FOR was associated with longer rethinking times and an increased probability of answer change. In turn, FOR judgments were consistently predicted by the fluency with which the initial answer was produced, providing a link to the wider literature on metamemory. These data support a model in which a metacognitive judgment about a first, initial model determines the extent of analytic engagement. (shrink)

One hundred and three participants solved conflict and non-conflict versions of four reasoning tasks using a two-response procedure: a base rate task, a causal reasoning task, a denominator neglect task, and a categorical syllogisms task. Participants were asked to give their first, intuitive answer, to make a Feeling of Rightness judgment, and then were given as much time as needed to rethink their answer. They also completed a standardized measure of IQ and the actively open-minded thinking questionnaire. The FORs of (...) both high- and low-capacity reasoners were responsive to conflict, such that FORs were lower for conflict relative to non-conflict problems. Consistent with the quantity hypothesis, high-capacity reasoners made a greater distinction between conflict and non-conflict items on measures of Type 2 thinking, namely, rethinking time and probability of changing answers. In contrast to the quality hypothesis, however, this rethinking time did not advantage the ability of the high-capacity group to produce normative answers, except for the base rate task. Indeed, we observed that the correlation between capacity and the probability of normative answers emerged at the initial response, rather than after rethinking. (shrink)

Much research in the last two decades has demonstrated that human responses deviate from the performance deemed normative according to various models of decision making and rational judgment (e.g., the basic axioms of utility theory). This gap between the normative and the descriptive can be interpreted as indicating systematic irrationalities in human cognition. However, four alternative interpretations preserve the assumption that human behavior and cognition is largely rational. These posit that the gap is due to (1) performance errors, (2) computational (...) limitations, (3) the wrong norm being applied by the experimenter, and (4) a different construal of the task by the subject. In the debates about the viability of these alternative explanations, attention has been focused too narrowly on the modal response. In a series of experiments involving most of the classic tasks in the heuristics and biases literature, we have examined the implications of individual differences in performance for each of the four explanations of the normative/descriptive gap. Performance errors are a minor factor in the gap; computational limitations underlie non-normative responding on several tasks, particularly those that involve some type of cognitive decontextualization. Unexpected patterns of covariance can suggest when the wrong norm is being applied to a task or when an alternative construal of the task should be considered appropriate. Key Words: biases; descriptive models; heuristics; individual differences; normative models; rationality; reasoning. (shrink)