Prior research found correlations between reflection test performance and philosophical tendencies among laypeople. In two large studies (total N = 1299)—one pre-registered—many of these correlations were replicated in a sample that included both laypeople and philosophers. For example, reflection test performance predicted preferring atheism over theism and instrumental harm over harm avoidance on the trolley problem. However, most reflection-philosophy correlations were undetected when controlling for other factors such as numeracy, preferences for open-minded thinking, personality, philosophical training, age, and gender. Nonetheless, (...) some correlations between reflection and philosophical views survived this multivariate analysis and were only partially confounded with either education or self-reported reasoning preferences. Unreflective thinking still predicted believing in God whereas reflective thinking still predicted believing that (a) proper names like ‘Santa’ do not necessarily refer to entities that actually exist and (b) science does reveal the fundamental nature of the world. So some robust relationships between reflection and philosophical tendencies were detected even among philosophers, and yet there was clearly more to the link between reflection and philosophy. To this end, demographic and metaphilosophical hypotheses are considered. (shrink)

Reflectivists consider reflective reasoning crucial for good judgment and action. Anti-reflectivists deny that reflection delivers what reflectivists seek. Alas, the evidence is mixed. So, does reflection confer normative value or not? This paper argues for a middle way: reflection can confer normative value, but its ability to do this is bound by such factors as what we might call epistemic identity: an identity that involves particular beliefs—for example, religious and political identities. We may reflectively defend our identities’ beliefs rather than (...) reflect open-mindedly to adopt whatever beliefs cohere with the best arguments and evidence. This bounded reflectivism is explicated with an algorithmic model of reflection synthesized from philosophy and science that yields testable predictions, psychometric implications, and realistic metaphilosophical suggestions—for example, overcoming motivated reflection may require embracing epistemic identity rather than veiling it (à la Rawls 1971). So bounded reflectivism should be preferred to views offering anything less. (shrink)

Philosophy is a reflective activity. So perhaps it is unsurprising that many philosophers have claimed that reflection plays an important role in shaping and even improving our philosophical thinking. This hypothesis seems plausible given that training in philosophy has correlated with better performance on tests of reflection and reflective reasoning has correlated with demonstrably better judgments in a variety of domains. This article reviews the hypothesized roles of reflection in philosophical thinking as well as the empirical evidence for these roles. (...) This reveals that although there are fairly reliable links between reflection and philosophical judgment among both laypeople and philosophers, the role of reflection in philosophical thinking may nonetheless depend in part on other factors, some of which have yet to be determined. So progress in research on reflection in philosophy may require further innovation in experimental methods and psychometric validation of philosophical measures. (shrink)

Over the past two decades, the study of moral reasoning has been heavily influenced by Joshua Greene’s dual-process model of moral judgment, according to which deontological judgments are typically supported by intuitive, automatic processes while utilitarian judgments are typically supported by reflective, conscious processes. However, most of the evidence gathered in support of this model comes from the study of people’s judgments about sacrificial dilemmas, such as Trolley Problems. To which extent does this model generalize to other debates in which (...) deontological and utilitarian judgments conflict, such as the existence of harmless moral violations, the difference between actions and omissions, the extent of our duties of assistance, and the appropriate justification for punishment? To find out, we conducted a series of five studies on the role of reflection in these kinds of moral conundrums. In Study 1, participants were asked to answer under cognitive load. In Study 2, participants had to answer under a strict time constraint. In Studies 3 to 5, we sought to promote reflection through exposure to counter-intuitive reasoning problems or direct instruction. Overall, our results offer strong support to the extension of Greene’s dual-process model to moral debates on the existence of harmless violations and partial support to its extension to moral debates on the extent of our duties of assistance. (shrink)

In response to crises, people sometimes prioritize fewer specific identifiable victims over many unspecified statistical victims. How other factors can explain this bias remains unclear. So two experiments investigated how complying with public health recommendations during the COVID19 pandemic depended on victim portrayal, reflection, and philosophical beliefs (Total N = 998). Only one experiment found that messaging about individual victims increased compliance compared to messaging about statistical victims—i.e., "flatten the curve" graphs—an effect that was undetected after controlling for other factors. (...) However, messaging about flu (vs. COVID19) indirectly reduced compliance by reducing perceived threat of the pandemic. Nevertheless, moral beliefs predicted compliance better than messaging and reflection in both experiments. The second experiment’s additional measures revealed that religiosity, political preferences, and beliefs about science also predicted compliance. This suggests that flouting public health recommendations may be less about ineffective messaging or reasoning than philosophical differences. (shrink)

Conventional sacrificial moral dilemmas propose directly causing some harm to prevent greater harm. Theory suggests that accepting such actions (consistent with utilitarian philosophy) involves more reflective reasoning than rejecting such actions (consistent with deontological philosophy). However, past findings do not always replicate, confound different kinds of reflection, and employ conventional sacrificial dilemmas that treat utilitarian and deontological considerations as opposite. In two studies, we examined whether past findings would replicate when employing process dissociation to assess deontological and utilitarian inclinations independently. (...) Findings suggested two categorically different impacts of reflection: measures of arithmetic reflection, such as the Cognitive Reflection Test, predicted only utilitarian, not deontological, response tendencies. However, measures of logical reflection, such as performance on logical syllogisms, positively predicted both utilitarian and deontological tendencies. These studies replicate some findings, clarify others, and reveal opportunity for additional nuance in dual process theorist’s claims about the link between reflection and dilemma judgments. (shrink)

The Cognitive Reflection Test is purported to test our inclination to overcome impulsive, intuitive thought with effortful, rational reflection. Research suggests that philosophers tend to perform better on this test than non-philosophers, and that men tend to perform better than women. Taken together, these findings could be interpreted as partially explaining the gender gap that exists in Philosophy: there are fewer women in Philosophy because women are less likely to possess the ideal ‘philosophical personality’. If this explanation for the gender (...) gap in Philosophy is accepted, it might be seen to exonerate Philosophy departments of the need to put in place much-needed strategies for promoting gender diversity. This paper discusses a number of reasons for thinking that this would be the wrong conclusion to draw from the research. Firstly, the CRT may not track what it is claimed it tracks. Secondly, the trait tracked by the CRT may not be something that we should value in philosophers. Thirdly, even if we accept that the CRT tracks a trait that has value, this trait might be of limited importance to good philosophising. Lastly, the causal story linking the gender gap in CRT score and the gender gap in Philosophy is likely to be far more complex than this explanation implies. (shrink)

Actively open-minded thinking is often used as a proxy for reflective thinking in research on reasoning and related fields. It is associated with less biased reasoning in many types of tasks. However, few studies have examined its psychometric properties and criterion validity. We developed a shortened, 17-item version of the AOT for quicker administration. AOT17 is highly correlated with the original 41-item scale and has highly similar relationships to other thinking dispositions, social competence and supernatural beliefs. Our analyses revealed that (...) the AOT is not a unitary construct, but comprises four distinct dimensions, some of which concern attitudes towards knowledge, and others concern attitudes towards people. This factor structure was replicated in another data-set, and correlations with other measures in four data-sets support the criterion validity of these dimensions. Different dimensions were responsible for the AOT's relationships with other thinking dispositions. (shrink)

Influential work on reasoning and decision-making has popularised the idea that sound reasoning requires correction of fast, intuitive thought processes by slower and more demanding deliberation. We present seven studies that question this corrective view of human thinking. We focused on the very problem that has been widely featured as the paradigmatic illustration of the corrective view, the well-known bat-and-ball problem. A two-response paradigm in which people were required to give an initial response under time pressure and cognitive load allowed (...) us to identify the presumed intuitive response that preceded the final response given after deliberation. Across our studies, we observe that correct final responses are often non-corrective in nature. Many reasoners who manage to answer the bat-and-ball problem correctly after deliberation already solved it correctly when they reasoned under conditions that minimised deliberation in the initial response phase. This suggests that sound bat-and-ball reasoners do not necessarily need to deliberate to correct their intuitions; their intuitions are often already correct. Pace the corrective view, findings suggest that in these cases, they deliberate to verify correct intuitive insights. (shrink)

Cognitive reflection, or the ability to inhibit intuitive and incorrect responses in favour of correct responses, predicts performance on a variety of cognitive tasks. The present study examined interventions to improve cognitive reflection. In two experiments, college students (N = 491) were assigned to one of three conditions, completed two versions of a cognitive reflection test (CRT), and then completed transfer tasks. Between the two CRTs, some participants were provided with elaborative feedback, others were instructed to consider additional responses for (...) their initial responses and the final group was a control. In both experiments, CRT performance increased between the first and second CRT in the feedback and instruction groups, but not in the control group. There was little evidence, however, for transfer to other tasks. These results suggest that cognitive reflection performance can be improved with brief interventions but that this improvement may not transfer to related tasks. (shrink)

Prior research has suggested that perceptual disfluency activates analytical processing and increases the solution rate of mathematical problems with appealing but incorrect answers (i.e., the Cogn...

The susceptibility of decision-makers’ choices to variations in option framing has been attributed to individual differences in cognitive style. According to this view, individuals who are prone to a more deliberate, or less intuitive, thinking style are less susceptible to framing manipulations. Research findings on the topic, however, have tended to yield small effects, with several studies also being limited in inferential value by methodological drawbacks. We report two experiments that examined the value of several cognitive-style variables, including measures of (...) cognitive reflection, subjective numeracy, actively open-minded thinking, need for cognition, and hemispheric dominance, in predicting participants’ frame-consistent choices. Our experiments used an isomorph of the Asian Disease Problem and we manipulated frames between participants. We controlled for participants’ sex and age, and we manipulated the order in which choice options were presented to participants. In Experiment 1 (N = 190) using an undergraduate sample and in Experiment 2 (N = 316) using a sample of Amazon Mechanical Turk workers, we found no significant effect of any of the cognitive style measures taken on predicting frame-consistent choice, regardless of whether we analyzed participants’ binary choices or their choices weighted by the extent to which participants preferred their chosen option over the non-chosen option. The sole factor that significantly predicted frame consistent choice was framing: in both experiments, participants were more likely to make frame consistent choices when the frame was positive than when it was negative, consistent with the tendency towards risk aversion in the task. The present findings do not support the view that individual differences in people’s susceptibility to framing manipulations can be substantially accounted for by individual differences in cognitive style. (shrink)

One of the most famous problems in the decision-making literature is the “bat and a ball” problem from the cognitive reflection test (CRT; Frederick, 2005). The problem goes as follows: „A bat and...