Champions of the methodological movement of experimental philosophy have challenged the long-standing practice of relying on intuitive verdicts on cases in philosophical inquiry. They argue that th...

Experimental restrictionists have challenged philosophers’ reliance on intuitions about thought experiment cases based on experimental findings. According to the expertise defense, only the intuitions of philosophical experts count—yet the bulk of experimental philosophy consists in studies with lay people. In this paper, we argue that direct strategies for assessing the expertise defense are preferable to indirect strategies. A direct argument in support of the expertise defense would have to show: first, that there is a significant difference between expert and lay (...) intuitions; second, that expert intuitions are superior to lay intuitions; and third, that expert intuitions accord with the relevant philosophical consensus. At present, there is only little experimental evidence that bears on these issues. To advance the debate, we conducted two new experiments on intuitions about knowledge with experts and lay people. Our results suggest that the intuitions of epistemological experts are superior in some respects, but they also pose an unexpected challenge to the expertise defense. Most strikingly, we found that even epistemological experts tend to ascribe knowledge in fake-barn-style cases. This suggests that philosophy, as a discipline, might fail to adequately map the intuitions of its expert practitioners onto a disciplinary consensus. (shrink)

ABSTRACT The use of intuitions as evidence is widespread in epistemology, but not uncontroversial. For over a decade and a half, some experimental epistemologists have called into question this appeal to epistemic intuitions. These philosophers bring the methods of experimental psychology, in particular survey methods, to bear on epistemological theorizing. Given their commitment to the relevance of empirical work to philosophical theory construction, they qualify as methodological naturalists. But some methodological naturalists who also recommend giving up appeals to intuition as (...) evidence do not base their case on experimental surveys. In this article I consider two main challenges to the standard practice of appealing to intuitions posed by these naturalist philosophers and argue that a Craig-style epistemological project can allow the methodological naturalist to address them. Anyway I conclude that, regardless of the truth of the Craigian approach, intuitions still have a role to play in epistemological theorizing in the adjudication between approaches. (shrink)

Experimental philosophers are often puzzled as to why many armchair philosophers question the philosophical significance of their research. Armchair philosophers, in contrast, are often puzzled as to why experimental philosophers think their work sheds any light on traditional philosophical problems. I argue there is truth on both sides.

We examined the effects of order of presentation on the moral judgments of professional philosophers and two comparison groups. All groups showed similar-sized order effects on their judgments about hypothetical moral scenarios targeting the doctrine of the double effect, the action-omission distinction, and the principle of moral luck. Philosophers' endorsements of related general moral principles were also substantially influenced by the order in which the hypothetical scenarios had previously been presented. Thus, philosophical expertise does not appear to enhance the stability (...) of moral judgments against this presumably unwanted source of bias, even given familiar types of cases and principles. (shrink)

Must philosophers incorporate tools of experimental science into their methodological toolbox? I argue here that they must. Tallying up all the resources that are now part of standard practice in analytic philosophy, we see the problem that they do not include adequate resources for detecting and correcting for their own biases and proclivities towards error. Methodologically sufficient resources for error- detection and error-correction can only come, in part, from the deployment of specific methods from the sciences. However, we need not (...) imagine that the resulting methodological norms will be so empirically demanding as to require that all appeals to intuition must first be precertified by a thorough vetting by teams of scientists. Rather, I sketch a set of more moderate methodological norms for how we might best include these necessary tools of experimental philosophy. (shrink)

The Cognitive Reflection Test is purported to test our inclination to overcome impulsive, intuitive thought with effortful, rational reflection. Research suggests that philosophers tend to perform better on this test than non-philosophers, and that men tend to perform better than women. Taken together, these findings could be interpreted as partially explaining the gender gap that exists in Philosophy: there are fewer women in Philosophy because women are less likely to possess the ideal ‘philosophical personality’. If this explanation for the gender (...) gap in Philosophy is accepted, it might be seen to exonerate Philosophy departments of the need to put in place much-needed strategies for promoting gender diversity. This paper discusses a number of reasons for thinking that this would be the wrong conclusion to draw from the research. Firstly, the CRT may not track what it is claimed it tracks. Secondly, the trait tracked by the CRT may not be something that we should value in philosophers. Thirdly, even if we accept that the CRT tracks a trait that has value, this trait might be of limited importance to good philosophising. Lastly, the causal story linking the gender gap in CRT score and the gender gap in Philosophy is likely to be far more complex than this explanation implies. (shrink)

Recent empirical work appears to suggest that the moral intuitions of professional philosophers are just as vulnerable to distorting psychological factors as are those of ordinary people. This paper assesses these recent tests of the ‘expertise defense’ of philosophical intuition. I argue that the use of familiar cases and principles constitutes a methodological problem. Since these items are familiar to philosophers, but not ordinary people, the two subject groups do not confront identical cognitive tasks. Reflection on this point shows that (...) these findings do not threaten philosophical expertise—though we can draw lessons for more effective empirical tests. (shrink)

Recent work in experimental philosophy has indicated that intuitions may be subject to several forms of bias, thereby casting doubt on the viability of intuition as an evidential source in philosophy. A common reply to these findings is the ‘expertise defense’ – the claim that although biases may be found in the intuitions of non-philosophers, persons with expertise in philosophy will be resistant to these biases. Much debate over the expertise defense has centered over the question of the burden of (...) proof; must defenders of expertise provide empirical evidence of its existence, or should we grant the existence of philosophical expertise as a ‘default’ assumption? Defenders have frequently appealed to analogy with other fields; since expertise clearly exists in, e.g., the sciences, we are entitled to assume its existence in philosophy. Recently, however, experimentalists have begun to provide empirical evidence that biases in intuition extend even to philosophers. Though these findings don't yet suffice to defeat the default assumption of expertise the analogy argument motivates, they do force any proponent of the analogy argument to provide more specific and empirically informed proposals for the possible nature of philosophical expertise. (shrink)

In one of the earlier influential papers in the field of experimental philosophy titled Normativity and Epistemic Intuitions published in 2001, Jonathan M. Weinberg, Shaun Nichols and Stephen Stich reported that respondents answered Gettier type questions differently depending on their ethnic background as well as socioeconomic status. There is currently a debate going on, on the significance of the results of Weinberg et al. (2001) and its implications for philosophical methodology in general and epistemology in specific. Despite the debates, however, (...) to our knowledge, there has not been a replication attempt of the experiments of the original paper. We collected data from four different sources (two on-line and two in-person) to replicate the experiments. Despite several different data sets and in various cases larger sample sizes and hence greater power to detect differences, we failed to detect significant differences between the above-mentioned ethnic and socioeconomic groups. Our results suggest that epistemic intuitions are more robust across ethnic and socioeconomic groups than Weinberg et al. (2001) indicates. Given our data, we believe that the notion of differences in epistemic intuitions among different ethnic and socioeconomic groups that follows from Weinberg et al. (2001) needs to be corrected. (shrink)

In what sense, if any, are philosophers experts in their domain of research and what could philosophical expertise be? The above questions are particularly pressing given recent methodological disputes in philosophy. The so-called expertise defense recently proposed as a reply to experimental philosophers postulates that philosophers are experts qua having improved intuitions. However, this model of philosophical expertise has been challenged by studies suggesting that philosophers’ intuitions are no less prone to biases and distortions than intuitions of non-philosophers. Should we (...) then give up on the idea that philosophers possess some sort of expertise? In this paper, I argue that instead of focusing on intuitions, we may understand the relevant results of philosophical practice more broadly and investigate the other kind of expertise they would require. My proposal is inspired by a prominent approach to investigating expert performance from psychology and suggests where and how to look for expertise in the results characteristic of philosophical practice. In developing this model, I discuss the following three candidates for such results: arguments, theories, and distinctions. Whether philosophers could be shown to be expert intuiters or not, there are interesting domains where we could look for philosophical expertise, beyond intuitions. (shrink)

Financial incentives, learning, group consultation, and increased experimental control are among the experimental techniques economists have successfully used to deflect the behavioral challenge posed by research conducted by such scholars as Tversky and Kahneman. These techniques save the economic armchair to the extent that they align laypeople judgments with economic theory by increasing cognitive effort and reflection in experimental subjects. It is natural to hypothesize that a similar strategy might work to address the experimental or restrictionist challenge to armchair philosophy. (...) To test this hypothesis, a randomized controlled experiment was carried out, as well as two lab experiments. Three types of knowledge attribution tasks were used. No support for the hypothesis was found. The paper describes the close similarities between the economist’s response to the behavioral challenge, and the expertise defense against the experimental challenge, and presents the experiments, results, and an array of robustness checks. The upshot is that these results make the experimental challenge all the more forceful. (shrink)

This paper presents new evidence on the impact of socioeconomic status and education on knowledge attribution. I examine a variety of cases, including vignettes where agents have been Gettiered, have false beliefs, and possess knowledge. Early work investigated whether SES might be associated with knowledge attribution :429–460, 2001; Seyedsayamdost in Episteme 12:95–116, 2014). But these studies used college education as a dummy variable for SES. I use the recently developed Great British Class Survey :219–250, 2013) to measure SES. The paper (...) reports evidence against an association between SES and patterns of knowledge ascription, and reports mixed evidence about education effects. (shrink)

The past 15 years occasioned an extraordinary blossoming of research into the cognitive and affective mechanisms that support moral judgment and behavior. This growth in our understanding of moral mechanisms overshadowed a crucial and complementary question, however: How are they learned? As this special issue of the journal Cognition attests, a new crop of research into moral learning has now firmly taken root. This new literature draws on recent advances in formal methods developed in other domains, such as Bayesian inference, (...) reinforcement learning and other machine learning techniques. Meanwhile, it also demonstrates how learning and deciding in a social domain—and especially in the moral domain—sometimes involves specialized cognitive systems. We review the contributions to this special issue and situate them within the broader contemporary literature. Our review focuses on how we learn moral values and moral rules, how we learn about personal moral character and relationships, and the philosophical implications of these emerging models. (shrink)

Experimental philosophy involves subjecting philosophical methods and judgments to empirical scrutiny. I begin by exploring conceptual, confirmational, and empirical factors that limit the significance of experiment-based and survey-based approaches to the evaluation of philosophical epistemic activities. I then consider specific criticisms of experimental philosophy: its experimental conditions lack ecological validity; it wrongly assumes that philosophers rely on psychologized data; it overlooks the reflective and social elements of philosophical case analysis; it misconstrues the importance of both procedural and evaluative forms of (...) philosophical expertise; it incorrectly views psychological bias as incompatible with reliability; and it generalizes to a global, self-defeating skepticism about case judgment. I explain why these criticisms should be understood as converging and interdependent. I also set out a three-level model of philosophical case judgment that frames the criticisms. (shrink)

Appeals to intuitions as evidence in philosophy are challenged by experimental philosophers and other critics. A common response to experimental philosophical criticisms is to hold that only professional philosophers? intuitions count as evidence in philosophy. This ?expert intuitions defence? is inadequate for two reasons. First, recent studies indicate significant variability in professional philosophers? intuitions. Second, the academic literature on professional intuitions gives us reasons to doubt that professional philosophers develop truth-apt intuitions. The onus falls on those who mount the expert (...) intuitions defence to meet these objections because it is implicitly being claimed that training and practice caused professional philosophers to acquire reliably accurate intuitions and we are owed an account of how this transformation takes place. A possible response to this situation is to attempt to reform philosophical practice to improve the quality of intuitions. Another possible response, advocated here, is to avoid appeals to intuitions as evidence. (shrink)

Given the available evidence, I argue that we face considerable uncertainty about free will. In particular, I argue that the available philosophical evidence does not support being highly confident in our theories about the nature of free will, though this does not necessarily mean that we should suspend judgment about either incompatibilism or compatibilism. For those who accept incompatibilism, however, I argue that there is enough uncertainty about libertarian free will that they should suspend judgment about whether we are ever (...) free, if not reject free will entirely. While I do not claim that compatibilists should be similarly agnostic about the existence of free will, I argue that most compatibilist theories are subject to considerable uncertainty as well, so that most compatibilists should be agnostic about how often we act freely. I conclude with a brief discussion of how we might address these issues going forward. (shrink)

Experimental philosophers have empirically challenged the connection between intuition and philosophical expertise. This paper reviews these challenges alongside other research findings in cognitive science on expert performance and argues for three claims. First, evidence taken to challenge philosophical expertise may also be explained by the well-researched failures and limitations of genuine expertise. Second, studying the failures and limitations of experts across many fields provides a promising research program upon which to base a new model of philosophical expertise. Third, a model (...) of philosophical expertise based on the limitations of genuine experts may suggest a series of constraints on the reliability of professional philosophical intuition. Even when the experts all agree, they may well be mistaken. — Bertrand Russell, On the Value of Scepticism. (shrink)

One rather common way of doing philosophy involves what is called “the method of cases,” where philosophers design hypothetical cases and use what we think about those cases—our “philosophical intuitions”—as evidence that certain philosophical theories are true or false, and as reasons for believing that those theories are true or false. This way of doing philosophy has been challenged in recent years on the basis of both general epistemological considerations and more specific methodological concerns. These methodological concerns have focused not (...) on whether philosophical intuitions can be a good source of evidence, but rather on whether they can be used in the ways that they currently are used in actual philosophical practice given how little we know about them and some of the worrisome things that we have learned about them in recent years. My goal here is to provide you with a short introduction to this way of challenging to how philosophers use the method of cases, and to walk you through some of the more popular ways of responding to this kind of methodological challenge and some of their shortcomings. (shrink)

Disagreement is a hot topic right now in epistemology, where there is spirited debate between epistemologists who argue that we should be moved by the fact that we disagree and those who argue that we need not. Both sides to this debate often use what is commonly called “the method of cases,” designing hypothetical cases involving peer disagreement and using what we think about those cases as evidence that specific normative theories are true or false, and as reasons for believing (...) as such. With so much weight being given in the epistemology of disagreement to what people think about cases of peer disagreement, our goal in this paper is to examine what kinds of things might shape how people think about these kinds of cases. We will show that two different kinds of framing effect shape how people think about cases of peer disagreement, and examine both what this means for how the method of cases is used in the epistemology of disagreement and what this might tell us about the role that motivated cognition is playing in debates about which normative positions about peer disagreement are right and wrong. (shrink)

The field of experimental philosophy has received considerable attention, essentially for producing results that seem highly counter-intuitive and at the same time question some of the fundamental methods used in philosophy. A substantial part of this attention has focused on the role of intuitions in philosophical methodology. One of the major contributions of experimental philosophy on this topic has been concrete evidence in support of intuitional diversity; the idea that intuitions vary systematically depending on variables such as ethnicity, socioeconomic background, (...) or gender. Because of the important implications, these findings have been the subject of extensive debate. Despite the seeming significance of the findings and despite all the debates that the experimental philosophy movement has prompted, what has not been examined systematically is the reproducibility of the results. Instead, the reported findings have been simply accepted as established facts. We set out to replicate a wide range of experiments and surprisingly failed to reproduce many of the reported findings, some of which are from the most cited and attention grabbing papers of the field. We draw two conclusions from our findings. The first is that the instability of intuitions has been exaggerated by experimental philosophers. Intuitions appear to be more uniform across different demographic groups. The argument that intuitions need to be discarded because they depend on arbitrary factors such as ethnicity, socioeconomic background, or gender does not seem tenable anymore. The second conclusion is that experimental philosophy needs a better system to ensure the reproducibility of published findings. The current research-publication system of various empirical fields, especially those employing statistical methods, leads to an overproduction of false-positive findings in the published literature. Unless changes are made to the current research-publication system, this overproduction is likely to continue, in experimental philosophy as well as other disciplines. (shrink)

We examined the effects of framing and order of presentation on professional philosophers’ judgments about a moral puzzle case (the “trolley problem”) and a version of the Tversky & Kahneman “Asian disease” scenario. Professional philosophers exhibited substantial framing effects and order effects, and were no less subject to such effects than was a comparison group of non-philosopher academic participants. Framing and order effects were not reduced by a forced delay during which participants were encouraged to consider “different variants of the (...) scenario or different ways of describing the case”. Nor were framing and order effects lower among participants reporting familiarity with the trolley problem or with loss-aversion framing effects, nor among those reporting having had a stable opinion on the issues before participating the experiment, nor among those reporting expertise on the very issues in question. Thus, for these scenario types, neither framing effects nor order effects appear to be reduced even by high levels of academic expertise. (shrink)

This dissertation examines the recent arguments against the “Centrality” thesis—the thesis that intuition plays central evidential roles in philosophical inquiry—and their implications for the negative program in experimental philosophy. Two types of objections to Centrality are discussed. First, there are some objections which turn out to only work against Centrality when it is taken as a potential form of philosophical exceptionalism. I respond by showing that negative experimental philosophy doesn’t need the assumption that philosophy is distinctive in its reliance on (...) intuitions. Second, there are some objections which turn out to be related to some particular view concerning the nature of evidence. In response, I distinguish between several different versions of Centrality, and argue that the version of Centrality that experimentalists need remains innocuous. Though none of the arguments against Centrality works as intended, I agree with its opponents that negative experimental philosophers have mischaracterized philosophical practice in a way which has problematic consequences for at least some versions of their argument. Specifically, I contend that philosophical practice grants important evidential status to general intuitions and context-rich intuitions, but extant experimental studies have almost exclusively focused on case intuitions and context-poor intuitions. I conclude that those who work on the negative program of experimental philosophy need to more carefully examine how philosophers actually use intuition in their practice. (shrink)