This chapter proceeds from the standard picture of the relation between intuitions and experimental philosophy: the alleged evidential role of intuitions about hypothetical cases, and experimental philosophy’s challenge to these judgments, based on their variation with philosophically irrelevant factors. I will survey some of the main defenses of this standard picture against the x-phi challenge, most of which fail. Concerning the most popular defense, the expertise defense, I will draw the bleak conclusion that intuitive expertise of the envisaged kind is (...) largely a myth. Next, I will consider the mischaracterization objection, which has mainly been developed by Deutsch and Cappelen on the basis of textual evidence: that philosophers do not appeal to intuitions as evidence for their case judgments, but instead argue for them. This would render the x-phi challenge mostly irrelevant, due to its focus on intuitions about hypothetical cases. I will then consider a few instructive replies to the mischaracterization objection, which are all unconvincing on further inspection. Finally, I will discuss some potential normative consequences of the mischaracterization objection, and I will argue that it recommends a shift away from the excessive focus on intuitions about cases in metaphilosophy and experimental philosophy, towards more work on the role of argumentation in the method of cases. More speculatively, I claim that philosophers should always argue for their case judgments, even if they have strong intuitions about them, because an argument-based methodology would be more transparent and philosophically fruitful than one that mainly relies on intuition. (shrink)

Deutsch 2010 (The Review of Philosophy and Psychology 1: 447–460) claims that hypothetical scenarios are evaluated using arguments, not intuitions, and therefore experiments on intuitions are philosophically inconsequential. Using the Gettier case as an example, he identifies three arguments that are supposed to point to the right response to the case. In the paper, I present the results of studies ran on Polish, Indian, Spanish, and American participants that suggest that there’s no deep difference between evaluating the Gettier case with (...) intuitions and evaluating it with Deutsch’s arguments. Specifically, I argue that one would find these arguments persuasive if and only if one is already disposed to exhibit the relevant intuition. (shrink)

This article offers a critique of research practices typical of experimental philosophy. To that end, it presents a review of methodological issues that have proved crucial to the quality of research in the biobehavioral sciences. It discusses various shortcomings in the experimental philosophy literature related to (1) the credibility of self-report questionnaires, (2) the validity and reliability of measurement, (3) the adherence to appropriate procedures for sampling, random assignment, and handling of participants, and (4) the meticulousness of study reporting. It (...) argues that the future standing of experimental philosophy will hinge upon improvements in research methods. (shrink)

Some experimental philosophers have criticized the standard intuition-based methodology in philosophy. One worry about this criticism is that it is just another version of the general skepticism toward the evidential efficacy of intuition, and is thereby subject to the same difficulties. In response, Weinberg provides a more nuanced version of the criticism by targeting merely the philosophical use of intuition. I contend that, though Weinberg’s approach differs from general skepticism about intuition, its focus on philosophical practices gives rise to a (...) new difficulty. Most extant experimental surveys investigate intuitions about particular cases through vignettes giving little contextual information. However, philosophical practices crucially depend on intuitions about general claims and typically provide more contextual background. I argue that, due to these two differences between surveys’ and philosophers’ appeals to intuition, Weinberg’s critique lacks enough support from current experimental data. I conclude that experimental philosophers who engage in the negative program should pay more attention on testing philosophers’ use of general intuitions and context-rich intuitions. (shrink)

Although experimental philosophy is now over a decade old, it has only recently been introduced to the domain of philosophical aesthetics. So why is there already a need to defend it? Because, as I argue in this paper, we can anticipate the three main types of objection generally addressed to experimental philosophy and show that none of them concern experimental philosophers in aesthetics. I begin with some general considerations about experimental philosophy and its, sometimes conflicting, characteristics. This framework is designed (...) to help me situate the experimental practice in aesthetics within the general movement. I then present the objections and respond to them in turn. Their failure should convince aestheticians to embrace the practice early on and opponents of experimental philosophy to revise their usual objections before addressing them to experimental philosophers in aesthetics. (shrink)

Some recent researches in experimental philosophy have posed a problem for philosophers’ appeal to intuition (hereinafter referred to as PAI); the aim of this paper is to offer an answer to this challenge. The thesis against PAI implies that, given some experimental results, intuition does not seem to be a reliable epistemic source, and —more importantly— given the actual state of knowledge about its operation, we do not have sufficient resources to mitigate its errors and thus establish its reliability. That (...) is why PAI is hopeless. Throughout this paper I will defend my own conception of PAI, which I have called the Deliberative Conception, and consequently, I will defend intersubjective agreement as a means to mitigate PAI errors, offering empirical evidence from recent studies on the Argumentative Theory of Reason that favor the conception I defend here. Finally, I will reply to some objections that might arise against the Deliberative Conception, which will lead me to discuss some metaphilosophical issues that are significantly relevant for the future of the dispute about the appeal to intuition. (shrink)

Similarly to other accounts of disease, Christopher Boorse’s Biostatistical Theory (BST) is generally presented and considered as conceptual analysis, that is, as making claims about the meaning of currently used concepts. But conceptual analysis has been convincingly critiqued as relying on problematic assumptions about the existence, meaning, and use of concepts. Because of these problems, accounts of disease and health should be evaluated not as claims about current meaning, I argue, but instead as proposals about how to define and use (...) these terms in the future, a methodology suggested by Quine and Carnap. I begin this article by describing problems with conceptual analysis and advantages of “philosophical explication,” my favored approach. I then describe two attacks on the BST that also question the entire project of defining “disease.” Finally, I defend the BST as a philosophical explication by showing how it could define useful terms for medical science and ethics. (shrink)

The so-called expertise defence against sceptical challenges from experimental philosophy has recently come under attack: there are several studies claiming to have found direct evidence that philosophers’ judgments in thought experiments are susceptible to erroneous effects. In this paper, we distinguish between the customary ‘immune experts’ version of the expertise defence and an ‘informed experts’ version. On the informed expertise defence, we argue, philosophers’ judgments in thought experiments could be preferable to those by the folk even if it were true (...) that philosophers’ judgments are no less immune to confounders than judgments by the folk are. We present results from an experimental study comparing philosophers and non-philosophers (n = 484), which support this version of the expertise defence. (shrink)

A key challenge in experimental social science research is the incentivisation of subjects such that they take the tasks presented to them seriously and answer honestly. If subject responses can be evaluated against an objective baseline, a standard way of incentivising participants is by rewarding them monetarily as a function of their performance. However, the subject area of experimental philosophy is such that this mode of incentivisation is not applicable as participant responses cannot easily be scored along a true-false spectrum (...) by the experimenters. We claim that experimental philosophers’ neglect of and claims of unimportance about incentivisation mechanisms in their surveys and experiments has plausibly led to poorer data quality and worse conclusions drawn overall, potentially threatening the research programme of experimental philosophy in the long run. As a solution to this, we propose the adoption of the Bayesian Truth Serum, an incentive-compatible mechanism used in economics and marketing, designed for eliciting honest responding in subjective data designs by rewarding participant answers that are surprisingly common. We argue that the Bayesian Truth Serum (i) adequately addresses the issue of incentive compatibility in subjective data research designs and (ii) that it should be applied to the vast majority of research in experimental philosophy. Further, we (iii) provide an empirical application of the method, demonstrating its qualified impact on the distribution of answers on a number of standard experimental philosophy items and outline guidance for researchers aiming to apply this mechanism in future research by specifying the additional costs and design steps involved. (shrink)

A key challenge in experimental social science research is the incentivisation of subjects such that they take the tasks presented to them seriously and answer honestly. If subject responses can be evaluated against an objective baseline, a standard way of incentivising participants is by rewarding them monetarily as a function of their performance. However, the subject area of experimental philosophy is such that this mode of incentivisation is not applicable as participant responses cannot easily be scored along a true-false spectrum (...) by the experimenters. We claim that experimental philosophers’ neglect of and claims of unimportance about incentivisation mechanisms in their surveys and experiments has plausibly led to poorer data quality and worse conclusions drawn overall, potentially threatening the research programme of experimental philosophy in the long run. As a solution to this, we propose the adoption of the Bayesian Truth Serum, an incentive-compatible mechanism used in economics and marketing, designed for eliciting honest responding in subjective data designs by rewarding participant answers that are surprisingly common. We argue that the Bayesian Truth Serum (i) adequately addresses the issue of incentive compatibility in subjective data research designs and (ii) that it should be applied to the vast majority of research in experimental philosophy. Further, we (iii) provide an empirical application of the method, demonstrating its qualified impact on the distribution of answers on a number of standard experimental philosophy items and outline guidance for researchers aiming to apply this mechanism in future research by specifying the additional costs and design steps involved. (shrink)

Proponents of the “negative program” in experimental philosophy have argued that judgements in philosophical cases, also known as case judgements, are unreliable and that the method of cases should be either strongly constrained or even abandoned. Here we put one of the main proponent’s account of why philosophical cases may cause the unreliability of case judgements to the test. We conducted our test with thought experiments from physics, which exhibit the exact same supposedly “disturbing characteristics” of philosophical cases.

Recent empirical work appears to suggest that the moral intuitions of professional philosophers are just as vulnerable to distorting psychological factors as are those of ordinary people. This paper assesses these recent tests of the ‘expertise defense’ of philosophical intuition. I argue that the use of familiar cases and principles constitutes a methodological problem. Since these items are familiar to philosophers, but not ordinary people, the two subject groups do not confront identical cognitive tasks. Reflection on this point shows that (...) these findings do not threaten philosophical expertise—though we can draw lessons for more effective empirical tests. (shrink)

The evidential value of moral intuitions has been challenged by psychological work showing that the intuitions of ordinary people are affected by distorting factors. One reply to this challenge, the expertise defence, claims that training in philosophical thinking confers enhanced reliability on the intuitions of professional philosophers. This defence is often expressed through analogy: since we do not allow doubts about folk judgments in domains like mathematics or physics to undermine the plausibility of judgments by experts in these domains, we (...) also should not do so in philosophy. In this paper I clarify the logic of the analogy strategy, and defend it against recent challenges by Jesper Ryberg. The discussion exposes an interesting divide: while Ryberg’s challenges may weaken analogies between morality and domains like mathematics, they do not affect analogies to other domains, such as physics. I conclude that the expertise defence can be supported by analogical means, though care is required in selecting an appropriate analog. I discuss implications of this conclusion for the expertise defence debate and for study of the moral domain itself. (shrink)

When experimental philosophers carry out studies on thought experiments, some participants are excluded based on certain exclusion criteria, mirroring standard social science vignette methodology. This involves excluding people that do not pay attention or who miscomprehend the scenario presented in thought experiments. However, experimental philosophy studies sometimes exclude an alarmingly high number of participants. We argue that this threatens the external and internal validity of the conclusions being drawn and we show how a simple visualization of thought experiments can reduce (...) exclusion rates significantly. Furthermore, we argue that focus should not merely be on how many are excluded, but also why they are excluded, and we highlight the role of comprehension questions in this regard. Philosophical thought experiments often rely on the acceptance of certain key premises that may be regarded contestable, and asking comprehension questions involving such key assumptions could be problematic as that may result in some participants being inadvertently excluded from the study, potentially creating a selection bias. (shrink)

An increasing number of moral realists and anti-realists have recently attempted to support their views by appeal to science. Arguments of this kind are typically criticized on the object-level. In addition, however, one occasionally also comes across a more sweeping metatheoretical skepticism. Scientific contributions to the question of the existence of objective moral truths, it is claimed, are impossible in principle; most prominently, because such arguments impermissibly derive normative from descriptive propositions, such arguments beg the question against non-naturalist moral realism, (...) science cannot inform conceptual accounts of moral judgements, and the conceptual is logically prior to the empirical. My main aim in this paper is to clarify and critically assess these four objections. Moreover, based on this assessment, I will formulate four general requirements that science-based arguments in favor of moral realism and anti-realism should meet. It will turn out that these arguments are limited in several ways, and that some existing arguments have been unsound. Yet it is still possible in principle for the empirical sciences to contribute to the moral realism/anti-realism debate. (shrink)

Lay persons may have intuitions about morality's objectivity. What do these intuitions look like? And what are their causes and consequences? In recent years, an increasing number of scholars have begun to investigate these questions empirically. This article presents and assesses the resulting area of research as well as its potential philosophical implications. First, we introduce the methods of empirical research on folk moral objectivism. Second, we provide an overview of the findings that have so far been made. Third, we (...) raise a number of methodological worries that cast doubt upon these findings. And fourth, we discuss ways in which lay persons' intuitions aboutmoral objectivity may bear on philosophical claims. (shrink)

Recent work in experimental philosophy has indicated that intuitions may be subject to several forms of bias, thereby casting doubt on the viability of intuition as an evidential source in philosophy. A common reply to these findings is the ‘expertise defense’ – the claim that although biases may be found in the intuitions of non-philosophers, persons with expertise in philosophy will be resistant to these biases. Much debate over the expertise defense has centered over the question of the burden of (...) proof; must defenders of expertise provide empirical evidence of its existence, or should we grant the existence of philosophical expertise as a ‘default’ assumption? Defenders have frequently appealed to analogy with other fields; since expertise clearly exists in, e.g., the sciences, we are entitled to assume its existence in philosophy. Recently, however, experimentalists have begun to provide empirical evidence that biases in intuition extend even to philosophers. Though these findings don't yet suffice to defeat the default assumption of expertise the analogy argument motivates, they do force any proponent of the analogy argument to provide more specific and empirically informed proposals for the possible nature of philosophical expertise. (shrink)

The “expertise defense” is the claim that philosophers have special expertise that allows them to resist the biases suggested by the findings of experimental philosophers. Typically, this defense is backed up by an analogy with expertise in science or other academic fields. Recently, however, studies have begun to suggest that philosophers' intuitions may be just as subject to inappropriate variation as those of the folk. Should we conclude that the expertise defense has been debunked? I'll argue that the analogy with (...) science still motivates a default assumption of philosophical expertise; however, the expertise so motivated is not expertise in intuition, and its existence would not suffice to answer the experimentalist challenge. I'll also suggest that there are deep parallels between the current methodological crisis in philosophy and the decline of introspection-based methods in psychology in the early twentieth century. The comparison can give us insight into the possible future evolution of philosoph.. (shrink)

The “expertise defense” is the claim that philosophers have special expertise that allows them to resist the biases suggested by the findings of experimental philosophers. Typically, this defense is backed up by an analogy with expertise in science or other academic fields. Recently, however, studies have begun to suggest that philosophers' intuitions may be just as subject to inappropriate variation as those of the folk. Should we conclude that the expertise defense has been debunked? I'll argue that the analogy with (...) science still motivates a default assumption of philosophical expertise; however, the expertise so motivated is not expertise in intuition, and its existence would not suffice to answer the experimentalist challenge. I'll also suggest that there are deep parallels between the current methodological crisis in philosophy and the decline of introspection-based methods in psychology in the early twentieth century. The comparison can give us insight into the possible future evolution of philosophical methodology. (shrink)

Experimental philosophy, at least in its ‘negative’ variety, has standardly been portrayed as presenting a dramatic challenge to traditional philosophical methodology. As such, it has prompted a large variety of counter-arguments and defenses of intuition. In this paper, I argue that many of these objections to experimental philosophy rest on various oversimplifications that both experimental philosophers and their opponents have made regarding intuitions and philosophical methodology. Once these oversimplifications are abandoned, I argue that the experimentalist critique of current philosophical methods (...) becomes somewhat less dramatic, but also much less open to objection. (shrink)

Upon discovering that certain beliefs we hold are contingent on arbitrary features of our background, we often feel uneasy. I defend the proposal that if such cases of contingency anxiety involve defeaters, this is because of the epistemic significance of disagreement. I note two hurdles to our accepting this Disagreement Hypothesis. Firstly, some cases of contingency anxiety apparently involve no disagreement. Secondly, the proposal may seem to make our awareness of the influence of arbitrary background factors irrelevant in determining whether (...) to revise our beliefs. I show that each of these problems can be successfully accommodated by the Disagreement Hypothesis. (shrink)

Upon discovering that certain beliefs we hold are contingent on arbitrary features of our background, we often feel uneasy. I defend the proposal that if such cases of contingency anxiety involve defeaters, this is because of the epistemic significance of disagreement. I note two hurdles to our accepting this Disagreement Hypothesis. Firstly, some cases of contingency anxiety apparently involve no disagreement. Secondly, the proposal may seem to make our awareness of the influence of arbitrary background factors irrelevant in determining whether (...) to revise our beliefs. I show that each of these problems can be successfully accommodated by the Disagreement Hypothesis. (shrink)

In recent years, a number of philosophers have conducted empirical studies that survey people's intuitions about various subject matters in philosophy. Some have found that intuitions vary accordingly to seemingly irrelevant facts: facts about who is considering the hypothetical case, the presence or absence of certain kinds of content, or the context in which the hypothetical case is being considered. Our research applies this experimental philosophical methodology to Judith Jarvis Thomson's famous Loop Case, which she used to call into question (...) the validity of the intuitively plausible Doctrine of Double Effect. We found that intuitions about the Loop Case vary according to the context in which the case is considered. We contend that this undermines the supposed evidential status of intuitions about the Loop Case. We conclude by considering the implications of our findings for philosophers who rely on the Loop Case to make philosophical arguments and for philosophers who use intuitions in general. (shrink)

Recent evidence suggests that participants without extensive training in philosophy (so-called lay people) have difficulties responding consistently when confronted with Robert Nozick’s Experience Machine thought experiment. For example, some of the participants who reject the experience machine for themselves would still advise a stranger to enter the machine permanently. This and similar findings have been interpreted as evidence for implicit biases that prevent lay people from making rational decisions about whether the experience machine is preferable to real life, which might (...) have consequences for one of the strongest objections to philosophical hedonism (the view that pleasure is the only intrinsic value). Against this consequence, it has been argued that expert philosophers are immune to such biases (the so-called expertise defense). In this paper, I report empirical evidence against this expertise defense. (shrink)

Champions of the methodological movement of experimental philosophy have challenged the long-standing practice of relying on intuitive verdicts on cases in philosophical inquiry. They argue that th...

Philosophical analysis was the central preoccupation of 20th-century analytic philosophy. In the contemporary methodological debate, however, it faces a number of pressing external and internal challenges. While external challenges, like those from experimental philosophy or semantic externalism, have been extensively discussed, internal challenges to philosophical analysis have received much less attention. One especially vexing internal challenge is that the success conditions of philosophical analysis are deeply unclear. According to the standard textbook view, a philosophical analysis aims at a strict biconditional (...) that captures the necessary and sufficient conditions for membership in the relevant category. The textbook view arguably identifies a necessary condition on successful philosophical analyses, but understood as a sufficient condition it is untenable, as I will argue in this paper. To this end, I first uncover eight conditions of adequacy on successful philosophical analyses, some of which have rarely been spelled out in detail. As we shall see, even sophisticated alternatives to the textbook view fail to accommodate some of these conditions. I then propose the concept grounding view as a more promising account of philosophical analysis. According to this view, successful philosophical analyses require necessary biconditionals that are constrained by grounding relations among the concepts involved. Apart from providing a satisfactory account of philosophical analysis in its own right, the concept grounding view is also able to meet the challenge that the success conditions of philosophical analysis are problematically unclear. (shrink)

Experimental restrictionists have challenged philosophers’ reliance on intuitions about thought experiment cases based on experimental findings. According to the expertise defense, only the intuitions of philosophical experts count—yet the bulk of experimental philosophy consists in studies with lay people. In this paper, we argue that direct strategies for assessing the expertise defense are preferable to indirect strategies. A direct argument in support of the expertise defense would have to show: first, that there is a significant difference between expert and lay (...) intuitions; second, that expert intuitions are superior to lay intuitions; and third, that expert intuitions accord with the relevant philosophical consensus. At present, there is only little experimental evidence that bears on these issues. To advance the debate, we conducted two new experiments on intuitions about knowledge with experts and lay people. Our results suggest that the intuitions of epistemological experts are superior in some respects, but they also pose an unexpected challenge to the expertise defense. Most strikingly, we found that even epistemological experts tend to ascribe knowledge in fake-barn-style cases. This suggests that philosophy, as a discipline, might fail to adequately map the intuitions of its expert practitioners onto a disciplinary consensus. (shrink)

According to the ‘expertise defence’, experimental findings suggesting that intuitive judgments about hypothetical cases are influenced by philosophically irrelevant factors do not undermine their evidential use in (moral) philosophy. This defence assumes that philosophical experts are unlikely to be influenced by irrelevant factors. We discuss relevant findings from experimental metaphilosophy that largely tell against this assumption. To advance the debate, we present the most comprehensive experimental study of intuitive expertise in ethics to date, which tests five well- known biases of (...) judgment and decision-making among expert ethicists and laypeople. We found that even expert ethicists are affected by some of these biases, but also that they enjoy a slight advantage over laypeople in some cases. We discuss the implications of these results for the expertise defence, and conclude that they still do not support the defence as it is typically presented in (moral) philosophy. (shrink)

In this paper, we first briefly survey the main responses to the challenge that experimental philosophy poses to the method of cases, given the common assumption that the latter is crucially based on intuitive judgments about cases. Second, we discuss two of the most popular responses in more detail: the expertise defense and the mischaracterization objection. Our take on the expertise defense is that the available empirical data do not support the claim that professional philosophers enjoy relevant expertise in their (...) intuitive judgments about cases. In contrast, the mischaracterization objection seems considerably more promising than its largely negative reception has suggested. We argue that the burden of proof is thus on philosophers who still hold that the method of cases crucially relies on intuitive judgments about cases. Finally, we discuss whether conceptual engineering provides an alternative to the method of cases in light of the challenge from experimental philosophy. We argue that this is not clearly the case, because conceptual engineering also requires descriptive information about the concepts it aims to improve. However, its primarily normative perspective on our concepts makes it largely orthogonal to the challenge from experimental philosophy, and it can also benefit from the empirical methods of the latter. (shrink)

In The Philosophy of Philosophy, Tim Williamson has offered a sophisticated account of thought experiments and of modal epistemology. More recently, he has also engaged in a variant of the so-called ‘expertise defence’ of traditional philosophical methodology. In this paper I argue that if Williamson’s account of thought experiments and of modal epistemology is right, this seriously undermines his version of the expertise defence.

Philosophers are often credited with particularly well-developed conceptual skills. The ‘expertise objection’ to experimental philosophy builds on this assumption to challenge inferences from findings about laypeople to conclusions about philosophers. We draw on psycholinguistics to develop and assess this objection. We examine whether philosophers are less or differently susceptible than laypersons to cognitive biases that affect how people understand verbal case descriptions and judge the cases described. We examine two possible sources of difference: Philosophers could be better at deploying concepts, (...) and this could make them less susceptible to comprehension biases (‘linguistic expertise objection’). Alternatively, exposure to different patterns of linguistic usage could render philosophers vulnerable to a fundamental comprehension bias, the linguistic salience bias, at different points (‘linguistic usage objection’). Together, these objections mount a novel ‘master argument’ against experimental philosophy. To develop and empirically assess this argument, we employ corpus analysis and distributional semantic analysis and elicit plausibility ratings from academic philosophers and psychology undergraduates. Our findings suggest philosophers are better at deploying concepts than laypeople but are susceptible to the linguistic salience bias to a similar extent and at similar points. We identify methodological consequences for experimental philosophy and for philosophical thought experiments. (shrink)

This paper provides new tools for philosophical argument analysis and fresh empirical foundations for ‘critical’ ordinary language philosophy. Language comprehension routinely involves stereotypical inferences with contextual defeaters. J.L. Austin’s Sense and Sensibilia first mooted the idea that contextually inappropriate stereotypical inferences from verbal case-descriptions drive some philosophical paradoxes; these engender philosophical problems that can be resolved by exposing the underlying fallacies. We build on psycholinguistic research on salience effects to explain when and why even perfectly competent speakers cannot help making (...) stereotypical inferences which are contextually inappropriate. We analyse a classical paradox about perception, suggest it relies on contextually inappropriate stereotypical inferences from appearance-verbs, and show that the conditions we identified as leading to contextually inappropriate stereotypical inferences are met in formulations of the paradox. Three experiments use a forced-choice plausibility-ranking task to document the predicted inappropriate inferences, in English, German, and Japanese. The cross-linguistic study allows us to assess the wider relevance of the proposed analysis. Our findings open up new perspectives for ‘evidential’ experimental philosophy. (shrink)

Perhaps personality traits substantially influence one’s philosophically relevant intuitions. This suggestion is not only possible, it is consistent with a growing body of empirical research: Personality traits have been shown to be systematically related to diverse intuitions concerning some fundamental philosophical debates. We argue that this fact, in conjunction with the plausible principle that almost all adequate philosophical views should take into account all available and relevant evidence, calls into question some prominent approaches to traditional philosophical projects. To this end, (...) we present the Philosophical Personality Argument (PPA). We explain how it supports the growing body of evidence challenging some of the uses of intuitions in philosophy, and we defend it from some criticisms of empirically based worries about intuitions in philosophy. We conclude that the current evidence indicates that the PPA is sound, and thus many traditional philosophical projects that use intuitions must become substantially more empirically oriented. (shrink)

We review evidence showing that disagreement in folk and expert philosophical intuitions can be predicted by global, heritable personality traits. The review focuses on recent studies of intuitions about free will, ethics, and intentional action. These findings are philosophically important because they suggest that while some projects cannot be done, other projects must take individual differences in philosophical character into account. But care needs to be taken when interpreting the implications of these individual differences. We illustrate one way that these (...) differences have been abused. We then illustrate two ways that these findings can be legitimately used to help illuminate philosophical issues. Given the large and readily available body of evidence, neglect of persistent and predictable philosophical differences is irresponsible. (shrink)

We examined the effects of order of presentation on the moral judgments of professional philosophers and two comparison groups. All groups showed similar-sized order effects on their judgments about hypothetical moral scenarios targeting the doctrine of the double effect, the action-omission distinction, and the principle of moral luck. Philosophers' endorsements of related general moral principles were also substantially influenced by the order in which the hypothetical scenarios had previously been presented. Thus, philosophical expertise does not appear to enhance the stability (...) of moral judgments against this presumably unwanted source of bias, even given familiar types of cases and principles. (shrink)

In this paper, we present the results of two surveys that investigate subjects’ judgments about what can be known or justifiably believed about lottery outcomes on the basis of statistical evidence, testimonial evidence, and “mixed” evidence, while considering possible anchoring and priming effects. We discuss these results in light of seven distinct hypotheses that capture various claims made by philosophers about lay people’s lottery judgments. We conclude by summarizing the main findings, pointing to future research, and comparing our findings to (...) recent studies by Turri and Friedman. (shrink)

In what sense, if any, are philosophers experts in their domain of research and what could philosophical expertise be? The above questions are particularly pressing given recent methodological disputes in philosophy. The so-called expertise defense recently proposed as a reply to experimental philosophers postulates that philosophers are experts qua having improved intuitions. However, this model of philosophical expertise has been challenged by studies suggesting that philosophers’ intuitions are no less prone to biases and distortions than intuitions of non-philosophers. Should we (...) then give up on the idea that philosophers possess some sort of expertise? In this paper, I argue that instead of focusing on intuitions, we may understand the relevant results of philosophical practice more broadly and investigate the other kind of expertise they would require. My proposal is inspired by a prominent approach to investigating expert performance from psychology and suggests where and how to look for expertise in the results characteristic of philosophical practice. In developing this model, I discuss the following three candidates for such results: arguments, theories, and distinctions. Whether philosophers could be shown to be expert intuiters or not, there are interesting domains where we could look for philosophical expertise, beyond intuitions. (shrink)

Financial incentives, learning, group consultation, and increased experimental control are among the experimental techniques economists have successfully used to deflect the behavioral challenge posed by research conducted by such scholars as Tversky and Kahneman. These techniques save the economic armchair to the extent that they align laypeople judgments with economic theory by increasing cognitive effort and reflection in experimental subjects. It is natural to hypothesize that a similar strategy might work to address the experimental or restrictionist challenge to armchair philosophy. (...) To test this hypothesis, a randomized controlled experiment was carried out, as well as two lab experiments. Three types of knowledge attribution tasks were used. No support for the hypothesis was found. The paper describes the close similarities between the economist’s response to the behavioral challenge, and the expertise defense against the experimental challenge, and presents the experiments, results, and an array of robustness checks. The upshot is that these results make the experimental challenge all the more forceful. (shrink)

This paper presents new evidence on the impact of socioeconomic status and education on knowledge attribution. I examine a variety of cases, including vignettes where agents have been Gettiered, have false beliefs, and possess knowledge. Early work investigated whether SES might be associated with knowledge attribution :429–460, 2001; Seyedsayamdost in Episteme 12:95–116, 2014). But these studies used college education as a dummy variable for SES. I use the recently developed Great British Class Survey :219–250, 2013) to measure SES. The paper (...) reports evidence against an association between SES and patterns of knowledge ascription, and reports mixed evidence about education effects. (shrink)

Experimental philosophers have empirically challenged the connection between intuition and philosophical expertise. This paper reviews these challenges alongside other research findings in cognitive science on expert performance and argues for three claims. First, evidence taken to challenge philosophical expertise may also be explained by the well-researched failures and limitations of genuine expertise. Second, studying the failures and limitations of experts across many fields provides a promising research program upon which to base a new model of philosophical expertise. Third, a model (...) of philosophical expertise based on the limitations of genuine experts may suggest a series of constraints on the reliability of professional philosophical intuition. Even when the experts all agree, they may well be mistaken. — Bertrand Russell, On the Value of Scepticism. (shrink)

Studies in experimental philosophy claim to document intuition variation. Some studies focus on demographic group-variation; Colaçoet al., for example, claim that age generates intuition variation regarding knowledge attribution in a fake-barn scenario. Other studies claim to show intuition variation when comparing the intuition of philosophers to that of non-philosophers. The main focus has been on documenting intuition variation rather than uncovering what underlying factor(s) may prompt such a phenomenon. We explore a number of suggested explanatory hypotheses put forth by Colaçoet (...) al., as well as an attempt to test Sosa's claim that intuition variance is a result of people ‘filling in the details’ of a thought experiment differently from one another. We show (i) that people respond consistently across conditions aimed at ‘filling in the details’ of thought experiments, (ii) that risk attitude does not seem relevant to knowledge ascription, (iii) that people's knowledge ascriptions do not vary due to views about defeasibility of knowledge. Yet, (iv) we find no grounds to reject that a large proportion of people appear to adhere to so-called subjectivism about knowledge, which may explain why they generally have intuitions about the fake-barn scenario that vary from those of philosophers. (shrink)

Studies in experimental philosophy claim to document intuition variation. Some studies focus on demographic group-variation; Colaço et al., for example, claim that age generates intuition variation regarding knowledge attribution in a fake-barn scenario. Other studies claim to show intuition variation when comparing the intuition of philosophers to that of non-philosophers. The main focus has been on documenting intuition variation rather than uncovering what underlying factor(s) may prompt such a phenomenon. We explore a number of suggested explanatory hypotheses put forth by (...) Colaço et al., as well as an attempt to test Sosa's claim that intuition variance is a result of people ‘filling in the details’ of a thought experiment differently from one another. We show (i) that people respond consistently across conditions aimed at ‘filling in the details’ of thought experiments, (ii) that risk attitude does not seem relevant to knowledge ascription, (iii) that people's knowledge ascriptions do not vary due to views about defeasibility of knowledge. Yet, (iv) we find no grounds to reject that a large proportion of people appear to adhere to so-called subjectivism about knowledge, which may explain why they generally have intuitions about the fake-barn scenario that vary from those of philosophers. (shrink)

When experimental philosophers carry out studies on thought experiments, some participants are excluded based on certain exclusion criteria, mirroring standard social science vignette methodology. This involves excluding people that do not pay attention or who miscomprehend the scenario presented in thought experiments. However, experimental philosophy studies sometimes exclude an alarmingly high number of participants. We argue that this threatens the external and internal validity of the conclusions being drawn and we show how a simple visualization of thought experiments can reduce (...) exclusion rates significantly. Furthermore, we argue that focus should not merely be on how many are excluded, but also why they are excluded, and we highlight the role of comprehension questions in this regard. Philosophical thought experiments often rely on the acceptance of certain key premises that may be regarded contestable, and asking comprehension questions involving such key assumptions could be problematic as that may result in some participants being inadvertently excluded from the study, potentially creating a selection bias. (shrink)

The time has come to consider whether experimental philosophy’s (“x-phi”) early arguments, debates, and conceptual frameworks, that may have worn well in its early days, fit with the diverse range of projects undertaken by experimental philosophers. Our aim is to propose a novel taxonomy for x-phi that identifies four paths from empirical findings to philosophical consequences, which we call the “fourfold route.” We show how this taxonomy can be fruitfully applied even at what one might have taken to be the (...) furthest edges of possible applications of x-phi in metaphysics and formal philosophy. Ultimately, the fourfold route helps us understand a different kind of empirical fact: the development of x-phi itself. (shrink)

In some domains experts perform better than novices, and in other domains experts do not generally perform better than novices. According to empirical studies of expert performance, this is because the former but not the latter domains make available to training practitioners a direct form of learning feedback. Several philosophers resource this empirical literature to cast doubt on the quality of philosophical expertise. They claim that philosophy is like the dubious domains in that it does not make available the good, (...) direct kind of learning feedback, and thus there are empirical grounds for doubting the epistemic quality of philosophical expertise. I examine the empirical studies that are purportedly bad news for professional philosophers. On the basis of that examination, I provide three reasons why the empirical study of non-philosophical expertise does not undermine the status of philosophical expertise. First, the non-philosophical task-types from which the critics generalize are unrepresentative of relevant philosophical task-types. Second, empirical critiques of non-philosophical experts are often made relative to the performance of linear models—a comparison that is inapt in a philosophical context. Third, the critics fail to discuss findings from the empirical study of non-philosophical expertise that have more favorable implications for the epistemic status of philosophical expertise. In addition to discussing implications for philosophical expertise, this article makes progress in the philosophical analysis of the science of expertise and expert development. (shrink)

Experimental philosophy involves subjecting philosophical methods and judgments to empirical scrutiny. I begin by exploring conceptual, confirmational, and empirical factors that limit the significance of experiment-based and survey-based approaches to the evaluation of philosophical epistemic activities. I then consider specific criticisms of experimental philosophy: its experimental conditions lack ecological validity; it wrongly assumes that philosophers rely on psychologized data; it overlooks the reflective and social elements of philosophical case analysis; it misconstrues the importance of both procedural and evaluative forms of (...) philosophical expertise; it incorrectly views psychological bias as incompatible with reliability; and it generalizes to a global, self-defeating skepticism about case judgment. I explain why these criticisms should be understood as converging and interdependent. I also set out a three-level model of philosophical case judgment that frames the criticisms. (shrink)