The purpose of this chapter is to provide a guide for conducting thought experiments in epistemology effectively. The guide raises several considerations for best practices when using this research method. Several weaknesses in the way thought experiments are conducted are also identified and several suggestions are reviewed for how to improve them. Training in these research techniques promotes more productive scholarship in epistemology, saves time and resources wasted on less efficient approaches, and reduces the risk that researchers are fooling themselves (...) when they use thought experiments in philosophy. (shrink)

Moderate scientism is the view that empirical science can help answer questions in nonscientific disciplines. In this paper, we evaluate moderate scientism in philosophy. We review several ways that science has contributed to research in epistemology, action theory, ethics, philosophy of language, and philosophy of mind. We also review several ways that science has contributed to our understanding of how philosophers make judgments and decisions. Based on this research, we conclude that the case for moderate philosophical scientism is strong: scientific (...) practice has promoted significant progress in philosophy and its further development should be welcomed and encouraged. (shrink)

Deutsch 2010 (The Review of Philosophy and Psychology 1: 447–460) claims that hypothetical scenarios are evaluated using arguments, not intuitions, and therefore experiments on intuitions are philosophically inconsequential. Using the Gettier case as an example, he identifies three arguments that are supposed to point to the right response to the case. In the paper, I present the results of studies ran on Polish, Indian, Spanish, and American participants that suggest that there’s no deep difference between evaluating the Gettier case with (...) intuitions and evaluating it with Deutsch’s arguments. Specifically, I argue that one would find these arguments persuasive if and only if one is already disposed to exhibit the relevant intuition. (shrink)

Many philosophers claim to employ intuitions in their philosophical arguments. Others contest that no such intuitions are used frequently or at all in philosophy. This article suggests and defends a conception of intuitions as part of the philosophical method: intuitions are special types of philosophical assumptions to which we are invited to assent, often as premises in argument, that may serve an independent function in philosophical argument and that are not formed through a purely inferential process. A series of philosophical (...) case studies shows that intuitions in these arguments contain the relevant features. The view has implications for philosophical method, offering a compromise between opponents on the divisive debate of the merits of experimental philosophy: experimental philosophy provides an especially useful role in philosophical assumption analysis. (shrink)

While philosophers generally accept some version of the principle ‘ought’ implies ‘can’, recent work in experimental philosophy and cognitive science provides evidence against a presupposition or a conceptual entailment from ‘ought’ to ‘can’. Here, we review some of this evidence, its effect on particular formulations of the principle, and future directions for cognitive scientists and philosophers.

We examined the effects of framing and order of presentation on professional philosophers’ judgments about a moral puzzle case (the “trolley problem”) and a version of the Tversky & Kahneman “Asian disease” scenario. Professional philosophers exhibited substantial framing effects and order effects, and were no less subject to such effects than was a comparison group of non-philosopher academic participants. Framing and order effects were not reduced by a forced delay during which participants were encouraged to consider “different variants of the (...) scenario or different ways of describing the case”. Nor were framing and order effects lower among participants reporting familiarity with the trolley problem or with loss-aversion framing effects, nor among those reporting having had a stable opinion on the issues before participating the experiment, nor among those reporting expertise on the very issues in question. Thus, for these scenario types, neither framing effects nor order effects appear to be reduced even by high levels of academic expertise. (shrink)

Recent work in experimental philosophy has indicated that intuitions may be subject to several forms of bias, thereby casting doubt on the viability of intuition as an evidential source in philosophy. A common reply to these findings is the ‘expertise defense’ – the claim that although biases may be found in the intuitions of non-philosophers, persons with expertise in philosophy will be resistant to these biases. Much debate over the expertise defense has centered over the question of the burden of (...) proof; must defenders of expertise provide empirical evidence of its existence, or should we grant the existence of philosophical expertise as a ‘default’ assumption? Defenders have frequently appealed to analogy with other fields; since expertise clearly exists in, e.g., the sciences, we are entitled to assume its existence in philosophy. Recently, however, experimentalists have begun to provide empirical evidence that biases in intuition extend even to philosophers. Though these findings don't yet suffice to defeat the default assumption of expertise the analogy argument motivates, they do force any proponent of the analogy argument to provide more specific and empirically informed proposals for the possible nature of philosophical expertise. (shrink)

Experimental philosophy, at least in its ‘negative’ variety, has standardly been portrayed as presenting a dramatic challenge to traditional philosophical methodology. As such, it has prompted a large variety of counter-arguments and defenses of intuition. In this paper, I argue that many of these objections to experimental philosophy rest on various oversimplifications that both experimental philosophers and their opponents have made regarding intuitions and philosophical methodology. Once these oversimplifications are abandoned, I argue that the experimentalist critique of current philosophical methods (...) becomes somewhat less dramatic, but also much less open to objection. (shrink)

Traditional views on philosophical methodology characterize our primary philosophical goal as production of a successful conceptual analysis. The notion of conceptual analysis, however, faces several challenges—from experimental philosophy to more traditional worries such as the paradox of analysis. This paper explores an alternate approach, commonly called conceptual engineering, which aims at recommending conceptual revisions. An important question for the conceptual engineer is as follows: what counts as a case of successful conceptual engineering? What sorts of revisions are permitted, and what (...) sorts are too revisionary? In this paper I examine ‘functional’ approaches to conceptual engineering, ultimately arguing for a ‘radical’ functionalism according to which even revisions which ‘change the subject’ are permitted, and successful re-engineering is constrained only by the requirement that continuity in needed functions of a pre-engineering concept be maintained somewhere in the postengineering conceptual scheme. I further argue that this approach suggests a heightened role, in metaphilosophical discourse, for a neglected epistemic goal—conceptual efficacy. (shrink)

Experimental philosophers have challenged friends of the expertise defense to show that the intuitive judgments of professional philosophers are different from the intuitive judgments of nonphilosophers, and the intuitive judgments of professional philosophers are better than the intuitive judgments of nonphilosophers, in ways that are relevant to the truth or falsity of such judgments. Friends of the expertise defense have responded by arguing that the burden of proof lies with experimental philosophers. This article sketches three arguments which show that both (...) and are probably false. If its arguments are cogent, then shifting the burden of proof is a futile move, since philosophical training makes no difference so far as making intuitive judgments in response to hypothetical cases is concerned. (shrink)

The assumption that philosophers rely on intuitions to justify their philosophical positions has recently come under substantial criticism. In order to protect philosophy from experimental findings that suggest that intuitions are epistemically problematic, a number of metaphilosophers have argued that intuitions play no substantial epistemic role in philosophy. This paper focuses on attempts to deny intuitions’ epistemic role through exegetical analysis of original thought experiments. Using Deutsch’s particularly well-developed exegesis of Gettier’s 10 coin case as an exemplar of this method, (...) I examine the challenges the strategy faces. I argue that intuition denial fails to provide a satisfactory account of how verdicts of thought experiments are justified. Instead, it commits intuition deniers to the conclusion that the arguments of Gettier, Kripke, Thomson, and others are bad arguments. As a result, rather than defusing challenges to the case method raised by experimental philosophers, intuition denial ultimately leads to the same troubling conclusion – that philosophers hold their positions on bad grounds. (shrink)

Studies suggest that people's moral intuitions are sensitive to morally irrelevant factors, such as personal force, spatial distance, ethnicity or nationality. Findings of this sort have been used to construct debunking arguments. The most prominent champion of this approach is Joshua Greene, who has attempted to undermine deontology by showing that deontological intuitions are triggered by morally irrelevant factors. This article offers a critical analysis of such empirically informed debunking arguments from moral irrelevance, and of Greene’s effort to undermine deontology. (...) One problem with arguments from moral irrelevance concerns the hierarchy between the targeted case-specific intuitions and the more general intuitions about which factors are morally (ir)relevant. If we assume that general intuitions always take precedence over case-specific intuitions, arguments from moral irrelevance become dialectically useless. By contrast, if we assume that both case-specific and general intuitions should be taken seriously, particularly sweeping debunking projects, such as Greene’s, are unlikely to go through. Another problem concerns the experimental aspect of arguments from moral irrelevance. Empirically informed arguments from moral irrelevance have been presented as examples of how empirical moral psychology can advance moral theory. But arguments from moral irrelevance can also be constructed from the armchair. And basing these arguments on empirical findings about laypeople’s intuitions is even counterproductive. (shrink)

Champions of the methodological movement of experimental philosophy have challenged the long-standing practice of relying on intuitive verdicts on cases in philosophical inquiry. They argue that th...

Experimental restrictionists have challenged philosophers’ reliance on intuitions about thought experiment cases based on experimental findings. According to the expertise defense, only the intuitions of philosophical experts count—yet the bulk of experimental philosophy consists in studies with lay people. In this paper, we argue that direct strategies for assessing the expertise defense are preferable to indirect strategies. A direct argument in support of the expertise defense would have to show: first, that there is a significant difference between expert and lay (...) intuitions; second, that expert intuitions are superior to lay intuitions; and third, that expert intuitions accord with the relevant philosophical consensus. At present, there is only little experimental evidence that bears on these issues. To advance the debate, we conducted two new experiments on intuitions about knowledge with experts and lay people. Our results suggest that the intuitions of epistemological experts are superior in some respects, but they also pose an unexpected challenge to the expertise defense. Most strikingly, we found that even epistemological experts tend to ascribe knowledge in fake-barn-style cases. This suggests that philosophy, as a discipline, might fail to adequately map the intuitions of its expert practitioners onto a disciplinary consensus. (shrink)

According to the ‘expertise defence’, experimental findings suggesting that intuitive judgments about hypothetical cases are influenced by philosophically irrelevant factors do not undermine their evidential use in (moral) philosophy. This defence assumes that philosophical experts are unlikely to be influenced by irrelevant factors. We discuss relevant findings from experimental metaphilosophy that largely tell against this assumption. To advance the debate, we present the most comprehensive experimental study of intuitive expertise in ethics to date, which tests five well- known biases of (...) judgment and decision-making among expert ethicists and laypeople. We found that even expert ethicists are affected by some of these biases, but also that they enjoy a slight advantage over laypeople in some cases. We discuss the implications of these results for the expertise defence, and conclude that they still do not support the defence as it is typically presented in (moral) philosophy. (shrink)

In The Philosophy of Philosophy, Tim Williamson has offered a sophisticated account of thought experiments and of modal epistemology. More recently, he has also engaged in a variant of the so-called ‘expertise defence’ of traditional philosophical methodology. In this paper I argue that if Williamson’s account of thought experiments and of modal epistemology is right, this seriously undermines his version of the expertise defence.

Philosophers are often credited with particularly well-developed conceptual skills. The ‘expertise objection’ to experimental philosophy builds on this assumption to challenge inferences from findings about laypeople to conclusions about philosophers. We draw on psycholinguistics to develop and assess this objection. We examine whether philosophers are less or differently susceptible than laypersons to cognitive biases that affect how people understand verbal case descriptions and judge the cases described. We examine two possible sources of difference: Philosophers could be better at deploying concepts, (...) and this could make them less susceptible to comprehension biases (‘linguistic expertise objection’). Alternatively, exposure to different patterns of linguistic usage could render philosophers vulnerable to a fundamental comprehension bias, the linguistic salience bias, at different points (‘linguistic usage objection’). Together, these objections mount a novel ‘master argument’ against experimental philosophy. To develop and empirically assess this argument, we employ corpus analysis and distributional semantic analysis and elicit plausibility ratings from academic philosophers and psychology undergraduates. Our findings suggest philosophers are better at deploying concepts than laypeople but are susceptible to the linguistic salience bias to a similar extent and at similar points. We identify methodological consequences for experimental philosophy and for philosophical thought experiments. (shrink)

In epistemology, fake-barn thought experiments are often taken to be intuitively clear cases in which a justified true belief does not qualify as knowledge. We report a study designed to determine whether non-philosophers share this intuition. The data suggest that while participants are less inclined to attribute knowledge in fake-barn cases than in unproblematic cases of knowledge, they nonetheless do attribute knowledge to protagonists in fake-barn cases. Moreover, the intuition that fake-barn cases do count as knowledge is negatively correlated with (...) age; older participants are less likely than younger participants to attribute knowledge in fake-barn cases. We also found that increasing the number of defeaters (fakes) does not decrease the inclination to attribute knowledge. (shrink)

Given the available evidence, I argue that we face considerable uncertainty about free will. In particular, I argue that the available philosophical evidence does not support being highly confident in our theories about the nature of free will, though this does not necessarily mean that we should suspend judgment about either incompatibilism or compatibilism. For those who accept incompatibilism, however, I argue that there is enough uncertainty about libertarian free will that they should suspend judgment about whether we are ever (...) free, if not reject free will entirely. While I do not claim that compatibilists should be similarly agnostic about the existence of free will, I argue that most compatibilist theories are subject to considerable uncertainty as well, so that most compatibilists should be agnostic about how often we act freely. I conclude with a brief discussion of how we might address these issues going forward. (shrink)

Experimental philosophers have empirically challenged the connection between intuition and philosophical expertise. This paper reviews these challenges alongside other research findings in cognitive science on expert performance and argues for three claims. First, evidence taken to challenge philosophical expertise may also be explained by the well-researched failures and limitations of genuine expertise. Second, studying the failures and limitations of experts across many fields provides a promising research program upon which to base a new model of philosophical expertise. Third, a model (...) of philosophical expertise based on the limitations of genuine experts may suggest a series of constraints on the reliability of professional philosophical intuition. Even when the experts all agree, they may well be mistaken. — Bertrand Russell, On the Value of Scepticism. (shrink)

This article reports on Clean Language Interviewing (CLI), a rigorous, recently developed 'content-empty' (non-leading) approach to second-person interviewing in the science of consciousness. Also presented is a new systematic third-person method of validation that evaluates the questions and other verbal interventions by the interviewer to produce an adherence-to-method or 'cleanness' rating. A review of 19 interviews from five research studies provides a benchmark for interviewers seeking to minimize leading questions. The inter-rater reliability analysis demonstrates substantial agreement among raters with an (...) average intraclass correlation coefficient of 0.72 (95% CI). We propose that this method of validation is applicable not only to CLI but to second-person interviews more generally. (shrink)

Determinism is a claim about the laws of nature: very roughly, it is the claim that everything that happens is determined by antecedent conditions together with the natural laws. Incompatibilism is a philosophical thesis about the relevance of determinism to free will: that the truth of determinism rules out the existence of free will. The incompatibilist believes that if determinism turned out to be true, it would also be true that we don't have, and have never had, free will. The (...) compatibilist denies that determinism has the consequences the incompatibilist thinks it has. According to the compatibilist, the truth of determinism does not preclude the existence of free will. (Even if we learned tomorrow that determinism is true, it might still be true that we have free will.) The philosophical problem of free will and determinism is the problem of understanding, how, if at all, the truth of determinism might be compatible with the truth of our belief that we have free will. That is, it's the problem of deciding who is right: the compatibilist or the incompatibilist. (shrink)

Moral psychology investigates human functioning in moral contexts, and asks how these results may impact debate in ethical theory. This work is necessarily interdisciplinary, drawing on both the empirical resources of the human sciences and the conceptual resources of philosophical ethics. The present article discusses several topics that illustrate this type of inquiry: thought experiments, responsibility, character, egoism v . altruism, and moral disagreement.

Rini 2015 [Synthese 192, (2): 431-452] claims to have identified a methodological flaw that invalidates the results of two experimental studies [Schwitzgebel & Cushman (2012) Mind and Language 27, (2): 135-153; Tobia, Buckwalter & Stich (2013) Philosophical Psychology 26, (5): 629–638] demonstrating order effects in professional philosophical intuition. This conclusion is reached on the basis of unsupported empirical premises for which no evidence is given. Subsequent findings in experimental cognitive science further reveal this as unsupported speculation.

Cognitive scientists have revealed systematic errors in human reasoning. There is disagreement about what these errors indicate about human rationality, but one upshot seems clear: human reasoning does not seem to fit traditional views of human rationality. This concern about rationality has made its way through various fields and has recently caught the attention of philosophers. The concern is that if philosophers are prone to systematic errors in reasoning, then the integrity of philosophy would be threatened. In this paper, I (...) present some of the more famous work in cognitive science that has marshaled this concern. Then I present reasons to think that those with training in philosophy will be less prone to certain systematic errors in reasoning. The suggestion is that if philosophers could be shown to be less prone to such errors, then the worries about the integrity of philosophy could be constrained. Then I present evidence that, according to performance on the CRT (Frederick 2005), those who have benefited from training and selection in philosophy are indeed less prone to one kind of systematic error: irrationally arbitrating between intuitive and reflective responses. Nonetheless, philosophers are not entirely immune to this systematic error, and their proclivity for this error is statistically related to their responses to a variety of philosophical questions. So, while the evidence herein puts constraints on the worries about the integrity of philosophy, it by no means eliminates these worries. The conclusion, then, is that the present evidence offers prima facie reasons to ascribe a mitigated privilege to philosophers' ability to rationally arbitrate between intuitive and reflective responses. (shrink)