Experimental philosophy involves subjecting philosophical methods and judgments to empirical scrutiny. I begin by exploring conceptual, confirmational, and empirical factors that limit the significance of experiment-based and survey-based approaches to the evaluation of philosophical epistemic activities. I then consider specific criticisms of experimental philosophy: its experimental conditions lack ecological validity; it wrongly assumes that philosophers rely on psychologized data; it overlooks the reflective and social elements of philosophical case analysis; it misconstrues the importance of both procedural and evaluative forms of (...) philosophical expertise; it incorrectly views psychological bias as incompatible with reliability; and it generalizes to a global, self-defeating skepticism about case judgment. I explain why these criticisms should be understood as converging and interdependent. I also set out a three-level model of philosophical case judgment that frames the criticisms. (shrink)

I start with some of the early challenges to the widely-employed philosophical method of cases—the very challenges that originally prompted the new movement of experimental philosophy—and with some fundamental questions about the method that are yet to have been given satisfying answers. I then propose that what has allowed both ‘armchair’ and ‘experimental’ participants in the ongoing debates concerning the method to ignore or repress those early challenges—and in particular Robert Cummins’s ‘calibration objection’—and to discount fundamental disagreements about those questions, (...) is in large part ‘the claim of continuity’, which is the claim, or assumption, that there is no philosophically significant difference between whatever it is that we do when we give our answer to the theorist’s question of whether some philosophically interesting word ‘applies’ (positively or negatively) to some theoretically significant case, and our use of that same word in the course of ordinary, non-philosophical discourse. I then summarize the ordinary language philosophy (OLP) argument against the claim of continuity, and explain why answers to the theorist’s questions are vulnerable to the calibration objection in a way that our non-philosophical, everyday employment of the same words is not. This then leads me to question another widespread assumption, which is the assumption that the theorist’s questions—as raised in the theorist’s context—have clear enough sense and correct answers. I end by responding to a series of objections to my argument and to OLP more generally. (shrink)

Experimental philosophers often seem to ignore or downplay the significance of demographic variation in philosophically relevant judgments. This article confirms this impression, discusses why demographic research is overlooked in experimental philosophy, and argues that variation is philosophically significant.