Recent replication crises in psychology and other fields have led to intense reflection about the validity of common research practices. Much of this reflection has focussed on reporting standards, and how they may be related to the questionable research practices that could underlie a high proportion of irreproducible findings in the published record. As a developing field, it is particularly important for Experimental Philosophy to avoid some of the pitfalls that have beset other disciplines. To this end, here we provide (...) a detailed, comprehensive assessment of current reporting practices in Experimental Philosophy. We focus on the quality of statistical reporting and the disclosure of information about study methodology. We assess all the articles using quantitative methods that were published over the years 2013–2016 in 29 leading philosophy journals. We find that null hypothesis significance testing is the prevalent statistical practice in Experimental Philosophy, although relying solely on this approach has been criticised in the psychological literature. To augment this approach, various additional measures have become commonplace in other fields, but we find that Experimental Philosophy has adopted these only partially: 53% of the papers report an effect size, 28% confidence intervals, 1% examined prospective statistical power and 5% report observed statistical power. Importantly, we find no direct relation between an article’s reporting quality and its impact. We conclude with recommendations for authors, reviewers and editors in Experimental Philosophy, to facilitate making research statistically-transparent and reproducible. (shrink)

Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project to estimate the reproducibility of experimental philosophy. Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, we enlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample (...) – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward. (shrink)

How do we determine whether some candidate causal factor is an actual cause of some particular outcome? Many philosophers have wanted a view of actual causation which fits with folk intuitions of actual causation and those who wish to depart from folk intuitions of actual causation are often charged with the task of providing a plausible account of just how and where the folk have gone wrong. In this paper, I provide a range of empirical evidence aimed at showing just (...) how and where the folk go wrong in determining whether an actual causal relation obtains. The evidence suggests that folk intuitions of actual causation are generated by two epistemically defective processes. I situate the empirical evidence within a background discussion of debunking, arguing for a two-pronged debunking explanation of folk intuitions of actual causation. I conclude that those who wish to depart from folk intuitions of actual causation should not be compelled to square their account of actual causation with the verdicts of the folk. In the dispute over actual causation, folk intuitions deserve to be rejected. (shrink)

Much of the recent movement organized under the heading “Experimental Philosophy” has been concerned with the empirical study of responses to thought experiments drawn from the literature on philosophical analysis. I consider what bearing these studies have on the traditional projects in which thought experiments have been used in philosophy. This will help to answer the question what the relation is between Experimental Philosophy and philosophy, whether it is an “exciting new style of [philosophical] research”, “a new interdisciplinary field that (...) uses methods normally associated with psychology to investigate questions normally associated with philosophy” (Knobe et al. 2012), or whether its relation to philosophy consists, as some have suggested, in no more than the word ‘philosophy’ appearing in its title, or whether the truth lies somewhere in between these two views. I first distinguishes different strands in Experimental Philosophy, negative and positive x-phi, and x-phi pursuing philosophy as opposed to x-phi as cognitive science. Next I review some ways in which Experimental Philosophy has been criticized. Finally, I consider what would have to be true for Experimental Philosophy to have one or another sort of relevance to philosophy, whether the assumptions required are true, how we could know it, and the ideal limits of the usefulness Experimental Philosophy to philosophy. I conclude x-phi cannot in principle be a replacement for traditional first person approaches because it yields the wrong kind of knowledge and that it can nonetheless be a practical aid in conducting philosophical thought experiments. n. (shrink)

Naturalistic philosophers rely on literature search and review in a number of ways and for different purposes. Yet this article shows how processes of literature search and review are likely to be affected by widespread and systematic biases. A solution to this problem is offered here. Whilst the tradition of systematic reviews of literature from scientific disciplines has been neglected in philosophy, systematic reviews are important tools that minimize bias in literature search and review and allow for greater reproducibility and (...) transparency. If naturalistic philosophers wish to reduce bias in their research, they should then supplement their traditional tools for literature search and review by including systematic methodologies. (shrink)

ABSTRACTExperimental philosophy often draws its data from questionnaire-based surveys of ordinary intuitions. Its proponents are keen to identify antecedents in the work of philosophers who have referred to intuition and everyday understanding [e.g. Knobe, Joshua, and Shaun Nichols, ‘An Experimental Philosophy Manifesto’. In Experimental Philosophy, edited by Joshua Knobe and Shaun Nichols, 3–14. Oxford: Oxford University Press, 2007]. In this context, ‘Empirical Semantics’, pioneered by Arne Naess early in the twentieth century, offers striking parallels. Naess believed that much contemporary philosophy (...) was unempirical because it made no reference to ordinary understanding or use of language. In response, he attempted large-scale studies of ordinary understanding of philosophically significant terms [e.g. Naess, Arne. ‘Truth’ as Conceived by Those Who Are Not Professional Philosophers. Oslo: Jacob Dybwad, 1938]. This article will compare Empirical Semantics and experimental philosophy, and assess what su... (shrink)

When do the folk think that material objects persist? Many metaphysicians have wanted a view which fits with folk intuitions, yet there is little agreement about what the folk intuit. I provide a range of empirical evidence which suggests that the folk operate with a teleological view of persistence: the folk tend to intuit that a material object survives alterations when its function is preserved. Given that the folk operate with a teleological view of persistence, I argue for a debunking (...) explanation of folk intuitions, concluding that metaphysicians should dismiss folk intuitions as tied into a benighted view of nature. (shrink)

When do the folk think that mereological composition occurs? Many metaphysicians have wanted a view of composition that fits with folk intuitions, and yet there has been little agreement about what the folk intuit. We aim to put the tools of experimental philosophy to constructive use. Our studies suggest that folk mereology is teleological: people tend to intuit that composition occurs when the result serves a purpose. We thus conclude that metaphysicians should dismiss folk intuitions, as tied into a benighted (...) teleological view of nature. (shrink)

In the past decade, experimental philosophy---the attempt at making progress on philosophical problems using empirical methods---has thrived in a wide range of domains. However, only in recent years has aesthetics succeeded in drawing the attention of experimental philosophers. The present paper constitutes the first survey of these works and of the nascent field of 'experimental philosophy of aesthetics'. We present both recent experimental works by philosophers on topics such as the ontology of aesthetics, aesthetic epistemology, aesthetic concepts, and imagination, as (...) well as research from other disciplines that not only are relevant to philosophy of aesthetics but also open new avenues of research for experimental philosophy of aesthetics. Overall, we conclude that the birth of an experimental philosophy of aesthetics is good news not only for aesthetics but also for experimental philosophy itself, as it contributes to broaden the scope of experimental philosophy. (shrink)

ABSTRACTAchievements are among the things that make a life good. Assessing the plausibility of this intuitive claim requires an account of the nature of achievements. One necessary condition for achievement appears to be that the achieving agent acted competently, i.e. was not just lucky. I begin by critically assessing existing accounts of anti-luck conditions for achievements in both the ethics and epistemology literature. My own proposal is that a goal is reached competently, only if the actions of the would-be-achiever make (...) success likely, and that this is the reason why she acts that way. (shrink)

Experimental philosophy offers an alternative mode of engagement for public philosophy, in which the public can play a participatory role. We organized two public events on the aesthetics of coffee that explored this alternative mode of engagement. The first event focuses on issues surrounding the communication of taste. The second event focuses on issues concerning ethical influences on taste. -/- In this paper, we report back on these two events which explored the possibility of doing experimental philosophical aesthetics as public (...) philosophy. We set the stage by considering the significance and current state of efforts in public philosophy, and by introducing the emerging sub-discipline of experimental philosophical aesthetics. Then, we discuss the research and outreach aspects of the two events on the aesthetics of coffee. Finally, we conclude by reflecting on the prospects and potential pitfalls of experimental philosophy as public philosophy. (shrink)

What is the rationale for the methodological innovations of experimental philosophy? This paper starts from the contention that common answers to this question are implausible. It then develops a framework within which experimental philosophy fulfills a specific function in an otherwise traditionalist picture of philosophical inquiry. The framework rests on two principal ideas. The first is Frank Jackson’s claim that conceptual analysis is unavoidable in ‘serious metaphysics’. The second is that the psychological structure of concepts is extremely intricate, much more (...) so than early practitioners of conceptual analysis had realized. This intricacy has implications for the activity of analyzing concepts: while the central, coarser, more prominent contours of a concept may be identified from the armchair, the finer details of the concept’s structure require experimental methods to detect. (shrink)

Some philosophers have criticized experimental philosophy for being superfluous. Jackson implies that experimental philosophy studies are unnecessary. More recently, Dunaway, Edmunds, and Manley empirically demonstrate that experimental studies do not deliver surprising results, which is a pro tanto reason for foregoing conducting such studies. This paper gives theoretical and empirical considerations against the superfluity criticism. The questions concerning the surprisingness of experimental philosophy studies have not been properly disambiguated, and their metaphilosophical significance have not been properly assessed. Once the most (...) relevant question is identified, a re-analysis of Dunaway and colleagues’ data actually undermines the superfluity criticism. (shrink)

This chapter presents an opinionated account of how to understand the contributions of experience, especially with respect to the role of cognitive science, in developing and assessing metaphysical theories of reality. I develop a methodological basis for the idea that, independently of work in experimental philosophy focused on explications of concepts, contemporary metaphysical theories with a role for experiential evidence can be fruitfully connected to empirical work in psychology, especially cognitive science. My argument is not that cognitive science should replace (...) the metaphysician’s use of a priori theorizing and ordinary experience as a guide to metaphysical reality. Rather, we should enrich our perspective on a priori theorizing and ordinary experience as a guide to metaphysical reality by drawing on any relevant work in cognitive science. (shrink)

Naturalistic philosophers rely on literature search and review in a number of ways and for different purposes. Yet this article shows how processes of literature search and review are likely to be affected by widespread and systematic biases. A solution to this problem is offered here. Whilst the tradition of systematic reviews of literature from scientific disciplines has been neglected in philosophy, systematic reviews are important tools that minimize bias in literature search and review and allow for greater reproducibility and (...) transparency. If naturalistic philosophers wish to reduce bias in their research, they should then supplement their traditional tools for literature search and review by including systematic methodologies. (shrink)

Both advocates and critics of experimental philosophy often describe it in narrow terms as being the empirical study of people’s intuitions about philosophical cases. This conception corresponds with a narrow origin story for the field—it grew out of a dissatisfaction with the uncritical use of philosophers’ own intuitions as evidence for philosophical claims. In contrast, a growing number of experimental philosophers have explicitly embraced a broad conception of the sub-discipline, which treats it as simply the use of empirical methods to (...) inform philosophical problems. And this conception has a corresponding broad origin story—the field grew out of a recognition that philosophers often make empirical claims and that empirical claims call for empirical support. In this paper, I argue that the broad conception should be accepted, offering support for the broad origin story. (shrink)

In the opening paragraph of “Computing Machinery and Intelligence” Alan Turing famously notes that “if the meaning of the words ‘machine’ and ‘think’ are to be found by examining how they are commonly used it is difficult to escape the conclusion that the meaning and the answer to the question, ‘Can machines think?’ is to be sought in a statistical survey such as a Gallup poll.” He then immediately responds, “But this is absurd.” But why is this absurd, if indeed (...) it is? We think that the suggested method is absurd because the answer to the question might not follow from the meaning of the words alone—it might critically depend on what machines can be built to do. Further, the ordinary use of the terms might display shallow biases or superstitions that we want to set aside, or overcome, in pursuing a science or philosophy of mind. However, we do not think that the method is absurd insofar as we are interested in getting clear on “the normal use of the words,” as Turing puts it. And we believe that getting clear on the normal use of words like “machine” and “think” is relevant even if we then want to move beyond the ordinary usage in our theorizing. But the best way to figure out how ordinary people use language is via empirical investigation. (shrink)

This paper argues that the activist, feminist and pragmatist Jane Addams was an experimental philosopher. To defend this claim, I argue for capacious notions of both philosophical pragmatism and experimental philosophy. I begin in Section 2 with a new defence of Rose and Danks’ [‘In Defense of a Broad Conception of Experimental Philosophy’. Metaphilosophy 44, no. 4 : 512–32] argument in favour of a broad conception of experimental philosophy. Koopman [‘Pragmatist Resources for Experimental Philosophy: Inquiry in Place of Intuition’. Journal (...) of Speculative Philosophy 26, no. 1 : 1–24] argues that many twentieth-century American pragmatists can make important contributions to contemporary experimental philosophy. In Section 3, I argue that while this may be true, it is also true that under the broad conception, many of the pragmatists just were experimental philosophers. In Section 4, I argue that as a pragmatist philosopher in her own right, Jane... (shrink)

There are three interconnected goals of this paper. The first is to articulate and motivate a view of the methodology for doing metaphysics that is broadly phenomenological in the sense of Husserl circa the Logical Investigations. The second is to articulate an argument for the importance of studying the history of philosophy when doing metaphysics that is in accordance with this methodology. The third is to confront this methodology with a series of objections and determine how well it fares in (...) light of them. (shrink)

In this paper I will discuss some issues related to a recent trend in experimental philosophy (or x-phi), and try to show the reasons of its late (and scarce) involvement with aesthetics, compared to other areas of philosophical investigation. In order to do this, it is first necessary to ask how an autonomous experimental philosophy of aesthetics could be related to the long-standing tradition of psychological experimental aesthetics. After distinguishing between a “narrow” and a “broad” approach of experimental philosophy, I (...) will then make a distinction between topics in aesthetics pertaining to perceptual and cognitive processes, and traditional issues involved in the analysis of general and culturally-laden concepts. The narrow program of experimental philosophy, focused on the investigation of folk intuitions, is particularly effective only when two general conditions are met: the use of hypothetical scenarios (testing of thought experiments) and the heuristic role of folk intuitions in drawing philosophically relevant conclusions. I will argue that, when aesthetics is concerned, these requirements are not easily met. These difficulties notwithstanding, I will support a pluralistic view where aesthetics is revealed as an instructive example of how experimental approaches and traditional “armchair” philosophy integrate, and enrich each other. (shrink)