Behavioral scientists routinely publish broad claims about human psychology and behavior in the world's top journals based on samples drawn entirely from Western, Educated, Industrialized, Rich, and Democratic (WEIRD) societies. Researchers – often implicitly – assume that either there is little variation across human populations, or that these “standard subjects” are as representative of the species as any other population. Are these assumptions justified? Here, our review of the comparative database from across the behavioral sciences suggests both that there is (...) substantial variability in experimental results across populations and that WEIRD subjects are particularly unusual compared with the rest of the species – frequent outliers. The domains reviewed include visual perception, fairness, cooperation, spatial reasoning, categorization and inferential induction, moral reasoning, reasoning styles, self-concepts and related motivations, and the heritability of IQ. The findings suggest that members of WEIRD societies, including young children, are among the least representative populations one could find for generalizing about humans. Many of these findings involve domains that are associated with fundamental aspects of psychology, motivation, and behavior – hence, there are no obviousa priorigrounds for claiming that a particular behavioral phenomenon is universal based on sampling from a single subpopulation. Overall, these empirical patterns suggests that we need to be less cavalier in addressing questions ofhumannature on the basis of data drawn from this particularly thin, and rather unusual, slice of humanity. We close by proposing ways to structurally re-organize the behavioral sciences to best tackle these challenges. (shrink)

The standard view in philosophy treats pains as phenomenally conscious mental states. This view has a number of corollaries, including that it is generally taken to rule out the existence of unfelt pains. The primary argument in support of the standard view is that it supposedly corresponds with the commonsense conception of pain. In this paper, we challenge this doctrine about the commonsense conception of pain, and with it the support offered for the standard view, by presenting the results of (...) a series of new empirical studies that indicate that lay people not only tend to believe that unfelt pains are possible, but actually, quite common. (shrink)

In Philosophy Within Its Proper Bounds, Edouard Machery argues that resolving many traditional and contemporary philosophical issues is beyond our epistemic reach and that philosophy should re-orient itself toward more humble, but ultimately more important intellectual endeavors, such as the analysis of concepts.

The article presents an anti-exceptionalist view of philosophical methodology, on which it is much closer to the methodology of other disciplines than many philosophers like to think. Like mathematics, it is a science, but not a natural science. Its methods are not primarily experimental, though it can draw on the results of natural science. Like foundational mathematics, its methods are abductive as well as deductive. As in the natural sciences, much progress in philosophy consists in the construction of better models (...) rather than in the discovery of new laws. We should not worry about whether philosophy is a priori or a posteriori, because the distinction is epistemologically superficial. (shrink)

In order for Herman Cappelen to argue in his Philosophy Without Intuitions that philosophers have been on the whole mistaken in thinking that we actually use intuitions much at all in our first-order philosophizing, he must attempt the task of characterizing what something must be, in order to be an intuition.My discussion here is focused on the latter half of the book concerning the “argument from philosophical practice. I am in wholehearted agreement with the first half’s thesis that the usage (...) of the term “intuition” is highly motley and of no methodological use. I truly sympathize with the frustration he evidently feels at wrangling with that task, because I’ve felt the same in my own project critiquing what I do take to be a fairly common practice in contemporary philosophy that we often gesture at when we speak of intuitions. For the literature on intuitions can be a total mess on even the most basic questions about what intuitions are: beliefs, or sui generis seemings? Special in .. (shrink)

The Twin Earth thought experiment invites us to consider a liquid that has all of the superficial properties associated with water (clear, potable, etc.) but has entirely different deeper causal properties (composed of “XYZ” rather than of H2O). Although this thought experiment was originally introduced to illuminate questions in the theory of reference, it has also played a crucial role in empirically informed debates within the philosophy of psychology about people’s ordinary natural kind concepts. Those debates have sought to accommodate (...) an apparent fact about ordinary people’s judgments: Intuitively, the Twin Earth liquid is not water. We present results from four experiments showing that people do not, in fact, have this intuition. Instead, people tend to have the intuition that there is a sense in which the liquid is not water but also a sense in which it is water. We explore the implications of this finding for debates about theories of natural kind concepts, arguing that it supports views positing two distinct criteria for membership in natural kind categories – one based on deeper causal properties, the other based on superficial, observable properties. (shrink)

The Twin Earth thought experiment invites us to consider a liquid that has all of the superficial properties associated with water (clear, potable, etc.) but has entirely different deeper causal properties (composed of “XYZ” rather than of H2O). Debates about natural kind concepts have sought to accommodate an apparent fact about ordinary people's judgments: Intuitively, the Twin Earth liquid is not water. We present results showing that people do not have this intuition. Instead, people tend to judge that there is (...) a sense in which the liquid is not water but also a sense in which it is water. (shrink)

Do philosophers and ordinary people conceive of subjective experience in the same way? In this article, we argue that they do not and that the philosophical concept of phenomenal consciousness does not coincide with the folk conception. We first offer experimental support for the hypothesis that philosophers and ordinary people conceive of subjective experience in markedly different ways. We then explore experimentally the folk conception, proposing that for the folk, subjective experience is closely linked to valence. We conclude by considering (...) the implications of our findings for a central issue in the philosophy of mind, the hard problem of consciousness. (shrink)

In this paper we propose to argue for two claims. The first is that a sizeable group of epistemological projects – a group which includes much of what has been done in epistemology in the analytic tradition – would be seriously undermined if one or more of a cluster of empirical hypotheses about epistemic intuitions turns out to be true. The basis for this claim will be set out in Section 2. The second claim is that, while the jury is (...) still out, there is now a substantial body of evidence suggesting that some of those empirical hypotheses are true. Much of this evidence derives from an ongoing series of experimental studies of epistemic intuitions that we have been conducting. A preliminary report on these studies will be presented in Section 3. In light of these studies, we think it is incumbent on those who pursue the epistemological projects in question to either explain why the truth of the hypotheses does not undermine their projects, or to say why, in light of the evidence we will present, they nonetheless assume that the hypotheses are false. In Section 4, which is devoted to Objections and Replies, we’ll consider some of the ways in which defenders of the projects we are criticizing might reply to our challenge. Our goal, in all of this, is not to offer a conclusive argument demonstrating that the epistemological projects we will be criticizing are untenable. Rather, our aim is to shift the burden of argument. (shrink)

Academics across widely ranging disciplines all pursue knowledge, but they do so using vastly different methods. Do these academics therefore also have different ideas about when someone possesses knowledge? Recent experimental findings suggest that intuitions about when individuals have knowledge may vary across groups; in particular, the concept of knowledge espoused by the discipline of philosophy may not align with the concept held by laypeople. Across two studies, we investigate the concept of knowledge held by academics across seven disciplines (N (...) = 1,581) and compare these judgments to those of philosophers (N = 204) and laypeople (N = 336). We find that academics and laypeople share a similar concept of knowledge, while philosophers have a substantially different concept. These experiments show that (a) in contrast to philosophers, other academics and laypeople attribute knowledge to others in some “Gettier” situations; (b) academics and laypeople are much less likely to attribute knowledge when reminded of the possibility of error, but philosophers are not affected by this reminder; and (c) non‐philosophy academics are overall more skeptical about knowledge than laypeople or philosophers. These findings suggest that academics across a wide range of disciplines share a similar concept of knowledge, and that this concept aligns closely with the intuitions held by laypeople, and differs considerably from the concept of knowledge described in the philosophical literature, as well as the epistemic intuitions of philosophers themselves. (shrink)

In the remainder of this article, we will disarm an important motivation for epistemic contextualism and interest-relative invariantism. We will accomplish this by presenting a stringent test of whether there is a stakes effect on ordinary knowledge ascription. Having shown that, even on a stringent way of testing, stakes fail to impact ordinary knowledge ascription, we will conclude that we should take another look at classical invariantism. Here is how we will proceed. Section 1 lays out some limitations of previous (...) research on stakes. Section 2 presents our study and concludes that there is little evidence for a substantial stakes effect. Section 3 responds to objections. The conclusion clears the way for classical invariantism. (shrink)

This article develops a new, general account of replication. I argue that a replication is an experiment that resamples the experimental components of an ori...

Grau and Pury (Review of Philosophy and Psychology, 5, 155–168, 2014) reported that people’s views about love are related to their views about reference. This surprising effect was however not replicated in Cova et al.’s (in press) replication study. In this article, we show that the replication failure is probably due to the replication’s low power and that a metaanalytic reanalysis of the result in Cova et al. suggests that the effect reported in Grau and Pury is real. We then (...) report a large, highly powered replication that successfully replicates Grau and Pury 2014. This successful replication is a case study in the challenges involved in replicating scientific work, and our article contributes to the discussion of these challenges. (shrink)

In this paper I explore an underdiscussed factor contributing to the replication crisis: Scientists, and following them policy makers, often neglect sources of errors in the production and interpretation of data and thus overestimate what can be learnt from them. This neglect leads scientists to conduct experiments that are insufficiently informative and science consumers, including other scientists, to put too much weight on experimental results. The former leads to fragile empirical literatures, the latter to surprise and disappointment when the fragility (...) of the empirical basis of some disciplines is revealed. (shrink)

Within the existing metaphilosophical literature on experimental philosophy, a great deal of attention has been devoted to the claim that there are large differences in philosophical intuitions between people of different demographic groups. Some philosophers argue that this claim has important metaphilosophical implications; others argue that it does not. However, the actual empirical work within experimental philosophy seems to point to a very different sort of metaphilosophical question. Specifically, what the actual empirical work suggests is that intuitions are surprisingly robust (...) across demographic groups. Prior to empirical study, it seemed plausible that unexpected patterns of intuition found in one demographic group would not emerge in other demographic groups. Yet, again and again, empirical work obtains the opposite result: that unexpected patterns found in one demographic group actually emerge also in other demographic groups. I cite 30 studies that find this sort of robustness. I then argue that to the extent that metaphilosophical work is to engage with the actual findings from experimental philosophy, it needs to explore the implications of the surprising robustness of philosophical intuitions across demographic differences. (shrink)

Science is our best way of finding out about the natural world, and philosophers who write about that world ought to be sensitive to the claims of our best science. There are obstacles, however, to outsiders using science well. We think philosophers are prone to misuse science: to give undue weight to results that are untested; to highlight favorable and ignore unfavorable data; to give illegitimate weight to the authority of science; to leap from scientific premises to philosophical conclusions without (...) spelling out their relevance; to treat mere resonance between a scientific theory and a philosophical view as empirical evidence for the philosophical view. This article identifies and illustrates some of the ways in which philosophers misuse science, explains why these pitfalls are easy to fall into, and concludes with suggestions for avoiding them. (shrink)

Experimental restrictionists have challenged philosophers’ reliance on intuitions about thought experiment cases based on experimental findings. According to the expertise defense, only the intuitions of philosophical experts count—yet the bulk of experimental philosophy consists in studies with lay people. In this paper, we argue that direct strategies for assessing the expertise defense are preferable to indirect strategies. A direct argument in support of the expertise defense would have to show: first, that there is a significant difference between expert and lay (...) intuitions; second, that expert intuitions are superior to lay intuitions; and third, that expert intuitions accord with the relevant philosophical consensus. At present, there is only little experimental evidence that bears on these issues. To advance the debate, we conducted two new experiments on intuitions about knowledge with experts and lay people. Our results suggest that the intuitions of epistemological experts are superior in some respects, but they also pose an unexpected challenge to the expertise defense. Most strikingly, we found that even epistemological experts tend to ascribe knowledge in fake-barn-style cases. This suggests that philosophy, as a discipline, might fail to adequately map the intuitions of its expert practitioners onto a disciplinary consensus. (shrink)

Many philosophers deny that happiness can be equated with pleasurable experiences. Nozick introduced an experience machine thought experiment to support the idea that happiness requires pleasurable experiences that are “in contact with reality.” In this thought experiment, people can choose to plug into a machine that induces exclusively pleasurable experiences. We test Nozick’s hypothesis that people will reject this offer. We also contrast Nozick’s experience machine scenario with scenarios that are less artificial, and offer options which are less invasive or (...) disruptive than being connected to a machine, specifically scenarios in which people are offered an experience pill or a pill that improves overall functioning. (shrink)

Following the influential thought experiments by Hilary Putnam and others, philosophers of language have for the most part adopted semantic externalism concerning natural kind terms. In this article, we present results from three experiments on the reference of natural kind terms. Our results confirm some standard externalist assumptions, but are in conflict with others: Ordinary speakers take both appearance and underlying nature to be central in their categorization judgments. Moreover, our results indicate that speakers’ categorization judgments are gradual, and proportional (...) to the degree of similarity between new samples and familiar, “standard” samples. These findings pose problems for traditional theories, both externalist and internalist. (shrink)

The moral domain is broader than the empathy and justice concerns assessed by existing measures of moral competence, and it is not just a subset of the values assessed by value inventories. To fill the need for reliable and theoretically grounded measurement of the full range of moral concerns, we developed the Moral Foundations Questionnaire on the basis of a theoretical model of 5 universally available sets of moral intuitions: Harm/Care, Fairness/Reciprocity, Ingroup/Loyalty, Authority/Respect, and Purity/Sanctity. We present evidence for the (...) internal and external validity of the scale and the model, and in doing so we present new findings about morality: Comparative model fitting of confirmatory factor analyses provides empirical justification for a 5-factor structure of moral concerns; convergent/discriminant validity evidence suggests that moral concerns predict personality features and social group attitudes not previously considered morally relevant; and we establish pragmatic validity of the measure in providing new knowledge and research opportunities concerning demographic and cultural differences in moral intuitions. These analyses provide evidence for the usefulness of Moral Foundations Theory in simultaneously increasing the scope and sharpening the resolution of psychological views of morality. (shrink)

Robert Kraut has proposed an analogy between valuing a loved one as irreplaceable and the sort of “rigid” attachment that (according to Saul Kripke’s account) occurs with the reference of proper names. We wanted to see if individuals with Kripkean intuitions were indeed more likely to value loved ones (and other persons and things) as irreplaceable. In this empirical study, 162 participants completed an online questionnaire asking them to consider how appropriate it would be to feel the same way about (...) a perfect replica of a loved one, as well as other questions about replaceability. Participants who previously had endorsed Kripkean reference (n = 96) rated loved ones as less replaceable on two different measures than participants who had previously endorsed Descriptivist reference (n = 66, t(160)> 2.27, p <.02, eta2> .03). Additional results suggest that this difference extends to other targets as well and is at least partially dependent on sentimental attachment. (shrink)

Most people's intuitive reaction after considering Nozick's experience machine thought-experiment seems to be just like his: we feel very little inclination to plug in to a virtual reality machine capable of providing us with pleasurable experiences. Many philosophers take this empirical fact as sufficient reason to believe that, more than pleasurable experiences, people care about “living in contact with reality.” Such claim, however, assumes that people's reaction to the experience machine thought-experiment is due to the fact that they value reality (...) over virtual experiences—an assumption that has seldom (if ever) been questioned. This paper challenges that very assumption. I report some experimental evidence suggesting that the intuition elicited by the thought-experiment may be explainable by the fact that people are averse to abandon the life they have been experiencing so far, regardless of whether such life is virtual or real. I use then an explanatory model, derived from what behavioral economists and psychologists call the status quo bias, to make sense of these results. Finally, I argue that since this explanation also accounts for people's reaction toward Nozick's thought-experiment, it would be wrong to take such intuition as evidence that people value being in touch with reality. (shrink)

Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project to estimate the reproducibility of experimental philosophy. Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, we enlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample (...) – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward. (shrink)

Bibliography of works in experimental philosophy.

Moral psychologists have recently turned their attention to the study of folk metaethical beliefs. We report the results of a cross-cultural study using Chinese, Polish and Ecuadorian participants that seeks to advance this line of investigation. Individuals in all three demographic groups were observed to attribute objectivity to ethical statements in very similar patterns. Differences in participants’ strength of opinion about an issue, the level of societal agreement or disagreement about an issue, and participants’ age were found to significantly affect (...) their inclination to view the truth of an ethical statement as a matter of objective fact. Implications for theorizing about folk morality are discussed. (shrink)

The standard view of philosophical methodology is that philosophers rely on intuitions as evidence. Herman Cappelen argues that this claim is false: it is not true that philosophers rely extensively on intuitions as evidence. At worst, analytic philosophers are guilty of engaging in somewhat irresponsible use of 'intuition'-vocabulary. While this irresponsibility has had little effect on first order philosophy, it has fundamentally misled meta-philosophers: it has encouraged meta-philosophical pseudo-problems and misleading pictures of what philosophy is.

This chapter addresses the issue of the underrepresentation of women in philosophy by presenting an account regarding gender differences in philosophical institutions. It begins with an analysis of data on the gender gap in academic philosophy; followed by a discussion about the term “intuition,”as well as the tendency to appeal to intuitions during philosophical arguments. It then presents empirical data about gender differences derived from a series of experiments such as a Gettier-style case study of Christina Starmans and Ori Friedman, (...) a philosophical thought experiment of Geoffrey Holtzman, and one of David Pizarro about moral responsibility and causal deviance, among others; one hypothesis derived from these studies pertains to the distinct differences between women and mens' intuitions regarding philosophy, with the instructors deciding that the mens' are more correct. (shrink)

It has long been known that people’s causal judgments can have an impact on their moral judgments. To take a simple example, if people conclude that a behavior caused the death of ten innocent children, they will therefore be inclined to regard the behavior itself as morally wrong. So far, none of this should come as any surprise. But recent experimental work points to the existence of a second, and more surprising, aspect of the relationship between causal judgment and moral (...) judgment. It appears that the relationship can sometimes go in the opposite direction. That is, it appears that our moral judgments can sometimes impact our causal judgments. (Hence, we might first determine that a behavior is morally wrong and then, on that basis, arrive at the conclusion that it was the cause of various outcomes.). (shrink)

It is often thought that judgments about what we ought to do are limited by judgments about what we can do, or that “ought implies can.” We conducted eight experiments to test the link between a range of moral requirements and abilities in ordinary moral evaluations. Moral obligations were repeatedly attributed in tandem with inability, regardless of the type (Experiments 1–3), temporal duration (Experiment 5), or scope (Experiment 6) of inability. This pattern was consistently observed using a variety of moral (...) vocabulary to probe moral judgments and was insensitive to different levels of seriousness for the consequences of inaction (Experiment 4). Judgments about moral obligation were no different for individuals who can or cannot perform physical actions, and these judgments differed from evaluations of a non-moral obligation (Experiment 7). Together these results demonstrate that commonsense morality rejects the “ought implies can” principle for moral requirements, and that judgments about moral obligation are made independently of considerations about ability. By contrast, judgments of blame were highly sensitive to considerations about ability (Experiment 8), which suggests that commonsense morality might accept a “blame implies can” principle. (shrink)