This special issue on what some regard as a crisis of replicability in cognitive science (i.e. the observation that a worryingly large proportion of experimental results across a number of areas cannot be reliably replicated) is informed by three recent developments. -/- First, philosophers of mind and cognitive science rely increasingly on empirical research, mainly in the psychological sciences, to back up their claims. This trend has been noticeable since the 1960s (see Knobe, 2015). This development has allowed philosophers to (...) draw on a wider range of relevant resources, but it also makes them vulnerable to relying on claims that may not survive further scrutiny. If we have reasons to believe that a large proportion of findings in the psychological sciences cannot be reliably replicated, this would be a problem for philosophers who use such findings in their work. Second, philosophers are increasingly designing and carrying out their own experiments to back up claims, or to test claims earlier made from the armchair, for example, on the perceived permissibility of diverting trolleys or on the nature of free will. This growing field of experimental philosophy has diversified the intellectual field in philosophy, but may also be vulnerable to issues of replicability that philosophers did not face before. -/- Third, the recent evidence of apparently widespread non-replicability in the social sciences (and other fields) has forced philosophers of science to grapple with long standing questions from their field from a new perspective. To what extent does replicability matter for theory construction? How do the notions of replicability and scientific progress interact? How can normative insights from philosophy of science be used in order to improve scientific practice? -/- It is with these three developments in mind—the increasing importance of empirically-informed philosophy, of experimental philosophy, and of philosophy of science around replicability—that this special issue has been conceived. (shrink)

This paper examines a constellation of ethical and editorial issues that have arisen since philosophers started to conduct, submit and publish empirical research. These issues encompass concerns over responsible authorship, fair treatment of human subjects, ethicality of experimental procedures, availability of data, unselective reporting and publishability of research findings. This study aims to assess whether the philosophical community has as yet successfully addressed such issues. To do so, the instructions for authors, submission process and published research papers of 29 main (...) journals in philosophy have been considered and analyzed. In light of the evidence reported here, it is argued that the philosophical community has as yet failed to properly tackle such issues. The paper also delivers some recommendations for authors, reviewers and editors in the field. (shrink)

Past work has demonstrated that people’s moral judgments can influence their judgments in a number of domains that might seem to involve straightforward matters of fact, including judgments about freedom, causation, the doing/allowing distinction, and intentional action. The present studies explore whether the effect of morality in these four domains can be explained by changes in the relevance of alternative possibilities. More precisely, we propose that moral judgment influences the degree to which people regard certain alternative possibilities as relevant, which (...) in turn impacts intuitions about freedom, causation, doing/allowing, and intentional action. Employing the stimuli used in previous research, Studies 1a, 2a, 3a, and 4a show that the relevance of alternatives is influenced by moral judgments and mediates the impact of morality on non-moral judgments. Studies 1b, 2b, 3b, and 4b then provide direct empirical evidence for the link between the relevance of alternatives and judgments in these four domains by manipulating (rather than measuring) the relevance of alternative possibilities. Lastly, Study 5 demonstrates that the critical mechanism is not whether alternative possibilities are considered, but whether they are regarded as relevant. These studies support a unified framework for understanding the impact of morality across these very different kinds of judgments. (shrink)

Past research has identified a number of asymmetries based on moral judgments. Beliefs about what a person values, whether a person is happy, whether a person has shown weakness of will, and whether a person deserves praise or blame seem to depend critically on whether participants themselves find the agent's behavior to be morally good or bad. To date, however, the origins of these asymmetries remain unknown. The present studies examine whether beliefs about an agent's “true self” explain these observed (...) asymmetries based on moral judgment. Using the identical materials from previous studies in this area, a series of five experiments indicate that people show a general tendency to conclude that deep inside every individual there is a “true self” calling him or her to behave in ways that are morally virtuous. In turn, this belief causes people to hold different intuitions about what the agent values, whether the agent is happy, whether he or she has shown weakness of will, and whether he or she deserves praise or blame. These results not only help to answer important questions about how people attribute various mental states to others; they also contribute to important theoretical debates regarding how moral values may shape our beliefs about phenomena that, on the surface, appear to be decidedly non-moral in nature. (shrink)

Five experiments provide evidence for a class of ‘dual character concepts.’ Dual character concepts characterize their members in terms of both (a) a set of concrete features and (b) the abstract values that these features serve to realize. As such, these concepts provide two bases for evaluating category members and two different criteria for category membership. Experiment 1 provides support for the notion that dual character concepts have two bases for evaluation. Experiments 2-4 explore the claim that dual character concepts (...) have two different criteria for category membership. The results show that when an object possesses the appropriate concrete features, but does not fulfill the appropriate abstract value, it is judged to be a category member in one sense but not in another. Finally, Experiment 5 uses the theory developed here to construct artificial dual character concepts and examines whether participants react to these artificial concepts in the same way as naturally occurring dual character concepts. The present studies serve to define the nature of dual character concepts and distinguish them from other types of concepts (e.g., natural kind concepts), which share some, but not all of the properties of dual character concepts. More broadly, these phenomena suggest a normative dimension in everyday conceptual representation. (shrink)

J.L. Austin is regarded as having an especially acute ear for fine distinctions of meaning overlooked by other philosophers. Austin employs an informal experimental approach to gathering evidence in support of these fine distinctions in meaning, an approach that has become a standard technique for investigating meaning in both philosophy and linguistics. In this paper, we subject Austin's methods to formal experimental investigation. His methods produce mixed results: We find support for his most famous distinction, drawn on the basis of (...) his `donkey stories', that `mistake' and `accident' apply to different cases, but not for some of his other attempts to distinguish the meaning of philosophically significant terms (such as `intentionally' and `deliberately'). We critically examine the methodology of informal experiments employed in ordinary language philosophy and much of contemporary philosophy of language and linguistics, and discuss the role that experimenter bias can play in influencing judgments about informal and formal linguistic experiments. (shrink)

Thinking Off Your Feet: How Empirical Psychology Vindicates Armchair Philosophy, by Michael Strevens. Cambridge, MA: Harvard University Press, 2019. Pp. xii + 345.

Experimental philosophers have empirically challenged the connection between intuition and philosophical expertise. This paper reviews these challenges alongside other research findings in cognitive science on expert performance and argues for three claims. First, evidence taken to challenge philosophical expertise may also be explained by the well-researched failures and limitations of genuine expertise. Second, studying the failures and limitations of experts across many fields provides a promising research program upon which to base a new model of philosophical expertise. Third, a model (...) of philosophical expertise based on the limitations of genuine experts may suggest a series of constraints on the reliability of professional philosophical intuition. Even when the experts all agree, they may well be mistaken. — Bertrand Russell, On the Value of Scepticism. (shrink)

Yarkoni argues that researchers making broad inferences often use impoverished statistical models that fail to include important sources of variation as random effects. We argue, however, that for many common study designs, random effects are inappropriate and insufficient to draw general inferences, as the source of variation is not random, but systematic.

This paper examines a constellation of ethical and editorial issues that have arisen since philosophers started to conduct, submit and publish empirical research. These issues encompass concerns over responsible authorship, fair treatment of human subjects, ethicality of experimental procedures, availability of data, unselective reporting and publishability of research findings. This study aims to assess whether the philosophical community has as yet successfully addressed such issues. To do so, the instructions for authors, submission process and published research papers of 29 main (...) journals in philosophy have been considered and analyzed. In light of the evidence reported here, it is argued that the philosophical community has as yet failed to properly tackle such issues. The paper also delivers some recommendations for authors, reviewers and editors in the field. (shrink)