Replicability is widely taken to ground the epistemic authority of science. However, in recent years, important published findings in the social, behavioral, and biomedical sciences have failed to replicate, suggesting that these fields are facing a “replicability crisis.” For philosophers, the crisis should not be taken as bad news but as an opportunity to do work on several fronts, including conceptual analysis, history and philosophy of science, research ethics, and social epistemology. This article introduces philosophers to these discussions. First, I (...) discuss precedents and evidence for the crisis. Second, I discuss methodological, statistical, and social-structural factors that have contributed to the crisis. Third, I focus on the philosophical issues raised by the crisis. Finally, I discuss proposed solutions and highlight the gaps that philosophers could focus on. (shrink)

Scientists are becoming increasingly aware of a “replicability crisis” in the behavioral, social, and biomedical sciences. Researchers have made progress identifying statistical and methodological...

Comparative psychology experiments typically test a null statistical hypothesis against an alternative. Coupled with Morgan’s canon, this is often taken to imply that the model positing the simpler psychological capacity should be treated as a ‘default’ that must be ruled out before any other model can be accepted. It has been posited that this practice neglects evidence. I argue that the problem is deeper, including the way it structures the evaluation of evidence that is considered; it frames model choice around (...) the acceptance or rejection of a default. I oppose this default framing in all its forms and develop an evidentialist alternative. Default framing fails to respect the difference between experimental statistical hypotheses and substantive hypotheses such as models. It is not actually supported by the use of null hypothesis significance testing (which I retain), it distorts the weighting of evidence, and it systematically biases practice. (shrink)

Philosophy is a reflective activity. So perhaps it is unsurprising that many philosophers have claimed that reflection plays an important role in shaping and even improving our philosophical thinking. This hypothesis seems plausible given that training in philosophy has correlated with better performance on tests of reflection and reflective reasoning has correlated with demonstrably better judgments in a variety of domains. This article reviews the hypothesized roles of reflection in philosophical thinking as well as the empirical evidence for these roles. (...) This reveals that although there are fairly reliable links between reflection and philosophical judgment among both laypeople and philosophers, the role of reflection in philosophical thinking may nonetheless depend in part on other factors, some of which have yet to be determined. So progress in research on reflection in philosophy may require further innovation in experimental methods and psychometric validation of philosophical measures. (shrink)