The reward system of science is the priority rule. The first scientist making a new discovery is rewarded with prestige, while second runners get little or nothing. Michael Strevens, following Philip Kitcher, defends this reward system, arguing that it incentivizes an efficient division of cognitive labor. I argue that this assessment depends on strong implicit assumptions about the replicability of findings. I question these assumptions on the basis of metascientific evidence and argue that the priority rule systematically discourages replication. My (...) analysis leads us to qualify Kitcher and Strevens’s contention that a priority-based reward system is normatively desirable for science. (shrink)

This fascinating study in the sociology of science explores the way scientists conduct, and draw conclusions from, their experiments. The book is organized around three case studies: replication of the TEA-laser, detecting gravitational rotation, and some experiments in the paranormal. "In his superb book, Collins shows why the quest for certainty is disappointed. He shows that standards of replication are, of course, social, and that there is consequently no outside standard, no Archimedean point beyond society from which we can lever (...) the intellects of our fellows. "- -Donald M. McCloskey, Journal of Economic Psychology "Collins is one of the genuine innovators of the sociology of scientific knowledge.... Changing Order is a rich and entertaining book. "- - Isis "The book gives a vivid sense of the contingent nature of research and is generally a good read. "- -Augustine Brannigan, Nature "This provocative book is a review of [Collins's] work, and an attempt to explain how scientists fit experimental results into pictures of the world.... A promising start for new explorations of our image of science, too often presented as infallibly authoritative. "- -Jon Turney, New Scientist. (shrink)

In his new foreword to this edition, Hilary Putnam forcefully rejects these nativist claims.

A heated debate surrounds the significance of reproducibility as an indicator for research quality and reliability, with many commentators linking a "crisis of reproducibility" to the rise of fraudulent, careless and unreliable practices of knowledge production. Through the analysis of discourse and practices across research fields, I point out that reproducibility is not only interpreted in different ways, but also serves a variety of epistemic functions depending on the research at hand. Given such variation, I argue that the uncritical pursuit (...) of reproducibility as an overarching epistemic value is misleading and potentially damaging to scientific advancement. Requirements for reproducibility, however they are interpreted, are one of many available means to secure reliable research outcomes. Furthermore, there are cases where the focus on enhancing reproducibility turns out not to foster high-quality research. Scientific communities and Open Science advocates should learn from inferential reasoning from irreproducible data, and promote incentives for all researchers to explicitly and publicly discuss their methodological commitments, the ways in which they learn from mistakes and problems in everyday practice, and the strategies they use to choose which research component of any project needs to be preserved in the long term, and how. (shrink)

The replicability of experiment is routinely offered as the gold standard of evidence. I argue that it is not supported by a universal principle of replicability in inductive logic. A failure of replication may not impugn a credible experimental result; and a successful replication can fail to vindicate an incredible experimental result. Rather, employing a material approach to inductive inference, the evidential import of successful replication of an experiment is determined by the prevailing background facts. Commonly, these background facts do (...) support successful replication as a good evidential guide and this has fostered the illusion of a deeper, exceptionless principle. (shrink)

In recent decades many sociologists and philosophers of science, especially the so-called ‘new experimentalists’, have stressed the need for detailed studies of real, ongoing experimental practices, and have claimed that a new image of science results from such an approach. Among the new objects of interest that have emerged from laboratory studies, an important one is the tacit dimension of scientific practices. Harry Collins, in particular, has insisted that irreducibly tacit presuppositions and skills are inevitably involved in experimental practices, and (...) that these tacit resources play an essential role in the stabilization of successful scientific achievements. What I will call the ‘opacity of experimental practices’ has been analyzed in different ways, but on the whole, it has been claimed to have harmful epistemological consequences with respect to crucial issues such as the nature of experimental facts, scientific realism, scientific rationality, and the contingency of what acquires the status of an established scientific result in practitioners’ eyes. Such claims remain highly controversial. The aim of this paper is to discuss the epistemological implications of the involvement of tacit resources in experimental practices and to provide helpful conceptual tools with respect to the issue of tacit resources in science. Specifically, the paper provides an analytical clarification of the relation between the opacity of experimental practices and the principle of experimenters substitutability, the latter being a principle commonly viewed as a necessary feature of any good science. Serious doubts are finally raised about the validity of the experimenters substitutability principle, and the impact of these doubts with respect to the contingency of scientific facts and results is considered. (shrink)

This paper revisits the debate between Harry Collins and Allan Franklin, concerning the experimenters’ regress. Focusing my attention on a case study from recent psychology (regarding experimental evidence for the existence of a Mozart Effect), I argue that Franklin is right to highlight the role of epistemological strategies in scientific practice, but that his account does not sufficiently appreciate Collins’s point about the importance of tacit knowledge in experimental practice. In turn, Collins rightly highlights the epistemic uncertainty (and skepticism) surrounding (...) much experimental research. However, I will argue that his analysis of tacit knowledge fails to elucidate the reasons why scientists often are (and should be) skeptical of other researchers’ experimental results. I will present an analysis of tacit knowledge in experimental research that not only answers to this desideratum, but also shows how such skepticism can in fact be a vital enabling factor for the dynamic processes of experimental knowledge generation. (shrink)

The authors provide an overview of philosophical discussions about the roles of experiment in science. First, they cover two approaches that took shape under the heading of “new experimentalism” in the 1980s and 1990s. One approach was primarily concerned with questions about entity realism, robustness, and epistemological strategies. The other has focused on exploratory experiments and the dynamic processes of experimental research as such, highlighting its iterative nature and drawing out the ways in which such research is grounded in experimental (...) systems, concepts and operational definitions. Second, the authors look at more recent philosophical work on the epistemology of causal inference, in particular highlighting discussions in the philosophy of the behavioral and social sciences, concerning the extrapolation from laboratory contexts to the world. (shrink)