The reward system of science is the priority rule. The first scientist making a new discovery is rewarded with prestige, while second runners get little or nothing. Michael Strevens, following Philip Kitcher, defends this reward system, arguing that it incentivizes an efficient division of cognitive labor. I argue that this assessment depends on strong implicit assumptions about the replicability of findings. I question these assumptions on the basis of metascientific evidence and argue that the priority rule systematically discourages replication. My (...) analysis leads us to qualify Kitcher and Strevens’s contention that a priority-based reward system is normatively desirable for science. (shrink)

"The pursuit of science by professional scientists every day bears less and less resemblance to the perception of science by the general public. It is not the rule-based, methodical system for accumulating facts that dominates the public view. Rather it is the idiosyncratic, often bumbling search for understanding in mostly uncharted places. It is full of wrong turns, cul-de-sacs, mistaken identities, false findings, errors of fact and judgment-and the occasional remarkable success. The widespread but distorted view of science as infallible (...) originates in an education system that teaches nothing but facts using very large, very frightening textbooks, and is spread by media that report on discoveries but almost never on process. It is further reinforced by politicians who pay for it and want to use it to determine policy and therefore want it right and, worst of all, sometimes by scientists who learn early on that talking too much about failures and not enough about successes can harm their careers. Failure, then, is a book that seeks to make science more appealing by exposing its faults. In this sequel to Ignorance, Stuart Firestein shows us that scientific enterprise is riddled with failures, and that this is not only necessary but good. Failure reveals how science got its start, when humans began to use a process-trial and error-as a kind of recipe that includes a hefty dose of failure. It gives the non-scientifically trained public an insider's view of how science is actually done, with the aim of making it accessible, comprehensible, and entertaining."--Publisher description. (shrink)

Featuring contributions from the world’s leading experts on the subject and based partly on several detailed case studies, this volume is the first comprehensive analysis of the scientific notion of robustness as well as of the general ...

ArgumentIn the theory-dominated view of scientific experimentation, all relations of theory and experiment are taken on a par; namely, that experiments are performed solely to ascertain the conclusions of scientific theories. As a result, different aspects of experimentation and of the relations of theory to experiment remain undifferentiated. This in turn fosters a notion of theory-ladenness of experimentation (TLE) that is toocoarse-grainedto accurately describe the relations of theory and experiment in scientific practice. By contrast, in this article, I suggest that (...) TLE should be understood as anumbrella conceptthat has different senses. To this end, I introduce a three-fold distinction among the theories of high-energy particle physics (HEP) as background theories, model theories, and phenomenological models. Drawing on this categorization, I contrast two types of experimentation, namely, “theory-driven” and “exploratory” experiments, and I distinguish between the “weak” and “strong” senses of TLE in the context of scattering experiments from the history of HEP. This distinction enables identifying the exploratory character of the deep-inelastic electron-proton scattering experiments – performed at the Stanford Linear Accelerator Center (SLAC) between the years 1967 and 1973 – thereby shedding light on a crucial phase of the history of HEP, namely, the discovery of “scaling,” which was the decisive step towards the construction of quantum chromo-dynamics as a gauge theory of strong interactions. (shrink)

Exploratory experimentation and high-throughput molecular biology appear to have considerable affinity for each other. Included in the latter category is metagenomics, which is the DNA-based study of diverse microbial communities from a vast range of non-laboratory environments. Metagenomics has already made numerous discoveries and these have led to reinterpretations of fundamental concepts of microbial organization, evolution, and ecology. The most outstanding success story of metagenomics to date involves the discovery of a rhodopsin gene, named proteorhodopsin, in marine bacteria that were (...) never suspected to have any photobiological capacities. A discussion of this finding and its detailed investigation illuminates the relationship between exploratory experimentation and metagenomics. Specifically, the proteorhodopsin story indicates that a dichotomous interpretation of theory-driven and exploratory experimentation is insufficient and that an interactive understanding of these two types of experimentation can be usefully supplemented by another category, "natural history experimentation". Further reflection on the context of metagenomics suggests the necessity of thinking more historically about exploratory and other forms of experimentation. (shrink)

This fascinating study in the sociology of science explores the way scientists conduct, and draw conclusions from, their experiments. The book is organized around three case studies: replication of the TEA-laser, detecting gravitational rotation, and some experiments in the paranormal. "In his superb book, Collins shows why the quest for certainty is disappointed. He shows that standards of replication are, of course, social, and that there is consequently no outside standard, no Archimedean point beyond society from which we can lever (...) the intellects of our fellows. "- -Donald M. McCloskey, Journal of Economic Psychology "Collins is one of the genuine innovators of the sociology of scientific knowledge.... Changing Order is a rich and entertaining book. "- - Isis "The book gives a vivid sense of the contingent nature of research and is generally a good read. "- -Augustine Brannigan, Nature "This provocative book is a review of [Collins's] work, and an attempt to explain how scientists fit experimental results into pictures of the world.... A promising start for new explorations of our image of science, too often presented as infallibly authoritative. "- -Jon Turney, New Scientist. (shrink)

My aim in this article is to introduce readers to the topic of exploratory experimentation and briefly explain how the three articles that follow, by Richard Burian, Kevin Elliott, and Maureen O'Malley, advance our understanding of the nature and significance of exploratory research. I suggest that the distinction between exploratory and theory-driven experimentation is multidimensional and that some of the dimensions are continuums. I point out that exploratory experiments are typically theory-informed even if they are not theory-driven. I also distinguish (...) between research programs and experiments. Research programs that are largely exploratory, such as the ones discussed in these case studies, can involve both exploratory and theory-driven experimentation. (shrink)

Philosophers of experiment have acknowledged that experiments are often more than mere hypothesis-tests, once thought to be an experiment's exclusive calling. Drawing on examples from contemporary biology, I make an additional amendment to our understanding of experiment by examining the way that `wide' instrumentation can, for reasons of efficiency, lead scientists away from traditional hypothesis-directed methods of experimentation and towards exploratory methods.

: The increasing attention on experiment in the last two decades has led to important insights into its material, cultural and social dimensions. However, the role of experiment as a tool for generating knowledge has been comparatively poorly studied. What questions are asked in experimental research? How are they treated and eventually resolved? And how do questions, epistemic situations, and experimental activity cohere and shape each other? In my paper, I treat these problems on the basis of detailed studies of (...) research practice. After presenting several cases from the history of electricity—Dufay, Ampère, and Faraday—I discuss a specific type of experiment—the "exploratory experiment"—and analyze how it works in concept formation. I argue that a fuller understanding of experiment can only be achieved by intertwining historical and philosophical perspectives in such a way that the very separation of the two become questioable. (shrink)

According to a received doctrine, espoused, by Karl Popper and Harry Collins, and taken for granted by many others, poorly replicated evidence should be epistemically defective and incapable of persuading scientists to accept the views it is used to argue for. But John Hughlings Jackson used poorly replicated clinical and post-mortem evidence to mount rationally compelling and influential arguments for a highly progressive theory of the organization of the brain and its functions. This paper sets out a number of Jackson's (...) arguments from his evidence and argues that they constitute a counter example against the received doctrine. (shrink)

This paper is devoted to an examination of the discovery, characterization, and analysis of the functions of microRNAs, which also serves as a vehicle for demonstrating the importance of exploratory experimentation in current (post-genomic) molecular biology. The material on microRNAs is important in its own right: it provides important insight into the extreme complexity of regulatory networks involving components made of DNA, RNA, and protein. These networks play a central role in regulating development of multicellular organisms and illustrate the importance (...) of epigenetic as well as genetic systems in evolution and development. The examination of these matters yields principled arguments for the historicity of the functions of key biological molecules and for the indispensability of exploratory experimentation in contemporary molecular biology as well as some insight into the complex interplay between exploratory experimentation and hypothesis-driven science. This latter result is not only important for philosophy of science, but also of practical importance for the evaluation of grant proposals, although the elaboration of this latter claim must be left for another occasion. (shrink)

Starting with some illustrative examples, I develop a systematic account of a specific type of experimentation--an experimentation which is not, as in the "standard view", driven by specific theories. It is typically practiced in periods in which no theory or--even more fundamentally--no conceptual framework is readily available. I call it exploratory experimentation and I explicate its systematic guidelines. From the historical examples I argue furthermore that exploratory experimentation may have an immense, but hitherto widely neglected, epistemic significance.

There has been relatively little effort to provide a systematic overview of different forms of exploratory experimentation (EE). The present paper examines the growing subdiscipline of nanotoxicology and suggests that it illustrates at least four ways that researchers can engage in EE: searching for regularities; developing new techniques, simulation models, and instrumentation; collecting and analyzing large swaths of data using new experimental strategies (e.g., computer-based simulation and "high-throughput" instrumentation); and structuring an entire disciplinary field around exploratory research agendas. In order (...) to distinguish these and other activities more effectively, the paper proposes a taxonomy that includes three dimensions along which types of EE vary: (1) the aim of the experimental activity, (2) the role of theory in the activity, and (3) the methods or strategies employed for varying experimental parameters. (shrink)

In the theory-dominated view of scientific experimentation, all relations of theory and experiment are taken on a par; namely, that experiments are performed solely to ascertain the conclusions of scientific theories. As a result, different aspects of experimentation and of the relation of theory to experiment remain undifferentiated. This in turn fosters a notion of theory-ladenness of experimentation that is too coarse-grained to accurately describe the relations of theory and experiment in scientific practice. By contrast, in this article, I suggest (...) that TLE should be understood as an umbrella concept that has different senses. To this end, I introduce a three-fold distinction among the theories of high-energy particle physics as background theories, model theories and phenomenological models. Drawing on this categorization, I contrast two types of experimentation, namely, “theory-driven” and “exploratory” experiments, and I distinguish between the “weak” and “strong” senses of TLE in the context of scattering experiments from the history of HEP. This distinction enables to identify the exploratory character of the deep-inelastic electron-proton scattering experiments—performed at the Stanford Linear Accelerator Center between the years 1967 and 1973—thereby shedding light on a crucial phase of the history of HEP, namely, the discovery of “scaling”, which was the decisive step towards the construction of quantum chromo-dynamics as a gauge theory of strong interactions. (shrink)

Why the replication crisis might be less severe than it seems at first.

The Scientific Attitude presents a systematic account of the cognitive and social features of science. Written by an experimental biologist actively engaged in research, the work is unique in its attempt to understand science in terms of day-to-day practice. The book goes beyond the traditional description of science that focuses on method and logic to characterize the scientific attitude as a way of looking at the world.