The replicability of a research claim is often positioned as an important step in establishing the credibility of scientific research. This expectation persists despite ongoing disagreements over how to characterise replication practices in various contexts. Rather than attempt to explain or resolve these disagreements, we propose that there is value in exploring the variable uses of the replicability concept. To this end, we treat the replicability concept as a goal-directed tool for studying scientific practices. This approach extends scholarship on the (...) goal-directed uses of concepts within investigative practices to explore the value of reflexively interrogating those concepts used to study the sciences as practiced. In doing so, we highlight the importance of considering how and when a given concept is an appropriate tool for a given goal when studying scientific practices. For instance, in the case of the replicability concept, our examination suggests that there is value in clarifying how a given characterisation of replicability is appropriate to a given context-specific analytic and/or evaluative goal. In addition, we hope to draw attention to how Metaresearch and HPS contexts provide complementary insights for those seeking to understand when and how replication practices can help in assessing a given research claim. (shrink)

There is an ongoing and robust tradition of science and technology studies scholars conducting ethnographic laboratory studies. These laboratory studies—like all ethnographies—are each conducted at a particular time, are situated in a particular place, and are about a particular culture. Presumably, this contextual specificity means that such ethnographies have limited applicability beyond the narrow slice of time, place, and culture that they each subject to examination. But we do not always or even often treat them that way. It is beyond (...) common for us to speak about what one or another laboratory study reveals about the laboratory, or “science” much more broadly. Given the contextual specificity of our ethnographic laboratory studies, what justifies this presumed generalizability? Initially, this manuscript surveys typical responses to this question, but then it pursues an unusual one: the potential replicability of ethnographic results. This potential is hereby explored, via an ethnographic replication attempt—one designed and conducted in order to test the generalizability of a particular laboratory study, that of Latour and Woolgar’s classic Laboratory Life. The results of the ethnographic replication attempt are reported, and a remarkable degree of replicability is established. (shrink)

This article seeks rapprochement between the sociology of knowledge and philosophy of science by attempting to capture the best social constructionist insights within a strongly realistic philosophy of science. Key to doing so are separating the grounds for the individual scientist coming to know that P from those grounds for socially credentialing the claim that P within the relevant scientific subcommunity and showing how truth considerations can enter into the analysis of knowledge without interfering with social constructionist treatments of credentialing (...) claims. A detailed epistemology and associated account of the social credentialing of knowledge claims are presented. Close attention is paid to the epistemological and social aspects of the nature and role of observation reports, the interpretation of data, simplifications, idealizations, and approximations, and the nature of replication. The article contains a National Aeronautics and Space Administration remote-sensing case study and a detailed analysis of replication in the 1881–1933 Michelson-Morley-Miller interferometer ether studies. (shrink)

This essay is a contribution to the history of methodological thought. I focus on key methodological criteria for successful experimentation, replication and multiple determinations of empirical evidence. Drawing on reports of experiments with viper venom from the late seventeenth and late eighteenth centuries, as well as on present-day methodological thought I examine whether past experimenters regarded repetition, replication, and multiple determinations as criteria for validity; what exactly they meant by this; what they hoped to gain by repeating, varying, triangulating, and (...) replicating; and how relevant these criteria were for them. I also consider if this analysis has implications for current philosophical work on the methodology of experimental practice. (shrink)

Scientific articles exemplify standard functional units constraining argumentative structures. Severe space limitations demand every paragraph and illustration contribute to establishing the paper's claims. Philosophical testing and confirmation models should take into account each paragraph, table, and illustration. Hypothetico-Deductive, Bayesian Inductive, and Inference-to-the-Best-Explanation models do not, garbling the logic of papers. Micro-analysis of the fundamental paper in plate tectonics reveals an argumentative structure commonplace in science but ignored by standard philosophical accounts that cannot be dismissed as mere rhetorical embellishment. Papers with (...) illustrations often display a second argumentative structure differing from the text's. Constraints on adequate testing and confirmation analyses are adduced. "Experiments are about the assembly of persuasive arguments, ones that will stand up in court.... The task at hand is to capture the building-up of a persuasive argument about the world even in the absence of the logician's certainty." --Galison, How Experiments End, 277. (shrink)

This paper examines how scientists conceptualize their research methodologies. Do scientists raise concerns about vague criteria and genuine uncertainties in experimental practice? If so, what sorts of issues do they identify as problematic? Do scientists acknowledge the presence of value judgments in scientific research, and do they reflect on the relation between epistemic and non-epistemic criteria for decisionmaking? We present findings from an analysis of qualitative interviews with 63 scientific researchers who talk about their views on good research practice. We (...) argue that analysts of science should care about scientists’ conceptualizations of the criteria and of the practical judgments that scientific inquiry involves. While scientists’ accounts of their own research methodologies alone do not give us a full picture of how science really works, they can point us to areas of concern. They can inspire and direct philosophical reflections about how science works. Throughout the interviews, the participating researchers provided specific examples from their own research contexts as illustrations of their methodological points. These examples reveal that scientists often struggle to evaluate the quality of their data, to figure out whether the available evidence confirms their hypothesis, whether a replication was successful, or to what extent they can rely on peer-reviewed papers. General ideas about good research methods do not directly translate into specific evaluation criteria or strategies that can guide research and help validate empirical data. (shrink)

Scientists and philosophers generally agree that the replication of experiments is a key ingredient of good and successful scientific practice. “One-offs“ are not significant; experiments must be replicable to be considered valid and important. But the term “replication“ has been used in a number of ways, and it is therefore quite difficult to appraise the meaning and significance of replications. I consider how history may help - and has helped - with this task. I propose that: 1) Studies of past (...) scientific episodes in historical context and of recent philosophical contributions to the discussion are heuristic tools for exploring and clarifying the meaning of that concept. 2) The analysis of the development of the methodological imperative of replication sheds light on the significance scientists have attached to it, thereby contributing further to the clarification of the concept. 3) The analysis of the history of philosophical thought about methods and scientific methodology helps understand why philosophers have not paid much attention to the analysis of the concept of replication. (shrink)

Laboratory experimentation was once considered impossible or irrelevant in economics. Recently, however, economic science has gone through a real ‘laboratory revolution’, and experimental economics is now a most lively subfield of the discipline. The methodological advantages and disadvantages of controlled experimentation constitute the main subject of this thesis. After a survey of the literature on experiments in philosophy and economics, the problem of testing normative theories of rationality is tackled. This philosophical issue was at the centre of a famous controversy (...) in decision theory, during which a methodology of normative falsification was first articulated and used to assess experimental results. In the third chapter, the methodological advantages of controlled experimentation are illustrated and discussed with examples taken from the experiments on the so-called ‘preference reversal’ phenomenon. Laboratory testing allows to establish with a high degree of certainty that certain phenomena lie behind the experimental data, by means of independent testing, elimination of alternative hypotheses, and the use of different instruments of observation. The fourth chapter is devoted to a conceptual analysis of the problem of ‘parallelism’. This is the problem of inferring from the occurrence of a phenomenon in the laboratory, to its instantiation also in non-laboratory environments. Experimental economists have discussed parallelism at length, and their views are presented and criticised. Eventually, it is argued that parallelism is a factual matter and as such can only be established on empirical grounds. The fifth chapter provides an example of how one can argue for parallelism, focusing on the case of experimentation on the ‘winner’s curse’ phenomenon. The role of experiments as ‘mediators’ between theoretical models and their target domain of application is illustrated, and the structure of parallelism arguments analysed in detail. Finally, in the last chapter, economic experiments are compared to simulations, in order to highlight their specific characteristics. (shrink)

The article discusses Karl Popper’s account of Lamarckism. In this article I use Popper’s published and unpublished statements regarding Lamarckism as well as his correspondence with the Australian immunologist Edward Steele and other biologists to examine why Popper was interested in Lamarckism, how his account of Lamarckism can be understood in the context of his philosophy, and what, if any, new context Popper provided for the discussion of this abandoned doctrine. I begin by discussing Popper’s frame of reference regarding Lamarckism, (...) examining how it changed following his involvement with different “transitory groups” of biologists concerned with redefining the boundaries between traditional disciplines. I then discuss Popper’s account of Lamarckism in positioning it in relation to three aspects of his philosophy: his distinction between the principles of induction/instruction and deduction/selection, his distinction between scientific and teleological concepts, and his concept of progress in science. Then, I follow the debate concerning Steele’s Lamarckian experiments with a closer look at Popper’s role and his position in this controversy. I conclude that Popper’s writings provided a new context for the discussion of Lamarckism in the 1970s and 1980s, thus making it “scientifically acceptable” again. I preface this discussion by a brief outline of Steele’s Lamarckian hypothesis and Popper’s comments on Steele’s work. (shrink)