The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high levels of false positives in the literature and, consequently, unexpectedly low replication rates. In this article, I offer an alternative view. I argue that questionable and other research practices do not usually inflate relevant Type I error rates. I begin (...) by introducing the concept of Type I error rates and distinguishing between statistical errors and theoretical errors. I then illustrate my argument with respect to model misspecification, multiple testing, selective inference, forking paths, exploratory analyses, p-hacking, optional stopping, double dipping, and HARKing. In each case, I demonstrate that relevant Type I error rates are not usually inflated above their nominal level, and in the rare cases that they are, the inflation is easily identified and resolved. I conclude that the replication crisis may be explained, at least in part, by researchers’ misinterpretation of statistical errors and their underestimation of theoretical errors. (shrink)

The 1980s, it is often claimed, was the decade when experimentation finally became a philosophical topic. This was the responsibility, the claim continues, of one particular movement within philosophy of science, called “new experimentalism.” The aim of this article is to complicate this historical narrative. We argue that in the 1980s, the study of experimentation was carried out not by one movement with one particular aim but rather in a diverse and open-ended way by people with different aims and backgrounds. (...) We then argue that from the late 1990s onward, this diversity disappeared and made room for disciplinary divisions—questions concerning experimentation became philosophical, others sociological, and so on. The reason for this, we claim, was that science and technology studies, philosophy of technology, and philosophy of science took over aspects of the 1980s study of experimentation. In this way, we argue, these elements became institutionalized, whereas others were forgotten. The importance of this process of institutionalization is illustrated by means of a discussion of other, similar approaches to the philosophy of experimentation that have not been able to ensure continuity because they did not find an institutional home. (shrink)

This dissertation proposes and defends a hybrid view I call Hybrid Impermissivism, which combines the following two theses: Moderate Uniqueness and Credal Permissivism. Moderate Uniqueness says that no evidence could justify both believing a proposition and its negation. However, on Moderate Uniqueness, evidence could justify both believing and suspending judgement on a proposition (hence the adjective “Moderate”). And Credal Permissivism says that more than one credal attitude could be justified on the evidence. Hybrid Impermissisim is developed into a precise theory (...) by using normative bridge principles on how rational belief and credence ought to interact. My overall conclusion is that Hybrid Impermissivism is a coherent, plausible, and conciliatory position and provides a correct characterisation of the requirements of evidence on doxastic attitudes . (shrink)

Likelihoodism is the view that the degree of evidential support should be analysed and measured in terms of likelihoods alone. The paper considers and responds to a popular criticism that a likelihoodist framework is too restrictive to guide belief. First, I show that the most detailed and rigorous version of this criticism, as put forward by Gandenberger (2016), is unsuccessful. Second, I provide a positive argument that a broadly likelihoodist framework can accommodate guidance for comparative belief, even when objectively well-grounded (...) prior probabilities are not available. As I show, the shift from non-relational to comparative probabilities opens up a new space for addressing the belief guidance problem for likelihoodism. (shrink)

We argue that the epistemic functions of replication in science are best understood by their role in assessing kinds of experimental error. Direct replications serve to assess the reliability of an experiment through its precision: the presence and degree of random error. Conceptual replications serve to assess the validity of an experiment through its accuracy: the presence and degree of systematic errors. To illustrate the aptness of this view, we examine the Hubble constant controversy in astronomy, showing how astronomers have (...) responded to the concordances and discordances in their results by carrying out the different kinds of replication that we identify, with the aim of establishing a precise, accurate value for the Hubble constant. We contrast our view with Machery’s “re-sampling” account of replicability, which maintains that replications only assess reliability. (shrink)

Mitchell & Gronenborn propose that we account for the presence of multiple models of protein structure, each produced in different contexts, through the framework of integrative pluralism. I argue that two interpretations of this framework are available, neither of which captures the relationship between a model and the protein structure it represents or between multiple models of protein structure. Further, it inclines us toward concluding prematurely that models of protein structure are right in their contexts and makes extrapolation of findings (...) from one context to another seem unwarranted. Instead, protein structure determination ought to be understood as modestly monistic. There is one model for every protein in each physicochemical context, and models of the same protein produced in different contexts are compatible with one another. ‘Integrating’ multiple models amounts to extrapolating from one context to another; this is possible because the effect of context on protein folding is relatively weak and predictable. Modest monism better describes the practice of protein structure determination than integrative pluralism and enables greater attention to how context affects protein folding. (shrink)

This dissertation is about human knowledge of reality. In particular, it argues that scientific knowledge is bounded by historically available instruments and theories; nevertheless, the use of several independent instruments and theories can provide access to the persistent potentialities of reality. The replicability of scientific observations and experiments allows us to obtain explorable evidence of robust entities and properties. The dissertation includes seven chapters. It also studies three cases – namely, Higgs bosons and hypothetical Ϝ-particles (section 2.4), the Ptolemaic and (...) Kepler model of the planets (section 6.7), and the special theory of relativity (chapter 7). -/- Chapter 1 is the introduction of the dissertation. Chapter 2 clarifies the notion of the real on the basis of two concepts: persistence and resistance. These concepts enable me to explain my ontological belief in the real potentialities of human-independent things and the implications of this view for the perceptual and epistemological levels of discussion. On the basis of the concept of “overlapping perspectives”, chapter 3 argues that entity realism and perspectivism are complementary. That is, an entity that manifests itself through several experimental/observational methods is something real, but our knowledge of its nature is perspectival. Critically studying the recent views of entity realism, chapter 4 extends the discussion of entity realism and provides a criterion for the reality of property tokens. Chapter 5, in contrast, develops the perspectival aspects of my view on the basis of the phenomenological-hermeneutical approaches to the philosophy of science. This chapter also elaborates my view of empirical evidence, as briefly expressed in sections 2.5 and 4.5. Chapter 6 concerns diachronic theoretical perspectives. It first explains my view of progress, according to which current perspectives are broader than past ones. Second, it argues that the successful explanations and predictions of abandoned theories can be accounted for from our currently acceptable perspectives. The case study of Ptolemaic astronomy supports the argument of this chapter. Chapter 7 serves as the conclusion of the dissertation by applying the central themes of the previous chapters to the case study of special relativity theory. I interpret frame-dependent properties, such as length and time duration, and the constancy of the speed of light according to realist perspectivism. (shrink)

While the term “reactivity” has come to be associated with specific phenomena in the social sciences, having to do with subjects’ awareness of being studied, this paper takes a broader stance on this concept. I argue that reactivity is a ubiquitous feature of the psychological subject matter and that this fact is a precondition of experimental research, while also posing potential problems for the experimenter. The latter are connected to the worry about distorted data and experimental artifacts. But what are (...) experimental artifacts and what is the most productive way of dealing with them? In this paper, I approach these questions by exploring the ways in which experimenters in psychology simultaneously exploit and suppress the reactivity of their subject matter in order to produce experimental data that speak to the question or subject matter at hand. Highlighting the artificiality of experimental data, I raise the question of what distinguishes a genuine experimental result from an experimental artifact. My analysis construes experimental results as the outcomes of inferences from the data that take material background assumptions as auxiliary premises. Artifacts occur when one or more of these background assumptions are false, such that the data do not reliably serve the purposes they were generated for. I conclude by laying out the ways in which my analysis of data quality is relevant to, and informed by, recent debates about the replicability of experimental results. (shrink)

In this talk I present the main results from Anta (2021), namely, that the theoretical division between Boltzmannian and Gibbsian statistical mechanics should be understood as a separation in the epistemic capabilities of this physical discipline. In particular, while from the Boltzmannian framework one can generate powerful explanations of thermal processes by appealing to their microdynamics, from the Gibbsian framework one can predict observable values in a computationally effective way. Finally, I argue that this statistical mechanical schism contradicts the Hempelian (...) (1958) thesis that the predictive power of a scientific theory is directly proportional to its explanatory potential, and vice versa. (shrink)

The enduring replication crisis in many scientific disciplines casts doubt on the ability of science to estimate effect sizes accurately, and in a wider sense, to self-correct its findings and to produce reliable knowledge. We investigate the merits of a particular countermeasure—replacing null hypothesis significance testing with Bayesian inference—in the context of the meta-analytic aggregation of effect sizes. In particular, we elaborate on the advantages of this Bayesian reform proposal under conditions of publication bias and other methodological imperfections that are (...) typical of experimental research in the behavioral sciences. Moving to Bayesian statistics would not solve the replication crisis single-handedly. However, the move would eliminate important sources of effect size overestimation for the conditions we study. (shrink)

The history of statistics is filled with many controversies, in which the prime focus has been the difference in the “interpretation of probability” between Fre- quentist and Bayesian theories. Many philosophical arguments have been elabo- rated to examine the problems of both theories based on this dichotomized view of statistics, including the well-known stopping-rule problem and the catch-all hy- pothesis problem. However, there are also several “hybrid” approaches in theory, practice, and philosophical analysis. This poses many fundamental questions. This paper (...) reviews three cases and argues that the interpretation problem of probabil- ity is insufficient to begin a philosophical analysis of the current issues in the field of statistics. A novel viewpoint is proposed to examine the relationship between the stopping-rule problem and the catch-all hypothesis problem. (shrink)

Although the impact of so-called “sponsorship bias” has been the subject of increased attention in the philosophy of science, what exactly constitutes its epistemic wrongness is still debated. In this paper, I will argue that neither evidential accounts nor social–epistemological accounts can fully account for the epistemic wrongness of sponsorship bias, but there are good reasons to prefer social–epistemological to evidential accounts. I will defend this claim by examining how both accounts deal with a paradigm case from medical epistemology, recently (...) discussed in a paper by Bennett Holman. I will argue that evidential accounts cannot adequately capture cases of sponsorship bias that involve the manufacturing of certainty because of their neutrality with respect to the role of non-epistemic values in scientific practice. If my argument holds, it further highlights the importance of integrating social and ethical concerns into epistemological analysis, especially in applied contexts. One can only properly grasp sponsorship bias as an epistemological problem if one resists the methodological tendency to analyze social, ethical, and epistemological issues in isolation from each other. (shrink)

Ian Hacking’s Representing and Intervening is often credited as being one of the first works to focus on the role of experimentation in philosophy of science, catalyzing a movement which is sometimes called the “philosophy of experiment” or “new experimentalism”. In the 1980s, a number of other movements and scholars also began focusing on the role of experimentation and instruments in science. Philosophical study of experimentation has thus seemed to be an invention of the 1980s whose central figure is Hacking. (...) This article aims to assess this historical claim, made by Hacking himself as well as others. It does so first by highlighting how a broader perspective on the history of philosophy reveals this invention narrative to be incorrect, since experimentation was a topic of interest for earlier philosophers. Secondly, the article evaluates a revision of this historical claim also made by some philosophers of experiment: the rediscovery narrative, which frames Hacking and others as having rediscovered the work of these earlier authors. This second narratives faces problems as well. Therefore we develop a third narrative which we call the contextualist narrative. Rather than considering experimentation in an essentialist manner as a fixed research object that is either present or not in the work of specific authors, experimentation should be addressed through a narrative that asks in what way it becomes a philosophical problem for certain authors and for what purpose. Such contextualization enables a repositioning of Hacking’s philosophy of experiment in relation to the specific debates in which he intervened, such as the realism-antirealism debate, the Science Wars and the debate on incommensurability. (shrink)

Making sense of why something succeeded or failed is central to scientific practice: it provides an interpretation of what happened, i.e. an hypothesized explanation for the results, that informs scientists’ deliberations over their next steps. In philosophy, the realism debate has dominated the project of making sense of scientists’ success and failure claims, restricting its focus to whether truth or reliability best explain science’s most secure successes. Our aim, in contrast, will be to expand and advance the practice-oriented project sketched (...) by Arthur Fine in his work on the Natural Ontological Attitude. An important obstacle to articulating a positive program, we suggest, has been overlooking how scientists adopt standardized rules and procedures in order to define and operationalize meanings for success and failure relative to their situated goals. To help fill this gap, we introduce two new ideas, design specifications and track records, and show how they advance our ability to make sense of scientific modeling practices while maintaining a deflationary stance toward the realism debate. (shrink)

We provide a novel articulation of the epistemic peril of p-hacking using three resources from philosophy: predictivism, Bayesian confirmation theory, and model selection theory. We defend a nuanced position on p-hacking: p-hacking is sometimes, but not always, epistemically pernicious. Our argument requires a novel understanding of Bayesianism, since a standard criticism of Bayesian confirmation theory is that it cannot represent the influence of biased methods. We then turn to pre-analysis plans, a methodological device used to mitigate p-hacking. Some say that (...) pre-analysis plans are epistemically meritorious while others deny this, and in practice pre-analysis plans are often violated. We resolve this debate with a modest defence of pre-analysis plans. Further, we argue that pre-analysis plans can be epistemically relevant even if the plan is not strictly followed—and suggest that allowing for flexible pre-analysis plans may be the best available policy option. (shrink)

One might be inclined to assume, given the mouse donning its cover, that the behavior of interest in Nicole Nelson's book Model Behavior (2018) is that of organisms like mice that are widely used as “stand-ins” for investigating the causes of human behavior. Instead, Nelson's ethnographic study focuses on the strategies adopted by a community of rodent behavioral researchers to identify and respond to epistemic challenges they face in using mice as models to understand the causes of disordered human behaviors (...) associated with mental illness. Although Nelson never explicitly describes the knowledge production activities in which her behavioral geneticist research subjects engage as “exemplary”, the question of whether or not these activities constitute “model behavior(s)”—generalizable norms for engaging in scientific research—is one of the many thought-provoking questions raised by her book. As a philosopher of science interested in this question, I take it up here. (shrink)

The question of where, between theory and experiment, computer simulations (CSs) locate on the methodological map is one of the central questions in the epistemology of simulation (cf. Saam Journal for General Philosophy of Science, 48, 293–309, 2017). The two extremes on the map have them either be a kind of experiment in their own right (e.g. Barberousse et al. Synthese, 169, 557–574, 2009; Morgan 2002, 2003, Journal of Economic Methodology, 12(2), 317–329, 2005; Morrison Philosophical Studies, 143, 33–57, 2009; Morrison (...) 2015; Massimi and Bhimji Studies in History and Philosophy of Science Part B: Studies in History and Philosophy of Modern Physics, 51, 71–81, 2015; Parker Synthese, 169, 483–496, 2009) or just an argument executed with the aid of a computer (e.g. Beisbart European Journal for Philosophy of Science, 2, 395–434, 2012; Beisbart and Norton International Studies in the Philosophy of Science, 26, 403–422, 2012). There exist multiple versions of the first kind of position, whereas the latter is rather unified. I will argue that, while many claims about the ‘experimental’ status of CSs seem unjustified, there is a variant of the first position that seems preferable. In particular I will argue that while CSs respect the logic of (deductively valid) arguments, they neither agree with their pragmatics nor their epistemology. I will then lay out in what sense CSs can fruitfully be seen as experiments, and what features set them apart from traditional experiments nonetheless. I conclude that they should be seen as surrogate experiments, i.e. experiments executed consciously on the wrong kind of system, but with an exploitable connection to the system of interest. Finally, I contrast my view with that of Beisbart (European Journal for Philosophy of Science, 8, 171–204, 2018), according to which CSs are surrogates for experiments, arguing that this introduces an arbitrary split between CSs and other kinds of simulations. (shrink)

Kerr coined the term ‘HARKing’ to refer to the practice of ‘hypothesizing after the results are known’. This questionable research practice has received increased attention in recent years because it is thought to have contributed to low replication rates in science. The present article discusses the concept of HARKing from a philosophical standpoint and then undertakes a critical review of Kerr’s twelve potential costs of HARKing. It is argued that these potential costs are either misconceived, misattributed to HARKing, lacking evidence, (...) or that they do not take into account pre- and post-publication peer review and public availability to research materials and data. It is concluded that it is premature to conclude that HARKing has led to low replication rates. (shrink)

We introduce a new type of pluralism about biological function that, in contrast to existing, demonstrates a practical integration among the term’s different meanings. In particular, we show how to generalize Sandra Mitchell’s notion of integrative pluralism to circumstances where multiple epistemic tools of the same type are jointly necessary to solve scientific problems. We argue that the multiple definitions of biological function operate jointly in this way based on how biologists explain the evolution of protein function. To clarify how (...) our account relates to existing views, we introduce a general typology for monist and pluralist accounts along with standardized criteria for judging which is best supported by evidence. (shrink)

Abstract : A measurement result is never absolutely accurate: it is affected by an unknown “measurement error” which characterizes the discrepancy between the obtained value and the “true value” of the quantity intended to be measured. As a consequence, to be acceptable a measurement result cannot take the form of a unique numerical value, but has to be accompanied by an indication of its “measurement uncertainty”, which enunciates a state of doubt. What, though, is the value of measurement uncertainty? What (...) is its numerical value: how does one calculate it? What is its epistemic value: how one should interpret a measurement result? Firstly, we describe the statistical models that scientists make use of in contemporary metrology to perform an uncertainty analysis, and we show that the issue of the interpretation of probabilities is vigorously debated. This debate brings out epistemological issues about the nature and function of physical measurements, metrologists insisting in particular on the subjective aspect of measurement. Secondly, we examine the philosophical elaboration of metrologists in their technical works, where they criticize the use of the notion of “true value” of a physical quantity. We then challenge this elaboration and defend such a notion. The third part turns to a specific use of measurement uncertainty in order to address our thematic from the perspective of precision physics, considering the activity of the adjustments of physical constants. In the course of this activity, physicists have developed a dynamic conception of the accuracy of their measurement results, oriented towards a future progress of knowledge, and underlining the epistemic virtues of a never-ending process of identification and correction of measurement errors. (shrink)

Pierre Duhem’s influential argument for holism relies on a view of the role that background theory plays in testing: according to this still common account of “auxiliary hypotheses,” elements of background theory serve as truth-apt premises in arguments for or against a hypothesis. I argue that this view is mistaken. Rather than serving as truth-apt premises in arguments, auxiliary hypotheses are employed as “epistemic tools”: instruments that perform specific tasks in connecting our theoretical questions with the world but that are (...) not premises in arguments. On the resulting picture, the acceptability of an auxiliary hypothesis depends not on its truth but on contextual factors such as the task or purpose it is put to and the other tools employed alongside it. (shrink)

A “stopping rule” in a sequential experiment is a rule or procedure for deciding when that experiment should end. Accordingly, the “stopping rule principle” states that, in a sequential experiment, the evidential relationship between the final data and an hypothesis under consideration does not depend on the experiment’s stopping rule: the same data should yield the same evidence, regardless of which stopping rule was used. In this essay, I reconstruct and rebut five independent arguments for the SRP. Reminding oneself that (...) the stopping rule is a part of an experiment’s design and is no more mysterious than many other design aspects helps elucidate why some of these arguments for the SRP are unsound. (shrink)

Several developments for diverse scientific goals, mostly in physics and physiology, had to take place, which eventually gave us fMRI as one of the central research paradigms of contemporary cognitive neuroscience. This technique stands on solid foundations established by the physics of magnetic resonance and the physiology of hemodynamics and is complimented by computational and statistical techniques. I argue, and support using concrete examples, that these foundations give rise to a productive theory-ladenness in fMRI, which enables researchers to identify and (...) control for the types of methodological and inferential errors. Consequently, this makes it possible for researchers to represent and investigate cognitive phenomena in terms of hemodynamic data and for experimental knowledge to grow independently of large scale theories of cognition. (shrink)

Several developments for diverse scientific goals, mostly in physics and physiology, had to take place, which eventually gave us fMRI as one of the central research paradigms of contemporary cognitive neuroscience. This technique stands on solid foundations established by the physics of magnetic resonance and the physiology of hemodynamics and is complimented by computational and statistical techniques. I argue, and support using concrete examples, that these foundations give rise to a productive theory-ladenness in fMRI, which enables researchers to identify and (...) control for the types of methodological and inferential errors. Consequently, this makes it possible for researchers to represent and investigate cognitive phenomena in terms of hemodynamic data and for experimental knowledge to grow independently of large scale theories of cognition. (shrink)

Whereas there is much discussion about Thomas Kuhn’s notion of methodological incommensurability and many have seen his ideas as an attempt to allow for rational disagreement in science, so far no serious analysis of how exactly Kuhn aims to account for rational disagreement has been proposed. This paper provides the first in-depth analysis of Kuhn’s account of rational disagreement in science—an account that can be seen as the most prominent attempt to allow for rational disagreement in science. Three things will (...) be shown: First, we find not one, but two accounts of rational disagreements in science in Kuhn’s writings: one stemming from methodological incommensurability and one stemming from Kuhn-underdetermination, which are not only fundamentally different—the first purports to explain how disagreeing scientists can nevertheless be rational, while the second attempts to show how rational scientists can nevertheless disagree—but appear to be incompatible with each other. Second, I will assess both accounts. Kuhn’s account from methodological incommensurability is not convincing since it cannot explain rational disagreement in science. Whereas, on the other hand, Kuhn’s account from Kuhn-underdetermination allows for rational disagreement, his argument why we should accept it is not convincing. Third, I present a tentative sketch of an alternative to Kuhn’s account that emphasizes the fallibility of epistemic justification in order to show that Kuhn’s argument founders. In sum, the paper shows that focusing not on the muchly debated consequences of methodological incommensurability, but on Kuhn’s treatment of rational disagreement gives new insight into the adequate interpretation of his thought as well as the cogency of his ideas. (shrink)

In this paper, I show how one might resist two influential arguments for the Likelihood Principle by appealing to the ontological significance of creative intentions. The first argument for the Likelihood Principle that I consider is the argument from intentions. After clarifying the argument, I show how the key premiss in the argument may be resisted by maintaining that creative intentions sometimes independently matter to what experiments exist. The second argument that I consider is Gandenberger’s :475–503, 2015) rehabilitation of Birnbaum’s (...) :269–306, 1962) proof of the Likelihood Principle from the more intuitively obvious principles of conditionality and sufficiency. As with the argument from intentions, I show how Gandenberger’s argument for his Experimental Conditionality Principle may be resisted by maintaining that creative intentions sometimes independently matter to what experiments exist. (shrink)

The replication crisis has prompted many to call for statistical reform within the psychological sciences. Here we examine issues within Frequentist statistics that may have led to the replication crisis, and we examine the alternative—Bayesian statistics—that many have suggested as a replacement. The Frequentist approach and the Bayesian approach offer radically different perspectives on evidence and inference with the Frequentist approach prioritising error control and the Bayesian approach offering a formal method for quantifying the relative strength of evidence for hypotheses. (...) We suggest that rather than mere statistical reform, what is needed is a better understanding of the different modes of statistical inference and a better understanding of how statistical inference relates to scientific inference. (shrink)

Current debates about the replication crisis in psychology take it for granted that direct replication is valuable and focus their attention on questionable research practices in regard to statistical analyses. This paper takes a broader look at the notion of replication as such. It is argued that all experimentation/replication involves individuation judgments and that research in experimental psychology frequently turns on probing the adequacy of such judgments. In this vein, I highlight the ubiquity of conceptual and material questions in research, (...) and I argue that replication is not as central to psychological research as it is sometimes taken to be. (shrink)

These preprints were automatically compiled into a PDF from the collection of papers deposited in PhilSci-Archive in conjunction with the PSA 2018.

This book addresses key conceptual issues relating to the modern scientific and engineering use of computer simulations. It analyses a broad set of questions, from the nature of computer simulations to their epistemological power, including the many scientific, social and ethics implications of using computer simulations. The book is written in an easily accessible narrative, one that weaves together philosophical questions and scientific technicalities. It will thus appeal equally to all academic scientists, engineers, and researchers in industry interested in questions (...) related to the general practice of computer simulations. (shrink)

Subjective Bayesianism is a major school of uncertain reasoning and statistical inference. It is often criticized for a lack of objectivity: it opens the door to the influence of values and biases, evidence judgments can vary substantially between scientists, it is not suited for informing policy decisions. My paper rebuts these concerns by connecting the debates on scientific objectivity and statistical method. First, I show that the above concerns arise equally for standard frequentist inference with null hypothesis significance tests. Second, (...) the criticisms are based on specific senses of objectivity with unclear epistemic value. Third, I show that Subjective Bayesianism promotes other, epistemically relevant senses of scientific objectivity—most notably by increasing the transparency of scientific reasoning. (shrink)

This paper reviews all major theories of evidence such as the Bayesian theory, hypothetico-deductivism, satisfaction theories, error-statistics, Achinstein's explanationist theory and Cartwright's argument theory. All these theories fail to take adequate account of the context in which a hypothesis is established and used. It is argued that the context of an inquiry determines important facts about what evidence is, and how much and what kind has to be collected to establish a hypothesis for a given purpose.

The article analyses in detail the Meselson–Stahl experiment, identifying two novel difficulties for the crucial experiment account, namely, the fragility of the experimental results and the fact that the hypotheses under scrutiny were not mutually exclusive. The crucial experiment account is rejected in favour of an experimental-mechanistic account of the historical significance of the experiment, emphasizing that the experiment generated data about the biochemistry of DNA replication that is independent of the testing of the semi-conservative, conservative, and dispersive hypotheses. _1_ (...) Introduction _2_ The Meselson–Stahl Experiment _3_ Some Difficulties for the Crucial Experiment Account _3.1_ Additional experiments were required _3.2_ Simplicity considerations are unconvincing _3.3_ The fragility of the experimental results _3.4_ The problematic interpretation of falsifyng results _3.5_ Not all possible hypotheses considered or tested _3.6_ The tested hypotheses were not mutually exclusive _4_ The Historical and Scientific Significance of the Meselson–Stahl Experiment _4.1_ The challenge for the crucial experiment account _4.2_ A mechanistic perspective on the experiment _4.3_ The experimental design and its independence from theoretical speculations _4.4_ The advantages of a ‘bottom-up’ mechanistic account _5_ Conclusion. (shrink)

There is a debate in Bayesian confirmation theory between subjective and non-subjective accounts of evidence. Colin Howson has provided a counterexample to our non-subjective account of evidence: the counterexample refers to a case in which there is strong evidence for a hypothesis, but the hypothesis is highly implausible. In this article, we contend that, by supposing that strong evidence for a hypothesis makes the hypothesis more believable, Howson conflates the distinction between confirmation and evidence. We demonstrate that Howson’s counterexample fails (...) for a different pair of hypotheses. (shrink)

Statistical reasoning is an integral part of modern scientific practice. In The Seven Pillars of Statistical Wisdom Stephen Stigler presents seven core ideas, or pillars, of statistical thinking and the historical developments of each of these pillars, many of which were concurrent with developments in biology. Here we focus on Stigler’s fifth pillar, regression, and his discussion of how regression to the mean came to be thought of as a solution to a challenge for the theory of natural selection. Stigler (...) argues that the purely mathematical phenomenon of regression to the mean provides a resolution to a problem for Darwin’s evolutionary theory. Thus, he argues that the resolution to the problem for Darwin’s theory is purely mathematical, rather than causal. We show why this argument is problematic. (shrink)

Evidential holism begins with something like the claim that “it is only jointly as a theory that scientific statements imply their observable consequences.” This is the holistic claim that Elliott Sober tells us is an “unexceptional observation”. But variations on this “unexceptional” claim feature as a premise in a series of controversial arguments for radical conclusions, such as that there is no analytic or synthetic distinction that the meaning of a sentence cannot be understood without understanding the whole language of (...) which it is a part and that all knowledge is empirical knowledge. This paper is a survey of what evidential holism is, how plausible it is, and what consequences it has. Section 1 will distinguish a range of different holistic claims, Sections 2 and 3 explore how well motivated they are and how they relate to one another, and Section 4 returns to the arguments listed above and uses the distinctions from the previous sections to identify holism's role in each case. (shrink)

The philosophical or theoretical commitments informing psychological research are sometimes characterized, even by theoretical psychologists themselves, as nonempirical, outside the bounds of methodological consideration, and/or nonrational. We argue that this characterization is incoherent. We illustrate our concern by analogy with problematic appeals to Kuhn’s work that have been influential in theoretical psychology. Following the contemporary pragmatist tradition, we argue that our philosophical/theoretical commitments are part of our larger webs of belief, and that for any of these beliefs to have meaning (...) their content must be informed by our practical engagement with the world, i.e., they are based on empirical evidence, broadly construed. It is this empirical basis that allows us to recognize our commitments at all and rationally to assess and criticize them when necessary. We conclude by demonstrating a rational assessment of the philosophical/theoretical commitments underlying a recent study in the social psychology of religion. (shrink)

The idea that simplicity matters in science is as old as science itself, with the much cited example of Ockham's Razor, 'entia non sunt multiplicanda praeter necessitatem': entities are not to be multiplied beyond necessity. A problem with Ockham's razor is that nearly everybody seems to accept it, but few are able to define its exact meaning and to make it operational in a non-arbitrary way. Using a multidisciplinary perspective including philosophers, mathematicians, econometricians and economists, this 2002 monograph examines simplicity (...) by asking six questions: what is meant by simplicity? How is simplicity measured? Is there an optimum trade-off between simplicity and goodness-of-fit? What is the relation between simplicity and empirical modelling? What is the relation between simplicity and prediction? What is the connection between simplicity and convenience? The book concludes with reflections on simplicity by Nobel Laureates in Economics. (shrink)

To study climate change, scientists employ computer models, which approximate target systems with various levels of skill. Given the imperfection of climate models, how do scientists use simulations to generate knowledge about the causes of observed climate change? Addressing a similar question in the context of biological modelling, Levins (1966) proposed an account grounded in robustness analysis. Recent philosophical discussions dispute the confirmatory power of robustness, raising the question of how the results of computer modelling studies contribute to the body (...) of evidence supporting hypotheses about climate change. Expanding on Staley’s (2004) distinction between evidential strength and security, and Lloyd’s (2015) argument connecting variety-of-evidence inferences and robustness analysis, I address this question with respect to recent challenges to the epistemology robustness analysis. Applying this epistemology to case studies of climate change, I argue that, despite imperfections in climate models, and epistemic constraints on variety-of-evidence reasoning and robustness analysis, this framework accounts for the strength and security of evidence supporting climatological inferences, including the finding that global warming is occurring and its primary causes are anthropogenic. (shrink)

Lloyd (2009) contends that climate models are confirmed by various instances of fit between their output and observational data. The present paper argues that what these instances of fit might confirm are not climate models themselves, but rather hypotheses about the adequacy of climate models for particular purposes. This required shift in thinking—from confirming climate models to confirming their adequacy-for-purpose—may sound trivial, but it is shown to complicate the evaluation of climate models considerably, both in principle and in practice.

No scientific conclusion follows automatically from a statistically non-significant result, yet people routinely use non-significant results to guide conclusions about the status of theories (or the effectiveness of practices). To know whether a non-significant result counts against a theory, or if it just indicates data insensitivity, researchers must use one of: power, intervals (such as confidence or credibility intervals), or else an indicator of the relative evidence for one theory over another, such as a Bayes factor. I argue Bayes factors (...) allow theory to be linked to data in a way that overcomes the weaknesses of the other approaches. Specifically, Bayes factors use the data themselves to determine their sensitivity in distinguishing theories (unlike power), and they make use of those aspects of a theory’s predictions that are often easiest to specify (unlike power and intervals, which require specifying the minimal interesting value in order to address theory). Bayes factors provide a coherent approach to determining whether non-significant results support a null hypothesis over a theory, or whether the data are just insensitive. They allow accepting and rejecting the null hypothesis to be put on an equal footing. Concrete examples are provided to indicate the range of application of a simple online Bayes calculator, which reveal both the strengths and weaknesses of Bayes factors. (shrink)

I argue that scientific realism, insofar as it is only committed to those scientific posits of which we have causal knowledge, is immune to Kyle Stanford’s argument from unconceived alternatives. This causal strategy is shown not to repeat the shortcomings of previous realist responses to Stanford’s argument. Furthermore, I show that the notion of causal knowledge underlying it can be made sufficiently precise by means of conceptual tools recently introduced into the debate on scientific realism. Finally, I apply this strategy (...) to the case of Jean Perrin’s experimental work on the atomic hypothesis, disputing Stanford’s claim that the problem of unconceived alternatives invalidates a realist interpretation of this historical episode. 1 Stanford’s Argument from Unconceived Alternatives2 Previous Attempts to Undermine the Problem of Unconceived Alternatives2.1 The plausibility of unconceived alternatives2.2 The distinctness of unconceived alternatives2.3 The induction from past to present3 Causal Knowledge as a Criterion for the Realist3.1 How Chakravartty’s proposal differs from earlier causal strategies3.2 Causal realism and the detection/auxiliary distinction4 Causal Realism, Unconceived Alternatives, and the Atomic Hypothesis4.1 Perrin and the philosophers: some initial observations4.2 Roush and Stanford on Perrin4.3 From Brownian motion to the reality of atoms4.4 What we know about atoms5 Conclusion. (shrink)

In the last three decades several cosmological principles and styles of reasoning termed 'anthropic' have been introduced into physics research and popular accounts of the universe and human beings' place in it. I discuss the circumstances of 'fine tuning' that have motivated this development, and what is common among the principles. I examine the two primary principles, and find a sharp difference between these 'Weak' and 'Strong' varieties: contrary to the view of the progenitors that all anthropic principles represent a (...) departure from Copernicanism in cosmology, the Weak Anthropic Principle is an instance of Copernicanism. It has close affinities with the step of Copernicus that Immanuel Kant took himself to be imitating in the 'critical' turn that gave rise to the Critique of Pure Reason. I conclude that the fact that a way of going about natural science mentions human beings is not sufficient reason to think that it is a subjective approach; in fact, it may need to mention human beings in order to be objective. (shrink)

Models carry the meaning of science. This puts a tremendous burden on the process of model selection. In general practice, models are selected on the basis of their relative goodness of fit to data penalized by model complexity. However, this may not be the most effective approach for selecting models to answer a specific scientific question because model fit is sensitive to all aspects of a model, not just those relevant to the question. Model Structural Adequacy analysis is proposed as (...) a means to select models based on their ability to answer specific scientific questions given the current understanding of the relevant aspects of the real world. (shrink)

A notion of experimental series is developed, in which experiments or experimental sets are connected through experimental suggestions arising from previous experimental outcomes. To that end, the justification of Howard Temin's DNA provirus hypothesis is examined. The hypothesis originated with evidence from two exploratory experimental sets on an oncogenic virus and was substantiated by including evidence from three additional experimental sets. Collectively these sets comprise an experimental series and the accumulative evidence from the series was adequate to justify the hypothesis (...) by persuading the virology community of its veracity. The notion of crucial experiment is also discussed in terms of experimental series. (shrink)

In this article, I argue that arguments from the history of science against scientific realism, like the arguments advanced by P. Kyle Stanford and Peter Vickers, are fallacious. The so-called Old Induction, like Vickers's, and New Induction, like Stanford's, are both guilty of confirmation bias—specifically, of cherry-picking evidence that allegedly challenges scientific realism while ignoring evidence to the contrary. I also show that the historical episodes that Stanford adduces in support of his New Induction are indeterminate between a pessimistic and (...) an optimistic interpretation. For these reasons, these arguments are fallacious, and thus do not pose a serious challenge to scientific realism. (shrink)

When scientists seek further confirmation of their results, they often attempt to duplicate the results using diverse means. To the extent that they are successful in doing so, their results are said to be robust. This paper investigates the logic of such "robustness analysis" [RA]. The most important and challenging question an account of RA can answer is what sense of evidential diversity is involved in RAs. I argue that prevailing formal explications of such diversity are unsatisfactory. I propose a (...) unified, explanatory account of diversity in RAs. The resulting account is, I argue, truer to actual cases of RA in science; moreover, this account affords us a helpful, new foothold on the logic undergirding RAs. (shrink)