Kuhn maintains that what marks the transition to a science is the ability to carry out ‘normal’ science—a practice he characterizes as abandoning the kind of testing that Popper lauds as the hallmark of science. Examining Kuhn's own contrast with Popper, I propose to recast Kuhnian normal science. Thus recast, it is seen to consist of severe and reliable tests of low-level experimental hypotheses (normal tests) and is, indeed, the place to look to demarcate science. While thereby vindicating Kuhn on (...) demarcation, my recasting of normal science is seen to tell against Kuhn's view of revolutionary science. (shrink)

According to Fisher, a hypothesis specifying a density function for X is falsified (at the level of significance ) if the realization of X is in the size- region of lowest densities. However, non-linear transformations of X can map low-density into high-density regions. Apparently, then, falsifications can always be turned into corroborations (and vice versa) by looking at suitable transformations of X (Neyman's Paradox). The present paper shows that, contrary to the view taken in the literature, this provides no argument (...) against a theory of statistical falsification. (shrink)

Philosophical discussions of biological classification have failed to recognise the central role of homology in the classification of biological parts and processes. One reason for this is a misunderstanding of the relationship between judgments of homology and the core explanatory theories of biology. The textbook characterisation of homology as identity by descent is commonly regarded as a definition. I suggest instead that it is one of several attempts to explain the phenomena of homology. Twenty years ago the ‘new experimentalist’ movement (...) in philosophy of science drew attention to the fact that many experimental phenomena have a ‘life of their own’: the conviction that they are real is not dependent on the theories used to characterise and explain them. I suggest that something similar can be true of descriptive phenomena, and that many homologies are phenomena of this kind. As a result the descriptive biology of form and function has a life of its own—a degree of epistemological independence from the theories that explain form and function. I also suggest that the two major ‘homology concepts’ in contemporary biology, usually seen as two competing definitions, are in reality complementary elements of the biological explanation of homology. (shrink)

: Bayesians and error statisticians have relied heavily upon examples from physics in developing their accounts of scientific inference. The present essay demonstrates it is possible to analyze H.B.D. Kettlewell's classic study of natural selection from Deborah Mayo's error statistical point of view (Mayo 1996). A comparison with a previous analysis of this episode from a Bayesian perspective (Rudge 1998) reveals that the error statistical account makes better sense of investigations such as Kettlewell's because it clarifies how core elements in (...) the design of experiments are used to minimize erroneous inferences rather than dwelling on whether the strategies used are reasonable. (shrink)

: Errors in science range along a spectrum from those relatively local to the phenomenon (usually easily remedied in the laboratory) to those more conceptually derived (involving theory or cultural factors, sometimes quite long-term). One may classify error types broadly as material, observational, conceptual or discoursive. This framework bridges philosophical and sociological perspectives, offering a basis for interfield discourse. A repertoire of error types also supports error analytics, a program for deepening reliability through strategies for regulating and probing error.

Accuracy-based arguments for conditionalization and probabilism appear to have a significant advantage over their Dutch Book rivals. They rely only on the plausible epistemic norm that one should try to decrease the inaccuracy of one’s beliefs. Furthermore, conditionalization and probabilism apparently follow from a wide range of measures of inaccuracy. However, we argue that there is an under-appreciated diachronic constraint on measures of inaccuracy which limits the measures from which one can prove conditionalization, and none of the remaining measures allow (...) one to prove probabilism. That is, among the measures in the literature, there are some from which one can prove conditionalization, others from which one can prove probabilism, but none from which one can prove both. Hence at present, the accuracy-based approach cannot underwrite both conditionalization and probabilism. (shrink)

The article analyses in detail the Meselson–Stahl experiment, identifying two novel difficulties for the crucial experiment account, namely, the fragility of the experimental results and the fact that the hypotheses under scrutiny were not mutually exclusive. The crucial experiment account is rejected in favour of an experimental-mechanistic account of the historical significance of the experiment, emphasizing that the experiment generated data about the biochemistry of DNA replication that is independent of the testing of the semi-conservative, conservative, and dispersive hypotheses. _1_ (...) Introduction _2_ The Meselson–Stahl Experiment _3_ Some Difficulties for the Crucial Experiment Account _3.1_ Additional experiments were required _3.2_ Simplicity considerations are unconvincing _3.3_ The fragility of the experimental results _3.4_ The problematic interpretation of falsifyng results _3.5_ Not all possible hypotheses considered or tested _3.6_ The tested hypotheses were not mutually exclusive _4_ The Historical and Scientific Significance of the Meselson–Stahl Experiment _4.1_ The challenge for the crucial experiment account _4.2_ A mechanistic perspective on the experiment _4.3_ The experimental design and its independence from theoretical speculations _4.4_ The advantages of a ‘bottom-up’ mechanistic account _5_ Conclusion. (shrink)

Neuroimaging technology is the most widely used tool to study human cognition. While originally a promising tool for mapping the content of cognitive theories onto the structures of the brain, recently developed tools for the analysis, handling and sharing of data have changed the theoretical landscape of cognitive neuroscience. Even with these advancements philosophical analyses of evidence in neuroimaging remain skeptical of the promise of neuroimaging technology. These views often treat the analysis techniques used to make sense of data produced (...) in a neuroimaging experiment as one, attributing the inferential limitations of analysis pipelines to the technology as a whole. Situated against the neuroscientists own critical assessment of their methods and the limitations of those methods, this skepticism appears based on a misunderstanding of the role data analysis techniques play in neuroimaging research. My project picks up here, examining how data analysis techniques, such as pattern classification analysis, are used to assess the evidential value of neuroimaging data. The project takes the form of three papers. In the first I identify the use of multiple data analysis techniques as an important aspect of the data interpretation process that is overlooked by critics. In the second I develop an account of inferences in neuroimaging research that is sensitive to this use of data analysis techniques, arguing that interpreting neuroimaging data is a process of isolating and explaining a variety of data patterns. In the third I argue that the development and uptake of new techniques for analyzing data must be accompanied by changes in research practices and standards of evidence if they are to promote knowledge generation. My approach to this work is both traditionally philosophical, insofar as it involves reading and analyzing the work of philosophers and neuroscientists, and embedded insofar as most of the research was conducted while engaged in attending lab meetings and participating in the work of those scientists whose work is the object of my research. (shrink)

The underdetermination thesis poses a threat to rational choice of scientific theories. We discuss two arguments for the thesis. One draws its strength from deductivism together with the existence thesis, and the other is defended on the basis of the failure of a reliable inductive method. We adopt a partially subjective/objective pragmatic Bayesian epistemology of science framework, and reject both arguments for the thesis. Thus, in science we are able to reinstate rational choice called into question by the underdetermination thesis.

This article presents a reconstruction of the so-called classical, formal or Mendelian genetics, which is intended to be more complete and adequate than existing reconstructions. This reconstruction has been carried out with the instruments, duly modified and extended with respect to the case under consideration, of the structuralist conception of theories. The so-called Mendel’s Laws, as well as linkage genetics and gene mapping are formulated in a precise manner while the global structure of genetics is represented as a theory-net. These (...) results are of methodological, philosophical and didactical relevance. (shrink)

When do data provide good evidence for a hypothesis, evidence that warrants an inference to the hypothesis? Standard answers either reject the legitimacy of induction or else allow warranted inference from data to hypothesis when there are suitable relationships between and among the data and hypotheses. The severity account rejects all of these, maintaining instead that the good evidence relation concerns not only relations between data and hypotheses but also the methods for obtaining the data and the sensitivity of these (...) methods to detecting falsehood. So, for example, the severity account allows two rival hypotheses to fit the data equally well, even to the point of having the same prior and posterior probabilities relative to those data, while the data nonetheless favour one hypothesis over the other by virtue of those data providing a severe test of one hypothesis and not the other. The contributions to Error and Inference variously trace the genesis of the severity account from statistics-oriented sciences, elaborate upon the account’s details, apply the account to various philosophical issues, and offer challenges to the account’s adequacy and replies to major criticisms. The editors have developed the severity account in detail elsewhere, and this anthology is an effort …. (shrink)

Some accounts of evidence regard it as an objective relationship holding between data and hypotheses, perhaps mediated by a testing procedure. Mayo’s error-statistical theory of evidence is an example of such an approach. Such a view leaves open the question of when an epistemic agent is justified in drawing an inference from such data to a hypothesis. Using Mayo’s account as an illustration, I propose a framework for addressing the justification question via a relativized notion, which I designate security , (...) meant to conceptualize practices aimed at the justification of inferences from evidence. I then show how the notion of security can be put to use by showing how two quite different theoretical approaches to model criticism in statistics can both be viewed as strategies for securing claims about statistical evidence. (shrink)

A toast is due to one who slays Misguided followers of Bayes, And in their heart strikes fear and terror With probabilities of error! (E.L. Lehmann).

: This paper is concerned with the claim that epistemic terms and categories are historical entities. The starting point is the observation that recent attempts at historical studies of epistemic terms fail to bridge the gap between history and philosophy proper. I examine whether, and how, it is possible to forge a closer link between historical and philosophical aspects of conceptual analysis. The paper explores possible links by analyzing aspects of the concept of error. A "pragmatic" and a "mentalist" notion (...) of error are identified in current philosophical studies of error: according to the latter, errors can be ascribed only to mental operations, according to the former, errors can also be ascribed to things and processes. The paper then draws on historical accounts of optical instruments to highlight certain presuppositions and implications of these two uses of the term. Contextual features and trans-contextual structures of the notion of error are distinguished. In conclusion, I argue that an intimate link between history and philosophy of science can be forged by an analysis ofthe development of conceptual arrangements which allows for trans- contextual structural aspects while drawing attention to the contextual epistemological and scientific conditions of their re-arrangement. (shrink)

The epistemology of studies addressing questions about historical and prehistorical phenomena is a subject of increasing discussion among philosophers of science. A related field of inquiry that has yet to be connected to this topic is the epistemology of climate science. Branching these areas of research, I show how variety-of-evidence reasoning accounts for scientific inferences about the past by detailing a case study in paleoclimate reconstruction. This analysis aims to clarify the logic of historical inquiry in general and, by focusing (...) on a case study about climate change, it offers an epistemic account of a particular discipline that is of environmental and social importance. (shrink)

The potential for financial conflicts of interest (COIs) to damage the credibility of scientific research has become a significant social concern, especially in the wake of high-profile incidents involving the pharmaceutical, tobacco, fossil-fuel, and chemical industries. Scientists and policy makers have debated whether the presence of financial COIs should count as a reason for treating research with suspicion or whether research should instead be evaluated solely based on its scientific quality. This paper examines a recent proposal to develop criteria for (...) evaluating the credibility of research without considering its source of funding. It concludes that proposals of this sort are likely to be either ineffective or impractical in many cases. Nevertheless, this does not imply that all research funded by those with an interest in the outcome must be placed under a cloud of suspicion; there are conditions under which research is at much more serious risk of being corrupted than in other cases, and attention to these conditions can guide productive responses to financial COIs. (shrink)

According to the demand of the Hypothetico-Deductive (H-D) method, a theory is confirmed when the prediction-observation (p-o) gap is small and disconfirmed when the gap is large. A major goal of this paper is to introduce a research domain for which this demand does not hold. In contrast to the H-D method's demand, this research, called the Catch model for reconstructing a face previously seen from memory, requires an increase, within limits, in the p-o gap. The Catch model research substantiates (...) theoretically and empirically a new proposed method that I call the "Deductive-Reconstruction" (D-R) method. This method provides essential conditions whose fulfillment guarantees successful reconstruction of past events (a face previously seen) from memory. It is argued that the D-R method fits the area of research of reconstructing past events from memory better than the H-D method. Application of the H-D method to the Catch model's research domain leads to an internal contradiction and failure to reconstruct past events (a face previously seen) from memory. Finally, the nature of the D-R method along with the Catch model is discussed from three points of view: confirmation, explanation, and generality. (shrink)

The orthodox view in statistics has it that frequentism and Bayesianism are diametrically opposed—two totally incompatible takes on the problem of statistical inference. This paper argues to the contrary that the two approaches are complementary and need to mesh if probabilistic reasoning is to be carried out correctly.

I consider the error-statistical account as both a theory of evidence and as a theory of inference. I seek to show how inferences regarding the truth of hypotheses can be upheld by avoiding a certain kind of alternative hypothesis problem. In addition to the testing of assumptions behind the experimental model, I discuss the role of judgments of implausibility. A benefit of my analysis is that it reveals a continuity in the application of error-statistical assessment to low-level empirical hypotheses and (...) highly general theoretical principles. This last point is illustrated with a brief sketch of the issues involved in the parametric framework analysis of tests of physical theories such as General Relativity and of fundamental physical principles such as the Einstein Equivalence Principle. (shrink)

: Peter Galison has recently claimed that twentieth-century microphysics has been pursued by two distinct experimental traditions--the image tradition and the logic tradition--that have only recently merged into a hybrid tradition. According to Galison, the two traditions employ fundamentally different forms of experimental argument, with the logic tradition using statistical arguments, while the image tradition strives for non-statistical demonstrations based on compelling ("golden") single events. I show that discoveries in both traditions have employed the same statistical form of argument, even (...) when basing discovery claims on single, golden events. Where Galison sees an epistemic divide between two communities that can only be bridged by a creole- or pidgin-like "interlanguage," there is in fact a shared commitment to a statistical form of experimental argument. (shrink)

As machine learning has gradually entered into ever more sectors of public and private life, there has been a growing demand for algorithmic explainability. How can we make the predictions of complex statistical models more intelligible to end users? A subdiscipline of computer science known as interpretable machine learning (IML) has emerged to address this urgent question. Numerous influential methods have been proposed, from local linear approximations to rule lists and counterfactuals. In this article, I highlight three conceptual challenges that (...) are largely overlooked by authors in this area. I argue that the vast majority of IML algorithms are plagued by (1) ambiguity with respect to their true target; (2) a disregard for error rates and severe testing; and (3) an emphasis on product over process. Each point is developed at length, drawing on relevant debates in epistemology and philosophy of science. Examples and counterexamples from IML are considered, demonstrating how failure to acknowledge these problems can result in counterintuitive and potentially misleading explanations. Without greater care for the conceptual foundations of IML, future work in this area is doomed to repeat the same mistakes. (shrink)

: Evidence claims depend on fallible assumptions. This paper discusses inferential robustness as a strategy for justifying evidence claims in spite of this fallibility. I argue that robustness can be understood as a means of establishing the partial security of evidence claims. An evidence claim is secure relative to an epistemic situation if it remains true in all scenarios that are epistemically possible relative to that epistemic situation.

Introduces a series of articles which deals with the relationship between history of science and philosophy of science.; Introduces a series of articles which deals with the relationship between history of science and philosophy of science.

Despite its potential implications for the objectivity of scientific knowledge, the claim that “scientific instruments are perspectival” has received little critical attention. I show that this claim is best understood as highlighting the dependence of instruments on different perspectives. When closely analyzed, instead of constituting a novel epistemic challenge, this dependence can be exploited to mount novel strategies for resolving two old epistemic problems: conceptual relativism and theory-ladeness. The novel content of this article consists in articulating and developing these strategies (...) by introducing two fine-grained notions of perspectives as the key units of analysis: “broad perspectives” and “narrow perspectives.”. (shrink)

Making sense of why something succeeded or failed is central to scientific practice: it provides an interpretation of what happened, i.e. an hypothesized explanation for the results, that informs scientists’ deliberations over their next steps. In philosophy, the realism debate has dominated the project of making sense of scientists’ success and failure claims, restricting its focus to whether truth or reliability best explain science’s most secure successes. Our aim, in contrast, will be to expand and advance the practice-oriented project sketched (...) by Arthur Fine in his work on the Natural Ontological Attitude. An important obstacle to articulating a positive program, we suggest, has been overlooking how scientists adopt standardized rules and procedures in order to define and operationalize meanings for success and failure relative to their situated goals. To help fill this gap, we introduce two new ideas, design specifications and track records, and show how they advance our ability to make sense of scientific modeling practices while maintaining a deflationary stance toward the realism debate. (shrink)

Laboratory experimentation was once considered impossible or irrelevant in economics. Recently, however, economic science has gone through a real ‘laboratory revolution’, and experimental economics is now a most lively subfield of the discipline. The methodological advantages and disadvantages of controlled experimentation constitute the main subject of this thesis. After a survey of the literature on experiments in philosophy and economics, the problem of testing normative theories of rationality is tackled. This philosophical issue was at the centre of a famous controversy (...) in decision theory, during which a methodology of normative falsification was first articulated and used to assess experimental results. In the third chapter, the methodological advantages of controlled experimentation are illustrated and discussed with examples taken from the experiments on the so-called ‘preference reversal’ phenomenon. Laboratory testing allows to establish with a high degree of certainty that certain phenomena lie behind the experimental data, by means of independent testing, elimination of alternative hypotheses, and the use of different instruments of observation. The fourth chapter is devoted to a conceptual analysis of the problem of ‘parallelism’. This is the problem of inferring from the occurrence of a phenomenon in the laboratory, to its instantiation also in non-laboratory environments. Experimental economists have discussed parallelism at length, and their views are presented and criticised. Eventually, it is argued that parallelism is a factual matter and as such can only be established on empirical grounds. The fifth chapter provides an example of how one can argue for parallelism, focusing on the case of experimentation on the ‘winner’s curse’ phenomenon. The role of experiments as ‘mediators’ between theoretical models and their target domain of application is illustrated, and the structure of parallelism arguments analysed in detail. Finally, in the last chapter, economic experiments are compared to simulations, in order to highlight their specific characteristics. (shrink)

The enduring replication crisis in many scientific disciplines casts doubt on the ability of science to estimate effect sizes accurately, and in a wider sense, to self-correct its findings and to produce reliable knowledge. We investigate the merits of a particular countermeasure—replacing null hypothesis significance testing with Bayesian inference—in the context of the meta-analytic aggregation of effect sizes. In particular, we elaborate on the advantages of this Bayesian reform proposal under conditions of publication bias and other methodological imperfections that are (...) typical of experimental research in the behavioral sciences. Moving to Bayesian statistics would not solve the replication crisis single-handedly. However, the move would eliminate important sources of effect size overestimation for the conditions we study. (shrink)

According to the hierarchy of models (HoM) account of scientific experimentation developed by Patrick Suppes and elaborated by Deborah Mayo, theoretical considerations about the phenomena of interest are involved in an experiment through theoretical models that in turn relate to experimental data through data models, via the linkage of experimental models. In this paper, I dispute the HoM account in the context of present-day high-energy physics (HEP) experiments. I argue that even though the HoM account aims to characterize experimentation as (...) a model-based activity, it does not involve a modeling concept for the process of data acquisition, and it thus fails to provide a model-based characterization of the theory-experiment relationship underlying this process. In order to characterize the foregoing relationship, I propose the concept of a model of data acquisition and illustrate it in the case of the ATLAS experiment at CERN’s Large Hadron Collider, where the Higgs boson was discovered in 2012. I show that the process of data acquisition in the ATLAS experiment is performed according to a model of data acquisition that specifies and organizes the experimental procedures necessary to select the data according to a predetermined set of selection criteria. I also point out that this data acquisition model is theory-laden, in the sense that the underlying data selection criteria are determined by considering the testable predictions of the theoretical models that the ATLAS experiment is aimed to test. I take this sense of theory-ladenness to indicate that the relationship between the procedures of the ATLAS experiment and the theoretical models of the phenomena of interest is first established, prior to the formation of data models, through the data acquisition model of the experiment, thus not requiring the intermediary of other types of models as suggested by the HoM account. I therefore conclude that in the context of present-day HEP experiments, the HoM account does not consistently extend to the process of data acquisition so as to include models of data acquisition. (shrink)

In this paper we consider the problem of how to measure the strength of statistical evidence from the perspective of evidence amalgamation operations. We begin with a fundamental measurement amalgamation principle : for any measurement, the inputs and outputs of an amalgamation procedure must be on the same scale, and this scale must have a meaningful interpretation vis a vis the object of measurement. Using the p value as a candidate evidence measure, we examine various commonly used approaches to amalgamation (...) of evidence across similar studies, including standard forms of meta-analysis. We show that none of these methods satisfies MAP. Thus an underlying measurement problem remains. We argue that a successful approach to evidence amalgamation necessitates a solution to the problem of evidence measurement, and we suggest some lines of reasoning that might guide further work towards this end. (shrink)

The likelihood principle (LP) is a core issue in disagreements between Bayesian and frequentist statistical theories. Yet statements of the LP are often ambiguous, while arguments for why a Bayesian must accept it rely upon unexamined implicit premises. I distinguish two propositions associated with the LP, which I label LP1 and LP2. I maintain that there is a compelling Bayesian argument for LP1, based upon strict conditionalization, standard Bayesian decision theory, and a proposition I call the practical relevance principle. In (...) contrast, I argue that there is no similarly compelling argument for or against LP2. I suggest that these conclusions lead to a restrictedly pluralistic view of Bayesian confirmation measures. (shrink)

Two approaches to evidential reasoning compete in the biomedical and social sciences: the experimental and the pragmatist. Whereas experimentalism has received considerable philosophical analysis and support since the times of Bacon and Mill, pragmatism about evidence has been neither articulated nor defended. The overall aim is to fill this gap and develop a theory that articulates the latter. The main ideas of the theory will be illustrated and supported by a case study on the smoking/lung cancer controversy in the 1950s.

In empirical modeling, an important desiderata for deeming theoretical entities and processes as real is that they can be reproducible in a statistical sense. Current day crises regarding replicability in science intertwines with the question of how statistical methods link data to statistical and substantive theories and models. Different answers to this question have important methodological consequences for inference, which are intertwined with a contrast between the ontological commitments of the two types of models. The key to untangling them is (...) the realization that behind every substantive model there is a statistical model that pertains exclusively to the probabilistic assumptions imposed on the data. It is not that the methodology determines whether to be a realist about entities and processes in a substantive field. It is rather that the substantive and statistical models refer to different entities and processes, and therefore call for different criteria of adequacy. (shrink)

There is a debate in Bayesian confirmation theory between subjective and non-subjective accounts of evidence. Colin Howson has provided a counterexample to our non-subjective account of evidence: the counterexample refers to a case in which there is strong evidence for a hypothesis, but the hypothesis is highly implausible. In this article, we contend that, by supposing that strong evidence for a hypothesis makes the hypothesis more believable, Howson conflates the distinction between confirmation and evidence. We demonstrate that Howson’s counterexample fails (...) for a different pair of hypotheses. (shrink)

Between the fourth and the recent fifth IPCC report, science as well as policy making have made great advances in dealing with uncertainties in global climate models. However, the uncertainties public decision making has to deal with go well beyond what is currently addressed by policy makers and climatologists alike. It is shown in this paper that within an anthropocentric framework, a whole hierarchy of models from various scientific disciplines is needed for political decisions as regards climate change. Via what (...) is sometimes referred to as ‘uncertainty cascade’ in the technical literature, the uncertainties of various models accumulate in the input to political decision making. This paper aims to chart the uncertainties in the multi-disciplinary enterprise of current climate modeling in broad strokes. It is shown that the uncertainty cascade makes it impossible to quantify uncertainties in the form of probability estimates. Moreover the paper highlights how global climate models fail to provide probability estimates. A better treatment of the uncertainties of climate predictions on the political level would require an overhaul of the current IPCC practice that separates the various scientific fields in various working groups. (shrink)

The remarkable transition from helpless infant to sophisticatedfive-year-old has long captured the attention of scholars interested inthe discovery of knowledge. To explain these achievements, developmentalpsychologists often compare children's discovery procedures to those ofprofessional scientists. For the child to be qualified as a ``littlescientist'', however, intellectual development must be shown to derivefrom rational hypothesis selection in the face of evidence. In thepresent paper we focus on one dimension of rational theory-choice,namely, the relation between hypothesis confirmation and evidencediversity. Psychological research suggests cultural (...) variability inappreciating evidence diversity and lack of such appreciation by youngchildren. Before reaching conclusions about the ``little scientist''thesis, however, it is essential to normatively analyze the diversityissue. We undertake such an analysis within a Bayesianperspective. (shrink)

Disputes between advocates of Bayesians and more orthodox approaches to statistical inference presuppose that Bayesians must regard must regard stopping rules, which play an important role in orthodox statistical methods, as evidentially irrelevant.In this essay, I show that this is not the case and that the stopping rule is evidentially relevant given some Bayesian confirmation measures that have been seriously proposed. However, I show that accepting a confirmation measure of this sort comes at the cost of rejecting two useful ancillaryBayesian (...) principles. (shrink)

Error statistics is an important methodological view in philosophy of statistics and philosophy of science that can be applied to scientific experiments such as clinical trials. In this paper, I raise two potential issues for ES when it comes to guiding, and explaining early stopping of randomized controlled trials : ES provides limited guidance in cases of early unfavorable trends due to the possibility of trend reversal; ES is silent on how to prospectively control error rates in experiments requiring multiple (...) interim analyses. The method of conditional power, together with a rationing principle for RCTs, can assist ES in addressing such issues. (shrink)

Clinical trials play a prominent role today in medicine, but are not without controversy. These issues start from the day physicians begin their specialization process in medical school and continues onto their day-to-day practice as attendings with referral patterns and resulting financial incentives. This combined with the lack of training in basic issues of epistemology and statistics, allows poor interpretations of clinical trials to reign free. A proposal to integrate the notion of severity to help remedy these issues are made (...) by ensuring that studies are tested “As Severe As Reasonably Possible” will put P-values, multiplicity adjustments, and model checking in their rightful place. In light of this, multiple clinical trials are examined with an in-depth analysis of erroneous statistical inferences taken from phase III randomized trials, non-inferiority, early phase, as well as observational studies. Severe testing in the setting of medicine will help with alleviate some of the issues with the current misinterpretation of clinical studies. (shrink)

I contrast two modes of error-elimination relevant to evaluating evidence in accounts that emphasize frequentist reliability. The contrast corresponds to that between the use of of a reliable inference procedure and the critical scrutiny of a procedure with regard to its reliability, in light of what is and is not known about the setting in which the procedure is used. I propose a notion of security as a category of evidential assessment for the latter. In statistical settings, robustness theory and (...) misspecification testing exemplify two distinct strategies for securing statistical inferences. (shrink)

The purpose of this paper is to show how the degree of experimental validity of scientific procedures is crucially involved in determining two typical pragmatic modes in science, namely, the preservation of useful procedures and the disposal of useless ideas. The term 'pragmatic' will here be used following Schurz's characterisation of being internally pragmatic, as referring to that which proves useful for scientific or epistemic goals. The first part of the paper consists in a characterisation of the notion of experimental (...) validity. The second part is focused on several historical examples illustrating how the above pragmatic modes relate to the question of experimental validity. The Michelson-Morley experiment is presented as a case of a highly valid and useful experiment preserved through the development of different theories (like, on the one hand, the ether theory, upheld by Fitzgerald and Lorentz, and, on the other hand, Einstein's special theory of relativity). The concept of caloric will be discussed as an example of an idea that was discarded once it became useless, after heat was understood as a form of energy within the new frame provided by the kinetic theory of heat towards the middle of the 19th century. (shrink)

In this paper, I show how one might resist two influential arguments for the Likelihood Principle by appealing to the ontological significance of creative intentions. The first argument for the Likelihood Principle that I consider is the argument from intentions. After clarifying the argument, I show how the key premiss in the argument may be resisted by maintaining that creative intentions sometimes independently matter to what experiments exist. The second argument that I consider is Gandenberger’s :475–503, 2015) rehabilitation of Birnbaum’s (...) :269–306, 1962) proof of the Likelihood Principle from the more intuitively obvious principles of conditionality and sufficiency. As with the argument from intentions, I show how Gandenberger’s argument for his Experimental Conditionality Principle may be resisted by maintaining that creative intentions sometimes independently matter to what experiments exist. (shrink)