An important question facing contemporary philosophy of science is whether the natural sciences in terms of their historical records exhibit distinguishing developmental patterns or structures. At least two philosophical stances are possible in answering this question. The first pertains to the plurality of the individual sciences. From this stance, the various sciences are analyzed individually and compared with one another in order to derive potential commonalities, if any, among them. The second stance involves a general philosophy of science in which (...) a thorough theory of the natural sciences is developed. The latter stance strives to account for more than possible commonalities among the sciences but also to provide a broad-spectrum philosophical framework to account for, or to explicate, the nature of science itself and its progress. In this paper, the second stance is taken in which an evolutionary philosophy of science is proposed. To that end, Thomas Kuhn’s evolutionary philosophy of science is initially discussed and critiqued. An evolutionary philosophy of science is then proposed based on a revision of Kuhn’s evolutionary philosophy of science in terms of George Gaylord Simpson’s various tempos and modes for biological evolution. Next, two historical case studies from the biological sciences are reconstructed to illustrate the robustness of the proposed evolutionary philosophy of science for explicating the progress of the natural sciences. A concluding section discusses the proposed evolutionary philosophy of science with respect to providing a broad-spectrum framework or general philosophy of science for understanding the nature and progress of the natural sciences. (shrink)

Jun Otsuka’s excellent book, Thinking about Statistics - the Philosophical Foundations (Otsuka 2023) is mostly organized around the idea that different statistical approaches can be illuminated by linking them to different ideas in general epistemology. Otsuka connects Bayesianism to internalism and foundationalism, frequentism to reliabilism, and the Akaike Information Criterion in model selection theory to instrumentalism. This useful mapping doesn’t cover all the interesting ideas he presents. His discussions of causal inference and machine learning are philosophically insightful, as is his (...) idea that statisticians embrace an assumption that is similar to Hume’s Principle of the Uniformity of Nature. I discuss these topics in what follows, sometimes disagreeing with details while at other times adding ideas that complement those presented in the book. (shrink)

Although theoretical results for several algorithms in many application domains were presented during the last decades, not all algorithms can be analyzed fully theoretically. Experimentation is necessary. The analysis of algorithms should follow the same principles and standards of other empirical sciences. This article focuses on stochastic search algorithms, such as evolutionary algorithms or particle swarm optimization. Stochastic search algorithms tackle hard real-world optimization problems, e.g., problems from chemical engineering, airfoil optimization, or bioinformatics, where classical methods from mathematical optimization fail. (...) Nowadays statistical tools that are able to cope with problems like small sample sizes, non-normal distributions, noisy results, etc. are developed for the analysis of algorithms. Although there are adequate tools to discuss the statistical significance of experimental data, statistical significance is not scientifically meaningful per se. It is necessary to bridge the gap between the statistical significance of an experimental result and its scientific meaning. We will propose some ideas on how to accomplish this task based on Mayo's learning model. (shrink)

I develop the idea of what I call an interpretive praxis as a generalized procedure for analyzing how experimenters can formulate observable predictions, discern real effects from experimental artifacts, and compare predictions with data. An interpretive praxis requires theories – theories not only about instruments and the interpretation of phenomena, but also theories that connect the use of instruments and interpretation of phenomena to high‐level theory. I will call all such theories that enable experimentation to work intermediate theories. I offer (...) an account of theory‐networks that embrace these intermediate theories and explain their functions. (shrink)

Psychological research has shown that cognitive illusions, of which visual illusions are just a special case, are systematic and pervasive, raising epistemological questions about how error in all forms of research can be identified and eliminated. The quantitative sciences make use of statistical techniques for this purpose, but it is not clear what the qualitative equivalent is, particularly in view of widespread scepticism about validity and objectivity. I argue that, in the light of cognitive psychology, the ‘error question’ cannot be (...) dismissed as a positivist obsession, and that the concepts of truth and objectivity are unavoidable. However, they constitute only a ‘minimal realism’, which does not necessarily bring a commitment to ‘absolute’ truth, certainty, correspondence, causation, reductionism, or universal laws in its wake. The assumption that it does reflects a misreading of positivism and, ironically, precipitates a ‘crisis of legitimation and representation’, as described by constructivist authors. (shrink)

A notion of experimental series is developed, in which experiments or experimental sets are connected through experimental suggestions arising from previous experimental outcomes. To that end, the justification of Howard Temin's DNA provirus hypothesis is examined. The hypothesis originated with evidence from two exploratory experimental sets on an oncogenic virus and was substantiated by including evidence from three additional experimental sets. Collectively these sets comprise an experimental series and the accumulative evidence from the series was adequate to justify the hypothesis (...) by persuading the virology community of its veracity. The notion of crucial experiment is also discussed in terms of experimental series. (shrink)

These preprints were automatically compiled into a PDF from the collection of papers deposited in PhilSci-Archive in conjunction with the PSA 2018.

A main message from the causal modelling literature in the last several decades is that under some plausible assumptions, there can be statistically consistent procedures for inferring (features of) the causal structure of a set of random variables from observational data. But whether we can control the error probabilities with a finite sample size depends on the kind of consistency the procedures can achieve. It has been shown that in general, under the standard causal Markov and Faithfulness assumptions, the procedures (...) can only be pointwise but not uniformly consistent without substantial background knowledge. This implies the impossibility of choosing a finite sample size to control the worst case error probabilities. In this paper, I consider the simpler task of inferring causal directions when the skeleton of the causal structure is known, and establish a similarly negative result concerning the possibility of controlling error probabilities. Although the result is negative in form, it has an interesting positive implication for causal discovery methods. (shrink)

Much of the recent work on the epistemology of causation has centered on two assumptions, known as the Causal Markov Condition and the Causal Faithfulness Condition. Philosophical discussions of the latter condition have exhibited situations in which it is likely to fail. This paper studies the Causal Faithfulness Condition as a conjunction of weaker conditions. We show that some of the weaker conjuncts can be empirically tested, and hence do not have to be assumed a priori. Our results lead to (...) two methodologically significant observations: (1) some common types of counterexamples to the Faithfulness condition constitute objections only to the empirically testable part of the condition; and (2) some common defenses of the Faithfulness condition do not provide justification or evidence for the testable parts of the condition. It is thus worthwhile to study the possibility of reliable causal inference under weaker Faithfulness conditions. As it turns out, the modification needed to make standard procedures work under a weaker version of the Faithfulness condition also has the practical effect of making them more robust when the standard Faithfulness condition actually holds. This, we argue, is related to the possibility of controlling error probabilities with finite sample size (“uniform consistency”) in causal inference. (shrink)

Obviously medicine should be evidence-based. The issues lie in the details: what exactly counts as evidence? Do certain kinds of evidence carry more weight than others? (And if so why?) And how exactly should medicine be based on evidence? When it comes to these details, the evidence-based medicine (EBM) movement has got itself into a mess – or so it will be argued. In order to start to resolve this mess, we need to go 'back to basics'; and that means (...) turning to the philosophy of science. The theory of evidence, or rather the logic of the interrelations between theory and evidence, has always been central to the philosophy of science – sometimes under the alias of the 'theory of confirmation'. When taken together with a little philosophical commonsense, this logic can help us move towards a position on evidence in medicine that is more sophisticated and defensible than anything that EBM has been able so far to supply. (shrink)

There are a variety of topics in the philosophy of science that need to be rethought, in varying degrees, after one pays careful attention to the ways in which computer simulations are used in the sciences. There are a number of conceptual issues internal to the practice of computer simulation that can benefit from the attention of philosophers. This essay surveys some of the recent literature on simulation from the perspective of the philosophy of science and argues that philosophers have (...) a lot to learn by paying closer attention to the practice of simulation. (shrink)

The orthodox view in statistics has it that frequentism and Bayesianism are diametrically opposed—two totally incompatible takes on the problem of statistical inference. This paper argues to the contrary that the two approaches are complementary and need to mesh if probabilistic reasoning is to be carried out correctly.

Using empirical evidence to attack intuitions can be epistemically dangerous, because various of the complaints that one might raise against them (e.g., that they are fallible; that we possess no non-circular defense of their reliability) can be raised just as easily against perception itself. But the opponents of intuition wish to challenge intuitions without at the same time challenging the rest of our epistemic apparatus. How might this be done? Let us use the term “hopefulness” to refer to the extent (...) to which we possess a good capacity for the detection and correction of the errors of any fallible source of evidence. I argue that we should not trust putative sources of evidence that are substantially lacking in hopefulness (even if they are basically reliable), and that we are indeed already operating under such a norm in our ordinary and scientific practices. I argue further that the philosophical practice of the appeal to intuitions is, in these terms, badly hopeless... (shrink)

Incommensurability of scientific theories, as conceived by Thomas Kuhnand Paul Feyerabend, is thought to be a major or even insurmountable obstacletothe empirical comparison of these theories. I examine this problem in light ofaconcrete case from the history of experimental biology, namely the oxidativephosphorylation controversy in biochemistry (ca. 1961-1977). After a briefhistorical exposition, I show that the two main competing theories which werethe subject of the ox-phos controversy instantiate some of the characteristicfeatures of incommensurable theories, namely translation failure,non-corresponding predictions, and different (...) claims about what kinds ofentitiesexist in the world. By examining how the controversy was eventually resolved, Ithen show that at least this pair of incommensurable theories couldneverthelessbe empirically compared. (shrink)

Unsupervised learning algorithms are widely used for many important statistical tasks with numerous applications in science and industry. Yet despite their prevalence, they have attracted remarkably little philosophical scrutiny to date. This stands in stark contrast to supervised and reinforcement learning algorithms, which have been widely studied and critically evaluated, often with an emphasis on ethical concerns. In this article, I analyze three canonical unsupervised learning problems: clustering, abstraction, and generative modeling. I argue that these methods raise unique epistemological and (...) ontological questions, providing data-driven tools for discovering natural kinds and distinguishing essence from contingency. This analysis goes some way toward filling the lacuna in contemporary philosophical discourse on unsupervised learning, as well as bringing conceptual unity to a heterogeneous field more often described by what it isnot(i.e., supervised or reinforcement learning) than by what itis. I submit that unsupervised learning is not just a legitimate subject of philosophical inquiry but perhaps the most fundamental branch of all AI. However, an uncritical overreliance on unsupervised methods poses major epistemic and ethical risks. I conclude by advocating for a pragmatic, error-statistical approach that embraces the opportunities and mitigates the challenges posed by this powerful class of algorithms. (shrink)

As machine learning has gradually entered into ever more sectors of public and private life, there has been a growing demand for algorithmic explainability. How can we make the predictions of complex statistical models more intelligible to end users? A subdiscipline of computer science known as interpretable machine learning (IML) has emerged to address this urgent question. Numerous influential methods have been proposed, from local linear approximations to rule lists and counterfactuals. In this article, I highlight three conceptual challenges that (...) are largely overlooked by authors in this area. I argue that the vast majority of IML algorithms are plagued by (1) ambiguity with respect to their true target; (2) a disregard for error rates and severe testing; and (3) an emphasis on product over process. Each point is developed at length, drawing on relevant debates in epistemology and philosophy of science. Examples and counterexamples from IML are considered, demonstrating how failure to acknowledge these problems can result in counterintuitive and potentially misleading explanations. Without greater care for the conceptual foundations of IML, future work in this area is doomed to repeat the same mistakes. (shrink)

The aim of this paper is to put in place some cornerstones in the foundations for an objective theory of confirmation by considering lessons from the failures of predictivism. Discussion begins with a widely accepted challenge, to find out what is needed in addition to the right kind of inferential–semantical relations between hypothesis and evidence to have a complete account of confirmation, one that gives a definitive answer to the question whether hypotheses branded as “post hoc monsters” can be confirmed. (...) The predictivist view is then presented as a way to meet this challenge. Particular attention is paid to Worrall’s version of predictivism, as it appears to be the most sophisticated of the lot. It is argued that, despite its faults, his view turns our heads in the right direction by attempting to remove contingent considerations from confirmational matters. The demand to remove such considerations becomes the first of four cornerstones. Each cornerstone is put in place with the aim to steer clear of the sort of failures that plague various kinds of predictivism. In the process, it becomes obvious that the original challenge is wrongheaded and in need of revision. The paper ends with just such a revision. (shrink)

In this paper we consider the problem of how to measure the strength of statistical evidence from the perspective of evidence amalgamation operations. We begin with a fundamental measurement amalgamation principle : for any measurement, the inputs and outputs of an amalgamation procedure must be on the same scale, and this scale must have a meaningful interpretation vis a vis the object of measurement. Using the p value as a candidate evidence measure, we examine various commonly used approaches to amalgamation (...) of evidence across similar studies, including standard forms of meta-analysis. We show that none of these methods satisfies MAP. Thus an underlying measurement problem remains. We argue that a successful approach to evidence amalgamation necessitates a solution to the problem of evidence measurement, and we suggest some lines of reasoning that might guide further work towards this end. (shrink)

The remarkable transition from helpless infant to sophisticatedfive-year-old has long captured the attention of scholars interested inthe discovery of knowledge. To explain these achievements, developmentalpsychologists often compare children's discovery procedures to those ofprofessional scientists. For the child to be qualified as a ``littlescientist'', however, intellectual development must be shown to derivefrom rational hypothesis selection in the face of evidence. In thepresent paper we focus on one dimension of rational theory-choice,namely, the relation between hypothesis confirmation and evidencediversity. Psychological research suggests cultural (...) variability inappreciating evidence diversity and lack of such appreciation by youngchildren. Before reaching conclusions about the ``little scientist''thesis, however, it is essential to normatively analyze the diversityissue. We undertake such an analysis within a Bayesianperspective. (shrink)

The epistemology of studies addressing questions about historical and prehistorical phenomena is a subject of increasing discussion among philosophers of science. A related field of inquiry that has yet to be connected to this topic is the epistemology of climate science. Branching these areas of research, I show how variety-of-evidence reasoning accounts for scientific inferences about the past by detailing a case study in paleoclimate reconstruction. This analysis aims to clarify the logic of historical inquiry in general and, by focusing (...) on a case study about climate change, it offers an epistemic account of a particular discipline that is of environmental and social importance. (shrink)

Cultural phylogenetics has made remarkable progress by relying on methods originally developed in biology. But biological and cultural evolution do not always proceed according to the same principles. So what, if anything, could justify the use of phylogenetic methods to reconstruct the evolutionary history of culture? In this paper, we describe models used to assess the reliability of inference methods and show how these models play an underappreciated role in addressing that question. The notion of reliability is of course central (...) to these models. As we explain, a common way of understanding reliability is in terms of low error rates. A careful look at case studies in cultural phylogenetics suggests that reliability models partly corroborate this understanding of reliability but also raises points of tension. We conclude by hinting at a few ways forward. (shrink)

Likelihoodism is the view that the degree of evidential support should be analysed and measured in terms of likelihoods alone. The paper considers and responds to a popular criticism that a likelihoodist framework is too restrictive to guide belief. First, I show that the most detailed and rigorous version of this criticism, as put forward by Gandenberger (2016), is unsuccessful. Second, I provide a positive argument that a broadly likelihoodist framework can accommodate guidance for comparative belief, even when objectively well-grounded (...) prior probabilities are not available. As I show, the shift from non-relational to comparative probabilities opens up a new space for addressing the belief guidance problem for likelihoodism. (shrink)

The function and legitimacy of values in decision making is a critically important issue in the contemporary analysis of science. It is particularly relevant for some of the more application-oriented areas of science, specifically decision-oriented science in the field of regulation of technological risks. Our main objective in this paper is to assess the diversity of roles that non-cognitive values related to decision making can adopt in the kinds of scientific activity that underlie risk regulation. We start out, first, by (...) analyzing the issue of values with the help of a framework taken from the wider philosophical debate on science and values. Second, we study the principal conceptualizations used by scholars who have applied them to numerous case studies. Third, we appraise the links between those conceptualizations and learning processes in decision-oriented science. In this, we recur to the concept of methodological learning, i.e., learning about the best methodologies for generating knowledge that is useful for science-based regulatory decisions. The main result of our analysis is that non-cognitive values can contribute to methodological improvements in science in three principal ways: as basis for critical analysis, for contextualizing methodologies, and for establishing the burden of proof. (shrink)

Why do people get sick? I argue that a disease explanation is best thought of as causal network instantiation, where a causal network describes the interrelations among multiple factors, and instantiation consists of observational or hypothetical assignment of factors to the patient whose disease is being explained. This paper first discusses inference from correlation to causation, integrating recent psychological discussions of causal reasoning with epidemiological approaches to understanding disease causation, particularly concerning ulcers and lung cancer. It then shows how causal (...) mechanisms represented by causal networks can contribute to reasoning involving correlation and causation. The understanding of causation and causal mechanisms provides the basis for a presentation of the causal network instantiation model of medical explanation. (shrink)

Models carry the meaning of science. This puts a tremendous burden on the process of model selection. In general practice, models are selected on the basis of their relative goodness of fit to data penalized by model complexity. However, this may not be the most effective approach for selecting models to answer a specific scientific question because model fit is sensitive to all aspects of a model, not just those relevant to the question. Model Structural Adequacy analysis is proposed as (...) a means to select models based on their ability to answer specific scientific questions given the current understanding of the relevant aspects of the real world. (shrink)

Descriptive accounts of the nature of explanation in neuroscience and the global goals of such explanation have recently proliferated in the philosophy of neuroscience and with them new understandings of the experimental practices of neuroscientists have emerged. In this paper, I consider two models of such practices; one that takes them to be reductive; another that takes them to be integrative. I investigate those areas of the neuroscience of learning and memory from which the examples used to substantiate these models (...) are culled, and argue that the multiplicity of experimental protocols used in these research areas presents specific challenges for both models. In my view, these challenges have been overlooked largely because philosophers have hitherto failed to pay sufficient attention to fundamental features of experimental practice. I demonstrate that when we do pay attention to such features, evidence for reduction and integrative unity in neuroscience is simply not borne out. I end by suggesting some new directions for the philosophy of neuroscience that pertain to taking a closer look at the nature of neuroscientific experiments. (shrink)

Optogenetic techniques are described as “revolutionary” for the unprecedented causal control they allow neuroscientists to exert over neural activity in awake behaving animals. In this paper, I demonstrate by means of a case study that optogenetic techniques will only illuminate causal links between the brain and behavior to the extent that their error characteristics are known and, further, that determining these error characteristics requires comparison of optogenetic techniques with techniques having well known error characteristics and consideration of the broader neural (...) and behavioral context in which the targets of optogenetic interventions are situated. (shrink)

One might be inclined to assume, given the mouse donning its cover, that the behavior of interest in Nicole Nelson's book Model Behavior (2018) is that of organisms like mice that are widely used as “stand-ins” for investigating the causes of human behavior. Instead, Nelson's ethnographic study focuses on the strategies adopted by a community of rodent behavioral researchers to identify and respond to epistemic challenges they face in using mice as models to understand the causes of disordered human behaviors (...) associated with mental illness. Although Nelson never explicitly describes the knowledge production activities in which her behavioral geneticist research subjects engage as “exemplary”, the question of whether or not these activities constitute “model behavior(s)”—generalizable norms for engaging in scientific research—is one of the many thought-provoking questions raised by her book. As a philosopher of science interested in this question, I take it up here. (shrink)

Many philosophers are skeptical about the scientific value of the concept of biological information. However, several have recently proposed a more positive view of ascribing information as an exercise in scientific modeling. I argue for an alternative role: guiding empirical data collection for the sake of theorizing about the evolution of semantics. I clarify and expand on Bergstrom and Rosvall’s suggestion of taking a “diagnostic” approach that defines biological information operationally as a procedure for collecting empirical cases. The more recent (...) modeling-based accounts still perpetuate a theory-centric view of scientific concepts, which motivated philosophers’ misplaced skepticism in the first place. (shrink)

Robustness is a common platitude: hypotheses are better supported with evidence generated by multiple techniques that rely on different background assumptions. Robustness has been put to numerous epistemic tasks, including the demarcation of artifacts from real entities, countering the “experimenter’s regress,” and resolving evidential discordance. Despite the frequency of appeals to robustness, the notion itself has received scant critique. Arguments based on robustness can give incorrect conclusions. More worrying is that although robustness may be valuable in ideal evidential circumstances (i.e., (...) when evidence is concordant), often when a variety of evidence is available from multiple techniques, the evidence is discordant. †To contact the author, please write to: Jacob Stegenga, Department of Philosophy, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093; e‐mail: [email protected]. (shrink)

Making sense of why something succeeded or failed is central to scientific practice: it provides an interpretation of what happened, i.e. an hypothesized explanation for the results, that informs scientists’ deliberations over their next steps. In philosophy, the realism debate has dominated the project of making sense of scientists’ success and failure claims, restricting its focus to whether truth or reliability best explain science’s most secure successes. Our aim, in contrast, will be to expand and advance the practice-oriented project sketched (...) by Arthur Fine in his work on the Natural Ontological Attitude. An important obstacle to articulating a positive program, we suggest, has been overlooking how scientists adopt standardized rules and procedures in order to define and operationalize meanings for success and failure relative to their situated goals. To help fill this gap, we introduce two new ideas, design specifications and track records, and show how they advance our ability to make sense of scientific modeling practices while maintaining a deflationary stance toward the realism debate. (shrink)

We introduce a new type of pluralism about biological function that, in contrast to existing, demonstrates a practical integration among the term’s different meanings. In particular, we show how to generalize Sandra Mitchell’s notion of integrative pluralism to circumstances where multiple epistemic tools of the same type are jointly necessary to solve scientific problems. We argue that the multiple definitions of biological function operate jointly in this way based on how biologists explain the evolution of protein function. To clarify how (...) our account relates to existing views, we introduce a general typology for monist and pluralist accounts along with standardized criteria for judging which is best supported by evidence. (shrink)

Introduces a series of articles which deals with the relationship between history of science and philosophy of science.; Introduces a series of articles which deals with the relationship between history of science and philosophy of science.

I describe two traditions of philosophical accounts of evidence: one characterizes the notion in terms of signs of success, the other characterizes the notion in terms of conditions of success. The best examples of the former rely on the probability calculus, and have the virtues of generality and theoretical simplicity. The best examples of the latter describe the features of evidence which scientists appeal to in practice, which include general features of methods, such as quality and relevance, and general features (...) of evidence, such as patterns in data, concordance with other evidence, and believability of the evidence. Two infamous episodes from biomedical research help to illustrate these features. Philosophical characterization of these latter features—conditions of success—has the virtue of potential relevance to, and descriptive accuracy of, practices of experimental scientists. (shrink)

The likelihood principle (LP) is a core issue in disagreements between Bayesian and frequentist statistical theories. Yet statements of the LP are often ambiguous, while arguments for why a Bayesian must accept it rely upon unexamined implicit premises. I distinguish two propositions associated with the LP, which I label LP1 and LP2. I maintain that there is a compelling Bayesian argument for LP1, based upon strict conditionalization, standard Bayesian decision theory, and a proposition I call the practical relevance principle. In (...) contrast, I argue that there is no similarly compelling argument for or against LP2. I suggest that these conclusions lead to a restrictedly pluralistic view of Bayesian confirmation measures. (shrink)

Amalgamating evidence of different kinds for the same hypothesis into an overall confirmation is analogous, I argue, to amalgamating individuals’ preferences into a group preference. The latter faces well-known impossibility theorems, most famously “Arrow’s Theorem”. Once the analogy between amalgamating evidence and amalgamating preferences is tight, it is obvious that amalgamating evidence might face a theorem similar to Arrow’s. I prove that this is so, and end by discussing the plausibility of the axioms required for the theorem.

Normal 0 0 1 85 487 UBC 4 1 598 11.773 0 0 0 Under what conditions is the failure to have evidence that p evidence that p is false? Absent evidence reasoning is common in many sciences, including astronomy, archeology, biology and medicine. An often-repeated epistemological motto is that “the absence of evidence is not evidence of absence.” Analysis of absent evidence reasoning usually takes place in a deductive or frequentist hypothesis-testing framework. Instead, I develop a Bayesian analysis of (...) this motto and prove that, under plausible assumptions about the nature of evidence, the absence of evidence is evidence of absence. (shrink)

Disputes between advocates of Bayesians and more orthodox approaches to statistical inference presuppose that Bayesians must regard must regard stopping rules, which play an important role in orthodox statistical methods, as evidentially irrelevant.In this essay, I show that this is not the case and that the stopping rule is evidentially relevant given some Bayesian confirmation measures that have been seriously proposed. However, I show that accepting a confirmation measure of this sort comes at the cost of rejecting two useful ancillaryBayesian (...) principles. (shrink)

Some accounts of evidence regard it as an objective relationship holding between data and hypotheses, perhaps mediated by a testing procedure. Mayo’s error-statistical theory of evidence is an example of such an approach. Such a view leaves open the question of when an epistemic agent is justified in drawing an inference from such data to a hypothesis. Using Mayo’s account as an illustration, I propose a framework for addressing the justification question via a relativized notion, which I designate security , (...) meant to conceptualize practices aimed at the justification of inferences from evidence. I then show how the notion of security can be put to use by showing how two quite different theoretical approaches to model criticism in statistics can both be viewed as strategies for securing claims about statistical evidence. (shrink)

Many philosophers have claimed that evidence for a theory is better when multiple independent tests yield the same result, i.e., when experimental results are robust. Little has been said about the grounds on which such a claim rests, however. The present essay presents an analysis of the evidential value of robustness that rests on the fallibility of assumptions about the reliability of testing procedures and a distinction between the strength of evidence and the security of an evidence claim. Robustness can (...) enhance the security of an evidence claim either by providing what I call second-order evidence, or by providing back-up evidence for a hypothesis. (shrink)

While epistemic justification is a central concern for both contemporary epistemology and philosophy of science, debates in contemporary epistemology about the nature of epistemic justification have not been discussed extensively by philosophers of science. As a step toward a coherent account of scientific justification that is informed by, and sheds light on, justificatory practices in the sciences, this paper examines one of these debates—the internalist-externalist debate—from the perspective of objective accounts of scientific evidence. In particular, we focus on Deborah Mayo’s (...) error-statistical theory of evidence because it is a paradigmatically objective theory of evidence that is strongly informed by methodological practice. We contend that from the standpoint of such an objective theory of evidence, justification in science has both externalist and internalist characteristics. In reaching this conclusion, however, we find that the terms of the contemporary debate between internalists and externalists have to be redefined to be applicable to scientific contexts. (shrink)

: Peter Galison has recently claimed that twentieth-century microphysics has been pursued by two distinct experimental traditions--the image tradition and the logic tradition--that have only recently merged into a hybrid tradition. According to Galison, the two traditions employ fundamentally different forms of experimental argument, with the logic tradition using statistical arguments, while the image tradition strives for non-statistical demonstrations based on compelling ("golden") single events. I show that discoveries in both traditions have employed the same statistical form of argument, even (...) when basing discovery claims on single, golden events. Where Galison sees an epistemic divide between two communities that can only be bridged by a creole- or pidgin-like "interlanguage," there is in fact a shared commitment to a statistical form of experimental argument. (shrink)

Error statistics is an important methodological view in philosophy of statistics and philosophy of science that can be applied to scientific experiments such as clinical trials. In this paper, I raise two potential issues for ES when it comes to guiding, and explaining early stopping of randomized controlled trials : ES provides limited guidance in cases of early unfavorable trends due to the possibility of trend reversal; ES is silent on how to prospectively control error rates in experiments requiring multiple (...) interim analyses. The method of conditional power, together with a rationing principle for RCTs, can assist ES in addressing such issues. (shrink)

I consider the error-statistical account as both a theory of evidence and as a theory of inference. I seek to show how inferences regarding the truth of hypotheses can be upheld by avoiding a certain kind of alternative hypothesis problem. In addition to the testing of assumptions behind the experimental model, I discuss the role of judgments of implausibility. A benefit of my analysis is that it reveals a continuity in the application of error-statistical assessment to low-level empirical hypotheses and (...) highly general theoretical principles. This last point is illustrated with a brief sketch of the issues involved in the parametric framework analysis of tests of physical theories such as General Relativity and of fundamental physical principles such as the Einstein Equivalence Principle. (shrink)