In an influential paper, Wendy Parker argues that agreement across climate models isn’t a reliable marker of confirmation in the context of cutting-edge climate science. In this paper, I argue that while Parker’s conclusion is generally correct, there is an important class of exceptions. Broadly speaking, agreement is not a reliable marker of confirmation when the hypotheses under consideration are mutually consistent—when, e.g., we’re concerned with overlapping ranges. Since many cutting-edge questions in climate modeling require making distinctions between mutually consistent (...) hypotheses, agreement across models will be generally unreliable in this domain. In cases where we are only concerned with mutually exclusive hypotheses, by contrast, agreement across climate models is plausibly a reliable marker of confirmation. (shrink)

I argue that what speakers mean or express can be determined by their implicit or unconscious states, rather than explicit or conscious states. Further, on this basis, I show that the sincerity conditions for utterances can also be fixed by implicit states. This is a surprising result which goes against common assumptions about speech acts and sincerity. Roughly, I argue that the result is implied by two plausible and independent theories of the metaphysics of speaker meaning and, further, that this (...) is a robust basis on which to make an inference, with a fair degree of confidence, about the relationship between expression and implicit attitudes. (shrink)

Practical ability manifested through robust and reliable task performance, as well as information relevance and well-structured representation, are key factors indicative of understanding in the philosophical literature. We explore these factors in the context of deep learning, identifying prominent patterns in how the results of these algorithms represent information. While the estimation applications of modern neural networks do not qualify as the mental activity of persons, we argue that coupling analyses from philosophical accounts with the empirical and theoretical basis for (...) identifying these factors in deep learning representations provides a framework for discussing and critically evaluating potential machine understanding given the continually improving task performance enabled by such algorithms. (shrink)

Philosophers of science have offered various accounts of climate model evaluation which have largely centered on model-fit assessment. However, despite the wide-spread prevalence of process-based evaluation in climate science practice, this sort of model evaluation has been undertheorized by philosophers of science. In this paper, I aim to expand this narrow philosophical view of climate model evaluation by providing a philosophical account of process evaluation that is rooted in a close examination of scientific practice. I propose dynamical adequacy as a (...) metric by which scientists test and evaluate models that represent and produce key regional climate processes and features. I argue that process-based evaluation confirms the adequacy of a regional climate model for simulating and predicting future changes of a specific regional climate feature. I offer a case study of how, in practice, scientists establish the reliability of model projections by assessing the dynamical adequacy of such models. I also show how process-based evaluation mitigates some well-known shortcomings of model-fit assessment and supports the adequacy and reliability of climate model projections against philosophical objections, like confirmational holism. Such adequacy is especially important for decision makers who need reliable regional model projections to guide their climate change mitigation and adaptation policies. (shrink)

Lisciandra poses a challenge for robustness analysis as applied to economic models. She argues that substituting tractability assumptions risks altering the main mathematical structure of the model, thereby preventing the possibility of meaningfully evaluating the same model under different assumptions. In such cases RA is argued to be inapplicable. However, Lisciandra is mistaken to take the goal of RA as keeping the mathematical properties of tractability assumptions intact. Instead, RA really aims to keep the modeling component while varying the corresponding (...) mathematical formulation. Thus, her argument concerning whether the associated mathematical properties of certain assumptions can be kept intact is irrelevant to the success of RA. Furthermore, we explicate and develop Lloyd’s account of “model robustness” to provide solutions to Lisciandra’s challenges. Our solutions are, namely, error analysis and independent empirical support. We conclude that although complex economic models do face potential dangers, there are solutions and robustness analysis need not be given up.. (shrink)

Computer simulations are nowadays often directly involved in the generation of experimental results. Given this dependency of experiments on computer simulations, that of simulations on models, and that of the models on free parameters, how do researchers establish trust in their experimental results? Using high-energy physics (HEP) as a case study, I will identify three different types of robustness that I call conceptual, methodological, and parametric robustness, and show how they can sanction this trust. However, as I will also show, (...) simulation models in HEP themselves fail to exhibit a type of robustness I call inverse parametric robustness. This combination of robustness and failures thereof is best understood by distinguishing different epistemic capacities of simulations and different senses of trust: Trusting simulations in their capacity to facilitate credible experimental results can mean accepting them as means for generating belief in these results, while this need not imply believing the models themselves in their capacity to represent an underlying reality. (shrink)

Jonathan Y. Tsou examines and defends positions on central issues in philosophy of psychiatry. The positions defended assume a naturalistic and realist perspective and are framed against skeptical perspectives on biological psychiatry. Issues addressed include the reality of mental disorders; mechanistic and disease explanations of abnormal behavior; definitions of mental disorder; natural and artificial kinds in psychiatry; biological essentialism and the projectability of psychiatric categories; looping effects and the stability of mental disorders; psychiatric classification; and the validity of the DSM's (...) diagnostic categories. The main argument defended by Tsou is that genuine mental disorders are biological kinds with harmful effects. This argument opposes the dogma that mental disorders are necessarily diseases that result from biological dysfunction. Tsou contends that the broader ideal of biological kinds offers a more promising and empirically ascertainable naturalistic standard for assessing the reality of mental disorders and the validity of psychiatric categories. (shrink)

Computer simulations of the formation and evolution of large-scale structure in the universe are integral to the enterprise of modern cosmology. Establishing the reliability of these simulations has been extremely challenging, primarily because of epistemic opacity. In this setting, robustness analysis defined by requiring converging outputs from a diverse ensemble of simulations is insufficient to determine simulation validity. We propose an alternative path of structured code validation that applies eliminative reasoning to isolate and reduce possible sources of error, a potential (...) path that is already being explored by some cosmologists. (shrink)

Animal welfare is a concept that plays a role within both our moral deliberations and the relevant areas of science. The study of animal welfare has impacts on decisions made by legislators, producers and consumers with regards to housing and treatment of animals. Our ethical deliberations in these domains need to consider our impact on animals, and the study of animal welfare provides the information that allows us to make informed decisions. This thesis focusses on taking a philosophical perspective to (...) answer the question of how we can measure the welfare of animals. Animal welfare science is an applied area of biology, aimed at measuring animal welfare. Although philosophy of animal ethics is common, philosophy focussing on animal welfare science is rare. Despite this lack, there are definitely many ways in which philosophical methods can be used to analyse the methodologies and concepts used in this science. One of the aims of the work in this thesis is to remedy this lack of attention in animal welfare. Animal welfare science is a strong emerging discipline, but there is the need for conceptual and methodological clarity and sophistication in this science if it is to play the relevant informative role for our practical and ethical decision-making. There is thus is a strong role here for philosophical analysis for this purpose. The central aim of this thesis is to provide an account of how we can measure subjective animal welfare, addressing some of the potential problems that may arise in this particular scientific endeavour. The two questions I will be answering are: what is animal welfare, and how do we measure it? Part One of the thesis looks at the subjective concept of animal welfare and its applications. In it, I argue for a subjective welfare view - that animal welfare should be understood as the subjective experience of individuals over their lifetimes - and look at how the subjective welfare concept informs our ethical decision-making in two different cases in applied animal ethics. Part Two of the thesis looks more closely at the scientific role of welfare. Understanding welfare subjectively creates unique measurement problems, due to the necessarily private nature of mental states and here I address a few of these problems, including whether subjective experience is measurable, how we might validate indicators of hidden target variables such as welfare, how we can make welfare comparisons between individual animals and how we might compare or integrate the different types of experience that make up welfare. I end with a discussion of the implications of all these problems and solutions for the practice of welfare science, and indicate useful future directions for research. (shrink)

In the 1960s, theoretical biologist Richard Levins criticised modellers in his own discipline of population biology for pursuing the “brute force” strategy of building hyper-realistic models. Instead of exclusively chasing complexity, Levins advocated for the use of multiple different kinds of complementary models, including much simpler ones. In this paper, I argue that the epistemic challenges Levins attributed to the brute force strategy still apply to state-of-the-art climate models today: they have big appetites for unattainable data, they are limited by (...) computational tractability, and they are incomprehensible to the human modeller. Along the lines Levins described, this uncertainty generates a trade-off between realistic, precise models with predictive power and simple, highly idealised models that facilitate understanding. In addition to building ensembles of highly complex dynamical models, climate modellers can address model uncertainty by comparing models of different types, such as dynamical and data-driven models, and by systematically comparing models at different levels of what climate modellers call the model hierarchy. Despite its age, Levins’ paper remains incredibly insightful and should be considered an important entry into the philosophy of computational modelling. (shrink)

In biomedical measurement, biomarkers are used to achieve reliable prediction of, and useful causal information about patient outcomes while minimizing complexity of measurement, resources, and invasiveness. A biomarker is an assayable metric that discloses the status of a biological process of interest, be it normative, pathophysiological, or in response to intervention. The greatest utility from biomarkers comes from their ability to help clinicians (and researchers) make and evaluate clinical decisions. In this paper we discuss a specific methodological use of clinical (...) biomarkers in pharmacological measurement: Some biomarkers, called ‘surrogate markers’, are used to substitute for a clinically meaningful endpoint corresponding to events and their penultimate risk factors. We confront the reliability of clinical biomarkers that are used to gather information about clinically meaningful endpoints. Our aim is to present a systematic methodology for assessing the reliability of multiple surrogate markers (and biomarkers in general). To do this we draw upon the robustness analysis literature in the philosophy of science and the empirical use of clinical biomarkers. After introducing robustness analysis we present two problems with biomarkers in relation to reliability. Next, we propose an intervention-based robustness methodology for organizing the reliability of biomarkers in general. We propose three relevant conditions for a robust methodology for biomarkers: (R1) Intervention-based demonstration of partial independence of modes: In biomarkers partial independence can be demonstrated through exogenous interventions that modify a process some number of “steps” removed from each of the markers. (R2) Comparison of diverging and converging results across biomarkers: By systematically comparing partially-independent biomarkers we can track under what conditions markers fail to converge in results, and under which conditions they successfully converge. (R3) Information within the context of theory: Through a systematic cross-comparison of the markers we can make causal conclusions as well as eliminate competing theories. We apply our robust methodology to currently developing Alzheimer’s research to show its usefulness for making causal conclusions. (shrink)

Although scientific realism is the default position in the life sciences, philosophical accounts of realism are geared towards physics and run into trouble when applied to fields such as biology or neuroscience. In this paper, I formulate a new robustness-based version of entity realism, and show that it provides a plausible account of realism for the life sciences that is also continuous with scientific practice. It is based on the idea that if there are several independent ways of measuring, detecting (...) or deriving something, then we are justified in believing that it is real. I also consider several possible objections to robustness-based entity realism, discuss its relationship to ontic structural realism, and show how it has the potential to provide a novel response to the pessimistic induction argument. (shrink)

The aim of this dissertation is to comprehensively study various robustness arguments proposed in the literature from Levins to Lloyd as well as the opposition offered to them and pose enquiry into the degree of epistemic virtue that they provide to the model prediction results with respect to climate science and modeling. Another critical issue that this dissertation strives to examine is that of the actual epistemic notion that is operational when scientists and philosophers appeal to robustness. In attempting to (...) explicate this idea, the discussion turns to arguments provided by Schupbach who completely rejects probabilistic independence in favour of explanatory reasoning, Stegenga and Menon who still see some value in probabilistic independence, and Winsberg who takes applies Schupbach’s to climate science, going beyond models to involve multi-modal evidence. After an exhaustive discussion on these arguments, this dissertation attempts to provide a thorough and updated notion of robustness in climate modeling and climate science. (shrink)

Varied evidence confirms more strongly than less varied evidence, ceteris paribus. This epistemological Variety of Evidence Thesis enjoys widespread intuitive support. We put forward a novel explication of one notion of varied evidence and the Variety of Evidence Thesis within Bayesian models of scientific inference by appealing to measures of entropy. Our explication of the Variety of Evidence Thesis holds in many of our models which also pronounce on disconfirmatory and discordant evidence. We argue that our models pronounce rightly. Against (...) a backdrop of failures of the Variety of Evidence Thesis, the intuitive case for the Variety of Evidence Thesis emerges strengthened. Our models do however not support the general case for the thesis since our explication of it fails to hold in certain cases. The parameter space of this failure is explored and an explanation for the failure is offered. (shrink)

Robustness arguments hold that hypotheses are more likely to be true when they are confirmed by diverse kinds of evidence. Robustness arguments require the confirming evidence to be independent. We identify two kinds of independence appealed to in robustness arguments: ontic independence —when the multiple lines of evidence depend on different materials, assumptions, or theories—and probabilistic independence. Many assume that OI is sufficient for a robustness argument to be warranted. However, we argue that, as typically construed, OI is not a (...) sufficient independence condition for warranting robustness arguments. We show that OI evidence can collectively confirm a hypothesis to a lower degree than individual lines of evidence, contrary to the standard assumption undergirding usual robustness arguments. We employ Bayesian networks to represent the ideal empirical scenario for a robustness argument and a variety of ways in which empirical scenarios can fall short of this ideal. (shrink)

It is often suggested that disagreement among scientific experts is a reason not to trust those experts, even about matters on which they are in agreement. In direct opposition to this view, I argue here that the very fact that there is disagreement among experts on a given issue provides a positive reason for non-experts to trust that the experts really are justified in their attitudes towards consensus theories. I show how this line of thought can be spelled out in (...) three distinct frameworks for non-deductive reasoning: namely, Bayesian Confirmation Theory, Inference to the Best Explanation, and Inferential Robustness Analysis. (shrink)

Suppose a theory T entails hypotheses H and $$H'$$, neither of which entails the other. A number of authors have argued that a piece of evidence E “indirectly confirms” H when E confirms either T or $$H'$$. But there has been a protracted and unsettled debate about whether indirect confirmation is a sound inference procedure. Skeptics argue that the procedure employs conditions of confirmation that jointly lead to absurdity. Proponents argue that this criticism is unfounded or that its import is (...) exaggerated. I will argue that no side has the story quite right, and some have the story quite wrong. Indirect confirmation, as characterized above, is unsound, and a good chunk of this paper will be concerned with showing why most extant defenses of the procedure err. On the other hand, when certain probabilistic (in)dependence relations hold between T, H, and $$H'$$, indirect confirmation can work, for reasons that trace back to Reichenbach’s principle of the common cause. I illustrate these matters with some contemporary and historical examples, with a particular focus on Kepler’s use of data about mars’s elliptical orbit to justify a claim about earth’s. (shrink)

Derived measurements involve problems of coordination. Conducting them often requires detailed theoretical assumptions about their target, while such assumptions can lack sources of evidence that are independent from these very measurements. In this paper, I defend two claims about problems of coordination. I motivate both by a novel case study on a central measurement problem in the history of physical geodesy: the determination of the earth's ellipticity. First, I argue that the severity of problems of coordination varies according to scientists' (...) predictive and experimental control over perturbations of the measurement process. Second, I identify a methodology by which scientists can solve hard problems of coordination and gradually increase their predictive control over perturbations. I dub this methodology ‘operational pluralism’ since it is driven by the introduction of alternative measurement operations that involve different physical indicators. (shrink)

A particular tradition in medicine claims that a variety of evidence is helpful in determining whether an observed correlation is causal. In line with this tradition, it has been claimed that establishing a causal claim in medicine requires both probabilistic and mechanistic evidence. This claim has been put forward by Federica Russo and Jon Williamson. As a result, it is sometimes called the Russo–Williamson thesis. In support of this thesis, Russo and Williamson appeal to the practice of the International Agency (...) for Research on Cancer. However, this practice presents some problematic cases for the Russo–Williamson thesis. One response to such cases is to argue in favour of reforming these practices. In this paper, we propose an alternative response according to which such cases are in fact consistent with the Russo–Williamson thesis. This response requires maintaining that there is a role for mechanism-based extrapolation in the practice of the IARC. However, the response works only if this mechanism-based extrapolation is reliable, and some have argued against the reliability of mechanism-based extrapolation. Against this, we provide some reasons for believing that reliable mechanism-based extrapolation is going on in the practice of the IARC. The reasons are provided by appealing to the role of robustness analysis. (shrink)

Bayesianism and likelihoodism are two of the most important frameworks philosophers of science use to analyse scientific methodology. However, both frameworks face a serious objection: much scientific inquiry takes place in highly idealized frameworks where all the hypotheses are known to be false. Yet, both Bayesianism and likelihoodism seem to be based on the assumption that the goal of scientific inquiry is always truth rather than closeness to the truth. Here, I argue in favour of a verisimilitude framework for inductive (...) inference. In the verisimilitude framework, scientific inquiry is conceived of, in part, as a process where inference methods ought to be calibrated to appropriate measures of closeness to the truth. To illustrate the verisimilitude framework, I offer a reconstruction of parsimony evaluations of scientific theories, and I give a reconstruction and extended analysis of the use of parsimony inference in phylogenetics. By recasting phylogenetic inference in the verisimilitude framework, it becomes possible to both raise and address objections to phylogenetic methods that rely on parsimony. 1Introduction2Problems with the Law of Likelihood3Introducing Verisimilitude-Based Inference4Examples of Verisimilitude-Based Inference Procedures4.1Parsimony inference over theories4.2Parsimony inference in phylogenetics5Conclusion. (shrink)

One important strategy for dealing with error in our methods is triangulation, or the use multiple methods to investigate the same object. Current accounts of triangulation assume that its primary function is to provide a confirmatory boost to hypotheses beyond what confirmation of each method alone could produce. Yet, researchers often use multiple methods to examine new constructs about which they are uncertain. For example, social psychologists use multiple indirect measures to provide convergent evidence about implicit attitudes, but how to (...) characterize implicit attitudes is an open question. To make sense of triangulation under uncertainty about constructs, I suggest two changes: first, triangulation can serve multiple epistemic functions, including some that are non-confirmatory, and second, researchers should assess the epistemic risk in claims about evidence and the acceptance/rejection of hypotheses. (shrink)

The aim of this thesis is to improve our understanding of how to assess and communicate uncertainty in areas of research deeply afflicted by it, the assessment and communication of which are made more fraught still by the studies’ immediate policy implications. The IPCC is my case study throughout the thesis, which consists of three parts. In Part 1, I offer a thorough diagnosis of conceptual problems faced by the IPCC uncertainty framework. The main problem I discuss is the persistent (...) ambiguity surrounding the concepts of ‘confidence’ and ‘likelihood’; I argue that the lack of a conceptually valid interpretation of these concepts compatible with the IPCC uncertainty guide’s recommendations has worrying implications for both the IPCC authors’ treatment of uncertainties and the interpretability of the information provided in the AR5. Finally, I show that an understanding of the reasons behind the IPCC’s decision to include two uncertainty scales can offer insights into the nature of this problem. In Part 2, I review what philosophers have said about model-based robustness analysis. I assess several arguments that have been offered for its epistemic import and relate this discussion to the context of climate model ensembles. I also discuss various measures of independence in the climate literature, and assess the extent to which these measures can help evaluate the epistemic import of model robustness. In Part 3, I explore the notion of the ‘weight of evidence’ typically associated with Keynes. I argue that the Bayesian is bound to struggle with this notion, and draw some lessons from this fact. Finally, I critically assess some recent proposals for a new IPCC uncertainty framework that significantly depart from the current one. (shrink)

Multiple determination is the epistemic strategy of establishing the same result by means of multiple, independent procedures. It is an important strategy praised by both philosophers of science and practicing scientists. Despite the heavy appeal to multiple determination, little analysis has been provided regarding the specific grounds upon which its epistemic virtues rest. This article distinguishes between the various dimensions of multiple determination and shows how they can be used to evaluate the epistemic force of the strategy in particular cases. (...) Distinguishing between the various dimensions helps to resolve the disagreements regarding the relevance and epistemic import of multiple determination for scientific research. It also suggests a fruitful mode of interaction between the philosophy of science and (historical) accounts of scientific practice. (shrink)

This paper considers the importance of unification in the context of developing scientific theories. I argue that unifying hypotheses are not valuable simply because they are supported by multiple lines of evidence. Instead, they can be valuable because they guide experimental research in different domains in such a way that the results from those experiments inform the scope of the theory being developed. I support this characterization by appealing to the early development of quantum theory. I then draw some comparisons (...) with discussions of robustness reasoning. (shrink)

Bayesian inference is limited in scope because it cannot be applied in idealized contexts where none of the hypotheses under consideration is true and because it is committed to always using the likelihood as a measure of evidential favouring, even when that is inappropriate. The purpose of this article is to study inductive inference in a very general setting where finding the truth is not necessarily the goal and where the measure of evidential favouring is not necessarily the likelihood. I (...) use an accuracy argument to argue for probabilism and I develop a new kind of argument to argue for two general updating rules, both of which are reasonable in different contexts. One of the updating rules has standard Bayesian updating, Bissiri et al.’s general Bayesian updating, Douven’s IBE-based updating, and Vassend’s ]) quasi-Bayesian updating as special cases. The other updating rule is novel. (shrink)

Derivational robustness may increase the degree to which various pieces of evidence indirectly confirm a robust result. There are two ways in which this increase may come about. First, if one can show that a result is robust, and that the various individual models used to derive it also have other confirmed results, these other results may indirectly confirm the robust result. Confirmation derives from the fact that data not known to bear on a result are shown to be relevant (...) when it is shown to be robust. Second, robustness may increase the degree to which the robust result is indirectly confirmed if it increases the weight with which existing evidence indirectly confirms it. This may happen when it strengthens the connection between the core and the robust result by showing that auxiliaries are not responsible for the result. (shrink)

Amalgamating evidence from heterogeneous sources and across levels of inquiry is becoming increasingly important in many pure and applied sciences. This special issue provides a forum for researchers from diverse scientific and philosophical perspectives to discuss evidence amalgamation, its methodologies, its history, its pitfalls, and its potential. We situate the contributions therein within six themes from the broad literature on this subject: the variety-of-evidence thesis, the philosophy of meta-analysis, the role of robustness/sensitivity analysis for evidence amalgamation, its bearing on questions (...) of extrapolation and external validity of experiments, its connection with theory development, and its interface with causal inference, especially regarding causal theories of cancer. (shrink)

This paper considers the importance of unification in the context of developing scientific theories. I argue that unifying hypotheses are not valuable simply because they are supported by multiple lines of evidence. Instead, they can be valuable because they guide experimental research in different domains in such a way that the results from those experiments inform the scope of the theory being developed. I support this characterization by appealing to the early development of quantum theory. I then draw some comparisons (...) with discussions of robustness reasoning. (shrink)

Convergence of model projections is often considered by climate scientists to be an important objective in so far as it may indicate the robustness of the models’ core hypotheses. Consequently, the range of climate projections from a multi-model ensemble, called “model spread”, is often expected to reduce as climate research moves forward. However, the successive Assessment Reports of the Intergovernmental Panel on Climate Change indicate no reduction in model spread, whereas it is indisputable that climate science has made improvements in (...) its modelling. In this paper, after providing a detailed explanation of the situation, we describe an epistemological setting in which a steady model spread is not doomed to be seen as negative, and is indeed compatible with a desirable evolution of climate models taken individually. We further argue that, from the perspective of collective progress, as far as the improvement of the products of a multi-model ensemble is concerned, reduction of model spread is of lower priority than model independence. (shrink)

This discussion centers on two desiderata: the role of measurement in information-gathering and physical interaction in scientific practice. By taking inspiration from van Fraassen’s view, we present a methodological account of perspectival measurement that addresses empirical practice where there is complex intervention, disagreeing results, and limited theory. The specific aim of our account is to provide a methodological prescription for developing measurement processes in the context of limited theory. The account should be useful to philosophers of science, who are interested (...) in the intersection between representation and intervention; scientists, who are interested in methodological suggestions for theory-development and reliability; and interdisciplinary researchers, who are interested in the intersections between the pandemic, built environments, and social processes. We apply the process-view of measurement to COVID-19, specifically, measuring replication in the SARS-CoV-2 virus. The aim is to show that our account tracks key elements—manipulation/intervention, independence, invariance, and theory-development—by organizing unfolding measurement processes. Additionally, we use our account to make prescriptive suggestions for measurement practice in the COVID-19 context by discussing the need to broaden measurement perspective on interaction, manipulation, and production. (shrink)

A number of philosophers of science have argued that there are important differences between robustness in modeling and experimental contexts, and—in particular—many of them have claimed that the former is non-confirmatory. In this paper, I argue for the opposite conclusion: robust hypotheses are confirmed under conditions that do not depend on the differences between and models and experiments—that is, the degree to which the robust hypothesis is confirmed depends on precisely the same factors in both situations. The positive argument turns (...) on the fact that confirmation theory doesn’t recognize a difference between different sources of evidence. Most of the paper is devoted to rebutting various objections designed to show that it should. I end by explaining why philosophers of science have (often) gone wrong on this point. (shrink)

Some authors claim that minimal models have limited epistemic value (Fumagalli, 2016; Grüne-Yanoff, 2009a). Others defend the epistemic benefits of modelling by invoking the role of robustness analysis for hypothesis confirmation (see, e.g., Levins, 1966; Kuorikoski et al., 2010) but such arguments find much resistance (see, e.g., Odenbaugh & Alexandrova, 2011). In this paper, we offer a Bayesian rationalization and defence of the view that robustness analysis can play a confirmatory role, and thereby shed light on the potential of minimal (...) models for hypothesis confirmation. We illustrate our argument by reference to a case study from macroeconomics. At the same time, we also show that there are cases in which robustness analysis is detrimental to confirmation. We characterize these cases and link them to recent investigations on evidential variety (Landes, 2020b, 2021; Osimani and Landes, forthcoming). We conclude that robustness analysis over minimal models can confirm, but its confirmatory value depends on concrete circumstances. (shrink)

Here I critically assess an argument put forward by Kuorikoski et al. (Br J Philos Sci, 61(3):541–567, 2010) for the epistemic import of model-based robustness analysis. I show that this argument is not sound since the sort of probabilistic independence on which it relies is unfeasible. By revising the notion of probabilistic independence imposed on the models’ results, I introduce a prima-facie more plausible argument. However, despite this prima-facie plausibility, I show that even this new argument is unsound in most (...) if not all cases of model-based robustness analysis. This I do to demonstrate that the epistemic import of model-based robust analysis cannot be satisfactorily defended on the basis of probabilistic independence. (shrink)

Michael Weisberg and Kenneth Reisman argue that the Volterra Principle can be derived from multiple predator-prey models and that, therefore, the Volterra Principle is a prime example for robustness analysis. In the current article, I give new results regarding the Volterra Principle, extending Weisberg’s and Reisman’s work, and I discuss the consequences of these results for robustness analysis. I argue that we do not end up with multiple, independent models but rather with one general model. I identify the kind of (...) situation in which this generalization approach may occur, and I analyze the generalized Volterra Principle from an explanatory perspective. (shrink)

We argue that the robustness analysis of idealized models can have confirmational power. This responds to concerns recently raised in the literature, according to which the robustness analysis of models whose idealizations are not discharged is unable to confirm the causal mechanisms underlying these models, and the robustness analysis of models whose idealizations are discharged is unnecessary. In response, we make clear that, where idealizations sweep out, in a specific way, the space of possibilities— which is sometimes, though not always, (...) the case—they can be holistically discharged. In turn, this can be used to show that the robustness analysis of idealized models can have confirmational force after all. (shrink)

In the philosophical literature concerning scientific experimentation, the notion of robustness has been solely discussed in relation to experimental results. In this paper, I propose a novel sense of experimental robustness that applies to experimental procedures. I call the foregoing sense of robustness procedure robustness and characterize it as the capacity of an experimental procedure to maintain its intended function invariant during the experimental process despite possible variations in its inputs. I argue that PR is a precondition for what I (...) call result robustness, which refers to the traditional sense of experimental robustness, namely the existence of convergent experimental results obtained through different and independent means of detection. Furthermore, I argue, PR and RR constitute useful experimental strategies in the context of high-energy physics experiments, but these strategies are not without limitations. (shrink)

Recently Kenneth Kendler and Peter Zachar have raised doubts about the correspondence theory of truth and scientific realism in psychopathology. They argue that coherentist or pragmatist approaches to truth are better suited for understanding the reality of psychiatric disorders. In this article, I show that rejecting realism based on the correspondence theory is deeply problematic: It makes psychopathology categorically different from other sciences, and results in an implausible view of scientific discovery and progress. As an alternative, I suggest a robustness-based (...) approach that can accommodate the significance of coherence and pragmatic factors without rejecting scientific realism and the correspondence theory of truth. (shrink)

In the philosophy of climate science, debate surrounding the issue of variety of evidence has mostly taken the form of attempting to connect these issues in climate science and climate modeling with philosophical accounts of what has come to be known as “robustness analysis.” I argue that an “explanatory” conception of robustness is the best candidate for understanding variety of evidence in climate science. I apply the analysis to both examples of model agreement, as well at to the convergence of (...) evidence from both model and non-model sources. (shrink)

This paper proposes an extended version of the interventionist account for causal inference in the practical context of biological mechanism research. This paper studies the details of biological mechanism researchers’ practices of assessing the evidential legitimacy of experimental data, arguing why quantity and variety are two important criteria for this assessment. Because of the nature of biological mechanism research, the epistemic values of these two criteria result from the independence both between the causation of data generation and the causation in (...) question and between different interventions, not techniques. The former independence ensures that the interventions in the causation in question are not affected by the causation that is responsible for data generation. The latter independence ensures the reliability of the final mechanisms not only in the empirical but also the formal aspects. This paper first explores how the researchers use quantity to check the effectiveness of interventions, where they at the same time determine the validity of the difference-making revealed by the results of interventions. Then, this paper draws a distinction between experimental interventions and experimental techniques, so that the reliability of mechanisms, as supported by the variety of evidence, can be safely ensured in the probabilistic sense. The latter process is where the researchers establish evidence of the mechanisms connecting the events of interest. By using case studies, this paper proposes to use ‘intervention’ as the fruitful connecting point of literature between evidence and mechanisms. (shrink)

Policy-makers face an uncertain world. One way of getting a handle on decision-making in such an environment is to rely on evidence. Despite the recent increase in post-fact figures in politics, evidence-based policymaking takes centre stage in policy-setting institutions. Often, however, policy-makers face large volumes of evidence from different sources. Robustness analysis can, prima facie, handle this evidential diversity. Roughly, a hypothesis is supported by robust evidence if the different evidential sources are in agreement. In this thesis, I strengthen the (...) case for the use of robustness analysis in evidence-based policymaking by answering open research questions about this inference technique. First, I argue that existing taxonomies miss a fruitful category of robustness reasoning, that is predictive stability. Second, I claim that derivational robustness analysis – the investigation of whether the results of different models are in agreement – can yield interesting insights even if not the entire relevant model space is covered by available models or if the model results are only partially in agreement. Third, I claim that expert knowledge is necessary to address questions that arise when one applies measurement robustness analysis – the investigation into whether multiple means of measurement yield the same result. Finally, I argue that, in situations where evidence from different measurements is not in agreement, it can be advisable to no longer take all of the evidence into account. This can be done in a rationally defensible way by choosing the most adequate theory or model underlying parts of the evidence set. I discuss examples from climate, medical, and economic policy-making to establish my claims. (shrink)

The 2011 Nobel Prize in Physics was awarded to researchers from the Supernova Cosmology Project and the High-z Supernova Search Team for the discovery of the accelerating expansion of the universe. In this paper, I provide a historical analysis of the supernova cosmology evidence put forward by these teams for the accelerating universe, in terms of an iterative model of scientific progress developed by Hasok Chang in the context of his study of the development of measurement standards. I argue, using (...) the key concept of epistemic iteration, that the iterative model adequately accounts for evidence production in experimental science as well. In order to apply Chang’s model to the experimental evidence for the accelerating universe, I introduce the concept of endorsement as a particular mode of progress, and argue that supernova scientists produced an endorsed measurement system to claim evidence for their discovery. Furthermore, I show that the credibility of the evidence was not based on a particular measurement, rather, what proved to be decisive was the “robust consistency” of many individual results. (shrink)

Bayesianism and likelihoodism are two of the most important frameworks philosophers of science use to analyse scientific methodology. However, both frameworks face a serious objection: much scientific inquiry takes place in highly idealized frameworks where all the hypotheses are known to be false. Yet, both Bayesianism and likelihoodism seem to be based on the assumption that the goal of scientific inquiry is always truth rather than closeness to the truth. Here, I argue in favor of a verisimilitude framework for inductive (...) inference. In the verisimilitude framework, scientific inquiry is conceived of, in part, as a process where inference methods ought to be calibrated to appropriate measures of closeness to the truth. To illustrate the verisimilitude framework, I offer a reconstruction of parsimony evaluations of scientific theories, and I give a reconstruction and extended analysis of the use of parsimony inference in phylogenetics. By recasting phylogenetic inference in the verisimilitude framework, it becomes possible to both raise and address objections to phylogenetic methods that rely on parsimony. (shrink)