Multiple determination is the epistemic strategy of establishing the same result by means of multiple, independent procedures. It is an important strategy praised by both philosophers of science and practicing scientists. Despite the heavy appeal to multiple determination, little analysis has been provided regarding the specific grounds upon which its epistemic virtues rest. This article distinguishes between the various dimensions of multiple determination and shows how they can be used to evaluate the epistemic force of the strategy in particular cases. (...) Distinguishing between the various dimensions helps to resolve the disagreements regarding the relevance and epistemic import of multiple determination for scientific research. It also suggests a fruitful mode of interaction between the philosophy of science and (historical) accounts of scientific practice. (shrink)

Diversity of evidence is widely claimed to be crucial for evidence amalgamation to have distinctive epistemic merits. Bayesian epistemologists capture this idea in the variety-of-evidence thesis: ceteris paribus, the strength of confirmation of a hypothesis by an evidential set increases with the diversity of the evidential elements in that set. Yet, formal exploration of this thesis has shown that it fails to be generally true. This article demonstrates that the thesis fails in even more circumstances than recent results would lead (...) us to expect. Most importantly, it can fail whatever the chance that the evidential sources are unreliable. Our results hold for two types of degrees of variety: reliability independence and testable aspect independence. We conclude that the variety-of-evidence thesis can, at best, be interpreted as an exception-prone rule of thumb. (shrink)

Diversity of evidence is widely claimed to be crucial for evidence amalgamation to have distinctive epistemic merits. Bayesian epistemologists capture this idea in the variety-of-evidence thesis: ceteris paribus, the strength of confirmation of a hypothesis by an evidential set increases with the diversity of the evidential elements in that set. Yet, formal exploration of this thesis has shown that it fails to be generally true. This article demonstrates that the thesis fails in even more circumstances than recent results would lead (...) us to expect. Most importantly, it can fail whatever the chance that the evidential sources are unreliable. Our results hold for two types of degrees of variety: reliability independence and testable aspect independence. We conclude that the variety-of-evidence thesis can, at best, be interpreted as an exception-prone rule of thumb. (shrink)

Economists reason causally. Like many other scientists, they aim at formulating justified causal claims about their object of study. This thesis contributes to our understanding of how causal reasoning proceeds in economics. By using the research on the causes of unemployment as a case study, three questions are adressed. What are the meanings of causal claims? How can a causal claim be adequately supported by evidence? How are causal beliefs affected by incoming facts? In the process of answering these semantic, (...) epistemic and dynamical questions, the richness of causal reasoning in economics is brought to the foreground. In the part on semantics, it is argued that the meaning of causal generalizations in policy-oriented economics is best captured by using the concept of ‘inferential relation’ rather than the one of ‘referential relation’. This part contributes to develop an inferentialist semantics by distinguishing among types of inferential relations. In the part on epistemology, it is argued that justification in sciences like economics often relies, and ought to rely, on evidential variety―i.e. the combination of evidence from multiple sources. An interpretation of independence among evidential sources is offered: two evidential sources are fully independent if and only if the reasons why they would be unreliable do not overlap. It is then shown that the variety-of-evidence thesis does not hold under extreme circumstances. The part on dynamics focuses on deviant-case study. A storyline is provided for what deviant-case study aims at and how it proceeds in what is characterized as an ‘eclectic science’. (shrink)

Some authors claim that minimal models have limited epistemic value (Fumagalli, 2016; Grüne-Yanoff, 2009a). Others defend the epistemic benefits of modelling by invoking the role of robustness analysis for hypothesis confirmation (see, e.g., Levins, 1966; Kuorikoski et al., 2010) but such arguments find much resistance (see, e.g., Odenbaugh & Alexandrova, 2011). In this paper, we offer a Bayesian rationalization and defence of the view that robustness analysis can play a confirmatory role, and thereby shed light on the potential of minimal (...) models for hypothesis confirmation. We illustrate our argument by reference to a case study from macroeconomics. At the same time, we also show that there are cases in which robustness analysis is detrimental to confirmation. We characterize these cases and link them to recent investigations on evidential variety (Landes, 2020b, 2021; Osimani and Landes, forthcoming). We conclude that robustness analysis over minimal models can confirm, but its confirmatory value depends on concrete circumstances. (shrink)

Should a scientist rely on methodological triangulation? Heesen et al. (Synthese 196(8):3067–3081, 2019) recently provided a convincing affirmative answer. However, their approach requires belief gambles if the evidence is discordant. We instead propose epistemically modest triangulation (EMT), according to which one should withhold judgement in such cases. We show that for a scientist in a methodologically diffident situation the expected utility of EMT is greater than that of Heesen et al.’s (2019) triangulation or that of using a single method. We (...) also show that EMT is more appropriate for increasing epistemic trust in science. In short: triangulate, but do not gamble with evidence. (shrink)

Robustness arguments hold that hypotheses are more likely to be true when they are confirmed by diverse kinds of evidence. Robustness arguments require the confirming evidence to be independent. We identify two kinds of independence appealed to in robustness arguments: ontic independence —when the multiple lines of evidence depend on different materials, assumptions, or theories—and probabilistic independence. Many assume that OI is sufficient for a robustness argument to be warranted. However, we argue that, as typically construed, OI is not a (...) sufficient independence condition for warranting robustness arguments. We show that OI evidence can collectively confirm a hypothesis to a lower degree than individual lines of evidence, contrary to the standard assumption undergirding usual robustness arguments. We employ Bayesian networks to represent the ideal empirical scenario for a robustness argument and a variety of ways in which empirical scenarios can fall short of this ideal. (shrink)

Amalgamating evidence from heterogeneous sources and across levels of inquiry is becoming increasingly important in many pure and applied sciences. This special issue provides a forum for researchers from diverse scientific and philosophical perspectives to discuss evidence amalgamation, its methodologies, its history, its pitfalls, and its potential. We situate the contributions therein within six themes from the broad literature on this subject: the variety-of-evidence thesis, the philosophy of meta-analysis, the role of robustness/sensitivity analysis for evidence amalgamation, its bearing on questions (...) of extrapolation and external validity of experiments, its connection with theory development, and its interface with causal inference, especially regarding causal theories of cancer. (shrink)

This article seeks, first, to show that much of the existing normative work on argument from expert opinion (AEO) is problematic for failing to be properly informed by empirical findings on expert performance. Second, it seeks to show how, with the analytic tool of Bayesian reasoning, the problem diagnosed can be remedied to circumvent some of the problems facing the scheme-based treatment of AEOs. To establish the first contention, we will illustrate how empirical studies on factors conditioning expert reliability can (...) be drawn upon to re-construct. Walton’s critical questions matching the scheme of AEOs. To establish the second contention, we will illustrate how Walton’s re-constructed set of critical questions can be formalized within a Bayesian network. Finally, we will highlight how the specific ways in which the Bayesian framework we propose is both continuous with and distinct from the models of source reliability put forward by theorists like Bovens and Hartmann (2003). (shrink)

According to the variety of evidence thesis items of evidence from independent lines of investigation are more confirmatory, ceteris paribus, than, for example, replications of analogous studies. This thesis is known to fail (Bovens and Hartmann; Claveau). However, the results obtained by Bovens and Hartmann only concern instruments whose evidence is either fully random or perfectly reliable; instead, for Claveau, unreliability is modelled as deterministic bias. In both cases, the unreliable instrument delivers totally irrelevant information. We present a model that (...) formalizes both reliability and unreliability differently. Our instruments either are reliable, but affected by random error, or are biased but not deterministically so.Bovens and Hartmann’s results are counter-intuitive in that in their model a long series of consistent reports from the same instrument does not raise suspicion of ‘too-good-to-be-true’ evidence. This happens precisely because they contemplate neither the role of systematic bias, nor unavoidable random error of reliable instruments. In our model, the variety of evidence thesis fails as well, but the area of failure is considerably smaller than for Bovens and Hartmann and Claveau, and holds for (the majority of) realistic cases (that is, where biased instruments are very biased). The essential mechanism that triggers variety of evidence thesis failure is the rate of false to true positives for the two kinds of instruments. Our emphasis is on modelling beliefs about sources of knowledge and their role in hypothesis confirmation in interaction with dimensions of evidence, such as variety and consistency. (shrink)

Varied evidence confirms more strongly than less varied evidence, ceteris paribus. This epistemological Variety of Evidence Thesis enjoys widespread intuitive support. We put forward a novel explication of one notion of varied evidence and the Variety of Evidence Thesis within Bayesian models of scientific inference by appealing to measures of entropy. Our explication of the Variety of Evidence Thesis holds in many of our models which also pronounce on disconfirmatory and discordant evidence. We argue that our models pronounce rightly. Against (...) a backdrop of failures of the Variety of Evidence Thesis, the intuitive case for the Variety of Evidence Thesis emerges strengthened. Our models do however not support the general case for the thesis since our explication of it fails to hold in certain cases. The parameter space of this failure is explored and an explanation for the failure is offered. (shrink)

Varied evidence for a hypothesis confirms it more strongly than less varied evidence, ceteris paribus. This epistemological Variety of Evidence Thesis enjoys long-standing widespread intuitive support. Recent literature has raised serious doubts that the correlational approach of explicating the thesis can vindicate it. By contrast, the eliminative approach due to Horwich vindicates the Variety of Evidence Thesis but only within a relatively narrow domain. I investigate the prospects of extending the eliminative approach to a larger domain by considering a larger (...) class of sensible explications of evidential variety. For a large subclass class of such explications I show how to construct cases in which the less diverse body of evidence for a hypothesis confirms more strongly. I hence argue that these prospects are dire since the eliminative approach widely fails to vindicate the thesis. (shrink)

The intuitive Variety of Evidence Thesis states that, ceteris paribus, more varied evidence for a hypothesis confirms it more strongly than less varied evidence. Recent Bayesian analyses have raised serious doubts in its validity. Claveau suggests the existence of a novel type of counter-example to this thesis: a gradual increase in source independence can lead to a decrease in hypothesis confirmation. I show that Claveau’s measure of gradual source independence suffers from two unsuspected types of inconsistencies. I hence put forward (...) a more natural measure of gradual source independence which is not plagued by inconsistencies. Claveau’s counter-examples to the variety of evidence thesis disappear with the measure I suggest. I hence argue that my measure is preferable and that this thesis does at least not seem to be troubled by Claveau’s arguments. (shrink)

Recent work in social epistemology has shown that, in certain situations, less communication leads to better outcomes for epistemic groups. In this paper, we show that, ceteris paribus, a Bayesian agent may believe less strongly that a single agent is biased than that an entire group of independent agents is biased. We explain this initially surprising result and show that it is in fact a consequence one may conceive on the basis of commonsense reasoning.

Modern empirical macroeconomic models, known as structural autoregressions (SVARs) are dynamic models that typically claim to represent a causal order among contemporaneously valued variables and to merely represent non-structural (reduced-form) co-occurence between lagged variables and contemporaneous variables. The strategy is held to meet the minimal requirements for identifying the residual errors in particular equations in the model with independent, though otherwise not directly observable, exogenous causes (“shocks”) that ultimately account for change in the model. In nonstationary models, such shocks accumulate (...) so that variables have discernible trends. Econometricians have conceived of variables that trend in sympathy with each other (so-called “cointegrated variables”) as sharing one or more of these unobserved trends as a common cause. It is possible for estimates of the values of both the otherwise unobservable individual shocks and the otherwise unobservable common trends to be backed-out of cointegrated systems of equations. The issue addressed in this paper is whether and in what circumstances these values can be regarded as observations of real entities rather than merely artifacts of the representation of variables in the model. The issue is related, on the one hand, to practical methodological problems in the use of SVARs for policy analysis—e.g., does it make sense to estimate of shocks or trends in one model and then use them as measures of variables in a conceptually distinct model? The issue is also related to debates in the philosophical analysis of causation—particularly, whether we are entitled, as assumed by the developers of Bayes-net approaches, to rely on the causal Markov condition (a generalization of Reichenbach’s common-cause condition) or whether cointegration generates a practical example of Nancy Cartwright’s “byproducts” objection to the causal Markov condition. (shrink)

Social scientists use many different methods, and there are often substantial disagreements about which method is appropriate for a given research question. In response to this uncertainty about the relative merits of different methods, W. E. B. Du Bois advocated for and applied “methodological triangulation”. This is to use multiple methods simultaneously in the belief that, where one is uncertain about the reliability of any given method, if multiple methods yield the same answer that answer is confirmed more strongly than (...) it could have been by any single method. Against this, methodological purists believe that one should choose a single appropriate method and stick with it. Using tools from voting theory, we show Du Boisian methodological triangulation to be more likely to yield the correct answer than purism, assuming the scientist is subject to some degree of diffidence about the relative merits of the various methods. This holds even when in fact only one of the methods is appropriate for the given research question. (shrink)

In this paper I criticize the current standards for the acceptability of expert testimony in current US legislation. The standards have been the subject of much academic literature after the Frye and Daubert cases. I expose what I call the Paradox of Proof, and argue that the historical and current standards have sidestepped the problem of determining who is an expert and who is not in a court of law. I then investigate the problem of recognizing expertise from the layperson’s (...) standpoint, and suggest what courses of action the future research ought to take on the problem of identifying expertise. (shrink)