Agreement between "independent" measurements of a theoretically posited quantity is intuitively compelling evidence that a theory is, loosely speaking, on the right track. But exactly what conclusion is warranted by such agreement? I propose a new account of the phenomenon's epistemic significance within the framework of Bayesian epistemology. I contrast my proposal with the standard Bayesian treatment, which lumps the phenomenon under the heading of "evidential diversity".

The variety-of-evidence thesis has been criticized by Bovens and Hartmann. This article points to two limitations of their Bayesian model: the conceptualization of unreliable evidential sources as randomizing and the restriction to comparing full independence to full dependence. It is shown that the variety-of-evidence thesis is rehabilitated when unreliable sources are reconceptualized as systematically biased. However, it turns out that allowing for degrees of independence leads to a qualification of the variety-of-evidence thesis: as Bovens and Hartmann claimed, more independence does (...) not always imply stronger confirmation. (shrink)

Probability ratio and likelihood ratio measures of inductive support and related notions have appeared as theoretical tools for probabilistic approaches in the philosophy of science, the psychology of reasoning, and artificial intelligence. In an effort of conceptual clarification, several authors have pursued axiomatic foundations for these two families of measures. Such results have been criticized, however, as relying on unduly demanding or poorly motivated mathematical assumptions. We provide two novel theorems showing that probability ratio and likelihood ratio measures can be (...) axiomatized in a way that overcomes these difficulties. (shrink)

Among Bayesian confirmation theorists, several quantitative measures of the degree to which an evidential proposition E confirms a hypothesis H have been proposed. According to one popular recent measure, s, the degree to which E confirms H is a function of the equation P(H|E) − P(H|~E). A consequence of s is that when we have two evidential propositions, E1 and E2, such that P(H|E1) = P(H|E2), and P(H|~E1) ≠ P(H|~E2), the confirmation afforded to H by E1 does not equal the (...) confirmation afforded to H by E2. I present several examples that demonstrate the unacceptability of this result, and conclude that we should reject s (and other measures that share this feature) as a measure of confirmation. (shrink)

Recent philosophical attention to climate models has highlighted their weaknesses and uncertainties. Here I address the ways that models gain support through observational data. I review examples of model fit, variety of evidence, and independent support for aspects of the models, contrasting my analysis with that of other philosophers. I also investigate model robustness, which often emerges when comparing climate models simulating the same time period or set of conditions. Starting from Michael Weisberg’s analysis of robustness, I conclude that his (...) approach involves a version of reasoning from variety of evidence, enabling this robustness to be a confirmatory virtue.. (shrink)

The conjunction fallacy has been a key topic in debates on the rationality of human reasoning and its limitations. Despite extensive inquiry, however, the attempt of providing a satisfactory account of the phenomenon has proven challenging. Here, we elaborate the suggestion (first discussed by Sides et al., 2001) that in standard conjunction problems the fallacious probability judgments experimentally observed are typically guided by sound assessments of confirmation relations, meant in terms of contemporary Bayesian confirmation theory. Our main formal result is (...) a confirmation-theoretic account of the conjuntion fallacy which is proven robust (i.e., not depending on various alternative ways of measuring degrees of confirmation). The proposed analysis is shown distinct from contentions that the conjunction effect is in fact not a fallacy and is compared with major competing explanations of the phenomenon, including earlier references to a confirmation-theoretic account. (shrink)

Starting from the sixties of the past century theory change has become a main concern of philosophy of science. Two of the best known formal accounts of theory change are the post-Popperian theories of verisimilitude (PPV for short) and the AGM theory of belief change (AGM for short). In this paper, we will investigate the conceptual relations between PPV and AGM and, in particular, we will ask whether the AGM rules for theory change are effective means for approaching the truth, (...) i.e., for achieving the cognitive aim of science pointed out by PPV. First, the key ideas of PPV and AGM and their application to a particular kind of propositional theories - the so called "conjunctive propositions" - will be illustrated. Afterwards, we will prove that, as far as conjunctive propositions are concerned, AGM belief change is an effective tool for approaching the truth. (shrink)

Complaints are common about the arbitrary and conservative bias of special-majority rules. Such complaints, however, apply to asymmetrical versions of those rules alone. Symmetrical special-majority rules remedy that defect, albeit at the cost of often rendering no determinate verdict. Here what is formally at stake, both procedurally and epistemically, is explored in the choice between those two forms of special-majority rule and simple-majority rule; and practical ways are suggested of resolving matters left open by symmetrical special-majority rules – such as (...) ‘judicial extrapolation’ or ‘subsidiarity’ in a federal system. (shrink)

Today's climate models are supported in a couple of ways that receive little attention from philosophers or climate scientists. In addition to standard 'model fit', wherein a model's simulation is compared to observational data, there is an additional type of confirmation available through the variety of instances of model fit. When a model performs well at fitting first one variable and then another, the probability of the model under some standard confirmation function, say, likelihood, goes up more than under each (...) individual case of fit alone. Thus, two instances of fit of distinct variables of a global climate model using distinct data sets considered collectively will provide stronger evidence for a model than either one of the instances considered individually. This has consequences for model robustness. Sets of models that produce robust results will, if their assumptions vary enough and they each are observationally sound, provide reasons to endorse common structures found in those models. Finally, independent empirical support for aspects and assumptions of the model provides an additional confirmational virtue for climate models, contrary to what is implied by some current philosophical writing on this topic. (shrink)

If a group is modelled as a single Bayesian agent, what should its beliefs be? I propose an axiomatic model that connects group beliefs to beliefs of group members, who are themselves modelled as Bayesian agents, possibly with different priors and different information. Group beliefs are proven to take a simple multiplicative form if people’s information is independent, and a more complex form if information overlaps arbitrarily. This shows that group beliefs can incorporate all information spread over the individuals without (...) the individuals having to communicate their (possibly complex and hard-to-describe) private information; communicating prior and posterior beliefs sufices. JEL classification: D70, D71.. (shrink)

Crupi et al. (2008) offer a confirmation-theoretic, Bayesian account of the conjunction fallacy—an error in reasoning that occurs when subjects judge that Pr( h 1 & h 2 | e ) > Pr( h 1 | e ). They introduce three formal conditions that are satisfied by classical conjunction fallacy cases, and they show that these same conditions imply that h 1 & h 2 is confirmed by e to a greater extent than is h 1 alone. Consequently, they suggest (...) that people are tracking this confirmation relation when they commit conjunction fallacies. I offer three experiments testing the merits of Crupi et al.’s account specifically and confirmation-theoretic accounts of the conjunction fallacy more generally. The results of Experiment 1 show that, although Crupi et al.’s conditions do seem to be causally linked to the conjunction fallacy, they are not necessary for it; there exist cases that do not meet their three conditions in which subjects still tend to commit the fallacy. The results of Experiments 2 and 3 show that Crupi et al.’s conditions, and those offered by other confirmation-theoretic accounts of the fallacy, are not sufficient for the fallacy either; there exist cases that meet all three of CFT’s conditions in which subjects do not tend to commit the fallacy. Additionally, these latter experiments show that such confirmation-theoretic conditions are at best only weakly causally relevant to the presence of the conjunction fallacy. Given these findings, CFT’s account specifically, and any general confirmation-theoretic account more broadly, falls short of offering a satisfying explanation of the presence of the conjunction fallacy. (shrink)

In this paper, we identify a new and mathematically well-defined sense in which the coherence of a set of hypotheses can be truth-conducive. Our focus is not, as usual, on the probability but on the confirmation of a coherent set and its members. We show that, if evidence confirms a hypothesis, confirmation is “transmitted” to any hypotheses that are sufficiently coherent with the former hypothesis, according to some appropriate probabilistic coherence measure such as Olsson’s or Fitelson’s measure. Our findings have (...) implications for scientific methodology, as they provide a formal rationale for the method of indirect confirmation and the method of confirming theories by confirming their parts. (shrink)

Can some evidence confirm a conjunction of two hypotheses more than it confirms either of the hypotheses separately? We show that it can, moreover under conditions that are the same for nine different measures of confirmation. Further we demonstrate that it is even possible for the conjunction of two disconfirmed hypotheses to be confirmed by the same evidence.

According to Hempel's paradox, evidence (E) that an object is a nonblack nonraven confirms the hypothesis (H) that every raven is black. According to the standard Bayesian solution, E does confirm H but only to a minute degree. This solution relies on the almost never explicitly defended assumption that the probability of H should not be affected by evidence that an object is nonblack. I argue that this assumption is implausible, and I propose a way out for Bayesians. Introduction Hempel's (...) paradox, the standard Bayesian solution, and the disputed assumption Attempts to defend the disputed assumption Attempts to refute the disputed assumption A way out for Bayesians Conclusion. (shrink)

On analogy with testimony, I define a notion of a scientific theory’s lacking or having candor, in a testing situation, according to whether the theory under test is probabilistically relevant to the processes in the test procedures, and thereby to the reliability of test outcomes. I argue that this property identifies what is distinctive about those theories that Karl Popper denounced as exhibiting “reinforced dogmatism” through their self-protective behavior (e.g., psychoanalysis, Hegelianism, Marxism). I explore whether lack of candor interferes with (...) the testing of theories, and conclude that (1) our default attitude toward theories that lack candor in a given test should be suspicion, but (2) the circumstance that a theory lacks candor in a testing situation does not preclude obtaining independent evidence for the auxiliary assumptions to which the theory is probabilistically relevant, and thereby eliminating the problem that lack of candor creates. Thus, Popper was right to think that lack of candor is a bad thing, but wrong to conclude that candor is a criterion of the scientificity of a theory. Seeing this requires recognition of some differences between intuitive relevance and probabilistic relevance, and proper appreciation of the notion of screening off and of the fact that probabilistic relevance is not transitive. (shrink)

(new version: 10/30/07). Click here to download the companion Mathematica 6 notebook that goes along with this paper.

Under the independence and competence assumptions of Condorcet’s classical jury model, the probability of a correct majority decision converges to certainty as the jury size increases, a seemingly unrealistic result. Using Bayesian networks, we argue that the model’s independence assumption requires that the state of the world (guilty or not guilty) is the latest common cause of all jurors’ votes. But often – arguably in all courtroom cases and in many expert panels – the latest such common cause is a (...) shared ‘body of evidence’ observed by the jurors. In the corresponding Bayesian network, the votes are direct descendants not of the state of the world, but of the body of evidence, which in turn is a direct descendant of the state of the world. We develop a model of jury decisions based on this Bayesian network. Our model permits the possibility of misleading evidence, even for a maximally competent observer, which cannot easily be accommodated in the classical model. We prove that (i) the probability of a correct majority verdict converges to the probability that the body of evidence is not misleading, a value typically below 1; (ii) depending on the required threshold of ‘no reasonable doubt’, it may be impossible, even in an arbitrarily large jury, to establish guilt of a defendant ‘beyond any reasonable doubt’. (shrink)

Initially, you judge that p. You then learn that most experts disagree. All things considered, you believe that the experts are probably right. Still, p continues to seem right to you, in some sense. You don’t yet see what, if anything, is wrong with your original reasoning. In such a case, we’ll say that you are ‘inclined’ toward p. This paper explores various roles that this state of inclination can play, both within epistemology and more broadly. Specifically, it will be (...) argued that: (i) inclinations can promote the accuracy of inquiring groups; (ii) they can support rational participation within philosophy despite pervasive disagreement; (iii) they allow us to make sense of an important way in which two people can continue to disagree even after they ‘conciliate’; (iv) inclinations carry information about individuals’ independent judgments and for this reason must be accounted for when updating on the opinions of others; (v) inclinations are connected to understanding in a way that belief is not; (vi) and awareness of the inclination-belief distinction enables us to respond to a provocative challenge purporting to show that critical thinking, or ‘thinking for oneself’, typically reduces expected accuracy and hence should be discouraged. (shrink)

It is no exaggeration to say that there has been an explosion of activity in the field of philosophical enquiry that is known as natural theology. Having been smothered in the early part of the twentieth century due to the dominance of the anti-metaphysical doctrine of logical positivism, natural theology began to make a comeback in the late 1950s as logical positivism collapsed and analytic philosophers took a newfound interest in metaphysical topics such as possibility and necessity, causation, time, the (...) mind-body problem, and God. This chapter begins by considering how we might characterise natural theology as a field of enquiry. It then proceeds to survey the landscape of contemporary natural theology, which has spawned a large and at times highly technical body of literature. Finally, consideration is given to two epistemological issues confronting the theist who wishes to appeal to natural theology, which could be termed the problem of the gap(s) and the problem of accessibility. (shrink)

In this article, I present a serious problem for confirmation measure Z.

What sort of evidence can confer the strongest support to a hypothesis? A natural answer is that the evidence entails the hypothesis. Roush claims that the likelihood ratio measure of degree of incremental support can deliver this intuitively natural result, and regards it as unifying “[the] account of induction and deduction in the only way that makes sense”. In this paper, we highlight a difficulty in the treatment of this case, and question the great significance that is attached to this (...) measure and its alleged capacity to accommodate the logicality requirement. We contrast the likelihood ratio measure with other measures, and argue that problems still emerge in light of tensions with plausible requirements for confirmation measures more generally. (shrink)

Testimonial evidence that is particularly helpful to confirmation combines agreement on some content with variation of detail. I examine the phenomenon of “undesigned coincidences” from a probabilistic point of view to explain how varied reports, including those that dovetail in detail, assist confirmation of an hypothesis. The formal analysis uses recent work in probability theory surrounding the concepts of dependence, independence, and varied evidence. I also discuss the connection between these types of report connections and an hypothesis about the reliability (...) of the sources involved. (shrink)

According to an influential Enlightenment ideal, one shouldn't rely epistemically on other people's say-so, at least not if one is in a position to evaluate the relevant evidence for oneself. However, in much recent work in social epistemology, we are urged to dispense with this ideal, which is seen as stemming from a misguided focus on isolated individuals to the exclusion of groups and communities. In this paper, I argue that that an emphasis on the social nature of inquiry should (...) not lead us to entirely abandon the Enlightenment ideal of epistemically autonomous agents. Specifically, I suggest that it is an appropriate ideal for those who serve as experts in a given epistemic community, and develop a notion of expert acceptance to make sense of this. I go on to show that, all other things being equal, this kind of epistemic autonomy among experts makes their joint testimony more reliable, which in turn brings epistemic benefits both to laypeople and to experts in other fields. (shrink)

Varied evidence confirms more strongly than less varied evidence, ceteris paribus. This epistemological Variety of Evidence Thesis enjoys widespread intuitive support. We put forward a novel explication of one notion of varied evidence and the Variety of Evidence Thesis within Bayesian models of scientific inference by appealing to measures of entropy. Our explication of the Variety of Evidence Thesis holds in many of our models which also pronounce on disconfirmatory and discordant evidence. We argue that our models pronounce rightly. Against (...) a backdrop of failures of the Variety of Evidence Thesis, the intuitive case for the Variety of Evidence Thesis emerges strengthened. Our models do however not support the general case for the thesis since our explication of it fails to hold in certain cases. The parameter space of this failure is explored and an explanation for the failure is offered. (shrink)

Robustness arguments hold that hypotheses are more likely to be true when they are confirmed by diverse kinds of evidence. Robustness arguments require the confirming evidence to be independent. We identify two kinds of independence appealed to in robustness arguments: ontic independence —when the multiple lines of evidence depend on different materials, assumptions, or theories—and probabilistic independence. Many assume that OI is sufficient for a robustness argument to be warranted. However, we argue that, as typically construed, OI is not a (...) sufficient independence condition for warranting robustness arguments. We show that OI evidence can collectively confirm a hypothesis to a lower degree than individual lines of evidence, contrary to the standard assumption undergirding usual robustness arguments. We employ Bayesian networks to represent the ideal empirical scenario for a robustness argument and a variety of ways in which empirical scenarios can fall short of this ideal. (shrink)

I propose a measure of dependence that relates a set of items of evidence to an hypothesis H and to H's negation. I dub this measure relative consilience and propose a method for using it as a correction factor for dependence among items of evidence. Using RC, I examine collusion and testimonial independence, the value of diverse evidence, and the strengthening of otherwise weak or non-existent cases. RC provides a valuable tool for formal epistemologists interested in analyzing cumulative case arguments.

Our epistemic access to the past is infamously patchy: historical information degrades and disappears and bygone eras are often beyond the reach of repeatable experiments. However, historical scientists have been remarkably successful at uncovering and explaining the past. I argue that part of this success is explained by the exploitation of dependencies between historical events, entities, and processes. For instance, if sauropod dinosaurs were hot blooded, they must have been gluttons; the high-energy demands of endothermy restrict sauropod grazing strategies. Understanding (...) such dependencies extends our reach into the past in spite of incomplete data. In addition, this serves as a counterexample to two accounts of method in the historical sciences. By one, historical science proceeds by identifying ‘smoking guns’: traces that discriminate between live hypotheses. By the other, historical hypotheses are supported by consilience: the convergence of independent lines of evidence. However, testing for ‘coherency’ between past hypotheses also plays a critical role in historical confirmation. Just as historical scientists exploit dependencies between past entities and present entities to infer what the past was like, they also exploit dependencies between past entities themselves. I do not suggest that archetypical historical science proceeds in this manner. Rather, the lesson I draw is that historical methodology cannot be characterized as archetypically relying on one method or another. Historical science is at base opportunistic, and is resistant to unitary analyses. 1 Introduction2 Snowballs and Explosions: The Basic Idea3 Were Sauropods Endothermic?4 Dependent Entities and Interdependent Explanations5 Smoking Guns and Consilience. (shrink)

When scientists seek further confirmation of their results, they often attempt to duplicate the results using diverse means. To the extent that they are successful in doing so, their results are said to be robust. This paper investigates the logic of such "robustness analysis" [RA]. The most important and challenging question an account of RA can answer is what sense of evidential diversity is involved in RAs. I argue that prevailing formal explications of such diversity are unsatisfactory. I propose a (...) unified, explanatory account of diversity in RAs. The resulting account is, I argue, truer to actual cases of RA in science; moreover, this account affords us a helpful, new foothold on the logic undergirding RAs. (shrink)

In robustness analysis, hypotheses are supported to the extent that a result proves robust, and a result is robust to the extent that we detect it in diverse ways. But what precise sense of diversity is at work here? In this paper, I show that the formal explications of evidential diversity most often appealed to in work on robustness – which all draw in one way or another on probabilistic independence – fail to shed light on the notion of diversity (...) relevant to robustness analysis. I close by briefly outlining a promising alternative approach inspired by Horwich’s (1982) eliminative account of evidential diversity. (shrink)

Social scientists use many different methods, and there are often substantial disagreements about which method is appropriate for a given research question. In response to this uncertainty about the relative merits of different methods, W. E. B. Du Bois advocated for and applied “methodological triangulation”. This is to use multiple methods simultaneously in the belief that, where one is uncertain about the reliability of any given method, if multiple methods yield the same answer that answer is confirmed more strongly than (...) it could have been by any single method. Against this, methodological purists believe that one should choose a single appropriate method and stick with it. Using tools from voting theory, we show Du Boisian methodological triangulation to be more likely to yield the correct answer than purism, assuming the scientist is subject to some degree of diffidence about the relative merits of the various methods. This holds even when in fact only one of the methods is appropriate for the given research question. (shrink)

Weight of evidence continues to be a powerful metaphor within formal approaches to epistemology. But attempts to construe the metaphor in precise and useful ways have encountered formidable obstacles. This paper shows that two quite different understandings of evidential weight can be traced back to one 1878 article by C.S. Peirce. One conception, often associated with I.J. Good, measures the balance or net weight of evidence, while the other, generally associated with J.M. Keynes, measures the gross weight of evidence. Conflations (...) of these two notions have contributed to misunderstandings in the literature on weight. This paper shows why Peirce developed each conception of weight, why he distinguished them, and why they are easily mistaken for one another. (shrink)

Robustness is often presented as a guideline for distinguishing the true or real from mere appearances or artifacts. Most of recent discussions of robustness have focused on the kind of derivational robustness analysis introduced by Levins, while the related but distinct idea of robustness as multiple accessibility, defended by Wimsatt, has received less attention. In this paper, I argue that the latter kind of robustness, when properly understood, can provide justification for ontological commitments. The idea is that we are justified (...) in believing that things studied by science are real insofar as we have robust evidence for them. I develop and analyze this idea in detail, and based on concrete examples show that it plays an important role in science. Finally, I demonstrate how robustness can be used to clarify the debate on scientific realism and to formulate new arguments. (shrink)

Is evidential support transitive? The answer is negative when evidential support is understood as confirmation so that X evidentially supports Y if and only if p(Y | X) > p(Y). I call evidential support so understood “support” (for short) and set out three alternative ways of understanding evidential support: support-t (support plus a sufficiently high probability), support-t* (support plus a substantial degree of support), and support-tt* (support plus both a sufficiently high probability and a substantial degree of support). I also (...) set out two screening-off conditions (under which support is transitive): SOC1 and SOC2. It has already been shown that support-t is non-transitive in the general case (where it is not required that SOC1 holds and it is not required that SOC2 holds), in the special case where SOC1 holds, and in the special case where SOC2 holds. I introduce two rather weak adequacy conditions on support measures and argue that on any support measure meeting those conditions it follows that neither support-t* nor support-tt* is transitive in the general case, in the special case where SOC1 holds, or in the special case where SOC2 holds. I then relate some of the results to Douven’s evidential support theory of conditionals along with a few rival theories. (shrink)

In From Instrumentalism to Constructive Realism Theo Kuipers presents a theory of qualitative confirmation that is supposed to not assume the existence of quantitative probabilities. He claims that this theory is able to resolve some paradoxes in confirmation theory, including the ravens paradox. This paper shows that there are flaws in Kuipers' qualitative confirmation theory and in his application of it to the ravens paradox.

Bayes' Theorem is a simple mathematical formula used for calculating conditional probabilities. It figures prominently in subjectivist or Bayesian approaches to epistemology, statistics, and inductive logic. Subjectivists, who maintain that rational belief is governed by the laws of probability, lean heavily on conditional probabilities in their theories of evidence and their models of empirical learning. Bayes' Theorem is central to these enterprises both because it simplifies the calculation of conditional probabilities and because it clarifies significant features of subjectivist position. Indeed, (...) the Theorem's central insight — that a hypothesis is confirmed by any body of data that its truth renders probable — is the cornerstone of all subjectivist methodology. (shrink)

Disputes between advocates of Bayesians and more orthodox approaches to statistical inference presuppose that Bayesians must regard must regard stopping rules, which play an important role in orthodox statistical methods, as evidentially irrelevant.In this essay, I show that this is not the case and that the stopping rule is evidentially relevant given some Bayesian confirmation measures that have been seriously proposed. However, I show that accepting a confirmation measure of this sort comes at the cost of rejecting two useful ancillaryBayesian (...) principles. (shrink)

We claim that the process of theoretical model refinement in economics is best characterised as robustness analysis: the systematic examination of the robustness of modelling results with respect to particular modelling assumptions. We argue that this practise has epistemic value by extending William Wimsatt's account of robustness analysis as triangulation via independent means of determination. For economists robustness analysis is a crucial methodological strategy because their models are often based on idealisations and abstractions, and it is usually difficult to tell (...) which idealisations are truly harmful. (shrink)

Derivational robustness may increase the degree to which various pieces of evidence indirectly confirm a robust result. There are two ways in which this increase may come about. First, if one can show that a result is robust, and that the various individual models used to derive it also have other confirmed results, these other results may indirectly confirm the robust result. Confirmation derives from the fact that data not known to bear on a result are shown to be relevant (...) when it is shown to be robust. Second, robustness may increase the degree to which the robust result is indirectly confirmed if it increases the weight with which existing evidence indirectly confirms it. This may happen when it strengthens the connection between the core and the robust result by showing that auxiliaries are not responsible for the result. (shrink)

The likelihood principle (LP) is a core issue in disagreements between Bayesian and frequentist statistical theories. Yet statements of the LP are often ambiguous, while arguments for why a Bayesian must accept it rely upon unexamined implicit premises. I distinguish two propositions associated with the LP, which I label LP1 and LP2. I maintain that there is a compelling Bayesian argument for LP1, based upon strict conditionalization, standard Bayesian decision theory, and a proposition I call the practical relevance principle. In (...) contrast, I argue that there is no similarly compelling argument for or against LP2. I suggest that these conclusions lead to a restrictedly pluralistic view of Bayesian confirmation measures. (shrink)

This paper raises a principled objection against the idea that Bayesian confirmation theory can be used to explain the conjunction fallacy. The paper demonstrates that confirmation-based explanations are limited in scope and can only be applied to cases of the fallacy of a certain restricted kind. In particular; confirmation-based explanations cannot account for the inverse conjunction fallacy, a more recently discovered form of the conjunction fallacy. Once the problem has been set out, the paper explores four different ways for the (...) confirmation theorist to come to terms with the problem, and argues that none of them are successful. (shrink)

Robustness concepts are often invoked to manage two obstacles confronting models of ecological systems: complexity and uncertainty. The intuitive idea is that any result derived from many idealized but credible models is thereby made more reliable or is better confirmed. An appropriate basis for this inference has proven elusive. Here, several representations of robustness analysis are vetted, paying particular attention to complex models of ecosystems and the global climate. The claim that robustness is itself confirmatory because robustness analysis employs a (...) Bayesian variety-of-evidence argument is criticized, but recent overwhelming pessimism about robustness may have a silver lining. (shrink)

One of the hallmark themes of Karl Popper’s approach to the social sciences was the insistence that when social scientists are members of the society they study, then they are liable to affect that society. In particular, they are liable to affect it in such a way that the claims they make lose their validity. “The interaction between the scientist’s pronouncements and social life almost invariably creates situations in which we have not only to consider the truth of such pronouncements, (...) but also their actual influence on future developments. The social scientist may be striving to find the truth; but, at the same time, he must always be exerting a definite influence upon society. The very fact that his pronouncements do exert an influence destroys their objectivity.” (Popper 1963. (shrink)

Consider the hypothesis H that a defendant is guilty, and the evidence E that a majority of h out of n independent jurors have voted for H and a minority of k:=n-h against H. How likely is the majority verdict to be correct? By a formula of Condorcet, the probability that H is true given E depends only on each juror's competence and on the absolute margin between the majority and the minority h-k, but neither on the number n, nor (...) on the proportion h/n. This paper reassesses that result and explores its implications. First, using the classical Condorcet jury model, I derive a more general version of Condorcet's formula, confirming the significance of the absolute margin, but showing that the probability that H is true given E depends also on an additional parameter: the prior probability that H is true. Second, I show that a related result holds when we consider not the degree of belief we attach to H given E, but the degree of support E gives to H. Third, I address the implications for the definition of special majority voting, a procedure used to capture the asymmetry between false positive and false negative decisions. I argue that the standard definition of special majority voting in terms of a required proportion of the jury is epistemically questionable, and that the classical Condorcet jury model leads to an alternative definition in terms of a required absolute margin between the majority and the minority. Finally, I show that the results on the significance of the absolute margin can be resisted if the so-called assumption of symmetrical juror competence is relaxed. (shrink)

According to the variety of evidence thesis items of evidence from independent lines of investigation are more confirmatory, ceteris paribus, than, for example, replications of analogous studies. This thesis is known to fail (Bovens and Hartmann; Claveau). However, the results obtained by Bovens and Hartmann only concern instruments whose evidence is either fully random or perfectly reliable; instead, for Claveau, unreliability is modelled as deterministic bias. In both cases, the unreliable instrument delivers totally irrelevant information. We present a model that (...) formalizes both reliability and unreliability differently. Our instruments either are reliable, but affected by random error, or are biased but not deterministically so.Bovens and Hartmann’s results are counter-intuitive in that in their model a long series of consistent reports from the same instrument does not raise suspicion of ‘too-good-to-be-true’ evidence. This happens precisely because they contemplate neither the role of systematic bias, nor unavoidable random error of reliable instruments. In our model, the variety of evidence thesis fails as well, but the area of failure is considerably smaller than for Bovens and Hartmann and Claveau, and holds for (the majority of) realistic cases (that is, where biased instruments are very biased). The essential mechanism that triggers variety of evidence thesis failure is the rate of false to true positives for the two kinds of instruments. Our emphasis is on modelling beliefs about sources of knowledge and their role in hypothesis confirmation in interaction with dimensions of evidence, such as variety and consistency. (shrink)

This article examines a metaphilosophical issue, namely existing disagreements in philosophy of science about the significance of using multiple means of determination in scientific practice. We argue that this disagreement can, in part, be resolved by separating different questions that can be asked about the use of multiple means of determination, including the following: what can be concluded from the convergence of data or the convergence of claims about phenomena? Are the conclusions drawn from the convergence of data and of (...) statements about phenomena of special importance to the debate about realism and antirealism? Do inferences based on multiple means of determination have stronger epistemic force than inferences that are secured in other ways? Is the epistemic goal of deploying multiple means of determination well entrenched within the scientific community? Most of these questions can be discussed both in a formal and in an empirical perspective. If the differences in perspective are taken into account, some disagreements can be easily resolved. In part, however, the disagreements reflect historiographical challenges that are very difficult, if not impossible to meet. (shrink)

This essay addresses the methodology of philosophy of science and illustrates how formal and empirical methods can be fruitfully combined. Special emphasis is given to the application of experimental methods to confirmation theory and to recent work on the conjunction fallacy, a key topic in the rationality debate arising from research in cognitive psychology. Several other issue can be studied in this way. In the concluding section, a brief outline is provided of three further examples.

The conjunction fallacy has been a key topic in debates on the rationality of human reasoning and its limitations. Despite extensive inquiry, however, the attempt to provide a satisfactory account of the phenomenon has proved challenging. Here we elaborate the suggestion (first discussed by Sides, Osherson, Bonini, & Viale, 2002) that in standard conjunction problems the fallacious probability judgements observed experimentally are typically guided by sound assessments of _confirmation_ relations, meant in terms of contemporary Bayesian confirmation theory. Our main formal (...) result is a confirmation-theoretic account of the conjunction fallacy, which is proven _robust_ (i.e., not depending on various alternative ways of measuring degrees of confirmation). The proposed analysis is shown distinct from contentions that the conjunction effect is in fact not a fallacy, and is compared with major competing explanations of the phenomenon, including earlier references to a confirmation-theoretic account. (shrink)

Several forms of symmetry in degrees of evidential support areconsidered. Some of these symmetries are shown not to hold in general. This has implications for the adequacy of many measures of degree ofevidential support that have been proposed and defended in the philosophical literature.