It is no exaggeration to say that there has been an explosion of activity in the field of philosophical enquiry that is known as natural theology. Having been smothered in the early part of the twentieth century due to the dominance of the anti-metaphysical doctrine of logical positivism, natural theology began to make a comeback in the late 1950s as logical positivism collapsed and analytic philosophers took a newfound interest in metaphysical topics such as possibility and necessity, causation, time, the (...) mind-body problem, and God. This chapter begins by considering how we might characterise natural theology as a field of enquiry. It then proceeds to survey the landscape of contemporary natural theology, which has spawned a large and at times highly technical body of literature. Finally, consideration is given to two epistemological issues confronting the theist who wishes to appeal to natural theology, which could be termed the problem of the gap(s) and the problem of accessibility. (shrink)

Varied evidence for a hypothesis confirms it more strongly than less varied evidence, ceteris paribus. This epistemological Variety of Evidence Thesis enjoys long-standing widespread intuitive support. Recent literature has raised serious doubts that the correlational approach of explicating the thesis can vindicate it. By contrast, the eliminative approach due to Horwich vindicates the Variety of Evidence Thesis but only within a relatively narrow domain. I investigate the prospects of extending the eliminative approach to a larger domain by considering a larger (...) class of sensible explications of evidential variety. For a large subclass class of such explications I show how to construct cases in which the less diverse body of evidence for a hypothesis confirms more strongly. I hence argue that these prospects are dire since the eliminative approach widely fails to vindicate the thesis. (shrink)

How should we reason in science? Jan Sprenger and Stephan Hartmann offer a refreshing take on classical topics in philosophy of science, using a single key concept to explain and to elucidate manifold aspects of scientific reasoning. They present good arguments and good inferences as being characterized by their effect on our rational degrees of belief. Refuting the view that there is no place for subjective attitudes in 'objective science', Sprenger and Hartmann explain the value of convincing evidence in terms (...) of a cycle of variations on the theme of representing rational degrees of belief by means of subjective probabilities (and changing them by Bayesian conditionalization). In doing so, they integrate Bayesian inference—the leading theory of rationality in social science—with the practice of 21st century science. Bayesian Philosophy of Science thereby shows how modeling such attitudes improves our understanding of causes, explanations, confirming evidence, and scientific models in general. It combines a scientifically minded and mathematically sophisticated approach with conceptual analysis and attention to methodological problems of modern science, especially in statistical inference, and is therefore a valuable resource for philosophers and scientific practitioners. (shrink)

According to an influential Enlightenment ideal, one shouldn't rely epistemically on other people's say-so, at least not if one is in a position to evaluate the relevant evidence for oneself. However, in much recent work in social epistemology, we are urged to dispense with this ideal, which is seen as stemming from a misguided focus on isolated individuals to the exclusion of groups and communities. In this paper, I argue that that an emphasis on the social nature of inquiry should (...) not lead us to entirely abandon the Enlightenment ideal of epistemically autonomous agents. Specifically, I suggest that it is an appropriate ideal for those who serve as experts in a given epistemic community, and develop a notion of expert acceptance to make sense of this. I go on to show that, all other things being equal, this kind of epistemic autonomy among experts makes their joint testimony more reliable, which in turn brings epistemic benefits both to laypeople and to experts in other fields. (shrink)

Varied evidence confirms more strongly than less varied evidence, ceteris paribus. This epistemological Variety of Evidence Thesis enjoys widespread intuitive support. We put forward a novel explication of one notion of varied evidence and the Variety of Evidence Thesis within Bayesian models of scientific inference by appealing to measures of entropy. Our explication of the Variety of Evidence Thesis holds in many of our models which also pronounce on disconfirmatory and discordant evidence. We argue that our models pronounce rightly. Against (...) a backdrop of failures of the Variety of Evidence Thesis, the intuitive case for the Variety of Evidence Thesis emerges strengthened. Our models do however not support the general case for the thesis since our explication of it fails to hold in certain cases. The parameter space of this failure is explored and an explanation for the failure is offered. (shrink)

Robustness arguments hold that hypotheses are more likely to be true when they are confirmed by diverse kinds of evidence. Robustness arguments require the confirming evidence to be independent. We identify two kinds of independence appealed to in robustness arguments: ontic independence —when the multiple lines of evidence depend on different materials, assumptions, or theories—and probabilistic independence. Many assume that OI is sufficient for a robustness argument to be warranted. However, we argue that, as typically construed, OI is not a (...) sufficient independence condition for warranting robustness arguments. We show that OI evidence can collectively confirm a hypothesis to a lower degree than individual lines of evidence, contrary to the standard assumption undergirding usual robustness arguments. We employ Bayesian networks to represent the ideal empirical scenario for a robustness argument and a variety of ways in which empirical scenarios can fall short of this ideal. (shrink)

The article argues for the epistemic rationale of triangulation, namely, the use of multiple and independent sources of evidence. It claims that triangulation is to be understood as causal reasoning from data to phenomenon, and it rationalizes its epistemic value in terms of controlling for likely errors and biases of particular data-generating procedures. This perspective is employed to address objections against triangulation concerning the fallibility and scope of the inference, as well as problems of independence, incomparability, and discordance of evidence. (...) The debate on the existence of social preferences is used as an illustrative case. (shrink)

When scientists seek further confirmation of their results, they often attempt to duplicate the results using diverse means. To the extent that they are successful in doing so, their results are said to be robust. This paper investigates the logic of such "robustness analysis" [RA]. The most important and challenging question an account of RA can answer is what sense of evidential diversity is involved in RAs. I argue that prevailing formal explications of such diversity are unsatisfactory. I propose a (...) unified, explanatory account of diversity in RAs. The resulting account is, I argue, truer to actual cases of RA in science; moreover, this account affords us a helpful, new foothold on the logic undergirding RAs. (shrink)

In robustness analysis, hypotheses are supported to the extent that a result proves robust, and a result is robust to the extent that we detect it in diverse ways. But what precise sense of diversity is at work here? In this paper, I show that the formal explications of evidential diversity most often appealed to in work on robustness – which all draw in one way or another on probabilistic independence – fail to shed light on the notion of diversity (...) relevant to robustness analysis. I close by briefly outlining a promising alternative approach inspired by Horwich’s (1982) eliminative account of evidential diversity. (shrink)

Social scientists use many different methods, and there are often substantial disagreements about which method is appropriate for a given research question. In response to this uncertainty about the relative merits of different methods, W. E. B. Du Bois advocated for and applied “methodological triangulation”. This is to use multiple methods simultaneously in the belief that, where one is uncertain about the reliability of any given method, if multiple methods yield the same answer that answer is confirmed more strongly than (...) it could have been by any single method. Against this, methodological purists believe that one should choose a single appropriate method and stick with it. Using tools from voting theory, we show Du Boisian methodological triangulation to be more likely to yield the correct answer than purism, assuming the scientist is subject to some degree of diffidence about the relative merits of the various methods. This holds even when in fact only one of the methods is appropriate for the given research question. (shrink)

Weight of evidence continues to be a powerful metaphor within formal approaches to epistemology. But attempts to construe the metaphor in precise and useful ways have encountered formidable obstacles. This paper shows that two quite different understandings of evidential weight can be traced back to one 1878 article by C.S. Peirce. One conception, often associated with I.J. Good, measures the balance or net weight of evidence, while the other, generally associated with J.M. Keynes, measures the gross weight of evidence. Conflations (...) of these two notions have contributed to misunderstandings in the literature on weight. This paper shows why Peirce developed each conception of weight, why he distinguished them, and why they are easily mistaken for one another. (shrink)

Robustness is often presented as a guideline for distinguishing the true or real from mere appearances or artifacts. Most of recent discussions of robustness have focused on the kind of derivational robustness analysis introduced by Levins, while the related but distinct idea of robustness as multiple accessibility, defended by Wimsatt, has received less attention. In this paper, I argue that the latter kind of robustness, when properly understood, can provide justification for ontological commitments. The idea is that we are justified (...) in believing that things studied by science are real insofar as we have robust evidence for them. I develop and analyze this idea in detail, and based on concrete examples show that it plays an important role in science. Finally, I demonstrate how robustness can be used to clarify the debate on scientific realism and to formulate new arguments. (shrink)

Agreement between "independent" measurements of a theoretically posited quantity is intuitively compelling evidence that a theory is, loosely speaking, on the right track. But exactly what conclusion is warranted by such agreement? I propose a new account of the phenomenon's epistemic significance within the framework of Bayesian epistemology. I contrast my proposal with the standard Bayesian treatment, which lumps the phenomenon under the heading of "evidential diversity".

The variety-of-evidence thesis has been criticized by Bovens and Hartmann. This article points to two limitations of their Bayesian model: the conceptualization of unreliable evidential sources as randomizing and the restriction to comparing full independence to full dependence. It is shown that the variety-of-evidence thesis is rehabilitated when unreliable sources are reconceptualized as systematically biased. However, it turns out that allowing for degrees of independence leads to a qualification of the variety-of-evidence thesis: as Bovens and Hartmann claimed, more independence does (...) not always imply stronger confirmation. (shrink)

Among Bayesian confirmation theorists, several quantitative measures of the degree to which an evidential proposition E confirms a hypothesis H have been proposed. According to one popular recent measure, s, the degree to which E confirms H is a function of the equation P(H|E) − P(H|~E). A consequence of s is that when we have two evidential propositions, E1 and E2, such that P(H|E1) = P(H|E2), and P(H|~E1) ≠ P(H|~E2), the confirmation afforded to H by E1 does not equal the (...) confirmation afforded to H by E2. I present several examples that demonstrate the unacceptability of this result, and conclude that we should reject s (and other measures that share this feature) as a measure of confirmation. (shrink)

Recent philosophical attention to climate models has highlighted their weaknesses and uncertainties. Here I address the ways that models gain support through observational data. I review examples of model fit, variety of evidence, and independent support for aspects of the models, contrasting my analysis with that of other philosophers. I also investigate model robustness, which often emerges when comparing climate models simulating the same time period or set of conditions. Starting from Michael Weisberg’s analysis of robustness, I conclude that his (...) approach involves a version of reasoning from variety of evidence, enabling this robustness to be a confirmatory virtue.. (shrink)

Starting from the sixties of the past century theory change has become a main concern of philosophy of science. Two of the best known formal accounts of theory change are the post-Popperian theories of verisimilitude (PPV for short) and the AGM theory of belief change (AGM for short). In this paper, we will investigate the conceptual relations between PPV and AGM and, in particular, we will ask whether the AGM rules for theory change are effective means for approaching the truth, (...) i.e., for achieving the cognitive aim of science pointed out by PPV. First, the key ideas of PPV and AGM and their application to a particular kind of propositional theories - the so called "conjunctive propositions" - will be illustrated. Afterwards, we will prove that, as far as conjunctive propositions are concerned, AGM belief change is an effective tool for approaching the truth. (shrink)

The conjunction fallacy has been a key topic in debates on the rationality of human reasoning and its limitations. Despite extensive inquiry, however, the attempt of providing a satisfactory account of the phenomenon has proven challenging. Here, we elaborate the suggestion (first discussed by Sides et al., 2001) that in standard conjunction problems the fallacious probability judgments experimentally observed are typically guided by sound assessments of confirmation relations, meant in terms of contemporary Bayesian confirmation theory. Our main formal result is (...) a confirmation-theoretic account of the conjuntion fallacy which is proven robust (i.e., not depending on various alternative ways of measuring degrees of confirmation). The proposed analysis is shown distinct from contentions that the conjunction effect is in fact not a fallacy and is compared with major competing explanations of the phenomenon, including earlier references to a confirmation-theoretic account. (shrink)

If a group is modelled as a single Bayesian agent, what should its beliefs be? I propose an axiomatic model that connects group beliefs to beliefs of group members, who are themselves modelled as Bayesian agents, possibly with different priors and different information. Group beliefs are proven to take a simple multiplicative form if people’s information is independent, and a more complex form if information overlaps arbitrarily. This shows that group beliefs can incorporate all information spread over the individuals without (...) the individuals having to communicate their (possibly complex and hard-to-describe) private information; communicating prior and posterior beliefs sufices. JEL classification: D70, D71.. (shrink)

In From Instrumentalism to Constructive Realism Theo Kuipers presents a theory of qualitative confirmation that is supposed to not assume the existence of quantitative probabilities. He claims that this theory is able to resolve some paradoxes in confirmation theory, including the ravens paradox. This paper shows that there are flaws in Kuipers' qualitative confirmation theory and in his application of it to the ravens paradox.

Bayes' Theorem is a simple mathematical formula used for calculating conditional probabilities. It figures prominently in subjectivist or Bayesian approaches to epistemology, statistics, and inductive logic. Subjectivists, who maintain that rational belief is governed by the laws of probability, lean heavily on conditional probabilities in their theories of evidence and their models of empirical learning. Bayes' Theorem is central to these enterprises both because it simplifies the calculation of conditional probabilities and because it clarifies significant features of subjectivist position. Indeed, (...) the Theorem's central insight — that a hypothesis is confirmed by any body of data that its truth renders probable — is the cornerstone of all subjectivist methodology. (shrink)

Philosophically, one of the most important questions in the enterprise termed confirmation theory is this: Why should one stick to well confirmed theories rather than to any other theories? This paper discusses the answers to this question one gets from absolute and incremental Bayesian confirmation theory. According to absolute confirmation, one should accept ''absolutely well confirmed'' theories, because absolute confirmation takes one to true theories. An examination of two popular measures of incremental confirmation suggests the view that one should stick (...) to incrementally well confirmed theories, because incremental confirmation takes one to (the most) informative (among all) true theories. However, incremental confirmation does not further this goal in general. I close by presenting a necessary and sufficient condition for revealing the confirmational structure in almost every world when presented separating data. (shrink)

In this paper, we identify a new and mathematically well-defined sense in which the coherence of a set of hypotheses can be truth-conducive. Our focus is not, as usual, on the probability but on the confirmation of a coherent set and its members. We show that, if evidence confirms a hypothesis, confirmation is “transmitted” to any hypotheses that are sufficiently coherent with the former hypothesis, according to some appropriate probabilistic coherence measure such as Olsson’s or Fitelson’s measure. Our findings have (...) implications for scientific methodology, as they provide a formal rationale for the method of indirect confirmation and the method of confirming theories by confirming their parts. (shrink)

The conjunction fallacy has been a key topic in debates on the rationality of human reasoning and its limitations. Despite extensive inquiry, however, the attempt to provide a satisfactory account of the phenomenon has proved challenging. Here we elaborate the suggestion (first discussed by Sides, Osherson, Bonini, & Viale, 2002) that in standard conjunction problems the fallacious probability judgements observed experimentally are typically guided by sound assessments of _confirmation_ relations, meant in terms of contemporary Bayesian confirmation theory. Our main formal (...) result is a confirmation-theoretic account of the conjunction fallacy, which is proven _robust_ (i.e., not depending on various alternative ways of measuring degrees of confirmation). The proposed analysis is shown distinct from contentions that the conjunction effect is in fact not a fallacy, and is compared with major competing explanations of the phenomenon, including earlier references to a confirmation-theoretic account. (shrink)

According to Hempel's paradox, evidence (E) that an object is a nonblack nonraven confirms the hypothesis (H) that every raven is black. According to the standard Bayesian solution, E does confirm H but only to a minute degree. This solution relies on the almost never explicitly defended assumption that the probability of H should not be affected by evidence that an object is nonblack. I argue that this assumption is implausible, and I propose a way out for Bayesians. Introduction Hempel's (...) paradox, the standard Bayesian solution, and the disputed assumption Attempts to defend the disputed assumption Attempts to refute the disputed assumption A way out for Bayesians Conclusion. (shrink)

Several forms of symmetry in degrees of evidential support areconsidered. Some of these symmetries are shown not to hold in general. This has implications for the adequacy of many measures of degree ofevidential support that have been proposed and defended in the philosophical literature.

On analogy with testimony, I define a notion of a scientific theory’s lacking or having candor, in a testing situation, according to whether the theory under test is probabilistically relevant to the processes in the test procedures, and thereby to the reliability of test outcomes. I argue that this property identifies what is distinctive about those theories that Karl Popper denounced as exhibiting “reinforced dogmatism” through their self-protective behavior (e.g., psychoanalysis, Hegelianism, Marxism). I explore whether lack of candor interferes with (...) the testing of theories, and conclude that (1) our default attitude toward theories that lack candor in a given test should be suspicion, but (2) the circumstance that a theory lacks candor in a testing situation does not preclude obtaining independent evidence for the auxiliary assumptions to which the theory is probabilistically relevant, and thereby eliminating the problem that lack of candor creates. Thus, Popper was right to think that lack of candor is a bad thing, but wrong to conclude that candor is a criterion of the scientificity of a theory. Seeing this requires recognition of some differences between intuitive relevance and probabilistic relevance, and proper appreciation of the notion of screening off and of the fact that probabilistic relevance is not transitive. (shrink)

(new version: 10/30/07). Click here to download the companion Mathematica 6 notebook that goes along with this paper.

Under the independence and competence assumptions of Condorcet’s classical jury model, the probability of a correct majority decision converges to certainty as the jury size increases, a seemingly unrealistic result. Using Bayesian networks, we argue that the model’s independence assumption requires that the state of the world (guilty or not guilty) is the latest common cause of all jurors’ votes. But often – arguably in all courtroom cases and in many expert panels – the latest such common cause is a (...) shared ‘body of evidence’ observed by the jurors. In the corresponding Bayesian network, the votes are direct descendants not of the state of the world, but of the body of evidence, which in turn is a direct descendant of the state of the world. We develop a model of jury decisions based on this Bayesian network. Our model permits the possibility of misleading evidence, even for a maximally competent observer, which cannot easily be accommodated in the classical model. We prove that (i) the probability of a correct majority verdict converges to the probability that the body of evidence is not misleading, a value typically below 1; (ii) depending on the required threshold of ‘no reasonable doubt’, it may be impossible, even in an arbitrarily large jury, to establish guilt of a defendant ‘beyond any reasonable doubt’. (shrink)

In this article, I present a serious problem for confirmation measure Z.

According to the variety of evidence thesis items of evidence from independent lines of investigation are more confirmatory, ceteris paribus, than, for example, replications of analogous studies. This thesis is known to fail (Bovens and Hartmann; Claveau). However, the results obtained by Bovens and Hartmann only concern instruments whose evidence is either fully random or perfectly reliable; instead, for Claveau, unreliability is modelled as deterministic bias. In both cases, the unreliable instrument delivers totally irrelevant information. We present a model that (...) formalizes both reliability and unreliability differently. Our instruments either are reliable, but affected by random error, or are biased but not deterministically so.Bovens and Hartmann’s results are counter-intuitive in that in their model a long series of consistent reports from the same instrument does not raise suspicion of ‘too-good-to-be-true’ evidence. This happens precisely because they contemplate neither the role of systematic bias, nor unavoidable random error of reliable instruments. In our model, the variety of evidence thesis fails as well, but the area of failure is considerably smaller than for Bovens and Hartmann and Claveau, and holds for (the majority of) realistic cases (that is, where biased instruments are very biased). The essential mechanism that triggers variety of evidence thesis failure is the rate of false to true positives for the two kinds of instruments. Our emphasis is on modelling beliefs about sources of knowledge and their role in hypothesis confirmation in interaction with dimensions of evidence, such as variety and consistency. (shrink)

Testimonial evidence that is particularly helpful to confirmation combines agreement on some content with variation of detail. I examine the phenomenon of “undesigned coincidences” from a probabilistic point of view to explain how varied reports, including those that dovetail in detail, assist confirmation of an hypothesis. The formal analysis uses recent work in probability theory surrounding the concepts of dependence, independence, and varied evidence. I also discuss the connection between these types of report connections and an hypothesis about the reliability (...) of the sources involved. (shrink)

Pluralism about scientific method is more-or-less accepted, but the consequences have yet to be drawn out. Scientists adopt different methods in response to different epistemic situations: depending on the system they are interested in, the resources at their disposal, and so forth. If it is right that different methods are appropriate in different situations, then mismatches between methods and situations are possible. This is most likely to occur due to method bias: when we prefer a particular kind of method, despite (...) that method clashing with evidential context or our aims. To explore these ideas, we sketch a kind of method pluralism which turns on two properties of evidence, before using agent-based models to examine the relationship between methods, epistemic situations, and bias. Based on our results, we suggest that although method bias can undermine the efficiency of a scientific community, it can also be productive through preserving a diversity of evidence. We consider circumstances where method bias could be particularly egregious, and those where it is a potential virtue, and argue that consideration of method bias reveals that community standards deserve a central place in the epistemology of science. (shrink)

Derivational robustness may increase the degree to which various pieces of evidence indirectly confirm a robust result. There are two ways in which this increase may come about. First, if one can show that a result is robust, and that the various individual models used to derive it also have other confirmed results, these other results may indirectly confirm the robust result. Confirmation derives from the fact that data not known to bear on a result are shown to be relevant (...) when it is shown to be robust. Second, robustness may increase the degree to which the robust result is indirectly confirmed if it increases the weight with which existing evidence indirectly confirms it. This may happen when it strengthens the connection between the core and the robust result by showing that auxiliaries are not responsible for the result. (shrink)

Our epistemic access to the past is infamously patchy: historical information degrades and disappears and bygone eras are often beyond the reach of repeatable experiments. However, historical scientists have been remarkably successful at uncovering and explaining the past. I argue that part of this success is explained by the exploitation of dependencies between historical events, entities, and processes. For instance, if sauropod dinosaurs were hot blooded, they must have been gluttons; the high-energy demands of endothermy restrict sauropod grazing strategies. Understanding (...) such dependencies extends our reach into the past in spite of incomplete data. In addition, this serves as a counterexample to two accounts of method in the historical sciences. By one, historical science proceeds by identifying ‘smoking guns’: traces that discriminate between live hypotheses. By the other, historical hypotheses are supported by consilience: the convergence of independent lines of evidence. However, testing for ‘coherency’ between past hypotheses also plays a critical role in historical confirmation. Just as historical scientists exploit dependencies between past entities and present entities to infer what the past was like, they also exploit dependencies between past entities themselves. I do not suggest that archetypical historical science proceeds in this manner. Rather, the lesson I draw is that historical methodology cannot be characterized as archetypically relying on one method or another. Historical science is at base opportunistic, and is resistant to unitary analyses. 1 Introduction2 Snowballs and Explosions: The Basic Idea3 Were Sauropods Endothermic?4 Dependent Entities and Interdependent Explanations5 Smoking Guns and Consilience. (shrink)

The likelihood principle (LP) is a core issue in disagreements between Bayesian and frequentist statistical theories. Yet statements of the LP are often ambiguous, while arguments for why a Bayesian must accept it rely upon unexamined implicit premises. I distinguish two propositions associated with the LP, which I label LP1 and LP2. I maintain that there is a compelling Bayesian argument for LP1, based upon strict conditionalization, standard Bayesian decision theory, and a proposition I call the practical relevance principle. In (...) contrast, I argue that there is no similarly compelling argument for or against LP2. I suggest that these conclusions lead to a restrictedly pluralistic view of Bayesian confirmation measures. (shrink)

Is evidential support transitive? The answer is negative when evidential support is understood as confirmation so that X evidentially supports Y if and only if p(Y | X) > p(Y). I call evidential support so understood “support” (for short) and set out three alternative ways of understanding evidential support: support-t (support plus a sufficiently high probability), support-t* (support plus a substantial degree of support), and support-tt* (support plus both a sufficiently high probability and a substantial degree of support). I also (...) set out two screening-off conditions (under which support is transitive): SOC1 and SOC2. It has already been shown that support-t is non-transitive in the general case (where it is not required that SOC1 holds and it is not required that SOC2 holds), in the special case where SOC1 holds, and in the special case where SOC2 holds. I introduce two rather weak adequacy conditions on support measures and argue that on any support measure meeting those conditions it follows that neither support-t* nor support-tt* is transitive in the general case, in the special case where SOC1 holds, or in the special case where SOC2 holds. I then relate some of the results to Douven’s evidential support theory of conditionals along with a few rival theories. (shrink)

I shall offer some very plausible assumptions for the measure of confirmation and show that they imply that E confirms H relative to background K to degree f/PK), where f is a strictly increasing function. An additional assumption about how measures of confirmation combine then makes f be proportional to a logarithm.

One of the hallmark themes of Karl Popper’s approach to the social sciences was the insistence that when social scientists are members of the society they study, then they are liable to affect that society. In particular, they are liable to affect it in such a way that the claims they make lose their validity. “The interaction between the scientist’s pronouncements and social life almost invariably creates situations in which we have not only to consider the truth of such pronouncements, (...) but also their actual influence on future developments. The social scientist may be striving to find the truth; but, at the same time, he must always be exerting a definite influence upon society. The very fact that his pronouncements do exert an influence destroys their objectivity.” (Popper 1963. (shrink)

Robustness concepts are often invoked to manage two obstacles confronting models of ecological systems: complexity and uncertainty. The intuitive idea is that any result derived from many idealized but credible models is thereby made more reliable or is better confirmed. An appropriate basis for this inference has proven elusive. Here, several representations of robustness analysis are vetted, paying particular attention to complex models of ecosystems and the global climate. The claim that robustness is itself confirmatory because robustness analysis employs a (...) Bayesian variety-of-evidence argument is criticized, but recent overwhelming pessimism about robustness may have a silver lining. (shrink)

In the recent literature on confirmation there are two leading approaches to the provision of a probabilistic measure of the degree to which a hypothesis is confirmed by evidence. The first is to construe the degree to which evidence E confirms hypothesis H as a function that is directly proportional to p and inversely proportional to p . I shall refer to this as the probability approach. The second approach construes the notion as a function that is directly proportional to (...) the true-positive rate – the probability of the evidence if the hypothesis is true, p – and inversely proportional to the false-positive rate – the probability of the evidence if the hypothesis is false, p . These reverse conditional probabilities – of the evidence on the truth or falsehood of the hypothesis – are sometimes known as likelihoods. I shall refer to the approach to confirmation that uses them as the likelihood approach.For each of these approaches, there are two obvious options as to how to define the confirmation function. The first is to define it as the difference between the magnitude that is treated as increasing confirmation or p ) and the magnitude that is treated as decreasing confirmation or p ). The second is to define confirmation as the quotient of these two magnitudes.This yields four different measures of confirmation, represented in the following table: Differences RatiosProbabilities PD = p – p1 PR = Graphic2Likelihoods LD = p – p3 LR = Graphic4All these measures agree on whether or not E provides some support for H. Intuitively, we want to say that E provides some support for H just in case learning that E is true would make us assign a higher probability to H, i.e. when p(H …. (shrink)

Today's climate models are supported in a couple of ways that receive little attention from philosophers or climate scientists. In addition to standard 'model fit', wherein a model's simulation is compared to observational data, there is an additional type of confirmation available through the variety of instances of model fit. When a model performs well at fitting first one variable and then another, the probability of the model under some standard confirmation function, say, likelihood, goes up more than under each (...) individual case of fit alone. Thus, two instances of fit of distinct variables of a global climate model using distinct data sets considered collectively will provide stronger evidence for a model than either one of the instances considered individually. This has consequences for model robustness. Sets of models that produce robust results will, if their assumptions vary enough and they each are observationally sound, provide reasons to endorse common structures found in those models. Finally, independent empirical support for aspects and assumptions of the model provides an additional confirmational virtue for climate models, contrary to what is implied by some current philosophical writing on this topic. (shrink)

Crupi et al. (2008) offer a confirmation-theoretic, Bayesian account of the conjunction fallacy—an error in reasoning that occurs when subjects judge that Pr( h 1 & h 2 | e ) > Pr( h 1 | e ). They introduce three formal conditions that are satisfied by classical conjunction fallacy cases, and they show that these same conditions imply that h 1 & h 2 is confirmed by e to a greater extent than is h 1 alone. Consequently, they suggest (...) that people are tracking this confirmation relation when they commit conjunction fallacies. I offer three experiments testing the merits of Crupi et al.’s account specifically and confirmation-theoretic accounts of the conjunction fallacy more generally. The results of Experiment 1 show that, although Crupi et al.’s conditions do seem to be causally linked to the conjunction fallacy, they are not necessary for it; there exist cases that do not meet their three conditions in which subjects still tend to commit the fallacy. The results of Experiments 2 and 3 show that Crupi et al.’s conditions, and those offered by other confirmation-theoretic accounts of the fallacy, are not sufficient for the fallacy either; there exist cases that meet all three of CFT’s conditions in which subjects do not tend to commit the fallacy. Additionally, these latter experiments show that such confirmation-theoretic conditions are at best only weakly causally relevant to the presence of the conjunction fallacy. Given these findings, CFT’s account specifically, and any general confirmation-theoretic account more broadly, falls short of offering a satisfying explanation of the presence of the conjunction fallacy. (shrink)

All economic models involve abstractions and idealisations. Economic theory itself does not tell which idealizations are truly fatal or harmful for the result and which are not. This is why much of what is seen as theoretical contribution in economics is constituted by deriving familiar results from different modelling assumptions. If a modelling result is robust with respect to particular modelling assumptions, the empirical falsity of these particular assumptions does not provide grounds for criticizing the result. In this paper we (...) demonstrate how derivational robustness analysis does carry epistemic weight and answer criticism concerning its non-empirical nature and the problematic form of the required independence of the ways of derivation. The epistemic rationale and importance of robustness analysis also challenge some common conceptions of the role of theory in economics. (shrink)

Disputes between advocates of Bayesians and more orthodox approaches to statistical inference presuppose that Bayesians must regard must regard stopping rules, which play an important role in orthodox statistical methods, as evidentially irrelevant.In this essay, I show that this is not the case and that the stopping rule is evidentially relevant given some Bayesian confirmation measures that have been seriously proposed. However, I show that accepting a confirmation measure of this sort comes at the cost of rejecting two useful ancillaryBayesian (...) principles. (shrink)

Here I critically assess an argument put forward by Kuorikoski et al. (Br J Philos Sci, 61(3):541–567, 2010) for the epistemic import of model-based robustness analysis. I show that this argument is not sound since the sort of probabilistic independence on which it relies is unfeasible. By revising the notion of probabilistic independence imposed on the models’ results, I introduce a prima-facie more plausible argument. However, despite this prima-facie plausibility, I show that even this new argument is unsound in most (...) if not all cases of model-based robustness analysis. This I do to demonstrate that the epistemic import of model-based robust analysis cannot be satisfactorily defended on the basis of probabilistic independence. (shrink)

This paper deals with the evidential value of neuroeconomic experiments for the triangulation of economically relevant phenomena. We examine the case of social preferences, which involves bringing together evidence from behavioural experiments, neuroeconomic experiments, and observational studies from other social sciences. We present an account of triangulation and identify the conditions under which neuroeconomic evidence is diverse in the way required for successful triangulation. We also show that the successful triangulation of phenomena does not necessarily afford additional confirmation to general (...) theories about those phenomena. (shrink)