We model scientific theories as Bayesian networks. Nodes carry credences and function as abstract representations of propositions within the structure. Directed links carry conditional probabilities and represent connections between those propositions. Updating is Bayesian across the network as a whole. The impact of evidence at one point within a scientific theory can have a very different impact on the network than does evidence of the same strength at a different point. A Bayesian model allows us to envisage and analyze the (...) differential impact of evidence and credence change at different points within a single network and across different theoretical structures. (shrink)

The Bayesian maxim for rational learning could be described as conservative change from one probabilistic belief or credence function to another in response to newinformation. Roughly: ‘Hold fixed any credences that are not directly affected by the learning experience.’ This is precisely articulated for the case when we learn that some proposition that we had previously entertained is indeed true (the rule of conditionalisation). But can this conservative-change maxim be extended to revising one’s credences in response to entertaining propositions or (...) concepts of which one was previously unaware? The economists Karni and Vierø (2013, 2015) make a proposal in this spirit. Philosophers have adopted effectively the same rule: revision in response to growing awareness should not affect the relative probabilities of propositions in one’s ‘old’ epistemic state. The rule is compelling, but only under the assumptions that its advocates introduce. It is not a general requirement of rationality, or so we argue. We provide informal counterexamples. And we show that, when awareness grows, the boundary between one’s ‘old’ and ‘new’ epistemic commitments is blurred. Accordingly, there is no general notion of conservative change in this setting. (shrink)

The epistemic probability of A given B is the degree to which B evidentially supports A, or makes A plausible. This paper is a first step in answering the question of what determines the values of epistemic probabilities. I break this question into two parts: the structural question and the substantive question. Just as an object’s weight is determined by its mass and gravitational acceleration, some probabilities are determined by other, more basic ones. The structural question asks what probabilities are (...) not determined in this way—these are the basic probabilities which determine values for all other probabilities. The substantive question asks how the values of these basic probabilities are determined. I defend an answer to the structural question on which basic probabilities are the probabilities of atomic propositions conditional on potential direct explanations. I defend this against the view, implicit in orthodox mathematical treatments of probability, that basic probabilities are the unconditional probabilities of complete worlds. I then apply my answer to the structural question to clear up common confusions in expositions of Bayesianism and shed light on the “problem of the priors.”. (shrink)

How should we reason in science? Jan Sprenger and Stephan Hartmann offer a refreshing take on classical topics in philosophy of science, using a single key concept to explain and to elucidate manifold aspects of scientific reasoning. They present good arguments and good inferences as being characterized by their effect on our rational degrees of belief. Refuting the view that there is no place for subjective attitudes in 'objective science', Sprenger and Hartmann explain the value of convincing evidence in terms (...) of a cycle of variations on the theme of representing rational degrees of belief by means of subjective probabilities (and changing them by Bayesian conditionalization). In doing so, they integrate Bayesian inference—the leading theory of rationality in social science—with the practice of 21st century science. Bayesian Philosophy of Science thereby shows how modeling such attitudes improves our understanding of causes, explanations, confirming evidence, and scientific models in general. It combines a scientifically minded and mathematically sophisticated approach with conceptual analysis and attention to methodological problems of modern science, especially in statistical inference, and is therefore a valuable resource for philosophers and scientific practitioners. (shrink)

Bayesians often assume, suppose, or conjecture that for any reasonable explication of the notion of simplicity a prior can be designed that will enforce a preference for hypotheses simpler in just that sense. Further, it is often claimed that the Bayesian framework automatically implements Occam's razor—that conditionalizing on data consistent with both a simple theory and a complex theory more or less inevitably favours the simpler theory. But it is shown here that there are simplicity-driven approaches to curve-fitting problems that (...) cannot be captured within the orthodox Bayesian framework and that the automatic razor does not function for such problems. (shrink)

Most philosophers agree that abduction (in the sense of Inference to the Best Explanation) is a type of inference that is frequently employed, in some form or other, both in everyday and in scientific reasoning. However, the exact form as well as the normative status of abduction are still matters of controversy. This entry contrasts abduction with other types of inference; points at prominent uses of it, both in and outside philosophy; considers various more or less precise statements of it; (...) discusses its normative status; and highlights possible connections between abduction and Bayesian confirmation theory. (shrink)

This article examines the effect of material evidence upon historiographic hypotheses. Through a series of successive Bayesian conditionalizations, I analyze the extended competition among several hypotheses that offered different accounts of the transition between the Bronze Age and the Iron Age in Palestine and in particular to the “emergence of Israel”. The model reconstructs, with low sensitivity to initial assumptions, the actual outcomes including a complete alteration of the scientific consensus. Several known issues of Bayesian confirmation, including the problem of (...) old evidence, the introduction and confirmation of novel theories and the sensitivity of convergence to uncertain and disputed evidence are discussed in relation to the model’s result and the actual historical process. The most important result is that convergence of probabilities and of scientific opinion is indeed possible when advocates of rival hypotheses hold similar judgment about the factual content of evidence, even if they differ sharply in their historiographic interpretation. This speaks against the contention that understanding of present remains is so irrevocably biased by theoretical and cultural presumptions as to make an objective assessment impossible. (shrink)

Defenders of Inference to the Best Explanation claim that explanatory factors should play an important role in empirical inference. They disagree, however, about how exactly to formulate this role. In particular, they disagree about whether to formulate IBE as an inference rule for full beliefs or for degrees of belief, as well as how a rule for degrees of belief should relate to Bayesianism. In this essay I advance a new argument against non-Bayesian versions of IBE. My argument focuses on (...) cases in which we are concerned with multiple levels of explanation of some phenomenon. I show that in many such cases, following IBE as an inference rule for full beliefs leads to deductively inconsistent beliefs, and following IBE as a non-Bayesian updating rule for degrees of belief leads to probabilistically incoherent degrees of belief. (shrink)

Throughout the debate on psi, skeptics have almost universally insisted on different standards for evaluating the evidence, claiming that psi represents a radical departure from our current scientific understanding. Thus, there is considerable ambiguity about what standard of evaluation psi must meet. Little attention has been paid to the possible harm to the integrity of scientific investigation from this resulting inconsistency in testing standards. Some have proposed using a Bayesian framework as an improvement on this dilemma in order to more (...) explicitly model beliefs, assumptions, and background scientific knowledge, especially when evaluating a controversial hypothesis. Recently, Kuhn’s notion of paradigms, which constrains scientific research within bound- aries believed to be most productive, has been incorporated into a Bayesian framework. Within this framework, I explore a likely paradigm or meta-theory used by skeptics that typically constrains research and makes it difficult for psi evidence to be accepted. It appears that such a paradigm would in many respects have difficulty accounting for consciousness, which is fundamental to an understanding of psi. I discuss why psi data are likely to play a key role in making progress in solving the problem of consciousness. Thus, applying different standards of evaluation to psi data is likely counterproductive. (shrink)

Bayesians often assume, suppose, or conjecture that for any reasonable explication of the notion of simplicity a prior can be designed that will enforce a preference for hypotheses simpler in just that sense. But it is shown here that there are simplicity-driven approaches to curve-fitting problems that cannot be captured within the orthodox Bayesian framework.

Two of the most influential theories about scientific inference are inference to the best explanation and Bayesianism. How are they related? Bas van Fraassen has claimed that IBE and Bayesianism are incompatible rival theories, as any probabilistic version of IBE would violate Bayesian conditionalization. In response, several authors have defended the view that IBE is compatible with Bayesian updating. They claim that the explanatory considerations in IBE are taken into account by the Bayesian because the Bayesian either does or should (...) make use of them in assigning probabilities to hypotheses. I argue that van Fraassen has not succeeded in establishing that IBE and Bayesianism are incompatible, but that the existing compatibilist response is also not satisfactory. I suggest that a more promising approach to the problem is to investigate whether explanatory considerations are taken into account by a Bayesian who assigns priors and likelihoods on his or her own terms. In this case, IBE would emerge from the Bayesian account, rather than being used to constrain priors and likelihoods. I provide a detailed discussion of the case of how the Copernican and Ptolemaic theories explain retrograde motion, and suggest that one of the key explanatory considerations is the extent to which the explanation a theory provides depends on its core elements rather than on auxiliary hypotheses. I then suggest that this type of consideration is reflected in the Bayesian likelihood, given priors that a Bayesian might be inclined to adopt even without explicit guidance by IBE. The aim is to show that IBE and Bayesianism may be compatible, not because they can be amalgamated, but rather because they capture substantially similar epistemic considerations. 1 Introduction2 Preliminaries3 Inference to the Best Explanation4 Bayesianism5 The Incompatibilist View : Inference to the Best Explanation Contradicts Bayesianism5. 1 Criticism of the incompatibilist view6 Constraint - Based Compatibilism6. 1 Criticism of constraint - based compatibilism7 Emergent Compatibilism7. 1 Analysis of inference to the best explanation7. 1. 1 Inference to the best explanation on specific hypotheses7. 1. 2 Inference to the best explanation on general theories7. 1. 3 Copernicus versus Ptolemy7. 1. 4 Explanatory virtues7. 1. 5 Summary7. 2 Bayesian account8 Conclusion. (shrink)

The “demarcation problem,” the issue of how to separate science from pseu- doscience, has been around since fall 1919—at least according to Karl Pop- per’s (1957) recollection of when he first started thinking about it. In Popper’s mind, the demarcation problem was intimately linked with one of the most vexing issues in philosophy of science, David Hume’s problem of induction (Vickers 2010) and, in particular, Hume’s contention that induction cannot be logically justified by appealing to the fact that “it works,” (...) as that in itself is an inductive argument, thereby potentially plunging the philosopher straight into the abyss of a viciously circular argument. (shrink)

Eliminative reasoning seems to play an important role in the sciences, but should it be part of our best theory of science? Statistical evidence, prevalent across the sciences, causes problems for eliminative inference, supporting the view that probabilistic theories of confirmation provide a better framework for reasoning about evidence. Here I argue that deductive elimination has an important inferential role to play in science, one that is compatible with probabilistic approaches to evidence. Eliminative inferences help frame testing problems, an essential (...) step that determines the context for evaluating statistical evidence. I illustrate this process with examples from molecular evolutionary biology. (shrink)

The philosopher of science faces overwhelming disagreement in the literature on the definition, nature, structure, ontology, and content of scientific theories. These disagreements are at least partly responsible for disagreements in many of the debates in the discipline which put weight on the concept scientific theory. I argue that available theories of theories and conceptual analyses of theory are ineffectual options for addressing this difficulty: they do not move debates forward in a significant way. Directing my attention to debates about (...) the properties of particular, named theories, I introduce ‘theory eliminativism’ as a certain type of debate-reformulation. As a methodological tool it has the potential to be a highly effective way to make progress in the face of the noted problem: post-reformulation disagreements about theory cannot compromise the debate, and the questions that really matter can still be asked and answered. In addition the reformulation process demands that philosophers engage with science and the history of science in a more serious way than is usual in order to answer important questions about the justification for targeting a particular set of propositions (say) in a given context. All things considered, we should expect the benefits of a theory-eliminating debate-reformulation to heavily outweigh the costs for a highly significant number of debates of the relevant type. (shrink)

Bayesian model selection has frequently been the focus of philosophical inquiry (e.g., Forster, Br J Philos Sci 46:399–424, 1995; Bandyopadhyay and Boik, Philos Sci 66:S390–S402, 1999; Dowe et al., Br J Philos Sci 58:709–754, 2007). This paper argues that Bayesian model selection procedures are very diverse in their inferential target and their justification, and substantiates this claim by means of case studies on three selected procedures: MML, BIC and DIC. Hence, there is no tight link between Bayesian model selection and (...) Bayesian philosophy. Consequently, arguments for or against Bayesian reasoning based on properties of Bayesian model selection procedures should be treated with great caution. (shrink)

The analysis of theory-confirmation generally takes the deductive form: show that a theory in conjunction with physical data and auxiliary hypotheses yield a prediction about phenomena; verify the prediction; provide a quantitative measure of the degree of theory-confirmation this yields. The issue of confirmation for an entire framework (e.g., Newtonian mechanics en bloc, as opposed, say, to Newton’s theory of gravitation) either does not arise, or is dismissed in so far as frameworks are thought not to be the kind of (...) thing that admits scientific confirmation. I argue that there is another form of scientific reasoning that has not received philosophical attention, what I call Newtonian abduction, that does provide confirmation for frameworks as a whole, and does so in two novel ways. (In particular, Newtonian abduction is not inference to the best explanation, but rather is closer to Peirce’s original idea of abduction.) I further argue that Newtonian abduction is at least as important a form of reasoning in science as standard deductive and inductive forms. The form is beautifully summed up by Maxwell (Proc Camb Philos Soc II:292–294, 1876): “The true method of physical reasoning is to begin with the phenomena and to deduce the forces from them by a direct application of the equations of motion.”. (shrink)

Occam's razor—the idea that all else being equal, we should pick the simpler hypothesis—plays a prominent role in ordinary and scientific inference. But why are simpler hypotheses better? One attractive hypothesis known as Bayesian Occam's razor is that more complex hypotheses tend to be more flexible—they can accommodate a wider range of possible data—and that flexibility is automatically penalized by Bayesian inference. In two experiments, we provide evidence that people's intuitive probabilistic and explanatory judgments follow the prescriptions of BOR. In (...) particular, people's judgments are consistent with the two most distinctive characteristics of BOR: They penalize hypotheses as a function not only of their numbers of free parameters but also as a function of the size of the parameter space, and they penalize those hypotheses even when their parameters can be “tuned” to fit the data better than comparatively simpler hypotheses. (shrink)

We present a conservative extension of a Bayesian account of confirmation that can deal with the problem of old evidence and new theories. So-called open-minded Bayesianism challenges the assumption—implicit in standard Bayesianism—that the correct empirical hypothesis is among the ones currently under consideration. It requires the inclusion of a catch-all hypothesis, which is characterized by means of sets of probability assignments. Upon the introduction of a new theory, the former catch-all is decomposed into a new empirical hypothesis and a new (...) catch-all. As will be seen, this motivates a second update rule, besides Bayes’ rule, for updating probabilities in light of a new theory. This rule conserves probability ratios among the old hypotheses. This framework allows for old evidence to confirm a new hypothesis due to a shift in the theoretical context. The result is a version of Bayesianism that, in the words of Earman, “keep[s] an open mind, but not so open that your brain falls out”. (shrink)

:While Bayesian methods are widely used in economics and finance, the foundations of this approach remain controversial. In the contemporary statistical literature Bayesian Ockham’s razor refers to the observation that the Bayesian approach to scientific inference will automatically assign greater likelihood to a simpler hypothesis if the data are compatible with both a simpler and a more complex hypothesis. In this paper I will discuss a problem that results when Bayesian Ockham’s razor is applied to nested economic models. I will (...) argue that previous responses to the problem found in the philosophical literature are unsatisfactory and develop a novel reply to the problem. (shrink)

This article discusses the role of simplicity and the notion of a best balance of simplicity and strength within the best systems account (BSA) of laws of nature. The article explores whether there is anything in scientific practice that corresponds to the notion of simplicity or to the trade-off between simplicity and strength to which the BSA appeals. Various theoretical rationales for simplicity preferences and their bearing on the identification of laws are also explored. It is concluded that there are (...) a number of issues about the role of simplicity within the BSA and its relation to strength that need to be addressed before the BSA can be regarded as an adequate account of laws. 1 Introduction2 The Best Systems Account3 The Trade-Off between Simplicity and Strength: Preliminary Considerations4 Alternative Conceptions of the Relationship between Simplicity and Strength5 Two Roles for Simplicity6 Simplicity in the Best Systems Account: Curve-Fitting7 Simplicity as a Corrective for Overfitting8 Descriptive Simplicity in the Best Systems Account?9 Simplicity as Due to Human Intellectual Limitations10 Summary11 Concluding Remarks. (shrink)

Our scientific theories, like our cognitive structures in general, consist of propositions linked by evidential, explanatory, probabilistic, and logical connections. Those theoretical webs ‘impinge on the world at their edges,’ subject to a continuing barrage of incoming evidence. Our credences in the various elements of those structures change in response to that continuing barrage of evidence, as do the perceived connections between them. Here we model scientific theories as Bayesian nets, with credences at nodes and conditional links between them modelled (...) as conditional probabilities. We update those networks, in terms of both credences at nodes and conditional probabilities at links, through a temporal barrage of random incoming evidence. Robust patterns of punctuated equilibrium, suggestive of ‘normal science’ alternating with ‘paradigm shifts,’ emerge prominently in that change dynamics. The suggestion is that at least some of the phenomena at the core of the Kuhnian tradition are predictable in the typical dynamics of scientific theory change captured as Bayesian nets under even a random evidence barrage. (shrink)

We discuss the scientific task of historical reconstruction and the problem of epistemic access. We argue that strong epistemic support for historical claims consists in the consilience of multiple independent lines of evidence, and analyze the impact hypothesis for the End-Cretaceous mass extinction to illustrate the accrual of epistemic support. Although there are elements of the impact hypothesis that enjoy strong epistemic support, the general conditions for this are strict, and help to clarify the difficulties associated with reconstructing the deep (...) past. (shrink)

Disagreements about the definition, nature, structure, ontology, and content of scientific theories are at least partly responsible for disagreements in other debates in the philosophy of science. I argue that available theories of theories and conceptual analyses of *theory* are ineffectual options for overcoming this difficulty. Directing my attention to debates about the properties of particular, named theories, I introduce ‘theory eliminativism’ as a certain type of debate-reformulation. As a methodological tool it has the potential to be a highly effective (...) way to make real progress in the face of the noted problem. After the recommended reformulation questions of genuine importance to philosophy of science can still be asked and answered, but now without any possibility of disagreements about ‘theories’ compromising the debate. (shrink)

Classic conceptions of model simplicity for machine learning are mainly based on the analysis of the structure of the model. Bayesian, Frequentist, information theoretic and expressive power concepts are the best known of them, which are reviewed in this work, along with their underlying assumptions and weaknesses. These approaches were developed before the advent of the Big Data deluge, which has overturned the importance of structural simplicity. The computational simplicity concept is presented, and it is argued that it is more (...) encompassing and closer to actual machine learning practices than the classic ones. In order to process the huge datasets which are commonplace nowadays, the computational complexity of the learning algorithm is the decisive factor to assess the viability of a machine learning strategy, while the classic accounts of simplicity play a surrogate role. Some of the desirable features of computational simplicity derive from its reliance on the learning system concept, which integrates key aspects of machine learning that are ignored by the classic concepts. Moreover, computational simplicity is directly associated with energy efficiency. In particular, the question of whether the maximum possibly achievable predictive accuracy should be attained, no matter the economic cost of the associated energy consumption pattern, is considered. (shrink)

We consider the use of interventions for resolving a problem of unidentified statistical models. The leading examples are from latent variable modelling, an influential statistical tool in the social sciences. We first explain the problem of statistical identifiability and contrast it with the identifiability of causal models. We then draw a parallel between the latent variable models and Bayesian networks with hidden nodes. This allows us to clarify the use of interventions for dealing with unidentified statistical models. We end by (...) discussing the philosophical and methodological import of our result. (shrink)