Policymakers who seek to make scientifically informed decisions are constantly confronted by scientific uncertainty and expert disagreement. This thesis asks: how can policymakers rationally respond to expert disagreement and scientific uncertainty? This is a work of non-ideal theory, which applies formal philosophical tools developed by ideal theorists to more realistic cases of policymaking under scientific uncertainty. I start with Bayesian approaches to expert testimony and the problem of expert disagreement, arguing that two popular approaches— supra-Bayesianism and the standard model of (...) expert deference—are insufficient. I develop a novel model of expert deference and show how it can deal with many of these problems raised for them. I then turn to opinion pooling, a popular method for dealing with disagreement. I show that various theoretical motivations for pooling functions are irrelevant to realistic policymaking cases. This leads to a cautious recommendation of linear pooling. However, I then show that any pooling method relies on value judgements, that are hidden in the selection of the scoring rule. My focus then narrows to a more specific case of scientific uncertainty: multiple models of the same system. I introduce a particular case study involving hurricane models developed to support insurance decision-making. I recapitulate my analysis of opinion pooling in the context of model ensembles, confirming that my hesitations apply. This motivates a shift of perspective, to viewing the problem as a decision theoretic one. I rework a recently developed ambiguity theory, called the confidence approach, to take input from model ensembles. I show how it facilitates the resolution of the policymaker’s problem in a way that avoids the issues encountered in previous chapters. This concludes my main study of the problem of expert disagreement. In the final chapter, I turn to methodological reflection. I argue that philosophers who employ the mathematical methods of the prior chapters are modelling. Employing results from the philosophy of scientific models, I develop the theory of normative modelling. I argue that it has important methodological conclusions for the practice of formal epistemology, ruling out popular moves such as searching for counterexamples. (shrink)

This chapter explores the topic of imprecise probabilities as it relates to model validation. IP is a family of formal methods that aim to provide a better representationRepresentation of severe uncertainty than is possible with standard probabilistic methods. Among the methods discussed here are using sets of probabilities to represent uncertainty, and using functions that do not satisfy the additvity property. We discuss the basics of IP, some examples of IP in computer simulation contexts, possible interpretations of the IP framework (...) and some conceptual problems for the approach. We conclude with a discussion of IP in the context of model validation. (shrink)

Kolmogorov''s axiomatization of probability includes the familiarratio formula for conditional probability: 0).$$ " align="middle" border="0">.

A scientific community cannot practice its trade without some set of received beliefs. These beliefs form the foundation of the "educational initiation that prepares and licenses the student for professional practice". The nature of the "rigorous and rigid" preparation helps ensure that the received beliefs are firmly fixed in the student's mind. Scientists take great pains to defend the assumption that scientists know what the world is like...To this end, "normal science" will often suppress novelties which undermine its foundations. Research (...) is therefore not about discovering the unknown, but rather "a strenuous and devoted attempt to force nature into the conceptual boxes supplied by professional education". (shrink)

Thomas S. Kuhn's classic book is now available with a new index.

When making decisions, people naturally face uncertainty about the potential consequences of their actions due in part to limits in their capacity to represent, evaluate or deliberate. Nonetheless, they aim to make the best decisions possible. In Decision Theory with a Human Face, Richard Bradley develops new theories of agency and rational decision-making, offering guidance on how 'real' agents who are aware of their bounds should represent the uncertainty they face, how they should revise their opinions as a result of (...) experience and how they should make decisions when lacking full awareness of, or precise opinions on relevant contingencies. He engages with the strengths and flaws of Bayesian reasoning, and presents clear and comprehensive explorations of key issues in decision theory, from belief and desire to semantics and learning. His book draws on philosophy, economics, decision science and psychology, and will appeal to readers in all of these disciplines. (shrink)

A major difficulty for currently existing theories of inductive inference involves the question of what to do when novel, unknown, or previously unsuspected phenomena occur. In this paper one particular instance of this difficulty is considered, the so-called sampling of species problem.The classical probabilistic theories of inductive inference due to Laplace, Johnson, de Finetti, and Carnap adopt a model of simple enumerative induction in which there are a prespecified number of types or species which may be observed. But, realistically, this (...) is often not the case. In 1838 the English mathematician Augustus De Morgan proposed a modification of the Laplacian model to accommodate situations where the possible types or species to be observed are not assumed to be known in advance; but he did not advance a justification for his solution. (shrink)

We present a conservative extension of a Bayesian account of confirmation that can deal with the problem of old evidence and new theories. So-called open-minded Bayesianism challenges the assumption—implicit in standard Bayesianism—that the correct empirical hypothesis is among the ones currently under consideration. It requires the inclusion of a catch-all hypothesis, which is characterized by means of sets of probability assignments. Upon the introduction of a new theory, the former catch-all is decomposed into a new empirical hypothesis and a new (...) catch-all. As will be seen, this motivates a second update rule, besides Bayes’ rule, for updating probabilities in light of a new theory. This rule conserves probability ratios among the old hypotheses. This framework allows for old evidence to confirm a new hypothesis due to a shift in the theoretical context. The result is a version of Bayesianism that, in the words of Earman, “keep[s] an open mind, but not so open that your brain falls out”. (shrink)

According to the orthodox treatment of risk preferences in decision theory, they are to be explained in terms of the agent's desires about concrete outcomes. The orthodoxy has been criticised both for conflating two types of attitudes and for committing agents to attitudes that do not seem rationally required. To avoid these problems, it has been suggested that an agent's attitudes to risk should be captured by a risk function that is independent of her utility and probability functions. The main (...) problem with that approach is that it suggests that attitudes to risk are wholly distinct from people's (non-instrumental) desires. To overcome this problem, we develop a framework where an agent's utility function is defined over chance propositions (i.e., propositions describing objective probability distributions) as well as ordinary (non-chance) ones, and argue that one should explain different risk attitudes in terms of different forms of the utility function over such propositions. (shrink)

There are at least two plausible generalisations of subjective expected utility (SEU) theory: cumulative prospect theory (which relaxes the independence axiom) and Levi’s decision theory (which relaxes at least ordering). These theories call for a re-assessment of the minimal requirements of rational choice. Here, I consider how an analysis of sequential decision making contributes to this assessment. I criticise Hammond’s (Economica 44(176):337–350, 1977; Econ Philos 4:292–297, 1988a; Risk, decision and rationality, 1988b; Theory Decis 25:25–78, 1988c) ‘consequentialist’ argument for the SEU (...) preference axioms, but go on to formulate a related diachronic-Dutch-book-style’ argument that better achieves Hammond’s aims. Some deny the importance of Dutch-book sure losses, however, in which case, Seidenfeld’s (Econ Philos 4:267–290, 1988a) argument that distinguishes between theories that relax independence and those that relax ordering is relevant. I unravel Seidenfeld’s argument in light of the various criticisms of it and show that the crux of the argument is somewhat different and much more persuasive than what others have taken it to be; the critical issue is the modelling of future choices between ‘indifferent’ decision-tree branches in the sequential setting. Finally, I consider how Seidenfeld’s conclusions might nonetheless be resisted. (shrink)

Recent literature has examined the problem facing decision makers with bounded awareness, who may be unaware of some states of nature. A question that naturally arises here is whether a value of awareness, analogous to value of information, can be attributed to changes in awareness. In this paper, such a value is defined. It is shown that the sum VOA +\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$+$$\end{document} VOI is constant and, except for scale effects, independent of the (...) choice set. It follows that the larger is VOA, the smaller is VOI. This point is illustrated for a simple two-state case, then proved for general classes of compact convex choice sets, and for alternative interpretations of the concept of unawareness. (shrink)

Contrary to what has been widely supposed, Bayesian theory deals successfully with the introduction of new theories that have never previously been entertained. The theory enables us to say what sorts of method should be used to assign probabilities to these new theories, and it allows that the probabilities of existing theories may be modified as a result.

Richard Bradley and others endorse Reverse Bayesianism as the way to model awareness growth. I raise a problem for Reverse Bayesianism—at least for the general version that Bradley endorses—and argue that there is no plausible way to restrict the principle that will give us the right results. To get the right results, we need to pay attention to the attitudes that agents have towards propositions of which they are unaware. This raises more general questions about how awareness growth should be (...) modelled. (shrink)

This book defends the view that any adequate account of rational decision making must take a decision maker's beliefs about causal relations into account. The early chapters of the book introduce the non-specialist to the rudiments of expected utility theory. The major technical advance offered by the book is a 'representation theorem' that shows that both causal decision theory and its main rival, Richard Jeffrey's logic of decision, are both instances of a more general conditional decision theory. The book solves (...) a long-standing problem for Jeffrey's theory by showing for the first time how to obtain a unique utility and probability representation for preferences and judgements of comparative likelihood. The book also contains a major new discussion of what it means to suppose that some event occurs or that some proposition is true. The most complete and robust defence of causal decision theory available. (shrink)

The pragmatic character of the Dutch book argument makes it unsuitable as an "epistemic" justification for the fundamental probabilist dogma that rational partial beliefs must conform to the axioms of probability. To secure an appropriately epistemic justification for this conclusion, one must explain what it means for a system of partial beliefs to accurately represent the state of the world, and then show that partial beliefs that violate the laws of probability are invariably less accurate than they could be otherwise. (...) The first task can be accomplished once we realize that the accuracy of systems of partial beliefs can be measured on a gradational scale that satisfies a small set of formal constraints, each of which has a sound epistemic motivation. When accuracy is measured in this way it can be shown that any system of degrees of belief that violates the axioms of probability can be replaced by an alternative system that obeys the axioms and yet is more accurate in every possible world. Since epistemically rational agents must strive to hold accurate beliefs, this establishes conformity with the axioms of probability as a norm of epistemic rationality whatever its prudential merits or defects might be. (shrink)

"[This book] proposes new foundations for the Bayesian principle of rational action, and goes on to develop a new logic of desirability and probabtility."—Frederic Schick, _Journal of Philosophy_.

Gilboa and Schmeidler provide a paradigm for modelling decision making under uncertainty. Unlike the classical theory of expected utility maximization, case-based decision theory does not assume that decision makers know the possible 'states of the world' or the outcomes, let alone the decision matrix attaching outcomes to act-state pairs. Case-based decision theory suggests that people make decisions by analogies to past cases: they tend to choose acts that performed well in the past in similar situations, and to avoid acts that (...) performed poorly. It is an alternative to expected utility theory when both states of the world and probabilities are neither given in the problem nor can be easily constructed. The authors describe the general theory and its relationship to planning, repeated choice problems, inductive inference, and learning; they highlight its mathematical and philosophical foundations and compare it with expected utility theory as well as with rule-based systems. (shrink)

In recent years, much work has been dedicated by logicians, computer scientists and economists to understanding awareness, as its importance for human behaviour becomes evident. Although several logics of awareness have been proposed, little attention has been explicitly dedicated to change in awareness. However, one of the most crucial aspects of awareness is the changes it undergoes, which have countless important consequences for knowledge and action. The aim of this paper is to propose a formal model of awareness change, and (...) to derive from it logics of awareness change. In the first part of the paper, the model of epistemic states of bounded agents proposed in Hill (Stud Log 89(1):81–109, 2008a ) is extended with operations modelling awareness change. In the second part of the paper, it is shown how this model naturally extends the “standard” logic of awareness to yield a logic of awareness change. (shrink)

Hierarchical Bayesian models (HBMs) provide an account of Bayesian inference in a hierarchically structured hypothesis space. Scientific theories are plausibly regarded as organized into hierarchies in many cases, with higher levels sometimes called ‘para- digms’ and lower levels encoding more specific or concrete hypotheses. Therefore, HBMs provide a useful model for scientific theory change, showing how higher-level theory change may be driven by the impact of evidence on lower levels. HBMs capture features described in the Kuhnian tradition, particularly the idea (...) that higher-level theories guide learning at lower levels. In addition, they help resolve certain issues for Bayesians, such as scientific preference for simplicity and the problem of new theories. (shrink)

Clear-cut cases of decision-making under risk (known probabilities) are unusual in real life. The gambler’s decisions at the roulette table are as close as we can get to this type of decision-making. In contrast, decision-making under uncertainty (unknown probabilities) can be exemplified by a decision whether to enter a jungle that may contain unknown dangers. Life is usually more like an expedition into an unknown jungle than a visit to the casino. Nevertheless, it is common in decision-supporting disciplines to proceed (...) as if reasonably reliable probability estimates were available for all possible outcomes, i.e. as if the prevailing epistemic conditions were analogous to those of gambling at the roulette table. This mistake can be called the tuxedo fallacy . It is argued that traditional engineering practices such as safety factors and multiple safety barriers avoid this fallacy and that they therefore manage uncertainty better than probabilistic risk analysis (PRA). PRA is a useful tool, but it must be supplemented with other methods in order not to limit the analysis to dangers that can be assigned meaningful probability estimates. (shrink)

L. A. Paul has recently argued that the epistemically transformative nature of certain experiences makes it impossible to rationally decide whether to have the experience or not. We start by explaining why, contrary to what Paul claims, epistemically transformative experiences do not pose a general problem for the possibility of rational choice. However, we show there is a particular type of agent for whom the problem identified by Paul does arise. With this agent in mind, we examine Paul’s own suggestion (...) for how to approach a transformative decision problem, namely, that one should decide based on whether one would like to come to know the experience in question, and we conclude that Paul’s suggestion is no solution for this particular agent. In other words, Paul’s solution does not work for the only type of agent for whom the problem she has identified arises. (shrink)

Diachronic Dutch book arguments seem to support both conditionalization and Bas van Fraassen's Reflection principle. But the Reflection principle is vulnerable to numerous counterexamples. This essay addresses two questions: first, under what circumstances should an agent obey Reflection, and second, should the counterexamples to Reflection make us doubt the Dutch book for conditionalization? In response to the first question, this essay formulates a new "Qualified Reflection" principle, which states that an agent should obey Reflection only if he or she is (...) certain that he or she will conditionalize on veridical evidence in the future. Qualified Reflection follows from the probability calculus together with a few idealizing assumptions. The essay then formulates a "Distorted Reflection" principle that approximates Reflection even in cases where the agent is not quite certain that he or she will conditionalize on veridical evidence. In response to the second question, the essay argues that contrary to a common misconception, not all Dutch books dramatize incoherence—some dramatize a less blameworthy sort of epistemic frailty that the essay calls "self-doubt." The distinction between Dutch books that dramatize incoherence and those that dramatize self-doubt cross-cuts the distinction between synchronic and diachronic Dutch books. The essay explains why the Dutch book for conditionalization reveals true incoherence, whereas the Dutch book for Reflection reveals only self-doubt. (shrink)

Richard Jeffrey espoused an antifoundationalist variant of Bayesian thinking that he termed ‘Radical Probabilism’. Radical Probabilism denies both the existence of an ideal, unbiased starting point for our attempts to learn about the world and the dogma of classical Bayesianism that the only justified change of belief is one based on the learning of certainties. Probabilistic judgment is basic and irreducible. Bayesian conditioning is appropriate when interaction with the environment yields new certainty of belief in some proposition but leaves one’s (...) conditional beliefs untouched (the ‘Rigidity’ condition). Although Richard Jeffrey denied the general applicability of this condition, one of his main contributions to probabilistic thinking is a form of belief updating—now typically called ‘Jeffrey conditioning’ or ‘probability kinematics’—that is appropriate in circumstances in which Rigidity is satisfied, but where the interaction causes one to reevaluate one’s probability judgments over some partition of the possibility space without conferring certainty on any particular element. The most familiar occasion for Jeffrey conditioning is receipt of uncertain evidence: things partially perceived or remembered. But it also serves to illuminate belief updating occasioned by a change in one’s degrees of conditional belief, a kind of belief change largely ignored by classical Bayesianism. I argue that such changes in conditional belief can also be basic (in the sense of not being analyzable as a consequence of conditioning on factual information) and offer a kinematical model for a particular kind change in conditional belief. Both are applied to changes in preference. Finally, I argue that Rigidity can fail when changes of belief give inferential grounds for changes in conditional belief (and vice versa). These failures show that conditioning methods are properly regarded, not as valid rules of inference, but as tools in the ‘art of judgment’. (shrink)

This paper contributes to the mathematical foundations of the model for utility theory developed by Richard Jeffrey in The Logic of Decision [5]. In it I discuss the relationship of Jeffrey's to classical models, state and interpret an existence theorem for numerical utilities and subjective probabilities and restate a theorem on their uniqueness.

I argue that standard decision theories, namely causal decision theory and evidential decision theory, both are unsatisfactory. I devise a new decision theory, from which, under certain conditions, standard game theory can be derived.

Brian Hedden defends a radical view about the relationship between rationality, personal identity, and time. On the standard view, personal identity over time plays a central role in thinking about rationality, because there are rational norms for how a person's attitudes and actions at one time should fit with her attitudes and actions at other times. But these norms are problematic. They make what you rationally ought to believe or do depend on facts about your past that aren't part of (...) your current perspective on the world, and they make rationality depend on controversial, murky metaphysical facts about what binds different instantaneous snapshots into a single person extended in time. Hedden takes a different approach, treating the relationship between different time-slices of the same person as no different from the relationship between different people. On his account, the locus of rationality is the time-slice rather than the temporally extended agent. This impersonal, time-slice-centric approach to rationality yields a unified approach to the rationality of beliefs, preferences, and actions where what rationality demands of you is solely determined by your evidence, with no special weight given to your past beliefs or actions. (shrink)

Lara Buchak sets out a new account of rational decision-making in the face of risk. She argues that the orthodox view is too narrow, and suggests an alternative, more permissive theory: one that allows individuals to pay attention to the worst-case or best-case scenario, and vindicates the ordinary decision-maker.

How should we make choices when we know so little about our futures? L. A. Paul argues that we must view life decisions as choices to make discoveries about the nature of experience. Her account of transformative experience holds that part of the value of living authentically is to experience our lives and preferences in whatever ways they evolve.

There is currently no viable alternative to the Bayesian analysis of scientific inference, yet the available versions of Bayesianism fail to do justice to several aspects of the testing and confirmation of scientific hypotheses. Bayes or Bust? provides the first balanced treatment of the complex set of issues involved in this nagging conundrum in the philosophy of science. Both Bayesians and anti-Bayesians will find a wealth of new insights on topics ranging from Bayes's original paper to contemporary formal learning theory. (...) In a paper published posthumously in 1763, the Reverend Thomas Bayes made a seminal contribution to the understanding of "analogical or inductive reasoning." Building on his insights, modem Bayesians have developed an account of scientific inference that has attracted numerous champions as well as numerous detractors. Earman argues that Bayesianism provides the best hope for a comprehensive and unified account of scientific inference, yet the presently available versions of Bayesianisin fail to do justice to several aspects of the testing and confirming of scientific theories and hypotheses. By focusing on the need for a resolution to this impasse, Earman sharpens the issues on which a resolution turns. John Earman is Professor of History and Philosophy of Science at the University of Pittsburgh. (shrink)

This is a major contribution to the theory of rational choice which will be of particular interest to philosophers and economists. The author sets out the foundations of rational choice, and then sketches a dynamic choice framework in which principles of ordering and independence follow from a number of apparently plausible conditions. However, there is potential conflict among these conditions, and when they are weakened to avoid it the usual foundations of rational choice no longer prevail. The thrust of the (...) argument is to suggest that the theory of rational choice is less deterministic than many suppose. (shrink)

Awareness growth—coming to entertain propositions of which one was previously unaware—is a crucial aspect of epistemic thriving. And yet, it is widely believed that orthodox Bayesianism cannot accommodate this phenomenon, since that would require employing supposedly defective catch-all propositions. Orthodox Bayesianism, it is concluded, must be amended. In this paper, I show that this argument fails, and that, on the contrary, the orthodox version of Bayesianism is particularly well-suited to accommodate awareness growth. For it entails what I call the refinement (...) view, which allows us to capture that awareness growth consists in the increase of one’s capacity of discernment. (shrink)

According to the traditional Bayesian view of credence, its structure is that of precise probability, its objects are descriptive propositions about the empirical world, and its dynamics are given by conditionalization. Each of the three essays that make up this thesis deals with a different variation on this traditional picture. The first variation replaces precise probability with sets of probabilities. The resulting imprecise Bayesianism is sometimes motivated on the grounds that our beliefs should not be more precise than the evidence (...) calls for. One known problem for this evidentially motivated imprecise view is that in certain cases, our imprecise credence in a particular proposition will remain the same no matter how much evidence we receive. In the first essay I argue that the problem is much more general than has been appreciated so far, and that it’s difficult to avoid without compromising the initial evidentialist motivation. The second variation replaces descriptive claims with moral claims as the objects of credence. I consider three standard arguments for probabilism with respect to descriptive uncertainty—representation theorem arguments, Dutch book arguments, and accuracy arguments—in order to examine whether such arguments can also be used to establish probabilism with respect to moral uncertainty. In the second essay, I argue that by and large they can, with some caveats. First, I don’t examine whether these arguments can be given sound non-cognitivist readings, and any conclusions therefore only hold conditional on cognitivism. Second, decision-theoretic representation theorems are found to be less convincing in the moral case, because there they implausibly commit us to thinking that intertheoretic comparisons of value are always possible. Third and finally, certain considerations may lead one to think that imprecise probabilism provides a more plausible model of moral epistemology. The third variation considers whether, in addition to conditionalization, agents may also change their minds by becoming aware of propositions they had not previously entertained, and therefore not previously assigned any probability. More specifically, I argue that if we wish to make room for reflective equilibrium in a probabilistic moral epistemology, we must allow for awareness growth. In the third essay, I sketch the outline of such a Bayesian account of reflective equilibrium. Given that this account gives a central place to awareness growth, and that the rationality constraints on belief change by awareness growth are much weaker than those on belief change by conditionalization, it follows that the rationality constraints on the credences of agents who are seeking reflective equilibrium are correspondingly weaker. (shrink)