Do people tend to be overconfident? Many think so. They’ve run studies on whether people are calibrated: whether their average confidence in their opinions matches the proportion of those opinions that are true. Under certain conditions, people are systematically ‘over-calibrated’—for example, of the opinions they’re 80% confident in, only 60% are true. From this empirical over-calibration, it’s inferred that people are irrationally overconfident. My question: When and why is this inference warranted? Answering it requires articulating a general connection between being (...) rational and being right—something extant studies have not done. I show how to do so using the notion of deference. This provides a theoretical foundation for calibration research, but also reveals a flaw: the connection between being rational and being right is much weaker than is standardly assumed, since rational people can often be expected to be miscalibrated. Thus we can’t test whether people are overconfident by simply testing whether they are over-calibrated; instead, we must try to predict the rational deviations from calibration, and then compare those predictions to people’s performance. I show how this can be done—and that doing so complicates the interpretation of robust empirical effects. (shrink)

Various theories try to give accounts of how measures of this confidence do or ought to behave, both as far as the internal mental consistency of the agent as ...

The object of this paper is to show why recent research in the psychology of deductive and probabilistic reasoning does not have.

As the ongoing literature on the paradoxes of the Lottery and the Preface reminds us, the nature of the relation between probability and rational acceptability remains far from settled. This article provides a novel perspective on the matter by exploiting a recently noted structural parallel with the problem of judgment aggregation. After offering a number of general desiderata on the relation between finite probability models and sets of accepted sentences in a Boolean sentential language, it is noted that a number (...) of these constraints will be satisfied if and only if acceptable sentences are true under all valuations in a distinguished non-empty set W. Drawing inspiration from distance-based aggregation procedures, various scoring rule based membership conditions for W are discussed and a possible point of contact with ranking theory is considered. The paper closes with various suggestions for further research. (shrink)

In this paper, I consider the relationship between Inference to the Best Explanation and Bayesianism, both of which are well-known accounts of the nature of scientific inference. In Sect. 2, I give a brief overview of Bayesianism and IBE. In Sect. 3, I argue that IBE in its most prominently defended forms is difficult to reconcile with Bayesianism because not all of the items that feature on popular lists of “explanatory virtues”—by means of which IBE ranks competing explanations—have confirmational import. (...) Rather, some of the items that feature on these lists are “informational virtues”—properties that do not make a hypothesis \ more probable than some competitor \ given evidence E, but that, roughly-speaking, give that hypothesis greater informative content. In Sect. 4, I consider as a response to my argument a recent version of compatibilism which argues that IBE can provide further normative constraints on the objectively correct probability function. I argue that this response does not succeed, owing to the difficulty of defending with any generality such further normative constraints. Lastly, in Sect. 5, I propose that IBE should be regarded, not as a theory of scientific inference, but rather as a theory of when we ought to “accept” H, where the acceptability of H is fixed by the goals of science and concerns whether H is worthy of commitment as research program. In this way, IBE and Bayesianism, as I will show, can be made compatible, and thus the Bayesian and the proponent of IBE can be friends. (shrink)

In the peer disagreement debate, three intuitively attractive claims seem to conflict: there is disagreement among peers on many important matters; peer disagreement is a serious challenge to one’s own opinion; and yet one should be able to maintain one’s opinion on important matters. I show that contrary to initial appearances, we can accept all three of these claims. Disagreement significantly shifts the balance of the evidence; but with respect to certain kinds of claims, one should nonetheless retain one’s beliefs. (...) And one should retain them even though these beliefs would not be supported by the new total evidence if one didn’t already hold them. (shrink)

Probabilistic dependence and independence are among the key concepts of Bayesian epistemology. This paper focuses on the study of one specific quantitative notion of probabilistic dependence. More specifically, section 1 introduces Keynes’s coefficient of dependence and shows how it is related to pivotal aspects of scientific reasoning such as confirmation, coherence, the explanatory and unificatory power of theories, and the diversity of evidence. The intimate connection between Keynes’s coefficient of dependence and scientific reasoning raises the question of how Keynes’s coefficient (...) of dependence is related to truth, and how it can be made fruitful for epistemological considerations. This question is answered in section 2 of the paper. Section 3 outlines the consequences the results have for epistemology and the philosophy of science from a Bayesian point of view. (shrink)

The paper investigates measures of explanatory power and how to define the inference schema “Inference to the Best Explanation”. It argues that these measures can also be used to quantify the systematic power of a hypothesis and the inference schema “Inference to the Best Systematization” is defined. It demonstrates that systematic power is a fruitful criterion for theory choice and IBS is truth-conducive. It also shows that even radical Bayesians must admit that systemic power is an integral component of Bayesian (...) reasoning. Finally, the paper puts the achieved results in perspective with van Fraassen’s famous criticism of IBE. (shrink)

In this paper we show that the coherence measures of Olsson (J Philos 94:246–272, 2002), Shogenji (Log Anal 59:338–345, 1999), and Fitelson (Log Anal 63:194–199, 2003) satisfy the two most important adequacy requirements for the purpose of assessing theories. Following Hempel (Synthese 12:439–469, 1960), Levi (Gambling with truth, New York, A. A. Knopf, 1967), and recently Huber (Synthese 161:89–118, 2008) we require, as minimal or necessary conditions, that adequate assessment functions favor true theories over false theories and true and informative (...) theories over true but uninformative theories. We then demonstrate that the coherence measures of Olsson, Shogenji, and Fitelson satisfy these minimal conditions if we confront the hypotheses with a separating sequence of observational statements. In the concluding remarks we set out the philosophical relevance, and limitations, of the formal results. Inter alia, we discuss the problematic implications of our precondition that competing hypotheses must be confronted with a separating sequence of observational statements, which also leads us to discuss theory assessment in the context of scientific antirealism. (shrink)

Single-case and long-run propensity theories are among the main objective interpretations of probability. There have been various objections to these theories, e.g. that it is difficult to explain why propensities should satisfy the probability axioms and, worse, that propensities are at odds with these axioms, that the explication of propensities is circular and accordingly not informative, and that single-case propensities are metaphysical and accordingly non-scientific. We consider various propensity theories of probability and their prospects in light of these objections. We (...) argue that while propensity theories face challenges, these challenges do not undermine their validity as prospective interpretations of probability in science. (shrink)

Gerd Gigerenzer and Thomas Sturm have recently proposed a modest form of what they describe as a normative, ecological and limited naturalism. The basic move in their argument is to infer that certain heuristics we tend to use should be used in the right ecological setting. To address this argument, we first consider the case of a concrete heuristic called Take the Best (TTB). There are at least two variants of the heuristic which we study by making explicit the choice (...) functions they induce, extending these variants of TTB beyond binary choice. We argue that the naturalistic argument can be applied to only one of the two variants of the heuristic; we also argue that the argument for the extension requires paying attention to other “rational” virtues of heuristics aside from efficacy, speed, and frugality. This notwithstanding, we show that there is a way of extending the right variant of TTB to obtain a very well behaved heuristic that could be used to offer a stronger case for the naturalistic argument (in the sense that if this heuristic is used, it is also a heuristic that we should use). The second part of the article considers attempts to extending the naturalistic argument from algorithms dealing with inference to heuristics dealing with choice. Our focus is the so-called Priority Heuristic, which we extend from risk to uncertainty. In this setting, the naturalist argument seems more difficult to formulate, if it remains feasible at all. Normativity seems in this case extrinsic to the heuristic, whose main virtue seems to be its ability to describe actual patterns of choice. But it seems that a new version of the naturalistic argument used with partial success in the case of inference is unavailable to solve the normative problem of whether we should exhibit the patterns of choice that we actually display. (shrink)

After delineating the distinguishing features of pragmatism, and noting the resources that pragmatists have available to respond effectively as pragmatists to the two major objections to pragmatism, I examine and critically evaluate the various proposals that pragmatists have offered as a solution to the problem of induction, followed by a discussion of the pragmatic positions on the status of theoretical entities. Thereafter I discuss the pragmatic posture toward the nature of explanation in science. I conclude that pragmatism has (a) a (...) generally compelling solution to Hume's problem of induction; (b) no specific position on the status of theoretical entities, although something like the non-realism of the sort developed by van Fraassen seems a defensible candidate for most pragmatists in general, even though there are non-trivial objections to van Fraassen's position; and (c) central to the pragmatic conception of scientific explanation is the abandonment of our common conception of truth as a necessary condition for sentences to provide adequate explanations, and a drift in the direction of a contextualist account of explanation. (shrink)

Degrees of belief are familiar to all of us. Our confidence in the truth of some propositions is higher than our confidence in the truth of other propositions. We are pretty confident that our computers will boot when we push their power button, but we are much more confident that the sun will rise tomorrow. Degrees of belief formally represent the strength with which we believe the truth of various propositions. The higher an agent’s degree of belief for a particular (...) proposition, the higher her confidence in the truth of that proposition. For instance, Sophia’s degree of belief that it will be sunny in Vienna tomorrow might be .52, whereas her degree of belief that the train will leave on time might be .23. The precise meaning of these statements depends, of course, on the underlying theory of degrees of belief. These theories offer a formal tool to measure degrees of belief, to investigate the relations between various degrees of belief in different propositions, and to normatively evaluate degrees of belief. (shrink)

This paper combines various structures representing degrees of belief, degrees of disbelief, and degrees of non-belief (degrees of expectations) into a unified whole. The representation uses relations of comparative necessity and possibility, as well as non-probabilistic functions assigning numerical values of necessity and possibility. We define all-encompassing necessity structures which have weak expectations (mere hypotheses, guesses, conjectures, etc.) occupying the lowest ranks and very strong, ineradicable ('a priori') beliefs occupying the highest ranks. Structurally, there are no differences from the top (...) to the bottom. I argue that belief is a vague notion, and that thresholds for belief, if there are any, are context-dependent. (shrink)

"A Survey of Ranking Theory": The paper gives an up-to-date survey of ranking theory. It carefully explains the basics. It elaborates on the ranking theoretic explication of reasons and their balance. It explains the dynamics of belief statable in ranking terms and indicates how the ranks can thereby be measured. It suggests how the theory of Bayesian nets can be carried over to ranking theory. It indicates what it might mean to objectify ranks. It discusses the formal and the philosophical (...) aspects of the tight relation and the complementarity of ranks and probabilities. It closes with comparative remarks on predecessors and other philosophical proposals as well as formal models developed in AI. (shrink)

In this paper I argue that there is a class of attitudes that have questions (rather than propositions or something else) as contents.

We defend a set of acceptance rules that avoids the lottery paradox, that is closed under classical entailment, and that accepts uncertain propositions without ad hoc restrictions. We show that the rules we recommend provide a semantics that validates exactly Adams’ conditional logic and are exactly the rules that preserve a natural, logical structure over probabilistic credal states that we call probalogic. To motivate probalogic, we first expand classical logic to geo-logic, which fills the entire unit cube, and then we (...) project the upper surfaces of the geo-logical cube onto the plane of probabilistic credal states by means of standard, linear perspective, which may be interpreted as an extension of the classical principle of indifference. Finally, we apply the geometrical/logical methods developed in the paper to prove a series of trivialization theorems against question-invariance as a constraint on acceptance rules and against rational monotonicity as an axiom of conditional logic in situations of uncertainty. (shrink)

This book examines the philosophical conception of abductive reasoning as developed by Charles S. Peirce, the founder of American pragmatism. It explores the historical and systematic connections of Peirce's original ideas and debates about their interpretations. Abduction is understood in a broad sense which covers the discovery and pursuit of hypotheses and inference to the best explanation. The analysis presents fresh insights into this notion of reasoning, which derives from effects to causes or from surprising observations to explanatory theories. The (...) author outlines some logical and AI approaches to abduction as well as studies various kinds of inverse problems in astronomy, physics, medicine, biology, and human sciences to provide examples of retroductions and abductions. The discussion covers also everyday examples with the implication of this notion in detective stories, one of Peirce’s own favorite themes. The author uses Bayesian probabilities to argue that explanatory abduction is a method of confirmation. He uses his own account of truth approximation to reformulate abduction as inference which leads to the truthlikeness of its conclusion. This allows a powerful abductive defense of scientific realism. This up-to-date survey and defense of the Peircean view of abduction may very well help researchers, students, and philosophers better understand the logic of truth-seeking. (shrink)

Lin and Kelly :957–981, 2012) and Leitgeb :1338–1389, 2013, Philos Rev 123:131–171, 2014), offer similar solutions to the Lottery Paradox, defining acceptance rules which determine a rational agent’s beliefs in terms of broader features of her credal state than just her isolated credences in individual propositions. I express each proposal as a method for obtaining an ordering over a partition from a credence function, and then a belief set from the ordering. Although these proposals avoid the original Lottery Paradox, I (...) raise a diachronic case which illustrates that neither satisfies both Lin and Kelly’s constraint that the update on orderings track the update on credence functions, and the intuitive constraint that credence of at least 0.5 is necessary for rational belief. I conclude by suggesting that we reformulate these proposals in terms of orderings over entire algebras based on partitions rather than orderings just over the partitions themselves. Reformulating both rules in this way yields acceptance rules which avoid the Lottery Paradox while satisfying both the tracking and likeliness constraints. (shrink)

The focus of this study is cognitive choice: the selection of one cognitive option (a hypothesis, a theory, or an axiom, for instance) rather than another. The study proposes that cognitive choice should be based on the plausibilities of states posited by rival cognitive options and the utilities of these options' information outcomes. The proposal introduces a form of decision theory that is novel because comparative; it permits many choices among cognitive options to be based on merely comparative plausibilities and (...) utilities. This form of decision theory intersects with recommendations by advocates of decision theory for cognitive choice, on the one hand, and defenders of comparative evaluation of scientific hypotheses and theories, on the other. But it differs from prior decision-theoretic proposals because it requires no more than minimal precision in specifying plausibilities and utilities. And it differs from comparative proposals because none has shown how comparative evaluations can be carried out within a decision-theoretic framework. (shrink)