This develops a framework for second-order conditionalization on statements about one's own epistemic reliability. It is the generalization of the framework of "Second-Guessing" (2009) to the case where the subject is uncertain about her reliability. See also "Epistemic Self-Doubt" (2017).

Do people tend to be overconfident? Many think so. They’ve run studies on whether people are calibrated: whether their average confidence in their opinions matches the proportion of those opinions that are true. Under certain conditions, people are systematically ‘over-calibrated’—for example, of the opinions they’re 80% confident in, only 60% are true. From this empirical over-calibration, it’s inferred that people are irrationally overconfident. My question: When and why is this inference warranted? Answering it requires articulating a general connection between being (...) rational and being right—something extant studies have not done. I show how to do so using the notion of deference. This provides a theoretical foundation for calibration research, but also reveals a flaw: the connection between being rational and being right is much weaker than is standardly assumed, since rational people can often be expected to be miscalibrated. Thus we can’t test whether people are overconfident by simply testing whether they are over-calibrated; instead, we must try to predict the rational deviations from calibration, and then compare those predictions to people’s performance. I show how this can be done—and that doing so complicates the interpretation of robust empirical effects. (shrink)

There is a widespread view that in order to be rational we must mostly know what we believe. In the probabilistic tradition this is defended by arguments that a person who failed to have this knowledge would be vulnerable to sure loss, or probabilistically incoherent. I argue that even gross failure to know one's own beliefs need not expose one to sure loss, and does not if we follow a generalization of the standard bridge principle between first-order and second-order beliefs. (...) This makes it possible for a subject to use probabilistic decision theory to manage in a rational way cases of potential failure of this self-knowledge, as we find in implicit bias. Through such cases I argue that it is possible for uncertainty about what our beliefs are to be not only rationally permissible but advantageous. (shrink)

Less discussed than Hume’s skepticism about what grounds there could be for projecting empirical hypotheses is his concern with a skeptical regress that he thought threatened to extinguish any belief when we reflect that our reasoning is not perfect. The root of the problem is the fact that a reflection about our reasoning is itself a piece of reasoning. If each reflection is negative and undermining, does that not give us a diminution of our original belief to nothing? It requires (...) much attention to detail, we argue, to determine whether or not there is a skeptical problem in this neighborhood. Consider that if we subsequently doubt a doubt we had about our reasoning, that would suggest a restoration of some of the force of our original belief. We would then have instead of runaway skepticism an alternating sequence of pieces of skeptical reasoning that cancel each others’ effects on our justification in the original proposition, at least to some degree. We will argue that the outcome of the sequence of reflections Hume is imagining depends on information about a given case that is not known a priori. We conclude this from the fact that under three precise, explanatory, and viable contemporary reconstructions of what this kind of reasoning about reasoning could be like and how it has the potential to affect our original beliefs, a belief-extinguishing regress is not automatic or necessary. (shrink)

Building on recent formal work by Aleks Knoks, we explore how the idea that certain epistemic norms may be indeterminate could be implemented in a default logic.

I argue that the skeptical force of a disagreement is mitigated to the extent that it is fundamental, where a fundamental disagreement is one that is driven by differences in epistemic starting points. My argument has three steps. First, I argue that proponents of conciliatory policies have good reason to affirm a view that I call “instrumentalism,” a view that commends treating our doxastic inclinations like instrumental readouts. Second, I show that instrumentalism supplies a basis for demanding conciliatory requirements in (...) superficial disagreements but not in fundamental disagreements. Third, I argue that the frequently invoked “independence” principle, which arguably would require significant conciliation in fundamental disputes, is unmotivated in light of the explanatory power of instrumentalism. The most plausible conciliatory view, then, is a weak conciliationism that features instrumentalism rather than independence as the central principle, and that therefore gives us a principled basis for thinking that fundamental disagreements should occasion less doxastic revision than shallow disagreements. (shrink)

On at least one of its uses, ‘higher-order evidence’ refers to evidence about what opinions are rationalized by your evidence. This chapter surveys the foundational epistemological questions raised by such evidence, the methods that have proven useful for answering them, and the potential consequences and applications of such answers.

Much work performed under the banner of social epistemology still centers the problems of the individual cognitive agent. AU distinguishes multiple senses of "social," some of which are more social than others, and argues that different senses are at work in various contributions to social epistemology. Drawing on work in history and philosophy of science and addressing the literature on testimony and disagreement in particular, this paper argues for a more thoroughgoing approach in social epistemology.

Plausibly, you should believe what your total evidence supports. But cases of misleading higher-order evidence—evidence about what your evidence supports—present a challenge to this thought. In such cases, taking both first-order and higher-order evidence at face value leads to a seemingly irrational incoherence between one’s first-order and higher-order attitudes: you will believe P, but also believe that your evidence doesn’t support P. To avoid sanctioning tension between epistemic levels, some authors have abandoned the thought that both first-order and higher-order evidence (...) have rational bearing. This sacrifice is both costly and unnecessary. We propose a principle, Evidential Calibration, which requires rational agents to accommodate first-order evidence correctly, while allowing rational uncertainty about what to believe. At the same time, it rules out irrational tensions between epistemic levels. We show that while there are serious problems for some views on which we can rationally believe, “P, but my evidence doesn’t support P”, Evidential Calibration avoids these problems. An important upshot of our discussion is a new way to think about the relationship between epistemic levels: why first-order and higher-order attitudes should generally be aligned, and why it is sometimes—though not always—problematic when they diverge. (shrink)

Conditionalization governs how to reallocate credence in light of new evidence. One prominent argument in favor of Conditionalization holds that an agent who violates it is vulnerable to a diachronic Dutch book: a series of acceptable bets offered at multiple times that inflict a sure loss. van Fraassen argues that an agent who violates the Principle of Reflection is likewise vulnerable to a diachronic Dutch book. He concludes that agents should conform to both Conditionalization and Reflection. Some authors reply that (...) Reflection is implausible and hence that there must be something wrong with diachronic Dutch book arguments. Other authors try to isolate a principled difference between the Dutch book argument for Conditionalization and the Dutch book argument for Reflection, such that the former argument may succeed even though the latter fails. I pursue a version of this strategy. I contend that, once we properly elucidate the notion of sure loss, non‐reflectors are not vulnerable to a sure loss. An agent who violates Reflection is not thereby subject to a diachronic Dutch book. Appearances to the contrary result from an unmotivated focus upon an overly narrow set of gambling scenarios. (shrink)

David Christensen and others argue that Dutch Strategies are more like peer disagreements than Dutch Books, and should not count against agents‘ conformity to ideal rationality. I review these arguments, then show that Dutch Books, Dutch Strategies, and peer disagreements are only possible in the case of what computer scientists call Byzantine Failures—uncorrected Byzantine Faults which update arbitrary values. Yet such Byzantine Failures make agents equally vulnerable to all three kinds of epistemic inconsistencies, so there is no principled basis for (...) claiming that only avoidance of true Dutch Books characterizes ideally rational agents. Agents without Byzantine Failures can be ideally rational in a very strong sense, but are not normative for humans. (shrink)

This paper considers two questions. First, what is the scope of the Equal Weight View? Is it the case that meeting halfway is the uniquely rational method of belief-revision in all cases of known peer disagreement? The answer is no. It is sometimes rational to maintain your own opinion in the face of peer disagreement. But this leaves open the possibility that the Equal Weight View is indeed sometimes the uniquely rational method of belief revision. Precisely what is the skeptical (...) import of this fact; is it the case that some form of skepticism triumphs in such cases? The answer to this question is also no. As it turns out, the situations in which it is most plausible that the Equal Weight view is a rational requirement are the ones in which meeting halfway with a disagreeing peer brings you closer to, and not farther from, knowledge. I argue for these theses in a novel way; by looking at the comparative reliability of belief- invariance and meeting halfway using measures of reliability for degrees of belief, and by drawing normative conclusions from such results. The conclusions here can have the effect of reframing the entire debate in the epistemology of disagreement. (shrink)

There has been considerable puzzlement over how to respond to higher-order evidence. The existing dilemmas can be defused by adopting a ‘two-dimensional’ representation of doxastic attitudes which incorporates not only substantive uncertainty about which first-order state of affairs obtains but also the degree of conviction with which we hold the attitude. This makes it possible that in cases of higher-order evidence the evidence sometimes impacts primarily on our conviction, rather than our substantive uncertainty. I argue that such a two-dimensional representation (...) is naturally developed by making use of imprecise probabilities. (shrink)

Higher-order evidence is evidence about what is rational to think in light of your evidence. Many have argued that it is special – falling into its own evidential category, or leading to deviations from standard rational norms. But it is not. Given standard assumptions, almost all evidence is higher-order evidence.

The prequel to this paper introduced the topic of iteration principles in epistemology and surveyed some arguments in support of them. In this sequel, I'll consider two influential families of objection to iteration principles. The first turns on the idea that they lead to some variety of skepticism, and the second turns on ‘margin for error’ considerations adduced by Timothy Williamson.

The new field of meta-research investigates industry bias, publication bias, contradictions between studies, and other trends in medical research. I argue that its findings should be used as meta-evidence for evaluating therapies. ‘Meta-evidence’ is evidence about the support that direct ‘first-order evidence’ provides the hypothesis. I consider three objections to my proposal: the irrelevance objection, the screening-off objection, and the underdetermination objection. I argue that meta-research evidence works by rationally revising our confidence in first-order evidence and, consequently, in the hypothesis—typically, (...) downward. (shrink)

How should you update your (degrees of) belief about a proposition when you find out that someone else — as reliable as you are in these matters — disagrees with you about its truth value? There are now several different answers to this question — the question of `peer disagreement' — in the literature, but none, I think, is plausible. Even more importantly, none of the answers in the literature places the peer-disagreement debate in its natural place among the most (...) general traditional concerns of normative epistemology. In this paper I try to do better. I start by emphasizing how we cannot and should not treat ourselves as `truthometers' — merely devices with a certain probability of tracking the truth. I argue that the truthometer view is the main motivation for the Equal Weight View in the context of peer disagreement. With this fact in mind, the discussion of peer disagreement becomes more complicated, sensitive to the justification of the relevant background degrees of belief (including the conditional ones), and to some of the most general points that arise in the context of discussions of scepticism. I argue that thus understood, peer disagreement is less special as an epistemic phenomenon than may be thought, and so that there is very little by way of positive theory that we can give about peer disagreement in general. (shrink)

Assume that it is your evidence that determines what opinions you should have. I argue that since you should take peer disagreement seriously, evidence must have two features. (1) It must sometimes warrant being modest: uncertain what your evidence warrants, and (thus) uncertain whether you’re rational. (2) But it must always warrant being guided: disposed to treat your evidence as a guide. Surprisingly, it is very difficult to vindicate both (1) and (2). But diagnosing why this is so leads to (...) a proposal—Trust—that is weak enough to allow modesty but strong enough to yield many guiding features. In fact, I claim that Trust is the Goldilocks principle—for it is necessary and sufficient to vindicate the claim that you should always prefer to use free evidence. Upshot: Trust lays the foundations for a theory of disagreement and, more generally, an epistemology that permits self-doubt—a modest epistemology. (shrink)

In 1962, the publication of Thomas Kuhn’s Structure ‘revolutionized’ the way one conducts philosophical and historical studies of science. Through the introduction of both memorable and controversial notions, such as paradigms, scientific revolutions, and incommensurability, Kuhn argued against the traditionally accepted notion of scientific change as a progression towards the truth about nature, and instead substituted the idea that science is a puzzle solving activity, operating under paradigms, which become discarded after it fails to respond accordingly to anomalous challenges and (...) a rival paradigm. Kuhn’s Structure has sold over 1.4 million copies and the Times Literary Supplement named it one of the “Hundred Most Influential Books since the Second World War.” Now, fifty years after this groundbreaking work was published, this volume offers a timely reappraisal of the legacy of Kuhn’s book and an investigation into what Structure offers philosophical, historical, and sociological studies of science in the future. (shrink)

When we get evidence that tells us our belief-forming mechanisms may not be reliable this presents a thorny set of questions about whether and how to revise our original belief. This article analyzes aspects of the problem and a variety of approaches to its solution.

In this introductory chapter, I first offer an overview of the two themes addressed in the present collection - namely, disagreement and skepticism - and their connection, then present the purpose and content of the volume.

Bayesian Epistemology is a general framework for thinking about agents who have beliefs that come in degrees. Theories in this framework give accounts of rational belief and rational belief change, which share two key features: (i) rational belief states are represented with probability functions, and (ii) rational belief change results from the acquisition of evidence. This dissertation focuses specifically on the second feature. I pose the Evidence Question: What is it to have evidence? Before addressing this question we must have (...) an understanding of Bayesian Epistemology. The first chapter argues that we should understand Bayesian Epistemology as giving us theories that are evaluative and not action-guiding. I reach this verdict after considering the popular ‘ought’-implies-‘can’ objection to Bayesian Epistemology. The second chapter argues that it is important for theories in Bayesian Epistemology to answer the Evidence Question, and distinguishes between internalist and externalist answers. The third and fourth chapters present and defend a specific answer to the Evidence Question. The account is inspired by reliabilist accounts of justification, and attempts to understand what it is to have evidence by appealing solely to considerations of reliability. Chapter 3 explains how to understand reliability, and how the account fits with Bayesian Epistemology, in particular, the requirement that an agent’s evidence receive probability 1. Chapter 4 responds to objections, which maintain that the account gives the wrong verdict in a variety of situations including skeptical scenarios, lottery cases, scientific cases, and cases involving inference. After slight modifications, I argue that my account has the resources to answer the objections. The fifth chapter considers the possibility of losing evidence. I show how my account can model these cases. To do so, however, we require a modification to Conditionalization, the orthodox principle governing belief change. I present such a modification. The sixth and seventh chapters propose a new understanding of Dutch Book Arguments, historically important arguments for Bayesian principles. The proposal shows that the Dutch Book Arguments for implausible principles are defective, while the ones for plausible principles are not. The final chapter is a conclusion. (shrink)

This paper argues for extreme rational permissivism—the view that agents with identical evidence can rationally believe contradictory hypotheses—and a mild version of steadfastness. Agents can rationally come to different conclusions on the basis of the same evidence because their way of weighing the theoretic virtues may differ substantially. Nevertheless, in the face of disagreement, agents face considerable pressure to reduce their confidence. Indeed, I argue that agents often ought to reduce their confidence in the higher-order propositions that they know or (...) rationally believe disputed content. I argue, however, that when the subject matter is difficult, there is more flexibility for agents to simultaneously believe that p while withholding belief about whether such belief is rational or known. This allows for modest steadfastness on hard questions in, e.g., philosophy and religion. (shrink)