Increasingly, epistemologists are becoming interested in social structures and their effect on epistemic enterprises, but little attention has been paid to the proper distribution of experimental results among scientists. This paper will analyze a model first suggested by two economists, which nicely captures one type of learning situation faced by scientists. The results of a computer simulation study of this model provide two interesting conclusions. First, in some contexts, a community of scientists is, as a whole, more reliable when its (...) members are less aware of their colleagues' experimental results. Second, there is a robust tradeoff between the reliability of a community and the speed with which it reaches a correct conclusion. ‡The author would like to thank Brian Skyrms, Kyle Stanford, Jeffrey Barrett, Bruce Glymour, and the participants in the Social Dynamics Seminar at University of California–Irvine for their helpful comments. Generous financial support was provided by the School of Social Science and Institute for Mathematical Behavioral Sciences at UCI. †To contact the author, please write to: Department of Philosophy, Baker Hall 135, Carnegie Mellon University, Pittsburgh, PA 15213-3890; e-mail: [email protected]. (shrink)

On appelle « biais de confirmation » la tendance supposée des humains à sélectionner les informations qui vont dans le sens de ce qu’ils croient (ou veulent croire) et à interpréter celles dont ils disposent en faveur de leurs hypothèses favorites. Cet article vise à porter un regard critique sur certains usages de cette notion, et plus généralement sur le recours aux « biais cognitifs » pour expliquer tout un ensemble de phénomènes sociaux interprétés comme les marques d’une forme d’irrationalité. (...) Remettant en question le caractère probant des résultats expérimentaux destinés à mettre en évidence une déviation qui nous conduirait systématiquement à des représentations inexactes, je suggère que l’approche bayésienne en psychologie du raisonnement permet de rendre compte de certains de ces résultats en faisant l’hypothèse que nos inférences se conforment à une telle norme. (shrink)

In this paper, I use a framework from computational linguistics, the Rational Speech Act framework, to model deceptive probabilistic communication. This account allows agents to discount for the biases they perceive their interlocutors to have. This way, agents can update their credences with the perceived interests of others in mind.

Can people efficiently navigate the modern communication environment, and if yes, how? We hypothesize that in addition to psychological capacities of epistemic vigilance, which evaluate the epistemic value of communicated information, some social institutions have evolved for the same function. Certain newspapers for instance, implement processes, distributed among several experts and tools, whose function is to curate information. We analyze how information curation is done at the institutional level and what challenges it meets. We also investigate what factors favor the (...) cultural evolution of institutions of epistemic vigilance: these include people’s preference for accurate and reliable information and their ability to assess communicated information in view of the source’s epistemic authority; but also contingent historical factors that make it worth—or not—to contribute to the maintenance of institutions of epistemic vigilance. We conclude the paper by considering the challenges and vulnerabilities of these institutions in the Digital Age. (shrink)

Influential classical and recent approaches to explicate confirmation, explanation, or explanatory power define these relations or degrees between hypotheses and evidence. This holds for both deductive and Bayesian approaches. However, this neglects the role of data, which for many everyday and scientific examples cannot simply be classified as evidence. I present arguments to sharply distinguish data from evidence in Bayesian approaches. Taking into account this distinction, we can rewrite Schupbach and Sprenger’s measure of explanatory power and show the strengths of (...) this adaptation by applying it to the example of the detection of gravitational waves in physics. (shrink)

Why are conditional degrees of belief in an observation E, given a statistical hypothesis H, aligned with the objective probabilities expressed by H? After showing that standard replies are not satisfactory, I develop a suppositional analysis of conditional degree of belief, transferring Ramsey’s classical proposal to statistical inference. The analysis saves the alignment, explains the role of chance-credence coordination, and rebuts the charge of arbitrary assessment of evidence in Bayesian inference. Finally, I explore the implications of this analysis for Bayesian (...) reasoning with idealized models in science. (shrink)

One of the most troubling and persistent challenges for Bayesian Confirmation Theory is the Problem of Old Evidence. The problem arises for anyone who models scientific reasoning by means of Bayesian Conditionalization. This article addresses the problem as follows: First, I clarify the nature and varieties of the POE and analyze various solution proposals in the literature. Second, I present a novel solution that combines previous attempts while making weaker and more plausible assumptions. Third and last, I summarize my findings (...) and put them into the context of the general debate about POE and Bayesian reasoning. (shrink)

Focused correlation compares the degree of association within an evidence set to the degree of association in that evidence set given that some hypothesis is true. A difference between the confirmation lent to a hypothesis by one evidence set and the confirmation lent to that hypothesis by another evidence set is robustly tracked by a difference in focused correlations of those evidence sets on that hypothesis, provided that all the individual pieces of evidence are equally, positively relevant to that hypothesis. (...) However, that result depends on a very strong equal relevance condition on individual pieces of evidence. In this essay, we prove tracking results for focused correlation analogous to Wheeler and Scheines’s results but for cases involving unequal relevance. Our result is robust as well, and we retain conditions for bidirectional tracking between incremental confirmation measures and focused correlation. (shrink)

Two recently popular metaphilosophical movements, formal philosophy and experimental philosophy, promote what seem to be conflicting methodologies. Nonetheless, I argue that the two can be mutually supportive. I propose an experimentally-informed variation on explication, a powerful formal philosophical tool introduced by Carnap. The resulting method, which I call “experimental explication,” provides the formalist with a means of responding to explication's gravest criticism. Moreover, this method introduces a philosophically salient, positive role for survey-style experiments while steering clear of several objections that (...) critics of “positive experimental philosophy” raise. Thus, it provides the experimentalist with a more defensible example of how empirical work can have positive philosophical import. For these reasons, experimental explication should appeal to experimental philosophers and formal philosophers alike. (shrink)

Computational modeling should play a central role in philosophy. In this introduction to our topical collection, we propose a small topology of computational modeling in philosophy in general, and show how the various contributions to our topical collection fit into this overall picture. On this basis, we describe some of the ways in which computational models from other disciplines have found their way into philosophy, and how the principles one found here still underlie current trends in the field. Moreover, we (...) argue that philosophers contribute to computational modeling not only by building their own models, but also by thinking about the various applications of the method in philosophy and the sciences. In this context, we note that models in philosophy are usually simple, while models in the sciences are often more complex and empirically grounded. Bridging certain methodological gaps that arise from this discrepancy may prove to be challenging and fruitful for the further development of computational modeling in philosophy and beyond. (shrink)

In the social sciences, research on conspiracy theories is accumulating fast. To contribute to this research, here I introduce a computational model about the psychological processes underlying support for conspiracy theories. The proposal is that endorsement of these theories depends on three factors: prior beliefs, novel evidence, and expected consequences. Thanks to the latter, a conspiracy hypothesis might be selected because it is the costliest to reject even if it is not the best supported by evidence and by prior beliefs (...) (i.e., even if it is not the most accurate). In this way, the model implies a key role for motivated reasoning. By examining the social conditions that favour the success of conspiracy theories, the paper embeds the model, whose focus is primarily psychological, within the broader social context, and applies this analysis to probe the role of conspiracy theories within contemporary Western societies. Altogether, the paper argues that a computational outlook can contribute to elucidate the socio-psychological dynamics underlying the attractiveness of conspiracy theories. (shrink)

Amalgamating evidence from heterogeneous sources and across levels of inquiry is becoming increasingly important in many pure and applied sciences. This special issue provides a forum for researchers from diverse scientific and philosophical perspectives to discuss evidence amalgamation, its methodologies, its history, its pitfalls, and its potential. We situate the contributions therein within six themes from the broad literature on this subject: the variety-of-evidence thesis, the philosophy of meta-analysis, the role of robustness/sensitivity analysis for evidence amalgamation, its bearing on questions (...) of extrapolation and external validity of experiments, its connection with theory development, and its interface with causal inference, especially regarding causal theories of cancer. (shrink)

This article seeks, first, to show that much of the existing normative work on argument from expert opinion (AEO) is problematic for failing to be properly informed by empirical findings on expert performance. Second, it seeks to show how, with the analytic tool of Bayesian reasoning, the problem diagnosed can be remedied to circumvent some of the problems facing the scheme-based treatment of AEOs. To establish the first contention, we will illustrate how empirical studies on factors conditioning expert reliability can (...) be drawn upon to re-construct. Walton’s critical questions matching the scheme of AEOs. To establish the second contention, we will illustrate how Walton’s re-constructed set of critical questions can be formalized within a Bayesian network. Finally, we will highlight how the specific ways in which the Bayesian framework we propose is both continuous with and distinct from the models of source reliability put forward by theorists like Bovens and Hartmann (2003). (shrink)

Susanna Schellenberg develops a unified account—“capacitism”—of perceptual content, phenomenology, and epistemic force. In this paper, I raise questions about her arguments for a capacitist account of evidential force, and then challenge her claim that such an account, even if correct, demands that our evidence be less than fully transparent to us.

This paper proposes a framework for representing in Bayesian terms the idea that analogical arguments of various degrees of strength may provide inductive support to yet untested scientific hypotheses. On this account, contextual information plays a crucial role in determining whether, and to what extent, a given similarity or dissimilarity between source and target may confirm an empirical hypothesis over a rival one. In addition to showing confirmation by analogy compatible with the adoption of a Bayesian standpoint, the proposal outlined (...) in this paper reveals a close agreement between the fulfillment of Hesse’s (Models and analogies in science, University of Notre Dame Press, 1963) criteria for analogical arguments capable of inductive support and the attribution of confirmatory power by the lights of Bayesian confirmation theory. In this sense, the Bayesian representation not only enriches a framework, Hesse’s, of enduring relevance for understanding scientific activity, but may offer something akin to a proof of concept of it. (shrink)

The paper introduces, compares and contrasts formal models of source reliability proposed in the epistemology literature, in particular the prominent models of Bovens and Hartmann and Olsson :127–143, 2011). All are Bayesian models seeking to provide normative guidance, yet they differ subtly in assumptions and resulting behavior. Models are evaluated both on conceptual grounds and through simulations, and the relationship between models is clarified. The simulations both show surprising similarities and highlight relevant differences between these models. Most importantly, however, our (...) evaluations reveal that important normative concerns arguably remain unresolved. The philosophical implications of this for testimony are discussed. (shrink)

In the latter half of the twentieth century, philosophers of science have argued (implicitly and explicitly) that epistemically rational individuals might compose epistemically irrational groups and that, conversely, epistemically rational groups might be composed of epistemically irrational individuals. We call the conjunction of these two claims the Independence Thesis, as they together imply that methodological prescriptions for scientific communities and those for individual scientists might be logically independent of one another. We develop a formal model of scientific inquiry, define four (...) criteria for individual and group epistemic rationality, and then prove that the four definitions diverge, in the sense that individuals will be judged rational when groups are not and vice versa. We conclude by explaining implications of the inconsistency thesis for (i) descriptive history and sociology of science and (ii) normative prescriptions for scientific communities. (shrink)

To what end should or do we pursue philosophy and how? Meta-philosophical questions along these lines have gained more and more interest recently. The collected volume ‘‘Erkenntnistheorie—Wie und wozu?’’ (Engl.: ‘‘Epistemology—How and to what end?’’) aspires to raise and tackle issues addressing the meta-epistemological questions ‘‘How is epistemology practiced and to what end?’’ (9). Although this aim sounds like a descriptive meta-epistemological endeavor, it is not surprising that many authors rather argue for normative claims surrounding the questions ‘‘How and to (...) what end should epistemology be pursued?’’. This review provides an overview on the collected volume and offers a critical evaluation of its overall achievement. (shrink)

Varied evidence confirms more strongly than less varied evidence, ceteris paribus. This epistemological Variety of Evidence Thesis enjoys widespread intuitive support. We put forward a novel explication of one notion of varied evidence and the Variety of Evidence Thesis within Bayesian models of scientific inference by appealing to measures of entropy. Our explication of the Variety of Evidence Thesis holds in many of our models which also pronounce on disconfirmatory and discordant evidence. We argue that our models pronounce rightly. Against (...) a backdrop of failures of the Variety of Evidence Thesis, the intuitive case for the Variety of Evidence Thesis emerges strengthened. Our models do however not support the general case for the thesis since our explication of it fails to hold in certain cases. The parameter space of this failure is explored and an explanation for the failure is offered. (shrink)

This is a paper about the methodology of normative ethics. I claim that much work in normative ethics can be interpreted as modelling, the form of inquiry familiar from science, involving idealised representations. I begin with the anti-theory debate in ethics, and note that the debate utilises the vocabulary of scientific theories without recognising the role models play in science. I characterise modelling, and show that work with these characteristics is common in ethics. This establishes the plausibility of my interpretation. (...) Taking methodological inspiration from modelling in science gives us new tools for managing idealisations, and a new perspective on pluralism. I demonstrate why this interpretation is a fruitful way of interpreting ethics, by looking at three case studies. First, I return to the anti-theory debate and argue that modelling opens up a new middle ground. Second, I argue that a modelling lens offers a new way of understanding impossibility theorems in population ethics, and their bearing on ethics as a whole. Finally, I show how viewing our work as modelling can be deployed in debates within ethics, using the debate over prioritarianism as an example. I close with further methodological suggestions for those who choose to see themselves as modellers. I discuss the role of counterexamples, our responses to moral disagreement, and the training of new ethicists. (shrink)

Eyewitness testimony is both an important and a notoriously unreliable type of criminal evidence. How should investigators, lawyers and decision-makers evaluate eyewitness reliability? In this article, I argue that Testimonial Inference to the Best Explanation is a promising, but underdeveloped prescriptive account of eyewitness evaluation. On this account, we assess the reliability of eyewitnesses by comparing different explanations of how their testimony came about. This account is compatible with, and complementary to both the Bayesian framework of rational eyewitness evaluation and (...) with prescriptive methods for eyewitness assessment developed by psychologists. Compared to these frameworks, the distinctive value of thinking in terms of competing explanations is that it helps us select, interpret and draw conclusions from the available evidence about the witness’s reliability. (shrink)

Agreement between "independent" measurements of a theoretically posited quantity is intuitively compelling evidence that a theory is, loosely speaking, on the right track. But exactly what conclusion is warranted by such agreement? I propose a new account of the phenomenon's epistemic significance within the framework of Bayesian epistemology. I contrast my proposal with the standard Bayesian treatment, which lumps the phenomenon under the heading of "evidential diversity".

Metacognitive mental states are mental states about mental states. For example, I may be uncertain whether my belief is correct. In social discourse, an interlocutor’s metacognitive certainty may constitute evidence about the reliability of their testimony. For example, if a speaker is certain that their belief is correct, then we may take this as evidence in favour of their belief, or its content. This paper argues that, if metacognitive certainty is genuine evidence, then it is disproportionate evidence for extreme beliefs. (...) In support of the argument, we report findings from five studies with different participant samples, designs, and measures. These studies show that, the more extreme an agent’s belief (positive or negative), the more certain they are about it, and vice versa. This relationship might contribute to moralism, virtue signalling, and polarisation, which in turn may be epistemically and morally problematic. Therefore, we caution against taking metacognitive certainty as genuine evidence. (shrink)

We argue that social deliberation may increase an agent’s confidence and credence under certain circumstances. An agent considers a proposition H and assigns a probability to it. However, she is not fully confident that she herself is reliable in this assignment. She then endorses H during deliberation with another person, expecting him to raise serious objections. To her surprise, however, the other person does not raise any objections to H. How should her attitudes toward H change? It seems plausible that (...) she should increase the credence she assigns to H and, at the same time, increase the reliability she assigns to herself concerning H. A Bayesian model helps us to investigate under what conditions, if any, this is rational. (shrink)

Here I critically assess an argument put forward by Kuorikoski et al. (Br J Philos Sci, 61(3):541–567, 2010) for the epistemic import of model-based robustness analysis. I show that this argument is not sound since the sort of probabilistic independence on which it relies is unfeasible. By revising the notion of probabilistic independence imposed on the models’ results, I introduce a prima-facie more plausible argument. However, despite this prima-facie plausibility, I show that even this new argument is unsound in most (...) if not all cases of model-based robustness analysis. This I do to demonstrate that the epistemic import of model-based robust analysis cannot be satisfactorily defended on the basis of probabilistic independence. (shrink)

Topics in Cognitive Science, Volume 14, Issue 3, Page 602-620, July 2022.

Our scientific theories, like our cognitive structures in general, consist of propositions linked by evidential, explanatory, probabilistic, and logical connections. Those theoretical webs ‘impinge on the world at their edges,’ subject to a continuing barrage of incoming evidence. Our credences in the various elements of those structures change in response to that continuing barrage of evidence, as do the perceived connections between them. Here we model scientific theories as Bayesian nets, with credences at nodes and conditional links between them modelled (...) as conditional probabilities. We update those networks, in terms of both credences at nodes and conditional probabilities at links, through a temporal barrage of random incoming evidence. Robust patterns of punctuated equilibrium, suggestive of ‘normal science’ alternating with ‘paradigm shifts,’ emerge prominently in that change dynamics. The suggestion is that at least some of the phenomena at the core of the Kuhnian tradition are predictable in the typical dynamics of scientific theory change captured as Bayesian nets under even a random evidence barrage. (shrink)

We model scientific theories as Bayesian networks. Nodes carry credences and function as abstract representations of propositions within the structure. Directed links carry conditional probabilities and represent connections between those propositions. Updating is Bayesian across the network as a whole. The impact of evidence at one point within a scientific theory can have a very different impact on the network than does evidence of the same strength at a different point. A Bayesian model allows us to envisage and analyze the (...) differential impact of evidence and credence change at different points within a single network and across different theoretical structures. (shrink)

The new field of meta-research investigates industry bias, publication bias, contradictions between studies, and other trends in medical research. I argue that its findings should be used as meta-evidence for evaluating therapies. ‘Meta-evidence’ is evidence about the support that direct ‘first-order evidence’ provides the hypothesis. I consider three objections to my proposal: the irrelevance objection, the screening-off objection, and the underdetermination objection. I argue that meta-research evidence works by rationally revising our confidence in first-order evidence and, consequently, in the hypothesis—typically, (...) downward. (shrink)

Wilcox proposed an argument against imprecise probabilities and for the principle of indifference based on a thought experiment where he argues that it is very intuitive to feel that one’s confidence in drawing a ball of a given colour out of an unknown urn should decrease while the number of potential colours in the urn increases. In my response to him, I argue that one’s intuitions may be unreliable because it is very hard to truly feel completely ignorant in such (...) a situation. I further argue that Wilcox must also account for the conflicting intuition that it is absurd to have to feel completely convinced that a specific claim about reality is true _in the absence of any evidence_ in order to avoid being irrational. It is dubious that this intuition is considerably less universal and strongly-held than Wilcox’s own intuition. Finally, I point out that even if Wilcox’s intuition were to be universally shared among members of our biological species, it is far from being clear that someone refusing to let that intuition dictate his or her beliefs would be irrational. For all these reasons, I believe that Wilcox was not successful in proving that philosophers and scientists representing uncertainty through imprecise probabilities are violating the principles of rationality. (shrink)

In this article, we address a major outstanding question of probabilistic Bayesian epistemology: how should a rational Bayesian agent update their beliefs upon learning an indicative conditional? A number of authors have recently contended that this question is fundamentally underdetermined by Bayesian norms, and hence that there is no single update procedure that rational agents are obliged to follow upon learning an indicative conditional. Here we resist this trend and argue that a core set of widely accepted Bayesian norms is (...) sufficient to identify a normatively privileged updating procedure for this kind of learning. Along the way, we justify a privileged formalization of the notion of ‘epistemic conservativity’, offer a new analysis of the Judy Benjamin problem, and emphasize the distinction between interpreting the content of new evidence and updating one’s beliefs on the basis of that content. (shrink)

Inference to the Best Explanation is usually employed in the Scientific Realism debates. As far as particular scientific theories are concerned, its most ready usage seems to be that of a theory of confirmation. There are however more uses of IBE, namely as an epistemological theory of testimony and as a means of categorising and justifying the sources of evidence. In this paper, I will present, develop and exemplify IBE as a theory of the quality of evidence - taking examples (...) from medicine and showing that IBE can thereby provide the epistemological underpinning and justify the criteria of grading quality of mechanistic evidence that have been recently provided in the Clarke et al. paper on how evidence of medical mechanisms is to be construed alongside population studies. (shrink)

Many cognitive psychologists have come to regard graded belief as fundamental to our understanding of how humans reason and many have also come to think of probability theory as providing at least part of the norms of correct reasoning. David Over has characterized this development as the emergence of a new paradigm in the Kuhnian sense. The target article argues that the choice of this term was unwarranted and also that it has done more harm than good. This commentary argues (...) that there is nothing in Thomas Kuhn’s work to suggest that he would object to Over’s terminological choice and that there is no evidence that the choice has caused any harm. (shrink)

We argue that all comparative expressions in natural language obey a principle that we call Comparability: if x and y are at least as F as themselves, then either x is at least as F as y or y is at least as F as x. This principle has been widely rejected among philosophers, especially by ethicists, and its falsity has been claimed to have important normative implications. We argue that Comparability is needed to explain the goodness of several patterns (...) of inference that seem manifestly valid, that the purported failures of Comparability would have absurd consequences, and that the influential arguments against Comparability are less compelling than they may have initially seemed. (shrink)

Molinists hold that there are contingently true counterfactuals about what agents would do if put in specific circumstances, that God knows these prior to creation, and that God uses this knowledge in choosing how to create. In this essay we critique Molinism, arguing that if these theses were true, agents would not be free. Consider Eve’s sinning upon being tempted by a serpent. We argue that if Molinism is true, then there is some set of facts that fully explains both (...) Eve’s action and everything else Eve does that influences that action; and that if this is the case, Eve does not act freely. The first premise of this argument follows from the explanatory relations the Molinist is committed to, and the second premise follows from libertarian intuitions about free will. (shrink)

The variety-of-evidence thesis has been criticized by Bovens and Hartmann. This article points to two limitations of their Bayesian model: the conceptualization of unreliable evidential sources as randomizing and the restriction to comparing full independence to full dependence. It is shown that the variety-of-evidence thesis is rehabilitated when unreliable sources are reconceptualized as systematically biased. However, it turns out that allowing for degrees of independence leads to a qualification of the variety-of-evidence thesis: as Bovens and Hartmann claimed, more independence does (...) not always imply stronger confirmation. (shrink)

Introduction to Synthese SI: Systematicity: The Nature of Science?

Some authors claim that minimal models have limited epistemic value (Fumagalli, 2016; Grüne-Yanoff, 2009a). Others defend the epistemic benefits of modelling by invoking the role of robustness analysis for hypothesis confirmation (see, e.g., Levins, 1966; Kuorikoski et al., 2010) but such arguments find much resistance (see, e.g., Odenbaugh & Alexandrova, 2011). In this paper, we offer a Bayesian rationalization and defence of the view that robustness analysis can play a confirmatory role, and thereby shed light on the potential of minimal (...) models for hypothesis confirmation. We illustrate our argument by reference to a case study from macroeconomics. At the same time, we also show that there are cases in which robustness analysis is detrimental to confirmation. We characterize these cases and link them to recent investigations on evidential variety (Landes, 2020b, 2021; Osimani and Landes, forthcoming). We conclude that robustness analysis over minimal models can confirm, but its confirmatory value depends on concrete circumstances. (shrink)

As a general rule, whenever a hearer is justified in forming the belief that p on the basis of a speaker’s testimony, she will also be justified in assuming that the speaker has formed her belief appropriately in light of a relevantly large and representative sample of the evidence that bears on p. In simpler terms, a justification for taking someone’s testimony entails a justification for trusting her assessment of the evidence. This introduces the possibility of what I will call (...) “evidential preemption.” Evidential preemption occurs when a speaker, in addition to offering testimony that p, also warns the hearer of the likelihood that she will subsequently be confronted with apparently contrary evidence: this is done, however, not so as to encourage the hearer to temper her confidence in p in anticipation of that evidence, but rather to suggest that the (apparently) contrary evidence is in fact misleading evidence or evidence that has already been taken into account. Either way, the speaker is signalling to the hearer that the subsequent disclosure of this evidence will not require her to significantly revise her belief that p. Such preemption can effectively inoculate an audience against future contrary evidence, and thereby creates an opening for a form of exploitative manipulation that I will call “epistemic grooming.” Nonetheless, I argue, not all uses of evidential preemption are nefarious; it can also serve as an important tool for guiding epistemically limited agents though complex evidential scenarios. (shrink)