Biased research occurs frequently in the sciences. In this paper, I will focus on one particular kind of biased research: research that is subject to sponsorship bias. I will address the following epistemological question: what precisely is epistemically wrong with biased research of this kind? I will defend the evidential account of epistemic wrongness: that is, research affected by sponsorship bias is epistemically wrong if and only if the researchers in question make false claims about the evidential support of some (...) hypothesis H by data E. I will argue that the evidential account captures the epistemic wrongness of three paradigmatic types of sponsorship bias. (shrink)

Bayesian confirmation theories might be the best standing theories of confirmation to date, but they are certainly not paradox-free. Here I recognize that BCTs’ appeal mainly comes from the fact that they capture some of our intuitions about confirmation better than those the- ories that came before them and that the superiority of BCTs is suffi- ciently justified by those advantages. Instead, I will focus on Sylvan and Nola’s claim that it is desirable that our best theory of confirmation be (...) as paradox-free as possible. For this reason, I will show that, as they respond to different interests, the project of the BCTs is not incompatible with Sylvan and Nola’s project of a paradox-free confirmation logic. In fact, it will turn out that, provided we are ready to embrace some degree of non-classicality, both projects complement each other nicely. (shrink)

ABSTRACTIn this paper, I review some recent treatments of Simpson's Paradox, and I propose a new rationalizing explanation of its paradoxicality.

Originally identified by Hume, the validity of is–ought inference is much debated in the meta-ethics literature. Our work shows that inference from is to ought typically proceeds from contextualised, value-laden causal utility conditional, bridging into a deontic conclusion. Such conditional statements tell us what actions are needed to achieve or avoid consequences that are good or bad. Psychological research has established that people generally reason fluently and easily with utility conditionals. Our own research also has shown that people’s reasoning from (...) is to ought is pragmatically sensitive and adapted to achieving the individual’s goals. But how do we acquire the necessary deontic rules? In this paper, we provide a rationale for this facility linked to Evans’s framework of dual mind rationality. People have an old mind which derives its rationality by repeating what has worked in the past, mostly by experiential learning. New mind rationality, in contrast, is evolutionarily recent, uniquely developed in humans, and draws on our ability to mentally simulate hypothetical events removed in time and place. We contend that the new mind achieves its goals by inducing and applying deontic rules and that a mechanism of deontic introduction evolved for this purpose. (shrink)

Do people tend to be overconfident? Many think so. They’ve run studies on whether people are calibrated: whether their average confidence in their opinions matches the proportion of those opinions that are true. Under certain conditions, people are systematically ‘over-calibrated’—for example, of the opinions they’re 80% confident in, only 60% are true. From this empirical over-calibration, it’s inferred that people are irrationally overconfident. My question: When and why is this inference warranted? Answering it requires articulating a general connection between being (...) rational and being right—something extant studies have not done. I show how to do so using the notion of deference. This provides a theoretical foundation for calibration research, but also reveals a flaw: the connection between being rational and being right is much weaker than is standardly assumed, since rational people can often be expected to be miscalibrated. Thus we can’t test whether people are overconfident by simply testing whether they are over-calibrated; instead, we must try to predict the rational deviations from calibration, and then compare those predictions to people’s performance. I show how this can be done—and that doing so complicates the interpretation of robust empirical effects. (shrink)

Searching for information is critical in many situations. In medicine, for instance, careful choice of a diagnostic test can help narrow down the range of plausible diseases that the patient might have. In a probabilistic framework, test selection is often modeled by assuming that people's goal is to reduce uncertainty about possible states of the world. In cognitive science, psychology, and medical decision making, Shannon entropy is the most prominent and most widely used model to formalize probabilistic uncertainty and the (...) reduction thereof. However, a variety of alternative entropy metrics (Hartley, Quadratic, Tsallis, Rényi, and more) are popular in the social and the natural sciences, computer science, and philosophy of science. Particular entropy measures have been predominant in particular research areas, and it is often an open issue whether these divergences emerge from different theoretical and practical goals or are merely due to historical accident. Cutting across disciplinary boundaries, we show that several entropy and entropy reduction measures arise as special cases in a unified formalism, the Sharma–Mittal framework. Using mathematical results, computer simulations, and analyses of published behavioral data, we discuss four key questions: How do various entropy models relate to each other? What insights can be obtained by considering diverse entropy models within a unified framework? What is the psychological plausibility of different entropy models? What new questions and insights for research on human information acquisition follow? Our work provides several new pathways for theoretical and empirical research, reconciling apparently conflicting approaches and empirical findings within a comprehensive and unified information-theoretic formalism. (shrink)

Bayesian approaches to human cognition have been extensively advocated in the last decades, but sharp objections have been raised too within cognitive science. In this paper, we outline a diagnosis of what has gone wrong with the prevalent strand of Bayesian cognitive science (here labelled pure Bayesian cognitive science), relying on selected illustrations from the psychology of reasoning and tools from the philosophy of science. Bayesians’ reliance on so-called method of rational analysis is a key point of our discussion. We (...) tentatively conclude on a constructive note, though: an appropriately modified variant of Bayesian cognitive science can still be coherently pursued, as some scholars have noted. (shrink)

Matthew Benton, John Hawthorne, and Yoaav Isaacs (BHI) claim that evil must be evidence against God’s existence, because the absence of evil would be (presumably excellent) evidence for it. Their argument is obviously valid on standard Bayesian epistemology. But in addition to raising a few reasons one might doubt its premise, I here highlight the rather misleading meaning, in BHI’s argument, of evil’s being evidence against God. BHI seek to establish that if one learned simply “that there was evil,” perhaps (...) via an oracle, one would gain evidence of some strength or other against God. But when we commonly observe that there is evil in the world, we learn a stronger proposition. And determining the evidential impact of that stronger proposition is not so easy. The interesting questions about the evidential impact of even a general awareness of evil in the world remain open. (shrink)

In the present paper we empirically investigate the psychometric properties of some of the most famous statistical and logical cognitive illusions from the “heuristics and biases” research program by Daniel Kahneman and Amos Tversky, who nearly 50 years ago introduced fascinating brain teasers such as the famous Linda problem, the Wason card selection task, and so-called Bayesian reasoning problems (e.g., the mammography task). In the meantime, a great number of articles has been published that empirically examine single cognitive illusions, theoretically (...) explaining people’s faulty thinking, or proposing and experimentally implementing measures to foster insight and to make these problems accessible to the human mind. Yet these problems have thus far usually been empirically analyzed on an individual-item level only (e.g., by experimentally comparing participants’ performance on various versions of one of these problems). In this paper, by contrast, we examine these illusions as a group and look at the ability to solve them as a psychological construct. Based on an sample ofN= 2,643 Luxembourgian school students of age 16–18 we investigate the internal psychometric structure of these illusions (i.e., Are they substantially correlated? Do they form a reflexive or a formative construct?), their connection to related constructs (e.g., Are they distinguishable from intelligence or mathematical competence in a confirmatory factor analysis?), and the question of which of a person’s abilities can predict the correct solution of these brain teasers (by means of a regression analysis). (shrink)