The article begins by describing two longstanding problems associated with direct inference. One problem concerns the role of uninformative frequency statements in inferring probabilities by direct inference. A second problem concerns the role of frequency statements with gerrymandered reference classes. I show that past approaches to the problem associated with uninformative frequency statements yield the wrong conclusions in some cases. I propose a modification of Kyburg’s approach to the problem that yields the right conclusions. Past theories of direct inference have (...) postponed treatment of the problem associated with gerrymandered reference classes by appealing to an unexplicated notion of projectability . I address the lacuna in past theories by introducing criteria for being a relevant statistic . The prescription that only relevant statistics play a role in direct inference corresponds to the sort of projectability constraints envisioned by past theories. (shrink)

Cognitive Science, Volume 46, Issue 3, March 2022.

Various real and imagined criminal law cases rest on “naked statistical evidence”. That is, they rest more or less entirely on a probability for guilt/liability derived from a single statistical model. The intuition is that there is something missing in these cases, high as the probability for guilt/liability may be, such that the relevant standard for legal proof is not met. Here we contribute to the considerable debate about how this intuition is best explained and what it teaches us about (...) evidential reasoning in the legal setting. We part ways with the recent scholarship, however. Unlike most others, our diagnosis is not that there is an important qualitative property that some evidence or bodies of evidence have, and that naked statistical evidence, most strikingly, lacks. Rather, we see cases resting on naked statistical evidence as lying at the extreme of a continuum of cases that are vulnerable to challenge due to “meta-uncertainty” about the underlying model. (shrink)

In this paper, I provide an argument for rejecting Sarah Moss's recent account of legal proof. Moss's account is attractive in a number of ways. It provides a new version of a knowledge-based theory of legal proof that elegantly resolves a number of puzzles about mere statistical evidence in the law. Moreover, the account promises to have attractive implications for social and moral philosophy, in particular about the impermissibility of racial profiling and other harmful kinds of statistical generalisation. In this (...) paper, I show that Moss's account of legal proof crucially depends on a moral norm called the rule of consideration. I argue that we have a number of reasons to be sceptical of this rule. Once we reject the rule, it is not clear that Moss's account of legal proof is either plausible or attractive. (shrink)

It is one thing to hold that merely statistical evidence is _sometimes_ insufficient for rational belief, as in typical lottery and profiling cases. It is another thing to hold that merely statistical evidence is _always_ insufficient for rational belief. Indeed, there are cases where statistical evidence plainly does justify belief. This project develops a dispositional account of the normativity of statistical evidence, where the dispositions that ground justifying statistical evidence are connected to the goals (= proper function) of objects. There (...) are strong intuitive motivations for doing this. For we can turn almost any case of _non-justifying_ merely statistical evidence into a case of _justifying_ merely statistical evidence by adding information about the dispositions and goals of the objects involved. The resulting view not only helps us understand when and why merely statistical evidence is normatively significant, but it also helps us understand how statistical evidence relates to more standard forms of evidence (perceptual, testimonial). The emerging view also has surprising applications, as it imposes limitations on the epistemic value of fine-tuning arguments for theism as well as undermines a standard class of case-based arguments for moral encroachment. (shrink)

The notion of individualised evidence holds the key to solve the puzzle of statistical evidence, but there’s still no consensus on how exactly to define it. To make progress on the problem, epistemologists have proposed various accounts of individualised evidence in terms of causal or modal anti-luck conditions on knowledge like appropriate causation, sensitivity and safety. In this paper, I show that each of these fails as satisfactory anti-luck condition, and that such failure lends abductive support to the following conclusion: (...) once the familiar anti-luck intuition on knowledge is extended to individualised evidence, no single causal or modal anti-luck condition on knowledge can succeed as the right anti-luck condition on individualised evidence. This conclusion casts serious doubts on the fruitfulness of the move from anti-luck conditions on knowledge to anti-luck conditions on individualised evidence. I expand on these doubts and point out further aspects where epistemology and the law come apart: epistemic anti- luck conditions on knowledge do not adequately characterise the legal notion of individualised evidence. (shrink)

In this paper we explore the connections between ethics and decision theory. In particular, we consider the question of whether decision theory carries with it a bias towards consequentialist ethical theories. We argue that there are plausible versions of the other ethical theories that can be accommodated by “standard” decision theory, but there are also variations of these ethical theories that are less easily accommodated. So while “standard” decision theory is not exclusively consequentialist, it is not necessarily ethically neutral. Moreover, (...) even if our decision-theoretic models get the right answers vis-`a-vis morally correct action, the question remains as to whether the motivation for the non-consequentialist theories and the psychological processes of the agents who subscribe to those ethical theories are lost or poorly represented in the resulting models. (shrink)

I defend the thesis that legal standards of proof are reducible to thresholds of probability. Many have rejected this thesis because it seems to entail that defendants can be found liable solely on the basis of statistical evidence. I argue that this inference is invalid. I do so by developing a view, called Legal Causalism, that combines Thomson's (1986) causal analysis of evidence with recent work in formal theories of causal inference. On this view, legal standards of proof can be (...) reduced to probabilities, but deriving these probabilities involves more than just statistics. (shrink)

Law-enforcement agencies are increasingly able to leverage crime statistics to make risk predictions for particular individuals, employing a form of inference that some condemn as violating the right to be “treated as an individual.” I suggest that the right encodes agents’ entitlement to a fair distribution of the burdens and benefits of the rule of law. Rather than precluding statistical prediction, it requires that citizens be able to anticipate which variables will be used as predictors and act intentionally to avoid (...) them. Furthermore, it condemns reliance on various indexes of distributive injustice, or unchosen properties, as evidence of law-breaking. (shrink)

This paper concerns recent attempts to use the epistemological notions of sensitivity and safety to shed light on legal debates about so-called “bare” statistical evidence. These notions might be thought to explain either the outright inadmissibility of such evidence or its inadequacy for a finding of fact—two different phenomena that are often discussed in tandem, but that, I insist, we do better to keep separate. I argue that neither sensitivity nor safety can hope to explain statistical evidence’s inadmissibility, since neither (...) offers a plausible criterion of admissibility that would exclude such evidence; both are subject to copious counterexamples, especially given their factivity, and it is difficult even to state a coherent criterion of admissibility in terms of either sensitivity or safety. The possibility remains, though, that either notion might explain statistical evidence’s inadequacy for a finding of fact; I express some doubts about this possibility but do not rule it out. (shrink)

In this article, I argue that faith’s going beyond the evidence need not compromise faith’s epistemic rationality. First, I explain how some of the recent literature on belief and credence points to a distinction between what I call B-evidence and C-evidence. Then, I apply this distinction to rational faith. I argue that if faith is more sensitive to B-evidence than to C-evidence, faith can go beyond the evidence and still be epistemically rational.

I explore how rational belief and rational credence relate to evidence. I begin by looking at three cases where rational belief and credence seem to respond differently to evidence: cases of naked statistical evidence, lotteries, and hedged assertions. I consider an explanation for these cases, namely, that one ought not form beliefs on the basis of statistical evidence alone, and raise worries for this view. Then, I suggest another view that explains how belief and credence relate to evidence. My view (...) focuses on the possibilities that the evidence makes salient. I argue that this makes better sense of the difference between rational credence and rational belief than other accounts. (shrink)

Philosophical Issues, Volume 31, Issue 1, Page 146-166, October 2021.

Journal of Political Philosophy, EarlyView.

Epistemologists have posed the following puzzle, known as the proof paradox: Why is it intuitively problematic for juries to convict on the basis of statistical evidence and yet intuitively unproblematic for juries to convict on the basis of far less reliable, non-statistical evidence? To answer this question, theorists have explained the exclusion of statistical evidence by arguing that legal proof requires certain epistemic features. In this paper, I make two contributions to the debate. First, I establish the Criminal Verdict Asymmetry, (...) a previously-unarticulated asymmetry between the epistemic norms of guilty and not guilty verdicts. I argue that the prosecution and defense’s different epistemic burdens influence whether statistical evidence can generate the type of verdict each side pursues. Second, I point out a mistake in how theorists have understood the role of statistical evidence in criminal trials. Though epistemologists have primarily focused on whether statistical evidence can generate specific epistemic features required for convictions, I consider whether statistical evidence can demonstrate a lack of such features. I find that there are epistemic advantages to allowing the defense to introduce statistical evidence which can reveal the prosecution’s failure to prove the defendant’s guilt. (shrink)

It has recently been argued that some cases of naked statistical evidence license a high credence, but not an outright belief. If this is correct, there cannot be an unconditional bridge principle from credence to outright belief. We show that at least one prominent putative counterexample to such a bridge principle is based on a mistake, by demonstrating that the statistical evidence falls short not only of licensing rational belief, but also of justifying a high credence.

According to the Rational Threshold View, a rational agent believes p if and only if her credence in p is equal to or greater than a certain threshold. One of the most serious challenges for this view is the problem of statistical evidence: statistical evidence is often not sufficient to make an outright belief rational, no matter how probable the target proposition is given such evidence. This indicates that rational belief is not as sensitive to statistical evidence as rational credence. (...) The aim of this paper is twofold. First, we argue that, in addition to playing a decisive role in rationalizing outright belief, non-statistical evidence also plays a preponderant role in rationalizing credence. More precisely, when both types of evidence are present in a context, non-statistical evidence should receive a heavier weight than statistical evidence in determining rational credence. Second, based on this result, we argue that a modified version of the Rational Threshold View can avoid the problem of statistical evidence. We conclude by suggesting a possible explanation of the varying sensitivity to different types of evidence for belief and credence based on the respective aims of these attitudes. (shrink)

The law views with suspicion statistical evidence, even evidence that is probabilistically on a par with direct, individual evidence that the law is in no way suspicious of. But it has proved remarkably hard to either justify this suspicion, or to debunk it. In this paper, we connect the discussion of statistical evidence to broader epistemological discussions of similar phenomena. We highlight Sensitivity – the requirement that a belief be counterfactually sensitive to the truth in a specific way – as (...) a way of epistemically explaining the legal suspicion towards statistical evidence. Still, we do not think of this as a satisfactory vindication of the reluctance to rely on statistical evidence. Knowledge – and Sensitivity, and indeed epistemology in general – are of little, if any, legal value. Instead, we tell an incentive-based story vindicating the suspicion towards statistical evidence. We conclude by showing that the epistemological story and the incentive-based story are closely and interestingly related, and by offering initial thoughts about the role of statistical evidence in morality. (shrink)

Most social policies cannot be defended without making inductive inferences. For example, consider certain arguments for racial profiling and affirmative action, respectively. They begin with statistics about crime or socioeconomic indicators. Next, there is an inductive step in which the statistic is projected from the past to the future. Finally, there is a normative step in which a policy is proposed as a response in the service of some goal—for example, to reduce crime or to correct socioeconomic imbalances. In comparison (...) to the normative step, the inductive step of a policy defense may seem trivial. We argue that this is not so. Satisfying the demands of the inductive step is difficult, and doing so has important but underappreciated implications for the normative step. In this paper, we provide an account of induction in social contexts and explore its implications for policy. Our account helps to explain which normative principles we ought to accept, and as a result it can explain why it is acceptable to make inferences involving race in some contexts (e.g., in defense of affirmative action) but not in others (e.g., in defense of racial profiling). (shrink)

Many philosophers have pointed out that statistical evidence, or at least some forms of it, lack desirable epistemic or non-epistemic properties, and that this should make us wary of litigations in which the case against the defendant rests in whole or in part on statistical evidence. Others have responded that such broad reservations about statistical evidence are overly restrictive since appellate courts have expressed nuanced views about statistical evidence. In an effort to clarify and reconcile, I put forward an interpretive (...) analysis of why statistical evidence should raise concerns in some cases but not others. I argue that when there is a mismatch between the specificity of the evidence and the expected specificity of the accusation, statistical evidence—as any other kind of evidence—should be considered insufficient to sustain a conviction. I rely on different stylized court cases to illustrate the explanatory power of this analysis. (shrink)

Suppose one hundred prisoners are in a yard under the supervision of a guard, and at some point, ninety-nine of them collectively kill the guard. If, after the fact, a prisoner is picked at random and tried, the probability of his guilt is 99%. But despite the high probability, the statistical chances, by themselves, seem insufficient to justify a conviction. The question is why. Two arguments are offered. The first, decision-theoretic argument shows that a conviction solely based on the statistics (...) in the prisoner scenario is unacceptable so long as the goal of expected utility maximization is combined with fairness constraints. The second, risk-based argument shows that a conviction solely based on the statistics in the prisoner scenario lets the risk of mistaken conviction surge potentially too high. The same, by contrast, cannot be said of convictions solely based on DNA evidence or eyewitness testimony. A noteworthy feature of the two arguments in the paper is that they are not confined to criminal trials and can in fact be extended to civil trials. (shrink)

Arguments on legal evidence rely on generalizations, that link a certain circumstance to a certain hypothesis and warrants the claim that the circumstance makes the hypothesis more probable. Some generalizations are acceptable and others are unacceptable. A generalization can be unacceptable on at least four different grounds. A false generalization is unacceptable because membership in the reference class does not increase the probability of the hypothesis. A non-robust generalization is unacceptable because it uses a reference class that is too heterogeneous. (...) A biastriggering generalization is unacceptable because decision makers are inclined to overestimate the evidentiary value of membership in the reference class. A discriminating generalization is unacceptable because it puts members in the reference class in an unfair disadvantage. Research funded by the Swedish Research Council. (shrink)

Could it be right to convict and punish defendants using only statistical evidence? In this paper, I argue that it is not and explain why it would be wrong. This is difficult to do because there is a powerful argument for thinking that we should convict and punish defendants using statistical evidence. It looks as if the relevant cases are cases of decision under risk and it seems we know what we should do in such cases (i.e., maximize expected value). (...) Given some standard assumptions about the values at stake, the case for convicting and punishing using statistical evidence seems solid. In trying to show where this argument goes wrong, I shall argue (against Lockeans, reliabilists, and others) that beliefs supported only by statistical evidence are epistemically defective and (against Enoch, Fisher, and Spectre) that these epistemic considerations should matter to the law. To solve the puzzle about the role of statistical evidence in the law, we need to revise some commonly held assumptions about epistemic value and defend the relevance of epistemology to this practical question. (shrink)

The rapidly increasing role of automation throughout the economy, culture and our personal lives has generated a large literature on the risks of algorithmic decision-making, particularly in high-stakes legal settings. Algorithmic tools are charged with bias, shrouded in secrecy, and frequently difficult to interpret. However, these criticisms have tended to focus on particular implementations, specific predictive techniques, and the idiosyncrasies of the American legal-regulatory regime. They do not address the more fundamental unease about the prospect that we might one day (...) replace judges with algorithms, no matter how fair, transparent, and intelligible they become. The aim of this paper is to propose an account of the source of that unease, and to evaluate its plausibility. I trace foundational unease with algorithmic decision-making in the law to the powerful intuition that there is a basic moral and legal difference between showing that something is true of many people just like you and showing that it is true of you. Human judgment attends to the exception; automation insists on blindly applying the rule. I show how this intuitive thought is connected to both epistemological arguments about the value of statistical evidence, as well as to court-centered conceptions of the rule of law. Unease with algorithmic decision-making in the law thus draws on an intuitive principle that underpins a disparate range of views in legal philosophy. This suggests the principle is deeply ingrained. Nonetheless, I argue that the powerful intuition is not as decisive as it may seem, and indeed runs into significant epistemological and normative challenges. At an epistemological level, I show how concerns about statistical evidence's ability to track the truth can be resolved by adopting a probabilistic, rather than modal, conception of truth-tracking. At a normative level, commitment to highly individualized decision-making co-exists with equally ingrained and competing principles, such as consistent application of law. This suggests that the “rule of law” may not identify a discrete set of institutional arrangements, as proponents of a court-centric conception would have it, but rather a more loosely defined set of values that could potentially be operationalized in multiple ways, including through some level of algorithmic adjudication. Although the prospect of replacing judges with algorithms is indeed unsettling, it does not necessarily entail unreasonable verdicts or an attack on the rule of law. (shrink)

We frequently engage in activities that impose a risk of serious harm on innocent others in order to realise trivial benefits for ourselves or third parties. Many moral theories tie the evidence-relative permissibility of engaging in such activities to the size of the risk that an individual agent imposes. I argue that we should move away from such a reliance on quantified individual risks when conceptualising morally permissible risk imposition. Under most circumstances of interest, a conscientious reasoner will identify a (...) gap between the factors they deem potentially relevant to the riskiness of an agent’s behaviour, and the factors they are reasonably able to quantify. This then leads a conscientious reasoner to conclude that they cannot, in good faith, come up with a quantitative risk estimate that is genuinely tailored to the agent’s particular situation. Based on this, I argue that principles of morally permissible risk imposition fail to provide us with practical guidance if they ask us to take into account our agent-specific risks in a quantified manner. I also argue that principles of permissible risk imposition which appeal to quantified individual risks implausibly imply that it is frequently indeterminate whether engaging in some risky activity is morally permissible. For both of these reasons, I contend that principles of morally permissible risk imposition should make no reference to quantified individual risks. They should instead acknowledge that any quantitative estimates that an agent might usefully be able to consider will likely not be tailored to the agent’s idiosyncratic situation. (shrink)

There are currently two robust traditions in philosophy dealing with doxastic attitudes: the tradition that is concerned primarily with all-or-nothing belief, and the tradition that is concerned primarily with degree of belief or credence. This paper concerns the relationship between belief and credence for a rational agent, and is directed at those who may have hoped that the notion of belief can either be reduced to credence or eliminated altogether when characterizing the norms governing ideally rational agents. It presents a (...) puzzle which lends support to two theses. First, that there is no formal reduction of a rational agent’s beliefs to her credences, because belief and credence are each responsive to different features of a body of evidence. Second, that if our traditional understanding of our practices of holding each other responsible is correct, then belief has a distinctive role to play, even for ideally rational agents, that cannot be played by credence. The question of which avenues remain for the credence-only theorist is considered. (shrink)

This article surveys several interrelated issues in the metaphysics of chance. First, what is the relationship between the probabilities associated with types of trials (for instance, the chance that a twenty‐eight‐year old develops diabetes before age thirty) and the probabilities associated with individual token trials (for instance, the chance that I develop diabetes before age thirty)? Second, which features of the the world fix the chances: are there objective chances at all, and if so, are there non‐chancy facts on which (...) they supervene? Third, can chance be reconciled with determinism, and if so, how? (shrink)

This paper presents a puzzle about moral responsibility. The problem is based upon the indeterminacy of relevant reference classes as applied to action. After discussing and rejecting a very tempting response I propose moral contextualism instead, that is, the idea that the truth value of judgments of the form S is morally responsible for x depends on and varies with the context of the attributor who makes that judgment. Even if this reply should not do all the expected work it (...) is a first step. (shrink)

This paper discusses a novel problem at the intersection of ethics and epistemology: there can be cases in which moral considerations seem to "encroach'' upon belief from multiple directions at once, and possibly to varying degrees, thereby leaving their overall effect on belief unclear. We introduce these cases -- cases of moral encroachment under moral uncertainty -- and show that they pose a problem for all predominant accounts of moral encroachment. We then address the problem, by developing a modular Bayesian (...) framework that, we argue, is sufficiently flexible and scaleable to accommodate the multifaceted uncertainty we describe while still generating clear recommendations for an agent's beliefs. Our framework has several practical upshots, and we close by articulating them: we derive insights about the relationship between moral character and doxastic behavior and make suggestions for how to encourage people to revise their doxastic states in morally laudable ways, without deviating from core Bayesian norms. (shrink)

methods that have shown promise for improving extreme risk analysis, particularly for assessing the risks of invasive pests and pathogens associated with international trade. We describe the legally inspired regulatory regime for banks, where these methods have been brought to bear on extreme ‘operational risks’. We argue that an ‘advocacy model’ similar to that used in the Basel II compliance regime for bank operational risks and to a lesser extent in biosecurity import risk analyses is ideal for permitting the diversity (...) of relevant evidence about invasive species to be presented and soundly evaluated. We recommend that the process be enhanced in ways that enable invasion ecology to make more explicit use of the methods found successful.. (shrink)

Everyday life reasoning and argumentation is defeasible and uncertain. I present a probability logic framework to rationally reconstruct everyday life reasoning and argumentation. Coherence in the sense of de Finetti is used as the basic rationality norm. I discuss two basic classes of approaches to construct measures of argument strength. The first class imposes a probabilistic relation between the premises and the conclusion. The second class imposes a deductive relation. I argue for the second class, as the first class is (...) problematic if the arguments involve conditionals. I present a measure of argument strength that allows for dealing explicitly with uncertain conditionals in the premise set. (shrink)

In some cases, there appears to be an asymmetry in the evidential value of statistical and more individualized evidence. For example, while I may accept that Alex is guilty based on eyewitness testimony that is 80% likely to be accurate, it does not seem permissible to do so based on the fact that 80% of a group that Alex is a member of are guilty. In this paper I suggest that rather than reflecting a deep defect in statistical evidence, this (...) asymmetry might arise from a general constraint on rational inquiry. Plausibly the degree of evidential support needed to justify taking a proposition to be true depends on the stakes of error. While relying on statistical evidence plausibly raises the stakes by introducing new kinds of risk to members of the reference class, paradigmatically `individualized' evidence---evidence tracing back to A's voluntary behavior---can lower the stakes. The net result explains the apparent evidential asymmetry without positing a deep difference in the brute justificatory power of different types of evidence. (shrink)

Statistical discrimination is a form of discrimination that uses statistical inferences about the groups to which individuals belong as grounds for treating them differently. It remains unclear what, if anything, makes statistical discrimination wrong. My thesis argues that statistical discrimination is wrong because, and insofar as, it contributes to existing social injustice. After an introduction to the issues in section 1, section 2 clarifies the concept of statistical discrimination and its differences with non-statistical discrimination. Section 3 discusses different accounts that (...) seek to explain when and why statistical discrimination is wrong. I examine two approaches, one of which regards the wrong of statistical discrimination as part of discrimination in general, while the other conceives of the wrong as distinctive to statistical discrimination itself. I argue the former approach is better. Among different accounts within the approach, the context-based consequentialist account that explains the wrong in relation to existing social injustice is most promising. Section 4 uses racial profiling as an example to illustrate how the account can help explain this hard case of statistical discrimination, calling upon an argument developed by Benjamin Eidelson. (shrink)

Belief is a familiar attitude: taking something to be the case or regarding it as true. But we are more confident in some of our beliefs than in others. For this reason, many epistemologists appeal to a second attitude, called credence, similar to a degree of confidence. This raises the question: how do belief and credence relate to each other? On a belief-first view, beliefs are more fundamental and credences are a species of beliefs, e.g. beliefs about probabilities. On a (...) credence-first view, credences are more fundamental and beliefs are a species of credence, e.g. credence above some threshold. In this thesis, I develop and defend a third view that I call belief-credence dualism. On this view, belief and credence are independent, equally fundamental attitudes, and neither reduces to the other. I begin by motivating the project: why should we care about the relationship between belief and credence? I argue it has broad implications for many debates in epistemology and beyond. Then, I defend dualism, arguing that it can explain features of our mental lives that a credence-first view and a belief-first view cannot. I also argue that dualism has attractive, interesting implications when applied to the pragmatic encroachment debate. Finally, I explore implications of dualism, both for the nature of evidence and how faith might go beyond the evidence but nonetheless be epistemically rational. I conclude that the human mind is, in some ways, complex, but we should be happy with this conclusion also long as each mental state we posit has a clear role to play. (shrink)

Fifty years of effort in artificial intelligence (AI) and the formalization of legal reasoning have produced both successes and failures. Considerable success in organizing and displaying evidence and its interrelationships has been accompanied by failure to achieve the original ambition of AI as applied to law: fully automated legal decision-making. The obstacles to formalizing legal reasoning have proved to be the same ones that make the formalization of commonsense reasoning so difficult, and are most evident where legal reasoning has to (...) meld with the vast web of ordinary human knowledge of the world. Underlying many of the problems is the mismatch between the discreteness of symbol manipulation and the continuous nature of imprecise natural language, of degrees of similarity and analogy, and of probabilities. (shrink)

To be honest, I have almost nothing critical to say about Jim’s presentation (and this is quite unusual for a cranky analytic philosopher like me!). What Jim has said is all very sensible, and his examples are very well chosen, etc. So, instead of making critical remarks, I will try to expand a little on one of the themes Jim briefly touched upon in his talk: the contextuality of probability.