Some early phase clinical studies of candidate HIV cure and remission interventions appear to have adverse medical risk–benefit ratios for participants. Why, then, do people participate? And is it ethically permissible to allow them to participate? Recent work in decision theory sheds light on both of these questions, by casting doubt on the idea that rational individuals prefer choices that maximise expected utility, and therefore by casting doubt on the idea that researchers have an ethical obligation not (...) to enrol participants in studies with high risk–benefit ratios. This work supports the view that researchers should instead defer to the considered preferences of the participants themselves. This essay briefly explains this recent work, and then explores its application to these two questions in more detail. (shrink)

I have claimed that risk-weighted expected utility maximizers are rational, and that their preferences cannot be captured by expected utility theory. Richard Pettigrew and Rachael Briggs have recently challenged these claims. Both authors argue that only EU-maximizers are rational. In addition, Pettigrew argues that the preferences of REU-maximizers can indeed be captured by EU theory, and Briggs argues that REU-maximizers lose a valuable tool for simplifying their decision problems. I hold that their arguments do (...) not succeed and that my original claims still stand. However, their arguments do highlight some costs of REU theory. (shrink)

This article argues that Lara Buchak’s risk-weighted expected utility (REU) theory fails to offer a true alternative to expected utility theory. Under commonly held assumptions about dynamic choice and the framing of decision problems, rational agents are guided by their attitudes to temporally extended courses of action. If so, REU theory makes approximately the same recommendations as expected utility theory. Being more permissive about dynamic choice or framing, however, undermines the theory’s claim (...) to capturing a steady choice disposition in the face of risk. I argue that this poses a challenge to alternatives to expected utility theory more generally. (shrink)

The orthodox theory of instrumental rationality, expected utility (EU) theory, severely restricts the way in which risk-considerations can figure into a rational individual's preferences. It is argued here that this is because EU theory neglects an important component of instrumental rationality. This paper presents a more general theory of decision-making, risk-weighted expected utility (REU) theory, of which expected utility maximization is a special case. According to REU theory, the weight that each (...) outcome gets in decision-making is not the subjective probability of that outcome; rather, the weight each outcome gets depends on both its subjective probability and its position in the gamble. Furthermore, the individual's utility function, her subjective probability function, and a function that measures her attitude towards risk can be separately derived from her preferences via a Representation Theorem. This theorem illuminates the role that each of these entities plays in preferences, and shows how REU theory explicates the components of instrumental rationality. (shrink)

When you are indifferent between two options, it’s rationally permissible to take either. One way to decide between two such options is to flip a fair coin, taking one option if it lands heads and the other if it lands tails. Is it rationally permissible to employ such a tie-breaking procedure? Intuitively, yes. However, if you are genuinely risk-averse—in particular, if you adhere to risk-weighted expected utility theory (Buchak in Risk and rationality, Oxford University (...) Press, 2013) and have a strictly convex risk-function—the answer will often be no: the REU of deciding by coin-flip will be lower than the REU of choosing one of the options outright (so long as at least one of the options is a nondegenerate gamble). This turns out to be a significant worry for risk-weighted expected utility theory. I argue that it adds real bite to established worries about diachronic consistency afflicting views, like risk-weighted expected utility theory, that violate Independence. And that, while these worries might be surmountable, surmounting them comes at a price. (shrink)

Ramsey (1926) sketches a proposal for measuring the subjective probabilities of an agent by their observable preferences, assuming that the agent is an expected utility maximizer. I show how to extend the spirit of Ramsey's method to a strictly wider class of agents: risk-weighted expected utility maximizers (Buchak 2013). In particular, I show how we can measure the risk attitudes of an agent by their observable preferences, assuming that the agent is a (...) class='Hi'>risk-weighted expected utility maximizer. Further, we can leverage this method to measure the subjective probabilities of a risk-weighted expected utility maximizer. (shrink)

It is widely held that the influence of risk on rational decisions is not entirely explained by the shape of an agent’s utility curve. Buchak (Erkenntnis, 2013, Risk and rationality, Oxford University Press, Oxford, in press) presents an axiomatic decision theory, risk-weighted expected utility theory (REU), in which decision weights are the agent’s subjective probabilities modified by his risk-function r. REU is briefly described, and the global applicability of r is discussed. Rabin’s (...) (Econometrica 68:1281–1292, 2000) calibration theorem strongly suggests that plausible levels of risk aversion cannot be fully explained by concave utility functions; this provides motivation for REU and other theories. But applied to the synchronic preferences of an individual agent, Rabin’s result is not as problematic as it may first appear. Theories that treat outcomes as gains and losses (e.g. prospect theory and cumulative prospect theory) account for risk sensitivity in a way not available to REU. Reference points that mark the difference between gains and losses are subject to framing, many instances of which cannot be regarded as rational. However, rational decision theory may recognize the difference between gains and losses, without endorsing all ways of fixing the point of reference. In any event, REU is a very interesting theory. (shrink)

Lara Buchak argues for a version of rank-weighted utilitarianism that assigns greater weight to the interests of the worse off. She argues that our distributive principles should be derived from the preferences of rational individuals behind a veil of ignorance, who ought to be risk averse. I argue that Buchak’s appeal to the veil of ignorance leads to a particular way of extending rank-weighted utilitarianism to the evaluation of uncertain prospects. This method recommends choices that violate the (...) unanimous preferences of rational individuals and choices that guarantee worse distributions. These results, I suggest, undermine Buchak’s argument for rank-weighted utilitarianism. (shrink)

This paper aims to address the question of how one ought to choose when one is uncertain about what outcomes will result from one’s choices, but when one can nevertheless assign probabilities to the different possible outcomes. These choices are commonly referred to as choices (or decisions) under risk. I assume in this paper that one ought to make instrumentally rational choices—more precisely, one ought to adopt suitable means to one’s morally permissible ends. Expected utility (EU) theory (...) is generally accepted as a normative theory of rational choice under risk, or, more specifically, as a theory of instrumental rationality. According to EU theory, when faced with a decision under risk, one ought to rank one’s options (from least to most choiceworthy) according to their EU and one ought to choose whichever option carries the greatest EU (or one of them in the event that several alternatives are tied). The EU of an option is a probability-weighted sum of each of its possible utilities. In this paper, I argue that EU theory is not the correct theory of instrumental rationality. In its place, I argue for a new theory of instrumental rationality, namely expected comparative utility (ECU) theory. I first show that for any choice option, a, and for any state of the world, G, the measure of the choiceworthiness of a in G is the comparative utility of a in G—that is, the difference in utility, in G, between a and whichever alternative to a carries the greatest utility in G. On the basis of this principle, I then argue, roughly speaking, that for any agent, S, faced with any decision under risk, S ought to rank her options (in terms of how choiceworthy they are) according to their ECU and S ought to choose whichever option carries the greatest ECU (or one of them in the event that several alternatives are tied). For any option, a, a’s ECU is a probability‐weighted sum of a’s comparative utilities across the various possible states of the world. In this paper, I show that in some commonplace decisions under risk, ECU theory delivers different verdicts from those of EU theory. (shrink)

A natural view in distributive ethics is that everyone's interests matter, but the interests of the relatively worse off matter more than the interests of the relatively better off. I provide a new argument for this view. The argument takes as its starting point the proposal, due to Harsanyi and Rawls, that facts about distributive ethics are discerned from individual preferences in the "original position." I draw on recent work in decision theory, along with an intuitive principle about risk-taking, (...) to derive the view. (shrink)

Can it be rational to be risk-averse? It seems plausible that the answer is yes—that normative decision theory should accommodate risk aversion. But there is a seemingly compelling class of arguments against our most promising methods of doing so. These long-run arguments point out that, in practice, each decision an agent makes is just one in a very long sequence of such decisions. Given this form of dynamic choice situation, and the (Strong) Law of Large Numbers, they conclude (...) that those theories which accommodate risk aversion end up delivering the same verdicts as risk-neutral theories in nearly all practical cases. If so, why not just accept a simpler, risk-neutral theory? The resulting practical verdicts seem to be much the same. In this paper, I show that these arguments do not in fact condemn those risk-aversion-accommodating theories. Risk aversion can indeed survive the long run. (shrink)

A review of some major topics of debate in normative decision theory from circa 2007 to 2019. Topics discussed include the ongoing debate between causal and evidential decision theory, decision instability, risk-weighted expected utility theory, decision-making with incomplete preferences, and decision-making with imprecise credences.

Two key questions of normative decision theory are: 1) whether the probabilities relevant to decision theory are evidential or causal; and 2) whether agents should be risk-neutral, and so maximise the expected value of the outcome, or instead risk-averse (or otherwise sensitive to risk). These questions are typically thought to be independent---that our answer to one bears little on our answer to the other. But there is a surprising argument that they are not. In this paper, (...) I show that evidential decision theory implies risk neutrality, at least in moral decision-making and at least on plausible empirical assumptions. Take any risk-aversion-accommodating decision theory, apply it using the probabilities prescribed by evidential decision theory, and every verdict of moral betterness you reach will match those of expected value theory. (shrink)

The paper summarizes expected utility theory, both in its original von Neumann-Morgenstern version and its later developments, and discusses the normative claims to rationality made by this theory.

We give two social aggregation theorems under conditions of risk, one for constant population cases, the other an extension to variable populations. Intra and interpersonal welfare comparisons are encoded in a single ‘individual preorder’. The theorems give axioms that uniquely determine a social preorder in terms of this individual preorder. The social preorders described by these theorems have features that may be considered characteristic of Harsanyi-style utilitarianism, such as indifference to ex ante and ex post equality. However, the theorems (...) are also consistent with the rejection of all of the expected utility axioms, completeness, continuity, and independence, at both the individual and social levels. In that sense, expected utility is inessential to Harsanyi-style utilitarianism. In fact, the variable population theorem imposes only a mild constraint on the individual preorder, while the constant population theorem imposes no constraint at all. We then derive further results under the assumption of our basic axioms. First, the individual preorder satisfies the main expected utility axiom of strong independence if and only if the social preorder has a vector-valued expected total utility representation, covering Harsanyi’s utilitarian theorem as a special case. Second, stronger utilitarian-friendly assumptions, like Pareto or strong separability, are essentially equivalent to strong independence. Third, if the individual preorder satisfies a ‘local expected utility’ condition popular in non-expected utility theory, then the social preorder has a ‘local expected total utility’ representation. Fourth, a wide range of non-expected utility theories nevertheless lead to social preorders of outcomes that have been seen as canonically egalitarian, such as rank-dependent social preorders. Although our aggregation theorems are stated under conditions of risk, they are valid in more general frameworks for representing uncertainty or ambiguity. (shrink)

Longtermism is the view that the most urgent global priorities, and those to which we should devote the largest portion of our resources, are those that focus on (i) ensuring a long future for humanity, and perhaps sentient or intelligent life more generally, and (ii) improving the quality of the lives that inhabit that long future. While it is by no means the only one, the argument most commonly given for this conclusion is that these interventions have greater expected (...) goodness per unit of resource devoted to them than each of the other available interventions, including those that focus on the health and well-being of the current population. In this paper, I argue that, even if we grant the consequentialist ethics upon which this argument depends, and even if we grant one of the axiologies that are typically paired with that ethics to give the argument, we are not morally required to choose an option that maximises expected utility; indeed, we might not even be permitted to do so. Instead, I will argue, if the argument's consequentialism is correct, we should choose using a decision theory that is sensitive to risk, and allows us to give greater weight to worse-case outcomes than expected utility theory does. And, I will show, such decision theories do not always recommend longtermist interventions. Indeed, sometimes, they recommend exactly the opposite: sometimes, they recommend hastening human extinction. Many, though not all, will take this as a reductio of the consequentialism or the axiology of the argument. I remain agnostic on the conclusion we should draw. (shrink)

The paper re-expresses arguments against the normative validity of expected utility theory in Robin Pope (1983, 1991a, 1991b, 1985, 1995, 2000, 2001, 2005, 2006, 2007). These concern the neglect of the evolving stages of knowledge ahead (stages of what the future will bring). Such evolution is fundamental to an experience of risk, yet not consistently incorporated even in axiomatised temporal versions of expected utility. Its neglect entails a disregard of emotional and financial effects on well-being (...) before a particular risk is resolved. These arguments are complemented with an analysis of the essential uniqueness property in the context of temporal and atemporal expected utility theory and a proof of the absence of a limit property natural in an axiomatised approach to temporal expected utility theory. Problems of the time structure of risk are investigated in a simple temporal framework restricted to a subclass of temporal lotteries in the sense of David Kreps and Evan Porteus (1978). This subclass is narrow but wide enough to discuss basic issues. It will be shown that there are serious objections against the modification of expected utility theory axiomatised by Kreps and Porteus (1978, 1979). By contrast the umbrella theory proffered by Pope that she has now termed SKAT, the Stages of Knowledge Ahead Theory, offers an epistemically consistent framework within which to construct particular models to deal with particular decision situations. A model by Caplin and Leahy (2001) will also be discussed and contrasted with the modelling within SKAT (Pope, Leopold and Leitner 2007). (shrink)

In a recent paper, Björn Lundgren and H. Orri Stefánsson (forthcoming) present three objections to normic de minimis expected utility theory (NDEUT) – a decision theoretic framework defended in Smith (2024). In this paper, I respond to these objections and outline some possible ways in which NDEUT might be modified or further developed. Like any de minimis framework, NDEUT employs a risk threshold to sort possibilities into those that must be considered when making a decision, and those (...) that can be legitimately ignored – the so-called ‘de minimis risks’. While this threshold would usually take the form of a probability value, in NDEUT the de minimis risks are identified instead on the basis of their abnormality. In the first section I will set up some of the formalism used in NDEUT and consider Lundgren and Stefánsson’s first objection – which is essentially formal in nature. In the second section I will delve further into the interpretation of NDEUT and consider the second and third objections, which turn on particular examples. (shrink)

The principle that rational agents should maximize expected utility or choiceworthiness is intuitively plausible in many ordinary cases of decision-making under uncertainty. But it is less plausible in cases of extreme, low-probability risk (like Pascal's Mugging), and intolerably paradoxical in cases like the St. Petersburg and Pasadena games. In this paper I show that, under certain conditions, stochastic dominance reasoning can capture most of the plausible implications of expectational reasoning while avoiding most of its pitfalls. Specifically, given (...) sufficient background uncertainty about the choiceworthiness of one's options, many expectation-maximizing gambles that do not stochastically dominate their alternatives "in a vacuum" become stochastically dominant in virtue of that background uncertainty. But, even under these conditions, stochastic dominance will not require agents to accept options whose expectational superiority depends on sufficiently small probabilities of extreme payoffs. The sort of background uncertainty on which these results depend looks unavoidable for any agent who measures the choiceworthiness of her options in part by the total amount of value in the resulting world. At least for such agents, then, stochastic dominance offers a plausible general principle of choice under uncertainty that can explain more of the apparent rational constraints on such choices than has previously been recognized. (shrink)

According to Stephen Finlay, ‘A ought to X’ means that X-ing is more conducive to contextually salient ends than relevant alternatives. This in turn is analysed in terms of probability. I show why this theory of ‘ought’ is hard to square with a theory of a reason’s weight which could explain why ‘A ought to X’ logically entails that the balance of reasons favours that A X-es. I develop two theories of weight to illustrate my point. I first look at (...) the prospects of a theory of weight based on expected utility theory. I then suggest a simpler theory. Although neither allows that ‘A ought to X’ logically entails that the balance of reasons favours that A X-es, this price may be accepted. For there remains a strong pragmatic relation between these claims. (shrink)

Neoclassical economists use expected utility theory to explain, predict, and prescribe choices under risk, that is, choices where the decision-maker knows---or at least deems suitable to act as if she knew---the relevant probabilities. Expected utility theory has been subject to both empirical and conceptual criticism. This chapter reviews expected utility theory and the main criticism it has faced. It ends with a brief discussion of subjective expected utility theory, which is the (...) theory neoclassical economists use to explain, predict, and prescribe choices under uncertainty, that is, choices where the decision-maker cannot act on the basis of objective probabilities but must instead consult her own subjective probabilities. (shrink)

We present a minimal pragmatic restriction on the interpretation of the weights in the “Equal Weight View” regarding peer disagreement and show that the view cannot respect it. Based on this result we argue against the view. The restriction is the following one: if an agent, $$\hbox {i}$$ i, assigns an equal or higher weight to another agent, $$\hbox {j}$$ j,, he must be willing—in exchange for a positive and certain payment—to accept an offer to let a completely rational and (...) sympathetic $$\hbox {j}$$ j choose for him whether to accept a bet with positive expected utility. If $$\hbox {i}$$ i assigns a lower weight to $$\hbox {j}$$ j than to himself, he must not be willing to pay any positive price for letting $$\hbox {j}$$ j choose for him. Respecting the constraint entails, we show, that the impact of disagreement on one’s degree of belief is not independent of what the disagreement is discovered to be. (shrink)

We investigate risk attitudes when the underlying domain of payoffs is finite and the payoffs are, in general, not numerical. In such cases, the traditional notions of absolute risk attitudes, that are designed for convex domains of numerical payoffs, are not applicable. We introduce comparative notions of weak and strong risk attitudes that remain applicable. We examine how they are characterized within the rank-dependent utility model, thus including expected utility as a special case. In (...) particular, we characterize strong comparative risk aversion under rank-dependent utility. This is our main result. From this and other findings, we draw two novel conclusions. First, under expected utility, weak and strong comparative risk aversion are characterized by the same condition over finite domains. By contrast, such is not the case under non-expected utility. Second, under expected utility, weak comparative risk aversion is characterized by the same condition when the utility functions have finite range and when they have convex range. By contrast, such is not the case under non-expected utility. Thus, considering comparative risk aversion over finite domains leads to a better understanding of the divide between expected and non-expected utility, more generally, the structural properties of the main models of decision-making under risk. (shrink)

According to the orthodox treatment of risk preferences in decision theory, they are to be explained in terms of the agent's desires about concrete outcomes. The orthodoxy has been criticised both for conflating two types of attitudes and for committing agents to attitudes that do not seem rationally required. To avoid these problems, it has been suggested that an agent's attitudes to risk should be captured by a risk function that is independent of her utility and (...) probability functions. The main problem with that approach is that it suggests that attitudes to risk are wholly distinct from people's (non-instrumental) desires. To overcome this problem, we develop a framework where an agent's utility function is defined over chance propositions (i.e., propositions describing objective probability distributions) as well as ordinary (non-chance) ones, and argue that one should explain different risk attitudes in terms of different forms of the utility function over such propositions. (shrink)

A moderately risk averse person may turn down a 50/50 gamble that either results in her winning $200 or losing $100. Such behaviour seems rational if, for instance, the pain of losing $100 is felt more strongly than the joy of winning $200. The aim of this paper is to examine an influential argument that some have interpreted as showing that such moderate risk aversion is irrational. After presenting an axiomatic argument that I take to be the strongest (...) case for the claim that moderate risk aversion is irrational, I show that it essentially depends on an assumption that those who think that risk aversion can be rational should be skeptical of. Hence, I conclude that risk aversion need not be irrational. (shrink)

Bartha and DesRoches (Synthese 199(3–4):8701–8740, 2021) and Steel and Bartha (Risk Analysis 43(2):260–268, 2023) argue that we should understand the precautionary principle as the injunction to maximise lexical utilities. They show that the lexical utility model has important pragmatic advantages. Moreover, the model has the theoretical advantage of satisfying all axioms of expected utility theory except continuity. In this paper I raise a trilemma for any attempt at modelling the precautionary principle with lexical utilities: it permits (...) choice cycles or leads to paralysis or implies that the smallest value difference that is possible in a context has extreme axiological implications. (shrink)

Veritism says that the fundamental source of epistemic value for a doxastic state is the extent to which it represents the world correctly: that is, its fundamental epistemic value is deter...

A de minimis risk is defined as a risk that is so small that it may be legitimately ignored when making a decision. While ignoring small risks is common in our day-to-day decision making, attempts to introduce the notion of a de minimis risk into the framework of decision theory have run up against a series of well-known difficulties. In this paper, I will develop an enriched decision theoretic framework that is capable of overcoming two major obstacles (...) to the modelling of de minimis risk. The key move is to introduce, into decision theory, a non-probabilistic conception of risk known as normic risk. (shrink)

I argue that prioritarianism cannot be assessed in abstraction from an account of the measure of utility. Rather, the soundness of this view crucially depends on what counts as a greater, lesser, or equal increase in a person’s utility. In particular, prioritarianism cannot accommodate a normatively compelling measure of utility that is captured by the axioms of John von Neumann and Oskar Morgenstern’s expected utility theory. Nor can it accommodate a plausible and elegant generalization of (...) this theory that has been offered in response to challenges to von Neumann and Morgenstern. This is, I think, a theoretically interesting and unexpected source of difficulty for prioritarianism, which I explore in this article. (shrink)

With the growing focus on prevention in medicine, studies of how to describe risk have become increasing important. Recently, some researchers have argued against giving patients “comparative risk information,” such as data about whether their baseline risk of developing a particular disease is above or below average. The concern is that giving patients this information will interfere with their consideration of more relevant data, such as the specific chance of getting the disease (the “personal risk”), the (...) risk reduction the treatment provides, and any possible side effects. I explore this view and the theories of rationality that ground it, and I argue instead that comparative risk information can play a positive role in decision-making. The criticism of disclosing this sort of information to patients, I conclude, rests on a mistakenly narrow account of the goals of prevention and the nature of rational choice in medicine. (shrink)

Suppose that a decision-maker's aim, under certainty, is to maximise some continuous value, such as lifetime income or continuous social welfare. Can such a decision-maker rationally satisfy what has been called "continuity for easy cases" while at the same time satisfying what seems to be a widespread intuition against the full-blown continuity axiom of expected utility theory? In this note I argue that the answer is "no": given transitivity and a weak trade-off principle, continuity for easy cases violates (...) the anti-continuity intuition. I end the note by exploring an even weaker continuity condition that is consistent with the aforementioned intuition. (shrink)

For aggregative theories of moral value, it is a challenge to rank worlds that each contain infinitely many valuable events. And, although there are several existing proposals for doing so, few provide a cardinal measure of each world's value. This raises the even greater challenge of ranking lotteries over such worlds—without a cardinal value for each world, we cannot apply expected value theory. How then can we compare such lotteries? To date, we have just one method for doing so (...) (proposed separately by Arntzenius, Bostrom, and Meacham), which is to compare the prospects for value at each individual location, and to then represent and compare lotteries by their expected values at each of those locations. But, as I show here, this approach violates several key principles of decision theory and generates some implausible verdicts. I propose an alternative—one which delivers plausible rankings of lotteries, which is implied by a plausible collection of axioms, and which can be applied alongside almost any ranking of infinite worlds. (shrink)

Many argue that absolutist moral theories -- those that prohibit particular kinds of actions or trade-offs under all circumstances -- cannot adequately account for the permissibility of risky actions. In this dissertation, I defend various versions of absolutism against this critique, using overlooked resources from formal decision theory. Against the prevailing view, I argue that almost all absolutist moral theories can give systematic and plausible verdicts about what to do in risky cases. In doing so, I show that critics have (...) overlooked: (1) the fact that absolutist theories -- and moral theories, more generally -- underdetermine their formal decision-theoretic representations; (2) that decision theories themselves can be generalised to better accommodate distinctively absolutist commitments. Overall, this dissertation demonstrates that we can navigate a risky world without compromising our moral commitments. (shrink)

Whereas many others have scrutinized the Allais paradox from a theoretical angle, we study the paradox from an historical perspective and link our findings to a suggestion as to how decision theory could make use of it today. We emphasize that Allais proposed the paradox asa normative argument, concerned with ‘the rational man’ and not the ‘real man’, to use his words. Moreover, and more subtly, we argue that Allais had an unusual sense of the normative, being concerned not so (...) much with therationality of choicesas with therationality of the agent as a person. These two claims are buttressed by a detailed investigation – the first of its kind – of the 1952 Paris conference on risk, which set the context for the invention of the paradox, and a detailed reconstruction – also the first of its kind – of Allais’s specific normative argument from his numerous but allusive writings. The paper contrasts these interpretations of what the paradox historically represented, with how it generally came to function within decision theory from the late 1970s onwards: that is, as an empirical refutation of the expected utility hypothesis, and more specifically of the condition of von Neumann–Morgenstern independence that underlies that hypothesis. While not denying that this use of the paradox was fruitful in many ways, we propose another use that turns out also to be compatible with an experimental perspective. Following Allais’s hints on ‘the experimental definition of rationality’, this new use consists inletting the experiment itself speak of the rationality or otherwise of the subjects. In the 1970s, a short sequence of papers inspired by Allais implemented original ways of eliciting the reasons guiding the subjects’ choices, and claimed to be able to draw relevant normative consequences from this information. We end by reviewing this forgotten experimental avenue not simply historically, but with a view to recommending it for possible use by decision theorists today. (shrink)

According to the priority view, or prioritarianism, it matters more to benefit people the worse off they are. But how exactly should the priority view be defined? This article argues for a highly general characterization which essentially involves risk, but makes no use of evaluative measurements or the expected utility axioms. A representation theorem is provided, and when further assumptions are added, common accounts of the priority view are recovered. A defense of the key idea behind the (...) priority view, the priority principle, is provided. But it is argued that the priority view fails on both ethical and conceptual grounds. (shrink)

A moral requirement R1 is said to be lexically prior to a moral requirement R2 just in case we are morally obliged to uphold R1 at the expense of R2 – no matter how many times R2 must be violated thereby. While lexical priority is a feature of many ethical theories, and arguably a part of common sense morality, attempts to model it within the framework of decision theory have led to a series of problems – a fact which is (...) sometimes spun as a ‘decision theoretic critique’ of lexical priority. In this paper, I develop an enriched decision theoretic framework that is capable of modelling lexical priority while avoiding all extant problems. This will involve introducing several new ingredients into the standard decision theoretic framework, including multidimensional utilities, de minimis risks, and the means to represent two different conceptions of risk. (shrink)

A strongly independent preorder on a possibly in finite dimensional convex set that satisfi es two of the following conditions must satisfy the third: (i) the Archimedean continuity condition; (ii) mixture continuity; and (iii) comparability under the preorder is an equivalence relation. In addition, if the preorder is nontrivial (has nonempty asymmetric part) and satisfi es two of the following conditions, it must satisfy the third: (i') a modest strengthening of the Archimedean condition; (ii') mixture continuity; and (iii') completeness. Applications (...) to decision making under conditions of risk and uncertainty are provided. (shrink)

In a well-known paper, Nick Bostrom presents a confrontation between a fictionalised Blaise Pascal and a mysterious mugger. The mugger persuades Pascal to hand over his wallet by exploiting Pascal's commitment to expected utility maximisation. He does so by offering Pascal an astronomically high reward such that, despite Pascal's low credence in the mugger's truthfulness, the expected utility of accepting the mugging is higher than rejecting it. In this article, I present another sort of high value, (...) low credence mugging. This time, the mugger utilises research on existential risk and the long-term potential of humanity to exploit Pascal's expected-utility-maximising descendant. This mugging is more insidious than Bostrom's original as it relies on plausible facts about the long-term future, as well as realistic credences about how our everyday actions could, albeit with infinitesimally low likelihood, affect the future of humanity. (shrink)

We provide conditions under which an incomplete strongly independent preorder on a convex set X can be represented by a set of mixture preserving real-valued functions. We allow X to be infi nite dimensional. The main continuity condition we focus on is mixture continuity. This is sufficient for such a representation provided X has countable dimension or satisfi es a condition that we call Polarization.

The difference between the unity of the individual and the separateness of persons requires that there be a shift in the moral weight that we accord to changes in utility when we move from making intrapersonal tradeoffs to making interpersonal tradeoffs. We examine which forms of egalitarianism can, and which cannot, account for this shift. We argue that a form of egalitarianism which is concerned only with the extent of outcome inequality cannot account for this shift. We also argue (...) that a view which is concerned with both outcome inequality and with the unfairness of inequality in individuals‘ expected utilities can account for this shift. Finally, we limn an alternative view, on.. (shrink)

Risky prospects represent policies that impose different types of risks on multiple people. I present an example from food safety. A utilitarian following Harsanyi's Aggregation Theorem ranks such prospects according to their mean expected utility or the expectation of the social utility. Such a ranking is not sensitive to any of four types of distributional concerns. I develop a model that lets the policy analyst rank prospects relative to the distributional concerns that she considers fitting in the (...) context at hand. I name this model ‘the Distribution View’ posing an alternative to Parfit's Priority View for risky prospects. (shrink)

Assuming that votes are independent, the epistemically optimal procedure in a binary collective choice problem is known to be a weighted supermajority rule with weights given by personal log-likelihood-ratios. It is shown here that an analogous result holds in a much more general model. Firstly, the result follows from a more basic principle than expected-utility maximisation, namely from an axiom (Epistemic Monotonicity) which requires neither utilities nor prior probabilities of the ‘correctness’ of alternatives. Secondly, a person’s input (...) need not be a vote for an alternative, it may be any type of input, for instance a subjective degree of belief or probability of the correctness of one of the alternatives. The case of a profile of subjective degrees of belief is particularly appealing, since here no parameters such as competence parameters need to be known. (shrink)

Considerations of dynamic inconsistency have figured prominently in debates over the rationality of preferences that violate the separability conditions characteristic of expected utility theory. These debates have mostly focused on risk- and ambiguity averse preferences, but analogous considerations apply to preferences for fairness. We revisit these debates in the context of a specific hypothesis regarding the violations of separability by such preferences, namely that they are potentially both explained and rationalised by attitudes to the chances of goods (...) that motivate a preference for equality in the distribution of chances across people and possible events. Our main aim is to argue that, first, when these violations of static separability are motivated by such attitudes to chances, then they need not result in dynamically inconsistent behaviour. Second, and more generally, considerations of dynamic consistency do not, we argue, undermine the rationality of such attitudes towards the distribution of chances, despite the fact that such attitudes give rise to violations of the static separability assumptions of expected utility theory. (shrink)

This paper presents an argument that certain AI safety measures, rather than mitigating existential risk, may instead exacerbate it. Under certain key assumptions - the inevitability of AI failure, the expected correlation between an AI system's power at the point of failure and the severity of the resulting harm, and the tendency of safety measures to enable AI systems to become more powerful before failing - safety efforts have negative expected utility. The paper examines three response (...) strategies: Optimism, Mitigation, and Holism. Each faces challenges stemming from intrinsic features of the AI safety landscape that we term Bottlenecking, the Perfection Barrier, and Equilibrium Fluctuation. The surprising robustness of the argument forces a re-examination of core assumptions around AI safety and points to several avenues for further research. (shrink)

In the context of a global pandemic, there is good health-based reason for governments to impose various social distancing measures. However, such measures also cause economic and other harms to people at low risk from the virus. In this paper, I examine how to make such trade-offs in a way that is respectfully justifiable to their losers. I argue that existing proposals like using standard QALY (quality-adjusted life-year) valuations or WELLBYs (wellbeing-adjusted life-years) as the currency for trade-offs do not (...) allow such justification, because they give weight to utilities that are irrelevant in a life-and-death context. Drawing on work on restricted aggregation in ethics, I articulate an alternative framework for balancing claims arising from prospects of different kinds of harm and benefit, and show how it can be applied to reasoning about trade-offs in a pandemic context. (shrink)

The basic axioms or formal conditions of decision theory, especially the ordering condition put on preferences and the axioms underlying the expected utility formula, are subject to a number of counter-examples, some of which can be endowed with normative value and thus fall within the ambit of a philosophical reflection on practical rationality. Against such counter-examples, a defensive strategy has been developed which consists in redescribing the outcomes of the available options in such a way that the threatened (...) axioms or conditions continue to hold. We examine how this strategy performs in three major cases: Sen's counterexamples to the binariness property of preferences, the Allais paradox of EU theory under risk, and the Ellsberg paradox of EU theory under uncertainty. We find that the strategy typically proves to be lacking in several major respects, suffering from logical triviality, incompleteness, and theoretical insularity. To give the strategy more structure, philosophers have developed “principles of individuation”; but we observe that these do not address the aforementioned defects. Instead, we propose the method of checking whether the strategy can overcome its typical defects once it is given a proper theoretical expansion. We find that the strategy passes the test imperfectly in Sen's case and not at all in Allais's. In Ellsberg's case, however, it comes close to meeting our requirement. But even the analysis of this more promising application suggests that the strategy ought to address the decision problem as a whole, rather than just the outcomes, and that it should extend its revision process to the very statements it is meant to protect. Thus, by and large, the same cautionary tale against redescription practices runs through the analysis of all three cases. A more general lesson, simply put, is that there is no easy way out from the paradoxes of decision theory. (shrink)

Consider a subjective expected utility preference relation. It is usually held that the representations which this relation admits differ only in one respect, namely, the possible scales for the measurement of utility. In this paper, I discuss the fact that there are, metaphorically speaking, two additional dimensions along which infinitely many more admissible representations can be found. The first additional dimension is that of state-dependence. The second—and, in this context, much lesser-known—additional dimension is that of act-dependence. The (...) simplest implication of their usually neglected existence is that the standard axiomatizations of subjective expected utility fail to provide the measurement of subjective probability with satisfactory behavioral foundations. (shrink)

Grey zone attacks tend to paralyze response for two reasons. First, they present us with choice scenarios of inherently dilemmatic structure, e.g., Prisoners’ Dilemmas and games of chicken, complicated by difficult conditions of choice, such as choice under risk or amid vagueness. Second, they exploit our uncertainty about how much we do or should care about the things under attack¬—each attack is small in effect, but their effects accumulate: how should we decide whether to treat a given attack as (...) something meriting a serious response rather than a mere irritation to be ignored? This chapter brings standard decision theoretic tools to bear on the issues, tools such as the maximization of expected utility principle, and the precautionary principle. But it also develops three innovations. It shows that seeing it as possible to make choices not just of actions given our values, but also choices of values themselves, can extricate us from certain kinds of decision paralysis. It shows how we can rationally regard ourselves as having bright decision lines even when nothing in the circumstance of choice has these lines in its structure. And it shows how certain conflict escalation risks from the former two strategies can be managed by both parties seeing that cooperation can yield a sharable surplus of goods, and that cooperation can be rational upon a rationally defensible change in their values so that each comes to derive utility from the success of both parties. This yields cooperative solutions to what amount to Prisoners’ Dilemmas. The Cold War was prosecuted on the logic of strategic rationality and that part of game theory that is deterrence theory. We need a new logic from decision theorists for the games that constitute grey zone conflict. (shrink)

In Richard Bradley’s book, Decision Theory with a Human Face, we have selected two themes for discussion. The first is the Bolker-Jeffrey theory of decision, which the book uses throughout as a tool to reorganize the whole field of decision theory, and in particular to evaluate the extent to which expected utility theories may be normatively too demanding. The second theme is the redefinition strategy that can be used to defend EU theories against the Allais and Ellsberg paradoxes, (...) a strategy that the book by and large endorses, and even develops in an original way concerning the Ellsberg paradox. We argue that the BJ theory is too specific to fulfil Bradley’s foundational project and that the redefinition strategy fails in both the Allais and Ellsberg cases. Although we share Bradley’s conclusion that EU theories do not state universal rationality requirements, we reach it not by a comparison with BJ theory, but by a comparison with the non-EU theories that the paradoxes have heuristically suggested. (shrink)

We introduce an expected-value theory of linguistic modality that makes reference to expected utility and a likelihood-based confirmation measure for deontics and epistemics, respectively. The account is a probabilistic semantics for deontics and epistemics, yet it proposes that deontics and epistemics share a common core modal semantics, as in traditional possible-worlds analysis of modality. We argue that this account is not only theoretically advantageous, but also has far-reaching empirical consequences. In particular, we predict modal versions of reasoning (...) fallacies from the heuristics and biases literature. Additionally, we derive the modal semantics in an entirely transparent manner, as it is based on the compositional semantics of Korean modal expressions that are morphosyntactically decomposed into a conditional and an evaluative predicate. (shrink)