Risk

Many people are worried about the harmful effects of climate change but nevertheless enjoy some activities that contribute to the emission of greenhouse gas (driving, flying, eating meat, etc.), the main cause of climate change. How should such people make choices between engaging in and refraining from enjoyable greenhouse-gas-emitting activities? In this chapter, we look at the answer provided by decision theory. Some scholars think that the right answer is given by interactive decision theory, or game theory; and moreover think (...) that since private climate decisions are instances of the prisoner’s dilemma, one rationally should engage in these activities provided that one enjoys them. Others think that the right answer is given by expected utility theory, the best-known version of individual decision theory under risk and uncertainty. In this chapter, we review these different answers, with a special focus on the latter answer and the debate it has generated. (shrink)

Many philosophers accept that, as well as having a right that others not harm us, we also have a right that others not subject us to a risk of harm. And yet, when we attempt to spell out precisely what this ‘right against risk imposition’ involves, we encounter a series of notorious puzzles. Existing attempts to deal with these puzzles have tended to focus on the nature of rights – but I propose an approach that focusses instead on the nature (...) of risk. The key move is to distinguish two different ways in which to conceptualise the risk that a given action presents – one of which is linked to the notion of probability and the other to the notion of normalcy. (shrink)

I defend a weak version of the Pigou-Dalton principle for chances. The principle says that it is better to increase the survival chance of a person who is more likely to die rather than a person who is less likely to die, assuming that the two people do not differ in any other morally relevant respect. The principle justifies plausible moral judgements that standard ex post views, such as prioritarianism and rank-dependent egalitarianism, cannot accommodate. However, the principle can be justified (...) by the same reasoning that has recently been used to defend the core axiom of ex post prioritarianism and egalitarianism, namely, Pigou-Dalton for well-being. The arguably biggest challenge for proponents of Pigou-Dalton for chances is that it violates State Dominance for social prospects. However, I argue that we have independent reason for rejecting State Dominance for social prospects, since it prevents a social planner from properly respecting people's preferences. (shrink)

Argues that given an appropriate understanding of objective probabilities, pure objective risk of harm can itself be a harm.

In a recent paper in this journal Duncan Pritchard responds to an objection to the modal account of risk pressed by Ebert, Smith and Durbach ( 2020 ). In this paper, I expand upon the objection and argue that it still stands. I go on to consider a more general question raised by this exchange – whether risk is ‘objective’, or whether it is something that varies from one perspective to another.

Many philosophers assume that, when making moral decisions under uncertainty, we should choose the option that has the greatest expected moral value, regardless of how risky it is. But their arguments for maximizing expected moral value do not support it over rival, risk-averse approaches. In this paper, I present a novel argument for maximizing expected value: when we think about larger series of decisions that each decision is a part of, all but the most risk-averse agents would prefer that we (...) consistently choose the option with the highest expected value. To the extent that what we choose on a given occasion should be guided by the entire series of choices we prefer, then on each occasion, we should choose the option with the highest expected moral value. (shrink)

Philosophy &Public Affairs, Volume 51, Issue 4, Page 373-412, Fall 2023.

Longtermists have recently argued that it is overwhelmingly important to do what we can to mitigate existential risks to humanity. I consider three mistakes that are often made in calculating the value of existential risk mitigation: focusing on cumulative risk rather than period risk; ignoring background risk; and neglecting population dynamics. I show how correcting these mistakes pushes the value of existential risk mitigation substantially below leading estimates, potentially low enough to threaten the normative case for existential risk mitigation. I (...) use this discussion to draw four positive lessons for the study of existential risk: the importance of treating existential risk as an intergenerational coordination problem; a surprising dialectical flip in the relevance of background risk levels to the case for existential risk mitigation; renewed importance of population dynamics, including the dynamics of digital minds; and a novel form of the cluelessness challenge to longtermism. -/- . (shrink)

Many researchers and intellectuals warn about extreme risks from artificial intelligence. However, these warnings typically came without systematic arguments in support. This paper provides an argument that AI will lead to the permanent disempowerment of humanity, e.g. human extinction, by 2100. It rests on four substantive premises which it motivates and defends: First, the speed of advances in AI capability, as well as the capability level current systems have already reached, suggest that it is practically possible to build AI systems (...) capable of disempowering humanity by 2100. Second, due to incentives and coordination problems, if it is possible to build such AI, it will be built. Third, since it appears to be a hard technical problem to build AI which is aligned with the goals of its designers, and many actors might build powerful AI, misaligned powerful AI will be built. Fourth, because disempowering humanity is useful for a large range of misaligned goals, such AI will try to disempower humanity. If AI is capable of disempowering humanity and tries to disempower humanity by 2100, then humanity will be disempowered by 2100. This conclusion has immense moral and prudential significance. (shrink)

It is plausible that current generations owe something to future generations. One possibility is that we have a duty to not harm them. Another possibility is that we have a duty to protect them. In either case, however, to satisfy the duties to future generations from environmental or political degradation, we need to engage in widespread collective action. But, as we are, we have a limited ability to do so, in part because we lack the self-discipline necessary for successful collective (...) action. Given that having an obligation hinges on being able to satisfy it, the apparent duty to future generations is at odds with our apparent inability to satisfy it. Thus, we either need to rethink our duties to future generations or rethink the nature of our abilities. I argue in this chapter that we should rethink the nature of our abilities. Specifically, we should enhance our self-discipline, which is distinct from enhancements of motivation, judgment, or emotion. Even the most intelligent, motivated, and empathetic actor is likely to slip up, which encourages others to withdraw their cooperation. Without the necessary self-discipline to sustain our public cooperative behavior, collective action is likely to fail, leaving us with one alternative: to abandon our duties to future generations. (shrink)

Longtermists claim that what we ought to do is mainly determined by how our actions might affect the very long-run future. A natural objection to longtermism is that these effects may be nearly impossible to predict — perhaps so close to impossible that, despite the astronomical importance of the far future, the expected value of our present actions is mainly determined by near-term considerations. This paper aims to precisify and evaluate one version of this epistemic objection to longtermism. To that (...) end, I develop two simple models for comparing ‘longtermist’ and ‘neartermist’ interventions, incorporating the idea that it is harder to make a predictable difference to the further future. These models yield mixed conclusions: if we simply aim to maximize expected value, and don’t mind premising our choices on minuscule probabilities of astronomical payoffs, the case for longtermism looks robust. But on some prima facie plausible empirical worldviews, the expectational superiority of longtermist interventions depends heavily on these ‘Pascalian’ probabilities. So the case for longtermism may depend either on plausible but non-obvious empirical claims or on a tolerance for Pascalian fanaticism. (shrink)

A social planner who evaluates risky public policies in light of the other risks with which their society will be faced should judge favourably some such policies even though they would deem them too risky when considered in isolation. I suggest that a longtermist would—or at least should—evaluate risky polices in light of their prediction about future risks; hence, longtermism supports social risk-taking. I consider two formal versions of this argument, discuss the conditions needed for the argument to be valid, (...) and briefly compare these conditions to some risky policy options with which actual public decision-makers are faced. (shrink)

“Existential risks” are risks that threaten the destruction of humanity’s long-term potential: risks of nuclear wars, pandemics, supervolcano eruptions, and so on. On standard utilitarianism, it seems, the reduction of such risks should be a key global priority today. Many effective altruists agree with this verdict. But how should the importance of these risks be assessed on a Christian moral theory? In this paper, I begin to answer this question – taking Thomas Aquinas as a reference, and the risks of (...) anthropogenic extinction as an example. I’ll suggest that on a Thomist framework, driving ourselves extinct would constitute a complete failure to fulfil our God-given nature, a radical form of hubris, and a loss of cosmological significance. So the reduction of such risks seems vital for Thomists, or Christians more broadly. Indeed, I end with the thought that these considerations are not parochially Christian, or indeed specifically religious: everyone with a similar view of mankind – as immensely valuable yet fallen and fragile – should agree that existential risks are a pressing moral concern. (shrink)

The standard argument to the conclusion that artificial intelligence (AI) constitutes an existential risk for the human species uses two premises: (1) AI may reach superintelligent levels, at which point we humans lose control (the ‘singularity claim’); (2) Any level of intelligence can go along with any goal (the ‘orthogonality thesis’). We find that the singularity claim requires a notion of ‘general intelligence’, while the orthogonality thesis requires a notion of ‘instrumental intelligence’. If this interpretation is correct, they cannot be (...) joined as premises and the argument for the existential risk of AI turns out invalid. If the interpretation is incorrect and both premises use the same notion of intelligence, then at least one of the premises is false and the orthogonality thesis remains itself orthogonal to the argument to existential risk from AI. In either case, the standard argument for existential risk from AI is not sound.—Having said that, there remains a risk of instrumental AI to cause very significant damage if designed or used badly, though this is not due to superintelligence or a singularity. (shrink)

Longtermism is the view that the most urgent global priorities, and those to which we should devote the largest portion of our resources, are those that focus on (i) ensuring a long future for humanity, and perhaps sentient or intelligent life more generally, and (ii) improving the quality of the lives that inhabit that long future. While it is by no means the only one, the argument most commonly given for this conclusion is that these interventions have greater expected goodness (...) per unit of resource devoted to them than each of the other available interventions, including those that focus on the health and well-being of the current population. In this paper, I argue that, even if we grant the consequentialist ethics upon which this argument depends, and even if we grant one of the axiologies that are typically paired with that ethics to give the argument, we are not morally required to choose an option that maximises expected utility; indeed, we might not even be permitted to do so. Instead, I will argue, if the argument's consequentialism is correct, we should choose using a decision theory that is sensitive to risk, and allows us to give greater weight to worse-case outcomes than expected utility theory does. And, I will show, such decision theories do not always recommend longtermist interventions. Indeed, sometimes, they recommend exactly the opposite: sometimes, they recommend hastening human extinction. Many, though not all, will take this as a reductio of the consequentialism or the axiology of the argument. I remain agnostic on the conclusion we should draw. (shrink)

Some people think that the inevitability of human extinction renders life meaningless. Joshua Seachris has argued that naturalism can be conceptualized as a meta-narrative and that it narrates across important questions of human life, including what is the meaning of life and how life will end. How a narrative ends is important, Seachris argues. In the absence of God, and with knowledge that human extinction is a certainty, is there any way that humanity could be meaningful and have a good (...) ending? I will distinguish between two conceptions of how humanity could be meaningful: the traditional view and an alternative view, which I will outline. I will argue that this alternative view provides a plausible explanation for how humanity could become meaningful. I will also argue that coming to terms with our mortality and other limitations would add meaning to human life and provide humanity with a good ending. (shrink)

A small but growing number of studies have aimed to understand, assess and reduce existential risks, or risks that threaten the continued existence of mankind. However, most attention has been focused on known and tangible risks. This paper proposes a heuristic for reducing the risk of black swan extinction events. These events are, as the name suggests, stochastic and unforeseen when they happen. Decision theory based on a fixed model of possible outcomes cannot properly deal with this kind of event. (...) Neither can probabilistic risk analysis. This paper will argue that the approach that is referred to as engineering safety could be applied to reducing the risk from black swan extinction events. It will also propose a conceptual sketch of how such a strategy may be implemented: isolated, self-sufficient, and continuously manned underground refuges. Some characteristics of such refuges are also described, in particular the psychosocial aspects. Furthermore, it is argued that this implementation of the engineering safety strategy safety barriers would be effective and plausible and could reduce the risk of an extinction event in a wide range of possible scenarios. Considering the staggering opportunity cost of an existential catastrophe, such strategies ought to be explored more vigorously. (shrink)

Some people feel distressed reflecting on human extinction. Some people even claim that our efforts and lives would be empty and pointless if humanity becomes extinct, even if this will not occur for millions of years. In this essay, I will attempt to demonstrate that this claim is false. The desire for long-lastingness or quasi-immortality is often unwittingly adopted as a standard for judging whether our efforts are significant. If we accomplish our goals and then later in life conclude that (...) these accomplishments were of no significance, then this is a sign that the desire for long-lastingness has crept into our standards. By recognizing this, and refraining from adopting an unreasonable standard to judge whether our efforts are significant, it will be to our advantage. Then, when we look back on life from an external perspective that encompasses times after humanity has become extinct, we will not conclude that our efforts amounted to nothing. Rather, we will conclude that many people made significant accomplishments that made their lives and the lives of other people better than they would have been if their goals had never been pursued. (shrink)

A lovingly critical review focused on issues of risk, aggregation, autonomy, and supererogation.

Are mandatory lockdown measures, which place restrictions on one’s freedom to move and assemble, justifiable? Offhand, such measures appear to compromise important rights to secure goals of public health. Proponents of such measures think the trade-off is worth it; opponents think it isn’t. However, one might think that casting the debate in these terms concedes too much to the opponents. Mandatory lockdown measures don’t infringe important rights because no one has a right to impose a risk of grievous harm on (...) others—and, in the context of a pandemic, participating in the prohibited activities (e.g., going out to the bar) does just that. -/- This chapter explores whether this defense of mandatory lockdown measures holds up. It, first, considers whether we have a right against risk imposition—and, if so, how such a right is best understood. It then considers the objection that, even if there is such a right, people who voluntarily choose to engage in the prohibited activities—at least if fully appraised of the risks involved—effectively waive it. The chapter argues that this objection fails. (shrink)

Illusionism claims that we are not conscious, that there is nothing it is like, in the usual sense of the word, to feel sad, or to smell lavender. According to Illusionists, we are, in a technical sense, zombies. Instead of arguing for the falsity of Illusionism directly, I will explain why the main philosophical motivations for it are mistaken – and I trust the rest will be taken care of by the extreme implausibility of the view. I want to spread (...) the good news to Illusionists that they don’t need to resort to this highly counterintuitive, strange, and as I will argue later, morally corrosive idea. One can be a physicalist and phenomenal realist since neither of the two types of arguments Illusionists rely on – the conceivability arguments, and the debunking arguments against physicalist phenomenal realism – work. In the last part of the paper, I will say something about the corrosive effect this metaphysics has on our moral and evaluative outlook. (shrink)

The received view of Kant’s moral philosophy is that it precludes all moral luck. But I offer a plausible interpretation according to which Kant embraces moral luck in circumstance and constitution. I interpret the unconditioned nature of transcendental freedom as a person’s ability to do the right thing no matter how she is inclined by her circumstantial and constitutive luck. I argue that various passages about degrees of difficulty relating to circumstantial and constitutive luck provide a reason to accept a (...) pro-moral luck interpretation of Kant. (shrink)

When an abortion is performed, someone dies. Are we killing an innocent human person? Widespread disagreement exists. However, it’s not necessary to establish personhood in order to establish the wrongness of abortion: a substantial chance of personhood is enough. We defend The Don’t Risk Homicide Argument: abortions are wrong after 10 weeks gestation because they substantially and unjustifiably risk homicide, the unjust killing of an innocent person. Why 10 weeks? Because the cumulative evidence establishes a substantial chance (a more than (...) 1 in 5 chance) that preborn humans are persons around this stage of development. We submit evidence from our bad track record, widespread disagreement about personhood (after 10 weeks gestation), problems with theories of personhood, the similarity between preborn humans and newborn babies, gestational age miscalculations, and the common intuitive responses of women to their pregnancies and miscarriages. Our argument is cogent because it bypasses the stalemate over preborn personhood and rests on common ground rather than contentious metaphysics. It also strongly suggests that society must do more to protect preborn humans. We discuss its practical implications for fetal pain relief, social policy, and abortion law. (shrink)

Bartha and DesRoches (2021) and Steel and Bartha (2023) argue that we should understand the precautionary principle as the injunction to maximise lexical utilities. They show that the lexical utility model has important pragmatic advantages. Moreover, the model has the theoretical advantage of satisfying all axioms of expected utility theory except continuity. In this paper I raise a trilemma for any attempt at modelling the precautionary principle with lexical utilities: it permits choice cycles or leads to paralysis or implies that (...) the smallest value difference that is possible in a context has extreme axiological implications. (shrink)

According to a common judgement, a social planner should often use a lottery to decide which of two people should receive a good. This judgement undermines one of the best-known arguments for utilitarianism, due to John C. Harsanyi, and more generally undermines axiomatic arguments for utilitarianism and similar views. In this paper we ask which combinations of views about (a) the social planner’s attitude to risk and inequality, and (b) the subjects’ attitudes to risk are consistent with the aforementioned judgement. (...) We find that the class of combinations of views that can plausibly accommodate this judgement is quite limited. But one theory does better than others: the theory of chance-sensitive utility. (shrink)

When you are indifferent between two options, it’s rationally permissible to take either. One way to decide between two such options is to flip a fair coin, taking one option if it lands heads and the other if it lands tails. Is it rationally permissible to employ such a tie-breaking procedure? Intuitively, yes. However, if you are genuinely risk-averse—in particular, if you adhere to risk-weighted expected utility theory (Buchak in Risk and rationality, Oxford University Press, 2013) and have a strictly (...) convex risk-function—the answer will often be no: the REU of deciding by coin-flip will be lower than the REU of choosing one of the options outright (so long as at least one of the options is a nondegenerate gamble). This turns out to be a significant worry for risk-weighted expected utility theory. I argue that it adds real bite to established worries about diachronic consistency afflicting views, like risk-weighted expected utility theory, that violate Independence. And that, while these worries might be surmountable, surmounting them comes at a price. (shrink)

How should you evaluate your choices when you’re unsure what their outcomes will be? One popular answer is to rank your options in terms of their expected utilities. But what should you do when you think that the value of their respective outcomes might be incommensurable? In the face of incommensurable values, it no longer makes sense to speak of ranking your options according to expected utility. Are there any general principles to guide us when facing decisions of this kind? (...) If only! This chapter develops an impossibility result: it holds that there are a handful of independently plausible constraints that no such decision theory can jointly satisfy. The result, while depressing, can be used to helpfully classify extant approaches based on which of the constraints they violate. (shrink)

A social planner who evaluates risky public policies in light of the other risks with which their society will be faced should judge favourably some such policies even though they would deem them too risky when considered in isolation. I suggest that a longtermist would—or at least should—evaluate risky polices in light of their prediction about future risks; hence, longtermism supports social risk-taking. I consider two formal versions of this argument, discuss the conditions needed for the argument to be valid, (...) and briefly compare these conditions to some risky policy options with which actual public decision-makers are faced. (shrink)

Orthodox causal decision theory is unstable. Its advice changes as you make up your mind about what you will do. Several have objected to this kind of instability and explored stable alternatives. Here, I'll show that explorers in search of stability must part with a vestige of their homeland. There is no plausible stable decision theory which satisfies Savage's Sure Thing Principle. So those in search of stability must learn to live without it.

All ordinary decisions involve some risk. If I go outside for a walk, I may trip and injure myself. But if I don’t go for a walk, I slightly increase my chances of cardiovascular disease. Typically, we disregard most small risks. When, for practical purposes, is it appropriate for one to ignore risk? This issue looms large because many activities performed by those in wealthy societies, such as driving a car, in some way risk contributing to climate harms. Are these (...) activities morally appropriate? -/- In this paper, I first summarize and respond to some arguments that purport to show that it is appropriate to ignore or discount very small risks. I argue that because our rationality is bounded, it is impossible for us to include every small risk in our decision-making process, and so we may reasonably use heuristics to guide many decisions. However, contrary to some thinkers, I argue that this does not violate the spirit of expected value theory; it merely shows that we should adopt a so-called "two-level" view. Our use of heuristics allows for the reasonable ignoring of some risks, and this perhaps explains why one might be inclined to think that individual climate-related risks are negligible. However, virtually all greenhouse-gas emitting activities in fact have some climate risk on the negative side of the ledger, and the use of heuristics does not permit the general ignoring of climate-change-related risk by individuals on grounds of expediency of judgment and decision-making. (shrink)

This paper aims to scrutinize how the notion of risk should be understood and applied to possibly catastrophic cases. I begin with clarifying the standard usage of the notion of risk, particularly emphasizing the conceptual relation between risk and probability. Then, I investigate how to make decisions in the case of seemingly catastrophic disasters by contrasting the precautionary principle with the preventive (prevention) principle. Finally, I examine what kind of causal thinking tends to be actually adopted when we make decisions (...) on emergent cases. My arguments are mainly based on Japan's 2011 massive earthquake and nuclear power station accident. Masaki Ichinose. (shrink)

A decision theory is self-recommending if, when you ask it which decision theory you should use, it considers itself to be among the permissible options. I show that many alternatives to expected utility theory are not self-recommending, and I argue that this tells against them.

A de minimis risk is defined as a risk that is so small that it may be legitimately ignored when making a decision. While ignoring small risks is common in our day-to-day decision making, attempts to introduce the notion of a de minimis risk into the framework of decision theory have run up against a series of well-known difficulties. In this paper, I will develop an enriched decision theoretic framework that is capable of overcoming two major obstacles to the modelling (...) of de minimis risk. The key move is to introduce, into decision theory, a non-probabilistic conception of risk known as normic risk. (shrink)

The EU proposal for the Artificial Intelligence Act (AIA) defines four risk categories: unacceptable, high, limited, and minimal. However, as these categories statically depend on broad fields of application of AI systems (AIs), the risk magnitude may be wrongly estimated, and the AIA may not be enforced effectively. Our suggestion is to apply the four categories to the risk scenarios of each AIs, rather than solely to its field of application. We address this model flaw by integrating the AIA with (...) the framework arising from the Intergovernmental Panel on Climate Change (IPCC) reports and related literature. This makes possible addressing AI risk considering the interaction between (a) risk determinants, (b) individual drivers of determinants, and (c) multiple risk types. Then we integrate the proposed model with a proportionality-based balance among values considered by the AIA’s risk analysis. The resulting semi-quantitative approach identifies a more efficient way to implement the AIA and addresses the regulatory issue of general-purpose AI (GPAI). (shrink)

The goal of this paper is to review and critically discuss the philosophical aspects of probabilistic seismic hazard analysis (PSHA). Given that estimates of seismic hazard are typically riddled with uncertainty, diferent epistemic values (related to the pursuit of scientifc knowledge) compete in the selection of seismic hazard models, in a context infuenced by non-epistemic values (related to practical goals and aims) as well. We frst distinguish between the diferent types of uncertainty in PSHA. We claim that epistemic and nonepistemic (...) considerations are closely related in the selection of the appropriate estimate of seismic hazard by the experts. Finally, we argue that the division of scientifc responsibility among the experts can lead to responsibility gaps. This raises a problem for the ownership of the results (“no one’s model” problem) similar to the “problem of many hands” in the ethics of technology. We conclude with a plea for a close collaboration between philosophy and engineering. (shrink)