Suppose that a decision-maker's aim, under certainty, is to maximise some continuous value, such as lifetime income or continuous social welfare. Can such a decision-maker rationally satisfy what has been called "continuity for easy cases" while at the same time satisfying what seems to be a widespread intuition against the full-blown continuity axiom of expected utility theory? In this note I argue that the answer is "no": given transitivity and a weak trade-off principle, continuity for easy cases violates the anti-continuity (...) intuition. I end the note by exploring an even weaker continuity condition that is consistent with the aforementioned intuition. (shrink)

This study seeks to explicate the philosophical foundations and theoretical outlines of grey systems theory by focusing on human perception, cognition, and understanding processes and by considering their functions in the process of producing knowledge. Primarily, the study investigates the processes of perception, cognition, and understanding, as well as their dynamicity. Then, it is explained how knowledge is produced through the interpretation/understanding of information and data and through the dynamicity governing this process. The findings reveal that human perception, cognition, and (...) understanding perpetually remain grey and imperfect, while lost sensatory data mark the very first aspect of greyness in such human capabilities. Furthermore, any piece of data, as a discrete and single entity, represents a determinate fact, symbol or signal from the world, while any set of data, no matter how large, remains incomplete and imperfect, and human beings always interpret inadequate sets of data in the world. Therefore, information and knowledge always remain grey and uncertain because they deeply rely on subjective understandings/interpretations and work with imperfect inputs and sets of data. The impact of knowledge on action and interaction and their effects on the world are some factors adding to the dynamicity of the world. Constant change in world data, outdated knowledge, defects in datasets, and human biases in understanding all confirm the infinitely grey nature of human knowledge of the world. (shrink)

Artificial intelligence (AI) is a digital technology that will be of major importance for the development of humanity in the near future. AI has raised fundamental questions about what we should do with such systems, what the systems themselves should do, what risks they involve and how we can control these. - After the background to the field (1), this article introduces the main debates (2), first on ethical issues that arise with AI systems as objects, i.e. tools made and (...) used by humans; here, the main sections are privacy (2.1), manipulation (2.2), opacity (2.3), bias (2.4), autonomy & responsibility (2.6) and the singularity (2.7). Then we look at AI systems as subjects, i.e. when ethics is for the AI systems themselves in machine ethics (2.8.) and artificial moral agency (2.9). Finally we look at future developments and the concept of AI (3). For each section within these themes, we provide a general explanation of the ethical issues, we outline existing positions and arguments, then we analyse how this plays out with current technologies and finally what policy conse-quences may be drawn. (shrink)

ABSTRACT Average utilitarianism and several related axiologies, when paired with the standard expectational theory of decision-making under risk and with reasonable empirical credences, can find their practical prescriptions overwhelmingly determined by the minuscule probability that the agent assigns to solipsism—that is, to the hypothesis that there is only one welfare subject in the world, namely, herself. This either (i) constitutes a reductio of these axiologies, (ii) suggests that they require bespoke decision theories, or (iii) furnishes an unexpected argument for ethical (...) egoism. (shrink)

Utility discounting in intertemporal economic modelling has been viewed as problematic, both for descriptive and normative reasons. However, positive utility discount rates can be defended normatively; in particular, it is rational for future utility to be discounted to take into account model-independent outcomes when decision-making under risk. The resultant values will tend to be smaller than descriptive rates under most probability assignments. This also allows us to address some objections that intertemporal considerations will be overdemanding. A principle for utility discount (...) rates is suggested which is rooted in probability discounting. Utility discounting is defended against objections from Parfit (1984) and Broome (2005); Broome (2012). A sample utility discount rate is estimated. [Open access]. (shrink)

Artificial intelligence (AI) and robotics are digital technologies that will have significant impact on the development of humanity in the near future. They have raised fundamental questions about what we should do with these systems, what the systems themselves should do, what risks they involve, and how we can control these. - After the Introduction to the field (§1), the main themes (§2) of this article are: Ethical issues that arise with AI systems as objects, i.e., tools made and used (...) by humans. This includes issues of privacy (§2.1) and manipulation (§2.2), opacity (§2.3) and bias (§2.4), human-robot interaction (§2.5), employment (§2.6), and the effects of autonomy (§2.7). Then AI systems as subjects, i.e., ethics for the AI systems themselves in machine ethics (§2.8) and artificial moral agency (§2.9). Finally, the problem of a possible future AI superintelligence leading to a “singularity” (§2.10). We close with a remark on the vision of AI (§3). - For each section within these themes, we provide a general explanation of the ethical issues, outline existing positions and arguments, then analyse how these play out with current technologies and finally, what policy consequences may be drawn. (shrink)

There are two types of artificial general intelligence (AGI) safety solutions: global and local. Most previously suggested solutions are local: they explain how to align or “box” a specific AI (Artificial Intelligence), but do not explain how to prevent the creation of dangerous AI in other places. Global solutions are those that ensure any AI on Earth is not dangerous. The number of suggested global solutions is much smaller than the number of proposed local solutions. Global solutions can be divided (...) into four groups: 1. No AI: AGI technology is banned or its use is otherwise prevented; 2. One AI: the first superintelligent AI is used to prevent the creation of any others; 3. Net of AIs as AI police: a balance is created between many AIs, so they evolve as a net and can prevent any rogue AI from taking over the world; 4. Humans inside AI: humans are augmented or part of AI. We explore many ideas, both old and new, regarding global solutions for AI safety. They include changing the number of AI teams, different forms of “AI Nanny” (non-self-improving global control AI system able to prevent creation of dangerous AIs), selling AI safety solutions, and sending messages to future AI. Not every local solution scales to a global solution or does it ethically and safely. The choice of the best local solution should include understanding of the ways in which it will be scaled up. Human-AI teams or a superintelligent AI Service as suggested by Drexler may be examples of such ethically scalable local solutions, but the final choice depends on some unknown variables such as the speed of AI progress. (shrink)

It is common practice in intergenerational justice to set fixed thresholds determining what qualifies as justice. Static definitions of how much and what to save for future generations, however, overestimate human epistemological limits and predictive capacity in regard to uncertainty in social- and ecosystems. Long-term predictions cannot account for the inherent range of contingent variables at play, especially according to contemporary theories of punctuated equilibrium. It is argued that policies deliberately testing ecological limits as currently conceived must be excluded from (...) political calculations to minimize current actions from foreclosing future life quality and options. To better reduce harms to present and future generations and support the stability of just institutions (and the stable environments they depend on) as Rawls and others demand, polities can overcompensate resource allocation to environmental sustainability. Focus on reducing environmental harms benefits both current and future generations, reconciling distributive versus intergenerational justice trade-offs. (shrink)

Most believe that it is worse for a person to die than to continue to exist with a good life. At the same time, many believe that it is not worse for a merely possible person never to exist than to exist with a good life. I argue that if the underlying properties that make us the sort of thing we essentially are can come in small degrees, then to maintain this commonly-held pair of beliefs we will have to embrace (...) an implausible sort of evaluative hypersensitivity to slight nonevaluative differences. Avoidance of such hypersensitivity pressures us to accept that it can be worse for merely possible people never to exist. If this conclusion is correct, then the standard basis for giving no or less priority to merely possible persons would disappear (i.e., that things cannot be better or worse for them). Though defenders of Person-Affecting Views and their opponents may still disagree in theory, they could arrive at the same answers to many monumentally important practical questions. (shrink)

I develop an argument that believing in the survivability of a mind uploading procedure conveys value to its believers that is assessable independently of assessing the truth of the belief. Regardless of whether the first-order metaphysical belief is true, believing it conveys a kind of Darwinian fitness to the believer. Of course, a further question remains of whether having that Darwinian property can be a basis—in a rational sense of being a basis—for one’s holding the belief. I’ll also make some (...) remarks in the present article toward answering that latter question. (shrink)

An advanced artificial intelligence could pose a significant existential risk to humanity. Several research institutes have been set-up to address those risks. And there is an increasing number of academic publications analysing and evaluating their seriousness. Nick Bostrom’s superintelligence: paths, dangers, strategies represents the apotheosis of this trend. In this article, I argue that in defending the credibility of AI risk, Bostrom makes an epistemic move that is analogous to one made by so-called sceptical theists in the debate about the (...) existence of God. And while this analogy is interesting in its own right, what is more interesting are its potential implications. It has been repeatedly argued that sceptical theism has devastating effects on our beliefs and practices. Could it be that AI-doomsaying has similar effects? I argue that it could. Specifically, and somewhat paradoxically, I argue that it could amount to either a reductio of the doomsayers position, or an important and additional reason to join their cause. I use this paradox to suggest that the modal standards for argument in the superintelligence debate need to be addressed. (shrink)

If scientists violate principles and practices of routine science to quickly develop interventions against catastrophic threats, they are engaged in what I call fast science. The magnitude, imminence, and plausibility of a threat justify engaging in and acting on fast science. Yet, that justification is incomplete. I defend two principles to assess fast science, which say: fast science should satisfy as much as possible the reliability-enhancing features of routine science, and the fast science developing an intervention against a threat should (...) not depend on the same problematic assumptions as the fast science which estimates the magnitude, imminence, and plausibility of the threat. (shrink)

Should you be willing to forego any sure good for a tiny probability of a vastly greater good? Fanatics say you should, anti-fanatics say you should not. Anti-fanaticism has great intuitive appeal. But, I argue, these intuitions are untenable, because satisfying them in their full generality is incompatible with three very plausible principles: acyclicity, a minimal dominance principle, and the principle that any outcome can be made better or worse. This argument against anti-fanaticism can be turned into a positive argument (...) for a weak version of fanaticism, but only from significantly more contentious premises. In combination, these facts suggest that those who find fanaticism counterintuitive should favor not anti-fanaticism, but an intermediate position that permits agents to have incomplete preferences that are neither fanatical nor anti-fanatical. (shrink)

This thesis is about the moral reasons we have to do less than best. It consists of six chapters. Part I of the thesis proposes, extends, and defends reasons to do less than best. In Chapter One (“The Conditional Obligation”) I outline and reject two recent arguments from Joe Horton and Theron Pummer for the claim that we have a conditional obligation to bring about the most good. In Chapter Two (“Agglomeration and Agent-Relative Costs”) I argue that agent-relative costs can (...) justify permissions to less than best in a far greater range of decisions contexts than we currently believe. In Chapter Three (“Risk and Aggregation”) I discuss how anti-aggregative moral theories deal with risk, whilst proposing an argument in favour of ex-post moral theories. -/- In Part II of the thesis, I discuss longtermism, presenting a series of reasons to believe we have both significant permissions and obligations to prioritise those in the short-term. In Chapter Four (“Listening to Future People”) I criticise a recent argument presented by Andreas Mogensen for the claim we cannot have obligations grounded in the wellbeing of future people. I then show that, even permitting the existence of obligations to future people, we still have significant reasons to resist longtermism on the grounds of partiality. In Chapter Five (“The Complaints of Future People”) I argue that scepticism about aggregation is inconsistent with an obligation, or indeed even a permission, to help far future people. In Chapter Six (“Leaving the Present Behind”) I explore the moral significance of “dooming”, whilst arguing that we have a pro tanto reason of fairness to prioritise aiding those currently in existence. (shrink)

Bartha and DesRoches (2021) and Steel and Bartha (2023) argue that we should understand the precautionary principle as the injunction to maximise lexical utilities. They show that the lexical utility model has important pragmatic advantages. Moreover, the model has the theoretical advantage of satisfying all axioms of expected utility theory except continuity. In this paper I raise a trilemma for any attempt at modelling the precautionary principle with lexical utilities: it permits choice cycles or leads to paralysis or implies that (...) the smallest value difference that is possible in a context has extreme axiological implications. (shrink)

When our choice affects some other person and the outcome is unknown, it has been argued that we should defer to their risk attitude, if known, or else default to use of a risk avoidant risk function. This, in turn, has been claimed to require the use of a risk avoidant risk function when making decisions that primarily affect future people, and to decrease the desirability of efforts to prevent human extinction, owing to the significant risks associated with continued human (...) survival. I raise objections to the claim that respect for others’ risk attitudes requires risk avoidance when choosing for future generations. In particular, I argue that there is no known principle of interpersonal aggregation that yields acceptable results in variable population contexts and is consistent with a plausible ideal of respect for others’ risk attitudes in fixed population cases. GPI Working Paper No . 20-2022. (shrink)

There is a remarkable trend in contemporary environmentalism that emphasizes ‘accepting responsibility’ for the natural world in contrast to outdated preservationist thinking that shirks such responsibility. This approach is often explained and justified by reference to the anthropocene: this fundamentally new epoch—defined by human domination—requires active human intervention to avert planetary catastrophe. However, in this paper, I suggest this rhetoric encourages a flight from history. This often jubilant, sometimes anxious, yearning for unprecedented human innovation and—ultimately—control in our new millennia mirrors (...) the Futurist movement that took off near the beginning of the last century. Despite the significant differences in the details of how academics have defended this twenty-first-century environmental outlook, they all represent the true flight from history; they too quickly jettison the ideas of historical environmentalists and so misunderstand the environmental values at the heart of preservation that are more salient than ever. (shrink)

A challenge faced by defenders of the precautionary principle is to clarify when the evidence that a harmful event might occur suffices to regard this prospect as a real possibility. Plausible versions of the principle must articulate some epistemic threshold, or de minimis requirement, which specifies when precautionary measures are justified. Critics have argued that formulating such a threshold is problematic in the context of the precautionary principle. First, this is because the precautionary principle appears to be ambiguous about the (...) distinction between risk and uncertainty: should the principle merely be invoked when evidential probabilities are absent, or also when probabilities have low epistemic credentials? Secondly, defenders of the precautionary principle face an aggregation puzzle: in judging whether or not the de minimis requirement has been met, how should first-order evidential probabilities and their second-order epistemic standing be aggregated? This article argues that the ambiguity can be resolved, and the epistemological puzzle can be solved. Focusing on decisions in the context of climate uncertainty, I advance a version of the precautionary principle that serves as a plausible decision rule, to be adopted in situations where its main alternative—cost–benefit analysis—does not deliver. (shrink)

Longtermists claim that what we ought to do is mainly determined by how our actions might affect the very long-run future. A natural objection to longtermism is that these effects may be nearly impossible to predict — perhaps so close to impossible that, despite the astronomical importance of the far future, the expected value of our present actions is mainly determined by near-term considerations. This paper aims to precisify and evaluate one version of this epistemic objection to longtermism. To that (...) end, I develop two simple models for comparing ‘longtermist’ and ‘neartermist’ interventions, incorporating the idea that it is harder to make a predictable difference to the further future. These models yield mixed conclusions: if we simply aim to maximize expected value, and don’t mind premising our choices on minuscule probabilities of astronomical payoffs, the case for longtermism looks robust. But on some prima facie plausible empirical worldviews, the expectational superiority of longtermist interventions depends heavily on these ‘Pascalian’ probabilities. So the case for longtermism may depend either on plausible but non-obvious empirical claims or on a tolerance for Pascalian fanaticism. (shrink)

Philosophy &Public Affairs, Volume 51, Issue 4, Page 373-412, Fall 2023.

We begin by showing that every theory of the value of uncertain prospects must have one of three unpalatable properties. _Reckless_ theories recommend giving up a sure thing, no matter how good, for an arbitrarily tiny chance of enormous gain; _timid_ theories permit passing up an arbitrarily large potential gain to prevent a tiny increase in risk; _non-transitive_ theories deny the principle that, if A is better than B and B is better than C, then A must be better than (...) C. Having set up this trilemma, we study its horns. Non-transitivity has been much discussed; we focus on drawing out the costs and benefits of recklessness and timidity when it comes to axiology, decision theory, and normative uncertainty. (shrink)

This thesis consists of a series of papers in population ethics: a subfield of normative ethics concerned with the distinctive issues that arise in cases where our actions can affect the identities or number of people of who ever exist. Each paper can be read independently of the others. In Chapter 1, I present a dilemma for Archimedean views in population axiology: roughly, those views on which adding enough good lives to a population can make that population better than any (...) other. In Chapter 2, I extend Gustaf Arrhenius’s famous impossibility theorems in population axiology into the domain of choices under risk. My risky impossibility theorems dispense with the assumption that welfare levels are finitely fine-grained, and so tell against lexical views in population axiology. In Chapter 3, I present objections to critical-level and critical-range views in population axiology. I then sketch out what I call the ‘Imprecise Exchange Rates View’ and argue that it is an attractive alternative. In Chapter 4, I address critical-level and critical-range views again. This time, I note that they are vulnerable to objections from biographical identity: identity between lives. I suggest that these objections give us reason to reject critical-level and critical-range views and embrace the Total View. In Chapter 5, I argue that objections of the same form – objections from personal identity – tell against person-affecting views in population ethics. In Chapter 6, I draw out some counterintuitive implications of two recent complaints-based theories of the procreation asymmetry. (shrink)

Longtermists have argued that humanity should significantly increase its efforts to prevent catastrophes like nuclear wars, pandemics, and AI disasters. But one prominent longtermist argument overshoots this conclusion: the argument also implies that humanity should reduce the risk of existential catastrophe even at extreme cost to the present generation. This overshoot means that democratic governments cannot use the longtermist argument to guide their catastrophe policy. In this paper, we show that the case for preventing catastrophe does not depend on longtermism. (...) Standard cost-benefit analysis implies that governments should spend much more on reducing catastrophic risk. We argue that a government catastrophe policy guided by cost-benefit analysis should be the goal of longtermists in the political sphere. This policy would be democratically acceptable, and it would reduce existential risk by almost as much as a strong longtermist policy. (shrink)

Plausibly, one important part of a good life is doing work that makes a contribution, or a positive difference to the world. In this paper, however, I explore contribution pessimism, the view that people will not always have adequate opportunities for making contributions. I distinguish between three interestingly different and at least initially plausible reasons why this view might be true: in slogan form, things might become too easy, they might become too good, or we might be too late. Now, (...) one response to these problems might be to deliberately attempt to undo them. However, I claim that this solution is intuitively misguided, and argue that explaining this supports a holistic approach to the value of contributions. Finally, I argue that if contribution pessimism is correct, it could provide an explanation of some widely held intuitions about issues in population ethics, with implications about the practical issue of how much priority we should give to addressing risks of human extinction. (shrink)

According to an intriguing though somewhat enigmatic line of thought first proposed by Jonathan Bennett, if humanity went extinct any time soon this would be unfortunate because important business would be left unfinished. This line of thought remains largely unexplored. I offer an interpretation of the idea that captures its intuitive appeal, is consistent with plausible constraints, and makes it non-redundant to other views in the literature. The resulting view contrasts with a welfare-promotion perspective, according to which extinction would be (...) bad because it would come at a massive opportunity cost in terms of feasibly achievable welfare over the lifetime of our species. (shrink)

I argue that many of the priority rankings that have been proposed by effective altruists seem to be in tension with apparently reasonable assumptions about the rational pursuit of our aims in the face of uncertainty. The particular issue on which I focus arises from recognition of the overwhelming importance and inscrutability of the indirect effects of our actions, conjoined with the plausibility of a permissive decision principle governing cases of deep uncertainty, known as the maximality rule. I conclude that (...) we lack a compelling decision theory that is consistent with a longtermist perspective and does not downplay the depth of our uncertainty, while also supporting orthodox effective altruist conclusions about cause prioritization. (shrink)

This article casts light on the moral implications of the possibility of human extinction, with a specific focus on extinction caused by an interruption in human reproduction. In the first two paragraphs, I show that moral philosophy has not yet given promising explanations for the wrongness of this kind of extinction. Specifically, the second paragraph contains a detailed rejection of John Leslie’s main claims on the morality of extinction. In the third paragraph, I offer a demonstration of the fact that (...) a moral view which stresses the permissibility of some types of human extinction can be effectively constructed, while in the following paragraph I propose a prima facie defense of a new approach to the topic which is likely to provide us with reasons in favor of the wrongness of a premature departure of humankind. (shrink)

In this chapter, I argue that the field of cultural evolution can usefully inform attempts to understand and influence the long-term future. First, I provide an overview of cultural evolution, covering what it means for culture to evolve, the mechanisms by which it happens, the crucial importance of cumulative cultural evolution for hunan history, and how cultural evolution (and in particular intergroup competition) has driven the rise of large-scale cooperation. Second, I draw out some possible lessons from cultural evolution for (...) thinking about the long-term future. In particular, I suggest we should be careful not to prematurely ”lock in” certain values or other cultural features, and instead aim for a society open to variation and competition. I also consider whether the future will bring greater selection pressure for particular kinds of values, such as patience. (shrink)

The aim of the paper is to contribute to the debate on effective altruism. It is an attempt to present it as a universal moral proposition – not only a new charity model for the richest citizens of the world. The article starts with a definition of a hypothetical group of relatively-poor effective altruists. Their hypothetical living conditions and opportunities are juxtaposed with the theory of effective altruism developed by Peter Singer and William MacAskill and with career guides proposed by (...) 80000hours – one of the websites gathering effective altruists. In the last part, selected practices for relatively poor effective altruists are described. The conclusion of the paper is, that although most of the reflections behind the concept of effective altruism are developed for the richest people in the world, it is a universal ethical position that can be applied into lives of relatively poor people, whose contribution should not be underestimated. (shrink)

Artificial intelligence algorithms, fueled by continuous technological development and increased computing power, have proven effective across a variety of tasks. Concurrently, quantum computers have shown promise in solving problems beyond the reach of classical computers. These advancements have contributed to a misconception that quantum computers enable hypercomputation, sparking speculation about quantum supremacy leading to an intelligence explosion and the creation of superintelligent agents. We challenge this notion, arguing that current evidence does not support the idea that quantum technologies enable hypercomputation. (...) Fundamental limitations on information storage within finite spaces and the accessibility of information from quantum states constrain quantum computers from surpassing the Turing computing barrier. While quantum technologies may offer exponential speed-ups in specific computing cases, there is insufficient evidence to suggest that focusing solely on quantum-related problems will lead to technological singularity and the emergence of superintelligence. Subsequently, there is no premise suggesting that general intelligence depends on quantum effects or that accelerating existing algorithms through quantum means will replicate true intelligence. We propose that if superintelligence is to be achieved, it will not be solely through quantum technologies. Instead, the attainment of superintelligence remains a conceptual challenge that humanity has yet to overcome, with quantum technologies showing no clear path toward its resolution. (shrink)

Critical-set views avoid the Repugnant Conclusion by subtracting some constant from the welfare score of each life in a population. These views are thus sensitive to facts about biographical identity: identity between lives. In this paper, I argue that questions of biographical identity give us reason to reject critical-set views and embrace the total view. I end with a practical implication. If we shift our credences towards the total view, we should also shift our efforts towards ensuring that humanity survives (...) for the long term. (shrink)

Longtermism is the view that positively influencing the long-term future is one of the key moral priorities of our time. Longtermists generally focus on humans, and neglect animals. This is a mistake. In this paper I will show that the basic argument for longtermism applies to animals at least as well as it does to humans, and that the reasons longtermists have given for ignoring animals do not withstand scrutiny. Because of their numbers, their capacity for suffering, and our ability (...) to influence their futures, animals ought to be a central concern of longtermists. Furthermore, I will suggest that longtermism is a fruitful framework for thinking about the wellbeing of animals, as it helps us to identify actions we can take now that have a reasonable chance of improving the wellbeing of animals over the very long term. (shrink)

An anthropogenic global catastrophic risk is a human-induced risk that threatens sustained and wide-scale loss of life and damage to civilisation across the globe. In order to understand how new research on governance mechanisms for emerging technologies might assuage such risks, it is important to ask how perceptions, beliefs, and attitudes towards the governance of global catastrophic risk within the research community shape the conduct of potentially risky research. The aim of this study is to deepen our understanding of emerging (...) technology research culture as it relates to global catastrophic risks, and to shed new light on how new research governance mechanisms might be developed. We analyse in-depth interviews with leading AI and biotech researchers both from universities and the private sector. We develop new insights in terms of four salient themes. First, ‘engineering mindset’, which highlights the premium placed by many interviewees on pursuing interesting research about the physical world for its own sake. Second, ‘self-government’, which looks at how self-regulation of technological development currently occurs. Third, ‘pure incentives’, focussing on how career and other incentives shapes research. Fourth, ‘norms and persuasion’, which examines the role of moral considerations in guiding the research choices of scientists. We end by considering the implications of these findings for future research on governance of anthropogenic global catastrophic risk. (shrink)

Who should decide how a machine will decide what to do when it is driving a car, performing a medical procedure, or, more generally, when it is facing any kind of morally laden decision? More and more, machines are making complex decisions with a considerable level of autonomy. We should be much more preoccupied by this problem than we currently are. After a series of preliminary remarks, this paper will go over four possible answers to the question raised above. First, (...) we may claim that it is the maker of a machine that gets to decide how it will behave in morally laden scenarios. Second, we may claim that the users of a machine should decide. Third, that decision may have to be made collectively or, fourth, by other machines built for this special purpose. The paper argues that each of these approaches suffers from its own shortcomings, and it concludes by showing, among other things, which approaches should be emphasized for different types of machines, situations, and/or morally laden decisions. (shrink)

Is the overall value of a world just the sum of values contributed by each value-bearing entity in that world? Additively separable axiologies (like total utilitarianism, prioritarianism, and critical level views) say 'yes', but non-additive axiologies (like average utilitarianism, rank-discounted utilitarianism, and variable value views) say 'no'. This distinction appears to be practically important: among other things, additive axiologies generally assign great importance to large changes in population size, and therefore tend to strongly prioritize the long-term survival of humanity over (...) the interests of the present generation. Non-additive axiologies, on the other hand, need not assign great importance to large changes in population size. We show, however, that when there is a large enough `background population' unaffected by our choices, a wide range of non-additive axiologies converge in their implications with additive axiologies—for instance, average utilitarianism converges with critical-level utilitarianism and various egalitarian theories converge with prioritarianism. We further argue that real-world background populations may be large enough to make these limit results practically significant. This means that arguments from the scale of potential future populations for the astronomical importance of avoiding existential catastrophe, and other arguments in practical ethics that seem to presuppose additive separability, may succeed in practice whether or not we accept additive separability as a basic axiological principle. (shrink)

Given the abrupt global disruption caused by SARS-CoV-2, one might think that the COVID pandemic was an unpredictable event. But in the years leading up to the emergence of the COVID pandemic, several documents had already been warning of the increasing occurrences of new disease outbreaks with pandemic potential and lack of corresponding policies to promote pandemic preparedness and response. In this article, we call these documents “early warnings”. We argue that a survey of early warnings can help science communicators (...) to promote the public understanding of evidence-based pandemic preparedness and response policies at local or international level. Our proposal differs from other approaches to pandemic preparedness and response in that it highlights the relevance of documents published before the COVID outbreak. We show that the early warnings did not become outdated after the COVID outbreak, but, rather, that they are even more pressing now. (shrink)