Historically, the hypothesis that our world is a computer simulation has struck many as just another improbable-but-possible “skeptical hypothesis” about the nature of reality. Recently, however, the simulation hypothesis has received significant attention from philosophers, physicists, and the popular press. This is due to the discovery of an epistemic dependency: If we believe that our civilization will one day run many simulations concerning its ancestry, then we should believe that we are probably in an ancestor simulation right now. This essay (...) examines a troubling but underexplored feature of the ancestor-simulation hypothesis: the termination risk posed by both ancestor-simulation technology and experimental probes into whether our world is an ancestor simulation. This essay evaluates the termination risk by using extrapolations from current computing practices and simulation technology. The conclusions, while provisional, have great implications for debates concerning the fundamental nature of reality and the safety of contemporary physics. (shrink)

The goal of the article is to explore what is the most probable type of simulation in which humanity lives (if any) and how this affects simulation termination risks. We firstly explore the question of what kind of simulation in which humanity is most likely located based on pure theoretical reasoning. We suggest a new patch to the classical simulation argument, showing that we are likely simulated not by our own descendants, but by alien civilizations. Based on this, we (...) provide classification of different possible simulations and we find that simpler, less expensive and one-person-centered simulations, resurrectional simulations, or simulations of the first artificial general intelligence’s (AGI’s) origin (singularity simulations) should dominate. Also, simulations which simulate the 21st century and global catastrophic risks are probable. We then explore whether the simulation could collapse or be terminated. Most simulations must be terminated after they model the singularity or after they model a global catastrophe before the singularity. Undeniably observed glitches, but not philosophical speculations could result in simulation termination. The simulation could collapse if it is overwhelmed by glitches. The Doomsday Argument in simulations implies termination soon. We conclude that all types of the most probable simulations except resurrectional simulations are prone to termination risks in a relatively short time frame of hundreds of years or less from now. (shrink)

Human-centered explainable AI (HCXAI) advocates for the integration of social aspects into AI explanations. Central to the HCXAI discourse is the Social Transparency (ST) framework, which aims to make the socio-organizational context of AI systems accessible to their users. In this work, we suggest extending the ST framework to address the risks of social misattributions in Large Language Models (LLMs), particularly in sensitive areas like mental health. In fact LLMs, which are remarkably capable of simulating roles and personas, may lead (...) to mismatches between designers' intentions and users' perceptions of social attributes, risking to promote emotional manipulation and dangerous behaviors, cases of epistemic injustice, and unwarranted trust. To address these issues, we propose enhancing the ST framework with a fifth 'W-question' to clarify the specific social attributions assigned to LLMs by its designers and users. This addition aims to bridge the gap between LLM capabilities and user perceptions, promoting the ethically responsible development and use of LLM-based technology. (shrink)

Termination in international contracts is considered a harsh sanction that harms international trade for each breach of contract or its provisions. The interest of international trade is fulfilled in maintaining and completing performance of contract, even if with a breach rectifiable by remedy. The termination destroys the contract and results in returning goods after their dispatch in addition to the accompanying new freight and insurance expenses and administrative and health procedures necessary for the entry and exit of goods (...) and to pay then refund the price. Moreover, the goods are exposed again to damage and perishing risks. Furthermore, the international sale contract is inherently associated with other international contracts such as goods transport contract, insurance contract and documentary credit through which the price is paid. If the sale contract is terminated, its effect will apply to all other associated contracts, if not performed, which produces many issues and hardships. (shrink)

I present a new argument that we are much more likely to be living in a computer simulation than in the ground-level of reality. (Similar arguments can be marshalled for the view that we are more likely to be Boltzmann brains than ordinary people, but I focus on the case of simulations.) I explain how this argument overcomes some objections to Bostrom’s classic argument for the same conclusion. I also consider to what extent the argument depends upon an internalist conception (...) of evidence, and I refute the common line of thought that finding many simulations being run—or running them ourselves—must increase the odds that we are in a simulation. GPI Working Paper No. 16-2021. (shrink)

Advocates of physician-assisted suicide often argue that, although the provision of PAS is morally permissible for persons with terminal, somatic illnesses, it is impermissible for patients suffering from psychiatric conditions. This claim is justified on the basis that psychiatric illnesses have certain morally relevant characteristics and/or implications that distinguish them from their somatic counterparts. In this paper, I address three arguments of this sort. First, that psychiatric conditions compromise a person’s decision-making capacity. Second, that we cannot have sufficient certainty that (...) a person’s psychiatric condition is untreatable. Third, that the institutionalisation of PAS for mental illnesses presents morally unacceptable risks. I argue that, if we accept that PAS is permissible for patients with somatic conditions, then none of these three arguments are strong enough to demonstrate that the exclusion of psychiatric patients from access to PAS is justifiable. (shrink)

Purpose – to differency in the franchise model implementation by tour operators in the European and Ukrainian markets. Design/Method/Approach. A theoretical approach is based on generalization, system and comparative analysis, content analysis, statistical, and graphical and tabular methods. Findings. The research characterized business franchising models of the largest multidisciplinary tour operators of mass tourism in Ukraine. The general conditions of performing tourist activity on the principles of business franchising for travel agencies are determined. The authors clarified the differences between business (...) franchising models in the European and Ukrainian markets. The mechanism of business multiplication and cooperation of opportunities aimed at promoting a tourist product on the target market defines the franchising. Originality/Value. The scientific novelty is to clarify the tourism activities conditions on a franchise basis in Europe and, in particular, in Ukraine, highlighting the franchise model features of the European business that are in a clearly defined vertically integrated management structure, strong national marketing management, corporate business support, longterm franchise agreements, and effective franchise system. Practical implications. The research practical results significance lies in travel agencies' possible application in deciding to join the franchise network and tour operators in addressing projected business risks diversification. Research limitattions / Future research. Due to the economic crisis in the tourism business, further research promising area is to find ways to stabilize the network business in tourism. The change in the financial condition of travel agencies after franchisee status obtain or termination is of interest. Paper type – theoretical. (shrink)

Preston Greene (2020) argues that we should not conduct simulation investigations because of the risk that we might be terminated if our world is a simulation designed to research various counterfactuals about the world of the simulators. In response, we propose a sequence of arguments, most of which have the form of an "even if” response to anyone unmoved by our previous arguments. It runs thus: (i) if simulation is possible, then simulators are as likely to care about simulating (...) simulations as they are likely to care about simulating basement (i.e. non-simulated) worlds. But (ii) even if simulations are interested only in simulating basement worlds the discovery that we are in a simulation will have little or no impact on the evolution of ordinary events. But (iii) even if discovering that we are in a simulation impacts the evolution of ordinary events, the effects of seeming to do so could also happen in a basement world, and might be the subject of interesting counterfactuals in the basement world Finally, (iv) there is little reason to think that there is a catastrophic effect from successful simulation probes, and no argument from the precautionary principle can be used to leverage the negligible credence one ought have in this. Thus, if we do develop a simulation probe, then let’s do it. (shrink)

Unlike other organs that operate continuously, such as the heart and kidneys, many of the operations of the nervous system shut down during sleep. The evolutionarily conserved unconscious state of sleep that puts animals at risk from predators indicates that it is an indispensable integral part of systems operation. A reasonable expectation is that any hypothesis for the mechanism of the nervous system functions should be able to provide an explanation for sleep. In this regard, the semblance hypothesis is (...) examined. Postsynaptic membranes are continuously being depolarized by the quantally released neurotransmitter molecules arriving from their presynaptic terminals. In this context, an incidental lateral activation of the postsynaptic membrane is expected to induce a semblance (cellular hallucination of arrival of activity from its presynaptic terminal, which forms a unit for internal sensation) of the arrival of activity from its presynaptic terminal as a systems property. This restricts induction of semblance to a context of a very high ratio of the duration of the default state of neurotransmitter-induced postsynaptic depolarization to the total duration of incidental lateral activations of the postsynaptic membrane. This requirement spans within a time-bin of a few sleep-wake cycles. Since the duration of quantal release remains maximized, the above requirement can be achieved only by ceiling the total duration of incidental lateral activations of the postsynaptic membrane, which necessitates a state of sleep. (shrink)

The article examines the so-called slippery slope argument (SSA) against the legalization of active voluntary euthanasia (AVE). According to the SSA, by legalizing AVE, the least morally controversial type of euthanasia, we will take the first step onto a slippery slope and inevitably end up in the moral abyss of widespread abuse and violations of the rights of the weakest and most vulnerable patients. In the first part of the paper, empirical evidence to the contrary is presented and analyzed: None (...) of the forecast regrettable trends can be elicited from the body of existing statistical data. Accordingly, we have no good reason to believe either that we already are, or are sooner or later going to be, sliding into a moral abyss. A related question is then considered: Would it not be wiser and safer to stick to the status quo and preserve the existing legal ban on AVE even if the risk of its abuse is uncertain and may well turn out to be relatively low? It is argued that such an appeal to precautionary reasoning fails to justify an outright legal ban on AVE for at least two reasons: (i) it grossly underestimates the hidden moral costs of current legal arrangements (competent terminal patients suffer both disrespect for their autonomous will and deprivation of the good of a timely death) and (ii) the ban is both too inefficient and disproportionate to qualify as a reasonable measure of precaution. (shrink)

Bob Solomon enjoyed humor, a good laugh. He was not a teller and collector of jokes or of humorous stories, as Ted Cohen and Noël Carroll are. He did not cultivate clever witticisms. Rather, his interest was in viewing life’s contingency and absurdity for the humor that can be found there, and the target of this humor was as likely to be himself or his friends as it was to be strangers. Bob also displayed philosophical courage. He once argued before (...) an incredulous audience of philosophers that the Three Stooges are funny, and admitted unashamedly to being a life-long devotee. In the published version of that talk he observes: “few adults in their chosen professions would dare attempt a Stooges gesture at risk of being terminally dismissed, but most men carry the secret knowledge around with them, and, in a wild fit of catharsis, display a tell-tale Stooges gesture when the door closes and the boss is out of view. I only hesitate to suggest that it is one of the most basic bonds between men, and perhaps the fact that it mystifies and sometimes horrifies women is far more elemental than the mere phrase ‘a sense of humor’ could ever suggest”. (shrink)

Boredom has dominated discussions about longevity thanks to Bernard Williams’s influential “The Makropulos Case.” I reveal the presence in that paper of a neglected, additional problem for the long-lived person, namely alienation in the face of unwanted change. Williams gestures towards this problem but does not pursue it. I flesh it out on his behalf, connecting it to what I call the ‘curmudgeonly attitude to change.’ This attitude manifests itself in the tendency, amongst those getting on in years, to observe (...) that things are getting worse. Curmudgeonliness is typically met with dismissal because it often concerns changes that don’t radically inhibit the curmudgeon’s well-being or autonomy. I believe that taking the curmudgeonly attitude more seriously will provide insight into the longer-lived self and its relation to the future. Using Williams’s approach to longevity as the framework, I contend that—as with boredom—a sense of alienation born of curmudgeonliness can become terminal for the subject, rendering her unable to envision the future as a site of worthwhile activity. However, I also uncover ways in which this agential stasis is significantly distinct from boredom and constitutes a different worry and a different risk for the long-lived individual. (shrink)

Physical activity levels of people with chronic neurological disorders are lower than those of healthy people. Problems in neurological disorders, including gait abnormalities, muscle weakness/loss of strength, spasticity, tremor, fatigue, balance disorder, and incontinence, results in lower physical activity level. After determining the situations that are contraindicated for physical activity, the patients should be evaluated by physiotherapists, and possible risks that may occur should be determined. Many studies have demonstrated that physical activity significantly reduces mortality and morbidity, increases community participation, (...) and improves health-related quality of life. These benefits show that increased physical activity and exercise should be part of the standard management of neurological disorders. In these patients, physical activity programs should be structured individually by providing appropriate environmental conditions and safety, following the assessment of the functional status and severity of the disease. The duration, intensity, and type of planned physical activity should be adjusted individually; Appropriate rest intervals should be given during the activity, and termination criteria should be determined according to individual tolerance. This literature review aims to provide an up-to-date overview of physical activity recommendations for individuals with chronic neurological disorders. (shrink)

Lawful euthanasia involves State endorsed termination of human life. Apart from a period of less than 9 months, in the Northern Territory, euthanasia has been illegal in Australia. Many of Australia’s parliaments have regularly considered introducing the practice and they continue to do so. In this context, this paper considers another type of State endorsed termination of human life: capital punishment. These took place in Australia from 1788 to 1967. The practice was abolished nationwide by 1985 and the (...) Commonwealth passed laws, in 2010, to prevent its reintroduction. This paper does not consider all of the arguments for or against euthanasia or capital punishment and nor does it argue that the two practices are identical. Instead, it argues that introducing euthanasia without careful consideration of the arguments and experiences of capital punishment would risk repetition of past mistakes. The paper considers whether introducing euthanasia would be inconsistent with arguments accepted as grounds for the abolition of capital punishment. It focuses, on the irrevocable argument. This is the argument that death is irrevocable and that the risk of an innocent person being executed should never be taken. The paper argues that, any criteria which might be adopted by the State as sufficient to justify euthanasia, would run the risk of people outside that criteria being euthanised. The paper argues that capital punishment and euthanasia each pose disproportionate risks to minority and vulnerable groups. The paper also argues that, the evidence of pain and suffering endured by the condemned in their execution require careful consideration in relation to arguments for euthanasia as a means to a quick and pain free “good death.” It considers the evidence that demonstrates that, like execution, euthanasia in practice can be slow and painful. The paper then argues that requiring health professional to administer lethal injections in acts of euthanasia would be inconsistent with the approach taken in Australia and the United States to the identification of those willing to administer the death penalty. The paper concludes that many of the key arguments which resulted in the abolition of the death penalty in Australia support the continued prohibition of euthanasia in Australia and ought to be addressed by proponents of change but its primary aim is to encourage further examination of the extent to which learnings relevant to the current euthanasia debate can be gained by examining the arguments and experience of capital punishment. (shrink)

Whether anorexic patients should be able to refuse treatment when this potentially has a fatal outcome is a vexed topic. A recent proposal for a new category of ‘terminal anorexia’ suggests criteria when a move to palliative care or even physician assisted suicide might be justified. I argue that this proposed diagnosis presents a false sense of certainty of the illness trajectory by conceptualizing anorexia in analogy with physical disorders and stressing the effects of starvation. Furthermore, this conceptualization is in (...) conflict with the claim that individuals who meet the diagnostic criteria for terminal anorexia have decision making capacity. It should therefore be rejected. (shrink)

In an effort to inform the discussion surrounding existential risks from AI, we formulate Extinction-level Goodhart’s Law as “Virtually any goal specification, pursued to the extreme, will result in the extinction of humanity”, and we aim to understand which formal models are suitable for investigating this hypothesis. Note that we remain agnostic as to whether Extinction-level Goodhart’s Law holds or not. As our key contribution, we identify a set of conditions that are necessary for a model that aims to be (...) informative for evaluating specific arguments for Extinction-level Goodhart’s Law. Since each of the conditions seems to significantly contribute to the complexity of the resulting model, formally evaluating the hypothesis might be exceedingly difficult. This raises the possibility that whether the risk of extinction from artificial intelligence is real or not, the underlying dynamics might be invisible to current scientific methods. (shrink)

A growing number of decision theorists have, in recent years, defended the view that rationality is permissive under risk: Different rational agents may be more or less risk-averse or risk-inclined. This can result in them making different choices under risk even if they value outcomes in exactly the same way. One pressing question that arises once we grant such permissiveness is what attitude to risk we should implement when choosing on behalf of other people. Are (...) we permitted to implement any of the rationally permissible risk attitudes, is there some specific risk attitude that is required when choosing for others, or are we required to defer to the risk attitudes of the people on whose behalf we are choosing? This article elaborates on this question, explains its wider practical and theoretical significance, provides an overview of existing answers, and explores how to go about providing a more systematic account of how to choose on behalf of others in risky contexts. (shrink)

I have claimed that risk-weighted expected utility maximizers are rational, and that their preferences cannot be captured by expected utility theory. Richard Pettigrew and Rachael Briggs have recently challenged these claims. Both authors argue that only EU-maximizers are rational. In addition, Pettigrew argues that the preferences of REU-maximizers can indeed be captured by EU theory, and Briggs argues that REU-maximizers lose a valuable tool for simplifying their decision problems. I hold that their arguments do not succeed and that my (...) original claims still stand. However, their arguments do highlight some costs of REU theory. (shrink)

This article argues that Lara Buchak’s risk-weighted expected utility (REU) theory fails to offer a true alternative to expected utility theory. Under commonly held assumptions about dynamic choice and the framing of decision problems, rational agents are guided by their attitudes to temporally extended courses of action. If so, REU theory makes approximately the same recommendations as expected utility theory. Being more permissive about dynamic choice or framing, however, undermines the theory’s claim to capturing a steady choice disposition in (...) the face of risk. I argue that this poses a challenge to alternatives to expected utility theory more generally. (shrink)

International regulation of autonomous weapon systems (AWS) is increasingly conceived as an exercise in risk management. This requires a shared approach for assessing the risks of AWS. This paper presents a structured approach to risk assessment and regulation for AWS, adapting a qualitative framework inspired by the Intergovernmental Panel on Climate Change (IPCC). It examines the interactions among key risk factors—determinants, drivers, and types—to evaluate the risk magnitude of AWS and establish risk tolerance thresholds through (...) a risk matrix informed by background knowledge of event likelihood and severity. Further, it proposes a methodology to assess community risk appetite, emphasizing that such assessments and resulting tolerance levels should be determined through deliberation in a multistakeholder forum. The paper highlights the complexities of applying risk-based regulations to AWS internationally, particularly the challenge of defining a global community for risk assessment and regulatory legitimization. (shrink)

A small but growing number of studies have aimed to understand, assess and reduce existential risks, or risks that threaten the continued existence of mankind. However, most attention has been focused on known and tangible risks. This paper proposes a heuristic for reducing the risk of black swan extinction events. These events are, as the name suggests, stochastic and unforeseen when they happen. Decision theory based on a fixed model of possible outcomes cannot properly deal with this kind of (...) event. Neither can probabilistic risk analysis. This paper will argue that the approach that is referred to as engineering safety could be applied to reducing the risk from black swan extinction events. It will also propose a conceptual sketch of how such a strategy may be implemented: isolated, self-sufficient, and continuously manned underground refuges. Some characteristics of such refuges are also described, in particular the psychosocial aspects. Furthermore, it is argued that this implementation of the engineering safety strategy safety barriers would be effective and plausible and could reduce the risk of an extinction event in a wide range of possible scenarios. Considering the staggering opportunity cost of an existential catastrophe, such strategies ought to be explored more vigorously. (shrink)

A theory of blameworthiness must answer two fundamental questions. First, what makes a person blameworthy when they act? Second, what makes a person blameworthy after the time of action? Two main answers have been given to the second question. According to interminability theorists, blameworthiness necessarily doesn’t even diminish over time. Terminability theorists deny this. In this paper, I argue against interminability and in favour of terminability. After clarifying the debate about whether blameworthiness is interminable or terminable, I argue there’s no (...) positive case for interminability. I then respond to three objections to terminability. In doing so, I clarify the nature of blame, self-blame, and posthumous blame. I also give theoretical reasons in favour of the view that a person’s blameworthiness for a minor wrong can not only diminish but also cease completely. (shrink)

Rawls famously argues that the parties in the original position would agree upon the two principles of justice. Among other things, these principles guarantee equal political liberty—that is, democracy—as a requirement of justice. We argue on the contrary that the parties have reason to reject this requirement. As we show, by Rawls’ own lights, the parties would be greatly concerned to mitigate existential risk. But it is doubtful whether democracy always minimizes such risk. Indeed, no one currently knows (...) which political systems would. Consequently, the parties—and we ourselves—have reason to reject democracy as a requirement of justice in favor of political experimentalism, a general approach to political justice which rules in at least some non-democratic political systems which might minimize existential risk. (shrink)

Violence risk assessment tools are increasingly used within criminal justice and forensic psychiatry, however there is little relevant, reliable and unbiased data regarding their predictive accuracy. We argue that such data are needed to (i) prevent excessive reliance on risk assessment scores, (ii) allow matching of different risk assessment tools to different contexts of application, (iii) protect against problematic forms of discrimination and stigmatisation, and (iv) ensure that contentious demographic variables are not prematurely removed from risk (...) assessment tools. (shrink)

It is widely held that the influence of risk on rational decisions is not entirely explained by the shape of an agent’s utility curve. Buchak (Erkenntnis, 2013, Risk and rationality, Oxford University Press, Oxford, in press) presents an axiomatic decision theory, risk-weighted expected utility theory (REU), in which decision weights are the agent’s subjective probabilities modified by his risk-function r. REU is briefly described, and the global applicability of r is discussed. Rabin’s (Econometrica 68:1281–1292, 2000) calibration (...) theorem strongly suggests that plausible levels of risk aversion cannot be fully explained by concave utility functions; this provides motivation for REU and other theories. But applied to the synchronic preferences of an individual agent, Rabin’s result is not as problematic as it may first appear. Theories that treat outcomes as gains and losses (e.g. prospect theory and cumulative prospect theory) account for risk sensitivity in a way not available to REU. Reference points that mark the difference between gains and losses are subject to framing, many instances of which cannot be regarded as rational. However, rational decision theory may recognize the difference between gains and losses, without endorsing all ways of fixing the point of reference. In any event, REU is a very interesting theory. (shrink)

Risk communication has been generally categorized as a warning act, which is performed in order to prevent or minimize risk. On the other side, risk analysis has also underscored the role played by information in reducing uncertainty about risk. In both approaches the safety aspects related to the protection of the right to health are on focus. However, it seems that there are cases where a risk cannot possibly be avoided or uncertainty reduced, this is (...) for instance valid for the declaration of side effects associated with pharmaceutical products or when a decision about drug approval or retirement must be delivered on the available evidence. In these cases, risk communication seems to accomplish other tasks than preventing risk or reducing uncertainty. The present paper analyzes the legal instruments which have been developed in order to control and manage the risks related to drugs – such as the notion of “development risk” or “residual risk” – and relates them to different kinds of uncertainty. These are conceptualized as epistemic, ecological, metric, ethical, and stochastic, depending on their nature. By referring to this taxonomy, different functions of pharmaceutical risk communication are identified and connected with the legal tools of uncertainty management. The purpose is to distinguish the different functions of risk communication and make explicit their different legal nature and implications. (shrink)

In addition to protecting agents’ autonomy, consent plays a crucial social role: it enables agents to secure partners in valuable interactions that would be prohibitively morally risk otherwise. To do this, consent must be observable: agents must be able to track the facts about whether they have received a consent-based permission. I argue that this morally justifies a consent-practice on which communicating that one consents is sufficient for consent, but also generates robust constraints on what sorts of behaviors can (...) be taken as consent- communicating. (shrink)

In this paper we aim to demonstrate the enormous ethical complexity that is prevalent in child obesity cases. This complexity, we argue, favors a cautious approach. Against those perhaps inclined to blame neglectful parents, we argue that laying the blame for child obesity at the feet of parents is simplistic once the broader context is taken into account. We also show that parents not only enjoy important relational prerogatives worth defending, but that children, too, are beneficiaries of that relationship in (...) ways difficult to match elsewhere. Finally, against the backdrop of growing public concern and pressure to intervene earlier in the life cycle, we examine the perhaps unintended stigmatizing effects that labeling and intervention can have and consider a number of risks and potential harms occasioned by state interventions in these cases. (shrink)

Powerful, technically complex international compliance regimes have developed recently in certain professions that deal with risk: banking (the Basel II regime), accountancy (IFRS) and the actuarial profession. The need to deal with major risks has acted as a strong driver of international co-operation to create enforceable international semilegal systems, as happened earlier in such fields as international health regulations. This regulation in technical fields contrasts with the failure of an international general-purpose political and legal regime to develop. We survey (...) the new global regulatory systems in the actuarial, banking and accounting fields, with a view to showing how the need to deal reasonably with risk has resulted in an international de facto law solidly based on correct abstract principles of probability. (shrink)

Uncertainty, insufficient information or information of poor quality, limited cognitive capacity and time, along with value conflicts and ethical considerations, are all aspects thatmake risk managementand riskcommunication difficult. This paper provides a review of different risk concepts and describes how these influence risk management, communication and planning in relation to forest ecosystem services. Based on the review and results of empirical studies, we suggest that personal assessment of risk is decisive in the management of forest ecosystem (...) services. The results are used together with a reviewof different principles of the distribution of risk to propose an approach to risk communication that is effective aswell as ethically sound. Knowledge of heuristics and mutual information on both beliefs and desires are important in the proposed risk communication approach. Such knowledge provides an opportunity for relevant information exchange, so that gaps in personal knowledge maps can be filled in and effective risk communication can be promoted. (shrink)

When our choice affects some other person and the outcome is unknown, it has been argued that we should defer to their risk attitude, if known, or else default to use of a risk avoidant risk function. This, in turn, has been claimed to require the use of a risk avoidant risk function when making decisions that primarily affect future people, and to decrease the desirability of efforts to prevent human extinction, owing to the significant (...) risks associated with continued human survival. I raise objections to the claim that respect for others’ risk attitudes requires risk avoidance when choosing for future generations. In particular, I argue that there is no known principle of interpersonal aggregation that yields acceptable results in variable population contexts and is consistent with a plausible ideal of respect for others’ risk attitudes in fixed population cases. GPI Working Paper No . 20-2022. (shrink)

A natural view in distributive ethics is that everyone's interests matter, but the interests of the relatively worse off matter more than the interests of the relatively better off. I provide a new argument for this view. The argument takes as its starting point the proposal, due to Harsanyi and Rawls, that facts about distributive ethics are discerned from individual preferences in the "original position." I draw on recent work in decision theory, along with an intuitive principle about risk-taking, (...) to derive the view. (shrink)

The EU Artificial Intelligence Act (AIA) defines four risk categories for AI systems: unacceptable, high, limited, and minimal. However, it lacks a clear methodology for the assessment of these risks in concrete situations. Risks are broadly categorized based on the application areas of AI systems and ambiguous risk factors. This paper suggests a methodology for assessing AI risk magnitudes, focusing on the construction of real-world risk scenarios. To this scope, we propose to integrate the AIA with (...) a framework developed by the Intergovernmental Panel on Climate Change (IPCC) reports and related literature. This approach enables a nuanced analysis of AI risk by exploring the interplay between (a) risk determinants, (b) individual drivers of determinants, and (c) multiple risk types. We further refine the proposed methodology by applying a proportionality test to balance the competing values involved in AI risk assessment. Finally, we present three uses of this approach under the AIA: to implement the Regulation, to assess the significance of risks, and to develop internal risk management systems for AI deployers. (shrink)

This paper examines a recent argument in favour of strong precautionary action—possibly including working to hasten human extinction—on the basis of a decision-theoretic view that accommodates the risk-attitudes of all affected while giving more weight to the more risk-averse attitudes. First, we dispute the need to take into account other people’s attitudes towards risk at all. Second we argue that a version of the non-identity problem undermines the case for doing so in the context of future people. (...) Lastly, we suggest that we should not work to hasten human extinction, even if significant risk aversion is warranted. (shrink)

A moderately risk averse person may turn down a 50/50 gamble that either results in her winning $200 or losing $100. Such behaviour seems rational if, for instance, the pain of losing $100 is felt more strongly than the joy of winning $200. The aim of this paper is to examine an influential argument that some have interpreted as showing that such moderate risk aversion is irrational. After presenting an axiomatic argument that I take to be the strongest (...) case for the claim that moderate risk aversion is irrational, I show that it essentially depends on an assumption that those who think that risk aversion can be rational should be skeptical of. Hence, I conclude that risk aversion need not be irrational. (shrink)

Which risks are bad? This is not an easy question to answer in any non-circular way. Not only are risks sought out for various reasons, but risks are plainly discounted in many situations. What may seem "risky" when examined all by itself, may not seem risky when encountered in a real lived situation. Thus risks that are imposed by others, in particular, might seem horrendous when considered in abstraction, but quite acceptable when encountered in life. What we need to do, (...) among other things, is to examine this "seeming." Are people being deluded or distracted when they fail to take seriously the riskiness of activities undertaken by others, or does this make some rational sense? There can be no doubt that people sometimes are deluded, of course. We are all fallible. But risks are not unalloyed evils. They are typically taken because of their association with something positive. So questions about whether people are making wise judgments when they don’t care about certain risks that they take, or, on the other side of the coin, when they become absolutely hysterical when confronted with a risk that appears to others to be insignificant, hinge on a web of further factors. (shrink)

The standard argument to the conclusion that artificial intelligence (AI) constitutes an existential risk for the human species uses two premises: (1) AI may reach superintelligent levels, at which point we humans lose control (the ‘singularity claim’); (2) Any level of intelligence can go along with any goal (the ‘orthogonality thesis’). We find that the singularity claim requires a notion of ‘general intelligence’, while the orthogonality thesis requires a notion of ‘instrumental intelligence’. If this interpretation is correct, they cannot (...) be joined as premises and the argument for the existential risk of AI turns out invalid. If the interpretation is incorrect and both premises use the same notion of intelligence, then at least one of the premises is false and the orthogonality thesis remains itself orthogonal to the argument to existential risk from AI. In either case, the standard argument for existential risk from AI is not sound.—Having said that, there remains a risk of instrumental AI to cause very significant damage if designed or used badly, though this is not due to superintelligence or a singularity. (shrink)

This book examines the moral luck paradox, relating it to Kantian, consequentialist and virtue-based approaches to ethics. It also applies the paradox to areas in medical ethics, including allocation of scarce medical resources, informed consent to treatment, withholding life-sustaining treatment, psychiatry, reproductive ethics, genetic testing and medical research. If risk and luck are taken seriously, it might seem to follow that we cannot develop any definite moral standards, that we are doomed to moral relativism. However, Dickenson offers strong counter-arguments (...) to this view that enable us to think in terms of universal standards. (shrink)

If the intelligence of artificial systems were to surpass that of humans significantly, this would constitute a significant risk for humanity. Time has come to consider these issues, and this consideration must include progress in AI as much as insights from the theory of AI. The papers in this volume try to make cautious headway in setting the problem, evaluating predictions on the future of AI, proposing ways to ensure that AI systems will be beneficial to humans – and (...) critically evaluating such proposals. (shrink)

Special Issue “Risks of artificial general intelligence”, Journal of Experimental and Theoretical Artificial Intelligence, 26/3 (2014), ed. Vincent C. Müller. http://www.tandfonline.com/toc/teta20/26/3# - Risks of general artificial intelligence, Vincent C. Müller, pages 297-301 - Autonomous technology and the greater human good - Steve Omohundro - pages 303-315 - - - The errors, insights and lessons of famous AI predictions – and what they mean for the future - Stuart Armstrong, Kaj Sotala & Seán S. Ó hÉigeartaigh - pages 317-342 - - (...) - The path to more general artificial intelligence - Ted Goertzel - pages 343-354 - - - Limitations and risks of machine ethics - Miles Brundage - pages 355-372 - - - Utility function security in artificially intelligent agents - Roman V. Yampolskiy - pages 373-389 - - - GOLEM: towards an AGI meta-architecture enabling both goal preservation and radical self-improvement - Ben Goertzel - pages 391-403 - - - Universal empathy and ethical bias for artificial general intelligence - Alexey Potapov & Sergey Rodionov - pages 405-416 - - - Bounding the impact of AGI - András Kornai - pages 417-438 - - - Ethics of brain emulations - Anders Sandberg - pages 439-457. (shrink)

Critical race theorists and standpoint epistemologists argue that agents who are members of dominant social groups are often in a state of ignorance about the extent of their social dominance, where this ignorance is explained by these agents' membership in a socially dominant group (e.g., Mills 2007). To illustrate this claim bluntly, it is argued: 1) that many white men do not know the extent of their social dominance, 2) that they remain ignorant as to the extent of their dominant (...) social position even where this information is freely attainable, and 3) that this ignorance is due in part to the fact that they are white men. We argue that on Buchak's (2010, 2013) model of risk averse instrumental rationality, ignorance of one's privileges can be rational. This argument yields a new account of elite-group ignorance, why it may occur, and how it might be alleviated. (shrink)

Why can testimony alone be enough for findings of liability? Why statistical evidence alone can’t? These questions underpin the “Proof Paradox” (Redmayne 2008, Enoch et al. 2012). Many epistemologists have attempted to explain this paradox from a purely epistemic perspective. I call it the “Epistemic Project”. In this paper, I take a step back from this recent trend. Stemming from considerations about the nature and role of standards of proof, I define three requirements that any successful account in line with (...) the Epistemic Project should meet. I then consider three recent epistemic accounts on which the standard is met when the evidence rules out modal risk (Pritchard 2018), normic risk (Ebert et al. 2020), or relevant alternatives (Gardiner 2019 2020). I argue that none of these accounts meets all the requirements. Finally, I offer reasons to be pessimistic about the prospects of having a successful epistemic explanation of the paradox. I suggest the discussion on the proof paradox would benefit from undergoing a ‘value-turn’. (shrink)

Catastrophic risk raises questions that are not only of practical importance, but also of great philosophical interest, such as how to define catastrophe and what distinguishes catastrophic outcomes from non-catastrophic ones. Catastrophic risk also raises questions about how to rationally respond to such risks. How to rationally respond arguably partly depends on the severity of the uncertainty, for instance, whether quantitative probabilistic information is available, or whether only comparative likelihood information is available, or neither type of information. Finally, (...) catastrophic risk raises important ethical questions about what to do when catastrophe avoidance conflicts with equity promotion. (shrink)

This is the editorial for a special volume of JETAI, featuring papers by Omohundro, Armstrong/Sotala/O’Heigeartaigh, T Goertzel, Brundage, Yampolskiy, B. Goertzel, Potapov/Rodinov, Kornai and Sandberg. - If the general intelligence of artificial systems were to surpass that of humans significantly, this would constitute a significant risk for humanity – so even if we estimate the probability of this event to be fairly low, it is necessary to think about it now. We need to estimate what progress we can expect, (...) what the impact of superintelligent machines might be, how we might design safe and controllable systems, and whether there are directions of research that should best be avoided or strengthened. (shrink)

The orthodox theory of instrumental rationality, expected utility (EU) theory, severely restricts the way in which risk-considerations can figure into a rational individual's preferences. It is argued here that this is because EU theory neglects an important component of instrumental rationality. This paper presents a more general theory of decision-making, risk-weighted expected utility (REU) theory, of which expected utility maximization is a special case. According to REU theory, the weight that each outcome gets in decision-making is not the (...) subjective probability of that outcome; rather, the weight each outcome gets depends on both its subjective probability and its position in the gamble. Furthermore, the individual's utility function, her subjective probability function, and a function that measures her attitude towards risk can be separately derived from her preferences via a Representation Theorem. This theorem illuminates the role that each of these entities plays in preferences, and shows how REU theory explicates the components of instrumental rationality. (shrink)

There has been a movement aiming to teach agents about their privilege by making the information about their privilege as costless as possible. However, some argue that in risk-sensitive frameworks, such as Lara Buchak’s (2013), it can be rational for privileged agents to shield themselves from learning about their privilege, even if the information is costless and relevant. This threatens the efficacy of these information-access efforts in alleviating the problem of elite-group ignorance. In response, I show that even within (...) the same framework, in this case David Kinney and Liam Kofi Bright’s (2021), the rationality of this information avoidance rests on shaky ground in practice. In this framework, whether an agent should avoid information depends on the precise details of (1) how relevant they expect the information to be, (2) their priors about the value of various options, and (3) their risk attitudes. The model suggests that the rationality of elite-group ignorance is a function of structural factors that are pervasive but nonetheless not insurmountable, thus offering a way out of pessimism about elite group education. (shrink)

This article explores the Nuffield Council on Bioethics’ recent report about non-invasive prenatal testing. Given that such testing is likely to become the norm, it is important to question whether there should be some ethical parameters regarding its use. The article engages with the viewpoints of Jeff McMahan, Julian Savulescu, Stephen Wilkinson and other commentators on prenatal ethics. The authors argue that there are a variety of moral considerations that legitimately play a significant role with regard to (prospective) parental decision-making (...) in the context of NIPT, for example, views on the morality of abortion and understandings of the impact of disability on quality of life. The variable nature of such considerations, both singularly and combined, suggests that any approach to NIPT should be sensitive to and understanding of similarly variable parental assessments and decisions. The implications of the approach developed for current and future policies in this area are explored, along with the impact of such arguments on ideas about procreative beneficence. (shrink)

The paper re-expresses arguments against the normative validity of expected utility theory in Robin Pope (1983, 1991a, 1991b, 1985, 1995, 2000, 2001, 2005, 2006, 2007). These concern the neglect of the evolving stages of knowledge ahead (stages of what the future will bring). Such evolution is fundamental to an experience of risk, yet not consistently incorporated even in axiomatised temporal versions of expected utility. Its neglect entails a disregard of emotional and financial effects on well-being before a particular (...) class='Hi'>risk is resolved. These arguments are complemented with an analysis of the essential uniqueness property in the context of temporal and atemporal expected utility theory and a proof of the absence of a limit property natural in an axiomatised approach to temporal expected utility theory. Problems of the time structure of risk are investigated in a simple temporal framework restricted to a subclass of temporal lotteries in the sense of David Kreps and Evan Porteus (1978). This subclass is narrow but wide enough to discuss basic issues. It will be shown that there are serious objections against the modification of expected utility theory axiomatised by Kreps and Porteus (1978, 1979). By contrast the umbrella theory proffered by Pope that she has now termed SKAT, the Stages of Knowledge Ahead Theory, offers an epistemically consistent framework within which to construct particular models to deal with particular decision situations. A model by Caplin and Leahy (2001) will also be discussed and contrasted with the modelling within SKAT (Pope, Leopold and Leitner 2007). (shrink)

To his pupil Nero and to Lucilius (friend and, as metonymy, representative of the entire mankind), Seneca testifies to his pedagogic vocation. With conviction he applies himself to demonstrate the perfect correspondence between the Stoic doctrine and the edu¬cational strategy that he proposes. Firstly, the reciprocity of the relationship between educator and pupil appears fundamental; both further their individual knowledge. Secondly, the limitations of an ethical precept that is not anchored in the intensity and concreteness of human life becomes clearly (...) apparent. Furthermore, it brings to question the weakness of a world vision not inspired by an innovative and original path. The starting point is therefore a rigorous examination of conscience to ultimately reach the revolutionary experience of risk in the moment of the last decision. In the name of truth the wise man must have the courage to embrace fate in order to really understand who he is (in a process of oikeiosis both as experience and as target), and he must instil in his pupils the courage to take risks along their own independent journey. In so doing, self-scrutiny and politics can become intertwined. It is herein that the educator’s risk and responsibilities lie. (shrink)

The author argues for a theory of responsibility for outcomes of imposed risk, based on whether it was permissible to impose the risk. When one tries to apply this persuasive model of responsibility for outcomes of risk imposition to procreation, which is a risk imposing act, one finds that it doesn’t match one’s intuitions about responsibility for outcomes of procreative risk. This mismatch exposes a justificatory gap for procreativity, namely, that procreation cannot avail itself of (...) the shared vulnerability to risks and their constraints—to the balance one is forced to strike between one’s interest in being free to impose risks on others and one’s interest in being safe from harm resulting from the risk imposed by others—which serves to justify risk imposition, generally. Whereas most risk impositions involve trade-offs of liberty and security among people who share the vulnerabilities associated with the taking, imposing, or being constrained from imposing risks, procreation involves the introduction of people into that position of vulnerability in the first place. Thus, when one procreates, one imposes risks in the absence of the shared vulnerability that usually serves as a justification for risk imposition. Procreative risks may not be wrongfully imposed, but they aren’t permissibly imposed in a manner fully comparable to other permissibly imposed risks. This makes procreation a unique form of risk imposition, with unique implications for its justification and for one’s responsibility for its outcomes. This insight can help explain several puzzling procreative asymmetries. (shrink)