The willingness of some scientists, futurists … and now philosophers to contemplate—or even actively pursue—their own obsolescence is a source of genuine wonder. Writers such as Hans Moravec,1 Ray Kurzweil2 and Nick Bostrom3 blithely maintain that we will soon be outclassed by our own cybernetic creations as though this were a prospect that could only be celebrated and not feared. In this context, one can only applaud Agar's clearheaded investigation4 of the prospects for creating ‘post-persons’ and his eminently sensible conclusion (...) that there might be good reasons to avoid doing so. His discussion of the significance of the difference between ‘weak’ and ‘strong’ thresholds in moral status and his inductive argument to the existence of higher levels of moral status than humans currently possess constitute significant advances in the philosophical literature on this topic. In these largely sympathetic remarks I will, however, argue both that post-persons are more easily conceived of than Agar suggests and that the threat posed by post-persons, should they eventuate, is greater than Agar allows.Agar's paper needs to be read in the context of Buchanan's discussion5 of the implications of post-personhood to which it is a response. Buchanan's discussion proceeds, for the most part, with reference to an essentially Kantian account of moral status as founded in the ability to engage in practical reasoning or practices of mutual accountability. Talk of ‘animals’, ‘persons’ …. (shrink)

:Several lines of reasoning have been employed to both approve and disapprove two of Nicholas Agar’s positions: his argument that the creation of postpersons is imaginable and possible and his inductive argument disfavoring the creation of postpersons. This article discusses a number of these lines of reasoning, arguing that1)The creation of postpersons is imaginable if they are envisaged as morally enhanced beings.2)The creation of postpersons is justified, subject to the condition that we create morally enhanced postpersons.The reason given for the (...) first point is that it is possible to imagine postpersons who are morally enhanced, provided that we consider moral enhancement as an augmented inclination to act in line with how we believe we ought to act. There are two reasons offered for the second point: the first indicates probability, and the second offers proof. That is, if we assume that the higher moral status of postpersons implies their enhanced morality, we can conclude, inductively, that postpersons will not be inclined to annihilate mere persons. For if mere persons have moral inhibitions against obliterating some species of a lower moral status than their own, morally enhanced postpersons will be even less likely to do the same to mere persons. In fact, they might consider it their moral duty to preserve those beings who enabled them to come into existence. Moreover, even if morally enhanced postpersons decide to annihilate mere persons, we can conclude, deductively, that such a decision is by necessity a morally superior stance to the wish of mere persons to continue to exist. (shrink)

I discuss the argument of Persson and Savulescu that moral enhancement ought to accompany cognitive enhancement, as well as briefly addressing critiques of this argument, notably by John Harris. I argue that Harris, who believes that cognitive enhancement is largely sufficient for making us behave more morally, might be disposing too easily of the great quandary of our moral existence: the gap between what we do and what we believe is morally right to do. In that regard, Persson and Savulescu's (...) position has the potential to offer more. However, I question Persson and Savulescu's proposal of compulsory moral enhancement, proposing the alternative of voluntary moral enhancement. (shrink)

abstract As history shows, some human beings are capable of acting very immorally. 1 Technological advance and consequent exponential growth in cognitive power means that even rare evil individuals can act with catastrophic effect. The advance of science makes biological, nuclear and other weapons of mass destruction easier and easier to fabricate and, thus, increases the probability that they will come into the hands of small terrorist groups and deranged individuals. Cognitive enhancement by means of drugs, implants and biological (including (...) genetic) interventions could thus accelerate the advance of science, or its application, and so increase the risk of the development or misuse of weapons of mass destruction. We argue that this is a reason which speaks against the desirability of cognitive enhancement, and the consequent speedier growth of knowledge, if it is not accompanied by an extensive moral enhancement of humankind. We review the possibilities for moral enhancement by biomedical and genetic means and conclude that, though it should be possible in principle, it is in practice probably distant. There is thus a reason not to support cognitive enhancement in the foreseeable future. However, we grant that there are also reasons in its favour, but we do not attempt to settle the balance between these reasons for and against. Rather, we conclude that if research into cognitive enhancement continues, as it is likely to, it must be accompanied by research into moral enhancement. (shrink)

In his challenging paper,1 Vojin Rakic argues against our claim that ‘there are strong reasons to believe’ that moral bioenhancement should be obligatory or compulsory if it can be made safe and effective.2 Rakic starts by criticising an argument that we employed against John Harris.3 ,4 In this argument we maintain, among other things, that moral bioenhancement cannot be wholly effective if our will is free in what is called an ‘indeterministic’ or ‘contra-causal sense’; that is, if our choices are (...) not fully determined by our biology and environmental circumstances. Rakic contends that we ‘do not take into account the possibility that we can have an entirely free will that does not limit the effectiveness of moral bio-enhancement’. We can use ‘our freedom to decide to be morally bio-enhanced’.In reply, we would like to insist that if our freedom is freedom in this indeterministic sense, we cannot use this freedom to decide to subject ourselves to effective moral bioenhancement, since this effectiveness presupposes that our will is fully determined by biological causes that this enhancement influences. If certain sub-atomic processes are indeterministic, probabilistic, we cannot make them deterministic. We cannot change the laws …. (shrink)

I shall discuss only one of Nicholas Agar's main claims,1 namely ‘that the bad consequences/of moral status enhancement/are, in moral terms, so bad that a moderate probability of their occurrence makes it wrong not to seek to prevent them’. His other main claim, which I grant, is that moral status enhancement to the effect of creating beings with a moral status higher than that of persons—post-persons—is possible. My chief objection to Agar's argument is that it is biased in favour of (...) persons. This comes out when he sums it up: ‘the creation of post-persons would be a morally bad thing. It is likely to impose significant penalties on mere persons’. Suppose it is true that the creation of post-persons will impose such significant penalties on mere persons that they are worse off than they were before the creation of post-persons. Then it follows that the creation of post-persons is bad for mere persons, but it does not follow that it is bad overall. This follows only if it is not the case that post-persons receive benefits to an extent that morally outweighs the burdens to mere persons. As far as I can see, Agar does not show this—that is why I think he is biased towards mere persons, and simply assumes that what is bad for them is bad overall.I have, in fact, been too concessive to Agar …. (shrink)

The universe that surrounds us is vast, and we are so very small. When we reflect on the vastness of the universe, our humdrum cosmic location, and the inevitable future demise of humanity, our lives can seem utterly insignificant. Many philosophers assume that such worries about our significance reflect a banal metaethical confusion. They dismiss the very idea of cosmic significance. This, I argue, is a mistake. Worries about cosmic insignificance do not express metaethical worries about objectivity or nihilism, and (...) we can make good sense of the idea of cosmic significance and its absence. It is also possible to explain why the vastness of the universe can make us feel insignificant. This impression does turn out to be mistaken, but not for the reasons typically assumed. In fact, we might be of immense cosmic significance—though we cannot, at this point, tell whether this is the case. (shrink)

The universe that surrounds us is vast, and we are so very small. When we reflect on the vastness of the universe, our humdrum cosmic location, and the inevitable future demise of humanity, our lives can seem utterly insignificant. Many philosophers assume that such worries about our significance reflect a banal metaethical confusion. They dismiss the very idea of cosmic significance. This, I argue, is a mistake. Worries about cosmic insignificance do not express metaethical worries about objectivity or nihilism, and (...) we can make good sense of the idea of cosmic significance and its absence. It is also possible to explain why the vastness of the universe can make us feel insignificant. This impression does turn out to be mistaken, but not for the reasons typically assumed. In fact, we might be of immense cosmic significance-though we cannot, at this point, tell whether this is the case. (shrink)

Cosmology seems extremely remote from everyday human practice and experience. It is usually taken for granted that cosmological data cannot rationally influence our beliefs about the fate of humanity—and possible other intelligent species—except perhaps in the extremely distant future, when the issue of “heat death” (in an ever-expanding universe) becomes actual. Here, an attempt is made to show that it may become a practical question much sooner, if an intelligent community wishes to maximize its creative potential. We estimate, on the (...) basis of a greatly simplified model, the rate of loss of potentially useful information due to the delay in undertaking the colonization of the largest gravitationally bound structures in an accelerating universe. In addition, we argue for a natural cosmological extension of the classical taxonomy of advanced technological communities given by Kardashev. New developments in the fields of anthropic self-selection and physical eschatology give, for the first time, solid foundations to such results. This may open some new (and possibly urgent) issues in the areas of future policy making and transhumanist studies generally. It may also give us a slightly better perspective on the SETI endeavor. (shrink)

Nicholas Agar argues that it is possible, and even likely, that radically enhanced human beings will turn out to be ‘post-persons’, that is, beings with a moral status higher than that of mere persons such as us.1 This would mean that they will be morally justified in sacrificing our lives and well-being not merely in cases of emergency, but also in cases of ‘supreme opportunities’ , that is, whenever such a sacrifice leads to ‘significant benefits for post-persons’. For this reason, (...) Agar believes, it would be morally wrong to allow any cognitive enhancement of people that might entail the risk of moral status enhancement.However, neither are there sufficient grounds to expect radically enhanced human beings to have a higher moral status than unenhanced human beings, nor would it, even if they did, be morally wrong to bring about their existence. We use moral status ascriptions mostly as a convenient shorthand to indicate a difference in capacities that strikes us as morally relevant. Rocks have zero moral status because they cannot feel or think, so we cannot hurt or kill them. Whatever we do to them, it does not affect them. Animals, on the other hand, …. (shrink)

This paper identifies human enhancement as one of the most significant areas of bioethical interest in the last twenty years. It discusses in more detail one area, namely moral enhancement, which is generating significant contemporary interest. The author argues that so far from being susceptible to new forms of high tech manipulation, either genetic, chemical, surgical or neurological, the only reliable methods of moral enhancement, either now or for the foreseeable future, are either those that have been in human and (...) animal use for millennia, namely socialization, education and parental supervision or those high tech methods that are general in their application. By that is meant those forms of cognitive enhancement that operate across a wide range of cognitive abilities and do not target specifically ‘ethical’ capacities. The paper analyses the work of some of the leading contemporary advocates of moral enhancement and finds that in so far as they identify moral qualities or moral emotions for enhancement they have little prospect of success. (shrink)

Nicholas Agar argues, that enhancement technologies could be used to create post-persons—beings of higher moral status than ordinary persons—and that it would be wrong to create such beings.1 I am sympathetic to the first claim. However, I wish to take issue with the second.Agar's second claim is grounded on the prediction that the creation of post-persons would, with at least moderate probability, harm those who remain mere persons. The harm that Agar has in mind here is a kind of meta-harm: (...) the harm of being made more susceptible to being permissibly harmed—more liable to harm. Agar suggests that, if post-persons existed, mere persons could frequently be permissibly sacrificed in order to provide benefits to the post-persons. For instance, perhaps they could be permissibly used in lethal medical experiments designed to develop medical treatments for post-persons. By contrast, he suggests that mere persons typically cannot be permissibly sacrificed to provide benefits to other mere persons. He thus claims that mere persons would be more liable to sacrifice if post-persons existed than they are in the absence of post-persons. The creation of post-persons would make them worse off in at least this one respect.Agar then argues that, since this meta-harm imposed on mere persons would not be compensated, it would be wrong to create post-persons. It is here that I believe his argument begins to go awry. According to the concept of compensation that Agar deploys , a harm imposed on X is compensated just in …. (shrink)

With very advanced technology, a very large population of people living happy lives could be sustained in the accessible region of the universe. For every year that development of such technologies and colonization of the universe is delayed, there is therefore a corresponding opportunity cost: a potential good, lives worth living, is not being realized. Given some plausible assumptions, this cost is extremely large. However, the lesson for standard utilitarians is not that we ought to maximize the pace of technological (...) development, but rather that we ought to maximize its safety, i.e. the probability that colonization will eventually occur. This goal has such high utility that standard utilitarians ought to focus all their efforts on it. Utilitarians of a ‘person-affecting’ stripe should accept a modified version of this conclusion. Some mixed ethical views, which combine utilitarian considerations with other criteria, will also be committed to a similar bottom line. (shrink)

Because of accelerating technological progress, humankind may be rapidly approaching a critical phase in its career. In addition to well-known threats such as nuclear holocaust, the propects of radically transforming technologies like nanotech systems and machine intelligence present us with unprecedented opportunities and risks. Our future, and whether we will have a future at all, may well be determined by how we deal with these challenges. In the case of radically transforming technologies, a better understanding of the transition dynamics from (...) a human to a "posthuman" society is needed. Of particular importance is to know where the pitfalls are: the ways in which things could go terminally wrong. While we have had long exposure to various personal, local, and endurable global hazards, this paper analyzes a recently emerging category: that of existential risks. These are threats that could case our extinction or destroy the potential of Earth - originating intelligent life. Some of these threats are relatively well known while others, including some of the gravest, have gone almost unrecognized. Existential risks have a cluster of features that make ordinary risk management ineffective. A final section of this paper discusses several ethical and policy implications. A clearer understanding of the threat picture will enable us to formulate better strategies. (shrink)

Unfit for the Future argues that the future of our species depends on radical enhancement of the moral aspects of our nature. Population growth and technological advances are threatening to undermine the conditions of worthwhile life on earth forever. We need to modify the biological bases of human motivation to deal with this challenge.

In this century a number of events could extinguish humanity. The probability of these events may be very low, but the expected value of preventing them could be high, as it represents the value of all future human lives. We review the challenges to studying human extinction risks and, by way of example, estimate the cost effectiveness of preventing extinction-level asteroid impacts.