:There are manifold intriguing issues located within largely unexplored borderlands of bioethics, future studies, and astrobiology. Human enhancement has for quite some time been among the foci of bioethical debates, but the same cannot be said about its global, transgenerational, and even cosmological consequences. In recent years, discussions of posthuman and, in general terms, postbiological civilization have slowly gained a measure of academic respect, in parallel with the renewed interest in the entire field of future studies and the great strides (...) made in understanding of the origin and evolution of life and intelligence in their widest, cosmic context. These developments promise much deeper synergic answers to questions regarding the long-term future of enhancement: how far can it go? Is human enhancement a further step toward building a true postbiological civilization? Should we actively participate and help shape this process? Is the future of humanity “typical” in the same Copernican sense as our location in space and time is typical in the galaxy, and if so, can we derive important insights about the evolutionary pathways of postbiological evolution from astrobiological and Search for ExtraTerrestrial Intelligence studies? These and similar questions could be understood as parts of a possible unifying research program attempting to connect cultural and moral evolution with what we know and understand about their cosmological and biological counterparts. (shrink)

With very advanced technology, a very large population of people living happy lives could be sustained in the accessible region of the universe. For every year that development of such technologies and colonization of the universe is delayed, there is therefore a corresponding opportunity cost: a potential good, lives worth living, is not being realized. Given some plausible assumptions, this cost is extremely large. However, the lesson for standard utilitarians is not that we ought to maximize the pace of technological (...) development, but rather that we ought to maximize its safety, i.e. the probability that colonization will eventually occur. This goal has such high utility that standard utilitarians ought to focus all their efforts on it. Utilitarians of a ‘person-affecting’ stripe should accept a modified version of this conclusion. Some mixed ethical views, which combine utilitarian considerations with other criteria, will also be committed to a similar bottom line. (shrink)

In the form in which it was originally expounded, the anthropic principle was presented as a warning to astrophysical and cosmological theorists of the risk of error in the interpretation of astronomical and cosmological information unless due account is taken of the biological restraints under which the information was acquired. However, the converse message is also valid: biological theorists also run the risk of error in the interpretation of the evolutionary record unless they take due heed of the astrophysical restraints (...) under which evolution took place. After an introductory discussion of the ordinary ('weak') anthropic principle and of its more contestable ('strong') analogue, a new application of the former to the problem of the evolution of terrestrial life is presented. It is shown that the evidence suggests that the evolutionary chain included at least one but probably not more than two links that were highly improbable (a priori) in the available time interval. (shrink)

Cosmology seems extremely remote from everyday human practice and experience. It is usually taken for granted that cosmological data cannot rationally influence our beliefs about the fate of humanity—and possible other intelligent species—except perhaps in the extremely distant future, when the issue of “heat death” (in an ever-expanding universe) becomes actual. Here, an attempt is made to show that it may become a practical question much sooner, if an intelligent community wishes to maximize its creative potential. We estimate, on the (...) basis of a greatly simplified model, the rate of loss of potentially useful information due to the delay in undertaking the colonization of the largest gravitationally bound structures in an accelerating universe. In addition, we argue for a natural cosmological extension of the classical taxonomy of advanced technological communities given by Kardashev. New developments in the fields of anthropic self-selection and physical eschatology give, for the first time, solid foundations to such results. This may open some new (and possibly urgent) issues in the areas of future policy making and transhumanist studies generally. It may also give us a slightly better perspective on the SETI endeavor. (shrink)

This paper discusses the relation between intelligence and motivation in artificial agents, developing and briefly arguing for two theses. The first, the orthogonality thesis, holds (with some caveats) that intelligence and final goals (purposes) are orthogonal axes along which possible artificial intellects can freely vary—more or less any level of intelligence could be combined with more or less any final goal. The second, the instrumental convergence thesis, holds that as long as they possess a sufficient level of intelligence, agents having (...) any of a wide range of final goals will pursue similar intermediary goals because they have instrumental reasons to do so. In combination, the two theses help us understand the possible range of behavior of superintelligent agents, and they point to some potential dangers in building such an agent. (shrink)

The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of (...) our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence. (shrink)

Humanity seems to have a bright future, i.e., a non-trivial chance of expanding to fill the universe with lasting life. But the fact that space near us seems dead now tells us that any given piece of dead matter faces an astronomically low chance of begating such a future. There thus exists a great filter between death and expanding lasting life, and humanity faces the ominous question: how far along this filter are we?

This article analyzes astrobiology as a cosmopolitical project—the ways in which astrobiological “sensemaking” practices do philosophical, political, cultural, ontological, and ethical work as much as they do scientific work. More specifically, this article argues that astrobiology is engaged in the crafting of a new “origin myth” that makes sense of humanity’s place in the universe during our transition from the Holocene to the Anthropocene. In doing so, this article traces the ways in which astrobiology employs scientific methodologies and engages with (...) popular culture in ways that do four kinds of major work commonly found in origin myths: telling the origin story, demarcating the boundaries between self and the other, giving normative guidance, and declaring a shared societal purpose. (shrink)