Recent progress in artificial intelligence (AI) has drawn attention to the technology’s transformative potential, including what some see as its prospects for causing large-scale harm. We review two influential arguments purporting to show how AI could pose catastrophic risks. The first argument — the Problem of Power-Seeking — claims that, under certain assumptions, advanced AI systems are likely to engage in dangerous power-seeking behavior in pursuit of their goals. We review reasons for thinking that AI systems might seek power, that (...) they might obtain it, that this could lead to catastrophe, and that we might build and deploy such systems anyway. The second argument claims that the development of human-level AI will unlock rapid further progress, culminating in AI systems far more capable than any human — this is the Singularity Hypothesis. Power-seeking behavior on the part of such systems might be particularly dangerous. We discuss a variety of objections to both arguments and conclude by assessing the state of the debate. (shrink)

The singularity hypothesis is a radical hypothesis about the future of artificial intelligence on which self-improving artificial agents will quickly become orders of magnitude more intelligent than the average human. Despite the ambitiousness of its claims, the singularity hypothesis has been defended at length by leading philosophers and artificial intelligence researchers. In this paper, I argue that the singularity hypothesis rests on scientifically implausible growth assumptions. I show how leading philosophical defenses of the singularity hypothesis (Chalmers 2010, Bostrom 2014) fail (...) to overcome the case for skepticism. I conclude by drawing out philosophical implications of this discussion for our understanding of consciousness, personal identity, digital minds, existential risk, and ethical longtermism. GPI Working Paper No . 19-2022. (shrink)

The GOLEM XIV’s forecast for the development of the human civilisation and a typology of technological singularities: In the paper, a conceptual analysis of technological singularity is conducted and results in the concept differentiated into convergent singularity, existential singularity, and forecasting singularity, based on selected works of Ray Kurzweil, Nick Bostrom, and Vernor Vinge respectively. A comparison is made between the variants and the forecast of GOLEM XIV (a quasi-alter ego and character by Stanisław Lem) for the possible development of (...) Homo sapiens civilisation. According to the prediction, the scientific and technological progress is to bring humanity to transfer its civilisational primacy to a nonhuman superhuman intelligence xor a posthuman one. Both scenarios are best described by forecasting singularity, yet all variants are applicable only conditionally. As GOLEM did not undertake, the trajectories may also intersect or combine. (shrink)

The impacts that AI and robotics systems can and will have on our everyday lives are already making themselves manifest. However, there is a lack of research on the ethical impacts and means for amelioration regarding AI and robotics within tourism and hospitality. Given the importance of designing technologies that cross national boundaries, and given that the tourism and hospitality industry is fundamentally predicated on multicultural interactions, this is an area of research and application that requires particular attention. Specifically, tourism (...) and hospitality have a range of context-unique stakeholders that need to be accounted for in the salient design of AI systems is to be achieved. This paper adopts a stakeholder approach to develop the conceptual framework to centralize human values in designing and deploying AI and robotics systems in tourism and hospitality. The conceptual framework includes several layers – ‘Human-human-AI’ interaction level, direct and indirect stakeholders, and the macroenvironment. The ethical issues on each layer are outlined as well as some possible solutions to them. Additionally, the paper develops a research agenda on the topic. (shrink)

This concluding chapter of _Techno-Fixers: Origins and Implications of Technological Faith_ examines the widespread overconfidence in present-day and proposed 'technological fixes', and provides guidelines - social, ethical and technical - for soberly assessing candidate technological solutions for societal problems.

This chapter focuses on AI-based cognitive and perceptual enhancements. AI-based brain enhancements are already under development, and they may become commonplace over the next 30–50 years. We raise doubts concerning whether radical AI-based enhancements transhumanists advocate will accomplish the transhumanists goals of longevity, human flourishing, and intelligence enhancement. We urge that even if the technologies are medically safe and are not used as tools by surveillance capitalism or an authoritarian dictatorship, these enhancements may still fail to do their job for (...) philosophical reasons. In what follows, we explore one such concern, a problem that involves the nature of the self. We illustrate that the so called transhumanist efforts to “merge oneself with AI” could lead to perverse realizations of AI technology, such as the demise of the person who sought enhancement. And, in a positive vein, we offer ways to avoid this, at least within the context of one theory of the nature of personhood. (shrink)

This paper aims to justify the concept of natural intelligence in the biosemiotic context. I will argue that the process of life is (i) a cognitive/semiotic process and (ii) that organisms, from bacteria to animals, are cognitive or semiotic agents. To justify these arguments, the neural-type intelligence represented by the form of reasoning known as anthropic reasoning will be compared and contrasted with types of intelligence explicated by four disciplines of biology – relational biology, evolutionary epistemology, biosemiotics and the systems (...) view of life – not biased towards neural intelligence. The comparison will be achieved by asking questions related to the process of observation and the notion of true observers. To answer the questions I will rely on a range of established concepts including SETI (search for extraterrestrial intelligence), Fermi’s paradox, bacterial cognition, versions of the panspermia theory, as well as some newly introduced concepts including biocivilisations, cognitive/semiotic universes, and the cognitive/semiotic multiverse. The key point emerging from the answers is that the process of cognition/semiosis – the essence of natural intelligence – is a biological universal. (shrink)

What kinds of fundamental limits are there in how capable artificial intelligence (AI) systems might become? Two questions in particular are of interest: (1) How much more capable could AI become relative to humans, and (2) how easily could superhuman capability be acquired? To answer these questions, we will consider the literature on human expertise and intelligence, discuss its relevance for AI, and consider how AI could improve on humans in two major aspects of thought and expertise, namely simulation and (...) pattern recognition. We find that although there are very real limits to prediction, it seems like AI could still substantially improve on human intelligence. (shrink)

The deep crisis in modern fundamental science development is ever more evident and openly recognised now even by mainstream, official science professionals and leaders. By no coincidence, it occurs in parallel to the world civilisation crisis and related global change processes, where the true power of unreduced scientific knowledge is just badly missing as the indispensable and unique tool for the emerging greater problem solution and further progress at a superior level of complex world dynamics. Here we reveal the mathematically (...) exact reason for the crisis in conventional science, containing also the natural and unified problem solution in the form of well-specified extension of usual, artificially restricted paradigm. We show how that extended, now causally complete science content provides various "unsolvable" problem solutions and opens new development possibilities for both science and society, where the former plays the role of the main, direct driver for the latter. We outline the related qualitative changes in science organisation, practice and purposes, giving rise to the sustainability transition in the entire civilisation dynamics towards the well-specified superior level of its unreduced, now well understood and universally defined complexity. (shrink)

This paper focuses on the research field of machine ethics and how it relates to a technological singularity—a hypothesized, futuristic event where artificial machines will have greater-than-human-level intelligence. One problem related to the singularity centers on the issue of whether human values and norms would survive such an event. To somehow ensure this, a number of artificial intelligence researchers have opted to focus on the development of artificial moral agents, which refers to machines capable of moral reasoning, judgment, and decision-making. (...) To date, different frameworks on how to arrive at these agents have been put forward. However, there seems to be no hard consensus as to which framework would likely yield a positive result. With the body of work that they have contributed in the study of moral agency, philosophers may contribute to the growing literature on artificial moral agency. While doing so, they could also think about how the said concept could affect other important philosophical concepts. (shrink)

For those who find Dreyfus’s critique of AI compelling, the prospects for producing true artificial human intelligence are bleak. An important question thus becomes, what are the prospects for producing artificial non-human intelligence? Applying Dreyfus’s work to this question is difficult, however, because his work is so thoroughly human-centered. Granting Dreyfus that the body is fundamental to intelligence, how are we to conceive of non-human bodies? In this paper, I argue that bringing Dreyfus’s work into conversation with the work of (...) Mark Bickhard offers a way of answering this question, and I try to suggest what doing so means for AI research. (shrink)

An extended analysis compared to observations shows that modern “globalised” world civilisation has passed through the invisible “complexity threshold”, after which usual “spontaneous”, empirically driven kind of development (“invisible hand” etc.) cannot continue any more without major destructive tendencies. A much deeper, non-simplified understanding of real interaction complexity is necessary in order to cope with such globalised world development problems. Here we introduce the universal definition, fundamental origin, and dynamic equations for a major related quantity of (systemic) risk characterising real (...) complex system development tendencies at any level of dynamics. Practically important conclusions are derived, opening further detailed applications in economy, finance and development practice. (shrink)

We propose a qualitatively new kind of governance for the emerging need to efficiently guide the densely interconnected, ever more complex world development, which is based on explicit and openly presented problem solutions and their interactive implementation practice within the versatile, but unified professional analysis of complex real-world dynamics, involving both the powerful central units and the attached creative worldwide network of professional representatives. We provide fundamental and rigorous scientific arguments in favour of introduction of just that kind of governance (...) at the modern development stage, after the complexity threshold in the real world dynamics evolution (sometimes intuitively designated as "globalisation"), where the traditional spontaneous-empirical kind of development and related administrative governance lose dramatically and inevitably their efficiency and the necessity of explicit consistent understanding and guidance of complex real-world dynamics becomes evident. (shrink)

The present volume is the fifth in the series of yearbooks with the title Globalistics and Globalization Studies. The subtitle of the present volume is Global Transformations and Global Future. We become more and more accustomed to think globally and to see global processes. And our future can all means be global. However, is this statement justified? Indeed, in recent years, many have begun to claim that globalization has stalled, that we are rather dealing with the process of anti-globalization. Will (...) not we find ourselves at some point again in an edifice spanning across the globe, but divided into national apartments, separated by walls of high tariffs and mutual suspicion? Of course, some setbacks are always possible, because the process of globalization cannot develop smoothly. It is a process which is itself emerging from contradictions and is shaped by a new contradiction. They often go much further than underlying systemic changes allow. They break forward, as the vanguard of a victorious army, and then often meet resistance of various social and political forces and may suddenly start to roll back just at the moment when everyone expects their further offensive. We believe that this is what is happening with globalization at present. The yearbook will be interesting to a wide range of researchers, teachers, students and all those who are concerned about global issues. (shrink)

With very advanced technology, a very large population of people living happy lives could be sustained in the accessible region of the universe. For every year that development of such technologies and colonization of the universe is delayed, there is therefore a corresponding opportunity cost: a potential good, lives worth living, is not being realized. Given some plausible assumptions, this cost is extremely large. However, the lesson for standard utilitarians is not that we ought to maximize the pace of technological (...) development, but rather that we ought to maximize its safety, i.e. the probability that colonization will eventually occur. This goal has such high utility that standard utilitarians ought to focus all their efforts on it. Utilitarians of a ‘person-affecting’ stripe should accept a modified version of this conclusion. Some mixed ethical views, which combine utilitarian considerations with other criteria, will also be committed to a similar bottom line. (shrink)

Transhumanism introduces from its very beginning a paradigm shift about concepts like human nature, progress and human future. An overview of its ideology reveals a strong belief in the idea of human enhancement through technologically means. The theory of technological singularity, which is more or less a radicalisation of the transhumanist discourse, foresees a radical evolutionary change through artificial intelligence. The boundaries between intelligent machines and human beings will be blurred. The consequence is the upcoming of a post-biological and posthuman (...) future when intelligent technology becomes autonomous and constantly self-improving. Considering these predictions, I will investigate here the way in which the idea of human enhancement modifies our understanding of technological innovation. I will argue that such change goes in at least two directions. On the one hand, innovation is seen as something that will inevitably lead towards intelligent machines and human enhancement. On the other hand, there is a direction such as “Singularity University,” where innovation is called to pragmatically solving human challenges. Yet there is a unifying spirit which holds together the two directions and I think it is the same transhumanist idea. (shrink)

Because of accelerating technological progress, humankind may be rapidly approaching a critical phase in its career. In addition to well-known threats such as nuclear holocaust, the propects of radically transforming technologies like nanotech systems and machine intelligence present us with unprecedented opportunities and risks. Our future, and whether we will have a future at all, may well be determined by how we deal with these challenges. In the case of radically transforming technologies, a better understanding of the transition dynamics from (...) a human to a "posthuman" society is needed. Of particular importance is to know where the pitfalls are: the ways in which things could go terminally wrong. While we have had long exposure to various personal, local, and endurable global hazards, this paper analyzes a recently emerging category: that of existential risks. These are threats that could case our extinction or destroy the potential of Earth - originating intelligent life. Some of these threats are relatively well known while others, including some of the gravest, have gone almost unrecognized. Existential risks have a cluster of features that make ordinary risk management ineffective. A final section of this paper discusses several ethical and policy implications. A clearer understanding of the threat picture will enable us to formulate better strategies. (shrink)

Systems evolve in order to adjust and survive. The paper’s contribution is that this evolvement is inadequate without an evolutionary telos. It is argued that without the presence of self-destruction in multiple levels of our existence and surroundings, our survival would have been impossible. This paper recognises an appreciation of auto-catastrophe at the cell level, in human attitudes (both as an individual and in societies), and extended to Earth and out to galaxies. Auto-Catastrophic Theory combines evolution with auto-catastrophic behaviours and (...) innovative machinery by offering new themes of understanding their merging such as (a) protogenic and deuterogenic auto-catastrophic processes, (b) protogenic and deuterogenic survival processes, and (c) ‘alive’, partially ‘alive’, and non-‘alive’ systems. The value of self-destruction relies on a numerical stability within a system and correlational relationships between systems. Auto-Catastrophic Theory provides novel justifications why artificial intelligence: (a) is crucial to overcome the extinction of humanity (via H+), (b) is crucial to offer indirect survival of humanity (by saving its history), and (c) is at the same time a threat for humanity. These novel justifications and themes, developed by combining evolution with catastrophe as well as innovative machinery, expand our knowledge of how best to handle fresh challenges ahead. (shrink)

The present paper criticizes Chalmers's discussion of the Singularity, viewed as the emergence of a superhuman intelligence via the self-amplifying development of artificial intelligence. The situated and embodied view of cognition rejects the notion that intelligence could arise in a closed 'brain-in-a-vat' system, because intelligence is rooted in a high-bandwidth, sensory-motor interaction with the outside world. Instead, it is proposed that superhuman intelligence can emerge only in a distributed fashion, in the form of a self-organizing network of humans, computers, and (...) other technologies: the 'Global Brain'. (shrink)

In his 1993 article ‘The Coming Technological Singularity: How to survive in the posthuman era’ the computer scientist Virnor Vinge speculated that developments in artificial intelligence might reach a point where improvements in machine intelligence result in smart AI’s producing ever-smarter AI’s. According to Vinge the ‘singularity’, as he called this threshold of recursive self-improvement, would be a ‘transcendental event’ transforming life on Earth in ways that unaugmented humans are not equipped to envisage. In this paper I argue Vinge’s idea (...) of a technologically led intelligence explosion is philosophically important because it requires us to consider the prospect of a posthuman condition succeeding the human one. What is the ‘humanity’ to which the posthuman is ‘post’? Does the possibility of a posthumanity presuppose that there is a ‘human essence’, or is there some other way of conceiving the human-posthuman difference? I argue that the difference should be conceived as a historically emergent disconnection between individuals, not in terms of the presence or lack of essential properties. I also suggest that these individuals should not be conceived in narrow biological terms but in ‘wide’ terms permitting biological, cultural and technological relations of descent between human and posthuman. Finally, I consider the ethical implications of this metaphysics of the posthuman. If, as I claim, the posthuman difference is not one between kinds but between individuals, we cannot specify its nature a priori but only a posteriori. Thus the only way to evaluate the posthuman condition would be to witness the emergence of posthumans. The implications of this are somewhat paradoxical. We are not currently in a position to evaluate the posthuman condition. Since there are no posthumans, the condition of posthumanity is not defined. However, posthumans could result from some iteration of our current technical activity, so we have an interest in understanding what they might be like. It follows that we have an interest in making or becoming posthumans. (shrink)

I survey four categories of factors that might give a digital mind, such as an upload or an artificial general intelligence, an advantage over humans. Hardware advantages include greater serial speeds and greater parallel speeds. Self-improvement advantages include improvement of algorithms, design of new mental modules, and modification of motivational system. Co-operative advantages include copyability, perfect co-operation, improved communication, and transfer of skills. Human handicaps include computational limitations and faulty heuristics, human-centric biases, and socially motivated cognition. The shape of hardware (...) growth curves, as well as the ease of modifying minds, are found to have a major impact on how quickly a digital mind may take advantage of these factors. (shrink)

The human desire to acquire new capacities is as ancient as our species itself. We have always sought to expand the boundaries of our existence, be it socially, geographically, or mentally. There is a tendency in at least some individuals always to search for a way around every obstacle and limitation to human life and happiness.

I distinguish the ethics of transhumanism from a related metaphysical position which I refer to as “speculative posthumanism.” Speculative posthumanism holds that posthumans might be radically non-human and thus unintelligible in human terms. I claim that this transcendence can be viewed as analogous to that of the thing-in-itself in Kantian and post-Kantian European philosophy. This schema implies an impasse for transhumanism because, while the radically non-human or posthuman would elude evaluation according to transhumanist principles such as personal autonomy or liberal (...) freedom, it is morally unacceptable for transhumanists to discount the possible outcomes of their favoured policies. I then consider whether the insights of critical posthumanists, who employ a cyborg perspective on human-technology couplings, can dissolve this impasse by “deconstructing” the opposition between the human and its prospective posthuman successors. By exhibiting its logical basis in the postructuralist philosophies of Derrida and Deleuze, I show that the cyborg perspective is consistent with both cyborg humanism and a modified speculative posthumanism. This modified account treats the alterity of the posthuman as a historically emergent feature of human and posthuman multiplicities that must be understood through their technical or imaginative synthesis, not in relation to a transcendental conception of the human. (shrink)

What happens when machines become more intelligent than humans? One view is that this event will be followed by an explosion to ever-greater levels of intelligence, as each generation of machines creates more intelligent machines in turn. This intelligence explosion is now often known as the “singularity”. The basic argument here was set out by the statistician I.J. Good in his 1965 article “Speculations Concerning the First Ultraintelligent Machine”: Let an ultraintelligent machine be defined as a machine that can far (...) surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an “intelligence explosion”, and the intelligence of man would be left far behind. Thus the first ultraintelligent machine is the last invention that man need ever make. The key idea is that a machine that is more intelligent than humans will be better than humans at designing machines. So it will be capable of designing a machine more intelligent than the most intelligent machine that humans can design. So if it is itself designed by humans, it will be capable of designing a machine more intelligent than itself. By similar reasoning, this next machine will also be capable of designing a machine more intelligent than itself. If every machine in turn does what it is capable of, we should expect a sequence of ever more intelligent machines. This intelligence explosion is sometimes combined with another idea, which we might call the “speed explosion”. The argument for a speed explosion starts from the familiar observation that computer processing speed doubles at regular intervals. Suppose that speed doubles every two years and will do so indefinitely. Now suppose that we have human-level artificial intelligence 1 designing new processors. Then faster processing will lead to faster designers and an ever-faster design cycle, leading to a limit point soon afterwards. The argument for a speed explosion was set out by the artificial intelligence researcher Ray Solomonoff in his 1985 article “The Time Scale of Artificial Intelligence”.1 Eliezer Yudkowsky gives a succinct version of the argument in his 1996 article “Staring at the Singularity”: “Computing speed doubles every two subjective years of work.. (shrink)

Neuroscience, together with a broadened concept of “mind” has instigated pragmatic and ethical concerns about the experience and treatment of pain. If pain medicine is to be authentic, it requires knowledge of the brain-mind, pain, and the relative and appropriate “goodness” of potential interventions that can and/or should be provided. This speaks to the need for an ethics that reflects and is relevant to the contemporary neuroscience of pain, acknowledgment and appreciation of the sentient being in pain, effects of environment (...) and value(s), and the nature of healing. It may be that neuroethics provides this viable meta-ethic for pain care. This essay describes how an integrative neuroethics of pain care allows, if not obligates, alignment of facts, values, and moral attitudes as a continuing process of re-investigation, analysis, and revision of what we know (and don’t know) about brains, minds, selves, and how we regard and treat the painient. (shrink)

The evolution of life on Earth has produced an organism that is beginning to model and understand its own evolution and the possible future evolution of life in the universe. These models and associated evidence show that evolution on Earth has a trajectory. The scale over which living processes are organized cooperatively has increased progressively, as has its evolvability. Recent theoretical advances raise the possibility that this trajectory is itself part of a wider developmental process. According to these theories, the (...) developmental process has been shaped by a yet larger evolutionary dynamic that involves the reproduction of universes. This evolutionary dynamic has tuned the key parameters of the universe to increase the likelihood that life will emerge and produce outcomes that are successful in the larger process (e.g. a key outcome may be to produce life and intelligence that intentionally reproduces the universe and tunes the parameters of ‘offspring’ universes). Theory suggests that when life emerges on a planet, it moves along this trajectory of its own accord. However, at a particular point evolution will continue to advance only if organisms emerge that decide to advance the developmental process intentionally. The organisms must be prepared to make this commitment even though the ultimate nature and destination of the process is uncertain, and may forever remain unknown. Organisms that complete this transition to intentional evolution will drive the further development of life and intelligence in the universe. Humanity’s increasing understanding of the evolution of life in the universe is rapidly bringing it to the threshold of this major evolutionary transition. (shrink)

Because of accelerating technological progress, humankind may be rapidly approaching a critical phase in its career. In addition to well-known threats such as nuclear holocaust, the prospects of radically transforming technologies like nanotech systems and machine intelligence present us with unprecedented opportunities and risks. Our future, and whether we will have a future at all, may well be determined by how we deal with these challenges. In the case of radically transforming technologies, a better understanding of the transition dynamics from (...) a human to a “posthuman” society is needed. Of particular importance is to know where the pitfalls are: the ways in which things could go terminally wrong. While we have had long exposure to various personal, local, and endurable global hazards, this paper analyzes a recently emerging category: that of existential risks. These are threats that could cause our extinction or destroy the potential of Earth-originating intelligent life. Some of these threats are relatively well known while others, including some of the gravest, have gone almost unrecognized. Existential risks have a cluster of features that make ordinary risk management ineffective. A final section of this paper discusses several ethical and policy implications. A clearer understanding of the threat picture will enable us to formulate better strategies. (shrink)

Law and the legal system through which law is effected are very powerful, yet the power of the law has always been limited by the laws of nature, upon which the law has now direct grip. Human law now faces an unprecedented challenge, the emergence of a second limit on its grip, a new “species” of intelligent agents (AI machines) that can perform cognitive tasks that until recently only humans could. What happens, as a matter of law, when another species (...) interacts with us, can be integrated into human minds and bodies, makes “real-world” decisions—not through human proxies, but directly—and does all this “intelligently”, with what one could call autonomous agency or even a “mind” of its own? The article starts from the clear premise that control cannot be exercised directly on AI machines through human law. That control can only be effected through laws that apply to humans. This has several regulatory implications. The article’s first discusses what, in any attempt to regulate AI machines, the law can achieve. Having identified what the law can do, the article then canvases what the law should aim to achieve overall. The article encapsulate its analysis in a list of both doctrinal and normative principles that should underpin any regulation aimed at AI machines. Finally, the article compares three transnational options to implement the proposed regulatory approach. (shrink)

V nasledujúcom príspevku sa snažíme zdôvodniť vyčlenenie troch typov procesov v pozorovanom vesmíre - procesov slabo, stredne a silne usmernených, a to na základe rôznej miery autonómnosti ich štruktúrnych prvkov a rôznej miery či intenzity zákonov, ktorými sú usmerňované alebo riadené. Individuálne a konkrétne procesy sú tak v podstate totožné s individuálnymi a konkrétnymi systémami, cez ktoré, v ktorých a prostredníctvom ktorých sa úplne realizujú, disponujúc tak vždy a všade vlastným substanciálnym obsahom. Na tomto základe potom vyčleňujeme slabo usmernené procesy (...) v neživej prírode s málo vyčlenenými alebo autonómnymi štruktúrnymi prvkami, stredne usmernené procesy živej prírody s oveľa väčšími, vyčlenenejšími a autonómnejšími štruktúrnymi prvkami vo forme živých buniek a postupne rastúcich a zdokonaľujúcich sa organizmov a tried organizmov a nakoniec silne usmernené procesy tzv. sociálnej prírody alebo ľudskej spoločnosti, pozostávajúcej z ľudí ako svojich základných alebo štruktúrnych prvkov a tiež z nimi generovaného technického a/lebo civilizačného "obalu", ktoré sú podobne ako živé procesy a systémy usmerňované a riadené čoraz väčším počtom pre nich špecifických vedeckých zákonov, princípov alebo "pravidiel". (shrink)

The goal of this paper is to describe the mechanism of the public perception of risk of artificial intelligence. For that we apply the social amplification of risk framework to the public perception of artificial intelligence using data collected from Twitter from 2007 to 2018. We analyzed when and how there appeared a significant representation of the association between risk and artificial intelligence in the public awareness of artificial intelligence. A significant finding is that the image of the risk of (...) AI is mostly associated with existential risks that became popular after the fourth quarter of 2014. The source of that was the public positioning of experts who happen to be the real movers of the risk perception of AI so far instead of actual disasters. We analyze here how this kind of risk was amplified, its secondary effects, what are the varieties of risk unrelated to existential risk, and what is the dynamics of the experts in addressing their concerns to the audience of lay people. (shrink)

Robotics and artificial intelligence are beginning to fundamentally change the relative profitability and productivity of investments in capital versus human labor; creating technological unemployment at all levels of the workforce; from the North to the developing world. As robotics and expert systems become cheaper and more capable the percentage of the population that can find employment will also fall; stressing economies already trying to curtail "entitlements" and adopt austerity. Two additional technology-driven trends will exacerbate the structural unemployment crisis in the (...) coming decades; desktop manufacturing and anti-aging medicine. Desktop manufacturing threatens to disintermediate the half of all workers involved in translating ideas into products in the hands of consumers; while anti-aging therapies will increase the old age dependency ratio of retirees to tax-paying workers. Policies that are being proposed to protect or create employment will have only a temporary moderating effect on job loss. Over time these policies; which will impose raise costs; lower the quality of goods and services; and lower competitiveness; will become fiscally impossible and lose political support. In order to enjoy the benefits of technological innovation and longer; healthier lives we will need to combine policies that control the pace of replacing paid human labor with a universal basic income guarantee provided through taxation and the public ownership of wealth. The intensifying debate over the reform of "entitlements" will be the strategic opening for a campaign for BIG to replace disability and unemployment insurance; Social Security; and other elements of the welfare state. (shrink)

The aim of this paper is to offer an analysis of the notion of artificial moral agent (AMA) and of its impact on human beings’ self-understanding as moral agents. Firstly, I introduce the topic by presenting what I call the Continuity Approach. Its main claim holds that AMAs and human moral agents exhibit no significant qualitative difference and, therefore, should be considered homogeneous entities. Secondly, I focus on the consequences this approach leads to. In order to do this I take (...) into consideration the work of Bostrom and Dietrich, who have radically assumed this viewpoint and thoroughly explored its implications. Thirdly, I present an alternative approach to AMAs—the Discontinuity Approach—which underscores an essential difference between human moral agents and AMAs by tackling the matter from another angle. In this section I concentrate on the work of Johnson and Bryson and I highlight the link between their claims and Heidegger’s and Jonas’s sug-gestions concerning the relationship between human beings and technological products. In conclusion I argue that, although the Continuity Approach turns out to be a necessary postulate to the machine ethics project, the Discontinuity Approach highlights a relevant distinction between AMAs and human moral agents. On this account, the Discontinuity Approach generates a clearer understanding of what AMAs are, of how we should face the moral issues they pose, and, finally, of the difference that separates machine ethics from moral philosophy. (shrink)

Transhumanism is a modern expression of ancient and transcultural aspirations to radically transform human existence, socially and bodily. Before the Enlightenment these aspirations were only expressed in religious millennialism, magical medicine, and spiritual practices. The Enlightenment channeled these desires into projects to use science and technology to improve health, longevity, and human abilities, and to use reason to revolutionize society. Since the Enlightenment, techno‐utopian movements have dynamically interacted with supernaturalist millennialism, sometimes syncretically, and often in violent opposition. Today the transhumanist (...) movement, a modern form of Enlightenment techno‐utopianism, has evolved a number of subsects, from the libertarian utopians funded by billionaire Peter Thiel, to religious syncretists like the Mormon Transhumanist Association, to the left‐wing technoprogressives and their bioliberal intellectual allies. In reaction to accelerating technological innovation and transhumanist ideas, apocalyptic Christians, and even secular catastrophists, have begun to incorporate human enhancement into their End Times scenarios. With all sides believing that the fate of humanity hangs in the balance, there is a growing likelihood of violent confrontation. (shrink)

This paper attempts to formalize and to address the ‘leakproofing’ of the Singularity problem presented by David Chalmers. The paper begins with the definition of the Artificial Intelligence Confinement Problem. After analysis of existing solutions and their shortcomings, a protocol is proposed aimed at making a more secure confinement environment which might delay potential negative effect from the technological singularity while allowing humanity to benefit from the superintelligence.

Self-improvement was one of the aspects of AI proposed for study in the 1956 Dartmouth conference. Turing proposed a “child machine” which could be taught in the human manner to attain adult human-level intelligence. In latter days, the contention that an AI system could be built to learn and improve itself indefinitely has acquired the label of the bootstrap fallacy. Attempts in AI to implement such a system have met with consistent failure for half a century. Technological optimists, however, have (...) maintained that a such system is possible, producing, if implemented, a feedback loop that would lead to a rapid exponential increase in intelligence. We examine the arguments for both positions and draw some conclusions. (shrink)

In general, existential threats are those that may potentially result in the extinction of the entire human species, if not significantly endanger its living population. Among the said threats include, but not limited to, pandemics and the impacts of a technological singularity. As regards pandemics, significant work has already been done on how to mitigate, if not prevent, the aftereffects of this type of disaster. For one, certain problem areas on how to properly manage pandemic responses have already been identified, (...) like the following: (a) not being able to learn from previous experiences, (b) the inability to act on warning signals, and (c) the failure to reach a global consensus on a problem (i.e., in a timely manner). In terms of a singularity, however, it may be said that further research is still needed, specifically on how to aptly respond to its projected negative outcomes. In this paper, by treating the three problem areas noted above as preliminary assessment measures of a country’s capacity to coordinate a national response to large-scale disasters, we examine the readiness of the Philippines in preparing for an intelligence explosion. By citing certain instances of how the said country, specifically its national government, faced the coronavirus disease 2019 pandemic, it puts forward the idea that the likely Philippine disaster response towards a singularity needs to be worked on, appealing for a more comprehensive assessment of such for a more informed response plan. (shrink)

There is all over the world a sort of fever affecting all the research fields related, closely or somewhat loosely,with human health issues. Some of them – cloning, therapeutic cloning, stem cell therapy, human enhancement, etc. – arise fierce and controversial public debates. At the same time, a concern can be felt worldwide that tomorrow’s medicine might well become more and more « dual », the advanced health devices threatening to become the privilege of a small whealthy minority, or at (...) least excluding the vast majority of the poor and the low middle class. Furthermore, there are even greater disparities between wealthy and poor nations in access to health care and in the level of protection available to members of the latter’s population in a medical context. The theme of rationing health care has been ongoingly gaining in prevalence over the two to three last decades in the public debates, causing many to express worries about the ability of our health system to provide both efficiency and justice in health care. But, among all the new health care devices, are there not some which could be efficient both in terms of improvement of the management of patients’ health and of a just allocation of care ? Besides, not only emerge concerns linked with the development of new technologies in health care, but also in connection with the impact of social-political transformations onto the medical relationship : what are in this context the doctor-patient relationship in regard to autonomy and gender ? Should we be free to use or not to use these new technologies ? Might not the « quest for perfection » develop into a duty of perfection ? And, with the improvement of the therapeutic power to prolong human life, are we to think of assisted suicide as the future of death ? These are some of the issues that this conference wants to adress from an ethical perspective and with rigour. To enrich our discussions also medical and life science praticioners willing to reflect ethically on moral questions of health issues in their professional life and politicians faced with ethical decisions in the domain of health are welcome to participate. (shrink)

Eliminative functionalism is the view that mental attributes, of humans and other machines, consist ultimately in behavioural abilities or dispositions. Hence, ‘Strong AI’: if a machine consistently acts as if it were fully conscious, then conscious it is. From these assumptions, optimistic futurists have derived a variety of remarkable visions of our ‘post-human’ future; from widely-recognised ‘robot rights’ to ‘mind uploading’, immortality, ‘apotheosis’ and beyond. It is argued here, however, that eliminative functionalism is false; for at least on our present (...) knowledge, the subjectively qualitative characteristics of conscious experience are neither deducible from, nor logically required to generate, the performance of any sort of overtly ‘intelligent’, or indeed, characteristically human behaviour. Thus, a machine could easily be designed to report awareness of phenomenal qualities, without necessarily possessing them; and Alan Turing’s ‘Imitation Game’ test for artificial thinking is unable to determine whether or not a machine is sentient. An alternative test is proposed, in which the machine is asked phenomenological questions under conditions designed to detect any form of cheating—whilst also, potentially revealing evidence for the occurrence of genuine qualitative experience. (shrink)

The thinkers who have reflected on the problem of a coming superintelligence have generally seen the issue as a technological problem, a problem of how to control what the superintelligence will do. I argue that this approach is probably mistaken because it is based on questionable assumptions about the behavior of intelligent agents and, moreover, potentially counterproductive because it might, in the end, bring about the existential catastrophe that it is meant to prevent. I contend that the problem posed by (...) a future superintelligence will likely be a political problem, that is, one of establishing a peaceful form of coexistence with other intelligent agents in a situation of mutual vulnerability, and not a technological problem of control. (shrink)

The invasion of the new technologies in our lives and the current dependence upon them makes us believe that in a not too distant future we will be made of more technology than biological matter. If until recently computers had hardly been discovered, today we are witnessing a real technological revolution in all the fields: biology, medicine etc. The evolution of the new technologies has raised various questions related to the future of mankind and the current human species, which determines (...) us to make speculations regarding a future event that may occur. For this reason, in this paper I shall analyze the concept of artificial intelligence and singularity and I shall also outline the relationship between the ontological argument and the possible worlds. The idea of possible world can serve as a way of describing a metaphor in the philosophy of science, as singularity can exist in a possible world only if one creates the conditions of a new concept regarding fiction. We believe that technological singularity will change the values of the current society and the individual will have to face a world that depersonalizes the individual, as transhumanism draws the theoretical frameworks of a ‹‹brave new world››. In this paper, we have also analyzed the logical explanation of God's existence and the explanation of singularity through artificial intelligence. Therefore, we shall bring up for discussion the idea of virtual universe in the context of downloaded consciousness, which can be operated through artificial intelligence. Our conclusions refer to the fact that eternal life could exist artificially, but it cannot be demonstrated in terms of the ontological argument. (shrink)

The historical sensibility of Western modernity is best captured by the phrase “acting upon a story that we can believe.” Whereas the most famous stories of historians facilitated nation-building processes, philosophers of history told the largest possible story to act upon: history itself. When the rise of an overwhelming postwar skepticism about the modern idea of history discredited the entire enterprise, the historical sensibility of “acting upon a story that we can believe” fell apart to its constituents: action, story form, (...) and belief in a feasible future outcome. Its constituent parts are nevertheless still hold, either separately or in paired arrangements. First, believable stories are still told, but without an equally believable future outcome to facilitate. Second, in the shape of what I call the prospect of unprecedented change, there still is a feasible vision of a future (in prospects of technology and the Anthropocene), but it defies story form. And third, it is even possible to upon that feasible future, but such action aims at avoiding worst case scenarios instead of facilitating best outcomes. These are, I believe, features of an emerging postwar historical sensibility that the theory and philosophy of history is yet to understand. (shrink)

Increasingly, innovation in artificial intelligence technologies portends the re-conceptualization of human existentiality along the paradigm of posthumanism. An exposition of this through a critical culturo-historical methodology uncloaks the Eurocentric genitive basis of the philosophical anthropology that underpins this technological posthumanism, as well as its dystopian possibilities. As a contribution to obviating the latter, an Africanist civilizational humanism proclaimed by Pixley ka Isaka Seme is proffered as a plausible alternative paradigm for humanity’s technological advancement. Seme, a pan-Africanist thinker of the early (...) twentieth century, proclaimed humanistic-spirituality as the indispensable gift African Civilisation-in-its-renaissance is yet to offer global humanity. His postulation is being provided as a contribution to the archive on cross-cultural ethics of artificial intelligence. (shrink)

I discuss the realizability and the ethical ramifications of Machine Ethics, from a number of different perspectives: I label these the anthropocentric, infocentric, biocentric and ecocentric perspectives. Each of these approaches takes a characteristic view of the position of humanity relative to other aspects of the designed and the natural worlds—or relative to the possibilities of ‘extra-human’ extensions to the ethical community. In the course of the discussion, a number of key issues emerge concerning the relation between technology and ethics, (...) and the nature of what it is to have moral status. Some radical challenges to certain technological presuppositions and ramifications of the infocentric approach will be discussed. Notwithstanding the obvious tensions between the infocentric perspective on one side and the biocentric and ecocentric perspectives on the other, we will see that there are also striking parallels in the way that each of these three approaches generates challenges to an anthropocentric ethical hegemony, and possible scope for some degree of convergence. (shrink)

Many researchers are working toward the goal of finding a treatment that halts or even reverses the aging process of the human body, a treatment that would make the recipient potentially immortal. The hope that they will succeed in the relatively near future is gaining ground among academics and laypeople alike. What will happen if this hope becomes reality? Specifically, how will our political and social institutions and practices be affected by that discovery? These are the questions raised in the (...) present paper. Concretely, I will discuss three political and social problems that the invention of an immortality treatment is likely to provoke, namely the struggle for access to that treatment, the threat of overpopulation, and the friction between potentially immortal individuals. (shrink)

Crane envisions the speculative conjecture that intelligent civilizations might want and be able to produce black holes in the very far future. He implicitly suggests two main purposes of this enterprise: (i) energy production and (ii) universe production. We discuss those two options. The commentary is obviously highly speculative and should be read accordingly.

Various potential strategic interactions between a “strong” Artificial intelligence and humans are analyzed using simple 2 × 2 order games, drawing on the New Periodic Table of those games developed by Robinson and Goforth. Strong risk aversion on the part of the human player leads to shutting down the AI research program, but alternative preference orderings by the human and the AI result in Nash equilibria with interesting properties. Some of the AI-Human games have multiple equilibria, and in other cases (...) Pareto-improvement over the Nash equilibrium could be attained if the AI’s behavior towards humans could be guaranteed to be benign. The preferences of a superintelligent AI cannot be known in advance, but speculation is possible as to its ranking of alternative states of the world, and how it might assimilate the accumulated wisdom of humanity. (shrink)

This article examines the potential implications of the implementation of artificial intelligence in health care for both its delivery and the medical profession. To this end, the first section explores the basic features of AI and the yet theoretical concept of autonomous AI followed by an overview of current and developing AI applications. Against this background, the second section discusses the transforming roles of physicians and changes in the patient–physician relationship that could be a consequence of gradual expansion of AI (...) in health care. Subsequently, an examination of the responsibilities physicians should assume in this process is explored. The third section describes conceivable practical and ethical challenges that implementation of a single all-encompassing AI healthcare system would pose. The fourth section presents arguments for regulation of AI in health care to ensure that these applications do not violate basic ethical principles and that human control of AI will be preserved in the future. In the final section, fundamental components of a moral framework from which such regulation may be derived are brought forward, and some possible strategies for building a moral framework are discussed. (shrink)