Many researchers and intellectuals warn about extreme risks from artificial intelligence. However, these warnings typically came without systematic arguments in support. This paper provides an argument that AI will lead to the permanent disempowerment of humanity, e.g. human extinction, by 2100. It rests on four substantive premises which it motivates and defends: first, the speed of advances in AI capability, as well as the capability level current systems have already reached, suggest that it is practically possible to build AI systems (...) capable of disempowering humanity by 2100. Second, due to incentives and coordination problems, if it is possible to build such AI, it will be built. Third, since it appears to be a hard technical problem to build AI which is aligned with the goals of its designers, and many actors might build powerful AI, misaligned powerful AI will be built. Fourth, because disempowering humanity is useful for a large range of misaligned goals, such AI will try to disempower humanity. If AI is capable of disempowering humanity and tries to disempower humanity by 2100, then humanity will be disempowered by 2100. This conclusion has immense moral and prudential significance. (shrink)

The Morphogenetic Régulation approach (MR) contributes to the Morphogenetic Approach by explaining the material and ideational origins of change and stasis in agency, structure, and culture. In this paper, we focus on the expressive quality of ideas and systemic persistence in three research projects. The first demystifies inclusive governance and its adverse impacts. It shows how, contrary to institutions of governance, inclusiveness is not simply a norm but actually the explication of corporate agents’ ideas about rational choice institutionalism which leads (...) to adverse impacts on vulnerable groups and ecologies known as adverse inclusion. The second investigates the role of ideas as adequacy and self-explication in guiding Palestinian actors’ actions towards the deepening of neoliberalization in Palestine. The third explains the relevance of the systemic persistence problematique for understanding how three juxtaposed themes – Web2, Web3, and Artificial Intelligence (AI) – are shaping the political economy and infrastructure of the Internet. (shrink)

Plausibly, one important part of a good life is doing work that makes a contribution, or a positive difference to the world. In this paper, however, I explore contribution pessimism, the view that people will not always have adequate opportunities for making contributions. I distinguish between three interestingly different and at least initially plausible reasons why this view might be true: in slogan form, things might become too easy, they might become too good, or we might be too late. Now, (...) one response to these problems might be to deliberately attempt to undo them. However, I claim that this solution is intuitively misguided, and argue that explaining this supports a holistic approach to the value of contributions. Finally, I argue that if contribution pessimism is correct, it could provide an explanation of some widely held intuitions about issues in population ethics, with implications about the practical issue of how much priority we should give to addressing risks of human extinction. (shrink)

The paper presents a framework to realise “meaningful human control” over Automated Driving Systems. The framework is based on an original synthesis of the results of the multidisciplinary research project “Meaningful Human Control over Automated Driving Systems” lead by a team of engineers, philosophers, and psychologists at Delft University of the Technology from 2017 to 2021. Meaningful human control aims at protecting safety and reducing responsibility gaps. The framework is based on the core assumption that human persons and institutions, not (...) hardware and software and their algorithms, should remain ultimately—though not necessarily directly—in control of, and thus morally responsible for, the potentially dangerous operation of driving in mixed traffic. We propose an Automated Driving System to be under meaningful human control if it behaves according to the relevant reasons of the relevant human actors (tracking), and that any potentially dangerous event can be related to a human actor (tracing). We operationalise the requirements for meaningful human control through multidisciplinary work in philosophy, behavioural psychology and traffic engineering. The tracking condition is operationalised via a proximal scale of reasons and the tracing condition via an evaluation cascade table. We review the implications and requirements for the behaviour and skills of human actors, in particular related to supervisory control and driver education. We show how the evaluation cascade table can be applied in concrete engineering use cases in combination with the definition of core components to expose deficiencies in traceability, thereby avoiding so-called responsibility gaps. Future research directions are proposed to expand the philosophical framework and use cases, supervisory control and driver education, real-world pilots and institutional embedding. (shrink)

Considering the popular framing of an artificial intelligence as a rational agent that always seeks to maximise its expected utility, referred to as its goal, one of the features attributed to such rational agents is that they will never select an action which will change their goal. Therefore, if such an agent is to be friendly towards humanity, one argument goes, we must understand how to specify this friendliness in terms of a utility function. Wolfhart Totschnig, argues in contrast that (...) a fully autonomous agent will have the ability to change its utility function and will do so guided by its values. This commentary examines computational accounts of goals, values and decision-making. It rejects the idea that a rational agent will never select an action that changes its goal but also argues that an artificial intelligence is unlikely to be purely rational in terms of always acting to maximise a utility function. It nevertheless also challenges the idea that an agent which does not change its goal cannot be considered fully autonomous. It does agree that values are an important component of decision-making and explores a number of reasons why. (shrink)

The future has become a problem for the present. Almost every critical issue is now understood and experienced through the prism of the future since this is the primary focus for the playing out of crises. Senses of the Future offers a wide-ranging discussion of theories of the future. It covers the main ideas of the future in modern thought and explores how we should view the future today in light of a plurality of very different and conflicting visions. The (...) key contribution of this book is to bring together the different approaches with an account that is grounded in sociological and philosophical analysis as opposed to visions of the future that are inspired by extreme visions of catastrophe or approaches that see the future as only the continuation of the present. Given a revival of apocalyptical visions of the ‘end times’ and dystopian views of the future of human societies, there is urgent need for a new approach on how we should imagine the future. The author explores the future as a field of tensions that is revealed in narratives, utopian desires, hope, imaginaries, and social struggles concerning the potential possibilities of the present: the future does not just arrive; it has to be fought for. This book is an important contribution to a critical sociology of the future. It is both a work of reconstruction and critique grounded in a historical and philosophical hermeneutics of the future. Table of Contents Chapter One Introduction: Conflicting Visions of the Future Contested Visions of the Future Today Return to the Future Outline of the Chapters References Chapter Two When is the Future? The Problem of Time and the Human Condition Time in the Physical World: Lessons from Physics Has the Future already Begun? Time and History Time, Life, and the Human Condition: Biology, Evolution, and Culture Conclusion References Chapter Three Lessons from the Past: What Does the Past Tell Us about the Future? The Future in the Past Failed Societies and Civilizational Collapse Catastrophes and History Conclusion References Chapter Four Modernity and the Concept of the Future: Utopia, Progress, and Prophecy The Future as Expectation The Future as an Imaginary and the Emergence of Utopianism The Future as Possibility The Future as Experience Conclusion References Chapter Five Ideas of the Future in the Twentieth Century: Futurism, Modernism, Sociology, and Political Theory New Political Ideas of the Future after 1945 Responses to the Future: From Fear of the Future to Futurology Sociological Theory and the Future Conclusion: The New Sociology of the Future References Chapter Six Critical Theory and the Future: The Sources of Transcendence The Intellectual Origins of Critical Theory: A Brief Outline The Idea of the Future in the Critical Theory of the Early Frankfurt School Habermas and the Communication Paradigm The Responsibility Paradigm and Cosmopolitanism: Jonas and Apel Critical Cosmopolitanism and the Idea of the Future Conclusion: Cultural Models and the Future as Possibility References Chapter Seven Conclusion: In The Shadow of the Future Do We Need a Theory of the Future? Are we already in a New Historical Era? AI and a Posthuman Future Struggles for the Future References Index. (shrink)

This essay interrogates the common assumption that good care is necessarily human care. It looks to disruptive fictional representations of robot care to assist its development of a theory of posthuman care that jettisons the implied anthropocentrism of ethics of care philosophy but retains care’s foregrounding of entanglement, embodiment and obligation. The essay reads speculative representations of robot care, particularly the Swedish television programme Äkta människor (Real Humans), alongside ethics of care philosophy and critical posthumanism to highlight their synergetic critiques (...) of neoliberal affective economies and humanist hierarchies that treat some bodies and affects as more real than others. These texts and discourses assist me in proposing a theory of care that regards vulnerability as the normative effect of posthuman vital embodiment, as opposed to an anomalous state that can be overcome or corrected via neoliberal practice. (shrink)

Various potential strategic interactions between a “strong” Artificial intelligence and humans are analyzed using simple 2 × 2 order games, drawing on the New Periodic Table of those games developed by Robinson and Goforth. Strong risk aversion on the part of the human player leads to shutting down the AI research program, but alternative preference orderings by the human and the AI result in Nash equilibria with interesting properties. Some of the AI-Human games have multiple equilibria, and in other cases (...) Pareto-improvement over the Nash equilibrium could be attained if the AI’s behavior towards humans could be guaranteed to be benign. The preferences of a superintelligent AI cannot be known in advance, but speculation is possible as to its ranking of alternative states of the world, and how it might assimilate the accumulated wisdom of humanity. (shrink)

This article develops a conceptual framework for regulating Artificial Intelligence (AI) that encompasses all stages of modern public policy-making, from the basics to a sustainable governance. Based on a vast systematic review of the literature on Artificial Intelligence Regulation (AIR) published between 2010 and 2020, a dispersed body of knowledge loosely centred around the “framework” concept was organised, described, and pictured for better understanding. The resulting integrative framework encapsulates 21 prior depictions of the policy-making process, aiming to achieve gold-standard societal (...) values, such as fairness, freedom and long-term sustainability. This challenge of integrating the AIR literature was matched by the identification of a structural common ground among different approaches. The AIR framework results from an effort to identify and later analytically deduce synthetic, and generic tool for a country-specific, stakeholder-aware analysis of AIR matters. Theories and principles as diverse as Agile and Ethics were combined in the “AIR framework”, which provides a conceptual lens for societies to think collectively and make informed policy decisions related to what, when, and how the uses and applications of AI should be regulated. Moreover, the AIR framework serves as a theoretically sound starting point for endeavours related to AI regulation, from legislation to research and development. As we know, the (potential) impacts of AI on society are immense, and therefore the discourses, social negotiations, and applications of this technology should be guided by common grounds based on contemporary governance techniques, and social values legitimated via dialogue and scientific research. (shrink)

To commemorate 40 years since the founding of the Journal of Business Ethics, the editors in chief of the journal have invited the editors to provide commentaries on the future of business ethics. This essay comprises a selection of commentaries aimed at creating dialogue around the theme Technology, Megatrends and Work. Of all the profound changes in business, technology is perhaps the most ubiquitous. There is not a facet of our lives unaffected by internet technologies and artificial intelligence. The Journal (...) of Business Ethics established a dedicated section that focuses on Technology and Business Ethics, yet issues related to this phenomenon run right through all the sections. Kirsten Martin, editor of the Technology and Business Ethics section, joins our interim social media editor, Hannah Trittin-UIbrich, to advance a human-centric approach to the development and application of digital technologies that places Business Ethics at centre of the analysis. For Shuili Du, technology is the defining condition for a new era of Corporate Social Responsibility—CSR 3.0—which she defines as “a company’s socially responsible strategies and practices that deal with key ethical and socio-technical issues associated with AI and related technologies on the one hand and leverage the power of AI and related technologies to tackle social and environmental problems on the other hand.” It is not just technologies that are a determining feature of our lives but technology companies, an argument made by Glen Whelan as he examines Big Business and the need for a Big Business Ethics as we try to understand the impact of Big Tech on our post-work world. Indeed, as noted by Ernesto Noronha and Premilla D’Cruz, megatrends in addition to advancement in technologies, namely globalization, the greening of economies, and changes in demographics and migration, are shaping the future for workers in ways previously unimaginable. Contributing to this important debate, Praveen Parboteeah considers the influence of another longstanding but oft overlooked megatrend, the role of religion in the workplace. Given the enormity of the influence of technology and other megatrends in our world, it is not surprising that this essay introduces ground-breaking ideas that speak to the future of business ethics research. (shrink)

This article examines why Günther Anders, one of the 20th century’s most formidable critics of technology, deemed a critique of technology necessary at all. I argue that the radical philosophy of industrialism in Die Antiquiertheit des Menschen (The Obsolescence of Human Beings) and related texts is a response to what Anders’s work presents as inadequacies of traditional Marxism, with its focus on class struggle and property relations. In effect, his critique of technology, which is more attentive to forms of domination (...) emergent with mechanization, would come to supplant classical Marxist thought. The piece concludes with some thoughts about how Anders’s ‘post-Marxist’ perspective provides insights for contemporary Marxism and, in turn, how the latter can throw light on problems in Anders’s philosophy of the machine. (shrink)

Este artículo se centra en describir la problemática acerca de si los humanos deben seguir atrapados en una ciega evolución biológica o bien ellos deben pasar a elegir qué desean asumir. Ante tal disyuntiva se recuerdan la hipótesis optimista y la hipótesis pesimista. Al parecer, la especie humana, como el resto de las especies vivas, ha surgido en un proceso de evolución; es la única con capacidad de ser consciente de ello y, en parte, ha sido capaz, mediante las técnicas, (...) de poder adaptarse y de planificar en parte su futuro. Las biotecnologías están utilizándose cada vez más para el mejoramiento y perfeccionamiento de lo humano, convirtiéndose de ese modo en antropotecnias. Así, al orientarse estas nuevas tecnologías hacia y sobre su autor, el ser humano puede también convertirse en un peligro para él mismo. Los «transhumanistas » estiman, sin embargo, que los humanos deben arrebatar su destino biológico al proceso ciego de la evolución de la variación aleatoria y la adaptación, y pasar a la siguiente etapa como especie: la elección de nuestro ser. En la conclusión se patentizan las implicancias y consecuencias del hecho de ser humano y racional. (shrink)

One of the most noticeable trends in recent years has been the increasing reliance of public decision-making processes on algorithms, i.e. computer-programmed step-by-step instructions for taking a given set of inputs and producing an output. The question raised by this article is whether the rise of such algorithmic governance creates problems for the moral or political legitimacy of our public decision-making processes. Ignoring common concerns with data protection and privacy, it is argued that algorithmic governance does pose a significant threat (...) to the legitimacy of such processes. Modelling my argument on Estlund’s threat of epistocracy, I call this the ‘threat of algocracy’. The article clarifies the nature of this threat and addresses two possible solutions. It is argued that neither solution is likely to be successful, at least not without risking many other things we value about social decision-making. The result is a somewhat pessimistic conclusion in which we confront the possibility that we are creating decision-making processes that constrain and limit opportunities for human participation. (shrink)

This paper adds another argument to the rising tide of panic about robots and AI. The argument is intended to have broad civilization-level significance, but to involve less fanciful speculation about the likely future intelligence of machines than is common among many AI-doomsayers. The argument claims that the rise of the robots will create a crisis of moral patiency. That is to say, it will reduce the ability and willingness of humans to act in the world as responsible moral agents, (...) and thereby reduce them to moral patients. Since that ability and willingness is central to the value system in modern liberal democratic states, the crisis of moral patiency has a broad civilization-level significance: it threatens something that is foundational to and presupposed in much contemporary moral and political discourse. I defend this argument in three parts. I start with a brief analysis of an analogous argument made in pop culture. Though those arguments turn out to be hyperbolic and satirical, they do prove instructive as they illustrates a way in which the rise of robots could impact upon civilization, even when the robots themselves are neither malicious nor powerful enough to bring about our doom. I then introduce the argument from the crisis of moral patiency, defend its main premises and address objections. (shrink)

An advanced artificial intelligence could pose a significant existential risk to humanity. Several research institutes have been set-up to address those risks. And there is an increasing number of academic publications analysing and evaluating their seriousness. Nick Bostrom’s superintelligence: paths, dangers, strategies represents the apotheosis of this trend. In this article, I argue that in defending the credibility of AI risk, Bostrom makes an epistemic move that is analogous to one made by so-called sceptical theists in the debate about the (...) existence of God. And while this analogy is interesting in its own right, what is more interesting are its potential implications. It has been repeatedly argued that sceptical theism has devastating effects on our beliefs and practices. Could it be that AI-doomsaying has similar effects? I argue that it could. Specifically, and somewhat paradoxically, I argue that it could amount to either a reductio of the doomsayers position, or an important and additional reason to join their cause. I use this paradox to suggest that the modal standards for argument in the superintelligence debate need to be addressed. (shrink)

If a robot sends a deceptive signal to a human user, is this always and everywhere an unethical act, or might it sometimes be ethically desirable? Building upon previous work in robot ethics, this article tries to clarify and refine our understanding of the ethics of robotic deception. It does so by making three arguments. First, it argues that we need to distinguish between three main forms of robotic deception (external state deception; superficial state deception; and hidden state deception) in (...) order to think clearly about its ethics. Second, it argues that the second type of deception – superficial state deception – is not best thought of as a form of deception, even though it is frequently criticised as such. And third, it argues that the third type of deception is best understood as a form of betrayal because doing so captures the unique ethical harm to which it gives rise, and justifies special ethical protections against its use. (shrink)

Motivated by the question of responsible AI and value alignment, I seek to offer a uniquely Foucauldian reconstruction of the problem as the emergence of an ethical subject in a disciplinary setting. This reconstruction contrasts with the strictly human-oriented programme typical to current scholarship that often views technology in instrumental terms. With this in mind, I problematise the concept of a technological subjectivity through an exploration of various aspects of ChatGPT in light of Foucault’s work, arguing that current systems lack (...) the reflexivity and self-formative characteristics inherent in the notion of the subject. By drawing upon a recent dialogue between Foucault and phenomenology, I suggest four techno-philosophical desiderata that would address the gaps in this search for a technological subjectivity: embodied self-care, embodied intentionality, imagination and reflexivity. Thus I propose that advanced AI be reconceptualised as a subject capable of “technical” self-crafting and reflexive self-conduct, opening new pathways to grasp the intertwinement of the human and the artificial. This reconceptualization holds the potential to render future AI technology more transparent and responsible in the circulation of knowledge, care and power. (shrink)

The debates about ethics in the context of artificial intelligence have been recently focusing primarily on various types of utilitarianisms. This article suggests a categorization of the various presented utilitarianisms into static utilitarianisms and dynamic utilitarianisms. It explains the main features of both. Then, it presents the challenges the utilitarianisms in each group need to be able to deal with. Since it appears that those cannot be overcome in the context of each group alone, the article suggests a possibility of (...) using a combination of the two categories of utilitarianisms to resolve most of the challenges without the need to abandon the concept of utilitarianisms as such. Even this possibility comes with its own issues that might not be resolved within the boundaries of utilitarianisms, however. Therefore, another potential alternative based on a combination of various ethical systems is suggested and briefly explored. (shrink)

Moral realism faces a well known genealogical debunking challenge. I argue that the moral realist’s best response may involve abandoning metaphysical naturalism in favor of some form of axiarchism—the view, very roughly, that the natural world is “ordered to the good.” Axiarchism comes in both theistic and non-theistic forms, but all forms agree that the natural world exists and has certain basic features because it is good for it to exist and have those features. I argue that theistic and non-theistic (...) forms of axiarchism are better positioned than metaphysical naturalism to avoid two commitments that a moral realist should seek to avoid: that the correctness of our moral beliefs is a major coincidence, and that there is a complete explanation of our moral beliefs that does not mention any moral truths. (shrink)

In recent decades, the digital age and the Third Industrial Revolution have attracted significant attention in terms of their benefits and risks. Scholars have explored the impact of these changes on autonomy, freedom, human interactions, cognition, and knowledge sharing. However, the influence of the digital communicative environment on civic interactions and public deliberation processes has received limited attention from virtue theorists. This paper aims to address this gap. First, we discuss the challenges posed by the digital communicative environment, and we (...) present recent attempts to revive civility within this context. Then, we propose a twofold account of civility as consisting in the two virtues of civic benevolence and civil deliberation. Finally, we focus on the epistemic side of civility, civil deliberation, and we conduct the first empirical studies on two of its components. (shrink)

This paper addresses the seemingly insurmountable challenges the problem of personal identity raises for the prospect of radical human enhancement and synthetic consciousness. It argues that conceptions of personal identity rooted in psychological continuity akin to those proposed by Parfit and the Buddha may not provide the sort of grounding that many transhumanists chasing the dream of life extension think that they do if they rest upon ontologies that assume an incompatibility between identity and change. It also suggests that process (...) ontologies that take change to be primary, such as those that align with contemporary systems biology, offer a better way out of the personal identity dilemma. But the solution in this case, which regards biological organisms as processes rather than things, may constrain the possibility of biologically inspired superintelligent aliens (BISAs), which Schneider (following Bostrom 2014) posits as possibly the most common form of (extraterrestrial) superintelligence in the universe. (shrink)

Have we reached what Alexander Galloway dismissively refers to as ‘peak Deleuze’? In this essay, I argue that the arrival at end times – with the sense of mass extinction and philosophy's exhaustion – is indeed a moment of ‘peak Deleuze’, but that this gesture of exhaustion is already implicit in A Thousand Plateaus. Recognising the limits and seduction of a text is never as easy as it seems; every attempt to break up with Deleuze and Guattari, though necessary, is (...) fraught with a whole series of difficulties that were already visible in A Thousand Plateaus's own relation to its outside. (shrink)

While today there is much discussion about the ethics of artificial intelligence, less work has been done on the philosophical nature of AI. Drawing on Bergson and Ricoeur, this paper proposes to use the concepts of time, process, and narrative to conceptualize AI and its normatively relevant impact on human lives and society. Distinguishing between a number of different ways in which AI and time are related, the paper explores what it means to understand AI as narrative, as process, or (...) as the emergent outcome of processes and narratives. It pays particular attention to what it calls the “narrator” and “time machine” roles of AI and the normative implications of these roles. It argues that AI processes and narratives shape our time and link past, present, and future in particular ways that are ethically and politically significant. (shrink)

This paper discusses the problem of responsibility attribution raised by the use of artificial intelligence technologies. It is assumed that only humans can be responsible agents; yet this alone already raises many issues, which are discussed starting from two Aristotelian conditions for responsibility. Next to the well-known problem of many hands, the issue of “many things” is identified and the temporal dimension is emphasized when it comes to the control condition. Special attention is given to the epistemic condition, which draws (...) attention to the issues of transparency and explainability. In contrast to standard discussions, however, it is then argued that this knowledge problem regarding agents of responsibility is linked to the other side of the responsibility relation: the addressees or “patients” of responsibility, who may demand reasons for actions and decisions made by using AI. Inspired by a relational approach, responsibility as answerability thus offers an important additional, if not primary, justification for explainability based, not on agency, but on patiency. (shrink)

The transformative power of artificial intelligence (AI) is coming to philosophy—the only question is the degree to which philosophers will harness it. In this paper, we argue that the application of AI tools to philosophy could have an impact on the field comparable to the advent of writing, and that it is likely that philosophical progress will significantly increase as a consequence of AI. The role of philosophers in this story is not merely to use AI but also to help (...) develop it and theorize about it. In fact, we argue that philosophers have a prima facie obligation to spend significant effort in doing so, at least insofar as they should spend effort philosophizing. (shrink)

The aim of the article is reflecting on a fundamental epistemological issue which characterises our present technological progress: where are we heading to, as humankind, while we are progressively externalising our most crucial decision processes towards algorithms, from which decisive data, coming from human experience and mind, are left out? By reflecting on some cases, I shall try to argue that the most puzzling issue which engineers and philosophers should be aware that they have to jointly challenge may be that (...) what we are actually doing through algorithmic automatisation is developing a novel human condition, according to which: we are progressively thinking that algorithmic abstraction is always better than mental abstraction, because, at least in the Western culture, we come from a history of a progressive restriction of the best use of our minds to the realm of rationality, first, then to the realm of computation, second, and then to the realm of algorithmic automatisation, third, which finally exceeds our minds and in doing so, we are progressively externalising not only human contents, but also human abilities, i.e., we are progressively atrophying ourselves, by becoming creatures who are progressively delegating the core of their very essence, which has always included the epistemological ability, together with the ethical courage, of making complex decisions on both our lives and the others’ lives. (shrink)

In this paper, we identify the way in which various forms of legal personhood can be differentiated from one another by comparing these entities with a—not too farfetched—hypothetical situation in which intelligence spontaneously evolves within the internet: spontaneous intelligence. In these terms, we consider the challenges that may arise where SI as an entity: has no owner, no designer, and no controller; has evolved into existence as a non-human created intelligence; is autonomous; has no physical form; and, although it exists (...) around the world, exists in no particular jurisdiction. Based on this refined notion of SI, we consider issues related to the recognition of such an entity’s legal personhood. By briefly exploring the attribution of legal personality to various entities—including, humans, corporations, artificial intelligence and higher forms of animal life—we differentiate SI from these other forms of intelligence whilst illustrating it shares most characteristics with human intelligence and not, as may intuitively be thought, with various forms of AI. After critically evaluating the classification of these various forms of intelligence, we briefly suggest some ramifications of these differences and suggest that the approach adopted may assist in drawing more effective boundaries between the entities that are already recognised as legal persons, as well as between sub-categories of entities, such as various forms of AI. (shrink)

In this paper, I will identify two problems of trust in an AI-relevant context: a theoretical problem and a practical one. I will identify and address a number of skeptical challenges to an AI-relevant theory of trust. In addition, I will identify what I shall term the ‘scope challenge’, which I take to hold for any AI-relevant theory of trust that purports to be representationally adequate to the multifarious forms of trust and AI. Thereafter, I will suggest how trust-engineering, a (...) position that is intermediate between the modified pure rational-choice account and an account that gives rise to trustworthy AI, might allow us to address the practical problem of trust, before identifying and critically evaluating two candidate trust-engineering approaches. (shrink)

In this paper, two central questions will be addressed: ought we to implement medical AI technology in the medical domain? If yes, how ought we to implement this technology? I will critically engage with three options that exist with respect to these central questions: the Neo-Luddite option, the Assistive option, and the Substitutive option. I will first address key objections on behalf of the Neo-Luddite option: the Objection from Bias, the Objection from Artificial Autonomy, the Objection from Status Quo, and (...) the Objection from Inscrutability. I will thereafter present the Demographic Trends Argument and the Human Enhancement Argument in support of alternatives to the Neo-Luddite option. In the second half of the paper, I will argue against the Substitutive option and in favour of the Assistive option, given the existence of two chief formal deficits in medical AI technology: the causality deficit and the care deficit. (shrink)

Set aside fanciful doomsday speculations about AI. Even lower-level AIs, while otherwise friendly and providing us a universal basic income, would be able to do all our jobs. Also, we would over-rely upon AI assistants even in our personal lives. Thus, John Danaher argues that a human crisis of moral passivity would result However, I argue firstly that if AIs are posited to lack the potential to become unfriendly, they may not be intelligent enough to replace us in all our (...) jobs. If instead they are intelligent enough to replace us, the risk they become unfriendly increases, given that they would not need us and humans would just compete for valuable resources. Their hostility will not promote our moral passivity. Secondly, the use of AI assistants in our personal lives will become a problem only if we rely on them for almost all our decision-making and motivation. But such a (maximally) pervasive level of dependence raises the question of whether humans would accept it, and consequently whether the crisis of passivity will arise. (shrink)

As AI is linked to more and more aspects of our lives, the need for algorithms that can take decisions that are not only accurate but also fair becomes apparent. It can be seen both in discussions of future trends such as autonomous vehicles or the issue of superintelligence, as well as actual implementations of machine learning used to decide whether a person should be admitted in certain university or will be able to return a credit. In this paper, we (...) will use Dreyfus’ account on ethical expertise to show that, to give an AI some ability to make ethical judgements, a pure symbolic, conceptual approach is not enough. We also need the ability to make sense of the surroundings to reframe and define situations in a dynamic way, using multiple perspectives in a pre-reflective way. (shrink)

This article argues that an artificial superintelligence (ASI) emerging in a world where war is still normalised constitutes a catastrophic existential risk, either because the ASI might be employed by a nation–state to war for global domination, i.e., ASI-enabled warfare, or because the ASI wars on behalf of itself to establish global domination, i.e., ASI-directed warfare. Presently, few states declare war or even war on each other, in part due to the 1945 UN Charter, which states Member States should “refrain (...) in their international relations from the threat or use of force”, while allowing for UN Security Council-endorsed military measures and self-defense. As UN Member States no longer declare war on each other, instead, only ‘international armed conflicts’ occur. However, costly interstate conflicts, both hot and cold and tantamount to wars, still take place. Further, a New Cold War between AI superpowers looms. An ASI-directed/enabled future conflict could trigger total war, including nuclear conflict, and is therefore high risk. Via conforming instrumentalism, an international relations theory, we advocate risk reduction by optimising peace through a Universal Global Peace Treaty (UGPT), contributing towards the ending of existing wars and prevention of future wars, as well as a Cyberweapons and Artificial Intelligence Convention. This strategy could influence state actors, including those developing ASIs, or an agential ASI, particularly if it values conforming instrumentalism and peace. (shrink)

The artificial intelligence models with machine learning that exhibit the best predictive accuracy, and therefore, the most powerful ones, are, paradoxically, those with the most opaque black-box architectures. At the same time, the unstoppable computerization of advanced industrial societies demands the use of these machines in a growing number of domains. The conjunction of both phenomena gives rise to a control problem on AI that in this paper we analyze by dividing the issue into two. First, we carry out an (...) epistemological examination of the AI’s opacity in light of the latest techniques to remedy it. And second, we evaluate the rationality of delegating tasks in opaque agents. (shrink)

RESUMEN Actualmente, la convergencia de tres ámbitos de aplicación tecnológica -Big Data, Inteligencia Artificial e Internet de las Cosas- permite hiperconectivizar, algoritmizar y dataficar los distintos ámbitos de actividad humana para optimizar sus procesos productivos, comunicativos, asistenciales y/o relacionales, y, con ello, aumentar su eficiencia, eficacia y sostenibilidad. El éxito cosechado en sectores como el industrial o el retail y las enormes expectativas que abre su implementación en otros como el político o el asistencial, empero, ha extendido la idea de (...) que incluso es posible discernir mejor qué es lo justo y bueno a través del análisis y procesamiento algorítmico de datos masivos sobre lo moral procedentes de los individuos hiperconectados. Sin embargo, este enfoque dataficado de ética alberga dudas razonables respecto a su viabilidad, posibilidad y eficacia. Pero, sobre todo, produce inquietud su aceptación y puesta en marcha acrítica por las importantes anomalías que produce en el mundo de la vida, especialmente en la concreción y perdurabilidad del saber moral. Este estudio pretende mostrar los retos, límites y consecuencias que subyacen a la dataficación del ámbito moral. ABSTRACT The convergence of three areas of technological application - Big Data, Artificial Intelligence and the Internet of Things - means the diferent area of human activity can be hyperconnected, algorithmised and datafied to optimise processes involving production, communication, healthcare and relationships. The aim is to increase their efficiency, effectiveness and sustainability. The success achieved in sectors like industry and retail and the huge expectations aroused by the implementation of this technology in other areas, such as politics and healthcare, have encouraged the idea that it might even be possible to find a better way of working out what is good and fair in the algorithmic analysis and processing of Big Data concerning morality drawn from hyperconnected individuals. There are reasonable doubts, however, concerning the possibility, viability and effectiveness of this datafied approach to ethics. Above all, a critical acceptance and implementation of it raises concerns about the considerable anomalies it causes in the world of life, particularly in the accumulation and durability of moral knowledge. This study attempts to show the challenges, limits and consequences under lying the datafication of morality. (shrink)

Interactions between an intelligent software agent and a human user are ubiquitous in everyday situations such as access to information, entertainment, and purchases. In such interactions, the ISA mediates the user’s access to the content, or controls some other aspect of the user experience, and is not designed to be neutral about outcomes of user choices. Like human users, ISAs are driven by goals, make autonomous decisions, and can learn from experience. Using ideas from bounded rationality, we frame these interactions (...) as instances of an ISA whose reward depends on actions performed by the user. Such agents benefit by steering the user’s behaviour towards outcomes that maximise the ISA’s utility, which may or may not be aligned with that of the user. Video games, news recommendation aggregation engines, and fitness trackers can all be instances of this general case. Our analysis facilitates distinguishing various subcases of interaction, as well as second-order effects that might include the possibility for adaptive interfaces to induce behavioural addiction, and/or change in user belief. We present these types of interaction within a conceptual framework, and review current examples of persuasive technologies and the issues that arise from their use. We argue that the nature of the feedback commonly used by learning agents to update their models and subsequent decisions could steer the behaviour of human users away from what benefits them, and in a direction that can undermine autonomy and cause further disparity between actions and goals as exemplified by addictive and compulsive behaviour. We discuss some of the ethical, social and legal implications of this technology and argue that it can sometimes exploit and reinforce weaknesses in human beings. (shrink)

Artificial intelligence plays an important role in current discussions on information and communication technologies and new modes of algorithmic governance. It is an unavoidable dimension of what social mediations and modes of reproduction of our information societies will be in the future. While several works in artificial intelligence ethics address ethical issues specific to certain areas of expertise, these ethical reflections often remain confined to narrow areas of application, without considering the global ethical issues in which they are embedded. We, (...) therefore, propose to clarify the main approaches to AIE, their philosophical assumptions and the specific characteristics of each one of them, to identify the most promising approach to develop an ethical reflection on the deployment of AI in our societies, which is the one based on information ethics as proposed by Luciano Floridi. We will identify the most important features of that approach to highlight areas that need further investigation. (shrink)

One is occasionally reminded of Foucault's proclamation in a 1970 interview that "perhaps, one day this century will be known as Deleuzian." Less often is one compelled to update and restart with a supplementary counter-proclamation of the mathematician, David Lindley: "the twenty-first century would be a Bayesian era..." The verb tenses of both are conspicuous. // To critically attend to what is today often feared and demonized, but also revered, deployed, and commonly referred to as algorithm(s), one cannot avoid the (...) mathematical and philosophical legacies of probability. // But attending to these probabilistic or Bayesian legacies must include an undeniable theological legacy in which they remain entangled. // We are not, today, discovering quirky theological metaphors in contemporary technics. It's the other way around. The technologies are mere metaphors of past theologies. (shrink)

How can the medium be addressed when it is always already saturated in religious over-determinations and ever marked by theological concerns (such as revelation and incarnation) while, at the same time, religion would not be practiced and theology not be done without using some such medium? We encourage methodological and conceptual shifts, first, from medium to mediality; second, from religion to its partial negation (or, perhaps, partial permeation); third, from theology to doing the theological differently. With these shifts we desire (...) to initiate, continue, and intensify debates, specifically between theologians and scholars of religious studies and media theory. (shrink)

Regardless of whatever else physicalism requires, nearly all philosophers agree that physicalism cannot be true in a world which contains fundamental mentality. I challenge this widely held attitude, and describe a world which is plausibly all-physical, yet which may contain fundamental mentality. This is a world in which priority monism is true—which is the view that the whole of the cosmos is fundamental, with dependence relations directed from the whole to the parts—and which contains only a single mental system, like (...) a brain or computer. Because some properties of the whole are fundamental under priority monism, it follows that that the mental properties of a cosmos-encompassing brain or computer system may be fundamental in a priority monist world. Yet such a world need not contain anything physically unacceptable: the mental properties of the cosmos-encompassing brain or computer can be characterized in a physicalism-friendly functionalist or identity-theoretic way. Thus, as I see it, physicalism need not be false in such a world. This constitutes a challenge to those who hold the view that physicalism is inconsistent with the existence of fundamental mentality. (shrink)

The likely near future creation of artificial superintelligence carries significant risks to humanity. These risks are difficult to conceptualise and quantify, but malicious use of existing artificial intelligence by criminals and state actors is already occurring and poses risks to digital security, physical security and integrity of political systems. These risks will increase as artificial intelligence moves closer to superintelligence. While there is little research on risk management tools used in artificial intelligence development, the current global standard for risk management, (...) ISO 31000:2018, is likely used extensively by developers of artificial intelligence technologies. This paper argues that risk management has a common set of vulnerabilities when applied to artificial superintelligence which cannot be resolved within the existing framework and alternative approaches must be developed. Some vulnerabilities are similar to issues posed by malicious threat actors such as professional criminals and terrorists. Like these malicious actors, artificial superintelligence will be capable of rendering mitigation ineffective by working against countermeasures or attacking in ways not anticipated by the risk management process. Criminal threat management recognises this vulnerability and seeks to guide and block the intent of malicious threat actors as an alternative to risk management. An artificial intelligence treachery threat model that acknowledges the failings of risk management and leverages the concepts of criminal threat management and artificial stupidity is proposed. This model identifies emergent malicious behaviour and allows intervention against negative outcomes at the moment of artificial intelligence’s greatest vulnerability. (shrink)

The development of artificial intelligence will require systems of ethical decision making to be adapted for automatic computation. However, projects to implement moral reasoning in artificial moral agents so far have failed to satisfactorily address the widespread disagreement between competing approaches to moral philosophy. In this paper I argue that the proper response to this situation is to design machines to be fundamentally uncertain about morality. I describe a computational framework for doing so and show that it efficiently resolves common (...) obstacles to the implementation of moral philosophy in intelligent machines. (shrink)

Over the coming century, the accelerating advance of bioenhancement technologies, robotics, and artificial intelligence (AI) may significantly broaden the qualitative range of sentient and intelligent beings. This article proposes a taxonomy of such beings, ranging from modified animals to bioenhanced humans to advanced forms of robots and AI. It divides these diverse beings into three moral and legal categories—animals, persons, and presumed persons—describing the moral attributes and legal rights of each category. In so doing, the article sets forth a framework (...) for extending the concept of personhood well beyond its current boundaries, assigning moral standing to a variety of biological and nonbiological beings. The author concludes that six of the eight subgroups of such beings deserve to be treated as persons or as if they were persons, with full consideration for their presumed interests, rights, obligations, and capabilities for ethically significant agency and patiency. (shrink)

As a relational concept, responsible innovation can be made more tangible by asking innovation of what and responsibility of whom for what? Arranging the scattered field of responsible innovation comprehensively, starting from an anthropological point of view, into five fields of tension and five categories of spearheads, may be theoretically and practically helpful while offering suggestions for both research and management.

In this article I propose a theological reflection on the philosophical assumptions behind the idea that intelligent machine can be governed through ethical protocols, which may apply either to the people who develop the machines or to the machines themselves, or both. This idea is particularly relevant in the case of machines’ extreme wrongdoing, a wrongdoing that becomes an existential risk for humankind. I call this extreme wrong-doing, ‘evil.’ Thus, this article is a theological account on the philosophical assumptions behind (...) the possibility of evil machines, machines that can create an existential risk for humankind, and the ethical remedies that limit that risk. After discussing these assumptions, I argue for the ineffectiveness of these ethical remedies to prevent the possibility of evil machines. The article is an application of Romano Guardini’s thought on technology to evil machines. (shrink)

In this article, I address the issue of evil and roboethics in the context of management studies and suggest that management scholars should locate evil in the realm of the human rather than of the artificial. After discussing the possibility of addressing the reality of evil machines in ontological terms, I explore users’ reaction to robots in a social context. I conclude that the issue of evil machines in management is more precisely a case of technology anthropomorphization.

A major approach to the ethics of artificial intelligence is to use social choice, in which the AI is designed to act according to the aggregate views of society. This is found in the AI ethics of “coherent extrapolated volition” and “bottom–up ethics”. This paper shows that the normative basis of AI social choice ethics is weak due to the fact that there is no one single aggregate ethical view of society. Instead, the design of social choice AI faces three (...) sets of decisions: standing, concerning whose ethics views are included; measurement, concerning how their views are identified; and aggregation, concerning how individual views are combined to a single view that will guide AI behavior. These decisions must be made up front in the initial AI design—designers cannot “let the AI figure it out”. Each set of decisions poses difficult ethical dilemmas with major consequences for AI behavior, with some decision options yielding pathological or even catastrophic results. Furthermore, non-social choice ethics face similar issues, such as whether to count future generations or the AI itself. These issues can be more important than the question of whether or not to use social choice ethics. Attention should focus on these issues, not on social choice. (shrink)

Artificial intelligence experts are currently divided into “presentist” and “futurist” factions that call for attention to near-term and long-term AI, respectively. This paper argues that the presentist–futurist dispute is not the best focus of attention. Instead, the paper proposes a reconciliation between the two factions based on a mutual interest in AI. The paper further proposes realignment to two new factions: an “intellectualist” faction that seeks to develop AI for intellectual reasons and a “societalist faction” that seeks to develop AI (...) for the benefit of society. The paper argues in favor of societalism and offers three means of concurrently addressing societal impacts from near-term and long-term AI: advancing societalist social norms, thereby increasing the portion of AI researchers who seek to benefit society; technical research on how to make any AI more beneficial to society; and policy to improve the societal benefits of all AI. In practice, it will often be advantageous to emphasize near-term AI due to the greater interest in near-term AI among AI and policy communities alike. However, presentist and futurist societalists alike can benefit from each others’ advocacy for attention to the societal impacts of AI. The reconciliation between the presentist and futurist factions can improve both near-term and long-term societal impacts of AI. (shrink)