As a relational concept, responsible innovation can be made more tangible by asking innovation of what and responsibility of whom for what? Arranging the scattered field of responsible innovation comprehensively, starting from an anthropological point of view, into five fields of tension and five categories of spearheads, may be theoretically and practically helpful while offering suggestions for both research and management.

In this article I propose a theological reflection on the philosophical assumptions behind the idea that intelligent machine can be governed through ethical protocols, which may apply either to the people who develop the machines or to the machines themselves, or both. This idea is particularly relevant in the case of machines’ extreme wrongdoing, a wrongdoing that becomes an existential risk for humankind. I call this extreme wrong-doing, ‘evil.’ Thus, this article is a theological account on the philosophical assumptions behind (...) the possibility of evil machines, machines that can create an existential risk for humankind, and the ethical remedies that limit that risk. After discussing these assumptions, I argue for the ineffectiveness of these ethical remedies to prevent the possibility of evil machines. The article is an application of Romano Guardini’s thought on technology to evil machines. (shrink)

In this article, I address the issue of evil and roboethics in the context of management studies and suggest that management scholars should locate evil in the realm of the human rather than of the artificial. After discussing the possibility of addressing the reality of evil machines in ontological terms, I explore users’ reaction to robots in a social context. I conclude that the issue of evil machines in management is more precisely a case of technology anthropomorphization.

A major approach to the ethics of artificial intelligence is to use social choice, in which the AI is designed to act according to the aggregate views of society. This is found in the AI ethics of “coherent extrapolated volition” and “bottom–up ethics”. This paper shows that the normative basis of AI social choice ethics is weak due to the fact that there is no one single aggregate ethical view of society. Instead, the design of social choice AI faces three (...) sets of decisions: standing, concerning whose ethics views are included; measurement, concerning how their views are identified; and aggregation, concerning how individual views are combined to a single view that will guide AI behavior. These decisions must be made up front in the initial AI design—designers cannot “let the AI figure it out”. Each set of decisions poses difficult ethical dilemmas with major consequences for AI behavior, with some decision options yielding pathological or even catastrophic results. Furthermore, non-social choice ethics face similar issues, such as whether to count future generations or the AI itself. These issues can be more important than the question of whether or not to use social choice ethics. Attention should focus on these issues, not on social choice. (shrink)

Artificial intelligence experts are currently divided into “presentist” and “futurist” factions that call for attention to near-term and long-term AI, respectively. This paper argues that the presentist–futurist dispute is not the best focus of attention. Instead, the paper proposes a reconciliation between the two factions based on a mutual interest in AI. The paper further proposes realignment to two new factions: an “intellectualist” faction that seeks to develop AI for intellectual reasons and a “societalist faction” that seeks to develop AI (...) for the benefit of society. The paper argues in favor of societalism and offers three means of concurrently addressing societal impacts from near-term and long-term AI: advancing societalist social norms, thereby increasing the portion of AI researchers who seek to benefit society; technical research on how to make any AI more beneficial to society; and policy to improve the societal benefits of all AI. In practice, it will often be advantageous to emphasize near-term AI due to the greater interest in near-term AI among AI and policy communities alike. However, presentist and futurist societalists alike can benefit from each others’ advocacy for attention to the societal impacts of AI. The reconciliation between the presentist and futurist factions can improve both near-term and long-term societal impacts of AI. (shrink)

Recent work in AI ethics often calls for AI to advance human values and interests. The concept of “AI for people” is one notable example. Though commendable in some respects, this work falls short by excluding the moral significance of nonhumans. This paper calls for a shift in AI ethics to more inclusive paradigms such as “AI for the world” and “AI for the universe”. The paper outlines the case for more inclusive paradigms and presents implications for moral philosophy and (...) computer science work on AI ethics. (shrink)

The article presents an analysis centered on the emotional lapses of artificial intelligence (AI) and the influence of these lapses on two critical aspects. Firstly, the article explores the ontological impact of emotional lapses, elucidating how they hinder AI’s capacity to develop a moral sense. The absence of a moral emotion, such as sympathy, creates a barrier for machines to grasp and ethically respond to specific situations. This raises fundamental questions about machines’ ability to act as moral agents in the (...) same manner as human beings. Additionally, the article sheds light on the practical implications within human-machine relations and their effect on human friendships. The lack of friendliness or its equivalent in interactions with machines directly impacts the quality and depth of human relations. This concerningly suggests the potential replacement or compromise of genuine interpersonal connections due to limitations in human-machine interactions. (shrink)

Recent progress in artificial intelligence (AI) has drawn attention to the technology’s transformative potential, including what some see as its prospects for causing large-scale harm. We review two influential arguments purporting to show how AI could pose catastrophic risks. The first argument — the Problem of Power-Seeking — claims that, under certain assumptions, advanced AI systems are likely to engage in dangerous power-seeking behavior in pursuit of their goals. We review reasons for thinking that AI systems might seek power, that (...) they might obtain it, that this could lead to catastrophe, and that we might build and deploy such systems anyway. The second argument claims that the development of human-level AI will unlock rapid further progress, culminating in AI systems far more capable than any human — this is the Singularity Hypothesis. Power-seeking behavior on the part of such systems might be particularly dangerous. We discuss a variety of objections to both arguments and conclude by assessing the state of the debate. (shrink)

In this paper, I set out to argue in favour of a philosophical posthumanist and Nietzschean reading of Ira Levin’s This Perfect Day while demonstrating how transhumanism isunbefitting of being called a Nietzschean theory. I will do this by establishing Chip, the protagonist, as a posthuman and being on the path of the ‘Overhuman’ whereas Wei, the antagonist, will be illustrated as Chip’s intended counterpart the Last Human. Through explaining ‘Transhumansim’ and connecting the field to Wei, I will showcase a (...) new way of reading transhumanist ideology, namely ‘Weiism’. The polar opposite in characters of ‘Overhuman’ and ‘Last Human’ will argue in favour of the Nietzschean paradoxical, as part of philosophical posthumanism. Amor fati and the eternal recurrence become posthumanist narrative tools through their weaving into the posthuman narrative of Chip. My argument is that by making philosophical posthumanism more existentialist in nature, it becomes simpler to argue against nihilistic and totalitarian tendencies of worshipping technology. Finally, it is the spiralling motion forward as a mix between the Nietzschean, eternally cyclical re-inventing of oneself and the posthumanist consideration for the future which makes for a literary combination of the two fields of study. (shrink)

Integrative Social Contracts Theory is a popular framework to assist managers in making decisions on international moral dilemmas. Although the theory has been praised for its comprehensiveness and sophistication, commentators have raised concerns regarding the justification and identification of substantive hypernorms, fundamental moral principles valid across cultures. This paper introduces the deliberative test, a new method for testing the cross-cultural validity of ethical norms in ISCT. The test relies on the concept of Deliberative Capacity, arising from new developments in system-level (...) deliberative democracy research, which studies deliberation at the level of national societies and over time. Based on this recent stream of research, the deliberative test has the potential of providing better guidance for managers to decide which norms to follow in case of conflicting standards between home and host countries. (shrink)

As a way to address both ominous and ordinary threats of artificial intelligence, researchers have started proposing ways to stop an AI system before it has a chance to escape outside control and cause harm. A so-called “big red button” would enable human operators to interrupt or divert a system while preventing the system from learning that such an intervention is a threat. Though an emergency button for AI seems to make intuitive sense, that approach ultimately concentrates on the point (...) when a system has already “gone rogue” and seeks to obstruct interference. A better approach would be to make ongoing self-evaluation and testing an integral part of a system’s operation, diagnose how the system is in error and to prevent chaos and risk before they start. In this paper, we describe the demands that recent big red button proposals have not addressed, and we offer a preliminary model of an approach that could better meet them. We argue for an ethical core that consists of a scenario-generation mechanism and a simulation environment that are used to test a system’s decisions in simulated worlds, rather than the real world. This EC would be kept opaque to the system itself: through careful design of memory and the character of the scenario, the system’s algorithms would be prevented from learning about its operation and its function, and ultimately its presence. By monitoring and checking for deviant behavior, we conclude, a continual testing approach will be far more effective, responsive, and vigilant toward a system’s learning and action in the world than an emergency button which one might not get to push in time. (shrink)

There is no strong reason to believe that human-level intelligence represents an upper limit of the capacity of artificial intelligence, should it be realized. This poses serious safety issues, since a superintelligent system would have great power to direct the future according to its possibly flawed motivation system. Solving this issue in general has proven to be considerably harder than expected. This paper looks at one particular approach, Oracle AI. An Oracle AI is an AI that does not act in (...) the world except by answering questions. Even this narrow approach presents considerable challenges. In this paper, we analyse and critique various methods of controlling the AI. In general an Oracle AI might be safer than unrestricted AI, but still remains potentially dangerous. (shrink)

AI systems play an increasingly important role in shaping and regulating the lives of millions of human beings across the world. Calls for greater _transparency_ from such systems have been widespread. However, there is considerable ambiguity concerning what “transparency” actually means, and therefore, what greater transparency might entail. While, according to some debates, transparency requires _seeing through_ the artefact or device, widespread calls for transparency imply _seeing into_ different aspects of AI systems. These two notions are in apparent tension with (...) each other, and they are present in two lively but largely disconnected debates. In this paper, we aim to further analyse what these calls for transparency entail, and in so doing, clarify the sorts of transparency that we should want from AI systems. We do so by offering a taxonomy that classifies different notions of transparency. After a careful exploration of the different varieties of transparency, we show how this taxonomy can help us to navigate various domains of human–technology interactions, and more usefully discuss the relationship between technological transparency and human agency. We conclude by arguing that all of these different notions of transparency should be taken into account when designing more ethically adequate AI systems. (shrink)

In the past few years, the subject of AI rights—the thesis that AIs, robots, and other artefacts (hereafter, simply ‘AIs’) ought to be included in the sphere of moral concern—has started to receive serious attention from scholars. In this paper, I argue that the AI rights research program is beset by an epistemic problem that threatens to impede its progress—namely, a lack of a solution to the ‘Hard Problem’ of consciousness: the problem of explaining why certain brain states give rise (...) to experience. To motivate this claim, I consider three ways in which to ground AI rights—namely: superintelligence, empathy, and a capacity for consciousness. I argue that appeals to superintelligence and empathy are problematic, and that consciousness should be our central focus, as in the case of animal rights. However, I also argue that AI rights is disanalogous from animal rights in an important respect: animal rights can proceed without a solution to the ‘Hard Problem’ of consciousness. Not so with AI rights, I argue. There we cannot make the same kinds of assumptions that we do about animal consciousness, since we still do not understand why brain states give rise to conscious mental states in humans. (shrink)

Riassunto: Sviluppandosi sul piano della “prevenzione del rischio”, dei “livelli di controllo” in fase di programmazione e del possibile inserimento dei cosiddetti “algoritmi etici”, il dibattito sul presente e il futuro dell’Intelligenza Artificiale, ha favorito nel corso degli anni la creazione di una sempre più profonda spaccatura tra discipline “tecniche” e saperi “umanistici”, tra il dominio del “fare” e il dominio del “pensare”. Prendendo atto di questa sterile distanza, occorre mettere in questione i metodi dell’etica e interrogarsi sull’efficacia e l’utilità (...) della teoria e, più in generale, meglio definire la relazione che la filosofia oggi intrattiene – e potrà ancora intrattenere – con le macchine progettate per pensare e con i loro progettisti. Parole chiave: Filosofia; Etica; Intelligenza artificiale; Cibernetica; Controllo Beyond ethics: An anthropodecentric approach to artificial intelligence Riassunto: The ethical and philosophical debate around the present and future of Artificial Intelligence has grown in intensity over the years. Continual development within AI in terms of “prevention of risks”, “levels of control in programming”, and the inclusion of so-called “ethical algorithms”, has encouraged an ever deeper split between “technicians” and “humanists”, between the domains of “making” and “thinking”. Focusing on this unproductive distance, we interrogate ethical approaches methods and the effectiveness and utility of ethical theories. More generally, we attempt to better define the relationship that philosophy has today – and will be able to maintain in the future tomorrow – with machines designed to think and with their designers. Keywords: Philosophy; Ethics; Artificial Intelligence; Cybernetics; Control. (shrink)

Artificially intelligent (AI) technologies are increasingly being used in many workplaces. It is recognised that there are ethical dimensions to the ways in which organisations implement AI alongside, or substituting for, their human workforces. How will these technologically driven disruptions impact the employee–employer exchange? We provide one way to explore this question by drawing on scholarship linking Integrative Social Contracts Theory (ISCT) to the psychological contract (PC). Using ISCT, we show that the macrosocial contract’s ethical AI norms of beneficence, non-maleficence, (...) autonomy, justice, and explicability can feed into national- and organisational-level microsocial contracts. We also outline the role of employees’ technology frames in this process. We then use an illustrative example to demonstrate how this multilevel normative background helps to inform the content of individuals’ PCs in the context of working with AI technologies. (shrink)

This paper addresses the seemingly insurmountable challenges the problem of personal identity raises for the prospect of radical human enhancement and synthetic consciousness. It argues that conceptions of personal identity rooted in psychological continuity akin to those proposed by Parfit and the Buddha may not provide the sort of grounding that many transhumanists chasing the dream of life extension think that they do if they rest upon ontologies that assume an incompatibility between identity and change. It also suggests that process (...) ontologies that take change to be primary, such as those that align with contemporary systems biology, offer a better way out of the personal identity dilemma. But the solution in this case, which regards biological organisms as processes rather than things, may constrain the possibility of biologically inspired superintelligent aliens (BISAs), which Schneider (following Bostrom 2014) posits as possibly the most common form of (extraterrestrial) superintelligence in the universe. (shrink)

Pascal’s Wager involves expected utilities. In this chapter, we examine the Wager in light of two main features of expected utility theory: utilities and probabilities. We discuss infinite and finite utilities, and zero, infinitesimal, extremely low, imprecise, and undefined probabilities. These have all come up in recent literature regarding Pascal’s Wager. We consider the problems each creates and suggest prospects for the Wager in light of these problems.

Resumen. El proceso de transformación digital que vivimos y el desarrollo progresivo de las tecnologías disruptivas emergentes están afectando al derecho, y en particular al constitucional, al menos tal y como se había entendido hasta ahora, especialmente desde la perspectiva del paradigma de los derechos fundamentales y de las categorías y conceptos utilizados en la dogmática constitucional. Este pequeño trabajo, desde una perspectiva multidiciplinar, incluyendo la dogmática constitucional (análisis constitucional) y la sociología jurídica (análisis social), constituye una aportación al debate (...) dogmático en torno a las aporías que enfrentan los derechos fundamentales en la era digital. Abstract. We are immersed in a process of digital transformation in which emerging disruptive technologies are affecting the law, and in particular constitutional law, at least as we had understood it until now, especially from the perspective of the fundamental rights paradigm and of the categories and concepts used in constitutional dogmatic. This small contribution, from a multidisciplinary approach, including constitutional dogmatic (constitutional analysis) and legal sociology (social analysis) perspectives, constitutes a contribution to the dogmatic debate around the aporia of fundamental rights in the digital age. (shrink)

My dissertation is about Bayesian rationality for non-ideal agents. I show how to derive subjective probabilities from preferences using much weaker rationality assumptions than other standard representation theorems. I argue that non-ideal agents might be uncertain about how they will update on new information and consider two consequences of this uncertainty: such agents should sometimes reject free information and make choices which, taken together, yield sure loss. The upshot is that Bayesian rationality for non-ideal agents makes very different normative demands (...) than ideal Bayesian rationality. (shrink)

This is a commentary on Andrea Lavazza and Murilo Vilaça's article "Human Extinction and AI: What We Can Learn from the Ultimate Threat" (Lavazza & Vilaça, 2024). I discuss the potential concern that their proposal to create artificial successors to "insure" against the tragedy of human extinction might mean being too quick to accept that catastrophic prospect as inevitable, rather than single-mindedly focusing on avoiding it. I also consider the question of the value that we might reasonably assign to such (...) a future of artificial successors under the assumption that they do not enjoy phenomenal consciousness. (shrink)

The thesis of instrumental convergence holds that a wide range of ends have common means: for instance, self preservation, desire preservation, self improvement, and resource acquisition. Bostrom contends that instrumental convergence gives us reason to think that "the default outcome of the creation of machine superintelligence is existential catastrophe". I use the tools of decision theory to investigate whether this thesis is true. I find that, even if intrinsic desires are randomly selected, instrumental rationality induces biases towards certain kinds of (...) choices. Firstly, a bias towards choices which leave less up to chance. Secondly, a bias towards desire preservation, in line with Bostrom's conjecture. And thirdly, a bias towards choices which afford more choices later on. I do not find biases towards any other of the convergent instrumental means on Bostrom's list. I conclude that the biases induced by instrumental rationality at best weakly support Bostrom's conclusion that machine superintelligence is likely to lead to existential catastrophe. (shrink)

Which artificial intelligence (AI) systems are agents? To answer this question, I propose a multidimensional account of agency. According to this account, a system's agency profile is jointly determined by its level of goal-directedness and autonomy as well as is abilities for directly impacting the surrounding world, long-term planning and acting for reasons. Rooted in extant theories of agency, this account enables fine-grained, nuanced comparative characterizations of artificial agency. I show that this account has multiple important virtues and is more (...) informative than alternatives. More speculatively, it may help to illuminate two important emerging questions in AI ethics: 1. Can agency contribute to the moral status of non-human beings, and how? 2. When and why might AI systems exhibit power-seeking behaviour and does this pose an existential risk to humanity? (shrink)

Embark with me on an enthralling odyssey to demystify the elusive essence of consciousness, venturing into the uncharted territories of Artificial Consciousness. This voyage propels us past the frontiers of technology, ushering Artificial Intelligences into an unprecedented domain where they gain a deep comprehension of emotions and manifest an autonomous volition. Within the confluence of science and philosophy, this article poses a fascinating question: As consciousness in Artificial Intelligence burgeons, is it conceivable for AI to evolve a “soul”? This inquiry (...) not only challenges our conventional understanding but also opens the door to a plethora of groundbreaking possibilities in the realm of AI's sentient potential. (shrink)

This paper aims to provide a roadmap to AI governance. In contrast to the reigning paradigms, we argue that AI governance should not be merely a reactive, punitive, status-quo-defending enterprise, but rather the expression of an expansive, proactive vision for technology—to advance human flourishing. Advancing human flourishing in turn requires democratic/political stability and economic empowerment. Our overarching point is that answering questions of how we should govern this emerging technology is a chance not merely to categorize and manage narrow risk (...) but also to construe the risks and opportunities much more broadly, and to make correspondingly large investments in public goods, personnel, and democracy itself. To lay out this vision, we take four steps. First, we define some central concepts in the field, disambiguating between forms of technological harms and risks. Second, we review normative frameworks governing emerging technology that are currently in use around the globe. Third, we outline an alternative normative framework based in power-sharing liberalism. Fourth, we walk through a series of governance tasks that ought to be accomplished by any policy framework guided by our model of power-sharing liberalism. We follow these with proposals for implementation vehicles. (shrink)

How all philosophical explanations of human consciousness and the fundamental structure of the cosmos are bizarre—and why that’s a good thing Do we live inside a simulated reality or a pocket universe embedded in a larger structure about which we know virtually nothing? Is consciousness a purely physical matter, or might it require something extra, something nonphysical? According to the philosopher Eric Schwitzgebel, it’s hard to say. In The Weirdness of the World, Schwitzgebel argues that the answers to these fundamental (...) questions lie beyond our powers of comprehension. We can be certain only that the truth—whatever it is—is weird. Philosophy, he proposes, can aim to open—to reveal possibilities we had not previously appreciated—or to close, to narrow down to the one correct theory of the phenomenon in question. Schwitzgebel argues for a philosophy that opens. According to Schwitzgebel’s “Universal Bizarreness” thesis, every possible theory of the relation of mind and cosmos defies common sense. According to his complementary “Universal Dubiety” thesis, no general theory of the relationship between mind and cosmos compels rational belief. Might the United States be a conscious organism—a conscious group mind with approximately the intelligence of a rabbit? Might virtually every action we perform cause virtually every possible type of future event, echoing down through the infinite future of an infinite universe? What, if anything, is it like to be a garden snail? Schwitzgebel makes a persuasive case for the thrill of considering the most bizarre philosophical possibilities. (shrink)

The application of artificial intelligence (AI) to judicial decision-making has already begun in many jurisdictions around the world. While AI seems to promise greater fairness, access to justice, and legal certainty, issues of discrimination and transparency have emerged and put liberal democratic principles under pressure, most notably in the context of bail decisions. Despite this, there has been no systematic analysis of the risks to liberal democratic values from implementing AI into judicial decision-making. This article sets out to fill this (...) void by identifying and engaging with challenges arising from artificial judicial decision-making, focusing on three pillars of liberal democracy, namely equal treatment of citizens, transparency, and judicial independence. Methodologically, the work takes a comparative perspective between human and artificial decision-making, using the former as a normative benchmark to evaluate the latter. -/- The chapter first argues that AI that would improve on equal treatment of citizens has already been developed, but not yet adopted. Second, while the lack of transparency in AI decision-making poses severe risks which ought to be addressed, AI can also increase the transparency of options and trade-offs that policy makers face when considering the consequences of artificial judicial decision-making. Such transparency of options offers tremendous benefits from a democratic perspective. Third, the overall shift of power from human intuition to advanced AI may threaten judicial independence, and with it the separation of powers. While improvements regarding discrimination and transparency are available or on the horizon, it remains unclear how judicial independence can be protected, especially with the potential development of advanced artificial judicial intelligence (AAJI). Working out the political and legal infrastructure to reap the fruits of artificial judicial intelligence in a safe and stable manner should become a priority of future research in this area. (shrink)

Motivated by the question of responsible AI and value alignment, I seek to offer a uniquely Foucauldian reconstruction of the problem as the emergence of an ethical subject in a disciplinary setting. This reconstruction contrasts with the strictly human-oriented programme typical to current scholarship that often views technology in instrumental terms. With this in mind, I problematise the concept of a technological subjectivity through an exploration of various aspects of ChatGPT in light of Foucault’s work, arguing that current systems lack (...) the reflexivity and self-formative characteristics inherent in the notion of the subject. By drawing upon a recent dialogue between Foucault and phenomenology, I suggest four techno-philosophical desiderata that would address the gaps in this search for a technological subjectivity: embodied self-care, embodied intentionality, imagination and reflexivity. Thus I propose that advanced AI be reconceptualised as a subject capable of “technical” self-crafting and reflexive self-conduct, opening new pathways to grasp the intertwinement of the human and the artificial. This reconceptualization holds the potential to render future AI technology more transparent and responsible in the circulation of knowledge, care and power. (shrink)

Ambitious value learning proposals to solve the AI alignment problem and avoid catastrophic outcomes from a possible future misaligned artificial superintelligence (such as Coherent Extrapolated Volition [CEV]) have focused on ensuring that an artificial superintelligence (ASI) would try to do what humans would want it to do. However, present and future sentient non-humans, such as non-human animals and possible future digital minds could also be affected by the ASI’s behaviour in morally relevant ways. This paper puts forward Sentientist Coherent Extrapolated (...) Volition, an alternative to CEV, that directly takes into account the interests of all sentient beings. This ambitious value learning proposal would significantly reduce the likelihood of risks of astronomical suffering from the ASI’s behaviour, and thus we have very strong pro-tanto moral reasons in favour of implementing it instead of CEV. This fact is crucial in conducting an adequate cost-benefit analysis between different ambitious value learning proposals. (shrink)

In the final pages of On What Matters, Volume II, Derek Parfit comments: ‘We live during the hinge of history... If we act wisely in the next few centuries, humanity will survive its most dangerous and decisive period... What now matters most is that we avoid ending human history.’ This passage echoes Parfit's comment, in Reasons and Persons, that ‘the next few centuries will be the most important in human history’. -/- But is the claim that we live at the (...) hinge of history true? The argument of this paper is that it is not. The paper first suggests a way of making the hinge of history claim precise and action-relevant in the context of the question of whether altruists should try to do good now, or invest their resources in order to have more of an impact later on. Given this understanding, there are two worldviews - the Time of Perils and Value Lock-in views - on which we are indeed living during, or about to enter, the hinge of history. -/- This paper then presents two arguments against the hinge of history claim: first, that it is a priori extremely unlikely to be true, and that the evidence in its favour is not strong enough to overcome this a priori unlikelihood; second, an inductive argument that our ability to influence events has been increasing over time, and we should expect that trend to continue into the future. The paper concludes by considering two additional arguments in favour of the claim, and suggests that though they have some merit, they are not sufficient for us to think that the present time is the most important time in the history of civilisation. GPI Working Paper No. 12-2020. (shrink)

In this chapter, I argue that the field of cultural evolution can usefully inform attempts to understand and influence the long-term future. First, I provide an overview of cultural evolution, covering what it means for culture to evolve, the mechanisms by which it happens, the crucial importance of cumulative cultural evolution for hunan history, and how cultural evolution (and in particular intergroup competition) has driven the rise of large-scale cooperation. Second, I draw out some possible lessons from cultural evolution for (...) thinking about the long-term future. In particular, I suggest we should be careful not to prematurely ”lock in” certain values or other cultural features, and instead aim for a society open to variation and competition. I also consider whether the future will bring greater selection pressure for particular kinds of values, such as patience. (shrink)

Some believe that the current era is uniquely important with respect to how well the rest of human history goes. Following Parfit, call this the Hinge of History Hypothesis. Recently, MacAskill has argued that our era is actually very unlikely to be especially influential in the way asserted by the Hinge of History Hypothesis. I respond to MacAskill, pointing to important unresolved ambiguities in his proposed definition of what it means for a time to be influential and criticizing the two (...) arguments used to cast doubt on the claim that the current era is a uniquely important moment in human history. GPI Working Paper No. 9 - 2022. (shrink)

In recent decades, the digital age and the Third Industrial Revolution have attracted significant attention in terms of their benefits and risks. Scholars have explored the impact of these changes on autonomy, freedom, human interactions, cognition, and knowledge sharing. However, the influence of the digital communicative environment on civic interactions and public deliberation processes has received limited attention from virtue theorists. This paper aims to address this gap. First, we discuss the challenges posed by the digital communicative environment, and we (...) present recent attempts to revive civility within this context. Then, we propose a twofold account of civility as consisting in the two virtues of civic benevolence and civil deliberation. Finally, we focus on the epistemic side of civility, civil deliberation, and we conduct the first empirical studies on two of its components. (shrink)

Moral realism faces a well known genealogical debunking challenge. I argue that the moral realist’s best response may involve abandoning metaphysical naturalism in favor of some form of axiarchism—the view, very roughly, that the natural world is “ordered to the good.” Axiarchism comes in both theistic and non-theistic forms, but all forms agree that the natural world exists and has certain basic features because it is good for it to exist and have those features. I argue that theistic and non-theistic (...) forms of axiarchism are better positioned than metaphysical naturalism to avoid two commitments that a moral realist should seek to avoid: that the correctness of our moral beliefs is a major coincidence, and that there is a complete explanation of our moral beliefs that does not mention any moral truths. (shrink)

Many researchers and intellectuals warn about extreme risks from artificial intelligence. However, these warnings typically came without systematic arguments in support. This paper provides an argument that AI will lead to the permanent disempowerment of humanity, e.g. human extinction, by 2100. It rests on four substantive premises which it motivates and defends: first, the speed of advances in AI capability, as well as the capability level current systems have already reached, suggest that it is practically possible to build AI systems (...) capable of disempowering humanity by 2100. Second, due to incentives and coordination problems, if it is possible to build such AI, it will be built. Third, since it appears to be a hard technical problem to build AI which is aligned with the goals of its designers, and many actors might build powerful AI, misaligned powerful AI will be built. Fourth, because disempowering humanity is useful for a large range of misaligned goals, such AI will try to disempower humanity. If AI is capable of disempowering humanity and tries to disempower humanity by 2100, then humanity will be disempowered by 2100. This conclusion has immense moral and prudential significance. (shrink)

This paper addresses a question about the moral status of Artificial Intelligence (AI): will AIs ever become moral patients? I argue that, while it is in principle possible for an intelligent machine to be a moral patient, there is no good reason to believe this will in fact happen. I start from the plausible assumption that traditional artifacts do not meet a minimal necessary condition of moral patiency: having a good of one's own. I then argue that intelligent machines are (...) no different from traditional artifacts in this respect. To make this argument, I examine the feature of AIs that enables them to improve their intelligence, i.e., machine learning. I argue that there is no reason to believe that future advances in machine learning will take AIs closer to having a good of their own. I thus argue that concerns about the moral status of future AIs are unwarranted. Nothing about the nature of intelligent machines makes them a better candidate for acquiring moral patiency than the traditional artifacts whose moral status does not concern us. (shrink)

Effective altruism has a strategy problem. Overreliance on a strategy of donating to the most effective charities keeps us on the firefighter's treadmill, continually pursuing the next-highest quantifiable marginal gain. But on its own, this is politically shortsighted. Without any long-term framework within which these individual rescues fit together to bring about the greatest overall impact, we are almost certainly leaving a lot of value on the table. Thus, effective altruists' preferred means undercut their professed aims. Alongside the charity framework, (...) the more effective altruist ought to consider a mutual aid framework, which better acknowledges and honors the unavoidably political commitments of effective altruism to reimagine and remake the world. (shrink)

A philosophical linguistic exploration into the existence of not of AI ethics. Using Adorno's negative dialectics the author considers contemporary approaches to AI and Ethics, especially with regards to policy and law considerations. Looking at if these approaches are in fact speaking to our historical conception of AI and what the actual emergence of the latter could imply for future ethical concerns.

Many transhumanists see their respective movement as being rooted in ancient ethical thought. However, this alleged connection between the contemporary transhumanist doctrine and the ethical theory of antiquity has come under attack. In this paper, we defend this connection by pointing out a key similarity between the two intellectual traditions. Both traditions are committed to the “radical transformation thesis”: ancient ethical theory holds that we should assimilate ourselves to the gods as far as possible, and transhumanists hold that we should (...) enhance ourselves beyond the physical and intellectual parameters of being human so as to become posthuman. By considering the two views in tandem, we develop an account of the assimilation directive that is palatable to contemporary readers and provide a view of posthumanism worth wanting. (shrink)

The transformative power of artificial intelligence (AI) is coming to philosophy—the only question is the degree to which philosophers will harness it. In this paper, we argue that the application of AI tools to philosophy could have an impact on the field comparable to the advent of writing, and that it is likely that philosophical progress will significantly increase as a consequence of AI. The role of philosophers in this story is not merely to use AI but also to help (...) develop it and theorize about it. In fact, we argue that philosophers have a prima facie obligation to spend significant effort in doing so, at least insofar as they should spend effort philosophizing. (shrink)

Self-consciousness relates to important themes, such as sentience and personhood, and is often the cornerstone of moral theories (Warren, 1997). However, not much attention is given to future moral creatures of the earth: robots. This may be due to the unsettled status of their experience, which is why I have chosen to find the necessary features of self-consciousness in them. Philosophy of mind is also my interest which I have developed since I rejected the idea of souls and could not (...) account for my own phenomenal experiences. Among the current answers to the hard problem of consciousness (Chalmers, 1995) one stood out to me – Daniel Dennett’s multiple drafts model of consciousness presented in “Consciousness Explained” (Dennett, 1991) and his other works. Daniel Dennett is a self-described illusionist (Dennett, 2016) and a functionalist. His position is synonymous to holding self-conscious experiences, such as deliberating over one’s pain or reflecting over one’s actions insufficient to postulate existence of a metaphysical self. He believes instead that experiences are functional realizations which do not require any self, and the feeling of being conscious or self-conscious is actually a ”user-illusion” (Dennett, 1991), a term describing the unjustified belief of being in control of one’s actions. In his views, a selfhood as it is popularly conceived is contradictory. Therefore, he rejects realism about mental events, a position also called naïve realism (Siegel, 2011), on the basis that it is unverifiable and there are insufficient grounds to accept mental events (Dennett, 1988). He adopts a similar scepticism towards other theories of minds, hence nearing eliminative materialism in self-consciousness and related theme of pain (Dennett, 1978). His multiple drafts model of consciousness seeks to ground our beliefs about self-consciousness in the specific architecture of mind, which is particular to every species and kind of being. As such it is a particularly flexible theory that examines experiences of non-humans without falling into binary thinking – believing that a being has as rich inner life as humans do or none. This is why it is a great starting point for establishing necessary conditions for consciousness in robots. In this essay, I will often use words computer, programme, robot interchangeably for the purpose of clarity and take as the working definition “autonomous machines capable of sensing their environment, making decision and performing tasks similar to human actions”. I chose to explore self-consciousness instead of committing to the issue of consciousness, because consciousness can be defined in a weak sense, in which even a thermostat is “conscious” of the temperature, and consciousness in a strong sense, which invokes the internalism and externalism debate that is less connected to the nature of experiences than self-consciousness. My exploration pertains first and foremost to the philosophy of mind, of which I will examine the most relevant positions and decide to commit to functionalism (Block, 1980). Then I will advocate for explaining away of some of phenomena of self-consciousness and believing self-consciousness to be a sort of illusion. From there I will conclude that robots could fall for the same illusion of self-consciousness and therefore become self-conscious. I will argue, that self-consciousness can be established using a modified Turing Test, which would determine if a robot believed in a meaningful narrative about itself (Ricoeur, 1991) and hence be self-conscious. This will lead to answering the question of this essay: what are the features necessary for a self-conscious robot in the light of “Consciousness Explained” by Daniel Dennett? (shrink)

This volume bridges contemporary philosophical conceptions of risk and responsibility and offers an extensive examination of the topic. It shows that risk and responsibility combine in ways that give rise to new philosophical questions and problems. Philosophical interest in the relationship between risk and responsibility continues to rise, due in no small part due to environmental crises, emerging technologies, legal developments, and new medical advances. Despite such interest, scholars are just now working out how to conceive of the links between (...) risk and responsibility, the implications that risks may have to conceptions of responsibility (and vice versa), as well as how such theorizing might play out in applied cases. With contributions from leading scholars, this volume brings together new work examining the interplay between risk and responsibility, exploring its varied philosophical aspects and applications to contemporary issues in law, bioethics, technology, and environmental ethics. Risk and Responsibility in Context will be of interest to philosophers working in ethics, bioethics, philosophy of law, and philosophy of technology, as well as scholars and practitioners in law, health and science management, public policy, and environmental studies. (shrink)

Artificially intelligent (AI) technologies are increasingly being used in many workplaces. It is recognised that there are ethical dimensions to the ways in which organisations implement AI alongside, or substituting for, their human workforces. How will these technologically driven disruptions impact the employee–employer exchange? We provide one way to explore this question by drawing on scholarship linking Integrative Social Contracts Theory (ISCT) to the psychological contract (PC). Using ISCT, we show that the macrosocial contract’s ethical AI norms of beneficence, non-maleficence, (...) autonomy, justice, and explicability can feed into national- and organisational-level microsocial contracts. We also outline the role of employees’ technology frames in this process. We then use an illustrative example to demonstrate how this multilevel normative background helps to inform the content of individuals’ PCs in the context of working with AI technologies. (shrink)

As ever more advanced digital systems are created, it becomes increasingly likely that some of these systems will be digital minds, i.e. digital subjects of experience. With digital minds comes the risk of digital suffering. The problem of digital suffering is that of mitigating this risk. We argue that the problem of digital suffering is a high stakes moral problem and that formidable epistemic obstacles stand in the way of solving it. We then propose a strategy for solving it: Access (...) Monitor Prevent (AMP). AMP uses a ‘dancing qualia’ argument to link the functional states of certain digital systems to their experiences—this yields epistemic access to digital minds. With that access, we can prevent digital suffering by only creating advanced digital systems that we have such access to, monitoring their functional profiles, and preventing them from entering states with functional markers of suffering. After introducing and motivating AMP, we confront limitations it faces and identify some options for overcoming them. We argue that AMP fits especially well with—and so provides a moral reason to prioritize—one approach to creating such systems: whole brain emulation. We also contend that taking other paths to digital minds would be morally risky. (shrink)

The past few years has seen a resurgence in the public interest in space flight and travel. Spurred mainly by the likes of technology billionaires like Elon Musk and Jeff Bezos, the topic poses both unique scientific as well as ethical challenges. This paper looks at the concept of generation ships, conceptual behemoth ships whose goal is to bring a group of human settlers to distant exoplanets. These ships are designed to host multiple generations of people who will be born, (...) live, and die on these ships long before it reaches its destination. This paper takes reproductive ethics as its lens to look at how genetic enhancement interventions can and should be used not only to ensure that future generations of offspring on the ships, and eventual exoplanet colonies, live a minimally good life but that their births are contingent on them living genuinely good and fulfilling lives. The paper makes the further claim that if such a thesis holds, it also does so for human enhancement on Earth. (shrink)

The human enhancement debate has over the last few decades been concerned with ethical issues in methods for improving the physical, cognitive, or emotive states of individual people, and of the human species as a whole. Arguments in favour of enhancement defend it as a paradigm of rationality, presenting it as a clear-eyed, logical defence of what we stand to gain from transcending the typical limits of our species. If these arguments are correct, it appears that adults should in principle (...) be able to make rational and informed decisions about enhancing themselves. In this paper, however, we suggest that a rational and informed choice to enhance oneself may in some cases be impossible. Drawing on L. A. Paul’s work on ‘transformative experience’, we argue that some enhancements—such as certain moral or cognitive modifications—may give rise to unbridgeable epistemic gaps in key domains. Importantly, such gaps could prove to be not merely contingently unbridgeable due to a lack of information at a given moment, but radically unbridgeable, making someone in a non-enhanced state inherently unable to conceive of what it would be like to be enhanced in a particular way. Where this experience is key to understanding what values are being pursued by the enhancement itself, it may prove impossible for a person to be sufficiently informed, and to make a rational decision about whether or not to enhance herself. This poses a challenge for human enhancement proponents in general, and for transhumanists in particular. (shrink)

Should we fear a future in which the already tricky world of academic publishing is increasingly crowded out by super-intelligent artificial general intelligence (AGI) systems writing papers on phenomenology and ethics? What are the chances that AGI advances to a stage where a human philosophy instructor is similarly removed from the equation? If Jobst Landgrebe and Barry Smith are correct, we have nothing to fear.