In light of recent breakneck pace in machine learning, questions about whether near-future artificial systems might be conscious and possess moral status are increasingly pressing. This paper argues that as matters stand these debates lack any clear criteria for resolution via the science of consciousness. Instead, insofar as they are settled at all, it is likely to be via shifts in public attitudes brought about by the increasingly close relationships between humans and AI users. Section 1 of the paper I (...) briefly lays out the current state of the science of consciousness and its limitations insofar as these pertain to machine consciousness, and claims that there are no obvious consensus frameworks to inform public opinion on AI consciousness. Section 2 examines the rise of conversational chatbots or Social AI, and argues that in many cases, these elicit strong and sincere attributions of consciousness, mentality, and moral status from users, a trend likely to become more widespread. Section 3 presents an inconsistent triad for theories that attempt to link consciousness, behaviour, and moral status, noting that the trends in Social AI systems will likely make the inconsistency of these three premises more pressing. Finally, Section 4 presents some limited suggestions for how consciousness and AI research communities should respond to the gap between expert opinion and folk judgment. (shrink)

The advent of conversational agents with increasingly human-like behaviour throws old philosophical questions into new light. Does it, or could it, ever make sense to speak of AI agents built out of generative language models in terms of consciousness, given that they are ‘mere’ simulacra of human behaviour, and that what they do can be seen as ‘merely’ role play? Drawing on the later writings of Wittgenstein, this paper attempts to tackle this question while avoiding the pitfalls of dualistic thinking.

A morally acceptable course of AI development should avoid two dangers: creating unaligned AI systems that pose a threat to humanity and mistreating AI systems that merit moral consideration in their own right. This paper argues these two dangers interact and that if we create AI systems that merit moral consideration, simultaneously avoiding both of these dangers would be extremely challenging. While our argument is straightforward and supported by a wide range of pretheoretical moral judgments, it has far-reaching moral implications (...) for AI development. Although the most obvious way to avoid the tension between alignment and ethical treatment would be to avoid creating AI systems that merit moral consideration, this option may be unrealistic and is perhaps fleeting. So, we conclude by offering some suggestions for other ways of mitigating mistreatment risks associated with alignment. (shrink)

If a machine attains consciousness, how could we find out? In this paper, I make three related claims regarding positive tests of machine consciousness. All three claims center on the idea that an AI can be constructed “ad hoc”, that is, with the purpose of satisfying a particular test of consciousness while clearly not being conscious. First, a proposed test of machine consciousness can be legitimate, even if AI can be constructed ad hoc specifically to pass this test. This is (...) underscored by the observation that many, if not all, putative tests of machine consciousness can be passed by non-conscious machines via ad hoc means. Second, we can identify ad hoc AI by taking inspiration from the notion of an ad hoc hypothesis in philosophy of science. Third, given the first and the second claim, the most reliable tests of animal consciousness turn out to be valid and useful positive tests of machine consciousness as well. If a non-ad hoc AI exhibits clusters of cognitive capacities facilitated by consciousness in humans which can be selectively switched off by masking and if it reproduces human behavior in suitably designed double dissociation tasks, we should treat the AI as conscious. (shrink)

1. 1.1. Suffering is bad. This is why, ceteris paribus, there are strong moral reasons to prevent suffering. Moreover, typically, those moral reasons are stronger when the amount of suffering at st...

Virtue ethics has many times been suggested as a promising recipe for the construction of artificial moral agents due to its emphasis on moral character and learning. However, given the complex nature of the theory, hardly any work has de facto attempted to implement the core tenets of virtue ethics in moral machines. The main goal of this paper is to demonstrate how virtue ethics can be taken all the way from theory to machine implementation. To achieve this goal, we (...) critically explore the possibilities and challenges for virtue ethics from a computational perspective. Drawing on previous conceptual and technical work, we outline a version of artificial virtue based on moral functionalism, connectionist bottom–up learning, and eudaimonic reward. We then describe how core features of the outlined theory can be interpreted in terms of functionality, which in turn informs the design of components necessary for virtuous cognition. Finally, we present a comprehensive framework for the technical development of artificial virtuous agents and discuss how they can be implemented in moral environments. (shrink)

It is widely agreed that possession of consciousness contributes to an entity’s moral status, even if it is not necessary for moral status (Levy and Savulescu 2009). An entity is considered to have...

Recent advancements in artificial intelligence have fueled widespread academic discourse on the ethics of AI within and across a diverse set of disciplines. One notable subfield of AI ethics is machine ethics, which seeks to implement ethical considerations into AI systems. However, since different research efforts within machine ethics have discipline-specific concepts, practices, and goals, the resulting body of work is pestered with conflict and confusion as opposed to fruitful synergies. The aim of this paper is to explore ways to (...) alleviate these issues, both on a practical and theoretical level of analysis. First, we describe two approaches to machine ethics: the philosophical approach and the engineering approach and show how tensions between the two arise due to discipline specific practices and aims. Using the concept of disciplinary capture, we then discuss potential promises and pitfalls to cross-disciplinary collaboration. Drawing on recent work in philosophy of science, we finally describe how metacognitive scaffolds can be used to avoid epistemological obstacles and foster innovative collaboration in AI ethics in general and machine ethics in particular. (shrink)

Implementationalism maintains that conventional, silicon-based artificial systems are not conscious because they fail to satisfy certain substantive constraints on computational implementation. In this article, we argue that several recently proposed substantive constraints are implausible, or at least are not well-supported, insofar as they conflate intuitions about computational implementation generally and consciousness specifically. We argue instead that the mechanistic account of computation can explain several of the intuitions driving implementationalism and noncomputationalism in a manner which is consistent with artificial consciousness. Our (...) argument provides indirect support for computationalism about consciousness and the view that conventional artificial systems can be conscious. (shrink)

The convergence of human and artificial intelligence is currently receiving considerable scholarly attention. Much debate about the resulting _Hybrid Minds_ focuses on the integration of artificial intelligence into the human brain through intelligent brain-computer interfaces as they enter clinical use. In this contribution we discuss a complementary development: the integration of a functional in vitro network of human neurons into an _in silico_ computing environment. To do so, we draw on a recent experiment reporting the creation of silico-biological intelligence as (...) a case study (Kagan et al., 2022b ). In this experiment, multielectrode arrays were plated with stem cell-derived human neurons, creating a system which the authors call _DishBrain_. By embedding the system into a virtual game-world, neural clusters were able to receive electrical input signals from the game-world and to respond appropriately with output signals from pre-assigned motor regions. Using this design, the authors demonstrate how the _DishBrain_ self-organises and successfully learns to play the computer game ‘Pong’, exhibiting ‘sentient’ and intelligent behaviour in its virtual environment. The creation of such hybrid, silico-biological intelligence raises numerous ethical challenges. Following the neuroscientific framework embraced by the authors themselves, we discuss the arising ethical challenges in the context of Karl Friston’s Free Energy Principle, focusing on the risk of creating synthetic phenomenology. Following the _DishBrain’s_ creator’s neuroscientific assumptions, we highlight how DishBrain’s design may risk bringing about artificial suffering and argue for a congruently cautious approach to such synthetic biological intelligence. (shrink)

In questo lavoro distinguo tra due versioni della tesi del carattere incarnato della mente: “debole” e “forte”. Secondo la versione debole, il possesso di stati mentali presuppone l’esistenza di un corpo che si muove ed agisce nell’ambiente, ossia un corpo funzionale. Secondo la versione forte, invece, il possesso di stati mentali presuppone l’esistenza di un corpo non solo funzionale ma anche senziente, ossia: il corpo come sede della sensibilità o coscienza fenomenica. Sostengo che alcuni approcci all’interno della “scienza cognitiva incarnata” (...) implicano la forma debole di embodiment : la robotica di Brooks, l’enattivismo sensomotorio di Noë e O’Regan e l’enattivismo radicale di Hutto e Myin. In contrapposizione a queste prospettive, e basandomi sull’analisi fenomenologica della corporeità vivente e vissuta, difendo la forma forte di embodiment, secondo cui la mente si fonda essenzialmente sul corpo funzionale e senziente. Parole chiave: Fenomenologia; Embodiment; Coscienza fenomenica; Enattivismo; Qualità sensibili -/- Abstract (english) -/- Functional body and sentient body. The strong view on the embodied mind in phenomenology: In this paper, I draw a distinction between weak and strong versions of the “embodiment thesis”. The weak version claims that mental states are grounded in a body that moves and acts in the environment, i.e., a functional body. The strong version claims that mental states are grounded in a body that is not only functional but also sentient, i.e., a body that is the locus of sensibility or phenomenal consciousness. I argue that some approaches within the “new embodied cognitive science” – Brooks’ robotics, Noë’s and O’Regan’s sensorimotor enactivism, Hutto’s and Myin’s radical enactivism – imply a weak version of the embodiment thesis. In contrast, by drawing on a phenomenological analysis of living and lived corporeality, I argue for the strong version, which claims that the mind is essentially grounded in the functional and sentient body. Keywords: Phenomenology; Embodiment; Phenomenal Consciousness; Enactivism; Sensible Qualities. (shrink)

En el presente artículo hacemos una revisión del método neurofenomenólogico de Thomas Metzinger y su capacidad para responder a problemas habituales de filosofía de la mente y evitar dificultades de otros materialismos. Metzinger define estados mentales en función de estados cerebrales, sin embargo, frente al materialismo eliminativo, sí considera como real la experiencia fenoménica y rechaza su reducción conceptual o epistémica. Esta peculiaridad salva su propuesta de críticas como la de José Ignacio Murillo o Graham Harman, que parecen dirigidas a (...) otros tipos de materialismos. Por ello, consideramos necesario repensar las consecuencias éticas de la tajante negación del libre albedrío y la afirmación de la posibilidad de máquinas artificiales conscientes que conlleva la propuesta de Metzinger. (shrink)

In a paper published in 2021, Thomas Metzinger proposed a global moratorium on development of synthetic phenomenology, with this beginning in 2021 and lasting until 2050, arguing that the development of conscious artifacts would bring about an explosion of human-like suffering on a global scale. The paper argues that Thomas Metzinger’s call for a global moratorium is unsound as it is currently formulated. Metzinger’s argument is based on a category error, a common mistake in AI discussions. For the sake of (...) clarity in AI discourse, and for reasons explained in the paper, such an error should be at least pointed out, if not corrected. This is the primary purpose of the paper. However, Metzinger’s proposal, can be taken as a generic warning against uncontrolled development of AI – the position we fully agree with. (shrink)

The scientific study of consciousness, also referred to as consciousness science, is a young scientific field devoted to understanding how conscious experiences and the brain relate. It comprises a host of theories, experiments, and analyses that aim to investigate the problem of consciousness empirically, theoretically, and conceptually. This thesis addresses some of the questions that arise in these investigations from a formal and mathematical perspective. These questions concern theories of consciousness, experimental paradigms, methodology, and artificial consciousness. -/- Regarding theories of (...) consciousness, the thesis contributes to the understanding of the mathematical structure that some of the formal theories in the field propose. The work presented here targets the theory of consciousness known as Integrated Information Theory (IIT) and the neuroscientific theory known as Predictive Processing Theory or Free Energy Principle in its Active Inference form (AI-PP). The thesis provides axiomatic definitions of the mathematical structures that constitute these theories, and uses these definitions to address some of the open questions surrounding the theories. For AI-PP, this includes a rigorous derivation of the formula for Active Inference via Free Energy minimisation and a proof of compositionality of Free Energy. For IIT, this includes resolutions of some of the criticisms of IIT's formal scope and applications, but also the identification of new issues that concern the formalism and its derivation. When possible, the definitions are provided in the mathematical framework of category theory. -/- Regarding experiments, the thesis addresses the main paradigm for testing and falsifying theories of consciousness currently applied in the field. This paradigm consists of comparing the conscious experience that a theory predicts with the conscious experience that is inferred from behavioural data or report by use of measures of consciousness. The thesis provides a formal model of this paradigm and shows that under a certain condition—if inference and prediction are independent—, any minimally informative theory of consciousness can always be falsified. This is deeply problematic since the field’s reliance on report or behaviour to infer conscious experiences, in conjunction with the general structure of most contemporary theories of consciousness, implies such independence. This observation provides the exact formal underpinning of the well-known unfolding argument. The thesis analyses the origin of the problem and identifies precisely which changes are required to avoid this problem in future research. The thesis furthermore shows that the problem of falsifying theories of consciousness, and of empirical comparisons of theories of consciousness more generally, follows from a pervasive closure paradigm in consciousness science, that consists of taking a neuroscientific account of the brain as input to a theory of consciousness, so as to explain what consciousness is, without allowing for modifications or adaptations of the neuroscientific account that would accommodate consciousness as part of the brain's functioning. As is shown in the thesis, this paradigm has implications that point to a fundamental need of revision. -/- Regarding methodological and conceptual questions, the thesis contributes to the foundations of structural research in consciousness science. Structural research aims to use mathematical structures or mathematical spaces, instead of verbal descriptions or simple categorisations, to represent conscious experiences scientifically, for example when building theories of consciousness, or when exploring new empirical avenues to measure consciousness. Despite considerable advances in this realm, there was, prior to this thesis, no explicit definition of what a mathematical structure of conscious experience should be; that is, how the attribution of mathematical structure to conscious experiences should be systematically understood. Perhaps the most important contribution of this thesis to the field is to propose such a definition. The definition, a structural concept, extends existing approaches wherever available, and provides a basis for developing a common formal language to study consciousness, bridging developments as far apart as psychophysics and phenomenology. In addition, and independently of this proposal, the thesis offers a critical analysis of which metaphysical premises need to be presumed in structural research, whether the use of particular formal tools (such as structure-preserving mappings or homomorphisms) is justified, and how structural theories of consciousness could otherwise be built in the first place. An attempt to expand the results from consciousness to more general problems in philosophy of science is made in the context of the well-known Newman problem. -/- Regarding the question of artificial consciousness—can AI feel?—, the thesis contributes two results that take the form of no-go theorems, as known from physics. The first no-go theorem shows that if consciousness is relevant for the temporal evolution of a system's states—if it is dynamically relevant—, then contemporary AI systems cannot be conscious. That is because AI systems run on CPUs, GPUs, TPUs or other processors which have been designed and verified to adhere to computational dynamics that systematically preclude or suppress deviations. The second no-go theorem is situated in the context of computational functionalism, a view which posits that consciousness is a computation. The theorem shows that if computational functionalism holds true, consciousness cannot be a Turing computation. Rather, it must be a novel type of computation that has recently been proposed by Geoffrey Hinton, called mortal computation. -/- This thesis is part of a global effort to pioneer a mathematical perspective in consciousness science, now called Mathematical Consciousness Science. The hope behind the research carried out in this PhD is to illustrate the power and usefulness of mathematical approaches in different areas of consciousness science, and in doing so, to lay the foundations for future mathematical work that complements and supports empirical and theoretical work in the further development of this exciting field. (shrink)

The recent remarkable success of generative AI models to create text and images has already started altering our perspective of intelligence and the “uniqueness” of humanity in this world. Simultaneously, arguments on why AI will never exceed human intelligence are ever-present as seen in Landgrebe and Smith (2022). To address whether machines may rule the world after all, this paper zooms in on one of the aspects of intelligence Landgrebe and Smith (2022) neglected to consider: creativity. Using Rhodes four Ps (...) of creativity as a starting point, this paper evaluates the creative ability in visual generative AI models with respect to the state of the art in creativity theory. The most part of the reflective evaluation is performed through a case study in generating illustrations of dogs using the generative AI tool Midjourney. (shrink)

Computational functionalism posits that consciousness is a computation. Here we show, perhaps surprisingly, that it cannot be a Turing computation. Rather, computational functionalism implies that consciousness is a novel type of computation that has recently been proposed by Geoffrey Hinton, called mortal computation.