This paper presents an overview of the risks and benefits of Social AI, understood as conversational AI systems that cater to human social needs like romance, companionship, or entertainment. Section 1 of the paper provides a brief history of conversational AI systems and introduces conceptual distinctions to help distinguish varieties of Social AI and pathways to their deployment. Section 2 of the paper adds further context via a brief discussion of anthropomorphism and its relevance to assessment of human-chatbot relationships. Section (...) 3 of the paper provides a survey of potential and in some cases demonstrated harms associated with user interactions with Social AI systems. Finally, Section 4 discusses how the benefits and harms of Social AI can best be addressed, with a primary focus on how frameworks from AI ethics can inform their development. (shrink)

How all philosophical explanations of human consciousness and the fundamental structure of the cosmos are bizarre—and why that’s a good thing Do we live inside a simulated reality or a pocket universe embedded in a larger structure about which we know virtually nothing? Is consciousness a purely physical matter, or might it require something extra, something nonphysical? According to the philosopher Eric Schwitzgebel, it’s hard to say. In The Weirdness of the World, Schwitzgebel argues that the answers to these fundamental (...) questions lie beyond our powers of comprehension. We can be certain only that the truth—whatever it is—is weird. Philosophy, he proposes, can aim to open—to reveal possibilities we had not previously appreciated—or to close, to narrow down to the one correct theory of the phenomenon in question. Schwitzgebel argues for a philosophy that opens. According to Schwitzgebel’s “Universal Bizarreness” thesis, every possible theory of the relation of mind and cosmos defies common sense. According to his complementary “Universal Dubiety” thesis, no general theory of the relationship between mind and cosmos compels rational belief. Might the United States be a conscious organism—a conscious group mind with approximately the intelligence of a rabbit? Might virtually every action we perform cause virtually every possible type of future event, echoing down through the infinite future of an infinite universe? What, if anything, is it like to be a garden snail? Schwitzgebel makes a persuasive case for the thrill of considering the most bizarre philosophical possibilities. (shrink)

If a machine attains consciousness, how could we find out? In this paper, I make three related claims regarding positive tests of machine consciousness. All three claims center on the idea that an AI can be constructed “ad hoc”, that is, with the purpose of satisfying a particular test of consciousness while clearly not being conscious. First, a proposed test of machine consciousness can be legitimate, even if AI can be constructed ad hoc specifically to pass this test. This is (...) underscored by the observation that many, if not all, putative tests of machine consciousness can be passed by non-conscious machines via ad hoc means. Second, we can identify ad hoc AI by taking inspiration from the notion of an ad hoc hypothesis in philosophy of science. Third, given the first and the second claim, the most reliable tests of animal consciousness turn out to be valid and useful positive tests of machine consciousness as well. If a non-ad hoc AI exhibits clusters of cognitive capacities facilitated by consciousness in humans which can be selectively switched off by masking and if it reproduces human behavior in suitably designed double dissociation tasks, we should treat the AI as conscious. (shrink)

Organoids and specifically human cerebral organoids (HCOs) are one of the most relevant novelties in the field of biomedical research. Grown either from embryonic or induced pluripotent stem cells, HCOs can be used as in vitro three-dimensional models, mimicking the developmental process and organization of the developing human brain. Based on that, and despite their current limitations, it cannot be assumed that they will never at any stage of development manifest some rudimentary form of consciousness. In the absence of behavioral (...) indicators of consciousness, the theoretical neurobiology of consciousness being applied to unresponsive brain-injured patients can be considered with respect to HCOs. In clinical neurology, it is difficult to discern a capacity for consciousness in unresponsive brain-injured patients who provide no behavioral indicators of consciousness. In such scenarios, a validated neurobiological theory of consciousness, which tells us what the neural mechanisms of consciousness are, could be used to identify a capacity for consciousness. Like the unresponsive patients that provide a diagnostic difficulty for neurologists, HCOs provide no behavioral indicators of consciousness. Therefore, this article discusses how three prominent neurobiological theories of consciousness apply to human cerebral organoids. From the perspective of the Temporal Circuit Hypothesis, the Global Neuronal Workspace Theory, and the Integrated Information Theory, we discuss what neuronal structures and functions might indicate that cerebral organoids have a neurobiological capacity to be conscious. (shrink)

1. 1.1. Suffering is bad. This is why, ceteris paribus, there are strong moral reasons to prevent suffering. Moreover, typically, those moral reasons are stronger when the amount of suffering at st...

Which animals have conscious experiences? Many different, diverse and unrelated behaviors and cognitive capacities have been proposed as tests of the presence of consciousness in an animal. It is unclear which of these tests, if any, are valid. To remedy this problem, I develop a list consisting of eight desiderata which can be used to assess putative tests of animal consciousness. These desiderata are based either on detailed analogies between consciousness-linked human behavior and non-human behavior, on theories of consciousness or (...) on methods from human consciousness science. If a test or set of tests satisfies more of these desiderata, passing it provides stronger evidence of consciousness. Moreover, one can design future tests of animal consciousness with the intention of satisfying these desiderata to ensure their evidential strength. (shrink)

Consciousness has an important role in ethics: when a being consciously experiences the frustration or satisfaction of its interests, those interests deserve higher moral priority than those of a behaviourally similar but non-conscious being. I consider the relationship between this ethical role and an a posteriori (or “type-B”) materialist solution to the mind-body problem. It is hard to avoid the conclusion that, if type-B materialism is correct, then the reference of the concept of phenomenal consciousness is radically indeterminate between a (...) neuronal-level property that is distinctive to mammals and a high-level functional property that is much more widely shared. This would leave many non-mammalian animals (such as birds, fish, insects and octopuses) with indeterminate moral status. There are ways to manage this radical moral indeterminacy, but all of these ways lead to profoundly troubling consequences. (shrink)

This paper addresses what we consider to be the most pressing challenge for the emerging science of consciousness: the measurement problem of consciousness. That is, by what methods can we determine the presence of and properties of consciousness? Most methods are currently developed through evaluation of the presence of consciousness in humans and here we argue that there are particular problems in application of these methods to nonhuman cases—what we call the indicator validity problem and the extrapolation problem. The first (...) is a problem with the application of indicators developed using the differences between conscious and unconscious processing in humans to the identification of other conscious vs. nonconscious organisms or systems. The second is a problem in extrapolating any indicators developed in humans or other organisms to artificial systems. However, while pressing ethical concerns add urgency to the attribution of consciousness and its attendant moral status to nonhuman animals and intelligent machines, we cannot wait for certainty and we advocate the use of a precautionary principle to avoid causing unintentional harm. We also intend that the considerations and limitations discussed in this paper can be used to further analyze and refine the methods of consciousness science with the hope that one day we may be able to solve the measurement problem of consciousness. (shrink)

There is no agreement on whether any invertebrates are conscious and no agreement on a methodology that could settle the issue. How can the debate move forward? I distinguish three broad types of approach: theory-heavy, theory-neutral and theory-light. Theory-heavy and theory-neutral approaches face serious problems, motivating a middle path: the theory-light approach. At the core of the theory-light approach is a minimal commitment about the relation between phenomenal consciousness and cognition that is compatible with many specific theories of consciousness: the (...) hypothesis that phenomenally conscious perception of a stimulus facilitates, relative to unconscious perception, a cluster of cognitive abilities in relation to that stimulus. This “facilitation hypothesis” can productively guide inquiry into invertebrate consciousness. What is needed? At this stage, not more theory, and not more undirected data gathering. What is needed is a systematic search for consciousness-linked cognitive abilities, their relationships to each other, and their sensitivity to masking. (shrink)

The risk of creating cerebral organoids/assembloids conscious enough to suffer is a recurrent concern in organoid research ethics. On one hand, we should, apparently, avoid discovering how to distinguish between organoids that it would be permissible (non-conscious) and impermissible (conscious) to use in research, since if successful we would create organoids that suffer. On the other, if we do not, the risk persists that research might inadvertently continue to cause organoids to suffer. Moreover, since modeling some brain disorders may require (...) inducing stress in organoids, it is unclear how to eliminate the risk, if we want to develop effective therapies. We are committed to harm avoidance but hamstrung by a presumption that we should avoid research that might tell us clearly when suffering occurs. How can we negotiate this challenge and maximize the therapeutic benefits of cerebral organoid research? The author interrogates the challenge, suggesting a tentative way forward. (shrink)

Creating simulations of the world can be a valuable way to test new ideas, predict the future, and broaden our understanding of a given topic. Presumably, the more similar the simulation is to the real world, the more transferable the knowledge generated in the simulation will be and, therefore, the more useful. As such, there is an incentive to create more advanced and representative simulations of the real world. Simultaneously, there are ethical and practical limitation to what can be done (...) in human and animal research, so creating simulated beings to stand in their place could be a way of advancing research while avoiding some of these issues. However, the value of representativeness implies that there will be an incentive to create simulated beings as similar to real-world humans as possible to better transfer the knowledge gained from that research. This raises important ethical questions related to how we ought to treat advanced simulated beings and consider if they might have autonomy and wellbeing concerns that ought to be respected. As such, the uncertainty and potential of this line of research should be carefully considered before the simulation begins. (shrink)