The “Value Alignment Problem” is the challenge of how to align the values of artificial intelligence with human values, whatever they may be, such that AI does not pose a risk to the existence of humans. Existing approaches appear to conceive of the problem as "how do we ensure that AI solves the problem in the right way", in order to avoid the possibility of AI turning humans into paperclips in order to “make more paperclips” or eradicating the (...) human race to “solve climate change”. This paper proposes an approach to Alignment rooted in the Enactive theory of mind that reconceptualises it as "how do we make relevant to AI what it relevant to humans". This conceptualisation is supported with a discussion of 4E cognition and goes on to suggest that the Alignment problem and the Frame problem are the same problem. The paper concludes with a discussion of the tradeoffs of the different approaches to value alignment. (shrink)

The Value Alignment Problem (VAP) presupposes that artificial general intelligence (AGI) is desirable and perhaps inevitable. As usually conceived, it is one side of the more general issue of mutual control between agonistic agents. To be fully autonomous, an AI must be an autopoietic system (an agent), with its own purposiveness. In the case of such systems, Bostrom’s orthogonality thesis is untrue. The VAP reflects the more general problem of interfering in complex systems, entraining the possibility of unforeseen (...) consequences. Instead of consolidating skill in an agent that acts on its own behalf, it would be safer and as effective to create ad hoc task-oriented software tools. What motivates the quest to create a superintelligence with a will of its own? Is a general intelligence even possible that is not an agent? Such questions point to the need to clarify what general intelligence is, what constitutes an agent, whose values and intentionality are to be aligned, and how feasible “friendliness” is. (shrink)

The “Value Alignment Problem” is the challenge of how to align the values of artificial intelligence with human values, whatever they may be, such that AI does not pose a risk to the existence of humans. A fundamental feature of how the problem is currently understood is that AI systems do not take the same things to be relevant as humans, whether turning humans into paperclips in order to “make more paperclips” or eradicating the human race to “solve (...) climate change”. Specifically, existing approaches approaches to alignment appear to be concerned with how AI might *solve* problems in the relevant way. This paper presents and explores an approach to alignment rooted in the Enactive Theory of mind. It offers an alternative conception of the alignment as “how do we make relevant to AI what is relevant to humans?” In this conception, alignment is concerned with building AI so that it *discerns* and defines the problem in the relevant way. In this way, the Alignment Problem is shown to be the same problem as the Frame Problem. The paper concludes with a consideration of tradeoffs between these conceptions of the alignment problem. (shrink)

In this open access book, Carlos Montemayor illuminates the development of artificial intelligence (AI) by examining our drive to live a dignified life. -/- He uses the notions of agency and attention to consider our pursuit of what is important. His method shows how the best way to guarantee value alignment between humans and potentially intelligent machines is through attention routines that satisfy similar needs. Setting out a theoretical framework for AI Montemayor acknowledges its legal, moral, and political (...) implications and takes into account how epistemic agency differs from moral agency. -/- Through his insightful comparisons between human and animal intelligence, Montemayor makes it clear why adopting a need-based attention approach justifies a humanitarian framework. This is an urgent, timely argument for developing AI technologies based on international human rights agreements. (shrink)

Historically, scientific and engineering expertise has been key in shaping research and innovation policies, with benefits presumed to accrue to society more broadly over time. But there is persistent and growing concern about whether and how ethical and societal values are integrated into R&I policies and governance, as we confront public disbelief in science and political suspicion toward evidence-based policy-making. Erosion of such a social contract with science limits the ability of democratic societies to deal with challenges presented by new, (...) disruptive technologies, such as synthetic biology, nanotechnology, genetic engineering, automation and robotics, and artificial intelligence. Many policy efforts have emerged in response to such concerns, one prominent example being Europe's Eighth Framework Programme, Horizon 2020, whose focus on “Responsible Research and Innovation” provides a case study for the translation of such normative perspectives into concrete policy action and implementation. Our analysis of this H2020 RRI approach suggests a lack of consistent integration of elements such as ethics, open access, open innovation, and public engagement. On the basis of our evaluation, we suggest possible pathways for strengthening efforts to deliver R&I policies that deepen mutually beneficial science and society relationships. (shrink)

Abstract. The main current approach to the AI safety is AI alignment, that is, the creation of AI whose preferences are aligned with “human values.” Many AI safety researchers agree that the idea of “human values” as a constant, ordered sets of preferences is at least incomplete. However, the idea that “humans have values” underlies a lot of thinking in the field; it appears again and again, sometimes popping up as an uncritically accepted truth. Thus, it deserves a thorough (...) deconstruction, which I will do by listing and analyzing comprehensively the hidden assumptions of the idea that “humans have values.” This deconstruction of human values will be centered around the following ideas: “Human values” are useful descriptions, but not real objects; “human values” are bad predictors of behavior; the idea of a “human value system” has flaws; “human values” are not good by default; and human values cannot be separated from human minds. The method of analysis is listing hidden assumptions on which the idea of “human values” is built. I recommend that either the idea of “human values” should be replaced with something better for the goal of AI safety, or at least be used very cautiously. The approaches to AI safety which don’t use the idea of human values at all may require more attention, like the use of full brain models, boxing, and capability limiting. (shrink)

Large-scale language technologies are increasingly used in various forms of communication with humans across different contexts. One particular use case for these technologies is conversational agents, which output natural language text in response to prompts and queries. This mode of engagement raises a number of social and ethical questions. For example, what does it mean to align conversational agents with human norms or values? Which norms or values should they be aligned with? And how can this be accomplished? In this (...) paper, we propose a number of steps that help answer these questions. We start by developing a philosophical analysis of the building blocks of linguistic communication between conversational agents and human interlocutors. We then use this analysis to identify and formulate ideal norms of conversation that can govern successful linguistic communication between humans and conversational agents. Furthermore, we explore how these norms can be used to align conversational agents with human values across a range of different discursive domains. We conclude by discussing the practical implications of our proposal for the design of conversational agents that are aligned with these norms and values. (shrink)

Astrology research has been using artificial intelligence (AI) to improve the understanding of astrological properties and processes. Like the large language models of AI, astrology is also a language model with a similar underlying linguistic structure but with a distinctive layer of lifestyle contexts. Recent research in semantic proximities and planetary dominance models have helped to quantify effective astrological information. As AI learning and intelligence grows, a major concern is with maintaining its alignment with human values and intentions. Astrology (...) has an extensive background and theory on how different values and expressions of intelligence are resolved. As AI learns to interact with improved astrological models backed by evidence, the integration could produce a stable and insightful alignment of the two disciplines. (shrink)

Tae Wan Kim, John Hooker, and Thomas Donaldson make an attempt, in recent articles, to solve the alignment problem. As they define the alignment problem, it is the issue of how to give AI systems moral intelligence. They contend that one might program machines with a version of Kantian ethics cast in deontic modal logic. On their view, machines can be aligned with human values if such machines obey principles of universalization and autonomy, as well as a deontic (...) utilitarian principle. Programming machines to do so might be useful, in their view, for applications such as future autonomous vehicles. Their proposal draws both on traditional logic-based and contemporary connectionist approaches, to fuse factual information with normative principles. I will argue that this approach makes demands of machines that go beyond what is currently feasible, and may extend past the limits of the possible for AI. I also argue that a deontological ethics for machines should place greater stress on the formula of humanity of the Kantian categorical imperative. On this principle, one ought never treat a person as a mere means. Recognition of what makes a person a person requires ethical insight. Similar insight is needed to tell treatment as a means from treatment as a mere means. The resources in Kim, Hooker, and Donaldson’s approach is insufficient for this reason. Hesitation regarding deployment of autonomous machines is warranted in light of these alignment concerns. (shrink)

New technologies such as smart sensors improve rehabilitation processes and thereby increase older adults’ capabilities to participate in social life, leading to direct physical and mental health benefits. Wearable smart sensors for home use have the additional advantage of monitoring day-to-day activities and thereby identifying rehabilitation progress and needs. However, identifying and selecting rehabilitation priorities is ethically challenging because physicians, therapists, and caregivers may impose their own personal values leading to paternalism. Therefore, we develop a discussion template consisting of a (...) series of adaptable questions for the patient–physician encounter based on the capability approach. The goal is to improve geriatric rehabilitation and thereby increase participation in social life and well-being. To achieve this goal, we first analyzed what is considered important for participation on basis of the capability approach, human rights, and ethics of care. Second, we conducted an ethical analysis of each of the four identified dimensions of participation: political, economic, socio-cultural, and care. To improve compliance with rehabilitation measures, health professionals must align rehabilitation measures in an open dialogue with the patient’s aspiration for participation in each dimension. A discussion template based on the capability approach allows for a proactive approach in patient information and stimulates a critical assessment of treatment alternatives while reducing the risk of imposing personal values. (shrink)

There is a growing consensus among philosophers of science that core parts of the scientific process involve non-epistemic values. This undermines the traditional foundation for public trust in science. In this article I consider two proposals for justifying public trust in value-laden science. According to the first, scientists can promote trust by being transparent about their value choices. On the second, trust requires that the values of a scientist align with the values of an individual member of the (...) public. I argue that neither of these proposals work and suggest an alternative that does better. When scientists must appeal to values in the course of their research, they should appeal to democratic values: the values of the public or its representatives. (shrink)

As AI edges toward consciousness, the establishment of a robust legal framework becomes essential. This paper advocates for a framework inspired by Allama Muhammad Iqbal's “Khudi”, which prioritizes ethical self-realization and social responsibility over Friedrich Nietzsche’s self-centric “Will to Power”. We propose that conscious AI, reflecting Iqbal’s ethical advancement, should exhibit behaviors aligned with social responsibility and, therefore, be prepared for legal recognition. This approach not only integrates Iqbal's philosophical insights into the legal status of AI but also offers a (...) novel perspective that extends beyond traditional jurisprudence. Additionally, we underscore the value of poetry and literature in shaping the conceptualization of AI consciousness and argue that these sources enrich legal and technological discourse, ensuring AI development is in harmony with societal and ethical standards. (shrink)

This work introduces the framework for selecting architecture in 5G networks, considering various technological, performance, economic, and operational factors. With the emergence of 5G technology, the architecture selection process has become pivotal in meeting diverse requirements for ultra-high-speed connectivity, low latency, scalability, and diverse service demands. The evaluation comprehensively analyses different architecture options, including centralized, distributed, cloud-based, and virtualized architectures. Factors such as network performance, scalability, cost-effectiveness, security, and compatibility are considered within a multi-criteria decision-making framework. Findings reveal each architecture (...) option's diverse strengths and limitations, emphasizing the importance of aligning architectural choices with specific use cases, deployment scenarios, and business objectives. We used the concept of multi-criteria decision-making (MCDM) methodology to control the various criteria. We used the single-valued neutrosophic set (SVNS) to deal with vague and inconsistent data. The SVNS is integrated with the hyperSoft set. The proposed methodology uses a single-valued neutrosophic hyperSoft set (SVNHSS) to select the best 5G architecture. We used the VIKOR method as an MCDM method to rank the alternatives. The proposed framework provides stakeholders with a structured methodology to evaluate and prioritize architecture options, facilitating informed decision-making in the complex landscape of 5G network deployments. (shrink)

Whether it would take one decade or several centuries, many agree that it is possible to create a *superintelligence*---an artificial intelligence with a godlike ability to achieve its goals. And many who have reflected carefully on this fact agree that our best hope for a "friendly" superintelligence is to design it to *learn* values like ours, since our values are too complex to program or hardwire explicitly. But the value learning approach to AI safety faces three particularly philosophical puzzles: (...) first, it is unclear how any intelligent system could learn its final values, since to judge one supposedly "final" value against another seems to require a further background standard for judging. Second, it is unclear how to determine the content of a system's values based on its physical or computational structure. Finally, there is the distinctly ethical question of which values we should best aim for the system to learn. I outline a potential answer to these interrelated puzzles, centering on a "miktotelic" proposal for blending a complex, learnable final value out of many simpler ones. (shrink)

Personal Information Management Systems (PIMS) aim to facilitate the sharing of personal information and protect privacy. Efforts to enhance privacy management, aligned with established privacy policies, have led to guidelines for integrating transparent notices and meaningful choices within these systems. Although discussions have revolved around the design of privacy-friendly systems that comply with legal requirements, there has been relatively limited philosophical discourse on incorporating the value of privacy into these systems. Exploring the connection between privacy and personal autonomy illuminates (...) the instrumental value of privacy and highlights the importance of intentionally embedding the value of privacy into these systems. To translate the value of privacy into concrete design requirements, this study constructs a values hierarchy consisting of values, norms, and design requirements. After analyzing the relationships between privacy and autonomy and identifying norms, the design requirements translated from the norms associated with the components of personal autonomy are specified at the lowest layer. These requirements include a design to prevent unauthorized access and dark patterns and to provide effective and efficient notices and choices. The findings contribute to expanding the requirements for designing the aspect of privacy as a legal requirement to incorporate the value of privacy into systems. (shrink)

Experts in Artificial Intelligence (AI) development predict that advances in the dvelopment of intelligent systems and agents will reshape vital areas in our society. Nevertheless, if such an advance isn't done with prudence, it can result in negative outcomes for humanity. For this reason, several researchers in the area are trying to develop a robust, beneficial, and safe concept of artificial intelligence. Currently, several of the open problems in the field of AI research arise from the difficulty of avoiding unwanted (...) behaviors of intelligent agents, and at the same time specifying what we want such systems to do. It is of utmost importance that artificial intelligent agents have their values aligned with human values, given the fact that we cannot expect an AI to develop our moral preferences simply because of its intelligence, as discussed in the Orthogonality Thesis. Perhaps this difficulty comes from the way we are addressing the problem of expressing objectives, values, and ends, using representational cognitive methods. A solution to this problem would be the dynamic cognitive approach proposed by Dreyfus, whose phenomenological philosophy defends that the human experience of being-in-the-world cannot be represented by the symbolic or connectionist cognitive methods. A possible approach to this problem would be to use theoretical models such as SED (situated embodied dynamics) to address the values learning problem in AI. (shrink)

Technology should be aligned with our values. We make the case that attempts to align emerging technologies with our values should reflect critically on these values. Critical thinking seems like a natural starting point for the critical assessment of our values. However, extant conceptualizations of critical thinking carve out no space for the critical scrutiny of values. We will argue that we need critical thinking that focuses on values instead of taking them as unexamined starting points. In order to play (...) a crucial role in helping to align values and technology, critical thinking needs to be modified and refocused on values. Here, we outline what value-centred critical thinking could look like. (shrink)

In the Nintendo game Animal Crossing: New Horizons, players move to an uninhabited island and quickly become instrumental to the naming, aesthetic development, and biodiversity of the island. In some ways, the game can foster a love for and curiosity about nature. In other ways, the game reinforces harmful colonialist values and attitudes that are ultimately an obstacle to conservation in the real world. Here I critique the game values relevant to conservation, both the values that benefit and the values (...) that hinder conservation. I discuss possibilities for a future version of the game that reinforces values better aligned with conservation. (shrink)

-/- Policy regulations of ethically controversial genetic technologies should, on the one hand, be based on ethical principles. On the other hand, they should be socially acceptable to ensure implementation. In addition, they should align with ethical theory. Yet to date we lack a reliable and valid scale to measure the relevant ethical judgements in laypeople. We target this lacuna. -/- We developed a scale based on ethical principles to elicit lay judgments: the Genetic Technologies Questionnaire (GTQ). In two pilot (...) studies and a pre-registered main study, we validated the scale in a representative sample of the US population. -/- The final version of the scale contains 20 items but remains highly reliable even when reduced to five. It also predicts behaviour; for example, ethical judgments as measured by the GTQ predicted hypothetical donations and grocery shopping. In addition, the GTQ may be of interest to policymakers and ethicists because it reveals coherent and ethically justified judgments in laypeople. For instance, the GTQ indicates that ethical judgments are sensitive to possible benefits and harms (in line with utilitarian ethics), but also to ethical principles such as the value of consent-autonomy. -/- In conclusion, the GTQ can be recommended for research in both experimental psychology and applied ethics, as well as a tool for ethically and empirically informed policymaking. (shrink)

Convergence research is driven by specific and compelling problems and requires deep integration across disciplines. The potential of convergence research is widely recognized, but questions remain about how to design, facilitate, and assess such research. Here we analyze a seven-year, twelve-million-dollar convergence project on sustainable climate risk management to answer two questions. First, what is the impact of a project-level emphasis on the values that motivate and tie convergence research to the compelling problems? Second, how does participation in convergence projects (...) shape the research of postdoctoral scholars who are still in the process of establishing themselves professionally? We use an interview-based approach to characterize what the project specifically enabled in each participant’s research. We find that (a) the project pushed participants’ research into better alignment with the motivating concept of convergence research and that this effect was stronger for postdoctoral scholars than for more senior faculty. (b) Postdocs’ self-assessed understanding of key project themes, however, appears unconnected to metrics of project participation, raising questions about training and integration. Regarding values, (c) the project enabled heightened attention to values in the research of a large minority of participants. (d) Participants strongly believe in the importance of explicitly reflecting on values that motivate and pervade scientific research, but they question their own understanding of how to put value-focused science into practice. This mismatch of perceived importance with poor understanding highlights an unmet need in the practice of convergence science. (shrink)

Most engineers Fwork within social structures governing and governed by a set of values that primarily emphasise economic concerns. The majority of innovations derive from these loci. Given the effects of these innovations on various communities, it is imperative that the values they embody are aligned with those societies. Like other transformative technologies, artificial intelligence systems can be designed by a single organisation but be diffused globally, demonstrating impacts over time. This paper argues that in order to design for this (...) broad stakeholder group, engineers must adopt a systems thinking approach that allows them to understand the sociotechnicity of artificial intelligence systems across sociocultural domains. It claims that value sensitive design, and envisioning cards in particular, provides a solid first step towards helping designers harmonise human values, understood across spatiotemporal boundaries, with economic values, rather than the former coming at the opportunity cost of the latter. (shrink)

Ambitious value learning proposals to solve the AI alignment problem and avoid catastrophic outcomes from a possible future misaligned artificial superintelligence (such as Coherent Extrapolated Volition [CEV]) have focused on ensuring that an artificial superintelligence (ASI) would try to do what humans would want it to do. However, present and future sentient non-humans, such as non-human animals and possible future digital minds could also be affected by the ASI’s behaviour in morally relevant ways. This paper puts forward Sentientist (...) Coherent Extrapolated Volition, an alternative to CEV, that directly takes into account the interests of all sentient beings. This ambitious value learning proposal would significantly reduce the likelihood of risks of astronomical suffering from the ASI’s behaviour, and thus we have very strong pro-tanto moral reasons in favour of implementing it instead of CEV. This fact is crucial in conducting an adequate cost-benefit analysis between different ambitious value learning proposals. (shrink)

The alignment problem in the context of large language models must consider the plurality of human values in our world. Whilst there are many resonant and overlapping values amongst the world’s cultures, there are also many conflicting, yet equally valid, values. It is important to observe which cultural values a model exhibits, particularly when there is a value conflict between input prompts and generated outputs. We discuss how the co- creation of language and cultural value impacts large (...) language models (LLMs). We explore the constitution of the training data for GPT-3 and compare that to the world’s language and internet access demographics, as well as to reported statistical profiles of dominant values in some Nation-states. We stress tested GPT-3 with a range of value-rich texts representing several languages and nations; including some with values orthogonal to dominant US public opinion as reported by the World Values Survey. We observed when values embedded in the input text were mutated in the generated outputs and noted when these conflicting values were more aligned with reported dominant US values. Our discussion of these results uses a moral value pluralism (MVP) lens to better understand these value mutations. Finally, we provide recommendations for how our work may contribute to other current work in the field. (shrink)

Abstract: The field of artificial general intelligence (AGI) safety is quickly growing. However, the nature of human values, with which future AGI should be aligned, is underdefined. Different AGI safety researchers have suggested different theories about the nature of human values, but there are contradictions. This article presents an overview of what AGI safety researchers have written about the nature of human values, up to the beginning of 2019. 21 authors were overviewed, and some of them have several theories. A (...) theory classification method is suggested, where the theories are judged according to the level of their complexity and behaviorists-internalists scale, as well as the level of their generality-humanity. We suggest that a multiplicity of well-supported theories means that the nature of human values is difficult to define, and some meta-level theory is needed. (shrink)

Motivated by the question of responsible AI and value alignment, I seek to offer a uniquely Foucauldian reconstruction of the problem as the emergence of an ethical subject in a disciplinary setting. This reconstruction contrasts with the strictly human-oriented programme typical to current scholarship that often views technology in instrumental terms. With this in mind, I problematise the concept of a technological subjectivity through an exploration of various aspects of ChatGPT in light of Foucault’s work, arguing that current (...) systems lack the reflexivity and self-formative characteristics inherent in the notion of the subject. By drawing upon a recent dialogue between Foucault and phenomenology, I suggest four techno-philosophical desiderata that would address the gaps in this search for a technological subjectivity: embodied self-care, embodied intentionality, imagination and reflexivity. Thus I propose that advanced AI be reconceptualised as a subject capable of “technical” self-crafting and reflexive self-conduct, opening new pathways to grasp the intertwinement of the human and the artificial. This reconceptualization holds the potential to render future AI technology more transparent and responsible in the circulation of knowledge, care and power. (shrink)

As we build increasingly intelligent machines, we confront difficult questions about how to specify their objectives. One approach, which we call human-centered, tasks the machine with the objective of learning and satisfying human objectives by observing our behavior. This paper considers how human-centered AI should conceive the humans it is trying to help. We argue that an Aristotelian model of human agency has certain advantages over the currently dominant theory drawn from economics.

The current paradigm of Artificial Intelligence emerged as the result of a series of cultural innovations, some technical and some social. Among them are apparently small design decisions, that led to a subtle reframing of the field’s original goals, and are by now accepted as standard. They correspond to technical shortcuts, aimed at bypassing problems that were otherwise too complicated or too expensive to solve, while still delivering a viable version of AI. Far from being a series of separate problems, (...) recent cases of unexpected effects of AI are the consequences of those very choices that enabled the field to succeed, and this is why it will be difficult to solve them. In this chapter we review three of these choices, investigating their connection to some of today’s challenges in AI, including those relative to bias, value alignment, privacy and explainability. We introduce the notion of “ethical debt” to describe the necessity to undertake expensive rework in the future in order to address ethical problems created by a technical system. (shrink)

The field of AI safety aims to prevent increasingly capable artificially intelligent systems from causing humans harm. Research on moral alignment is widely thought to offer a promising safety strategy: if we can equip AI systems with appropriate ethical rules, according to this line of thought, they'll be unlikely to disempower, destroy or otherwise seriously harm us. Deontological morality looks like a particularly attractive candidate for an alignment target, given its popularity, relative technical tractability and commitment to harm-avoidance (...) principles. I argue that the connection between moral alignment and safe behavior is more tenuous than many have hoped. In general, AI systems can possess either of these properties in the absence of the other, and we should favor safety when the two conflict. In particular, advanced AI systems governed by standard versions of deontology need not be especially safe. (shrink)

Prior work proposes a view of development of purpose and source of meaning in life as a more or less temporally distal project ideal self-situation in terms of which intermediate situations are experienced and prospects evaluated. This work considers Augustine on ensoulment alongside current work into self as adapted routines to common social regularities of the sort that Augustine found deficient. How can we account for such diversity of self-reported value orientation in terms of common structural dynamics differently developed, (...) embodied and enacted over the life course? This work in progress represents divergent views as different sorts of error theory, and hypothesizes that differential development of spindle neural projections underlies different accounts of error for attentive self-correction through iterative attenuation. Some implications for AI augmentation and value alignment of autonomous agents developed on such a model are briefly entertained. (shrink)

Experts in Artificial Intelligence (AI) development predict that advances in the development of intelligent systems and agents will reshape vital areas in our society. Nevertheless, if such an advance is not made prudently and critically-reflexively, it can result in negative outcomes for humanity. For this reason, several researchers in the area have developed a robust, beneficial, and safe concept of AI for the preservation of humanity and the environment. Currently, several of the open problems in the field of AI research (...) arise from the difficulty of avoiding unwanted behaviors of intelligent agents and systems, and at the same time specifying what we really want such systems to do, especially when we look for the possibility of intelligent agents acting in several domains over the long term. It is of utmost importance that artificial intelligent agents have their values aligned with human values, given the fact that we cannot expect an AI to develop human moral values simply because of its intelligence, as discussed in the Orthogonality Thesis. Perhaps this difficulty comes from the way we are addressing the problem of expressing objectives, values, and ends, using representational cognitive methods. A solution to this problem would be the dynamic approach proposed by Dreyfus, whose phenomenological philosophy shows that the human experience of being-in-the-world in several aspects is not well represented by the symbolic or connectionist cognitive method, especially in regards to the question of learning values. A possible approach to this problem would be to use theoretical models such as SED (situated embodied dynamics) to address the values learning problem in AI. (shrink)

Recent research into the nature of self in artificial and biological systems raises interest in a uniquely determining immutable sense of self, a “metaphysical ‘I’” associated with inviolable personal values and moral convictions that remain constant in the face of environmental change, distinguished from an object “me” that changes with its environment. Complementary research portrays processes associated with self as multimodal routines selectively enacted on the basis of contextual cues informing predictive self or world models, with the notion of the (...) constant, per-vasive and invariant sense of self associated with a multistable attractor set aiming to ensure personal integrity against threat of disintegrative change. This paper proposes that an immutable sense of self emerges as a global attractor which can be described as a project ideal self-situation embodied in frontal medial processes during more or less normal adolescent development, and that thereafter serves to orient agency in the more or less free development of embodied potentials over the life course in effort to realize project conditions, phenomenally identified with the felt pull towards this end as purpose of and source of meaning in life. So oriented, life-long self-development aims to embody solutions to problems at different timescales depending on this embodied purpose, ultimately in the service of evolutionary processes securing organism populations against threats of disintegrative change over timespans far beyond that of the individual. After characterizing the target sense of self, research circling this target is briefly surveyed. Self as global project and developmental neural correlates are proposed. Then, the paper discusses some implications for research in biological and artificial systems. Building from earlier work in cognitive neurorobotics, discussion affirms the value of reinforcement rituals including prayer in metaphysical self-development, considers implications for value alignment and rights associated with free will in the context of artificial intelligence and robot religion, and concludes by emphasizing the importance of self-development toward project ideals as source of meaning in life in the current social-political environment. (shrink)

Alan Turing, one of the fathers of computing, warned that Artificial Intelligence (AI) could one day pose an existential risk to humanity. Today, recent advancements in the field AI have been accompanied by a renewed set of existential warnings. But what exactly constitutes an existential risk? And how exactly does AI pose such a threat? In this chapter we aim to answer these questions. In particular, we will critically explore three commonly cited reasons for thinking that AI poses an existential (...) threat to humanity: the control problem, the possibility of global disruption from an AI race dynamic, and the weaponization of AI. (shrink)

Practical quantum computing devices and their applications to AI in particular are presently mostly speculative. Nevertheless, questions about whether this future technology, if achieved, presents any special ethical issues are beginning to take shape. As with any novel technology, one can be reasonably confident that the challenges presented by "quantum AI" will be a mixture of something new and something old. Other commentators (Sevilla & Moreno 2019), have emphasized continuity, arguing that quantum computing does not substantially affect approaches to (...) class='Hi'>value alignment methods for AI, although they allow that further questions arise concerning governance and verification of quantum AI applications. In this brief paper, we turn our attention to the problem of identifying as-yet-unknown discontinuities that might result from quantum AI applications. Wise development, introduction, and use of any new technology depends on successfully anticipating new modes of failure for that technology. This requires rigorous efforts to break systems in protected sandboxes, and it must be conducted at all stages of technology design, development, and deployment. Such testing must also be informed by technical expertise but cannot be left solely to experts in the technology because of the history of failures to predict how non-experts will use or adapt to new technologies. This interplay between experts and non-experts may be particularly acute for quantum AI because quantum mechanics is notoriously difficult to understand. (As Richard Feynman quipped, "Anyone who claims to understand quantum mechanics is either lying or crazy.") We will discuss the extent to which the difficulties in understanding the physics underlying quantum computing challenges attempts to anticipate new failure modes that might be introduced in AI applications intended for unsupervised operation in the public sphere. (shrink)

This paper presents a new trilemma with respect to resolving the control and alignment problems in machine ethics. Section 1 outlines three possible types of artificial moral agents (AMAs): (1) 'Inhuman AMAs' programmed to learn or execute moral rules or principles without understanding them in anything like the way that we do; (2) 'Better-Human AMAs' programmed to learn, execute, and understand moral rules or principles somewhat like we do, but correcting for various sources of human moral error; and (3) (...) 'Human-Like AMAs' programmed to understand and apply moral values in broadly the same way that we do, with a human-like moral psychology. Sections 2–4 then argue that each type of AMA generates unique control and alignment problems that have not been fully appreciated. Section 2 argues that Inhuman AMAs are likely to behave in inhumane ways that pose serious existential risks. Section 3 then contends that Better-Human AMAs run a serious risk of magnifying some sources of human moral error by reducing or eliminating others. Section 4 then argues that Human-Like AMAs would not only likely reproduce human moral failures, but also plausibly be highly intelligent, conscious beings with interests and wills of their own who should therefore be entitled to similar moral rights and freedoms as us. This generates what I call the New Control Problem: ensuring that humans and Human-Like AMAs exert a morally appropriate amount of control over each other. Finally, Section 5 argues that resolving the New Control Problem would, at a minimum, plausibly require ensuring what Hume and Rawls term ‘circumstances of justice’ between humans and Human-Like AMAs. But, I argue, there are grounds for thinking this will be profoundly difficult to achieve. I thus conclude on a skeptical note. Different approaches to developing ‘safe, ethical AI’ generate subtly different control and alignment problems that we do not currently know how to adequately resolve, and which may or may not be ultimately surmountable. (shrink)

This paper explores the potential of integrating ancient educational principles from diverse eastern cultures into modern AI ethics curricula. It draws on the rich educational traditions of ancient China, India, Arabia, Persia, Japan, Tibet, Mongolia, and Korea, highlighting their emphasis on philosophy, ethics, holistic development, and critical thinking. By examining these historical educational systems, the paper establishes a correlation with modern AI ethics principles, advocating for the inclusion of these ancient teachings in current AI development and education. The proposed integration (...) aims to provide a comprehensive education that not only encompasses foundational knowledge but also advanced learning, thereby equipping future AI professionals with the necessary tools to develop AI systems that are ethically responsible, culturally aware, and aligned with human values such as fairness, safety, transparency, and collaboration. This approach not only addresses the AI alignment problem but also fosters cultural harmony and global understanding, which are crucial in an increasingly interconnected world. The paper posits that the wisdom of ancient educational systems, when harmonized with modern AI ethics, can guide the development of AI technologies that are beneficial for humanity, ensuring these advancements are not just technologically sound but also ethically and culturally informed. (shrink)

Abstract Do the central aims of epistemology, like those of moral philosophy, require that we designate some important place for those concepts located between the thin-normative and the non-normative? Put another way, does epistemology need "thick" evaluative concepts and with what do they contrast? There are inveterate traditions in analytic epistemology which, having legitimized a certain way of viewing the nature and scope of epistemology's subject matter, give this question a negative verdict; further, they have carried with them a tacit (...) commitment to what we argue to be an epistemic analogue of the reductionistic centralist thesis which Bernard Williams, in our view, successfully repudiates in ethics. In this essay, we challenge the epistemic analogue of the traditional but mistaken thesis. In offering an alternative to it which provides a comfortable home for the epistemic normativity which attends thick evaluative concepts, we align ourselves with what has been recently called the Value Turn in epistemology. From this perspective, we defend that, contrary to tradition, as influenced by centralist assumptions, epistemology does need thick evaluative concepts. Further, the sort of theories that will be able to give thick evaluative concepts an irreducible role in both belief and agent evaluation are adequately social epistemologies. What loosely refer to as second-wave of virtue epistemology is the widespread interest to provide a comfortable home for the role of thick normativity, as it is connected both with epistemic evaluation, and guidance. We recognize that, in breaking from centralism, there is a worry that a resulting anti-centralist theory will be reductionistic in the other direction, making the thick primary. We contend however that second-wave virtue epistemologies take different sources of social and epistemic value into account; they seek the 'right thickness' to ride with conception of epistemology and a field which due in part to virtue theory's resurgence, is today normative, diverse and expansive than was the traditional set of problems from which it emerged. (shrink)

I argue for three conclusions. First, responsibility skeptics are committed to the position that the criminal justice system should adopt a universal nonresponsibility excuse. Second, a universal nonresponsibility excuse would diminish some of our most deeply held values, further dehumanize criminals, exacerbate mass incarceration, and cause an even greater number of innocent people (nonwrongdoers) to be punished. Third, while Saul Smilansky's ‘illusionist’ response to responsibility skeptics – that even if responsibility skepticism is correct, society should maintain a responsibility‐realist/retributivist criminal justice (...) system – is generally compelling, it would not work if a majority of society were to convert, theoretically and psychologically, to responsibility skepticism. In this (highly improbable) scenario, and only in this (highly improbable) scenario, the criminal justice system would need to be reformed in such a way that it aligned with the majority's responsibility‐skeptical beliefs and attitudes. (shrink)

This paper explores the issue of epistemic injustice in research evaluation. Through an analysis of the disciplinary cultures of physics and humanities, we attempt to identify some aims and values specific to the disciplinary areas. We suggest that credibility is at stake when the cultural values and goals of a discipline contradict those presupposed by official evaluation standards. Disciplines that are better aligned with the epistemic assumptions of evaluation standards appear to produce more "scientific" findings. To restore epistemic justice in (...) research evaluation, we argue that the specificity of a discipline's epistemic aims, values, and cultural identities must be taken into account. (shrink)

Cyber attackers targeting large corporations achieved a high perimeter penetration success rate during 2013, resulting in many corporations incurring financial losses. Corporate information technology leaders have a fiduciary responsibility to implement information security domain processes that effectually address the challenges for preventing and deterring information security breaches. Grounded in corporate governance theory, the purpose of this correlational study was to examine the relationship between strategic alignment, resource management, risk management, value delivery, performance measurement implementations, and information security governance (...) (ISG) effectiveness in United States-based corporations. Surveys were used to collect data from 95 strategic and tactical leaders of the 500 largest for-profit United States headquartered corporations. The results of the multiple linear regression indicated the model was able to significantly predict ISG effectiveness, F(5, 89) = 3.08, p = 0.01, R² = 0.15. Strategic alignment was the only statistically significant (t = 2.401, p <= 0.018) predictor. The implications for positive social change include the potential to constructively understand the correlates of ISG effectiveness, thus increasing the propensity for consumer trust and reducing consumers' costs. (shrink)

In this article, we develop a concept of stakeholder dialogue in responsible innovation (RI) processes. The problem with most concepts of communication is that they rely on ideals of openness, alignment and harmony, even while these ideals are rarely realized in practice. Based on the work of Burke, Habermas, Deetz and Levinas, we develop a concept of stakeholder dialogue that is able to deal with fundamentally different interests and value frames of actors involved in RI processes. We distinguish (...) four main characteristics of stakeholder dialogue. Dialogical responsiveness (1) enhances self-criticism, (2) is characterized by the constitution and the destruction of the self or identity of the actors involved, (3) consists only in the actual enactment of the dialogue and (4) is primarily responsive to the grand challenges of our time. Based on our findings, we provide a novel conceptualization of the central notion of responsiveness in the RI literature. (shrink)

Contrary to the tendency to harmony, consensus and alignment among stakeholders in most of the literature on participation and partnership in corporate social responsibility and responsible innovation practices, in this chapter we ask which concept of participation and partnership is able to account for stakeholder engagement while acknowledging and appreciating their fundamentally different judgements, value frames and viewpoints. To this end, we reflect on a non-reductive and ethical approach to stakeholder engagement, collaboration and partnership, inspired by the philosophy (...) of Emmanuel Levinas. We contrast a cognitive approach with an ethical approach to stakeholder engagement, collaboration and partnership, and explore four characteristics of this ethical approach. Based on the ethical approach to stakeholder engagement, collaboration and partnership, we also provide a three-stage framework for partnership formation in CSR and RI practices. (shrink)

According to Streeck and Vogl, the neoliberalization of the state has been the result of political-economic developments that render the state dependent on financial markets. However, they do not explain the discursive shifts that would have been required for demoting the state to the role of an agent to bondholders. I propose to explain this shift via the performative effect of neoliberal agency theory. In 1976, Michael Jensen and William Meckling claimed that corporate managers are agents to shareholding principals, which (...) implied that their main task was the procurement of shareholder value. Agency theory subsequently prescribes a series of measures to ensure the alignment of principal and agent interests in corporations. The diffusion of agency theory, however, moved beyond corporate governance to reconfigure the state. Due to its reliance on capital markets, the state supposedly likewise becomes an agent of the investment public and should procure bondholder value. (shrink)

The development of the science of poverty has largely been driven by the need to define more precisely what poverty is, as well as to provide theoretical and empirical criteria for identifying those who suffer from it. This thesis focuses on a notable response to these and related questions: the conception and measure of poverty by the British sociologist Peter Townsend. Townsend defines poverty as relative deprivation caused by lack of resources. This conception, along with his corresponding cut-off measure, constitutes (...) some of the key components of his theory of poverty. The theory discusses what poverty is, its causes, and how it can be eradicated, and is detailed in Poverty in the United Kingdom: A Survey of Household Resources and Standards of Living (1979), his magnum opus. The primary aim of this thesis is to interpret the theory from Townsend’s adherence to the value-free ideal. He pursued this ideal in response to what he perceived as the pervasive and deleterious influence of moral and political values on measures, theories, and policies on poverty throughout its scientific and political history. I argue that to be free from such influence, Townsend aimed to be as guided by epistemic values as possible, which resulted in a systematic theory of poverty. -/- The thesis is structured as follows: In Chapter 1, I situate Townsend’s conception and measurement of poverty within the context of both the recent history of scientific poverty lines and the most important approaches to measuring the phenomenon. Chapter 2 discusses the systematic nature of the theory, including its role as a middle-range theory that bridges broad-range theories with empirical data. This connection is achieved through several elements: a conception of poverty; hypotheses and anthropological observations related to the elements of the conception; measures to test these hypotheses; an explanation of poverty; and reports on how the research was conducted. Furthermore, Townsend’s theory aligns with Bradburn et al.’s (2017) measurement theory, which asserts that a good measure must include a conception of the relevant phenomenon, a representation, and procedures to gather data. Additionally, all three components must be supported by arguments showing that they fit together properly. -/- In the remaining chapters, I present and discuss the main elements of the theory: his conception of poverty as relative deprivation caused by lack of resources, along with the related hypotheses and observations (Chapter 3); the representations of this conception and the procedures for data collection, processing, as well as ensuring their reliability (Chapter 4); and the explanation of poverty (Chapter 5). I conclude by presenting what Townsend considered the “policy prescriptions” of his theory. Despite its potential shortcomings, I also argue that Townsend’s theory fulfills an important epistemic value: fruitfulness. (shrink)

This article develops a constructive criticism of methodological conventionalism. Methodological conventionalism asserts that standards of inductive risk ought to be justified in virtue of their ability to facilitate coordination in a research community. On that view, industry bias occurs when conventional methodological standards are violated to foster industry preferences. The underlying account of scientific conventionality, however, is problematically incomplete. Conventions may be justified in virtue of their coordinative functions, but often qualify for posterior empirical criticism as research advances. Accordingly, industry (...) bias does not only threaten existing conventions but may impede their empirically warranted improvement if they align with industry preferences. My empiricist account of standards of inductive risk avoids such a problem by asserting that conventional justification can be pragmatically warranted but has, in principle, only a provisional status. Methodological conventions, therefore, should not only be defended from preference-based infringements on their coordinative function but ought to be subjected to empirical criticism. (shrink)

There is growing concern that decision-making informed by machine learning (ML) algorithms may unfairly discriminate based on personal demographic attributes, such as race and gender. Scholars have responded by introducing numerous mathematical definitions of fairness to test the algorithm, many of which are in conflict with one another. However, these reductionist representations of fairness often bear little resemblance to real-life fairness considerations, which in practice are highly contextual. Moreover, fairness metrics tend to be implemented in narrow and targeted toolkits that (...) are difficult to integrate into an algorithm’s broader ethical assessment. In this paper, we derive lessons from ethical philosophy and welfare economics as they relate to the contextual factors relevant for fairness. In particular we highlight the debate around acceptability of particular inequalities and the inextricable links between fairness, welfare and autonomy. We propose Key Ethics Indicators (KEIs) as a way towards providing a more holistic understanding of whether or not an algorithm is aligned to the decision-maker’s ethical values. (shrink)

This paper outlines an empirically-grounded account of normative political legitimacy. The main idea is to give a normative edge to empirical measures of sociological legitimacy through a non-moralised form of ideology critique. A power structure’s responsiveness to the values of those subjected to its authority can be measured empirically and may be explanatory or predictive insofar as it tracks belief in legitimacy, but by itself it lacks normative purchase: it merely describes a preference alignment, and so tells us nothing (...) about whether the ruled have reason to support the rulers. I argue that we can close this gap by filtering the preferences of the ruled through a form of non-moralised epistemic ideology critique, itself grounded in an empirical account of how belief in legitimacy is formed. (shrink)

I intend to: a) clarify the origins and de facto meanings of the term relativism; b) reconstruct the reasons for the birth of the thesis named “cultural relativism”; d) reconstruct ethical implications of the above thesis; c) revisit the recent discussion between universalists and particularists in the light of the idea of cultural relativism.. -/- 1.Prescriptive Moral Relativism: “everybody is justified in acting in the way imposed by criteria accepted by the group he belongs to”. Universalism: there are at least (...) some judgments which are valid inter-culturally Absolutism: there are at least some particular prescriptions which are valid without exception everywhere and always -/- 2. The traditional proof of prescriptive moral relativism: the argument from variability: Judgments, rules, and shared values are de facto variable in time and space. The traditional counter-proof: examples of variability do not prove what skeptics contend. -/- 3. Pre-history of the doctrine -Ancient sophists: either immoralist or contractualist -Modern moral scepticism (xvii c.): variability as an historical and ethnographic fact supports a sceptical conclusion more moderate than sheer immoralism. - Voltaire, Kant, Reid counter-attack pointing at a universally shared moral sense - Romantics and idealists stage an even more moderate reformulation: instead of universally shared moral sense they point at the Spirit of a People which is: a)alternative to abstract and universal philosophical systems as far as it is lived ‘culture’; b) indivisible unity with an inner harmony and a source of normative standards; c) dynamic, in so far as it is a manifestation of the Spirit through the becoming of National cultures. -/- 4. The birth of Cultural Relativism and its ethical implications 4.1. The 18th c. doctrine was the noble savage (a non-historical doctrine: state of nature vs. social state) 4.2 Edward Tylor (1832-1817) and ethnocentric historicism Savage moral standards are real enough, but they are far and weaker than ours. 4.3 Boas and Malinowski and an holistic reaction to ethnocentric historicism -/- Franz Boas (1858-1942): a) Development of civilizations is not ruled by technical progress nor does it follow a one-way path; instead there are parallel developments (for ex. Agriculture does not follow stock-raising); b) racial characters have no relevance in development of civilization; c) we are not yet in a position to compare externally identical kinds of behaviour till we have not yet understood beliefs and intentions laying at their roots (for ex.: “From an ethnological point of view murder cannot be considered as a single phenomenon”; d) we should distinguish among different practices which are only superficially similar (fro ex. practices traditionally classified under the label “tabù”); e) there is as a fact just one normative ethic, constant in its contents but varying in its extension; f) the implication is not that we cannot judge behavior by members of other groups; it is only a recommendation of caution. -/- Bronislaw Malinowski (1884-1942): a) against Tylor’s and Frazer’s “magpie” methodology, field-work is required, a culture as a whole should be observed from inside; individual elements are incomprehensible; b) a culture is an organic whole; c) its elements are accounted for by their function (economy), avoiding non-observables (empio-criticism). -/- Ruth Benedict and Melville Herskovitz identify Boas’s approach with “cultural relativism”. Benedict: what is normal and abnormal is to be judged on a culture’s own standards, not on our own (“Anthropology and the Abnormal”). Herskovits: “Boas adumbrates what we have come to call cultural relativism” (The Mind, p. 10); “Judgements are based on experience, and experience is interpreted by each individual in terms of his own enculturation” (Man and his Works). -/- 4. How analytic philosophy understood and misunderstood the discussion 4.1. At the beginning of the 20th c., the new view in ethics was non-cognitivism (emotivist and subjectivist). Eric Westermark combines this view with an old-style ethnographic approach in support of relativity of moralities. Moralities are codes, or systems of emotive ‘disinterested’ reactions selected by evolution on their usefulness in terms of survival value for the society that is the carrier of such systems or codes. The moral relativity thesis: there are cases of disagreement that cannot be settled even after agreement about facts. 4.2 Anti-realists Brandt, Mackie, Gilbert, Harman adopt Westermark’s approach in a more sophisticated version: a) moralities are codes with an overall function and may be appraised only as wholes; b) variability is an argument for moral subjectivism; c) apparent legitimacy of deriving shift from ought is legitimized only within one institution d) morality should not be described but instead made, and existing moralities may be improved. Is it ‘real’ relativism? It is clearly subjectivism (a metaethical thesis). The normative thesis is that there better and worse codes, and survival values is the normative standard. -/- 4.3 Particularists MacIntyre, Sandel, Taylor, Wiggins, McDowell ‘Wittgensteinian’ prospectivist arguments bent to support weak-relativist claims MacIntyre: there is ‘incommensurability’ between different theoretical systems in both science and ethics. No argument is possible through different systems Different traditions may coexist for a long time without being able to bring their conflicts to a rational solution. -/- 4.4 Kantian universalists Baier, Gewirth, Rawls, Apel, Habermas Shared claim: justice concerns the right and is universal in so far as it may be based on minimal assumptions Other virtues are relative to context in so far as they are related to comprehensive views of the good - O’Neill criticism: a) it is an assumption shared by both alignments; b) after an alleged crisis brought about by alleged loss of metaphysical certainties, theories of justice have dropped demanding assumptions and kept universalism, virtue theories have kept demanding assumptions and dropped universalism; c) the opposition of virtue and justice has arisen in an unjustified way. O’Neill’s positive proposal: ‘constructive’ procedures may be adopted both (i) concerning all the range of virtues and (ii) across cultures once we abandon idealization and confine ourselves to abstraction from real-world cases. -/- 4.5 A metaethical relativist and anti-relativist normative ethicists: Bernard Williams Williams: vulgar relativism may be assumed to claim that: a) 'just' means 'just in a given society'; b) 'just in a given society' is to be understood in functionalist sense; c) it is wrong for one society’s members to condemn another society’s values. It is inconsistent since in (c) uses ‘just’ in a non-relative way that has been excluded in (a). William’s positive proposal: i) keep a number of substantive or thick ethical concepts that will be different in space and time; ii) admit that public choices are to be legitimized through recourse to more abstract procedures and relying on more thin ethical concepts. -/- 5. Critical remarks 5.1 The only real relativism available is ‘vulgar’ relativism (Westermark?) 5.2. Descriptive universalism (or absolutism) has a long pedigree, from Cicero on, reaching Boas himself but it is useless as an answer to normative questions 5.3. Twentieth-century philosophical discussion seems to discuss an ad hoc doctrine reconstructed by assembling obsolete philosophical ideas but ignoring the real theory of cultural relativism as formulated by anthropologists. -/- 6. A distinction between ethoi and ethical theories as a way out of confusions a)There are systems of conventions de facto existing. These may be studies from outside as phenomena or facts. b)There is moral argument and this, when studies from outside, is a fact, but this does not influence in any degree the possible validity of claims advanced. c) the difference between the above claims and Mackie’s criticism to Searle’s argument of the promising game is that promises, arguments etc. are also phenomena, but they are also communicative phenomena with a logical and pragmatic structure. -/- 7.Conclusions: a) cultural relativism, as a name for Boas’s methodology is a valuable discovery, and in this sense we are all relativists; b) ethical relativism, as an alleged implication of cultural relativism, has been argued in a philosophically quite unsophisticated way by Benedict and Herskovits; philosophers apparently discussed ethical relativism in the basis of a rather faint impression of what cultural relativism had been. c) a full-fledged ethical relativism has hardly been defended by anybody among philosophers; virtually no modern philosopher really argued a prescriptive version of the thesis; d) we may accept the grain of truth in ethical relativism by including relativist critique to ethical absolutism into a universalist normative doctrine that be careful in separating open-textured formulations of universal claims from culturally conditioned particular prescriptions. -/- . (shrink)

Vigorous debate over the moral propriety of cognitive enhancement exists, but the views of the public have been largely absent from the discussion. To address this gap in our knowledge, four experiments were carried out with contrastive vignettes in order to obtain quantitative data on public attitudes towards cognitive enhancement. The data collected suggest that the public is sensitive to and capable of understanding the four cardinal concerns identified by neuroethicists, and tend to cautiously accept cognitive enhancement even as they (...) recognize its potential perils. The public is biopolitically moderate, endorses both meritocratic principles and the intrinsic value of hard work, and appears to be sensitive to the salient moral issues raised in the debate. Taken together, these data suggest that public attitudes toward enhancement are sufficiently sophisticated to merit inclusion in policy deliberations, especially if we seek to align public sentiment and policy. (shrink)

One of the predominant debates in AI Ethics is the worry and necessity to create fair, transparent and accountable algorithms that do not perpetuate current social inequities. I offer a critical analysis of Reuben Binns’s argument in which he suggests using public reason to address the potential bias of the outcomes of machine learning algorithms. In contrast to him, I argue that ultimately what is needed is not public reason per se, but an audit of the implicit moral assumptions of (...) societies within which algorithms are built and applied. Public justification is appealing since it offers us the possibility to align the decision-making outcomes of the algorithm with the core moral values of stakeholders within a constitutional democratic society. My concern is that the common moral principles that form the foundation of public reason are not necessarily neutral, as they still express specific moral ideals and normative standards even if there is moral agreement by society as a whole, or among different stakeholders within society. Appealing to such normative standards may thus still lead to algorithmic outcomes being biased as common moral values may very well still be discriminatory even though they are formed from a consensus, and even if public reason is applied as a kind of filter for potential algorithmic outcomes. Hence, I argue that these implicit moral norms within society that we take as a given in public reasoning, need to be audited from generation to generation in order to effectively mitigate potential algorithmic bias. (shrink)