We are living in an algorithmic age where mathematics and computer science are coming together in powerful new ways to influence, shape and guide our behaviour and the governance of our societies. As these algorithmic governance structures proliferate, it is vital that we ensure their effectiveness and legitimacy. That is, we need to ensure that they are an effective means for achieving a legitimate policy goal that are also procedurally fair, open and unbiased. But how can we ensure that algorithmic (...) governance structures are both? This article shares the results of a collective intelligence workshop that addressed exactly this question. The workshop brought together a multidisciplinary group of scholars to consider barriers to legitimate and effective algorithmic governance and the research methods needed to address the nature and impact of specific barriers. An interactive management workshop technique was used to harness the collective intelligence of this multidisciplinary group. This method enabled participants to produce a framework and research agenda for those who are concerned about algorithmic governance. We outline this research agenda below, providing a detailed map of key research themes, questions and methods that our workshop felt ought to be pursued. This builds upon existing work on research agendas for critical algorithm studies in a unique way through the method of collective intelligence. (shrink)

The idea that humans should abandon their individuality and use technology to bind themselves together into hivemind societies seems both farfetched and frightening – something that is redolent of the worst dystopias from science fiction. In this article, we argue that these common reactions to the ideal of a hivemind society are mistaken. The idea that humans could form hiveminds is sufficiently plausible for its axiological consequences to be taken seriously. Furthermore, far from being a dystopian nightmare, the hivemind society (...) could be desirable and could enable a form of sentient flourishing. Consequently, we should not be so quick to deny it. We provide two arguments in support of this claim – the axiological openness argument and the desirability argument – and then defend it against three major objections. (shrink)

Human obsolescence is imminent. We are living through an era in which our activity is becoming less and less relevant to our well-being and to the fate of our planet. This trend toward increased obsolescence is likely to continue in the future, and we must do our best to prepare ourselves and our societies for this reality. Far from being a cause for despair, this is in fact an opportunity for optimism. Harnessed in the right way, the technology that hastens (...) our obsolescence can open us up to new utopian possibilities and enable heightened forms of human flourishing. (shrink)

Purpose This paper aims to formalize long-term trajectories of human civilization as a scientific and ethical field of study. The long-term trajectory of human civilization can be defined as the path that human civilization takes during the entire future time period in which human civilization could continue to exist. -/- Design/methodology/approach This paper focuses on four types of trajectories: status quo trajectories, in which human civilization persists in a state broadly similar to its current state into the distant future; catastrophe (...) trajectories, in which one or more events cause significant harm to human civilization; technological transformation trajectories, in which radical technological breakthroughs put human civilization on a fundamentally different course; and astronomical trajectories, in which human civilization expands beyond its home planet and into the accessible portions of the cosmos. -/- Findings Status quo trajectories appear unlikely to persist into the distant future, especially in light of long-term astronomical processes. Several catastrophe, technological transformation and astronomical trajectories appear possible. -/- Originality/value Some current actions may be able to affect the long-term trajectory. Whether these actions should be pursued depends on a mix of empirical and ethical factors. For some ethical frameworks, these actions may be especially important to pursue. (shrink)

In the recent and not-too-distant past many of our parents, grandparents and forbears believed that a person’s skin colour and physiognomy, gender, or sexuality licensed them being regarded and treated in ways that are now widely recognised as blatantly unjust, disrespectful, cruel and brutal. But the nineteenth, twentieth, and twenty-first centuries have hosted a series of radical changes in attitudes, beliefs, behaviour and institutionalised practices with regard to the fundamental moral equality of what were once seen as different “kinds of (...) people.” This paper explores the social structure of such “moral revolutions,” via the Wittgensteinian- and Kuhnian- inspired concepts moral perception, moral certainty, normal morality, and moral paradigm. (shrink)

In the value sensitive design literature, there has been little attention for how values may change during the adoption and use of a sociotechnical system, and what that implies for design. A value change taxonomy is proposed, as well as a number of technical features that allow dealing with value change.

The question of whether AI systems such as robots can or should be afforded moral agency or patiency is not one amenable either to discovery or simple reasoning, because we as societies constantly reconstruct our artefacts, including our ethical systems. Consequently, the place of AI systems in society is a matter of normative, not descriptive ethics. Here I start from a functionalist assumption, that ethics is the set of behaviour that maintains a society. This assumption allows me to exploit the (...) theoretical biology of sociality and autonomy to explain our moral intuitions. From this grounding I extend to consider possible ethics for maintaining either human- or of artefact-centred societies. I conclude that while constructing AI systems as either moral agents or patients is possible, neither is desirable. In particular, I argue that we are unlikely to construct a coherent ethics in which it it is ethical to afford AI moral subjectivity. We are therefore obliged not to build AI we are obliged to. (shrink)

In Norms in the Wild, distinguished philosopher Cristina Bicchieri argues that when it comes to human behavior, social scientists place too much stress on rational deliberation. In fact, she says, many choices occur without much deliberation at all. Two people passing in a corridor automatically negotiate their shared space; cars at an intersection obey traffic signals; we choose clothing based on our instincts for what is considered appropriate. Bicchieri's theory of social norms accounts for these automatic components of coordination, where (...) individuals react automatically to cues that focus their attention on what the norm is in that situation. Social norms thus act as rules for making choices in a social world where people expect others -- often unconsciously -- to follow the same rule. Some norms enable seamless social co-operation, while others are less beneficial to human flourishing.Bicchieri is famous for her interdisciplinary work on game theory and most recently her work on social norms, and Norms in the Wild represents her latest challenge to many of the fundamental assumptions of the social sciences. Bicchieri's work has broad implications not only for understanding human behavior, but for changing it for better outcomes. People have a strongly conditioned preference for following social norms, but that also means that manipulating their expectations can cause major behavioral changes. Bicchieri has been working recently with UNICEF and other NGO's to explore the applicability of her views to issues of human rights around the world. Is it possible to change social expectations around forced marriage, genital mutilations, and public health practices like vaccinations and sanitation? If so, how? What tools might we use? This short book explores how social norms work, and how changing them - changing preferences, beliefs, and especially social expectations - can potentially improve lives all around the world. It will appeal to an unusually broad range of readers including philosophers, psychologists and others in behavioral sciences, and anyone involved in public policy or at NGOs. (shrink)

Much recent philosophical work on social freedom focuses on whether freedom should be understood as non-interference, in the liberal tradition associated with Isaiah Berlin, or as non-domination, in the republican tradition revived by Philip Pettit and Quentin Skinner. We defend a conception of freedom that lies between these two alternatives: freedom as independence. Like republican freedom, it demands the robust absence of relevant constraints on action. Unlike republican, and like liberal freedom, it is not moralized. We show that freedom as (...) independence retains the virtues of its liberal and republican counterparts while shedding their vices. Our aim is to put this conception of freedom more firmly on the map and to offer a novel perspective on the logical space in which different conceptions of freedom are located. (shrink)

This article gives two arguments for believing that our society is unknowingly guilty of serious, large-scale wrongdoing. First is an inductive argument: most other societies, in history and in the world today, have been unknowingly guilty of serious wrongdoing, so ours probably is too. Second is a disjunctive argument: there are a large number of distinct ways in which our practices could turn out to be horribly wrong, so even if no particular hypothesized moral mistake strikes us as very likely, (...) the disjunction of all such mistakes should receive significant credence. The article then discusses what our society should do in light of the likelihood that we are doing something seriously wrong: we should regard intellectual progress, of the sort that will allow us to find and correct our moral mistakes as soon as possible, as an urgent moral priority rather than as a mere luxury; and we should also consider it important to save resources and cultivate flexibility, so that when the time comes to change our policies we will be able to do so quickly and smoothly. (shrink)

This work deals with all aspects of consequentialism, encompassing utilitarianism, alienation and the demands of morality, restrictive consequentialism, alternative actions, an objectivist's guide to subjective value, recent work on the limits of obligation and more.

Political disintegration is a persistent feature of world history. The Collapse of Complex Societies, though written by an archaeologist, will therefore strike a chord throughout the social sciences. Any explanation of societal collapse carries lessons not just for the study of ancient societies, but for the members of all such societies in both the present and future. Dr. Tainter describes nearly two dozen cases of collapse and reviews more than 2000 years of explanations. He then develops a new and far-reaching (...) theory that accounts for collapse among diverse kinds of societies, evaluating his model and clarifying the processes of disintegration by detailed studies of the Roman, Mayan and Chacoan collapses. (shrink)

Our brains were designed for tribal life, for getting along with a select group of others and for fighting off everyone else. But modern times have forced the world’s tribes into a shared space, resulting in epic clashes of values along with unprecedented opportunities. As the world shrinks, the moral lines that divide us become more salient and more puzzling. We fight over everything from tax codes to gay marriage to global warming, and we wonder where, if at all, we (...) can find our common ground. (shrink)

It is common to cite the child’s “right to an open future” in discussions of how parents and the state may and should treat children. However, the right to an open future can only be useful in these discussions if we have some method for deriving the content of the right. In the paper in which he introduces the right to an open future Joel Feinberg seems to provide such a method: he derives the right from the content of adult (...) autonomy rights. In this paper I argue that his argument fails. If it is to give us guidance about the content of the child’s right to an open future, then the right should be interpreted as a right to a maximally open future. But this strong interpretation is unjustified: the arguments that can be found in Feinberg in favor of the right are invalid, and, in any case, this interpretation has implausible implications. A moderate interpretation of the right to an open future, according to which children have a right to acquire some reasonable range of skills and options, is more plausible. However, if a moderate interpretation is correct, there is not only no argument in Feinberg to support it, there is also no method for deriving the content of the right. Without such a method we have to bring in other moral considerations in order to work out the limits on parental discretion and what children are owed. The right to an open future then does no normative work. (shrink)

We normally take it for granted that other people will live on after we ourselves have died. Even if we do not believe in a personal afterlife in which we survive our own deaths, we assume that there will be a "collective afterlife" in which humanity survives long after we are gone. Samuel Scheffler maintains that this assumption plays a surprising - indeed astonishing - role in our lives.

It is more than a half-century since Nelson Goodman [1955] applied what we call the Reflective Equilibrium model of justification to the problem of justifying induction, and more than three decades since Rawls [1971] and Daniels [1979] applied celebrated extensions of this model to the problem of justifying principles of social justice. The resulting Wide Reflective Equilibrium model (WRE) is generally thought to capture an acceptable way to reconcile inconsistency between an intuitively plausible general principle and an intuitively plausible judgment (...) about a particular case. Recently a different model for reconciling moral inconsistency has emerged: Moral Consistency Reasoning [Campbell and Kumar 2012, 2013a; Kumar and Campbell 2012; Campbell 2009: 86?7; Campbell and Woodrow 2003; Wong 2002]. MCR applies when two moral judgments give opposing assessments of (what appear to be) relevantly similar particular cases. Though WRE and MCR are strikingly different, each arguably captures a rationally acceptable method for reconciling moral inconsistency. Moreover, as will be shown, they function in complementary ways. Are they parts of a more comprehensive model of moral reasoning in the face of inconsistency that would explain the attractions of each? This essay first spells out the relevant differences between the models and then formulates a more general model of moral reasoning in the face of inconsistency. ?1 reviews the emergence of Goodman's model that he offers in the spirit of epistemology naturalized, almost a decade before Quine coined the term [1969a]. ?2 analyses six salient features of WRE to be compared with six contrasting features of MCR in ?3. ?4 presents the general model. (shrink)

The problem of imaginative resistance holds interest for aestheticians, literary theorists, ethicists, philosophers of mind, and epistemologists. We present a somewhat opinionated overview of the philosophical discussion to date. We begin by introducing the phenomenon of imaginative resistance. We then review existing responses to the problem, giving special attention to recent research directions. Finally, we consider the philosophical significance that imaginative resistance has—or, at least, is alleged to have—for issues in moral psychology, theories of cognitive architecture, and modal epistemology.

The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of (...) our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence. (shrink)

This paper shows that moral progress is a substantive and plausible idea. Moral progress in belief involves deepening our grasp of existing moral concepts, while moral progress in practices involves realizing deepened moral understandings in behavior or social institutions. Moral insights could not be assimilated or widely disseminated if they involved devising and applying totally new moral concepts. Thus, it is argued, moral failures of past societies cannot be explained by appeal to ignorance of new moral ideas, but must be (...) understood as resulting from refusals to subject social practices to critical scrutiny. Moral philosophy is not the main vehicle for disseminating morally progressive insights, though it has an important role in processes that lead to moral progress. Yet we have grounds for cautious optimism, since progressive moral insights can be disseminated and can, sometimes, have constructive social effects. (shrink)

Thomas S. Kuhn's classic book is now available with a new index.

Transhumanism is a loosely defined movement that has developed gradually over the past two decades. [1] It promotes an interdisciplinary approach to understanding and evaluating the opportunities for enhancing the human condition and the human organism opened up by the advancement of technology. Attention is given to both present technologies, like genetic engineering and information technology, and anticipated future ones, such as molecular nanotechnology and artificial intelligence.

_"A stimulating history of how the imagination interacted with its sibling psychological faculties—emotion, perception and reason—to shape the history of human mental life."—_The __Wall Street Journal__ To imagine—to see what is not there—is the startling ability that has fueled human development and innovation through the centuries. As a species we stand alone in our remarkable capacity to refashion the world after the picture in our minds. Traversing the realms of science, politics, religion, culture, philosophy, and history, Felipe Fernández-Armesto reveals the (...) thrilling and disquieting tales of our imaginative leaps—from the first _Homo sapiens_ to the present day. Through groundbreaking insights in cognitive science, Fernández-Armesto explores how and why we have ideas in the first place, providing a tantalizing glimpse into who we are and what we might yet accomplish. Unearthing historical evidence, he begins by reconstructing the thoughts of our Paleolithic ancestors to reveal the subtlety and profundity of the thinking of early humans. A masterful paean to the human imagination from a wonderfully elegant thinker, _Out of Our Minds_ shows that bad ideas are often more influential than good ones; that the oldest recoverable thoughts include some of the best; that ideas of Western origin often issued from exchanges with the wider world; and that the pace of innovative thinking is under threat. (shrink)

A common objection to moral enhancement is that it would undermine our moral freedom and that this is a bad thing because moral freedom is a great good. Michael Hauskeller has defended this view on a couple of occasions using an arresting thought experiment called the 'Little Alex' problem. In this paper, I reconstruct the argument Hauskeller derives from this thought experiment and subject it to critical scrutiny. I claim that the argument ultimately fails because (a) it assumes that moral (...) freedom is an intrinsic good when, in fact, it is more likely to be an axiological catalyst; and (b) there are reasons to think that moral enhancement does not undermine moral freedom. (shrink)

Awareness that moral beliefs and practices have changed across time threatens our confidence in our current moral beliefs: if past moral beliefs turned out to be wrong, how can we be sure ours aren't likewise mistaken? In this paper, I set up four desiderata for a successful theory of moral progress: it must allow us to judge that progress has occurred, avoid the image of increasing correspondence towards ahistorical truthmakers, allow for revision in belief, and yet not be disobligating. Rorty's (...) pragmatist account of moral progress delivers on the first three, but at the cost of failing to meet the fourth: it drains moral beliefs of their categorical force. I then outline K.E. Løgstrup’s understanding of the relation between the ‘ethical demand’ and changing, socially mediated norms. While Løgstrup does posit an unchanging ground of normativity - the "ethical demand" to act for the sake of the other whose welfare is in our hands – he also thinks that changing social norms are an indispensable part of ethical life. I argue that Løgstrup's discussion of the ‘refraction’ of the ethical demand through changing social norms provides resources for an account of moral progress that fulfils these four desiderata. (shrink)