Mark Coeckelbergh (Int J Soc Robot 1:217–221, 2009) argues that robot ethics should investigate what interaction with robots can do to humans rather than focusing on the robot’s moral status. We should ask what robots do to our sociality and whether human–robot interaction can contribute to the human good and human flourishing. This paper extends Coeckelbergh’s call and investigate what it means to live with disembodied AI-powered agents. We address the following question: Can the human–AI interaction contribute to our moral (...) development? We present an empirically informed philosophical analysis of how the AI personal assistant Siri changes its users’ way of life, based on the responses obtained from 20 semi-directive individual interviews with Siri users. We identify changes in the users’ social interaction associated with the adoption of Siri. These changes include: (1) the indirect effect of reducing opportunities of human interaction, (2) the second-order effect of diminished expectations toward each other in a community, and (3) the acquired preference to obtain hassle-free interaction with Siri over human interaction. We examine them in relation to concerns that are voiced in the current debates over the rise of AI, namely the suspicion that humans could become overly reliant on AI (Danaher 2019) and the worry that social AI could impede on moral development (Fröding and Peterson, Ethics Inf Technol 23:207–214, 2012; Li, Ethics Inf Technol 23:543–550, 2021). We analyze the ethical costs that come from these changes in light of virtue ethics and address potential objections along the way. We end by offering directions for thinking about how to live with AI personal assistant while preserving favorable conditions for moral development. (shrink)

This chapter defends the view that manipulated behaviour is explained by an injustice. Injustices that explain manipulated behaviour need not involve agential features such as intentionality. Therefore, technology can manipulate us, even if technological artefacts like robots, intelligent software agents, or other ‘mere tools’ lack agential features such as intentionality. The chapter thus sketches a comprehensive account of manipulated behaviour related to but distinct from existing accounts of manipulative behaviour. It then builds on that account to defend the possibility that (...) we are being manipulated by technology. (shrink)

In this paper we introduce the concept of attentional scaffolds and show the resemblance between social media platforms and slot machines, both functioning as hostile attentional scaffolds. The first section establishes the groundwork for the concept of attentional scaffolds and draws parallels to the mechanics of slot machines, to argue that social media platforms aim to capture users’ attention to maximize engagement through a system of intermittent rewards. The second section shifts focus to the interplay between emotions and attention, revealing (...) how online attentional capture through emotionally triggering stimuli leads to distraction. The final section elucidates the collective implications of scaffolding attention through social media platforms. The examination of phenomena such as emotional contagion and the emergence of group emotions underscores the transition from individual experiences to shared collective outcomes. Employing online moral outrage as a case study, we illustrate how negative emotions serve as scaffolds for individuals’ attention, propagate within social groups, and give rise to collective attitudes. (shrink)

Are we being manipulated online? If so, is being manipulated by online technologies and algorithmic systems notably different from human forms of manipulation? And what is under threat exactly when people are manipulated online? This volume provides philosophical and conceptual depth to debates in digital ethics about online manipulation. The contributions explore the ramifications of our increasingly consequential interactions with online technologies such as online recommender systems, social media, user-friendly design, micro-targeting, default-settings, gamification, and real-time profiling. The authors in this (...) volume address four broad and interconnected themes: • What is the conceptual nature of online manipulation? And how, methodologically, should the concept be defined? • Does online manipulation threaten autonomy, freedom, and meaning in life, and if so, how? • What are the epistemic, affective, and political harms and risks associated with online manipulation? • What are legal and regulatory perspectives on online manipulation? The Philosophy of Online Manipulation brings these various considerations together to offer philosophically robust answers to critical questions concerning our online interactions with one another and with autonomous systems. It will be of interest to researchers and advanced students working in moral philosophy, digital ethics, philosophy of technology, and the ethics of manipulation. (shrink)

This chapter serves as an introduction to the edited collection of the same name, which includes chapters that explore digital well-being from a range of disciplinary perspectives, including philosophy, psychology, economics, health care, and education. The purpose of this introductory chapter is to provide a short primer on the different disciplinary approaches to the study of well-being. To supplement this primer, we also invited key experts from several disciplines—philosophy, psychology, public policy, and health care—to share their thoughts on what they (...) believe are the most important open questions and ethical issues for the multi-disciplinary study of digital well-being. We also introduce and discuss several themes that we believe will be fundamental to the ongoing study of digital well-being: digital gratitude, automated interventions, and sustainable co-well-being. (shrink)

The ubiquity of technology in our lives and its culmination in artificial intelligence raises questions about its role in our moral considerations. In this paper, we address a moral concern in relation to technological systems given their deep integration in our lives. Coeckelbergh develops a social-relational account, suggesting that it can point us toward a dynamic, historicised evaluation of moral concern. While agreeing with Coeckelbergh’s move away from grounding moral concern in the ontological properties of entities, we suggest that it (...) problematically upholds moral relativism. We suggest that the role of power, as described by Arendt and Foucault, is significant in social relations and as curating moral possibilities. This produces a clearer picture of the relations at hand and opens up the possibility that relations may be deemed violent. Violence as such gives us some way of evaluating the morality of a social relation, moving away from Coeckelbergh’s seeming relativism while retaining his emphasis on social–historical moral precedent. (shrink)

In this paper I critically evaluate the value neutrality thesis regarding technology, and find it wanting. I then introduce the various ways in which artifacts can come to influence moral value, and our evaluation of moral situations and actions. Here, following van de Poel and Kroes, I introduce the idea of value sensitive design. Specifically, I show how by virtue of their designed properties, artifacts may come to embody values. Such accounts, however, have several shortcomings. In agreement with Michael Klenk, (...) I raise epistemic and metaphysical issues with respect to designed properties embodying value. The concept of an affordance, borrowed from ecological psychology, provides a more philosophically fruitful grounding to the potential way(s) in which artifacts might embody values. This is due to the way in which it incorporates key insights from perception more generally, and how we go about determining possibilities for action in our environment specifically. The affordance account as it is presented by Klenk, however, is insufficient. I therefore argue that we understand affordances based on whether they are meaningful, and, secondly, that we grade them based on their force. (shrink)

In this paper I critically evaluate the value neutrality thesis regarding technology, and find it wanting. I then introduce the various ways in which artifacts can come to influence moral value, and our evaluation of moral situations and actions. Here, following van de Poel and Kroes, I introduce the idea of value sensitive design. Specifically, I show how by virtue of their designed properties, artifacts may come to embody values. Such accounts, however, have several shortcomings. In agreement with Michael Klenk, (...) I raise epistemic and metaphysical issues with respect to designed properties embodying value. The concept of an affordance, borrowed from ecological psychology, provides a more philosophically fruitful grounding to the potential way in which artifacts might embody values. This is due to the way in which it incorporates key insights from perception more generally, and how we go about determining possibilities for action in our environment specifically. The affordance account as it is presented by Klenk, however, is insufficient. I therefore argue that we understand affordances based on whether they are meaningful, and, secondly, that we grade them based on their force. (shrink)

The development of personal technologies has recently shifted from devices that seek to capture user attention to those that aim to improve user well-being. Digital wellness technologies use the same attractive qualities of other persuasive apps to motivate users towards behaviors that are personally and socially valuable, such as exercise, wealth-management, and meaningful communication. While these aims are certainly an improvement over the market-driven motivations of earlier technologies, they retain their predecessors’ focus on influencing user behavior as a primary metric (...) of success. Digital wellness technologies are still persuasive technologies, and they do not evade concerns over whether their influence on users is ethically justified. In this paper, we describe several ethical frameworks with which to assess the justification of digital wellness technologies’ influence on users. We propose that while some technologies help users to complete tasks and satisfy immediate preferences, other technologies encourage users to reflect on the values underlying their habits and teach them to evaluate their lives’ competing demands. While the former approach to digital wellness technology is not unethical, we propose that the latter approach is more likely to lead to skillful user engagement with technology. (shrink)

Conversational artificial agents and artificially intelligent voice assistants are becoming increasingly popular. Digital virtual assistants such as Siri, or conversational devices such as Amazon Echo or Google Home are permeating everyday life, and are designed to be more and more humanlike in their speech. This study investigates the effect this can have on one’s conformity with an AI assistant. In the 1950s, Solomon Asch’s already demonstrated the power and danger of conformity amongst people. In these classical experiments test persons were (...) asked to answer relatively simple questions, whilst others pretending to be participants tried to convince the test person to give wrong answers. These studies were later replicated with embodied robots, but these physical robots are still rare. In light of our increasing reliance on AI assistants, this study investigates to what extent an individual will conform to a disembodied virtual assistant. We also investigate if there is a difference between a group that interacts with an assistant that communicates through text, one that has a robotic voice and one that has a humanlike voice. The assistant attempts to subtly influence participants’ final responses in a general knowledge quiz, and we measure how often participants change their answer after having been given advice. Results show that participants conformed significantly more often to the assistant with a human voice than the one that communicated through text. (shrink)

Organisations increasingly use digital nudges to influence their workforces’ behaviour without coercion or incentives. This can expose employees to arbitrary domination by infringing on their autonomy through manipulation and indoctrination. Nudges might furthermore give rise to the phenomenon of “organised immaturity.” Adopting a balanced approach between overly optimistic and dystopian standpoints, I propose a framework for determining the moral permissibility of digital nudging in the workplace. In this regard, I argue that not only should organisations provide pre-discursive justification of nudges (...) but they should also ensure that employees can challenge their implementation whenever necessary through legitimation procedures. Building on Rainer Forst’s concept of the right to justification, this article offers a way to combine contract- and deliberation-based theories for addressing questions in business ethics. I further introduce the concept of meta-autonomy as a capacity that employees can acquire to counter threats of arbitrary domination and to mitigate organised immaturity. (shrink)

In this article, we argue that rational persuasion can be a _pro tanto_ wrong and that online platforms possess features that are especially conducive to this wrong. We begin by setting out an account of rational persuasion. This consists of four jointly sufficient conditions for rational persuasion and is intended to capture the core, uncontroversial cases of such persuasion. We then discuss a series of wrong-making features which are present in methods of influence commonly thought of as _pro tanto_ wrong, (...) such as manipulation and paternalism. It is next shown that these wrong-making features are also present in a range of cases that are, by the jointly sufficient conditions already established, rational persuasion, and so some forms of rational persuasion are _pro tanto_ wrong, including in some ways that have not previously been remarked upon. Finally, we demonstrate that online settings possess a number of features that are especially conducive to wrongful rational persuasion. (shrink)

This article presents the first, systematic analysis of the ethical challenges posed by recommender systems through a literature review. The article identifies six areas of concern, and maps them onto a proposed taxonomy of different kinds of ethical impact. The analysis uncovers a gap in the literature: currently user-centred approaches do not consider the interests of a variety of other stakeholders—as opposed to just the receivers of a recommendation—in assessing the ethical impacts of a recommender system.

Artificial intelligence is shaping strategy, activities, interactions, and relationships in business and specifically in marketing. The drawback of the substantial opportunities AI systems and applications provide in marketing are ethical controversies. Building on the literature on AI ethics, the authors systematically scrutinize the ethical challenges of deploying AI in marketing from a multi-stakeholder perspective. By revealing interdependencies and tensions between ethical principles, the authors shed light on the applicability of a purely principled, deontological approach to AI ethics in marketing. To (...) reconcile some of these tensions and account for the AI-for-social-good perspective, the authors make suggestions of how AI in marketing can be leveraged to promote societal and environmental well-being. (shrink)

The primary goal of this essay is to provide a comprehensive overview and analysis of the various relations between material artifacts and the embodied mind. A secondary goal of this essay is to identify some of the trends in the design and use of artifacts. First, based on their functional properties, I identify four categories of artifacts co-opted by the embodied mind, namely (1) embodied artifacts, (2) perceptual artifacts, (3) cognitive artifacts, and (4) affective artifacts. These categories can overlap and (...) so some artifacts are members of more than one category. I also identify some of the techniques (or skills) we use when interacting with artifacts. Identifying these categories of artifacts and techniques allows us to map the landscape of relations between embodied minds and the artifactual world. Second, having identified categories of artifacts and techniques, this essay then outlines some of the trends in the design and use of artifacts, focussing on neuroprosthetics, brain-computer interfaces, and personalisation algorithms nudging their users towards particular epistemic paths of information consumption. (shrink)

The topic of fake news has received increased attention from philosophers since the term became a favorite of politicians (Habgood-Coote 2016; Dentith 2016). Notably missing from the conversation, however, is a discussion of fake news and conspiracy theory media as a market. This paper will take as its starting point the account of noxious markets put forward by Debra Satz (2010), and will argue that there is a pro tanto moral reason to restrict the market for fake news. Specifically, we (...) begin with Satz’s argument that restricting a market may be required when i) that market inhibits citizens from being able to stand in an equal relationship with one another, and ii) this problem cannot be solved without such direct restrictions. Our own argument then proceeds in three parts: first, we argue that the market for fake news fits Satz’s description of a noxious market; second, we argue against explanations of the proliferation of fake news that are couched in terms of “epistemic vice”, and likewise argue against prescribing critical thinking education as a solution to the problem; finally, we conclude that, in the absence of other solutions to mitigate the noxious effects of the fake news market, we have a pro tanto moral reason to impose restrictions on this market. At the end of the paper, we consider one proposal to regulate the fake news market, which involves making social media outlets potentially liable in civil court for damages caused by the fake news hosted on their websites. (shrink)

In this paper, we will re-elaborate the notions of filter bubble and of echo chamber by considering human cognitive systems’ limitations in everyday interactions and how they experience digital technologies. Researchers who applied the concept of filter bubble and echo chambers in empirical investigations see them as forms of algorithmically-caused systems that seclude the users of digital technologies from viewpoints and opinions that oppose theirs. However, a significant majority of empirical research has shown that users do find and interact with (...) opposing views. Furthermore, we argue that the notion of filter bubble overestimates the social impact of digital technologies in explaining social and political developments without considering the not-only-technological circumstances of online behavior and interaction. This provides us with motivation to reconsider this notion’s validity and re-elaborate it in light of existing epistemological theories that deal with the discomfort people experience when dealing with what they do not know. Therefore, we will survey a series of philosophical reflections regarding the epistemic limitations of human cognitive systems. In particular, we will discuss how knowledge and mere belief are phenomenologically indistinguishable and how people’s experience of having their beliefs challenged is cause of epistemic discomfort. We will then go on to argue, in contrast with Pariser’s assumptions, that digital media users might tend to conform to their held viewpoints because of the “immediate” way they experience opposing viewpoints. Since online people experience others and their viewpoints as material features of digital environments, we maintain that this modality of confronting oneself with contrasting opinions prompts users to reinforce their preexisting beliefs and attitudes. (shrink)

This is an interdisciplinary article providing an account of a phenomenon that is quite widespread but has been thus far mostly neglected by scholars: the overuse of digital technologies. Digital overuse can be defined as a usage of digital technologies that subjects perceive as dissatisfactory and non-meaningful a posteriori. DO has often been implicitly conceived as one of the main obstacle to so-called digital well-being. The article is structured in two parts. The first provides a definition of the phenomenon and (...) a brief review of the explanations provided by various disciplines, in particular psychology and the evolutionary and behavioural sciences. Specifically, the article distinguishes between the endogenous and exogenous factors underlying digital overuse, that is between causes that seem to be intrinsic to digital technologies, and design techniques intentionally aimed at nudging users towards this behaviour. The second part is devoted to a discussion of the ethical concerns surrounding the phenomenon of the overuse of digital technologies, and how it may be possible to reduce such overuse among users. (shrink)

Our aim in this paper is to explore two possible directions of interaction between normative folk psychology and decision theory. In one direction, folk psychology plays a regulative role that constrains practical decision‐making. In the other direction, decision theory provides novel tools and norms that shape folk psychology. We argue that these interactions could lead to the emergence of an iterative “decision theoretic spiral," where folk psychology influences decision‐making, decision‐making is studied by decision theory, and decision theory influences folk psychology. (...) Understanding these interactions is important both for the theoretical study of social cognition and decision theory, and also for thinking about how to implement practical interventions into real‐world decision‐making. (shrink)

Global lockdowns during the COVID-19 pandemic have offered many people first-hand experience of how their daily online activities threaten their digital well-being. This article begins by critically evaluating the current approaches to digital well-being offered by ethicists of technology, NGOs, and social media corporations. My aim is to explain why digital well-being needs to be reimagined within a new conceptual paradigm. After this, I lay the foundations for such an alternative approach, one that shows how current digital well-being initiatives can (...) be designed in more insightful ways. This new conceptual framework aims to transform how philosophers of technology think about this topic, as well as offering social media corporations practical ways to design their technologies in ways that will improve the digital well-being of users. (shrink)

The COVID-19 pandemic has catalysed what may soon become a permanent digital transition in the domains of work, education, medicine, and leisure. This transition has also precipitated a spike in concern regarding our digital well-being. Prominent lobbying groups, such as the Center for Humane Technology, have responded to this concern. In April 2020, the CHT has offered a set of ‘Digital Well-Being Guidelines during the COVID-19 Pandemic.’ These guidelines offer a rule-based approach to digital well-being, one which aims to mitigate (...) the effects of moving much of our lives online. The CHT’s guidelines follow much recent interest in digital well-being in the last decade. Ethicists of technology have recently argued that character-based strategies and redesigning of online architecture have the potential to promote the digital well-being of online technology users. In this article, I evaluate the CHT’s rule-based approach, comparing it with character-based strategies and approaches to redesigning online architecture. I argue that all these approaches have some merit, but that each needs to contribute to an integrated approach to digital well-being in order to surmount the challenges of a post-COVID world in which we may well spend much of our lives online. (shrink)

Recommender Systems (RecSys) have been around since the early days of the Internet, helping users navigate the vast ocean of information and the increasingly available options that have been available for us ever since. The range of tasks for which one could use a RecSys is expanding as the technical capabilities grow, with the disruption of Machine Learning representing a tipping point in this domain, as in many others. However, the increase of the technical capabilities of AI-powered RecSys did not (...) come with a thorough consideration of their ethical implications and, despite being a well-established technical domain, the potential impacts of RecSys on their users are still under-assessed. This paper aims at filling this gap in regards to one of the main impacts of RecSys: personal autonomy. We first describe how technology can affect human values and a suitable methodology to identify these effects and mitigate potential harms: Value Sensitive Design (VSD). We use VSD to carry out a conceptual investigation of personal autonomy in the context of a generic RecSys and draw on a nuanced account of procedural autonomy to focus on two components: competence and authenticity. We provide the results of our inquiry as a value hierarchy and apply it to the design of a speculative RecSys as an example. (shrink)

AI as decision support supposedly helps human agents make ‘better’decisions more efficiently. However, research shows that it can, sometimes greatly, influence the decisions of its human users. While there has been a fair amount of research on intended AI influence, there seem to be great gaps within both theoretical and practical studies concerning unintended AI influence. In this paper I aim to address some of these gaps, and hope to shed some light on the ethical and moral concerns that arise (...) with unintended AI influence. I argue that unintended AI influence has important implications for the way we perceive and evaluate human-AI interaction. To make this point approachable from both the theoretical and practical side, and to avoid anthropocentricallyladen ambiguities, I introduce the notion of decision points. Based on this, the main argument of this paper will be presented in two consecutive steps: i) unintended AI influence doesn’t allow for an appropriate determination of decision points-this will be introduced as decision-point-dilemma, and ii) this has important implications for the ascription of responsibility. (shrink)

Social machines are systems formed by material and human elements interacting in a structured way. The use of digital platforms as mediators allows large numbers of humans to participate in such machines, which have interconnected AI and human components operating as a single system capable of highly sophisticated behavior. Under certain conditions, such systems can be understood as autonomous goal-driven agents. Many popular online platforms can be regarded as instances of this class of agent. We argue that autonomous social machines (...) provide a new paradigm for the design of intelligent systems, marking a new phase in AI. After describing the characteristics of goal-driven social machines, we discuss the consequences of their adoption, for the practice of artificial intelligence as well as for its regulation. (shrink)

Autonomous mechanisms have been proposed to regulate certain aspects of society and are already being used to regulate business organisations. We take seriously recent proposals for algorithmic regulation of society, and we identify the existing technologies that can be used to implement them, most of them originally introduced in business contexts. We build on the notion of ‘social machine’ and we connect it to various ongoing trends and ideas, including crowdsourced task-work, social compiler, mechanism design, reputation management systems, and social (...) scoring. After showing how all the building blocks of algorithmic regulation are already well in place, we discuss the possible implications for human autonomy and social order. The main contribution of this paper is to identify convergent social and technical trends that are leading towards social regulation by algorithms, and to discuss the possible social, political, and ethical consequences of taking this path. (shrink)

Traditional medical practices and relationships are changing given the widespread adoption of AI-driven technologies across the various domains of health and healthcare. In many cases, these new technologies are not specific to the field of healthcare. Still, they are existent, ubiquitous, and commercially available systems upskilled to integrate these novel care practices. Given the widespread adoption, coupled with the dramatic changes in practices, new ethical and social issues emerge due to how these systems nudge users into making decisions and changing (...) behaviours. This article discusses how these AI-driven systems pose particular ethical challenges with regards to nudging. To confront these issues, the value sensitive design approach is adopted as a principled methodology that designers can adopt to design these systems to avoid harming and contribute to the social good. The AI for Social Good factors are adopted as the norms constraining maleficence. In contrast, higher-order values specific to AI, such as those from the EU High-Level Expert Group on AI and the United Nations Sustainable Development Goals, are adopted as the values to be promoted as much as possible in design. The use case of Amazon Alexa's Healthcare Skills is used to illustrate this design approach. It provides an exemplar of how designers and engineers can begin to orientate their design programs of these technologies towards the social good. (shrink)

This article presents the first thematic review of the literature on the ethical issues concerning digital well-being. The term ‘digital well-being’ is used to refer to the impact of digital technologies on what it means to live a life that is good for a human being. The review explores the existing literature on the ethics of digital well-being, with the goal of mapping the current debate and identifying open questions for future research. The review identifies major issues related to several (...) key social domains: healthcare, education, governance and social development, and media and entertainment. It also highlights three broader themes: positive computing, personalised human–computer interaction, and autonomy and self-determination. The review argues that three themes will be central to ongoing discussions and research by showing how they can be used to identify open questions related to the ethics of digital well-being. (shrink)

This article presents the first thematic review of the literature on the ethical issues concerning digital well-being. The term ‘digital well-being’ is used to refer to the impact of digital technologies on what it means to live a life that isgood fora human being. The review explores the existing literature on the ethics of digital well-being, with the goal of mapping the current debate and identifying open questions for future research. The review identifies major issues related to several key social (...) domains: healthcare, education, governance and social development, and media and entertainment. It also highlights three broader themes: positive computing, personalised human–computer interaction, and autonomy and self-determination. The review argues that three themes will be central to ongoing discussions and research by showing how they can be used to identify open questions related to the ethics of digital well-being. (shrink)

We explore the question of whether machines can infer information about our psychological traits or mental states by observing samples of our behaviour gathered from our online activities. Ongoing technical advances across a range of research communities indicate that machines are now able to access this information, but the extent to which this is possible and the consequent implications have not been well explored. We begin by highlighting the urgency of asking this question, and then explore its conceptual underpinnings, in (...) order to help emphasise the relevant issues. To answer the question, we review a large number of empirical studies, in which samples of behaviour are used to automatically infer a range of psychological constructs, including affect and emotions, aptitudes and skills, attitudes and orientations (e.g. values and sexual orientation), personality, and disorders and conditions (e.g. depression and addiction). We also present a general perspective that can bring these disparate studies together and allow us to think clearly about their philosophical and ethical implications, such as issues related to consent, privacy, and the use of persuasive technologies for controlling human behaviour. (shrink)

Persuasive design draws on our basic psychological makeup to build products that make our engagement with them habitual. It uses variable rewards, creates Fear of Missing Out, and leverages social approval to incrementally increase and maintain user engagement. Social media and networking platforms, video games, and slot machines are all examples of persuasive technologies. Recent attention has focused on the dangers of PD: It can deceptively prod users into forming habits that help the company’s bottom line but not the user’s (...) wellbeing. But PD is not inherently immoral. We can take advantage of our psychological biases to make beneficial changes in ways that enhance our agency rather than limit it. Knowing that a tool is persuasively designed is a consideration in favor of using it when we are trying to break bad habits, such as smoking. How are we to conceptually distinguish between ethical and unethical uses of PD? In this paper, I argue that unethical uses of PD betray or erode our trust. Annette Baier offers a moral test for trust: If gaining knowledge about what other parties do with our trust in them would lead us to stop trusting, then that trusting relationship is immoral. I apply this test to the case of PD. Using trust as a litmus test for ferreting out unethical PD has several advantages, one of which is that it reveals how the harm of unethical PD extends beyond the individual to her wider social network. I close the paper by investigating these cascading effects. (shrink)

Feasting on a plethora of social media platforms, news aggregators, and online marketplaces, recommender systems (RSs) are spreading pervasively throughout our daily online activities. Over the years, a host of ethical issues have been associated with the diffusion of RSs and the tracking and monitoring of users’ data. Here, we focus on the impact RSs may have on personal autonomy as the most elusive among the often-cited sources of grievance and public outcry. On the grounds of a philosophically nuanced notion (...) of autonomy, we illustrate three specific reasons why RSs may limit or compromise it: the threat of manipulation and deception associated with RSs; the RSs’ power to reshape users’ personal identity; the impact of RSs on knowledge and critical thinking. In our view, however, notwithstanding these legitimate concerns, RSs may effectively help users to navigate an otherwise overwhelming landscape. Our perspective, therefore, is not to be intended as a bulwark to protect the _status quo_ but as an invitation to carefully weigh these aspects in the design of ethically oriented RSs. (shrink)

Ever-increasing numbers of human interactions with intelligent software agents, online and offline, and their increasing ability to influence humans have prompted a surge in attention toward the concept of (online) manipulation. Several scholars have argued that manipulative influence is always hidden. But manipulation is sometimes overt, and when this is acknowledged the distinction between manipulation and other forms of social influence becomes problematic. Therefore, we need a better conceptualisation of manipulation that allows it to be overt and yet clearly distinct (...) from related concepts of social influence. I argue that manipulation is careless influence, show how this account helps to alleviate the shortcomings of the hidden influence view of manipulation, and derive implications for digital ethics. (shrink)

Autonomous mechanisms have been proposed to regulate certain aspects of society and are already being used to regulate business organisations. We take seriously recent proposals for algorithmic regulation of society, and we identify the existing technologies that can be used to implement them, most of them originally introduced in business contexts. We build on the notion of 'social machine' and we connect it to various ongoing trends and ideas, including crowdsourced task-work, social compiler, mechanism design, reputation management systems, and social (...) scoring. After showing how all the building blocks of algorithmic regulation are already well in place, we discuss possible implications for human autonomy and social order. The main contribution of this paper is to identify convergent social and technical trends that are leading towards social regulation by algorithms, and to discuss the possible social, political, and ethical consequences of taking this path. (shrink)