Many of our daily activities are now made more convenient and efficient by virtual assistants, and the day when they can be designed to instruct us in certain skills, such as those needed to make moral judgements, is not far off. In this paper we ask to what extent it would be ethically acceptable for these so-called virtual assistants for moral enhancement to use subtle strategies, known as “nudges”, to influence our decisions. To achieve our goal, we will first characterise (...) nudges in their standard use and discuss the debate they have generated around their possible manipulative character, establishing three conditions of manipulation. Secondly, we ask whether nudges can occur in moral virtual assistants that are not manipulative. After critically analysing some proposed virtual assistants, we argue in favour of one of them, given that by pursuing an open and neutral moral enhancement, it promotes and respects the autonomy of the person as much as possible. Thirdly, we analyse how nudges could enhance the functioning of such an assistant, and evaluate them in terms of their degree of threat to the subject’s autonomy and their level of transparency. Finally, we consider the possibility of using motivational nudges, which not only help us in the formation of moral judgements but also in our moral behaviour. (shrink)

Algorithmic systems that provide services to people by supporting or replacing human decision-making promise greater convenience in various areas. The opacity of these applications, however, means that it is not clear how much they truly serve their users. A promising way to address the issue of possible undesired biases consists in giving users control by letting them configure a system and aligning its performance with users’ own preferences. However, as the present paper argues, this form of control over an algorithmic (...) system demands an algorithmic literacy that also entails a certain way of making oneself knowable: users must interrogate their own dispositions and see how these can be formalized such that they can be translated into the algorithmic system. This may, however, extend already existing practices through which people are monitored and probed and means that exerting such control requires users to direct a computational mode of thinking at themselves. (shrink)

Persuasive design draws on our basic psychological makeup to build products that make our engagement with them habitual. It uses variable rewards, creates Fear of Missing Out, and leverages social approval to incrementally increase and maintain user engagement. Social media and networking platforms, video games, and slot machines are all examples of persuasive technologies. Recent attention has focused on the dangers of PD: It can deceptively prod users into forming habits that help the company’s bottom line but not the user’s (...) wellbeing. But PD is not inherently immoral. We can take advantage of our psychological biases to make beneficial changes in ways that enhance our agency rather than limit it. Knowing that a tool is persuasively designed is a consideration in favor of using it when we are trying to break bad habits, such as smoking. How are we to conceptually distinguish between ethical and unethical uses of PD? In this paper, I argue that unethical uses of PD betray or erode our trust. Annette Baier offers a moral test for trust: If gaining knowledge about what other parties do with our trust in them would lead us to stop trusting, then that trusting relationship is immoral. I apply this test to the case of PD. Using trust as a litmus test for ferreting out unethical PD has several advantages, one of which is that it reveals how the harm of unethical PD extends beyond the individual to her wider social network. I close the paper by investigating these cascading effects. (shrink)

In this panel, we explore the future of value sensitive design (VSD). The stakes are high. Many in public and private sectors and in civil society are gradually realizing that taking our values seriously implies that we have to ensure that values effectively inform the design of technology which, in turn, shapes people’s lives. Value sensitive design offers a highly developed set of theory, tools, and methods to systematically do so.

The development of personal technologies has recently shifted from devices that seek to capture user attention to those that aim to improve user well-being. Digital wellness technologies use the same attractive qualities of other persuasive apps to motivate users towards behaviors that are personally and socially valuable, such as exercise, wealth-management, and meaningful communication. While these aims are certainly an improvement over the market-driven motivations of earlier technologies, they retain their predecessors’ focus on influencing user behavior as a primary metric (...) of success. Digital wellness technologies are still persuasive technologies, and they do not evade concerns over whether their influence on users is ethically justified. In this paper, we describe several ethical frameworks with which to assess the justification of digital wellness technologies’ influence on users. We propose that while some technologies help users to complete tasks and satisfy immediate preferences, other technologies encourage users to reflect on the values underlying their habits and teach them to evaluate their lives’ competing demands. While the former approach to digital wellness technology is not unethical, we propose that the latter approach is more likely to lead to skillful user engagement with technology. (shrink)

Algorithmic communications pose several challenges to democracy. The three phenomena of filtering, hypernudging, and microtargeting can have the effect of polarizing an electorate and thus undermine the deliberative potential of a democratic society. Algorithms can spread fake news throughout the society, undermining the epistemic potential that broad participation in democracy is meant to offer. They can pose a threat to political equality in that some people may have the means to make use of algorithmic communications and the sophistication to be (...) immune from attempts at manipulation, while other people are vulnerable to manipulation by those who use these means. My concern here is with the danger that algorithmic communications can pose to political equality, which arises because most citizens must make decisions about what and who to support in democratic politics with only a sparse budget of time, money, and energy. Algorithmic communications such as hypernudging and microtargeting can be a threat to democratic participation when persons are operating in environments that do not conduce to political sophistication. This constitutes a deepening of political inequality. The political sophistication necessary to counter this vulnerability is rooted for many in economic life and it can and ought to be enhanced by changing the terms of economic life. (shrink)

This study concerns the sociotechnical bases of human autonomy. Drawing on recent literature on AI ethics, philosophical literature on dimensions of autonomy, and on independent philosophical scrutiny, we first propose a multi-dimensional model of human autonomy and then discuss how AI systems can support or hinder human autonomy. What emerges is a philosophically motivated picture of autonomy and of the normative requirements personal autonomy poses in the context of algorithmic systems. Ranging from consent to data collection and processing, to computational (...) tasks and interface design, to institutional and societal considerations, various aspects related to sociotechnical systems must be accounted for in order to get the full picture of potential effects of AI systems on human autonomy. It is clear how human agents can, for example, via coercion or manipulation, hinder each other’s autonomy, or how they can respect each other’s autonomy. AI systems can promote or hinder human autonomy, but can they literally respect or disrespect a person’s autonomy? We argue for a philosophical view according to which AI systems—while not moral agents or bearers of duties, and unable to literally respect or disrespect—are governed by so-called “ought-to-be norms.” This explains the normativity at stake with AI systems. The responsible people (designers, users, etc.) have duties and ought-to-do norms, which correspond to these ought-to-be norms. (shrink)

This is an interdisciplinary article providing an account of a phenomenon that is quite widespread but has been thus far mostly neglected by scholars: the overuse of digital technologies. Digital overuse can be defined as a usage of digital technologies that subjects perceive as dissatisfactory and non-meaningful a posteriori. DO has often been implicitly conceived as one of the main obstacle to so-called digital well-being. The article is structured in two parts. The first provides a definition of the phenomenon and (...) a brief review of the explanations provided by various disciplines, in particular psychology and the evolutionary and behavioural sciences. Specifically, the article distinguishes between the endogenous and exogenous factors underlying digital overuse, that is between causes that seem to be intrinsic to digital technologies, and design techniques intentionally aimed at nudging users towards this behaviour. The second part is devoted to a discussion of the ethical concerns surrounding the phenomenon of the overuse of digital technologies, and how it may be possible to reduce such overuse among users. (shrink)

The literature on ethics and user attitudes towards AVs discusses user concerns in relation to automation; however, we show that there are additional relevant issues at stake. To assess adolescents’ attitudes regarding the ‘car of the future’ as presented by car manufacturers, we conducted two studies with over 400 participants altogether. We used a mixed methods approach in which we combined qualitative and quantitative methods. In the first study, our respondents appeared to be more concerned about other aspects of AVs (...) than automation. Instead, their most commonly raised concerns were the extensive use of AI, recommender systems, and related issues of autonomy, invasiveness and personal privacy. The second study confirmed that several AV impacts were negatively perceived. The responses were, however, ambivalent. This confirms previous research on AV attitudes. On one hand, the AV features were perceived as useful, while on the other hand, their impacts were negatively assessed. We followed theoretical insights form futures studies and responsible research and innovation, which helped to identify that there are additional user concerns than what has been previously discussed in the literature on public attitudes and ethics of AVs, as well what has been envisioned by car manufactures. (shrink)

In this article, we address the case of self-tracking as a practice in which two meaningful backgrounds (physical world and technological infrastructure) play an important role as the spatial dimension of human practices. Using a (post)phenomenological approach, we show how quantification multiplies backgrounds, while at the same time generating data about the user. As a result, we can no longer speak of a unified background of human activity, but of multiple dimensions of this background, which, additionally, is perceived as having (...) no pivotal role in the process, often being hidden, situated beyond human consciousness, or taken for granted. Consequently, the phenomenological experience of the background turns into a hermeneutic practice focused on the interpretation of representations and descriptions. By adopting a (post)phenomenological approach, we show the problems and limitations of quantification of human activities occurring in self-tracking and the theoretical problems associated with the scheme of human-technology relations. (shrink)

In this paper, I discuss the formation of habits with the help of self-tracking technologies. Although devices like Fitbit smart bands come with promises of empowerment through the means of increased control over users’ habits, existing literature does not provide conclusive findings about the validity of such claims. I contribute to the ongoing debate by relying on John Dewey’s pragmatist philosophy and its notion of intelligent habit. I demonstrate that from a pragmatist standpoint, habits that are the most likely to (...) accomplish users’ goals contribute to their flourishing need to be reflective (accompanied by adequate deliberation) and flexible (adaptable to the changing circumstances). On this basis I highlight some ethical-epistemic issues surrounding self-tracking technologies that inhibit the formation of habits desirable from a Deweyan standpoint. These include a lack of reflection on the part of the developers, difficulties for users to deliberate and consciously shape the habits developed by their devices, and dependence upon self-tracking tools that makes it difficult to adapt habits to individual needs and circumstances. I conclude the paper by discussing self-tracking’s general impact on flourishing, as well as placing my arguments in the context of the diversity of self-tracking practices and identifying how users attempt to alleviate the shortcomings of the technology and make it more suitable to their goals and needs. (shrink)

Consumer-targeted sleep tracking applications (STA) that run on mobile devices (e.g., smartphones) promise to be useful tools for the individual user. Assisted by built-in and/or external sensors, these apps can analyze sleep data and generate assessment reports for the user on their sleep duration and quality. However, STA also raise ethical questions, for example, on the autonomy of the sleeping person, or potential effects on third parties. Nevertheless, a specific ethical analysis of the use of these technologies is still missing (...) so far. The aim of the current analysis is to identify the characteristics of sleep tracking apps and to explore the specific ethical aspects associated with this form of self-tracking. Firstly, the field of mobile health applications was screened for STA to explore their typical functions and target user groups. Secondly, an ethical analysis was conducted focusing on the three ethical dimensions: (1) medicalization, (2) vulnerability, and (3) relationality. The analysis indicates that these three normative dimensions are decisive for assessing STA and that the ethical profile of this technology varies greatly depending on the respective user group. As the three dimensions medicalization, vulnerability, and relationality play a distinguishing role in the use of STA, they should be especially addressed in responsible development and implementation of STA. In addition, the analysis helps to evaluate the use of STA, in terms of different risks for specific user groups, the sensitive contexts of usage, and potential interference with the intimacy of third parties. (shrink)

This paper presents a literature review on the ethics of self-tracking technologies which are utilized by users to monitor parameters related to their activity and bodily parameters. By examining a total of 65 works extracted through a systematic database search and backwards snowballing, the authors of this review discuss three categories of opportunities and ten categories of concerns currently associated with self-tracking. The former include empowerment and well-being, contribution to health goals, and solidarity. The latter are social harms, privacy and (...) surveillance, ownership control and commodification of data, autonomy, data-facilitated harm, datafication and interpretability of data, negative impact on relation to self and others, shortcomings of design, negative impact on health perception, and regulation and enforcement of rules. The review concludes with a critical analysis of the existing literature and an overview of a future research agenda that could complement the current work on ethics of self-tracking. (shrink)

Problem Self-tracking—and of course also health-related self-tracking—has an influence on those who use it. This influence can (but does not necessarily have to) pose a threat to the autonomy of people tracking themselves. Argumentation Self-tracking can easily come into conflict with one of the three conditions for autonomy defined by Beauchamp, Faden, and Childress: voluntariness. Based on a distinction between different forms of manipulative influence—mildly controlling and substantially controlling—I will argue that health-related self-tracking often has a mildly controlling influence but (...) that it can also turn into a substantially controlling manipulative influence and even become coercive. Conclusion Substantially manipulative self-tracking and self-tracking that involves coercion is a violation of the condition of voluntariness set for autonomy. This risk of violating autonomy must be taken into account when assessing health-related self-tracking. (shrink)

Global lockdowns during the COVID-19 pandemic have offered many people first-hand experience of how their daily online activities threaten their digital well-being. This article begins by critically evaluating the current approaches to digital well-being offered by ethicists of technology, NGOs, and social media corporations. My aim is to explain why digital well-being needs to be reimagined within a new conceptual paradigm. After this, I lay the foundations for such an alternative approach, one that shows how current digital well-being initiatives can (...) be designed in more insightful ways. This new conceptual framework aims to transform how philosophers of technology think about this topic, as well as offering social media corporations practical ways to design their technologies in ways that will improve the digital well-being of users. (shrink)

Background Protecting the privacy of research participants is widely recognized as one of the standard ethical requirements for clinical research. It is unknown, however, how research professionals regard concepts of privacy as well as the situations in the research setting that require privacy protections. The aim of this study was to explore the views of research professionals from Arab countries regarding concepts and scope of privacy that occur in clinical research. Methods We adopted an exploratory qualitative approach by the use (...) of focus group discussions. We recruited individuals involved in research from Egypt and Morocco. We analyzed focus group data via a constant comparison approach, which consisted of close reading of the transcribed interviews followed by coding and then determining themes and subthemes. Results Between August 2016 and July 2018, we conducted nine focus group discussions. Respondents discussed several privacy issues that occurred before the research began ; during research, and after the research. Respondents revealed their perspectives of patients towards privacy in the clinical and research settings and mentioned that patients are more likely to permit access to their privacy in the clinical setting compared with research setting due to the existence of benefits and trust in clinical care. Respondents also recommended training regarding data protections for individuals involved in research. Conclusions Our study shows that research professionals discussed a range of privacy issues that are present during the different stages of research. We recommend 1) development of standards regarding privacy protections during recruitment efforts; 2) additional training for individuals involved in research regarding best practices with data security in secondary research; 3) a quantitative study involving investigators and REC members to determine their knowledge, attitudes and practices regarding privacy issues that occur in research; and 4) a quantitative study involving patients to elicit their views regarding their privacy concerns in research. (shrink)

This paper discusses the interpersonal dimension of self-tracking technologies from the standpoint of Dewey’s pragmatist ethics. Users of self-tracking routinely exchange data with others, interact through social features embedded in their tools, and form communities focused on the sharing and discussion of data. I employ Dewey’s notion of transaction to discuss how self-quantification impacts users’ perception of others and how it mediates interpersonal relations. In Dewey’s ethics engagement with others is a fundamental part of moral life and individual flourishing can (...) only be achieved in social contexts and through the extension of care towards other people. The ethical ideals and epistemic concepts present in pragmatism allow me to argue that despite claims that self-tracking technologies lead to the formation of communities, pro-social instincts exist prior to the adoption of the devices and self-tracking actually inhibits the formation of mutually uplifting social bonds. In my discussion, I focus on the degree of epistemic distance that makes genuine engagement with others difficult, limits to transactional agency that prohibits users from deciding how they are perceived by others, and the reductive and instrumental nature of interactions embedded in the social features of self-tracking technologies. Moreover, I also analyse some political aspects of community-formation in the context of self-quantification and criticise the ownership structures of data and infrastructure that limit communities’ political agency. (shrink)

The COVID-19 pandemic has catalysed what may soon become a permanent digital transition in the domains of work, education, medicine, and leisure. This transition has also precipitated a spike in concern regarding our digital well-being. Prominent lobbying groups, such as the Center for Humane Technology, have responded to this concern. In April 2020, the CHT has offered a set of ‘Digital Well-Being Guidelines during the COVID-19 Pandemic.’ These guidelines offer a rule-based approach to digital well-being, one which aims to mitigate (...) the effects of moving much of our lives online. The CHT’s guidelines follow much recent interest in digital well-being in the last decade. Ethicists of technology have recently argued that character-based strategies and redesigning of online architecture have the potential to promote the digital well-being of online technology users. In this article, I evaluate the CHT’s rule-based approach, comparing it with character-based strategies and approaches to redesigning online architecture. I argue that all these approaches have some merit, but that each needs to contribute to an integrated approach to digital well-being in order to surmount the challenges of a post-COVID world in which we may well spend much of our lives online. (shrink)

It is important to design digital infrastructure that can better accommodate multicultural and pluralistic views from its foundations. It is insufficient to look at only the responses and influences of culture on technology without considering how the technology can be adapted in anticipation of, and to support, pluralistic multicultural perspectives in its original design. This goes beyond the simple act of supporting multiple languages and interfaces, but should include the ability of digital and data infrastructure to capture and accommodate pluralistic (...) views, supporting multiple perspectives in the representation and processing of the data itself. In this work, we look at how rethinking the representation of data can allow us to more directly tackle domains that are typically hampered due to intercultural differences, and their inevitable losses in translation, particularly losses of valuable information like context and intention. When we refer to a loss of context and intention, we are referring to the loss of semantic information when practices such as referencing and citation are hard-coded to a particular set of cultural norms. We show that it is possible to expand the way in which we track referential data to capture richer semantic information regarding the contexts and intentions of the creators of this data, and thereby better serve the varied needs of those who consume, study, and refer to such data. We demonstrate this concept through a prototype system for a multicultural digital infrastructure, which we have namedMultiVerse, and discuss its ethical implications from the perspectives of ‘multistability’, Intercultural Information Ethics framework, and poststructuralism. (shrink)

Choice architecture describes the environment in which choices are presented to decision-makers. In recent years, public and private actors have looked at choice architecture with great interest as they seek to influence human behaviour. These actors are typically called choice architects. Increasingly, however, this role of architecting choice is not performed by a human choice architect, but an algorithm or artificial intelligence, powered by a stream of Big Data and infused with an objective it has been programmed to maximise. We (...) call this entity the autonomous choice architect. In this paper, we present an account of why artificial intelligence can fulfil the role of a choice architect and why this creates problems of transparency, responsibility and accountability for nudges. We argue that choice architects, be them autonomous computational systems or human-beings, at a most basic level select, from a range of designs, the design which is most likely to maximise a pre-determined objective. We then proceed to argue that, given the growing demand for targeted, personalised choice architecture and for faster, dynamic reconfigurations of choice architecture, as well as the ever-expanding pool of data from which feedback can be drawn, the role of the human choice architect is increasingly obscured behind algorithmic, artificially intelligent systems. We provide a discussion of the implications of autonomous choice architects, focusing on the importance of the humans who programme these systems, ultimately arguing that despite technological advances, the responsibility of choice architecture and influence remains firmly one human beings must bear. (shrink)

Mobile health applications (‘health apps’) that promise the user to help her with some aspect of her health are very popular: for-profit apps such as MyFitnessPal, Fitbit, or Headspace have tens of millions of users each. For-profit health apps are designed and run as optimization systems. One would expect that these health apps aim to optimize the health of the user, but in reality they aim to optimize user engagement and, in effect, conversion. This is problematic, I argue, because digital (...) health environments that aim to optimize user engagement risk being manipulative. To develop this argument, I first provide a brief analysis of the underlying business models and the resulting designs of the digital environments provided by popular for-profit health apps. In a second step, I present a concept of manipulation that can help analyze digital environments such as health apps. In the last part of the article, I use my concept of manipulation to analyze the manipulative potential of for-profit health apps. Although for-profit health can certainly empower their users, the conditions for empowerment also largely overlap with the conditions for manipulation. As a result, we should be cautious when embracing the empowerment discourse surrounding health apps. An additional aim of this article is to contribute to the rapidly growing literature on digital choice architectures and the ethics of influencing behavior through such choice architectures. I take health apps to be a paradigmatic example of digital choice architectures that give rise to ethical questions, so my analysis of the manipulative potential of health apps can also inform the larger literature on digital choice architectures. (shrink)

Recommendation systems (RSs) predict what the user likes and recommend it to them. While at the onset of RSs, the latter was designed to maximize the recommendation accuracy (i.e., accuracy was their only goal), nowadays many RSs models include diversity in recommendations (which thus is a further goal of RSs). In the computer science community, the introduction of diversity in RSs is justified mainly through economic reasons: diversity increases user satisfaction and, in niche markets, profits.I contend that, first, the economic (...) justification of diversity in RSs risks reducing it to an empirical matter of preference; second, diversity is ethically relevant as it supports two autonomy rights of the user: the right to an open present and the right to be treated as an individual. So far, diversity in RSs has been morally defended only in the case of RSs of news and scholarly content: diversity is held to have a depolarizing effect in a democratic society and the scientific community and make the users more autonomous in their news choices. I provide a justification of diversity in RSs that embraces all kinds of RSs (i.e., a holistic moral defense) and is based on a normative principle founded on the agency of the user, which I call the right to be an exception to predictions. Such a right holds that the proper treatment of a RS user qua agent forbids providing them with recommendations based only on their past or similar users’ choices. (shrink)

As information technologies have become synonymous with progress in modern society, several ethical concerns have surfaced about their societal implications. In the past few decades, information technologies have had a value-laden impact on social evolution. However, there is limited agreement on the responsibility of businesses and innovators concerning the ethical aspects of information technologies. There is a need to understand the role of business incentives and attitudes in driving technological progress and to understand how they steer the ethics discourse on (...) technology. In the information technology industry, there is an observed trivialization of ethics supported by a business driven and technology-centric approach to ethics. This trivialization rests on hardened beliefs, ideologies, and arguments which hint at reduced accountability for business and tend to individualize social responsibility. The phenomenon of ethics trivialization needs to be duly addressed to resolve the tensions between business needs and ethical concerns. This paper has identified from literature and conceptually analyzed the beliefs and ideologies underlying ethics trivialization which undermine ethics in business contexts. The paper has attempted to address the business concerns indicated by this phenomenon as well as highlight the weaknesses of its assumptions, rhetoric, and justifications. The aim of this paper is to systematically present the justifications in favor of and against the practice of ethics trivialization in the information technology domain, thereby highlighting the need to develop frameworks for assessment of ethical responsibility, accountability, and democratization of the value trade-offs involved in the design of technologies. (shrink)