There is a common problem in artificial intelligence (AI) and information security. In AI, an expert system needs to be able to justify and explain a decision to the user. In information security, experts need to be able to explain to the public why a system is secure. In both cases, an important goal of explanation is to acquire or maintain the users’ trust. In this paper, I investigate the relation between explanation and trust in the context of computing science. (...) This analysis draws on literature study and concept analysis, using elements from system theory as well as actor-network theory. I apply the conceptual framework to both AI and information security, and show the benefit of the framework for both fields by means of examples. The main focus is on expert systems (AI) and electronic voting systems (security). Finally, I discuss consequences of the analysis for ethics in terms of (un)informed consent and dissent, and the associated division of responsibilities. (shrink)

This article joins in and extends the contemporary debate on the right to privacy. We bring together two strands of the contemporary discourse on privacy. While we endorse the prevailing claim that norms of informational privacy protect the autonomy of individual subjects, we supplement it with an argument demonstrating that privacy is an integral element of the dynamics of all social relationships. This latter claim is developed in terms of the social role theory and substantiated by an analysis of the (...) role of privacy in intimate relationships, in professional relationships and in social interactions between strangers in public. We conclude by arguing that it is not always reasonable to assume a conflict between individual privacy on the one hand and society on the other. Legislators and participants in public debate also have to take into account the consequences of limiting privacy on social interaction and the integration of the society. (shrink)

In this essay, a new approach to the ethics of emerging information technology will be presented, called anticipatory technology ethics (ATE). The ethics of emerging technology is the study of ethical issues at the R&D and introduction stage of technology development through anticipation of possible future devices, applications, and social consequences. In the essay, I will first locate emerging technology in the technology development cycle, after which I will consider ethical approaches to emerging technologies, as well as obstacles in developing (...) such approaches. I will argue that any sound approach must centrally include futures studies of technology. I then present ATE and some applications of it to emerging information technologies. In ATE, ethical analysis is performed at three levels, the technology, artifact and application levels, and at each levels distinct types of ethical questions are asked. ATE analyses result in the identification and evaluation of a broad range of ethical issues that can be anticipated in relation to an emerging information technology. This ethical analysis can then be used for ethical recommendations for design or governance. (shrink)

In this contribution we will explore some of the implications of the vision of Ambient Intelligence (AmI) for law and legal philosophy. AmI creates an environment that monitors and anticipates human behaviour with the aim of customised adaptation of the environment to a person’s inferred preferences. Such an environment depends on distributed human and non-human intelligence that raises a host of unsettling questions around causality, subjectivity, agency and (criminal) liability. After discussing the vision of AmI we will present relevant research (...) in the field of philosophy of technology, inspired by the post-phenomenological position taken by Don Ihde and the constructivist realism of Bruno Latour. We will posit the need to conceptualise technological normativity in comparison with legal normativity, claiming that this is necessary to develop democratic accountability for the implications of emerging technologies like AmI. Lastly we will investigate to what extent technological devices and infrastructures can and should be used to achieve compliance with the criminal law, and we will discuss some of the implications of non-human distributed intelligence for criminal liability. (shrink)

The currently developing fields of Ambient Intelligence and Persuasive Technology bring about a convergence of information technology and cognitive science. Smart environments that are able to respond intelligently to what we do and that even aim to influence our behaviour challenge the basic frameworks we commonly use for understanding the relations and role divisions between human beings and technological artifacts. After discussing the promises and threats of these technologies, this article develops alternative conceptions of agency, freedom, and responsibility that make (...) it possible to better understand and assess the social roles of Ambient Intelligence and Persuasive Technology. The central claim of the article is that these new technologies urge us to blur the boundaries between humans and technologies also at the level of our conceptual and moral frameworks. (shrink)

The paper outlines a new interpretation of informational privacy and of its moral value. The main theses defended are: (a) informational privacy is a function of the ontological friction in the infosphere, that is, of the forces that oppose the information flow within the space of information; (b) digital ICTs (information and communication technologies) affect the ontological friction by changing the nature of the infosphere (re-ontologization); (c) digital ICTs can therefore both decrease and protect informational privacy but, most importantly, they (...) can also alter its nature and hence our understanding and appreciation of it; (d) a change in our ontological perspective, brought about by digital ICTs, suggests considering each person as being constituted by his or her information and hence regarding a breach of one’s informational privacy as a form of aggression towards one’s personal identity. (shrink)

Dark patterns have received significant attention in literature as interface design practices which undermine users’ autonomy by coercing, misleading or manipulating their decision making and behavior. Individual autonomy has been argued to be one of the normative lenses for the evaluation of dark patterns. However, theoretical perspectives on autonomy have not been sufficiently adapted in literature to identify the ethical concerns raised by dark patterns. The aim of this paper is to conceptualize user autonomy within the context of dark patterns. (...) In this paper, we systematically review 151 dark patterns from 16 taxonomies to understand how dark patterns threaten users’ autonomy. We demonstrate through this analysis that implications for autonomy arise along four dimensions, because autonomy itself can be understood as subsuming several distinguishable concepts. These are agency, freedom of choice, control and independence. We argue that an assessment of whether a design pattern qualifies as ‘dark’ should account for the sense in which autonomy is threatened, as individuals’ rights and expectations of autonomy vary in various contexts and depend upon the interpretation of autonomy. This paper aims to contribute to the development of the normative lens of individual autonomy for the evaluation of dark patterns, as well as for persuasive design more broadly. (shrink)

Information and communication technology is changing many aspects ofhuman endeavour and existence. This is beyond dispute for most. Whatare contested are the social and ethical implications of thesechanges. Possible sources of these disputes are the multiple ways inwhich one can conceptualize and interpret the informationtechnology/society interrelationship. Each of these ways ofconceptualization and interpretation enables one to see theinformation technology/society relationship differently and thereforeconstrue its social and ethical implications in a different manner. Atthe center of this technology/society interrelationship we find manycomplex (...) questions about the nature of the human, the technical,agency, autonomy, freedom and much more. This is indeed a vastintellectual landscape, which can obviously not be explored here inits fullness. This entry is about just one particular perspective onthis landscape. It is primarily concerned with the phenomenologicalapproach to interpreting information technology and its social andethical implications. It should be noted from the start that there isnot a unified phenomenological tradition or approach to informationtechnology in particular, or other phenomena more generally. Thephenomenological tradition consists of many different approaches thatshare certain characteristics but not all. We may however suggest, with Don Ihde,that they all accept that “phenomenology investigates theconditions of what makes things appear as such [as that which we takethem to be].” Differently stated, phenomenology suggests thatthere is a co-constitutive relationship between us and the phenomenawe encounter in our engagement with the world. In this sensephenomenologists would suggest that to understand thetechnology/society relationship we need to reveal how theyco-constitute each other—i.e. draw on each other for theirongoing meaning and sense. We will elaborate more precisely what thismeans in section 2 below. However, in order to understand the distinctiveness of thephenomenological approach other possible ways of interpreting thistechnology/society relationship will also be outlined brieflybelow., It can be said that information technology has become in a very realsense ubiquitous. Most everyday technologies such as elevators,automobiles, microwaves, watches, and so forth depend onmicroprocessors for their ongoing operation. Most organizations andinstitutions have become reliant on their information technologyinfrastructure to a lesser or greater degree. Indeed informationtechnology is seen by many as a cost-efficient way to solve amultitude of problems facing our complex contemporary society. One canalmost say that information technology has become construed as thedefault technology for solving a whole raft of technical and socialproblems such as health provision, security, governance, etc. Onecould also argue that it has become synonymous with society’sview of modernization and progress. For most it seems obvious thatinformation technology has made it possible for humans to continue toconstruct increasingly complex systems of coordination and socialordering—systems without which contemporary society would not beable to exist in its present form. To say the least, we, ascontemporary human beings, have our manner of being made possiblethrough a rather comprehensive entanglement with information andcommunication technology. Indeed, the economic, organizational andsocial benefit of information technology is not widely disputed. Thedispute is more often about the way information technology is changingor transforming the social domain, and in particular, the ethicaldomain. This dispute is largely centered around different ways ofconceptualizing and interpreting the nature of our entanglement withinformation technology. This debate is not merely an academic debateabout different and competing theoretical ‘models.’Rather, these different ways of conceptualizing it is central to ourunderstanding of how we go about managing our increasingly entangledrelationship with information technology. (shrink)

The conjunction of wireless computing, ubiquitous Internet access, and the miniaturisation of sensors have opened the door for technological applications that can monitor health and well-being outside of formal healthcare systems. The health-related Internet of Things (H-IoT) increasingly plays a key role in health management by providing real-time tele-monitoring of patients, testing of treatments, actuation of medical devices, and fitness and well-being monitoring. Given its numerous applications and proposed benefits, adoption by medical and social care institutions and consumers may be (...) rapid. However, a host of ethical concerns are also raised that must be addressed. The inherent sensitivity of health-related data being generated and latent risks of Internet-enabled devices pose serious challenges. Users, already in a vulnerable position as patients, face a seemingly impossible task to retain control over their data due to the scale, scope and complexity of systems that create, aggregate, and analyse personal health data. In response, the H-IoT must be designed to be technologically robust and scientifically reliable, while also remaining ethically responsible, trustworthy, and respectful of user rights and interests. To assist developers of the H-IoT, this paper describes nine principles and nine guidelines for ethical design of H-IoT devices and data protocols. (shrink)

Personal Health Monitoring (PHM) uses electronic devices which monitor and record health-related data outside a hospital, usually within the home. This paper examines the ethical issues raised by PHM. Eight themes describing the ethical implications of PHM are identified through a review of 68 academic articles concerning PHM. The identified themes include privacy, autonomy, obtrusiveness and visibility, stigma and identity, medicalisation, social isolation, delivery of care, and safety and technological need. The issues around each of these are discussed. The system (...) / lifeworld perspective of Habermas is applied to develop an understanding of the role of PHMs as mediators of communication between the institutional and the domestic environment. Furthermore, links are established between the ethical issues to demonstrate that the ethics of PHM involves a complex network of ethical interactions. The paper extends the discussion of the critical effect PHMs have on the patient’s identity and concludes that a holistic understanding of the ethical issues surrounding PHMs will help both researchers and practitioners in developing effective PHM implementations. (shrink)

The internet of things is increasingly spreading into the domain of medical and social care. Internet-enabled devices for monitoring and managing the health and well-being of users outside of traditional medical institutions have rapidly become common tools to support healthcare. Health-related internet of things (H-IoT) technologies increasingly play a key role in health management, for purposes including disease prevention, real-time tele-monitoring of patient’s functions, testing of treatments, fitness and well-being monitoring, medication dispensation, and health research data collection. H-IoT promises many (...) benefits for health and healthcare. However, it also raises a host of ethical problems stemming from the inherent risks of Internet enabled devices, the sensitivity of health-related data, and their impact on the delivery of healthcare. This paper maps the main ethical problems that have been identified by the relevant literature and identifies key themes in the on-going debate on ethical problems concerning H-IoT. (shrink)

Despite their ethical challenges, recommender systems (RS) are widely endorsed as a necessary solution to the problem of information overload. After clarifying how the harmful effects of information overload can be characterized in distinct ways, I explore the often overlooked potential benefits of abundant online spaces. I argue that these spaces afford valuable opportunities to experience spontaneous freedom. I then put forth a more comprehensive evaluation of the role RS should assume in algorithmically structuring the online space. This evaluation aims (...) to reconcile the dual objectives of mitigating the harms of information overload and preserving opportunities to experience spontaneous freedom. (shrink)

The present essay includes an overview of key milestones in the development of computer ethics as a field of applied ethics. It also describes the ongoing debate about the proper scope of CE, as a subfield both in applied ethics and computer science. Following a brief description of the cluster of ethical issues that CE scholars and practitioners have generally considered to be the standard or "mainstream" issues comprising the field thus far, the essay speculates about the future direction of (...) CE and describes some theoretical and practical questions that will likely arise. (shrink)

Ubiquitous computing is a new kind of computing where devices enhance everyday artefacts and open up previously inaccessible situations for data capture. ‘Technology paternalism’ has been suggested by Spiekermann and Pallas (Poiesis & Praxis: Int J Technol Assess Ethics Sci 4(1):6–18, 2006) as a concept to gauge the social and ethical impact of these new technologies. In this article we explore this concept in the specific setting of UK road maintenance and construction. Drawing on examples from our qualitative fieldwork we (...) suggest that cultural logics such as those reflected in paternalistic health and safety discourse are central in legitimising the introduction of ubiquitous computing technologies. As such, there is little doubt that paternalism plays an essential role in people’s reasoning about ubiquitous computing in this setting. We argue, however, that since discourses such as health and safety are used by everyone (including both managers and workers) in the organisation to further their own aims, technologies transcend purely paternalistic conceptualisations and instead become a focal point for ongoing struggles for control between those deploying and using them. This means that the benefits and costs of such new technologies become harder to define from an ethical and social perspective. (shrink)

This paper is as much about surveillance as about persuasive technologies (PTs). With regard to PTs it raises the question about the ethical limits of persuasion. It will be argued that even some forms of self-imposed persuasive soft surveillance technologies may be considered unethical. Therefore, the ethical evaluation of surveillance technologies should not be limited to privacy issues. While it will also be argued that PTs may become instrumental in pre-commitment strategies, it will also be demonstrated that the use of (...) persuasive surveillance technologies in order to influence the users to become more compliant, to get their consent more easily or making it harder to opt out of the system does give rise to ethical issues. (shrink)

This paper explores and rehabilitates the value of decisional privacy as a conceptual tool, complementary to informational privacy, for critiquing personalized choice architectures employed by self-tracking technologies. Self-tracking technologies are promoted and used as a means to self-improvement. Based on large aggregates of personal data and the data of other users, self-tracking technologies offer personalized feedback that nudges the user into behavioral change. The real-time personalization of choice architectures requires continuous surveillance and is a very powerful technology, recently coined as (...) “hypernudging.” While users celebrate the increased personalization of their coaching devices, “hypernudging” technologies raise concerns about manipulation. This paper addresses that intuition by claiming that decisional privacy is at stake. It thus counters the trend to solely focus on informational privacy when evaluating information and communication technologies. It proposes that decisional privacy and informational privacy are often part of a mutually reinforcing dynamic. Hypernudging is used as a key example to illustrate that the two dimensions should not be treated separately. Hypernudging self-tracking technologies compromise autonomy because they violate informational and decisional privacy. In order to effectively judge whether technologies that use hypernudges empower users, we need both privacy dimensions as conceptual tools. (shrink)

The tendency towards an increasing integration of the informational web into our daily physical world (in particular in so-called Ambient Intelligent technologies which combine ideas derived from the field of Ubiquitous Computing, Intelligent User Interfaces and Ubiquitous Communication) is likely to make the development of successful profiling and personalization algorithms, like the ones currently used by internet companies such as Amazon , even more important than it is today. I argue that the way in which we experience ourselves necessarily goes (...) through a moment of technical mediation. Because of this algorithmic profiling that thrives on continuous reconfiguration of identification should not be understood as a supplementary process which maps a pre-established identity that exists independently from the profiling practice. In order to clarify how the experience of one’s identity can become affected by such machine-profiling a theoretical exploration of identity is made (including Agamben’s understanding of an apparatus , Ricoeur’s distinction between idem - and ipse -identity, and Stiegler’s notion of a conjunctive–disjunctive relationship towards retentional apparatuses ). Although it is clear that no specific predictions about the impact of Ambient Intelligent technologies can be made without taking more particulars into account, the theoretical concepts are used to describe three general scenarios about the way wherein the experience of identity might become affected. To conclude, I argue that the experience of one’s identity may affect whether the cases of unwarranted discrimination resulting from ubiquitous differentiations and identifications within an Ambient Intelligent environment, will become a matter of societal concern. (shrink)

In the future systems of ambient intelligence will include decision support systems that will automate the process of discrimination among people that seek entry into environments and to engage in search of the opportunities that are available there. This article argues that these systems must be subject to active and continuous assessment and regulation because of the ways in which they are likely to contribute to economic and social inequality. This regulatory constraint must involve limitations on the collection and use (...) of information about individuals and groups. The article explores a variety of rationales or justifications for establishing these limits. It emphasizes the unintended consequences that flow from the use of these systems as the most compelling rationale. (shrink)

The tendency towards an increasing integration of the informational web into our daily physical world (in particular in so-called Ambient Intelligent technologies which combine ideas derived from the field of Ubiquitous Computing, Intelligent User Interfaces and Ubiquitous Communication) is likely to make the development of successful profiling and personalization algorithms, like the ones currently used by internet companies such as Amazon, even more important than it is today. I argue that the way in which we experience ourselves necessarily goes through (...) a moment of technical mediation. Because of this algorithmic profiling that thrives on continuous reconfiguration of identification should not be understood as a supplementary process which maps a pre-established identity that exists independently from the profiling practice. In order to clarify how the experience of one’s identity can become affected by such machine-profiling a theoretical exploration of identity is made (including Agamben’s understanding of an apparatus, Ricoeur’s distinction between idem- and ipse-identity, and Stiegler’s notion of a conjunctive–disjunctive relationship towards retentional apparatuses). Although it is clear that no specific predictions about the impact of Ambient Intelligent technologies can be made without taking more particulars into account, the theoretical concepts are used to describe three general scenarios about the way wherein the experience of identity might become affected. To conclude, I argue that the experience of one’s identity may affect whether the cases of unwarranted discrimination resulting from ubiquitous differentiations and identifications within an Ambient Intelligent environment, will become a matter of societal concern. (shrink)

This paper provides an in-depth analysis of the privacy rights dilemma surrounding radio frequency identification (RFID) technology. As one example of ubiquitous information system, RFID has multitudinous applications in various industries and businesses across society. The use of this technology will have to lead to a policy setting dilemma in that a balance between individuals’ privacy concerns and the benefits that they derive from it must be drawn. After describing the basic RFID technology some of its most prevalent uses, a (...) definition of privacy is derived in the context of information systems. To illustrate current attempts at controlling the undesirable side effects of RFID, Lessig’s cyberspace framework is presented. It is found that each of Lessig’s components is inadequate at preventing individual privacy violations in RFID. The main focus within this framework is on the norms of society. The social norm mechanism that addresses privacy issues in cyberspace is the Fair Information Practices Principles (FIPP). After an analysis of these principles, it is posited that the FIPP only deal with procedural justice issues related to data collection and omit distributive and interactional justice reasoning related to the actual beneficial and detrimental outcomes to the individuals whose data is being obtained. Thus, RFID is presented in the context of the tension between the many benefits that are provided by the technology in social exchanges, and the risk it carries of the loss of privacy. The new, expanded framework recognizes both sides of the issue with the ultimate goal of providing a greater understanding of how privacy issues can be addressed with RFID technology. (shrink)

Intelligent environments aim to provide context-sensitive services to humans in the physical spaces in which they work and live. While the ethical dimensions of these systems have been considered, this is an aspect which requires further analysis. A literature review shows that these approaches are disconnected from each other, and that they are making little impact on real systems being built. This article provides a solution to both of these problems. It synthesises the ethical issues addressed by previous work and (...) highlights other important concerns which have been overlooked so far. Furthermore, it proposes an alternative, more holistic approach that can be used to guide the development of intelligent environments. The validity of the framework is demonstrated by its integration into an actual project. (shrink)