The paper examines how technology challenges conventional borders of national legal systems, as shown by cases that scholars address as a part of their everyday work in the fields of information technology (IT)-Law, i.e., computer crimes, data protection, digital copyright, and so forth. Information on the internet has in fact a ubiquitous nature that transcends political borders and questions the notion of the law as made of commands enforced through physical sanctions. Whereas many of today’s impasses on jurisdiction, international conflicts (...) of law and diverging interpretations of statutes can be addressed by embedding legal safeguards in ICT and other kinds of technology, to overcome the ineffectiveness of state action by design entails its own risks, e.g., threats of paternalism hinging on the regulatory tools of technology. Rather than modelling people’s behaviour by design, the article suggests that design policies should respect individual and collective autonomy by decreasing the impact of harm-generating behaviour (e.g., security measures and default settings for data protection), or by widening the range of people’s choices (e.g., user friendly interfaces). (shrink)

This paper proposes a framework for an ethical impact assessment which can be performed in regard to any policy, service, project or programme involving information technology. The framework is structured on the four principles posited by Beauchamp and Childress together with a separate section on privacy and data protection. The framework identifies key social values and ethical issues, provides some brief explanatory contextual information which is then followed by a set of questions aimed at the technology developer or policy-maker to (...) facilitate consideration of ethical issues, in consultation with stakeholders, which may arise in their undertaking. In addition, the framework includes a set of ethical tools and procedural practices which can be employed as part of the ethical impact assessment. Although the framework has been developed within a European context, it could be applied equally well beyond European borders. (shrink)

Digital innovations are rapidly changing the contemporary workplace. Big Tech companies marketing algorithmic management increasingly decide on the Future of Work. Political responses, however, often focus on managing the impact of these technologies on workers. They leave the question of how these technologies are designed or how workers can determine their own futures unanswered. This approach risks surrendering the Future of Work debate to techno-determinist imaginaries aligned with corporate interests. Using Cornelius Castoriadis’ early writings on worker struggles in French Tayloristic (...) factories and his later oeuvre on conflictual social imaginaries, I propose an agonistic approach to the Future of Work. Not merely companies implementing workplace technologies, but also workers themselves possess agency in determining the Future of Work. Workers’ frequent contestations against machinic surveillance and technologically mediated coordination of the labour process disclose an alternative Future of Work in which technologies are used to enhance worker autonomy rather than bureaucratic control. Worker struggles at Amazon Mechanical Turk illustrate this agonistic dynamic: Amazon mobilizes algorithmic management to fragment and control a workforce of globally dispersed remote workers, but the latter form online social communities and create counter-technologies to reappropriate control over the labour process. (shrink)

This article introduces Designing for Care (D4C), a distinctive approach to project management and technological design informed by Care Ethics. We propose to conceptualize “care” as both the foundational value of D4C and as its guiding mid-level principle. As a value, care provides moral grounding. As a principle, it equips D4C with moral guidance to enact a caring process. The latter is made of a set of concrete, and often recursive, caring practices. One of the key assumption of D4C is (...) a relational ontology of individual and group identities, which fosters the actualization of caring practices as essentially relational and (often) reciprocal. Moreover, D4C adopts the “ecological turn” in CE and stresses the ecological situatedness and impact of concrete projects, envisioning an extension of caring from intra-species to inter-species relations. We argue that care and caring can influence directly some of the phases and practices within the management of (energy) projects and the design of sociotechnical (energy) artefacts and systems. When issues related to “value change” emerge as problematic (e.g., values trade-offs, conflicts), the mid-level guiding principle of care helps evaluate and prioritize different values at stake within specific projects. Although there may be several actors and stakeholders involved in project management and technological design, here we will focus on the professionals in charge of imagining, designing, and carrying out these processes (i.e., project managers, designers, engineers). We suggest that adopting D4C would improve their ability to capture and assess stakeholders’ values, critically reflect on and evaluate their own values, and judge which values prioritize. Although D4C may be adaptable to different fields and design contexts, we recommend its use especially within small and medium-scale (energy) projects. To show the benefits of adopting it, we envisage the application of D4C within the project management and the technological design of a community battery. The adoption of D4C can have multiple positive effects: transforming the mentality and practice of managing a project and designing technologies; enhancing caring relationships between managers, designers, and users as well as among users; achieving better communication, more inclusive participation, and more just decision-making. This is an initial attempt to articulate the structure and the procedural character of D4C. The application of D4C in a concrete project is needed to assess its actual impact, benefits, and limitations. (shrink)

The majority of studies on absorptive capacity (AC) underscore the importance of absorbing technological knowledge from other firms to create economic value. However, to preserve moral legitimacy and create social value, firms must also discern and adapt to (shifts in) societal values. A comparative case study of eight firms in the food industry reveals how organizations prioritize and operationalize the societal value health in product innovation while navigating inter- and intravalue conflicts. The value-sensitive framework induced in this article extends AC (...) by explaining how technically savvy, economic value–creating firms diverge in their receptivity, articulation, and reflexivity of societal values. (shrink)

Recently, amid growing awareness that computer algorithms are not neutral tools but can cause harm by reproducing and amplifying bias, attempts to detect and prevent such biases have intensified. An approach that has received considerable attention in this regard is the Value Sensitive Design (VSD) methodology, which aims to contribute to both the critical analysis of (dis)values in existing technologies and the construction of novel technologies that account for specific desired values. This article provides a brief overview of the key (...) features of the Value Sensitive Design approach, examines its contributions to understanding and addressing issues around bias in computer systems, outlines the current debates on algorithmic bias and fairness in machine learning, and discusses how such debates could profit from VSD-derived insights and recommendations. Relating these debates on values in design and algorithmic bias to research on cognitive biases, we conclude by stressing our collective duty to not only detect and counter biases in software systems, but to also address and remedy their societal origins. (shrink)

Contemporary design practices, such as participatory design, human-centered design, and codesign, have inherent ethical qualities, which often remain implicit and unexamined. Three design projects in the high-tech industry were studied using three ethical traditions as lenses. Virtue ethics helped to understand cooperation, curiosity, creativity, and empowerment as virtues that people in PD need to cultivate, so that they can engage, for example, in mutual learning and collaborative prototyping. Ethics of alterity helped to understand human-centered design as a fragile encounter between (...) project team members and prospective users, and foregrounds the ethics in these encounters: our tendencies to “grasp the other” and to “program invention.” And pragmatist ethics helped to understand codesign as a process of joint inquiry and imagination, involving the organization of iterative processes of problem setting and solution finding, with moral qualities. When we open the “black boxes” of design practices, we find them filled with ethics. Moreover, it is proposed that design practitioners need to make explicit their practices’ inherent ethical qualities and that they can do that by embracing reflexivity. (shrink)

Safe-by-Design (SBD) frameworks for the development of emerging technologies have become an ever more popular means by which scholars argue that transformative emerging technologies can safely incorporate human values. One such popular SBD methodology is called Value Sensitive Design (VSD). A central tenet of this design methodology is to investigate stakeholder values and design those values into technologies during early stage research and development (R&D). To accomplish this, the VSD framework mandates that designers consult the philosophical and ethical literature to (...) best determine how to weigh moral trade-offs. However, the VSD framework also concedes the universalism of moral values, particularly the values of freedom, autonomy, equality trust and privacy justice. This paper argues that the VSD methodology, particularly applied to nano-bio-info-cogno (NBIC) technologies, has an insufficient grounding for the determination of moral values. As such, an exploration of the value-investigations of VSD are deconstructed to illustrate both its strengths and weaknesses. This paper also provides possible modalities for the strengthening of the VSD methodology, particularly through the application of moral imagination and how moral imagination exceed the boundaries of moral intuitions in the development of novel technologies. (shrink)

The convergence of computing, sensing, and communication technology will soon permit large-scale deployment of self-driving vehicles. This will in turn permit a radical transformation of traffic control technology. This paper makes a case for the importance of addressing questions of social justice in this transformation, and sketches a preliminary framework for doing so. We explain how new forms of traffic control technology have potential implications for several dimensions of social justice, including safety, sustainability, privacy, efficiency, and equal access. Our central (...) focus is on efficiency and equal access as desiderata for traffic control design. We explain the limitations of conventional traffic control in meeting these desiderata, and sketch a preliminary vision for a next-generation traffic control tailored to address better the demands of social justice. One component of this vision is cooperative, hierarchically distributed self-organization among vehicles. Another component of this vision is a priority system enabling selection of priority levels by the user for each vehicle trip in the network, based on the supporting structure of non-monetary credits. (shrink)

PurposeThe purpose of this paper is to add one further value to the previously articulated “universal values” and to describe the constituent components of three universal values.Design/methodology/approachThis interpretive/constructivist study of Australia's largest online community of seniors involved a 30‐month ethnographic investigation. After an initial period of 11 months of observing social interaction on the entire site, in‐depth, semi‐structured interviews were conducted with 30 participants, selected according to criterion sampling, a form of purposive sampling.FindingsFour key moral values were identified: equality, freedom, (...) respect and trust. All of them had been found in other studies, with equality and respect (as human dignity) identified as universal values. The findings from this study suggest that freedom is another universal value.Originality/valueThis study extends the understanding of universal values to include freedom. Further, it demonstrates the constituent components for freedom, and those of two other universal values previously identified in the literature, equality and human dignity, as well as revealing linkages between these three values. (shrink)

Over the past decade Identity Management has become a central theme in information technology, policy, and administration in the public and private sectors. In these contexts the term ‘Identity Management’ is used primarily to refer to ways and methods of dealing with registration and authorization issues regarding persons in organizational and service-oriented domains. Especially due to the growing range of choices and options for, and the enhanced autonomy and rights of, employees, citizens, and customers, there is a growing demand for (...) systems that enable the regulation of rights, duties, responsibilities, entitlements and access of innumerable people simultaneously. ‘Identity Management’ or ‘Identity Management Systems’ have become important headings under which such systems are designed and implemented. But there is another meaning of the term ‘identity management’, which is clearly related and which has gained currency. This second construal refers to the need to manage our moral identities and our identity related information. This paper explores the relation between the management of our (moral) identities and ‘Identity Management’ as conceptualized in IT discourse. (shrink)

This study extended the scope of previous findings in human–computer interaction research within the computers are social actors paradigm by showing that online users attribute perceptions of moral qualities to Websites and, further, that differential perceptions of morality affected the extent of persuasion. In an experiment (N = 138) that manipulated four morality conditions (universalist, relativist, egotistic, control) across worldview, a measured independent variable, users were asked to evaluate a Web site designed to aid them in making ethical decisions. Web (...) sites offered four different types of ethical advice as participants contemplated cases involving ethical quandaries. Perceptions of the Web sites’ moral qualities varied depending on the type of advice given. Further, the Web sites’ perceived morality and participants’ worldview predicted credibility, persuasiveness, and attitudes toward the Web sites. (shrink)

Organizations such as the EU High-Level Expert Group on AI and the IEEE have recently formulated ethical principles and (moral) values that should be adhered to in the design and deployment of artificial intelligence (AI). These include respect for autonomy, non-maleficence, fairness, transparency, explainability, and accountability. But how can we ensure and verify that an AI system actually respects these values? To help answer this question, I propose an account for determining when an AI system can be said to embody (...) certain values. This account understands embodied values as the result of design activities intended to embed those values in such systems. AI systems are here understood as a special kind of sociotechnical system that, like traditional sociotechnical systems, are composed of technical artifacts, human agents, and institutions but—in addition—contain artificial agents and certain technical norms that regulate interactions between artificial agents and other elements of the system. The specific challenges and opportunities of embedding values in AI systems are discussed, and some lessons for better embedding values in AI systems are drawn. (shrink)

This paper examines one particular problem of values in cloud computing: how individuals can take advantage of the cloud to store data without compromising their privacy and autonomy. Through the creation of Lockbox, an encrypted cloud storage application, we explore how designers can use reflection in designing for human values to maintain both privacy and usability in the cloud.

Robots are leaving factories and entering urban spaces. In this paper, I will explore how we can integrate robots of various types into the urban landscape. I will distinguish between two perspectives: the responsible design and use of urban robots and robots as part of responsible urban innovations. The first viewpoint considers issues arising from the use of a robot in an urban environment. To develop a substantive understanding of Responsible Urban Robotics, we need to focus on normative implications of (...) city life as the context in which in robots are being used. I will refer to the desirable qualities of city life as “cityness” and will argue that we should design for cityness. The second approach asks how robots might be used to address challenges specific to cities. From the perspective of RRI, this may require participatory approaches in which the needs of the stakeholders are addressed. But we may also find inspiration in the work undertaken in architecture on expanding the concept and field to ensure that architects not only provide services to the lucky few but also create useful and beautiful spaces for the many. A dialogue with architects, urban designers, and urban planners may also be needed to successfully address the spatial issues raised by the presence of robots in the city. (shrink)

The paper presents results of recent laboratory experiments that study if and how computer-mediated communication affects cooperation and trust. It is argued that communication medium does not matter much for trust-building and maintenance, whereas relevant pre-play communication and group size can have a major influence. The implications of the findings for the design of sites that depend on trusting communities are discussed.

Automation does not always replace human labour altogether: there is an intermediate stage of human co-existence with machines, including robots, in a production process. Cobots are robots designed to participate at close quarters with humans in such a process. I shall discuss the possible role of cobots in facilitating the eventual total elimination of human operators from production in which co-bots are initially involved. This issue is complicated by another: cobots are often introduced to workplaces with the message (from managers) (...) that they will not replace human operators but will rather assist human operators and make their jobs more interesting and responsible. If, in the process of learning to assist human operators, robots acquire the skills of human operators, then the promise of avoiding replacement can turn out to be false, and if a human operator loses his job, he has been harmed twice over: once by unemployment and once by deception. I shall suggest that this moral risk attends some cobots more than others. (shrink)

In projects concerning big data, ethical questions need to be answered during the design process. In this paper the Value Sensitive Design method is applied in the context of data-driven health services aimed at disease prevention. It shows how Value Sensitive Design, with the use of a moral dialogue and an ethical matrix, can support the identification and operationalization of moral values that are at stake in the design of such services. It also shows that using this method can support (...) meeting the requirements of the General Data Protection Regulation. (shrink)

According to some philosophers of technology, technology embodies moral values in virtue of its functional properties and the intentions of its designers. But this paper shows that such an account makes the values supposedly embedded in technology epistemically opaque and that it does not allow for values to change. Therefore, to overcome these shortcomings, the paper introduces the novel Affordance Account of Value Embedding as a superior alternative. Accordingly, artefacts bear affordances, that is, artefacts make certain actions likelier given the (...) circumstances. Based on an interdisciplinary perspective that invokes recent moral anthropology, I conceptualize affordances as response-dependent properties. That is, they depend on intrinsic as well as extrinsic properties of the artefact. We have reason to value these properties. Therefore, artefacts embody values and are not value-neutral, which has practical implications for the design of new technologies. (shrink)

Community acceptance still remains a challenge for wind energy projects. The most popular explanation for local opposition, the Not in My Backyard effect, has received fierce criticism in the past decade. Critics argue that opposition is not merely a matter of selfishness or ignorance, but that moral, ecological and aesthetic values play an important role. In order to better take such values into account, a more bottom-up, participatory decision process is usually proposed. Research on this topic focusses on either stakeholder (...) motivations/attitudes, or their behavior during project implementation. This paper proposes a third research focus, namely the ‘objects’ which elicit certain behavioral responses and attitudes—the wind turbine and parks. More concretely, this paper explores Value Sensitive Design as way to arrive at wind turbines and parks that better embed or reflect key values. After a critical discussion of the notion of acceptance versus acceptability and support, the paper discusses existing literature on ecology and aesthetics in relation to wind turbine/park design, which could serve as ‘building blocks’ of a more integral VSD approach of the topic. It also discusses the challenge of demarcating wind park projects as VSD projects. A further challenge is that VSD has been applied mainly at the level of technical artifacts, whereas wind parks can best be conceptualized as socio-technical system. This new application would therefore expand the current practice of VSD, and may as a consequence also lead to interesting new insights for the VSD community. The paper concludes that such an outcome-oriented approach of wind turbines and park is worth exploring further, as a supplement to rather than a replacement of the process-oriented approach that is promoted by the current literature on community acceptance of wind parks. (shrink)

Recently, there is increased attention to the integration of moral values into the conception, design, and development of emerging IT. The most reviewed approach for this purpose in ethics and technology so far is Value-Sensitive Design (VSD). This article considers VSD as the prime candidate for implementing normative considerations into design. Its methodology is considered from a conceptual, analytical, normative perspective. The focus here is on the suitability of VSD for integrating moral values into the design of technologies in a (...) way that joins in with an analytical perspective on ethics of technology. Despite its promising character, it turns out that VSD falls short in several respects: (1) VSD does not have a clear methodology for identifying stakeholders, (2) the integration of empirical methods with conceptual research within the methodology of VSD is obscure, (3) VSD runs the risk of committing the naturalistic fallacy when using empirical knowledge for implementing values in design, (4) the concept of values, as well as their realization, is left undetermined and (5) VSD lacks a complimentary or explicit ethical theory for dealing with value trade-offs. For the normative evaluation of a technology, I claim that an explicit and justified ethical starting point or principle is required. Moreover, explicit attention should be given to the value aims and assumptions of a particular design. The criteria of adequacy for such an approach or methodology follow from the evaluation of VSD as the prime candidate for implementing moral values in design. (shrink)

When thinking about ethics, technology is often only mentioned as the source of our problems, not as a potential solution to our moral dilemmas. When thinking about technology, ethics is often only mentioned as a constraint on developments, not as a source and spring of innovation. In this paper, we argue that ethics can be the source of technological development rather than just a constraint and technological progress can create moral progress rather than just moral problems. We show this by (...) an analysis of how technology can contribute to the solution of so-called moral overload or moral dilemmas. Such dilemmas typically create a moral residue that is the basis of a second-order principle that tells us to reshape the world so that we can meet all our moral obligations. We can do so, among other things, through guided technological innovation. (shrink)

This contribution discusses the development of the Data Ethics Decision Aid (DEDA), a framework for reviewing government data projects that considers their social impact, the embedded values and the government’s responsibilities in times of data-driven public management. Drawing from distinct qualitative research approaches, the DEDA framework was developed in an iterative process (2016–2018) and has since then been applied by various Dutch municipalities, the Association of Dutch Municipalities, and the Ministry of General Affairs (NL). We present the DEDA framework as (...) an effective process to moderate case-deliberation and advance the development of responsible data practices. In addition, by thoroughly documenting the deliberation process, the DEDA framework establishes accountability. First, this paper sheds light on the necessity for data ethical case deliberation. Second, it describes the prototypes, the final design of the framework, and its evaluation. After a comparison with other frameworks, and a discussion of the findings, the paper concludes by arguing that the DEDA framework is a useful process for ethical evaluation of data projects for public management and an effective tool for creating awareness of ethical issues in data practices. (shrink)

Software users have different sets of personal values, such as benevolence, self-direction, and tradition. Among other factors, these personal values influence users’ emotions, preferences, motivations, and ways of performing tasks—and hence, information needs. Studies of user acceptance indicate that personal traits like values and related soft issues are important for the user’s approval of software. If a user’s dominant personal value were known, software could automatically show an interface variant which offers information and functionality that best matches his or her (...) dominant value. A user’s dominant personal value is the one that most strongly influences his or her attitudes and behaviors. However, existing methods for measuring a user’s values are work intensive and/or interfere with the user’s privacy needs. If interface tailoring for very large groups of users is planned, value approximation has to be achieved on a large scale to assign individualized software to all users of the software. Our work focuses on approximating the dominant values of a user with less effort and less impact on privacy. Instead of probing for a user’s values directly, we explore the potential of approximating these values based on the user’s preferences for key tasks. Producing tailored versions of software is a separate topic not in the focus here. In this paper we rather describe a method to identify user values from task preferences and an empirical study of applying parts of this method. We are proposing the method in this paper for the first time except for a preliminary version orally presented at a workshop. The method consists of a research process and an application process. In the research process a researcher has to identify key tasks occurring in a context under investigation which have a relationship to personal values. These key tasks can be used in the application process to approximate the dominant values of new users in a similar context. In this empirical study we show that the research process of our method allows us to determine key tasks which approximate values in the shared context of nursing. The majority of the nurses were found to have one of the three following dominant values: benevolence, self-direction, or hedonism. Data confirmed common expectations: that nurses with the value of benevolence, when compared to all other nurses, had a higher preference for tasks which helped people immediately or improved their circumstances of the treatment. In relation to all other nurses, participants with self-direction disliked tasks which affected their personal freedom, and users with hedonism had a lower preference for tasks which involved physical work and preferred tasks which promised gratification. Our findings advance measurement of personal values in large user groups by asking questions with less privacy concern. However, the method requires substantial efforts during the initial research process to prepare such measurements. Future work includes replicating our method in other contexts and identifying value-dependent tasks for users with other values than the three values our empirical study mainly focused on. (shrink)

In this paper, we argue that the characteristics of digital platforms challenge the fundamental assumptions of value sensitive design (VSD). Traditionally, VSD methods assume that we can identify relevant values during the design phase of new technologies. The underlying assumption is that there is onlyepistemic uncertaintyabout which values will be impacted by a technology. VSD methods suggest that one can predict which values will be affected by new technologies by increasing knowledge about how values are interpreted or understood in context. (...) In contrast, digital platforms exhibit a novel form of uncertainty, namely,ontological uncertainty: even with full information and overview, it cannot be foreseen what users or developers will do with digital platforms. Hence, predictions about which values are affected might not hold. In this paper, we suggest expanding VSD methods to account for value dynamism resulting from ontological uncertainty. Our expansions involve (1) extending VSD to the entire lifecycle of a platform, (2) broadening VSD through the addition of reflexivity, i.e. second-order learning about what values to aim at, and (3) adding specific tools of moral sandboxing and moral prototyping to enhance such reflexivity. While we illustrate our approach with a short case study about ride-sharing platforms such as Uber, our approach is relevant for other technologies exhibiting ontological uncertainty as well, such as machine learning, robotics and artificial intelligence. (shrink)

Following societal and policy pressures for responsible innovation, innovators are more and more expected to consider the broader socio-ethical context of their work, and more importantly, to integrate such considerations into their daily practices. This may require the involvement of ‘outsiders’ in innovation trajectories, including e.g. societal and governmental actors. However, methods on how to functionally organize such integration in light of responsible innovation have only recently started to emerge. We present an approach to do just that, in which we (...) first develop value profiles of the involved actors, and second, design a workshop setting that allows innovators to develop design requirements in collaboration with representatives of parties that are not usually involved in such innovation design practices. Using a case study in automated vehicle development, we positively demonstrate the possibility and utility of our approach. We stress that in this study we wish to demonstrate the functionality of our developed method, and did not search for scientifically valid outcomes regarding this technical field. (shrink)

The paper examines today’s debate on the new responsibilities of Internet service providers in connection with legal problems concerning jurisdiction, data processing, people’s privacy and education. The focus is foremost on the default rules and safe harbour clauses for ISPs liability, set up by the US and European legal systems. This framework is deepened in light of the different functions of the services provided on the Internet so as to highlight multiple levels of control over information and, correspondingly, different types (...) of liability. The new responsibilities of ISPs concern the original “end-to-end” architecture of the medium and policies on design rather than responsibility for user content and individual messages. (shrink)