That technologies may raise ethical issues is now widely recognised. The ‘responsible innovation’ literature – as well as, to a lesser extent, the applied ethics and bioethics literature – has responded to the need for ethical reflection on technologies by developing a number of tools and approaches to facilitate such reflection. Some of these instruments consist of lists of questions that people are encouraged to ask about technologies – a methodology known as the ‘Socratic approach’. However, to date, these instruments (...) have often not adequately acknowledged various political impacts of technologies, which are, I suggest, essential to a proper account of the ethical issues they raise. New technologies can make some people richer and some people poorer, empower some and disempower others, have dramatic implications for relationships between different social groups and impact on social understandings and experiences that are central to the lives, and narratives, of denizens of technological societies. The distinctive contribution of this paper, then, is to offer a revised and updated version of the Socratic approach that highlights the political, as well as the more traditionally ethical, issues raised by the development of new technologies. (shrink)

This article examines the role of medical doctors, AI designers, and other stakeholders in making applied AI and machine learning ethically acceptable on the general premises of shared decision-making in medicine. Recent policy documents such as the EU strategy on trustworthy AI and the research literature have often suggested that AI could be made ethically acceptable by increased collaboration between developers and other stakeholders. The article articulates and examines four central alternative models of how AI can be designed and applied (...) in patient care, which we call the ordinary evidence model, the ethical design model, the collaborative model, and the public deliberation model. We argue that the collaborative model is the most promising for covering most AI technology, while the public deliberation model is called for when the technology is recognized as fundamentally transforming the conditions for ethical shared decision-making. (shrink)

Artificial intelligence (AI) and robotics are digital technologies that will have significant impact on the development of humanity in the near future. They have raised fundamental questions about what we should do with these systems, what the systems themselves should do, what risks they involve, and how we can control these. - After the Introduction to the field (§1), the main themes (§2) of this article are: Ethical issues that arise with AI systems as objects, i.e., tools made and used (...) by humans. This includes issues of privacy (§2.1) and manipulation (§2.2), opacity (§2.3) and bias (§2.4), human-robot interaction (§2.5), employment (§2.6), and the effects of autonomy (§2.7). Then AI systems as subjects, i.e., ethics for the AI systems themselves in machine ethics (§2.8) and artificial moral agency (§2.9). Finally, the problem of a possible future AI superintelligence leading to a “singularity” (§2.10). We close with a remark on the vision of AI (§3). - For each section within these themes, we provide a general explanation of the ethical issues, outline existing positions and arguments, then analyse how these play out with current technologies and finally, what policy consequences may be drawn. (shrink)

Though rapid collection of big data is ubiquitous across domains, from industry settings to academic contexts, the ethics of big data collection and research are contested. A nexus of data ethics issues is the concept of creep, or repurposing of data for other applications or research beyond the conditions of original collection. Data creep has proven controversial and has prompted concerns about the scope of ethical oversight. Institutional review boards offer little guidance regarding big data, and problematic research can still (...) meet ethical standards. While ethics seem concrete through institutional deployment, I frame ethics as produced. Informed by my ethnographic research at a large public university in the U.S., I explore ethics through two models: ethics as institutional procedures and ethics as acts and intentions. The university where I conducted fieldwork is the development grounds for a predictive model that uses student data to anticipate academic success. While students consent to data collection, the circumstances of consent and the degree to which they are informed are not so apparent, as many data are a product of creep. Drawing from interviews and participant observation with administrators, data scientists, developers, and students, I examine data ethics, from a larger institutional model to everyday enactments related to data creep. After demonstrating the limits of such models, I propose a remodeling of ethics that draws on recent works on data, justice, and refusal to pose generative questions for rethinking ethics in institutional contexts. (shrink)

Current European innovation and security policies are increasingly channeled into efforts to address the assumed challenges that threaten European societies. A field in which this has become particularly salient is digitized EU border management. Here, the framework of responsible research and innovation (RRI) has recently been used to point to the alleged sensitivity of political actors towards the contingent dimensions of emerging security technologies. RRI, in general, is concerned with societal needs and the engagement and inclusion of various stakeholder groups (...) in the research and innovation processes, aiming to anticipate undesired consequences of and identifying socially acceptable alternatives for emerging technologies. However, RRI has also been criticized as an industry-driven attempt to gain societal legitimacy for new technologies. In this article, we argue that while RRI evokes a space where different actors enter co-creative dialogues, it lays bare the specific challenges of governing security innovation in socially responsible ways. Empirically, we draw on the case study of BODEGA, the first EU funded research project to apply the RRI framework to the field of border security. We show how stakeholders involved in the project represent their work in relation to RRI and the resulting benefits and challenges they face. The paper argues that applying the framework to the field of (border) security lays bare its limitations, namely that RRI itself embodies a political agenda, conceals alternative experiences by those on whom security is enacted upon and that its key propositions of openness and transparency are hardly met in practice due to confidentiality agreements. Our hope is to contribute to work on RRI and emerging debates about how the concept can (or cannot) be contextualized for the field of security—a field that might be more in need than any other to consider the ethical dimension of its activities. (shrink)

New media and technologies such as social media and online platforms are disrupting the way businesses are run and how society functions. This article advises that scholars consider the morality of new media as an area of investigation. While prior literature has given much attention to how social media provides benefits, how it affects society generally, and how it can be used efficiently, research on the ethical aspects of new media has received relatively less attention. In an age where matters (...) such as violence, hate crimes, fake news, etc. are increasingly pervasive, we need to address the role of online technology in aiding or limiting such negative acts. In this regard, this article uses the canvas of a terror attack that was facilitated by online technology to bring to light pressing social and ethical issues in the use of new media. I draw upon 264 news articles focusing on the 2019 Christchurch terrorist attacks to piece together how the attack was orchestrated and focus on technology-enabled facets of the event. I stir discussion on the ethical aspects of technology with regard to online discrimination and highlight business and other stakeholder responsibilities and challenges as technology continues to evolve and pervade our social lives. (shrink)

Bioethicists and philosophers dominate the on-going debate on human enhancement. They have debated the definition of human enhancement as well as the potential impacts of human enhancement technologies (such as pharmaceutical enhancements or pre-natal selection). These discussions have percolated, through bioethics bodies and bioethics recommendations, policy makers and have eventually been translated into policy. While some suggestions have been based largely in Western liberal democracies, others have deliberated the geopolitical consequences of human enhancement technologies. This paper argues that the present (...) debate currently lacks perspectives from developing countries. It begins by introducing the current debate on human enhancement and recognizes Allen Buchanan’s well-raised concerns on how these technologies may potentially cause new injustices for low- and middle-income countries (‘developing countries’). It then provides two arguments calling for further research into human enhancement from the perspective of developing countries. First, this paper will argue that the current frames with which enhancement technologies are viewed are inherently neoliberal and require change. The second argument shows how the potential impacts of human enhancement technologies in developing countries have not been fully realized by analyzing how human enhancement technologies will impact Thailand, a developing country. (shrink)

This paper describes and critically reflects on a participatory policy process which resulted in a government decision not to introduce genetically modified cotton in farmers’ fields in Mali. In January 2006, 45 Malian farmers gathered in Sikasso to deliberate on GM cotton and the future of farming in Mali. As an invited policy space convened by the government of Sikasso region, this first-time farmers' jury was unique in West Africa. It was known as l’ECID—Espace Citoyen d’Interpellation Démocratique —and it had (...) an unprecedented impact on the region. In this Deliberative and Inclusive Process, the ECID combined the citizens’ jury method with indigenous methods for debate and dialogue, including the traditional African palaver. The ECID brought together male and female producers representing every district in the Sikasso region of southern Mali, specialist witnesses from various continents and a panel of independent observers, as well as resource persons and members of the national and international press and media. As an experiment in deliberative democracy, the ECID of Sikasso aimed to give men and women farmers the opportunity to share knowledge on the benefits and risks of GM cotton, and make policy recommendations on the future of GM technology in Malian agriculture. Designed as a bottom-up and participatory process, the ECID’s outcomes significantly changed national policy on the release of GM technology and have had an enduring influence in Mali. In this paper, we describe our positionality as action researchers and co-organisers of the ECID. We explain the methodology used for the ECID of Sikasso and critically reflect on the safeguards that were put in place to ensure a balanced and trustworthy deliberative process. The ECID and its key outcomes are discussed in the context of the political economy of GM cotton in West Africa. Last, we briefly highlight the relevance of the ECID for current international debates on racism in the theory and practice deliberative democracy; the production of post-normal transdisciplinary knowledge for technology risk-assessments; and the politics of knowledge in participatory policy-making for food and agriculture. (shrink)

This paper presents an experimental approach for engaging undergraduate STEM students in anticipatory ethical reasoning, or ethical reasoning applied to the analysis of potential mid- to long-term implications and outcomes of technological innovation. The authors implemented two variations of an approach that integrates three key components—scenario analysis, design fiction, and ethical frameworks—into five sections of an introductory course on the social contexts of science and technology that is required of STEM majors. The authors dub this approach Creative Anticipatory Ethical Reasoning, (...) or CAER. Scenario analysis is a strategy emerging from business consulting for grounded analysis of plausible future trajectories to inform planning. Design fiction is a creative hands-on activity that blends science fiction and design prototyping to facilitate critical thinking with respect to the societal dimensions of a plausible future technology. The authors present the following findings: in each of the variations, students demonstrated significant engagement with CAER and a substantive shift in their conception of what constitutes responsible innovation and ethical conduct in science and technology. Specifically, their integration of ethical reasoning with stakeholder perspectives and scenario analysis reframed technologies, from unproblematic solutions for societal problems to socially-embedded forms of life that might diverge from designers’ intentions. This suggests that CAER could be a useful pedagogical intervention for expanding students’ ethical engagement to consider the potential unintended consequences of technological innovation. (shrink)

Digital innovations are rapidly changing the contemporary workplace. Big Tech companies marketing algorithmic management increasingly decide on the Future of Work. Political responses, however, often focus on managing the impact of these technologies on workers. They leave the question of how these technologies are designed or how workers can determine their own futures unanswered. This approach risks surrendering the Future of Work debate to techno-determinist imaginaries aligned with corporate interests. Using Cornelius Castoriadis’ early writings on worker struggles in French Tayloristic (...) factories and his later oeuvre on conflictual social imaginaries, I propose an agonistic approach to the Future of Work. Not merely companies implementing workplace technologies, but also workers themselves possess agency in determining the Future of Work. Workers’ frequent contestations against machinic surveillance and technologically mediated coordination of the labour process disclose an alternative Future of Work in which technologies are used to enhance worker autonomy rather than bureaucratic control. Worker struggles at Amazon Mechanical Turk illustrate this agonistic dynamic: Amazon mobilizes algorithmic management to fragment and control a workforce of globally dispersed remote workers, but the latter form online social communities and create counter-technologies to reappropriate control over the labour process. (shrink)

There is growing need for hybrid curricula that integrate constructivist methods from Science and Technology Studies (STS) into both engineering and policy courses at the undergraduate and graduate levels. However, institutional and disciplinary barriers have made implementing such curricula difficult at many institutions. While several programs have recently been launched that mix technical training with consideration of “societal” or “ethical issues,” these programs often lack a constructivist element, leaving newly-minted practitioners entering practical fields ill-equipped to unpack the politics of knowledge (...) and technology or engage with skeptical publics. This paper presents a novel format for designing interdisciplinary coursework that combines conceptual content from STS with training in engineering and policy. Courses following this format would ideally be team taught by instructors with advanced training in diverse fields, and hence co-learning between instructors and disciplines is a key element of the format. Several instruments for facilitating both student and instructor collaborative learning are introduced. The format is also designed for versatility: in addition to being adaptable to both technical and policy training environments, topics are modularized around a conceptual core so that issues ranging from biotech to nuclear security can be incorporated to fit programmatic needs and resources. (shrink)

In anticipatory governance and responsible innovation, anticipation is a key theoretical and practical dimension for promoting a more responsible governance of new and emerging sciences and technologies. Yet, anticipation has been subjected to a range of criticisms, such that many now see it as unnecessary for AG and RI. According to Alfred Nordmann, practices engaging with ‘the future’, when performed under certain conditions, may reify the future, diminish our ability to see what is happening, and/or reproduce the illusion of control (...) over the future. Several authors have stressed that these critiques fail to capture the heterogeneous character of anticipatory practices, and yet research on the question of what particular kind of socio-epistemic engagements with ‘the future’ AG and RI aim to enact through anticipation remains fragmentary and their underlying rationale under-theorised. This article aims to advance the theoretical characterisation and problematisation of anticipation as key interventive tools for AG and RI. By distinguishing between four modes of anticipation and heuristically testing them against Nordmann’s critiques, the article argues that despite his assessment failing to recognise the heterogeneity of anticipatory practices considered valuable for AG and RI, it reinforces the relevance of performing certain modes of anticipatory exercises, namely critical-hermeneutic ones. Thus, anticipation continues to be a necessary heuristic dimension for AG and RI. More concretely, the article maintains that such anticipatory heuristics may find their radical constructive and critical-reflective character in the dynamics of inclusive scrutiny and negotiation about the plausibility and desirability of the envisioned or created futures. (shrink)

The implementation of care robotics in care settings is identified by some authors as a disruptive innovation, in the sense that it will upend the praxis of care. It is an open ethical question whether this alleged disruption will also have a transformative impact on established ethical concepts and principles. One prevalent worry is that the implementation of care robots will turn deception into a routine component of elderly care, at least to the extent that these robots will function as (...) simulacra for something that they are not (i.e. human caregivers). At face value, this may indeed seem to indicate a concern for how this technology may upend existing practices and relationships within a care setting. Yet, on closer inspection, this reaction may rather point to a rediscovery and a revaluation of a particularly well-entrenched value or virtue, i.e. veracity. The virtue of veracity is one of the values that is mobilized to argue against a substitution of human caregivers (while a combination of care robots and human caregivers is much more accepted). The subject of this paper is to explore how the moral panic surrounding care robots should not so much be interpreted as an anticipated and probable disruptor in a care setting, but rather as a sensitizing – in a way conservationist – argument that identifies veracity as an established value that is supposed to be protected and advanced in present day and future care settings. (shrink)

The emergence of the “4th Industrial Revolution,” i.e. the convergence of artificial intelligence, the Internet of Things, advanced materials, and bioengineering technologies, could accelerate socioeconomic insecurities and anxieties or provide beneficial alternatives to the status quo. In the post-Covid-19 era, the entities that are best positioned to capitalize on these innovations are large firms, which use digital platforms and big data to orchestrate vast ecosystems of users and extract market share across industry sectors. Nonetheless, these technologies also have the potential (...) to democratize ownership, broaden political-economic participation, and reduce environmental harms. We articulate the potential sociotechnical pathways in this high-stakes crossroads by analyzing cellular agriculture, an exemplary 4th Industrial Revolution technology that synergizes computer science, biopharma, tissue engineering, and food science to grow cultured meat, dairy, and egg products from cultured cells and/or genetically modified yeast. Our exploration of this space involved multi-sited ethnographic research in both the cellular agriculture community and alternative economic organizations devoted to open source licensing, member-owned cooperatives, social financing, and platform business models. Upon discussing how these latter approaches could potentially facilitate alternative sociotechnical pathways in cellular agriculture, we reflect upon the broader implications of this work with respect to the 4th Industrial Revolution and the enduring need for public policy reform. (shrink)