Various approaches have emerged over the last several decades to meet the challenges and complexities of anticipating and responding to the potential impacts of emerging technologies. Although many of the existing approaches share similarities, they each have shortfalls. This paper takes as the object of its study Anticipatory Ethics for Emerging Technologies (ATE) to technology assessment, given that it was formatted to address many of the privations characterising parallel approaches. The ATE approach, also in practice, presents certain areas for retooling, (...) such as how it characterises levels and objects of analysis. This paper results from the work done with the TechEthos Horizon 2020 project in evaluating the ethical, legal, and social impacts of climate engineering, digital extended reality, and neurotechnologies. To meet the challenges these technology families present, this paper aims to enhance the ATE framework to encompass the variety of human processes and material forms, functions, and applications that comprise the socio-technical systems in which these technologies are embedded. (shrink)

Embedding ethics modules within computer science courses has become a popular response to the growing recognition that CS programs need to better equip their students to navigate the ethical dimensions of computing technologies like AI, machine learning, and big data analytics. However, the popularity of this approach has outpaced the evidence of its positive outcomes. To help close that gap, this empirical study reports positive results from Northeastern’s program that embeds values analysis modules into CS courses. The resulting data suggest (...) that such modules have a positive effect on students’ moral attitudes and that students leave the modules believing they are more prepared to navigate the ethical dimensions they’ll likely face in their eventual careers. Importantly, these gains were accomplished at an institution without a philosophy doctoral program, suggesting this strategy can be effectively employed by a wider range of institutions than many have thought. (shrink)

Ample scholarship demonstrates that data-intensive technologies have the capacity to cause serious harm and that their developers are obliged to address ethics in their work. This ethnographic paper tells the story of data scientists attempting to instantiate a carefully considered ethical vision into a data infrastructure while balancing competing priorities, negotiating divergent interests, and wrestling with contrasting values. I use their story to develop the concept of “ethical abduction,” which I characterize as an exemplary process by which actors can intentionally (...) and systematically address ethical issues that arise during their day-to-day actions by making decisions with consideration for a foundational ethical worldview. It entails tacking back and forth between divergent but complementary ways of thinking: between establishing ideals and making decisions given practical constraints; between understanding historical context and anticipating future consequences; between acknowledging structural dependencies and accepting responsibility for moral agency. (shrink)

Part of understanding the meaning and power of algorithms means asking what new demands they might make of ethical frameworks, and how they might be held accountable to ethical standards. I develop a definition of networked information algorithms as assemblages of institutionally situated code, practices, and norms with the power to create, sustain, and signify relationships among people and data through minimally observable, semiautonomous action. Starting from Merrill’s prompt to see ethics as the study of “what we ought to do,” (...) I examine ethical dimensions of contemporary NIAs. Specifically, in an effort to sketch an empirically grounded, pragmatic ethics of algorithms, I trace an algorithmic assemblage’s power to convene constituents, suggest actions based on perceived similarity and probability, and govern the timing and timeframes of ethical action. (shrink)

To put frameworks of Responsible Innovation and Responsible Research and Innovation (R(R)I) into practice, engagement methods have been developed to study and enhance technoscientific experts’ capacities to reflexively address value considerations in their work. These methods commonly rely on engagement between technoscientific experts and social scholars, which makes them vulnerable to structural barriers to interdisciplinary collaboration. To circumvent these barriers, we adapt Socio-Technical Integration Research (STIR) for broader use within technoscientific communities. We call this adaptation: reflexive practitioner dialogues. While the (...) primary aim of this article is to introduce and explain the methodological adaptation, we also analyze results from a pilot study with participants who are involved in research on contemplative practices such as mindfulness meditation. The analysis is guided by research questions that sought to assess whether and under what conditions the practitioner dialogues support reflexive and practical engagement with value considerations in participants’ work. The results indicate that reflexive practitioner dialogues can stimulate reflexive awareness of value conflicts and help re-direct decision-making responsively. We characterize the conditions facilitating such responsiveness as “value exnovators,” highlighting the oft-unacknowledged interpersonal relational practices that support collaborative engagement with value considerations. We suggest that “exnovation”—exposing the strengths of given practices for their improvement—can support R(R)I practices by directing analytical attention to their micro-level carriers. (shrink)

The ethics of artificial intelligence is a widely discussed topic. There are numerous initiatives that aim to develop the principles and guidance to ensure that the development, deployment and use of AI are ethically acceptable. What is generally unclear is how organisations that make use of AI understand and address these ethical issues in practice. While there is an abundance of conceptual work on AI ethics, empirical insights are rare and often anecdotal. This paper fills the gap in our current (...) understanding of how organisations deal with AI ethics by presenting empirical findings collected using a set of ten case studies and providing an account of the cross-case analysis. The paper reviews the discussion of ethical issues of AI as well as mitigation strategies that have been proposed in the literature. Using this background, the cross-case analysis categorises the organisational responses that were observed in practice. The discussion shows that organisations are highly aware of the AI ethics debate and keen to engage with ethical issues proactively. However, they make use of only a relatively small subsection of the mitigation strategies proposed in the literature. These insights are of importance to organisations deploying or using AI, to the academic AI ethics debate, but maybe most valuable to policymakers involved in the current debate about suitable policy developments to address the ethical issues raised by AI. (shrink)

The US National Institute of Health’s Human Microbiome Project aims to use genomic techniques to understand the microbial communities that live on the human body. The emergent field of microbiome science brought together diverse disciplinary perspectives and technologies, thus facilitating the negotiation of differing values. Here, we describe how values are conceptualized and negotiated within microbiome research. Analyzing discussions from a series of interdisciplinary workshops conducted with microbiome researchers, we argue that negotiations of epistemic, social, and institutional values were inextricable (...) from the reflective and strategic category work that defined and organized the microbiome as an object of study and a potential future site of biomedical intervention. Negotiating the divergence or tension between emerging scientific and regulatory classifications also activated “values levers” and opened up reflective discussions of how classifications embody values and how these values might differ across domains. These data suggest that scholars at the intersections of science and technology studies, ethics, and policy could leverage such openings to identify and intervene in the ways that ethical/regulatory and scientific/technical practices are coproduced within unfolding research. (shrink)

This paper argues that although moral intuitions are insufficient for making judgments on new technological innovations, they maintain great utility for informing responsible innovation. To do this, this paper employs the Value Sensitive Design (VSD) methodology as an illustrative example of how stakeholder values can be better distilled to inform responsible innovation. Further, it is argued that moral intuitions are necessary for determining stakeholder values required for the design of responsible technologies. This argument is supported by the claim that the (...) moral intuitions of stakeholders allow designers to conceptualize stakeholder values and incorporate them into the early phases of design. It is concluded that design-for-values (DFV) frameworks like the VSD methodology can remain potent if developers adopt heuristic tools to diminish the influence of cognitive biases thus strengthening the reliability of moral intuitions. (shrink)

Though rapid collection of big data is ubiquitous across domains, from industry settings to academic contexts, the ethics of big data collection and research are contested. A nexus of data ethics issues is the concept of creep, or repurposing of data for other applications or research beyond the conditions of original collection. Data creep has proven controversial and has prompted concerns about the scope of ethical oversight. Institutional review boards offer little guidance regarding big data, and problematic research can still (...) meet ethical standards. While ethics seem concrete through institutional deployment, I frame ethics as produced. Informed by my ethnographic research at a large public university in the U.S., I explore ethics through two models: ethics as institutional procedures and ethics as acts and intentions. The university where I conducted fieldwork is the development grounds for a predictive model that uses student data to anticipate academic success. While students consent to data collection, the circumstances of consent and the degree to which they are informed are not so apparent, as many data are a product of creep. Drawing from interviews and participant observation with administrators, data scientists, developers, and students, I examine data ethics, from a larger institutional model to everyday enactments related to data creep. After demonstrating the limits of such models, I propose a remodeling of ethics that draws on recent works on data, justice, and refusal to pose generative questions for rethinking ethics in institutional contexts. (shrink)

Reports from integrative researchers who have followed calls for sociotechnical integration emphasize that the potential of interdisciplinary collaboration to inflect the social shaping of technoscience is often constrained by their liminal position. Integrative researchers tend to be positioned as either adversarial outsiders or co-opted insiders. In an attempt to navigate these dynamics, we show that attending to affective disturbances can open up possibilities for productive engagements across disciplinary divides. Drawing on the work of Helen Verran, we analyze “disconcertment” in three (...) sociotechnical integration research studies. We develop a heuristic that weaves together disconcertment, affective labor, and responsivity to analyze the role of the body in interdisciplinary collaborations. We draw out how bodies do affective labor when generating responsivity between collaborators in moments of disconcertment. Responsive bodies can function as sensors, sources, and processors of disconcerting experiences of difference. We further show how attending to disconcertment can stimulate methodological choices to recognize, amplify, or minimize the difference between collaborators. Although these choices are context-dependent, each one examined generates responsivity that supports collaborators to readjust the technical in terms of the social. This analysis contributes to science and technology studies scholarship on the role of affect in successes and failures of interdisciplinary collaboration. (shrink)

A variety of approaches have appeared in academic literature and in design practice representing “ethics-first” methods. These approaches typically focus on clarifying the normative dimensions of design, or outlining strategies for explicitly incorporating values into design. While this body of literature has developed considerably over the last 20 years, two themes central to the endeavour of ethics and values in design (E + VID) have yet to be systematically discussed in relation to each other: (a) designer agency, and (b) the (...) strength of normative claims informing the design process. To address this gap, we undertook a structured review of leading E + VID approaches and critiques, and classified them according to their positions on normative strength, and views regarding designer agency. We identified 18 distinct approaches and 13 critiques that met the inclusion criteria for our review. Included papers were distributed across the spectrum of views regarding normative strength, and we found that no approaches and only one critique represented a view characteristic of “low” designer agency. We suggest that the absence of “low” designer agency approaches results in the neglect of crucial influences on design as targets of intervention by designers. We conclude with suggestions for future research that might illuminate strategies to achieve ethical design in information mature societies, and argue that without attending to the tensions raised by balancing normatively “strong” visions of the future with limitations imposed on designer agency in corporate-driven design settings, “meaningful” ethical design will continue to encounter challenges in practice. (shrink)

In this article, we first offer a model of design knowledge types and their interrelationships in value sensitive design. Then we demonstrate that value sensitive design is a formative framework, which provides a shaping influence on practice, enables creative appropriation, and supports theory and method development.

Academia-intelligence agency collaborations are on the rise for a variety of reasons. These can take many forms, one of which is in the classroom, using students to stand in for intelligence analysts. Classrooms, however, are ethically complex spaces, with students considered vulnerable populations, and become even more complex when layering multiple goals, activities, tools, and stakeholders over those traditionally present. This does not necessarily mean one must shy away from academia-intelligence agency partnerships in classrooms, but that these must be conducted (...) carefully and reflexively. This paper hopes to contribute to this conversation by describing one purposeful classroom encounter that occurred between a professor, students, and intelligence practitioners in the fall of 2015 at North Carolina State University: an experiment conducted as part of a graduate-level political science class that involved students working with a prototype analytic technology, a type of participatory sensing/self-tracking device, developed by the National Security Agency. This experiment opened up the following questions that this paper will explore: What social, ethical, and pedagogical considerations arise with the deployment of a prototype intelligence technology in the college classroom, and how can they be addressed? How can academia-intelligence agency collaboration in the classroom be conducted in ways that provide benefits to all parties, while minimizing disruptions and negative consequences? This paper will discuss the experimental findings in the context of ethical perspectives involved in values in design and participatory/self-tracking data practices, and discuss lessons learned for the ethics of future academia-intelligence agency partnerships in the classroom. (shrink)

Discourses on Responsible Innovation and Responsible Research and Innovation, in short RI, have revolved around but not elaborated on the notion of critique. In this article, generative critique is introduced to RI as a practice that sits in-between adversarial armchair critique and co-opted, uncritical service. How to position oneself and be positioned on this spectrum has puzzled humanities scholars and social scientists who engage in interdisciplinary collaborations with scientists, engineers, and other professionals. Recently, generative critique has been presented as a (...) solution to the puzzle in interdisciplinary collaborations on neuroscientific experiments. Generative critique seeks to create connections across disciplines that help remake seemingly stable objects in moments when taken-for-granted ways of seeing and approaching objects are unsettled. In order to translate generative critique from the neurosciences to RI, socio-technical integration research is proposed as a practice of generative critique in interdisciplinary RI collaborations. These collaborations aim to account for societal aspects in research and technology development. For this purpose, a variety of approaches have been developed, including STIR and video-reflexive ethnography. STIR and VRE resemble each other but diverge on affective, collaborative, and temporal dimensions. Their juxtaposition serves to develop suggestions for how STIR could be modified on these dimensions to better enact generative critique in interdisciplinary RI collaborations. In this way, the article contributes to ongoing discussions in RI and in the engaged programme in science and technology studies more broadly on the dynamics of positioning in collaborative work. (shrink)

Privacy is a critical challenge for corporate social responsibility in the mobile device ecosystem. Mobile application firms can collect granular and largely unregulated data about their consumers, and must make ethical decisions about how and whether to collect, store, and share these data. This paper conducts a discourse analysis of mobile application developer forums to discover when and how privacy conversations, as a representative of larger ethical debates, arise during development. It finds that online forums can be useful spaces for (...) ethical deliberations, as developers use these spaces to define, discuss, and justify their values. It also discovers that ethical discussions in mobile development are prompted by work practices which vary considerably between iOS and Android, today’s two major mobile platforms. For educators, regulators, and managers interested in encouraging more ethical discussion and deliberation in mobile development, these work practices provide a valuable point of entry. But while the triggers for privacy conversations are quite different between platforms, ultimately the justifications for privacy are similar. Developers for both platforms use moral and cautionary tales, moral evaluation, and instrumental and technical rationalization to justify and legitimize privacy as a value in mobile development. Understanding these three forms of justification for privacy is useful to educators, regulators, and managers who wish to promote ethical practices in mobile development. (shrink)

It is widely accepted that translational research practitioners need to acquire special skills and knowledge that will enable them to anticipate, analyze, and manage a range of ethical issues. While there is a small but growing literature that addresses the ethics of translational research, there is a dearth of scholarship regarding how this might apply to engineers. In this paper we examine engineers as key translators and argue that they are well positioned to ask transformative ethical questions. Asking engineers to (...) both broaden and deepen their consideration of ethics in their work, however, requires a shift in the way ethics is often portrayed and perceived in science and engineering communities. Rather than interpreting ethics as a roadblock to the success of translational research, we suggest that engineers should be encouraged to ask questions about the socio-ethical dimensions of their work. This requires expanding the conceptual framework of engineering beyond its traditional focus on “how” and “what” questions to also include “why” and “who” questions to facilitate the gathering of normative, socially-situated information. Empowering engineers to ask “why” and “who” questions should spur the development of technologies and practices that contribute to improving health outcomes. (shrink)

Contemporary design practices, such as participatory design, human-centered design, and codesign, have inherent ethical qualities, which often remain implicit and unexamined. Three design projects in the high-tech industry were studied using three ethical traditions as lenses. Virtue ethics helped to understand cooperation, curiosity, creativity, and empowerment as virtues that people in PD need to cultivate, so that they can engage, for example, in mutual learning and collaborative prototyping. Ethics of alterity helped to understand human-centered design as a fragile encounter between (...) project team members and prospective users, and foregrounds the ethics in these encounters: our tendencies to “grasp the other” and to “program invention.” And pragmatist ethics helped to understand codesign as a process of joint inquiry and imagination, involving the organization of iterative processes of problem setting and solution finding, with moral qualities. When we open the “black boxes” of design practices, we find them filled with ethics. Moreover, it is proposed that design practitioners need to make explicit their practices’ inherent ethical qualities and that they can do that by embracing reflexivity. (shrink)

Internet protocol development is a social process, and resulting protocols are shaped by their developers’ politics and values. This article argues that the work of protocol development poses barriers to developers’ reflection upon values and politics in protocol design. A participant observation of a team developing internet protocols revealed that difficulties defining the stakeholders in an infrastructure and tensions between local and global viewpoints both complicated values reflection. Further, Internet architects tended to equate a core value of interoperability with values (...) neutrality. The article describes how particular work practices within infrastructure development overcame these challenges by engaging developers in praxis: situated, lived experience of the social nature of technology. (shrink)

There is growing consensus that teaching computer ethics is important, but there is little consensus on how to do so. One unmet challenge is increasing the capacity of computing students to make decisions about the ethical challenges embedded in their technical work. This paper reports on the design, testing, and evaluation of an educational simulation to meet this challenge. The privacy by design simulation enables more relevant and effective computer ethics education by letting students experience and make decisions about common (...) ethical challenges encountered in real-world work environments. This paper describes the process of incorporating empirical observations of ethical questions in computing into an online simulation and an in-person board game. We employed theValues at Playframework to transform empirical observations of design into a playable educational experience. First, we conducted qualitative research to discover when and how values levers—practices that encourage values discussions during technology development—occur during the design of new mobile applications. We then translated these findings into gameplay elements, including the goals, roles, and elements of surprise incorporated into a simulation. We ran the online simulation in five undergraduate computer and information science classes. Based on this experience, we created a more accessible board game, which we tested in two undergraduate classes and two professional workshops. We evaluated the effectiveness of both the online simulation and the board game using two methods: a pre/post-test of moral sensitivity based on the Defining Issues Test, and a questionnaire evaluating student experience. We found that converting real-world ethical challenges into a playable simulation increased student’s reported interest in ethical issues in technology, and that students identified the role-playing activity as relevant to their technical coursework. This demonstrates that roleplaying can emphasize ethical decision-making as a relevant component of technical work. (shrink)

The technical details of Internet architecture affect social debates about privacy and autonomy, intellectual property, cybersecurity, and the basic performance and reliability of Internet services. This paper explores one method for practicing anticipatory ethics in order to understand how a new infrastructure for the Internet might impact these social debates. This paper systematically examines values expressed by an Internet architecture engineering team—the Named Data Networking project—based on data gathered from publications and internal documents. Networking engineers making technical choices also weigh (...) non-technical values when working on Internet infrastructure. Analysis of the team’s documents reveals both values invoked in response to technical constraints and possibilities, such as efficiency and dynamism, as well as values, including privacy, security and anonymity, which stem from a concern for personal liberties. More peripheral communitarian values espoused by the engineers include democratization and trust. The paper considers the contextual and social origins of these values, and then uses them as a method of practicing anticipatory ethics: considering the impact such priorities may have on a future Internet. (shrink)

This paper aims to contribute to the development of tools to support an analysis of Big Data as manifestations of social processes and human behaviour. Such a task demands both an understanding of the epistemological challenge posed by the Big Data phenomenon and a critical assessment of the offers and promises coming from the area of Big Data analytics. This paper draws upon the critical social and data scientists’ view on Big Data as an epistemological challenge that stems not only (...) from the sheer volume of digital data but, predominantly, from the proliferation of the narrow-technological and the positivist views on data. Adoption of the social-scientific epistemological stance presupposes that digital data was conceptualised as manifestations of the social. In order to answer the epistemological challenge, social scientists need to extend the repertoire of social scientific theories and conceptual frameworks that may inform the analysis of the social in the age of Big Data. However, an ‘epistemological revolution’ discourse on Big Data may hinder the integration of the social scientific knowledge into the Big Data analytics. (shrink)

The Internet was conceptualized as a technology that would be capable of bringing about a better future, but recent literature in science and technology studies and adjacent fields provides numerous examples of how this pervasive sociotechnical system has been shaped and used to dystopic ends. This article examines different future imaginaries present in Future Internet Architecture projects funded by the National Science Foundation from 2006 to 2016, whose goal was to incorporate social values while building new protocols to replace Transmission (...) Control Protocol and Internet Protocol to transfer and route information across the ever-expanding Internet. I examine the findings from two of the NSF’s FIA projects—Mobility First and eXpressive Internet Architecture—to understand the projects’ trajectories and values directives through their funding cycle and their projections into the future. I discuss how project documentation and participant articulations fall into the following three distinct themes about past experience and speculation: understanding the public, negotiating resources, and carrying project values into the future. I conclude that if the future Internet is to promote positive sociotechnical relationships, its architects must recognize that complex social and political decisions pervade each step of technical work and do more to honor this fact. (shrink)

Academia-intelligence agency collaborations are on the rise for a variety of reasons. These can take many forms, one of which is in the classroom, using students to stand in for intelligence analysts. Classrooms, however, are ethically complex spaces, with students considered vulnerable populations, and become even more complex when layering multiple goals, activities, tools, and stakeholders over those traditionally present. This does not necessarily mean one must shy away from academia-intelligence agency partnerships in classrooms, but that these must be conducted (...) carefully and reflexively. This paper hopes to contribute to this conversation by describing one purposeful classroom encounter that occurred between a professor, students, and intelligence practitioners in the fall of 2015 at North Carolina State University: an experiment conducted as part of a graduate-level political science class that involved students working with a prototype analytic technology, a type of participatory sensing/self-tracking device, developed by the National Security Agency. This experiment opened up the following questions that this paper will explore: What social, ethical, and pedagogical considerations arise with the deployment of a prototype intelligence technology in the college classroom, and how can they be addressed? How can academia-intelligence agency collaboration in the classroom be conducted in ways that provide benefits to all parties, while minimizing disruptions and negative consequences? This paper will discuss the experimental findings in the context of ethical perspectives involved in values in design and participatory/self-tracking data practices, and discuss lessons learned for the ethics of future academia-intelligence agency partnerships in the classroom. (shrink)

This paper reports on a two-year, field-based study set in a charter management organization, a not-for-profit educational organization that operates 18 public schools exclusively in the Black and Latinx communities of South and East Los Angeles. At CMO-LAX, the nine-member Data Team pursues the organization's avowed mission of making public schools data-driven, primarily through the aggregation, analysis, and visualization of digital data derived from quotidian educational activities. This paper draws on the theory of racialized organizations to characterize aspects of data-driven (...) management of public education as practiced by CMO-LAX. I explore two examples of how CMO-LAX shapes data to support racial projects: the reconstruction of the figure of chronic truants and the incorporation of this figure in a calculative regime of student accomplishment. Organizational uses of data support a strategy I call productive myopia, a way of pursuing racial projects via seemingly independent, objective quantifications. This strategy allows the organization to claim to mitigate racial projects and, simultaneously, to accommodate them. This paper concludes by arguing for approaches to research and practice that center racial projects, particularly when data-intensive tools and platforms are incorporated into the provision of public goods and services such as education. (shrink)