Research on the ethics of algorithms has grown substantially over the past decade. Alongside the exponential development and application of machine learning algorithms, new ethical problems and solutions relating to their ubiquitous use in society have been proposed. This article builds on a review of the ethics of algorithms published in 2016, 2016). The goals are to contribute to the debate on the identification and analysis of the ethical implications of algorithms, to provide an updated analysis of epistemic and normative (...) concerns, and to offer actionable guidance for the governance of the design, development and deployment of algorithms. (shrink)

It is well-known that racism is encoded into the social practices and institutions of medicine. Less well-known is that racism is encoded into the material artifacts of medicine. We argue that many medical devices are not merely biased, but materialize oppression. An oppressive device exhibits a harmful bias that reflects and perpetuates unjust power relations. Using pulse oximeters and spirometers as case studies, we show how medical devices can materialize oppression along various axes of social difference, including race, gender, class, (...) and ability. Our account uses political philosophy and cognitive science to give a theoretical basis for understanding materialized oppression, explaining how artifacts encode and carry oppressive ideas from the past to the present and future. Oppressive medical devices present a moral aggregation problem. To remedy this problem, we suggest redundantly layered solutions that are coordinated to disrupt reciprocal causal connections between the attitudes, practices, and artifacts of oppressive systems. (shrink)

Research on the ethics of algorithms has grown substantially over the past decade. Alongside the exponential development and application of machine learning algorithms, new ethical problems and solutions relating to their ubiquitous use in society have been proposed. This article builds on a review of the ethics of algorithms published in 2016, 2016). The goals are to contribute to the debate on the identification and analysis of the ethical implications of algorithms, to provide an updated analysis of epistemic and normative (...) concerns, and to offer actionable guidance for the governance of the design, development and deployment of algorithms. (shrink)

In a landmark essay, Andreas Matthias claimed that current developments in autonomous, artificially intelligent (AI) systems are creating a so-called responsibility gap, which is allegedly ever-widening and stands to undermine both the moral and legal frameworks of our society. But how severe is the threat posed by emerging technologies? In fact, a great number of authors have indicated that the fear is thoroughly instilled. The most pessimistic are calling for a drastic scaling-back or complete moratorium on AI systems, while the (...) optimists aim to show that the gap can be bridged nonetheless. Contrary to both camps, I argue against the prevailing assumption that there is a technology-based responsibility gap. I show how moral responsibility is a dynamic and flexible process, one that can effectively encompass emerging technological entities. (shrink)

Data‐driven algorithms are widely used to make or assist decisions in sensitive domains, including healthcare, social services, education, hiring, and criminal justice. In various cases, such algorithms have preserved or even exacerbated biases against vulnerable communities, sparking a vibrant field of research focused on so‐called algorithmic biases. This research includes work on identification, diagnosis, and response to biases in algorithm‐based decision‐making. This paper aims to facilitate the application of philosophical analysis to these contested issues by providing an overview of three (...) key topics: What is algorithmic bias? Why and how can it occur? What can and should be done about it? Throughout, we highlight connections—both actual and potential—with philosophical ideas and concerns. (shrink)

Organizations such as the EU High-Level Expert Group on AI and the IEEE have recently formulated ethical principles and (moral) values that should be adhered to in the design and deployment of artificial intelligence (AI). These include respect for autonomy, non-maleficence, fairness, transparency, explainability, and accountability. But how can we ensure and verify that an AI system actually respects these values? To help answer this question, I propose an account for determining when an AI system can be said to embody (...) certain values. This account understands embodied values as the result of design activities intended to embed those values in such systems. AI systems are here understood as a special kind of sociotechnical system that, like traditional sociotechnical systems, are composed of technical artifacts, human agents, and institutions but—in addition—contain artificial agents and certain technical norms that regulate interactions between artificial agents and other elements of the system. The specific challenges and opportunities of embedding values in AI systems are discussed, and some lessons for better embedding values in AI systems are drawn. (shrink)

Algorithms silently structure our lives. Algorithms can determine whether someone is hired, promoted, offered a loan, or provided housing as well as determine which political ads and news articles consumers see. Yet, the responsibility for algorithms in these important decisions is not clear. This article identifies whether developers have a responsibility for their algorithms later in use, what those firms are responsible for, and the normative grounding for that responsibility. I conceptualize algorithms as value-laden, rather than neutral, in that algorithms (...) create moral consequences, reinforce or undercut ethical principles, and enable or diminish stakeholder rights and dignity. In addition, algorithms are an important actor in ethical decisions and influence the delegation of roles and responsibilities within these decisions. As such, firms should be responsible not only for the value-laden-ness of an algorithm but also for designing who-does-what within the algorithmic decision. As such, firms developing algorithms are accountable for designing how large a role individual will be permitted to take in the subsequent algorithmic decision. Counter to current arguments, I find that if an algorithm is designed to preclude individuals from taking responsibility within a decision, then the designer of the algorithm should be held accountable for the ethical implications of the algorithm in use. (shrink)

In what way might public statues wrong people? In recent years, philosophers have drawn on speech act theory to answer this question by arguing that statues constitute harmful or disrespectful forms of speech. My aim in this paper will be add a different theoretical perspective to this discussion. I will argue that while the speech act approach provides a useful starting point for thinking about what is wrong with public statues, we can get a fuller understanding of these wrongs by (...) drawing on resources from recent work in situated affectivity. I will argue that public statues can be understood as affective artifacts and that this can both help us understand both the deep affective wrongs caused by public statues and offer a possible explanation as to why some people are so strongly opposed to their removal. (shrink)

The idea that technologies can change moral beliefs and practices is an old one. But how, exactly, does this happen? This paper builds on an emerging field of inquiry by developing a synoptic taxonomy of the mechanisms of techno-moral change. It argues that technology affects moral beliefs and practices in three main domains: decisional (how we make morally loaded decisions), relational (how we relate to others) and perceptual (how we perceive situations). It argues that across these three domains there are (...) six primary mechanisms of techno-moral change: (i) adding options; (ii) changing decision-making costs; (iii) enabling new relationships; (iv) changing the burdens and expectations within relationships; (v) changing the balance of power in relationships; and (vi) changing perception (information, mental models and metaphors). The paper also discusses the layered, interactive and second-order effects of these mechanisms. (shrink)

Selective permeability holds that people’s distinct capacities allow them to do different things in a space, making it unequally accessible. Though mainly applied to urban geography so far, we propose selective permeability as an affordance-based approach for understanding diversity in education. This has advantages. First, it avoids dismissing lower achievements as necessarily coming from “within” students, instead locating challenges in the environment. This implies that settings (not just people) need remedial attention, also raising questions about normative judgments in disability nomenclature. (...) Second, affordances can be negotiated in numerous ways to reach a goal, analogously to how people with missing arms have learned to drive with their feet, so restrictive problem-solving methods are often counterproductive. Third, our approach illuminates how cultural factors ranging from gait styles to language and hence group coordination modulate action possibilities, so that cultural groups may encounter objectively different affordances in the same classroom. But fourth, while fit with environment allows for skill refinement, non-fit can contribute to growth situations, which suggests a degree of selective closure can be desirable. Throughout, we argue social constructs—including educational ones—are literally built or enacted barriers or openings that have reality in environments in the same way that affordances do. (shrink)

This paper explores the important role of critical science, and in particular of post-colonial and decolonial theories, in understanding and shaping the ongoing advances in artificial intelligence. Artificial intelligence is viewed as amongst the technological advances that will reshape modern societies and their relations. While the design and deployment of systems that continually adapt holds the promise of far-reaching positive change, they simultaneously pose significant risks, especially to already vulnerable peoples. Values and power are central to this discussion. Decolonial theories (...) use historical hindsight to explain patterns of power that shape our intellectual, political, economic, and social world. By embedding a decolonial critical approach within its technical practice, AI communities can develop foresight and tactics that can better align research and technology development with established ethical principles, centring vulnerable peoples who continue to bear the brunt of negative impacts of innovation and scientific progress. We highlight problematic applications that are instances of coloniality, and using a decolonial lens, submit three tactics that can form a decolonial field of artificial intelligence: creating a critical technical practice of AI, seeking reverse tutelage and reverse pedagogies, and the renewal of affective and political communities. The years ahead will usher in a wave of new scientific breakthroughs and technologies driven by AI research, making it incumbent upon AI communities to strengthen the social contract through ethical foresight and the multiplicity of intellectual perspectives available to us, ultimately supporting future technologies that enable greater well-being, with the goal of beneficence and justice for all. (shrink)

According to the Value-Neutrality Thesis, technology is morally and politically neutral, neither good nor bad. A knife may be put to bad use to murder an innocent person or to good use to peel an apple for a starving person, but the knife itself is a mere instrument, not a proper subject for moral or political evaluation. While contemporary philosophers of technology widely reject the VNT, it remains unclear whether claims about values in technology are just a figure of speech (...) or nontrivial empirical claims with genuine factual content and real-world implications. This paper provides the missing argument. I argue that by virtue of their material properties, technological artifacts are part of the normative order rather than external to it. I illustrate how values can be empirically identified in technology. The reason why value-talk is not trivial or metaphorical is that due to the endurance and longevity of technological artifacts, values embedded in them have long-term implications that surpass their designers and builders. I further argue that taking sides in this debate has real-world implications in the form of moral constraints on the development of technology. (shrink)

This paper argues that although moral intuitions are insufficient for making judgments on new technological innovations, they maintain great utility for informing responsible innovation. To do this, this paper employs the Value Sensitive Design (VSD) methodology as an illustrative example of how stakeholder values can be better distilled to inform responsible innovation. Further, it is argued that moral intuitions are necessary for determining stakeholder values required for the design of responsible technologies. This argument is supported by the claim that the (...) moral intuitions of stakeholders allow designers to conceptualize stakeholder values and incorporate them into the early phases of design. It is concluded that design-for-values (DFV) frameworks like the VSD methodology can remain potent if developers adopt heuristic tools to diminish the influence of cognitive biases thus strengthening the reliability of moral intuitions. (shrink)

Technologies that deploy data science methods are liable to result in epistemic harms involving the diminution of individuals with respect to their standing as knowers or their credibility as sources of testimony. Not all harms of this kind are unjust but when they are we ought to try to prevent or correct them. Epistemically unjust harms will typically intersect with other more familiar and well-studied kinds of harm that result from the design, development, and use of data science technologies. However, (...) we argue that epistemic injustices can be distinguished conceptually from more familiar kinds of harm. We argue that epistemic harms are morally relevant even in cases where those who suffer them are unharmed in other ways. Via a series of examples from the criminal justice system, workplace hierarchies, and educational contexts we explain the kinds of epistemic injustice that can result from common uses of data science technologies. (shrink)

One of the primary, if not most critical, difficulties in the design and implementation of autonomous systems is the black-boxed nature of the decision-making structures and logical pathways. How human values are embodied and actualised in situ may ultimately prove to be harmful if not outright recalcitrant. For this reason, the values of stakeholders become of particular significance given the risks posed by opaque structures of intelligent agents (IAs). This paper explores how decision matrix algorithms, via the belief-desire-intention model for (...) autonomous vehicles, can be designed to minimize the risks of opaque architectures. Primarily through an explicit orientation towards designing for the values of explainability and verifiability. In doing so, this research adopts the Value Sensitive Design (VSD) approach as a principled framework for the incorporation of such values within design. VSD is recognized as a potential starting point that offers a systematic way for engineering teams to formally incorporate existing technical solutions within ethical design, while simultaneously remaining pliable to emerging issues and needs. It is concluded that the VSD methodology offers at least a strong enough foundation from which designers can begin to anticipate design needs and formulate salient design flows that can be adapted to the changing ethical landscapes required for utilisation in autonomous vehicles. (shrink)

According to some philosophers of technology, technology embodies moral values in virtue of its functional properties and the intentions of its designers. But this paper shows that such an account makes the values supposedly embedded in technology epistemically opaque and that it does not allow for values to change. Therefore, to overcome these shortcomings, the paper introduces the novel Affordance Account of Value Embedding as a superior alternative. Accordingly, artefacts bear affordances, that is, artefacts make certain actions likelier given the (...) circumstances. Based on an interdisciplinary perspective that invokes recent moral anthropology, I conceptualize affordances as response-dependent properties. That is, they depend on intrinsic as well as extrinsic properties of the artefact. We have reason to value these properties. Therefore, artefacts embody values and are not value-neutral, which has practical implications for the design of new technologies. (shrink)

STS research has devoted relatively little attention to the promotion and reception of science and technology by non-scientific actors and institutions. One consequence is that the relationship of science and technology to political power has tended to remain undertheorized. This article aims to fill that gap by introducing the concept of sociotechnical imaginaries. Through a comparative examination of the development and regulation of nuclear power in the US and South Korea, the article demonstrates the analytic potential of the imaginaries concept. (...) Although nuclear power and nationhood have long been imagined together in both countries, the nature of those imaginations has remained strikingly different. In the US, the state’s central move was to present itself as a responsible regulator of a potentially runaway technology that demands effective containment. In South Korea, the dominant imaginary was of atoms for development which the state not only imported but incorporated into its scientific, technological and political practices. In turn, these disparate imaginaries have underwritten very different responses to a variety of nuclear shocks and challenges, such as Three Mile Island (TMI), Chernobyl, and the spread of the anti-nuclear movement. (shrink)

The American justice system, from police departments to the courts, is increasingly turning to information technology for help identifying potential offenders, determining where, geographically, to allocate enforcement resources, assessing flight risk and the potential for recidivism amongst arrestees, and making other judgments about when, where, and how to manage crime. In particular, there is a focus on machine learning and other data analytics tools, which promise to accurately predict where crime will occur and who will perpetrate it. Activists and academics (...) have begun to raise critical questions about the use of these tools in policing contexts. In this chapter, I review the emerging critical literature on predictive policing and contribute to it by raising ethical questions about the use of predictive analytics tools to identify potential offenders. Drawing from work on the ethics of profiling, I argue that the much-lauded move from reactive to preemptive policing can mean wrongfully generalizing about individuals, making harmful assumptions about them, instrumentalizing them, and failing to respect them as full ethical persons. I suggest that these problems stem both from the nature of predictive policing tools and from the sociotechnical contexts in which they are implemented... (shrink)

This article explores the norms that govern regular users’ acts of sharing content on social networking sites. Many debates on how to counteract misinformation on Social Networking Sites focus on the epistemic norms of testimony, implicitly assuming that the users’ acts of sharing should fall under the same norms as those for posting original content. I challenge this assumption by proposing a non-epistemic interpretation of (mis) information sharing on social networking sites which I construe as infrastructures for forms of life (...) found online. Misinformation sharing belongs more in the realm of rumour spreading and gossiping rather than in the information-giving language games. However, the norms for sharing cannot be fixed in advance, as these emerge at the interaction between the platforms’ explicit rules, local norms established by user practices, and a meta-norm of sociality. This unpredictability does not leave us with a normative void as an important user responsibility still remains, namely that of making the context of the sharing gesture explicit. If users will clarify how their gestures of sharing are meant to be interpreted by others, they will implicitly assume responsibility for possible misunderstandings based on omissions, and the harms of shared misinformation can be diminished. (shrink)

This article connects value-sensitive design to Gibson’s affordance theory: the view that we perceive in terms of the ease or difficulty with which we can negotiate space. Gibson’s ideas offer a nonsubjectivist way of grasping culturally relative values, out of which we develop a concept of political affordances, here understood as openings or closures for social action, often implicit. Political affordances are equally about environments and capacities to act in them. Capacities and hence the severity of affordances vary with age, (...) health, social status and more. This suggests settings are selectively permeable, or what postphenomenologists call multistable. Multistable settings are such that a single physical location shows up differently – as welcoming or hostile – depending on how individuals can act on it. In egregious cases, authoritarian governments redesign politically imbued spaces to psychologically cordon both them and the ideologies they represent. Selective permeability is also orchestrated according to business interests, which is symptomatic of commercial imperatives increasingly dictating what counts as moral and political goods. (shrink)

Lethal Autonomous Weapons (LAWs) are robotic weapons systems, primarily of value to the military, that could engage in offensive or defensive actions without human intervention. This paper assesses and engages the current arguments for and against the use of LAWs through the lens of achieving more ethical warfare. Specific interest is given particularly to ethical LAWs, which are artificially intelligent weapons systems that make decisions within the bounds of their ethics-based code. To ensure that a wide, but not exhaustive, survey (...) of the implications of employing such ethical devices to replace humans in warfare is taken into account, this paper will engage on matters related to current scholarship on the rejection or acceptance of LAWs—including contemporary technological shortcomings of LAWs to differentiate between targets and the behavioral and psychological volatility of humans—and current and proposed regulatory infrastructures for developing and using such devices. After careful consideration of these factors, this paper will conclude that only ethical LAWs should be used to replace human involvement in war, and, by extension of their consistent abilities, should remove humans from war until a more formidable discovery is made in conducting ethical warfare. (shrink)

Recently, there is increased attention to the integration of moral values into the conception, design, and development of emerging IT. The most reviewed approach for this purpose in ethics and technology so far is Value-Sensitive Design (VSD). This article considers VSD as the prime candidate for implementing normative considerations into design. Its methodology is considered from a conceptual, analytical, normative perspective. The focus here is on the suitability of VSD for integrating moral values into the design of technologies in a (...) way that joins in with an analytical perspective on ethics of technology. Despite its promising character, it turns out that VSD falls short in several respects: (1) VSD does not have a clear methodology for identifying stakeholders, (2) the integration of empirical methods with conceptual research within the methodology of VSD is obscure, (3) VSD runs the risk of committing the naturalistic fallacy when using empirical knowledge for implementing values in design, (4) the concept of values, as well as their realization, is left undetermined and (5) VSD lacks a complimentary or explicit ethical theory for dealing with value trade-offs. For the normative evaluation of a technology, I claim that an explicit and justified ethical starting point or principle is required. Moreover, explicit attention should be given to the value aims and assumptions of a particular design. The criteria of adequacy for such an approach or methodology follow from the evaluation of VSD as the prime candidate for implementing moral values in design. (shrink)

Although artificial intelligence has been given an unprecedented amount of attention in both the public and academic domains in the last few years, its convergence with other transformative technologies like cloud computing, robotics, and augmented/virtual reality is predicted to exacerbate its impacts on society. The adoption and integration of these technologies within industry and manufacturing spaces is a fundamental part of what is called Industry 4.0, or the Fourth Industrial Revolution. The impacts of this paradigm shift on the human operators (...) who continue to work alongside and symbiotically with these technologies in the industry bring with it novel ethical issues. Therefore, how to design these technologies for human values becomes the critical area of intervention. This paper takes up the case study of robotic AI-based assistance systems to explore the potential value implications that emerge due to current design practices and use. The design methodology known as Value Sensitive Design (VSD) is proposed as a sufficient starting point for designing these technologies for human values to address these issues. (shrink)

Most engineers Fwork within social structures governing and governed by a set of values that primarily emphasise economic concerns. The majority of innovations derive from these loci. Given the effects of these innovations on various communities, it is imperative that the values they embody are aligned with those societies. Like other transformative technologies, artificial intelligence systems can be designed by a single organisation but be diffused globally, demonstrating impacts over time. This paper argues that in order to design for this (...) broad stakeholder group, engineers must adopt a systems thinking approach that allows them to understand the sociotechnicity of artificial intelligence systems across sociocultural domains. It claims that value sensitive design, and envisioning cards in particular, provides a solid first step towards helping designers harmonise human values, understood across spatiotemporal boundaries, with economic values, rather than the former coming at the opportunity cost of the latter. (shrink)

This article contemplates symbols and values inscribed on Cairo’s landscape during the 2011 revolution and the period since, focusing on Tahrir Square and the role of the Egyptian flag in street discourses there. I start by briefly pondering how intertwined popular narratives readied the square and flag as emblems of dissent. Next I examine how these appropriations shaped protests in the square, and how military authorities who retook control in 2013 re-coopted the square and flag, with the reabsorption of each (...) critical to that of the other and executed in the same place: Tahrir. Pro-military factions have created the pretense that they were for the revolution by altering the square and structures around it. Furthermore, the square has remained open to the public, but ceased to be inviting. This relates to post-revolutionary alterations that psychologically repel entry. I consider these changes in light of affordance theory, value sensitive design research and especially the defensible space model, arguing that Tahrir Square has been symbolically cordoned and closed. (shrink)

We propose a pragmatist account of value change that helps to understand how and why values sometimes change due to technological developments. Inspired by John Dewey’s writings on value, we propose to understand values as evaluative devices that carry over from earlier experiences and that are to some extent shared in society. We discuss the various functions that values fulfil in moral inquiry and propose a conceptual framework that helps to understand value change as the interaction between three manifestations of (...) value distinguished by Dewey, i.e., “immediate value,” “values as the result of inquiry” and “generalized values.” We show how this framework helps to distinguish three types of value change: value dynamism, value adaptation, and value emergence, and we illustrate these with examples from the domain of technology. We argue that our account helps to better understand how technology may induce value change, namely through the creation of what Dewey calls indeterminate situations, and we show how our account can integrate several insights on moral change offered by other authors. (shrink)

Ethicists differ considerably in their reasons for using empirical data. This paper presents a brief overview of four traditional approaches to the use of empirical data: “the prescriptive applied ethicists,” “the theorists,” “the critical applied ethicists,” and “the particularists.” The main aim of this paper is to introduce a fifth approach of more recent date (i.e. “integrated empirical ethics”) and to offer some methodological directives for research in integrated empirical ethics. All five approaches are presented in a table for heuristic (...) purposes. The table consists of eight columns: “view on distinction descriptive-prescriptive sciences,” “location of moral authority,” “central goal(s),” “types of normativity,” “use of empirical data,” “method,” “interaction empirical data and moral theory,” and “cooperation with descriptive sciences.” Ethicists can use the table in order to identify their own approach. Reflection on these issues prior to starting research in empirical ethics should lead to harmonization of the different scientific disciplines and effective planning of the final research design. Integrated empirical ethics (IEE) refers to studies in which ethicists and descriptive scientists cooperate together continuously and intensively. Both disciplines try to integrate moral theory and empirical data in order to reach a normative conclusion with respect to a specific social practice. IEE is not wholly prescriptive or wholly descriptive since IEE assumes an interdepence between facts and values and between the empirical and the normative. The paper ends with three suggestions for consideration on some of the future challenges of integrated empirical ethics. (shrink)

This paper provides a systematic literature review, analysis and discussion of methods that are proposed to practise ethics in research and innovation. Ethical considerations concerning the impacts of R&I are increasingly important, due to the quickening pace of technological innovation and the ubiquitous use of the outcomes of R&I processes in society. For this reason, several methods for practising ethics have been developed in different fields of R&I. The paper first of all presents a systematic search of academic sources that (...) present and discuss such methods. Secondly, it provides a categorisation of these methods according to three main kinds: ex ante methods, dealing with emerging technologies, intra methods, dealing with technology design, and ex post methods, dealing with ethical analysis of existing technologies. Thirdly, it discusses the methods by considering problems in the way they deal with the uncertainty of technological change, ethical technology design, the identification, analysis and resolving of ethical impacts of technologies and stakeholder participation. The results and discussion of our literature review are valuable for gaining an overview of the state of the art and serve as an outline of a future research agenda of methods for practising ethics in R&I. (shrink)

This paper explores how political theory may help us map algorithmic logics against different visions of the political. Drawing on Chantal Mouffe’s theories of agonistic pluralism, this paper depicts algorithms in public life in ten distinct scenes, in order to ask the question, what kinds of politics do they instantiate? Algorithms are working within highly contested online spaces of public discourse, such as YouTube and Facebook, where incompatible perspectives coexist. Yet algorithms are designed to produce clear “winners” from information contests, (...) often with little visibility or accountability for how those contests are designed. In isolation, many of these algorithms seem the opposite of agonistic: much of the complexity of search, ranking, and recommendation algorithms is nonnegotiable and kept far from view, inside an algorithmic “black box.” But what if we widen our perspective? This paper suggests agonistic pluralism as both a design ideal for engineers and a provocation to understand algorithms in a broader social context: rather than focusing on the calculations in isolation, we need to account for the spaces of contestation where they operate. (shrink)

The paper presents an ethical analysis and constructive critique of the current practice of AI ethics. It identifies conceptual substantive and procedural challenges and it outlines strategies to address them. The strategies include countering the hype and understanding AI as ubiquitous infrastructure including neglected issues of ethics and justice such as structural background injustices into the scope of AI ethics and making the procedures and fora of AI ethics more inclusive and better informed with regard to philosophical ethics. These measures (...) integrate the perspective of AI justice into AI ethics, strengthening its capacity to provide comprehensive normative orientation and guidance for the development and use of AI that actually improves human lives and living together. (shrink)

This paper contributes to our understanding of farm data value chains with assistance from 54 semi-structured interviews and field notes from participant observations. Methodologically, it includes individuals, such as farmers, who hold well-known positionalities within digital agriculture spaces—platforms that include precision farming techniques, farm equipment built on machine learning architecture and algorithms, and robotics—while also including less visible elements and practices. The actors interviewed and materialities and performances observed thus came from spaces and places inhabited by, for example, farmers, crop (...) scientists, statisticians, programmers, and senior leadership in firms located in the U.S. and Canada. The stability of “the” artifacts followed for this project proved challenging, which led to me rethinking how to approach the subject conceptually. The paper is animated by a posthumanist commitment, drawing heavily from assemblage thinking and critical data scholarship coming out of Science and Technology Studies. The argument’s understanding of “chains” therefore lies on an alternative conceptual plane relative to most commodity chain scholarship. To speak of a data value chain is to foreground an orchestrating set of relations among humans, non-humans, products, spaces, places, and practices. The paper’s principle contribution involves interrogating lock-in tendencies at different “points” along the digital farm platform assemblage while pushing for a varied understanding of governance depending on the roles of the actors and actants involved. (shrink)

Firms use algorithms to make important business decisions. To date, the algorithmic accountability literature has elided a fundamentally empirical question important to business ethics and management: Under what circumstances, if any, are algorithmic decision-making systems considered legitimate? The present study begins to answer this question. Using factorial vignette survey methodology, we explore the impact of decision importance, governance, outcomes, and data inputs on perceptions of the legitimacy of algorithmic decisions made by firms. We find that many of the procedural governance (...) mechanisms in practice today, such as notices and impact statements, do not lead to algorithmic decisions being perceived as more legitimate in general, and, consistent with legitimacy theory, that algorithmic decisions with good outcomes are perceived as more legitimate than bad outcomes. Yet, robust governance, such as offering an appeal process, can create a legitimacy dividend for decisions with bad outcomes. However, when arbitrary or morally dubious factors are used to make decisions, most legitimacy dividends are erased. In other words, companies cannot overcome the legitimacy penalty of using arbitrary or morally dubious factors, such as race or the day of the week, with a good outcome or an appeal process for individuals. These findings add new perspectives to both the literature on legitimacy and policy discussions on algorithmic decision-making in firms. (shrink)

Algorithms, or rather algorithmic actions, are seen as problematic because they are inscrutable, automatic, and subsumed in the flow of daily practices. Yet, they are also seen to be playing an important role in organizing opportunities, enacting certain categories, and doing what David Lyon calls “social sorting.” Thus, there is a general concern that this increasingly prevalent mode of ordering and organizing should be governed more explicitly. Some have argued for more transparency and openness, others have argued for more democratic (...) or value-centered design of such actors. In this article, we argue that governing practices—of, and through algorithmic actors—are best understood in terms of what Foucault calls governmentality. Governmentality allows us to consider the performative nature of these governing practices. They allow us to show how practice becomes problematized, how calculative practices are enacted as technologies of governance, how such calculative practices produce domains of knowledge and expertise, and finally, how such domains of knowledge become internalized in order to enact self-governing subjects. In other words, it allows us to show the mutually constitutive nature of problems, domains of knowledge, and subjectivities enacted through governing practices. In order to demonstrate this, we present attempts to govern academic writing with a specific focus on the algorithmic action of Turnitin. (shrink)

REVIEW (1): "Jeff Kochan’s book offers both an original reading of Martin Heidegger’s early writings on science and a powerful defense of the sociology of scientific knowledge (SSK) research program. Science as Social Existence weaves together a compelling argument for the thesis that SSK and Heidegger’s existential phenomenology should be thought of as mutually supporting research programs." (Julian Kiverstein, in Isis) ---- REVIEW (2): "I cannot in the space of this review do justice to the richness and range of Kochan's (...) discussion [...]. There is a great deal in this foundational portion of Kochan's discussion that I find tremendously interesting and engaging [...]." (David R. Cerbone, in Studies in History and Philosophy of Science) ---- REVIEW (3): "Science as Social Existence will be of interest not only to Heidegger scholars but to anyone engaged in science and technology studies. [...] This is an informative and original book. Kochan should be praised for his clear, pleasant-to-read prose." (Michael Butler, in CHOICE). (shrink)

While the ethics of technology is analyzed across disciplines from science and technology studies, engineering, computer science, critical management studies, and law, less attention is paid to the role that firms and managers play in the design, development, and dissemination of technology across communities and within their firm. Although firms play an important role in the development of technology, and make associated value judgments around its use, it remains open how we should understand the contours of what firms owe society (...) as the rate of technological development accelerates. We focus here on digital technologies: devices that rely on rapidly accelerating digital sensing, storage, and transmission capabilities to intervene in human processes. This symposium focuses on how firms should engage ethical choices in developing and deploying these technologies. In this introduction, we, first, identify themes the symposium articles share and discuss how the set of articles illuminate diverse facets of the intersection of technology and business ethics. Second, we use these themes to explore what business ethics offers to the study of technology and, third, what technology studies offers to the field of business ethics. Each field brings expertise that, together, improves our understanding of the ethical implications of technology. Finally we introduce each of the five papers, suggest future research directions, and interpret their implications for business ethics. (shrink)

This essay provides a critique of mainstream computer ethics and argues for the importance of a complementary approach called disclosive computer ethics, which is concerned with the moral deciphering of embedded values and norms in computer systems, applications and practices. Also, four key values are proposed as starting points for disclosive studies in computer ethics: justice, autonomy, democracy and privacy. Finally, it is argued that research in disclosive computer ethics should be multi-level and interdisciplinary, distinguishing between a disclosure level, a (...) theoretical level, and an an application level. (shrink)

Data increasingly drive our lives. Often presented as a new trajectory, the deep immersion of our lives in data has a history that is well over a century old. By revisiting the work of early pioneers of what would today be called data science, we can bring into view both assumptions that fund our data-driven moment as well as alternative relations to data. I here excavate insights by contrasting a seemingly unlikely pair of early data technologists, Francis Galton and W.E.B. (...) Du Bois. Galton, well known for his contributions to eugenics, was first and foremost a tinkering technician of measure. There are numerous domains of science over which Galtonian conceptions retain considerable influence, presumably without his pride in racial inequality. A more viable, because more egalitarian, alternative for the present can be found in the early data work of Du Bois. (shrink)

Three philosophical perspectives on the relation between technology and society are distinguished and discussed: 1) technology as an autonomous force that determines society; 2) technology as a human construct that can be shaped by human values, and 3) a co-evolutionary perspective on technology and society where neither of them determines the other. The historical evolution of the three perspectives is discussed and it is argued that all three are still present in current debates about technological change and how it may (...) affect society. This is illustrated for the case of Artificial Intelligence (AI). It is argued that each of the three perspectives contributes to the debate of AI but that the third has the strongest potential to uncover blind spots in the current debate. (shrink)

In response to calls for greater interdisciplinary involvement from the social sciences and humanities in the development, governance, and study of artificial intelligence systems, this paper presents one sociologist’s view on the problem of algorithmic bias and the reproduction of societal bias. Discussions of bias in AI cover much of the same conceptual terrain that sociologists studying inequality have long understood using more specific terms and theories. Concerns over reproducing societal bias should be informed by an understanding of the ways (...) that inequality is continually reproduced in society—processes that AI systems are either complicit in, or can be designed to disrupt and counter. The contrast presented here is between conservative and radical approaches to AI, with conservatism referring to dominant tendencies that reproduce and strengthen the status quo, while radical approaches work to disrupt systemic forms of inequality. The limitations of a conservative approach to racial bias are discussed through the specific example of biased criminal risk assessments and Indigenous overrepresentation in Canada’s criminal justice system. This illustrates the dangers of treating racial bias as a generalizable problem and equality as a generalizable solution, emphasizing the importance of considering inequality in context. Societal issues can no longer be out of scope for AI and machine learning, given the impact of these systems on human lives. This requires engagement with a growing body of critical AI scholarship that goes beyond biased data to analyze structured ways of perpetuating inequality, opening up the possibility for interdisciplinary engagement and radical alternatives. (shrink)

When the social relevance of robotic applications is addressed today, the use of assistive technology in care settings is almost always the first example. So-called care robots are presented as a solution to the nursing crisis, despite doubts about their technological readiness and the lack of concrete usage scenarios in everyday nursing practice. We inquire into this interconnection of social robotics and care. We show how both are made available for each other in three arenas: innovation policy, care organization, and (...) robotic engineering. First, we analyze the discursive “logics” of care robotics within European innovation policy, second, we disclose how care robotics is encountering a historically grown conflict within health care organization, and third we show how care scenarios are being used in robotic engineering. From this diagnosis, we derive a threefold critique of robotics in healthcare, which calls attention to the politics, historicity, and social situatedness of care robotics in elderly care. (shrink)

To commemorate 40 years since the founding of the Journal of Business Ethics, the editors in chief of the journal have invited the editors to provide commentaries on the future of business ethics. This essay comprises a selection of commentaries aimed at creating dialogue around the theme Technology, Megatrends and Work. Of all the profound changes in business, technology is perhaps the most ubiquitous. There is not a facet of our lives unaffected by internet technologies and artificial intelligence. The Journal (...) of Business Ethics established a dedicated section that focuses on Technology and Business Ethics, yet issues related to this phenomenon run right through all the sections. Kirsten Martin, editor of the Technology and Business Ethics section, joins our interim social media editor, Hannah Trittin-UIbrich, to advance a human-centric approach to the development and application of digital technologies that places Business Ethics at centre of the analysis. For Shuili Du, technology is the defining condition for a new era of Corporate Social Responsibility—CSR 3.0—which she defines as “a company’s socially responsible strategies and practices that deal with key ethical and socio-technical issues associated with AI and related technologies on the one hand and leverage the power of AI and related technologies to tackle social and environmental problems on the other hand.” It is not just technologies that are a determining feature of our lives but technology companies, an argument made by Glen Whelan as he examines Big Business and the need for a Big Business Ethics as we try to understand the impact of Big Tech on our post-work world. Indeed, as noted by Ernesto Noronha and Premilla D’Cruz, megatrends in addition to advancement in technologies, namely globalization, the greening of economies, and changes in demographics and migration, are shaping the future for workers in ways previously unimaginable. Contributing to this important debate, Praveen Parboteeah considers the influence of another longstanding but oft overlooked megatrend, the role of religion in the workplace. Given the enormity of the influence of technology and other megatrends in our world, it is not surprising that this essay introduces ground-breaking ideas that speak to the future of business ethics research. (shrink)

Information and communication technology is changing many aspects ofhuman endeavour and existence. This is beyond dispute for most. Whatare contested are the social and ethical implications of thesechanges. Possible sources of these disputes are the multiple ways inwhich one can conceptualize and interpret the informationtechnology/society interrelationship. Each of these ways ofconceptualization and interpretation enables one to see theinformation technology/society relationship differently and thereforeconstrue its social and ethical implications in a different manner. Atthe center of this technology/society interrelationship we find manycomplex (...) questions about the nature of the human, the technical,agency, autonomy, freedom and much more. This is indeed a vastintellectual landscape, which can obviously not be explored here inits fullness. This entry is about just one particular perspective onthis landscape. It is primarily concerned with the phenomenologicalapproach to interpreting information technology and its social andethical implications. It should be noted from the start that there isnot a unified phenomenological tradition or approach to informationtechnology in particular, or other phenomena more generally. Thephenomenological tradition consists of many different approaches thatshare certain characteristics but not all. We may however suggest, with Don Ihde,that they all accept that “phenomenology investigates theconditions of what makes things appear as such [as that which we takethem to be].” Differently stated, phenomenology suggests thatthere is a co-constitutive relationship between us and the phenomenawe encounter in our engagement with the world. In this sensephenomenologists would suggest that to understand thetechnology/society relationship we need to reveal how theyco-constitute each other—i.e. draw on each other for theirongoing meaning and sense. We will elaborate more precisely what thismeans in section 2 below. However, in order to understand the distinctiveness of thephenomenological approach other possible ways of interpreting thistechnology/society relationship will also be outlined brieflybelow., It can be said that information technology has become in a very realsense ubiquitous. Most everyday technologies such as elevators,automobiles, microwaves, watches, and so forth depend onmicroprocessors for their ongoing operation. Most organizations andinstitutions have become reliant on their information technologyinfrastructure to a lesser or greater degree. Indeed informationtechnology is seen by many as a cost-efficient way to solve amultitude of problems facing our complex contemporary society. One canalmost say that information technology has become construed as thedefault technology for solving a whole raft of technical and socialproblems such as health provision, security, governance, etc. Onecould also argue that it has become synonymous with society’sview of modernization and progress. For most it seems obvious thatinformation technology has made it possible for humans to continue toconstruct increasingly complex systems of coordination and socialordering—systems without which contemporary society would not beable to exist in its present form. To say the least, we, ascontemporary human beings, have our manner of being made possiblethrough a rather comprehensive entanglement with information andcommunication technology. Indeed, the economic, organizational andsocial benefit of information technology is not widely disputed. Thedispute is more often about the way information technology is changingor transforming the social domain, and in particular, the ethicaldomain. This dispute is largely centered around different ways ofconceptualizing and interpreting the nature of our entanglement withinformation technology. This debate is not merely an academic debateabout different and competing theoretical ‘models.’Rather, these different ways of conceptualizing it is central to ourunderstanding of how we go about managing our increasingly entangledrelationship with information technology. (shrink)

Neither traditional philosophy nor current applied ethics seem able to cope adequately with the highly dynamic character of our modern technological culture. This is because they have insufficient insight into the moral significance of technological artifacts and systems. Here, much can be learned from recent science and technology studies. They have opened up the black box of technological developments and have revealed the intimate intertwinement of technology and society in minute detail. However, while applied ethics is characterized by a certain (...) “technology blindness,” the most influential approaches within STS show a “normative deficit” and display an agnostic or even antagonistic attitude toward ethics. To repair the blind spots of both applied ethics and STS,the authors sketch the contours of a pragmatist approach. They will explore the tasks and tools of a pragmatist ethics and pay special attention to the exploration of future worlds disclosed and shaped by technology and the management of deep value conflicts inherent to a pluralist society. (shrink)

Artificial Intelligence (AI) is predicted to have a deep impact on the future of work and employment. The paper outlines a normative framework to understand and protect human freedom and justice in this transition. The proposed framework is based on four main ideas: going beyond the idea of a Basic Income to compensate the losers in the transition towards AI-driven work, towards a Responsible Innovation approach, in which the development of AI technologies is governed by an inclusive and deliberate societal (...) judgment; going beyond a philosophical conceptualisation of social justice only focused on the distribution of ‘primary goods’, towards one focused on the different goals, values, and virtues of various social practices (Walzer’s ‘spheres of justice’) and the different individual capabilities of persons (Sen’s ‘capabilities’); going beyond a classical understanding of capital, towards one explicitly including mental capacities as a source of value for AI-driven activities. In an effort to promote an interdisciplinary approach, the paper combines political and economic theories of freedom, justice and capital with recent approaches in applied ethics of technology, and starts applying its normative framework to some concrete example of AI-based systems: healthcare robotics, ‘citizen science’, social media and platform economy. (shrink)

Praised as a panacea for resolving all societal issues, and self-evidently presupposed as technological innovation, the concept of innovation has become the emblem of our age. This is especially reflected in the context of the European Union, where it is considered to play a central role in both strengthening the economy and confronting the current environmental crisis. The pressing question is how technological innovation can be steered into the right direction. To this end, recent frameworks of Responsible Innovation focus on (...) how to enable outcomes of innovation processes to become societally desirable and ethically acceptable. However, questions with regard to the technological nature of these innovation processes are rarely raised. For this reason, this paper raises the following research question: To what extent is RI possible in the current age, where the concept of innovation is predominantly presupposed as technological innovation? On the one hand, we depart from a post-phenomenological perspective to evaluate the possibility of RI in relation to the particular technological innovations discussed in the RI literature. On the other hand, we emphasize the central role innovation plays in the current age, and suggest that the presupposed concept of innovation projects a techno-economic paradigm. In doing so, we ultimately argue that in the attempt to steer innovation, frameworks of RI are in fact steered by the techno-economic paradigm inherent in the presupposed concept of innovation. Finally, we account for what implications this has for the societal purpose of RI. (shrink)

This chapter defends the view that manipulated behaviour is explained by an injustice. Injustices that explain manipulated behaviour need not involve agential features such as intentionality. Therefore, technology can manipulate us, even if technological artefacts like robots, intelligent software agents, or other ‘mere tools’ lack agential features such as intentionality. The chapter thus sketches a comprehensive account of manipulated behaviour related to but distinct from existing accounts of manipulative behaviour. It then builds on that account to defend the possibility that (...) we are being manipulated by technology. (shrink)

Most accounts of responsibility focus on one type of responsibility, moral responsibility, or address one particular aspect of moral responsibility such as agency. This article outlines a broader framework to think about responsibility that includes causal responsibility, relational responsibility, and what I call “narrative responsibility” as a form of “hermeneutic responsibility”, connects these notions of responsibility with different kinds of knowledge, disciplines, and perspectives on human being, and shows how this framework is helpful for mapping and analysing how artificial intelligence (...) (AI) challenges human responsibility and sense-making in various ways. Mobilizing recent hermeneutic approaches to technology, the article argues that next to, and interwoven with, other types of responsibility such as moral responsibility, we also have narrative and hermeneutic responsibility—in general and for technology. For example, it is our task as humans to make sense of, with and, if necessary, against AI. While from a posthumanist point of view, technologies also contribute to sense-making, humans are the experiencers and bearers of responsibility and always remain in charge when it comes to this hermeneutic responsibility. Facing and working with a world of data, correlations, and probabilities, we are nevertheless condemned to make sense. Moreover, this also has a normative, sometimes even political aspect: acknowledging and embracing our hermeneutic responsibility is important if we want to avoid that our stories are written elsewhere—through technology. (shrink)