Much bioethical literature and policy guidances for big data analytics in biomedical research emphasize the importance of trust. It is essential that potential participants trust so they will allow their data to be used to further research. However, comparatively, little guidance is offered as to what trustworthy oversight mechanisms are, or how policy should support them, as data are collected, shared, and used. Generally, “trust” is not characterized well enough, or meaningfully enough, for the term to be systematically applied in (...) policy development. Yet points made in the philosophical literature on trust can help. They allow us, not only to better distinguish the different ways the term “trust” may be interpreted, but also to better determine how different approaches to trust can align with policy and governance—in what ways they may relate to key bioethical concepts and related laws, and in what ways they can help to balance individual and group interests in data sharing. This article draws from the philosophical literature on trust to identify a relationship among consent, trust, and justice. Specifically, parallels are drawn between “character-trustworthiness” and “natural justice,” a set of widely held legal safeguards intended to ensure decision-makers follow a pattern of procedural fairness which protects the rights of the individual and thereby maintains public confidence in the decision-making process. Relevance to traditional bioethical principles, established laws, and consent procedures are addressed throughout. In conclusion, policy actions are suggested. (shrink)

Electricity is hidden within wires and networks only revealing its quantity and flow when metered. The making of its properties into data is therefore particularly important to the relations that are formed around electricity as a produced and managed phenomenon. We propose approaching all metering as a situated activity, a form of quantification work in which data is made and becomes mobile in particular spatial and temporal terms, enabling its entry into data infrastructures and schemes of evaluation and value production. (...) We interrogate the transition from the pre-digital into the making of bigger, more spatiotemporally granular electricity data, through focusing on those actors selling and materialising new metering technologies, data infrastructures and services for larger businesses and public sector organisations in the UK. We examine the claims of truth and visibility that accompany these shifts and their enrolment into management techniques that serve to more precisely apportion responsibility for, and evaluate the status of, particular patterns and instances of electricity use. We argue that whilst through becoming Big Data electricity flow is now able to be known and given identity in significantly new terms, enabling new relations to be formed with the many heterogeneous entities implicated in making and managing energy demand, it is necessary to sustain some ambivalence as to the performative consequences that follow for energy governance. We consider the wider application of our conceptualisation of metering, reflecting on comparisons with the introduction of new metering systems in domestic settings and as part of other infrastructural networks. (shrink)

This article explores how the shift from print to electronic calendars materializes and exacerbates a distinctively quantitative, “spreadsheet” orientation to time. Drawing on interviews with engineers, I argue that calendaring systems are emblematic of a larger design rationale in Silicon Valley to mechanize human thought and action in order to make them more efficient and reliable. The belief that technology can be profitably employed to control and manage time has a long history and continues to animate contemporary sociotechnical imaginaries of (...) what automation will deliver. In the current moment we live in the age of the algorithm and machine learning, so it is no wonder, then, that the contemporary design of digital calendars is driven by a vision of intelligent time management. As I go on to show in the second part of the article, this vision is increasingly realized in the form of intelligent digital assistants whose tracking capacities and behavioral algorithms aim to solve life’s existential problem—how best to organize the time of our lives. This article contributes to STS scholarship on the role of technological artifacts in generating new temporalities that shape people’s perception of time, how they act in the world, and how they understand themselves. (shrink)

Galleries, libraries, archives and museums are striving to retain audience attention to issues related to cultural heritage, by implementing various novel opportunities for audience engagement through technological means online. Although born-digital assets for cultural heritage may have inundated the Internet in some areas, most of the time they are stored in “digital warehouses,” and the questions of the digital ecosystem’s sustainability, meaningful public participation and creative reuse of data still remain. Emerging technologies, such as artificial intelligence, are used to bring (...) born-digital archives to light, aiming to enhance the public’s engagement and participation. At the core of this debate lies both the openness of data and issues of privacy. How open to the public should born-digital archives be? Should everything be open and available online, and what does it take to achieve balance between openness and privacy, especially through AI initiatives? The study is qualitative and builds on the rationale of grounded theory. The role of AI development is critically investigated in relation to opening up born-digital archives online, by considering privacy and ethics issues. Grounded in the context of the author’s PhD research, the paper proposes a human-centred approach to AI development for democratising its development towards fairness and social inclusion, contrary to the stereotypical cliché of blackboxing, allowing space for the plurality of born-digital archives to flourish. (shrink)

Information security governance has become an elusive goal and a murky concept. This paper problematizes both information security governance and the broader concept of governance. What does it mean to govern information security, or for that matter, anything? Why have information technologies proven difficult to govern? And what assurances can governance provide for the billions of people who rely on information technologies every day? Drawing together several distinct bodies of literature—including multiple strands of governance theory, actor–network theory, and scholarship on (...) sociotechnical regimes—this paper conceptualizes networked action on a spectrum from uncertain governance to governing uncertainty. I advance a twofold argument. First, I argue that networks can better govern uncertainty as they become more able not only to enroll actors in a collective agenda, but also to cut ties with those who seek to undermine that agenda. And second, I argue that the dominant conception of information security governance, which emphasizes governing uncertainty through risk management, in practice devolves to uncertain governance. This is largely because information technologies have evolved toward greater connectedness—and with it, greater vulnerability—creating a regime of insecurity. This evolution is illustrated using the history of the US government’s efforts to govern information security. (shrink)

In light of the recent emergence of predictive techniques in law enforcement to forecast crimes before they occur, this paper examines the temporal operation of power exercised by predictive policing algorithms. I argue that predictive policing exercises power through a paranoid style that constitutes a form of temporal governmentality. Temporality is especially pertinent to understanding what is ethically at stake in predictive policing as it is continuous with a historical racialized practice of organizing, managing, controlling, and stealing time. After first (...) clarifying the concept of temporal governmentality, I apply this lens to Chicago Police Department’s Strategic Subject List. This predictive algorithm operates, I argue, through a paranoid logic that aims to preempt future possibilities of crime on the basis of a criminal past codified in historical crime data. (shrink)

In recent years, many qualitative sociologists, anthropologists, and social theorists have critiqued the use of algorithms and other automated processes involved in data science on both epistemological and political grounds. Yet, it has proven difficult to bring these important insights into the practice of data science itself. We suggest that part of this problem has to do with under-examined or unacknowledged assumptions about the relationship between the two fields—ideas about how data science and its critics can and should relate. Inspired (...) by recent work in Science and Technology Studies on interventions, we attempted to stage an encounter in which practicing data scientists were asked to analyze a corpus of critical social science literature about their work, using tools of textual analysis such as co-word and topic modelling. The idea was to provoke discussion both about the content of these texts and the possible limits of such analyses. In this commentary, we reflect on the planning stages of the experiment and how responses to the exercise, from both data scientists and qualitative social scientists, revealed some of the tensions and interactions between the normative positions of the different fields. We argue for further studies which can help us understand what these interdisciplinary tensions turn on—which do not paper over them but also do not take them as given. (shrink)

This article responds to recent debates in critical algorithm studies about the significance of the term “algorithm.” Where some have suggested that critical scholars should align their use of the term with its common definition in professional computer science, I argue that we should instead approach algorithms as “multiples”—unstable objects that are enacted through the varied practices that people use to engage with them, including the practices of “outsider” researchers. This approach builds on the work of Laura Devendorf, Elizabeth Goodman, (...) and Annemarie Mol. Different ways of enacting algorithms foreground certain issues while occluding others: computer scientists enact algorithms as conceptual objects indifferent to implementation details, while calls for accountability enact algorithms as closed boxes to be opened. I propose that critical researchers might seek to enact algorithms ethnographically, seeing them as heterogeneous and diffuse sociotechnical systems, rather than rigidly constrained and procedural formulas. To do so, I suggest thinking of algorithms not “in” culture, as the event occasioning this essay was titled, but “as” culture: part of broad patterns of meaning and practice that can be engaged with empirically. I offer a set of practical tactics for the ethnographic enactment of algorithmic systems, which do not depend on pinning down a singular “algorithm” or achieving “access,” but which rather work from the partial and mobile position of an outsider. (shrink)

Platform companies use techniques of algorithmic management to control their users. Though digital marketplaces vary in their use of these techniques, few studies have asked why. This question is theoretically consequential. Economic sociology has traditionally focused on the embedded activities of market actors to explain competitive and valuation dynamics in markets. But restrictive platforms can leave little autonomy to market actors. Whether or not the analytical focus on their interactions makes sense thus depends on how restrictive the platform is, turning (...) the question into a first order analytical concern. The paper argues that we can explain why platforms adopt more and less restrictive architectures by focusing on the design logic that informs their construction. Platforms treat markets as search algorithms that blend software computation with human interactions. If the algorithm requires actors to follow narrow scripts of behavior, the platform should become more restrictive. This depends on the need for centralized computation, the degree to which required inputs can be standardized, and the misalignment of interests between users. The paper discusses how these criteria can be mobilized to explain the architectures of four illustrative cases. (shrink)

In the age of ubiquitous computing and artificially intelligent applications, social machines serves as a powerful framework for understanding and interpreting interactions in socio-algorithmic ecosystems. Although researchers have largely used it to analyze the interactions of individuals and algorithms, limited attempts have been made to investigate the politics in social machines. In this study, I claim that social machines are per se political machines, and introduce a five-point framework for classifying influence processes in socio-algorithmic ecosystems. By drawing from scholars from (...) political theory, I use a notion of influence that functions as a meta-concept for connecting and comparing different conceptions of politics. In this way, I can associate multiple political aspects of social machines from a cybernetic perspective. I show that the framework efficiently categorizes dimensions of influence that shape interactions between individuals and algorithms. These categories are symbolic influence, political conduct, algorithmic influence, design, and regulatory influence. Using case studies, I describe how they interact with each other on online social networks and in algorithmic decision-making systems and illustrate how the framework is able to guide scientists in further research. (shrink)

This article employs a cybernetic approach to explore the scope of what constitutes anthropological and ethnographic research and the potential to utilize data science techniques to broaden what constitutes ethnography. Four types of relationships anthropologists historically have tended to seek out with data science as a discipline: anthropology of data science, anthropology over data science, anthropology with data science and, the least developed of the four, anthropology by data science. I relate potential insights data scientists have cultivated on abductive, bottom-up (...) quantitative research that might be useful for anthropologists in particular and cybernetically minded thinkers in general. Grounded Nick Seaver’s concept of bastard disciplines and methodologies, an anthropology by data science relationship provides a beneficial way to ground such strategic incorporations within anthropological research and helpful food for thought for cybernetic scholars in other disciplinary contexts. (shrink)

Digital platforms and application software have changed how people work in a range of industries. Empirical studies of the gig economy have raised concerns about new systems of algorithmic management exercised over workers and how these alter the structural conditions of their work. Drawing on the republican literature, we offer a theoretical account of algorithmic domination and a framework for understanding how it can be applied to ride hail and food delivery services in the on-demand economy. We argue that certain (...) algorithms can facilitate new relationships of domination by sustaining a socio-technical system in which the owners and managers of a company dominate workers. This analysis has implications for the growing use of algorithms throughout the gig economy and broader labor market. (shrink)

The goal of this article is to deepen the concept of emerging urban mobility technology. Drawing on philosophical everyday and urban aesthetics, as well as the postphenomenological strand in the philosophy of technology, we explicate the relation between everyday aesthetic experience and urban mobility commoning. Thus, we shed light on the central role of aesthetics for providing depth to the important experiential and value-driven meaning of contemporary urban mobility. We use the example of self-driving vehicle (SDV), as potentially mundane, public, (...) dynamic, and social urban robots, for expanding the range of perspectives relevant for our relations to urban mobility technology. We present the range of existing SDV conceptualizations and contrast them with experiential and aesthetic understanding of urban mobility. In conclusion, we reflect on the potential undesired consequences from the depolitization of technological development, and potential new pathways for speculative thinking concerning urban mobility futures in responsible innovation processes. (shrink)

Algorithms silently structure our lives. Algorithms can determine whether someone is hired, promoted, offered a loan, or provided housing as well as determine which political ads and news articles consumers see. Yet, the responsibility for algorithms in these important decisions is not clear. This article identifies whether developers have a responsibility for their algorithms later in use, what those firms are responsible for, and the normative grounding for that responsibility. I conceptualize algorithms as value-laden, rather than neutral, in that algorithms (...) create moral consequences, reinforce or undercut ethical principles, and enable or diminish stakeholder rights and dignity. In addition, algorithms are an important actor in ethical decisions and influence the delegation of roles and responsibilities within these decisions. As such, firms should be responsible not only for the value-laden-ness of an algorithm but also for designing who-does-what within the algorithmic decision. As such, firms developing algorithms are accountable for designing how large a role individual will be permitted to take in the subsequent algorithmic decision. Counter to current arguments, I find that if an algorithm is designed to preclude individuals from taking responsibility within a decision, then the designer of the algorithm should be held accountable for the ethical implications of the algorithm in use. (shrink)

Organizations increasingly rely on algorithm-based HR decision-making to monitor their employees. This trend is reinforced by the technology industry claiming that its decision-making tools are efficient and objective, downplaying their potential biases. In our manuscript, we identify an important challenge arising from the efficiency-driven logic of algorithm-based HR decision-making, namely that it may shift the delicate balance between employees’ personal integrity and compliance more in the direction of compliance. We suggest that critical data literacy, ethical awareness, the use of participatory (...) design methods, and private regulatory regimes within civil society can help overcome these challenges. Our paper contributes to literature on workplace monitoring, critical data studies, personal integrity, and literature at the intersection between HR management and corporate responsibility. (shrink)

A wave of recent scholarship has warned about the potential for discriminatory harms of algorithmic systems, spurring an interest in algorithmic accountability and regulation. Meanwhile, parallel concerns about surveillance practices have already led to multiple successful regulatory efforts of surveillance technologies—many of which have algorithmic components. Here, we examine municipal surveillance regulation as offering lessons for algorithmic oversight. Taking the 2017 Seattle Surveillance Ordinance as our primary case study and surveying efforts across five other cities, we describe the features of (...) existing surveillance regulation; including procedures for describing surveillance technologies in detail, requirements for public engagement, and processes for establishing acceptable uses. Although the Seattle Surveillance Ordinance was not intended to address algorithmic accountability, we find these considerations to be relevant to the law’s aim of surfacing disparate impacts of systems in use. We also find that in notable cases government employees did not identify regulated algorithmic surveillance technologies as reliant on algorithmic or machine learning systems, highlighting definitional gaps that could hinder future efforts toward algorithmic regulation. We argue that finer-grained distinctions between types of information systems in the language of law and policy, and risk assessment tools integrated into their implementation would strengthen future regulatory efforts by rendering underlying algorithmic components more legible and accountable to political and community stakeholders. (shrink)

A growing literature is taking an institutionalist and governance perspective on how algorithms shape society based on unprecedented capacities for managing social complexity. Algorithmic governance altogether emerges as a novel and distinctive kind of societal steering. It appears to transcend established categories and modes of governance—and thus seems to call for new ways of thinking about how social relations can be regulated and ordered. However, as this paper argues, despite its novel way of realizing outcomes of collective steering and coordination, (...) it can nevertheless be grasped with an old and fundamental figure in political philosophy: that of Thomas Hobbes’ Leviathan. Comparing algorithmic governance with this figure serves to highlight their similarities as socio-political arrangements, and specifically to clarify how algorithmic governance parallels the apolitical traits of the Leviathan—it eliminates the political as it requires compliance and forgoing contestation to best fulfill its role and to produce satisfying outcomes. (shrink)

In this paper, we build upon Bruno Latour’s political writings to address the current impasse regarding algorithms in public life. We assert that the increasing difficulties at governing algorithms—be they qualified as “machine learning,” “big data,” or “artificial intelligence”—can be related to their current ontological thinness: deriving from constricted views on theoretical practices, algorithms’ standard definition as problem-solving computerized methods provides poor grips for affective dissensions. We then emphasize on the role historical and ethnographic studies of algorithms can potentially play (...) in the politicization of algorithms. By both digging into the genealogy of algorithms’ constricted definition and by making their contemporary constitutive relationships more visible, both historical and ethnographic studies can contribute to vascularizing algorithms and making them objects of enlarged disputes. We conclude by giving a flavor of the political potential of the vascularization efforts we call for, using materials from an ethnographic study conducted in a computer science laboratory. (shrink)

The discourse around self-driving cars has been dominated by an emphasis on their potential to reduce the number of accidents. At the same time, proponents acknowledge that self-driving cars would inevitably be involved in fatal accidents where moral algorithms would decide the fate of those involved. This is a necessary trade-off, proponents suggest, in order to reap the benefits of this new technology. In this article, I engage this argument, demonstrating how an undue optimism and enthusiasm about this technology is (...) obscuring our ability to see what is at stake and explaining how moving beyond the dominant utilitarian framings around this technology opens up a space for both ethical inquiry and innovative design. I suggest that a genuine caring concern for the many lives lost in car accidents now and in the future—a concern that transcends false binary trade-offs and that recognizes the systemic biases and power structures that make certain groups more vulnerable than others—could serve as a starting point to rethink mobility, as it connects to the design of our cities, the well-being of our communities, and the future of our planet. (shrink)

In science and technology studies today, there is a troubling tendency to portray actors in the biosciences as “cultural dopes” and technology as having monolithic qualities with predetermined outcomes. To remedy this analytical impasse, this article introduces the concept styles of valuation to analyze how actors struggle with valuing technology in practice. Empirically, this article examines how actors in a bioscientific laboratory struggle with valuing the properties and qualities of algorithms in a high-throughput setting and identifies the copresence of several (...) different styles. The question that the actors struggle with is what different configurations of algorithms, devices, and humans are “good bioscience,” that is, what do the actors perform as a good distribution of agency between algorithms and humans? A key finding is that algorithms, robots, and humans are valued in multiple ways in the same setting. For the actors, it is not apparent which configuration of agency and devices is more authoritative nor is it obvious which skills and functions should be redistributed to the algorithms. Thus, rather than tying algorithms to one set of values, such as “speed,” “precision,” or “automation,” this article demonstrates the broad utility of attending to the multivalence of algorithms and technology in practice. (shrink)

AI technology is capturing the African imaginations as a gateway to progress and prosperity. There is a growing interest in AI by different actors across the continent including scientists, researchers, humanitarian and aid organizations, academic institutions, tech start-ups, and media organizations. Several African states are looking to adopt AI technology to capture economic growth and development opportunities. On the other hand, African researchers highlight the gap in regulatory frameworks and policies that govern the development of AI in the continent. They (...) argue that this could lead to AI technology exacerbating problems of inequalities and injustice in the continent. However, most of the literature on AI ethics is biased toward Euro-American perspectives and lack the understanding of how AI development is apprehended in the Global South, and particularly Africa. Drawing on the case study of the first African Master’s in Machine Intelligence program, this paper argues for looking beyond the question of ethics in AI and examining AI governance issues through the analytical lens of the raciality of computing and the political economy of technoscience to understand AI development in Africa. By doing so, this paper seeks a different theorization for AI ethics from the South that is based on lived experiences of those in the margins and avoids the framings of technological futures that simplistically pathologize or celebrate Africa. (shrink)

Journal of Philosophy of Education, EarlyView.

While research in HCI on dealing with cultural issues when designing ICTs tended to adopt fixed and taxonomic views, recent theoretical perspectives closer to the social sciences have called for attending to the contingent, fluid, and dynamic aspects of the notion of culture. In this article, we contribute to translating these perspectives into an approach for informing design. We focus on abandoning prior conceptions of culture to allow the discovery of cultural differences through inductive field research while engaging with the (...) target community. This allows a view on cultural difference that is generative for design: it is unique to each case, and it also remains close to the concerns of community members. We base our approach on Basile Zimmermann’s waves and forms framework, and we illustrate it through our engagement and design with VOCI, a local voluntary community of tech-savvy university students in Syria between 2011 and 2015. (shrink)

Algorithms, once obscure objects of technical art, have lately been subject to considerable popular and scholarly scrutiny. What does it mean to adopt the algorithm as an object of analytic attention? What is in view, and out of view, when we focus on the algorithm? Using Niklaus Wirth's 1975 formulation that “algorithms + data structures = programs” as a launching-off point, this paper examines how an algorithmic lens shapes the way in which we might inquire into contemporary digital culture.

What claims are made about the objectivity of machines versus that of human experts? Whereas most current debates focus on the growing impact of algorithms in the age of Big Data, I argue here in favor of taking a longer historical perspective on these developments. Drawing on Daston and Galison's analysis of scientific production since the eighteenth century, I show that their distinction among three forms of objectivity sheds light on existing discussions about algorithmic objectivity and accountability in expert fields.

We live in exciting times for AI and Law: technical developments are moving at a breakneck pace, and at the same time, the call for more robust AI governance and regulation grows stronger. How should we as an AI & Law community navigate these dramatic developments and claims? In this Presidential Address, I present my ideas for a way forward: researching, developing and evaluating real AI systems for the legal field with researchers from AI, Law and beyond. I will demonstrate (...) how we at the Netherlands National Police Lab AI are developing responsible AI by combining insights from different disciplines, and how this connects to the future of our field. (shrink)

Many actors mobilize the cognitive, legal and technical tool-box of data protection when they discuss and address controversial issues such as digital mass surveillance. Yet, critical approaches to the digital only barely explore the politics of data protection in relation to data-driven governance. Building on governmentality studies and Actor-Network-Theory, this article analyses the potential and limits of using data protection to critique the ‘digital age’. Using the conceptual tool of dispositifs, it sketches an analytics of data protection and the emergence (...) of its configuration as ‘data protection by design and by default’. This exploration reminds us that governing through data implies, first and foremost, governing digital data. (shrink)

Purpose Algorithms are in the mainstream media news on an almost daily basis. Their context is invariably artificial intelligence and machine learning decision-making. In media articles, algorithms are described as powerful, autonomous actors that have a capability of producing actions that have consequences. Despite a tendency for deification, the prevailing critique of algorithms focuses on ethical concerns raised by decisions resulting from algorithmic processing. However, the purpose of this paper is to propose that the ethical concerns discussed are limited in (...) scope and suggest that it is not clear what concerns dominate the debate. Design/methodology/approach The paper uses a systematic mapping study approach to review articles appearing in leading UK national papers from the perspective of the ethical concerns over a period of one year. The articles are categorised using a widely cited framework detailing a taxonomy of ethical concerns. The UK context is important because of UK public policy initiatives around AI. Findings The research presented in this paper contributes the first systematic mapping study of articles appearing in leading UK national papers from the perspective of widely accepted ethical concerns such as inscrutable evidence, misguided evidence, unfair outcomes and transformative effects. Originality/value The research presented in this paper contributes the first systematic mapping study of articles appearing in leading UK national papers from the perspective of the ethical concerns. The UK context is important because of UK public policy initiatives around AI. To review the media content from the perspective of ethical concerns, this paper uses the synthesised conceptual map of ethical concerns developed by Mittelstad et al. Given the dominance of that framework, this paper’s contribution is also an important instantiation and experimental validation of using that conceptual map. (shrink)

The literature addressing bias and fairness in AI models (fair-AI) is growing at a fast pace, making it difficult for novel researchers and practitioners to have a bird’s-eye view picture of the field. In particular, many policy initiatives, standards, and best practices in fair-AI have been proposed for setting principles, procedures, and knowledge bases to guide and operationalize the management of bias and fairness. The first objective of this paper is to concisely survey the state-of-the-art of fair-AI methods and resources, (...) and the main policies on bias in AI, with the aim of providing such a bird’s-eye guidance for both researchers and practitioners. The second objective of the paper is to contribute to the policy advice and best practices state-of-the-art by leveraging from the results of the NoBIAS research project. We present and discuss a few relevant topics organized around the NoBIAS architecture, which is made up of a Legal Layer, focusing on the European Union context, and a Bias Management Layer, focusing on understanding, mitigating, and accounting for bias. (shrink)

How do we make the case for "knowledge democracy" in the face of the growing influence of right-wing figures and movements that denounce experts and expertise? While the threats to knowledge posed by these movements are real, it would be a mistake to return to a classic intellectual strategy--the politics of demarcation--in the face of this danger. Examining practical proposals for combatting fake news and opinion manipulation on the Internet, namely so-called "fact-checking" tools and services, I argue that they threaten (...) to enroll us in a problematic normative project, one that aims to re-establish a hierarchy between knowledge and its presumed opposite, non-knowledge, or anti-knowledge. I list a number of shortcomings of this strategy. Most importantly, it distracts us from the role of technology in the crisis of public evidence in today's computationally-intensive societies. Social media are a truth-less public sphere by design. A politics of demarcation also puts us at risk of forgetting a key insight from the previous century that remains valid today: knowledge democracy is a re-constructive practice and an ideal. Instead of consolidating hierarchies of knowledge through facts that derive their authority form outside the public sphere, we need to recover the central role in public life of experimental facts: statements whose truth value is unstable. The experimental validation of public knowledge must happen in the public domain. (shrink)