The use of computers for simulation work can be traced back to the 1950s, and the pioneering work of Stafford Beer, KD Tocher and others at Cybor House in Sheffield, UK, the research and development (R&D) department of British steelmakers, United Steel. This innovative simulation work sought to offer an abstracted, ‘total’ environment of the steelmaking process in which different operational activities could be modeled. Critical to this work was the ability of computer simulations to perform such modelling at a (...) fraction of the cost, wasting fewer material resources, and in a considerably shorter timeframe. Such work can be understood as the earliest example of the application of industrial-scale ‘automated computation’ to a real-world industrial process. Similarly indebted to the early principles of computer simulation, Waymo engineers are also engaged in the building of so-called ‘conflict typologies’ designed to encode material properties of everyday driving interactions between road users, rather than simply road users themselves. Through ‘motion planning’, coupled with the categorization of driving interactions, Waymo engineers build instrumental understanding of their own system’s purported intelligence in navigating everyday driving situations. Functioning as ‘generative mechanisms’ rather than simply evaluative devices, engineers seek to industrialize—instrumentalize, scale up, rationalize—everyday driving knowledge. Through conflict typologies, instrumental knowledge of the actual capacities of autonomous vehicles is industrialized, materialized, and realized. (shrink)

Artificial intelligence (AI) and machine learning (ML) are becoming increasingly significant areas of research for scholars in science and technology studies (STS) and media studies. In March 2020, Waymo, Google/Alphabet’s autonomous vehicle project, introduced the ‘Open Dataset Virtual Challenge’, an annual competition leveraging their Waymo Open Dataset. This freely accessible dataset comprises annotated autonomous vehicle data from their own Waymo vehicles. Yearly, Waymo has continued to host iterations of this challenge, inviting teams of computer scientists to tackle evolving machine learning (...) and vision problems using Google's data and tools. This article analyses these challenges, situating them within the context of the ‘Grand Challenges’ of artificial intelligence (AI), which aimed to foster accountable and commercially viable advancements in the late 1980s. Through two exploratory workshops, we adopted a ‘technographic’ approach to examine the pivotal role of challenges in the development and political economy of AI. Serving as an organising principle for the AI innovation ecosystem, the challenge connects companies and external collaborators, driving advancements in specific machine vision domains. By exploring six key themes—interface methods, incrementalism, metrics, AI vernacular, applied domains, and competitive advantages—the article illustrates the role of these challenges in shaping AI research and development. By unpacking the dynamic interaction between data, computation, and labour, these challenges serve as catalysts propelling advancements towards self-driving technologies. The study reveals how challenges have historically and presently shaped the evolving landscape of self-driving and AI technologies. (shrink)

Digital innovations are rapidly changing the contemporary workplace. Big Tech companies marketing algorithmic management increasingly decide on the Future of Work. Political responses, however, often focus on managing the impact of these technologies on workers. They leave the question of how these technologies are designed or how workers can determine their own futures unanswered. This approach risks surrendering the Future of Work debate to techno-determinist imaginaries aligned with corporate interests. Using Cornelius Castoriadis’ early writings on worker struggles in French Tayloristic (...) factories and his later oeuvre on conflictual social imaginaries, I propose an agonistic approach to the Future of Work. Not merely companies implementing workplace technologies, but also workers themselves possess agency in determining the Future of Work. Workers’ frequent contestations against machinic surveillance and technologically mediated coordination of the labour process disclose an alternative Future of Work in which technologies are used to enhance worker autonomy rather than bureaucratic control. Worker struggles at Amazon Mechanical Turk illustrate this agonistic dynamic: Amazon mobilizes algorithmic management to fragment and control a workforce of globally dispersed remote workers, but the latter form online social communities and create counter-technologies to reappropriate control over the labour process. (shrink)

Impact sourcing is the practice of employing socio-economically disadvantaged individuals at business process outsourcing centres to reduce poverty and create secure jobs. One of the pioneers of impact sourcing is Sama, a training-data company that focuses on annotating data for artificial intelligence (AI) systems and claims to support an ethical AI supply chain through its business operations. Drawing on fieldwork undertaken at three of Sama’s East African delivery centres in Kenya and Uganda and follow-up online interviews, this article interrogates Sama’s (...) claims regarding the benefits of its impact sourcing model. Our analysis reveals alarming accounts of low wages, insecure work, a tightly disciplined labour management process, gender-based exploitation and harassment and a system designed to extract value from low-paid workers to produce profits for investors. We argue that competitive market-based dynamics generate a powerful force that pushes such companies towards limiting the actual social impact of their business model in favour of ensuring higher profit margins. This force can be resisted, but only through countervailing measures such as pressure from organised workers, civil society, or regulation. These findings have broad implications related to working conditions for low-wage data annotators across the sector and cast doubt on the ethical nature of AI products that rely on this form of AI data work. (shrink)

The increasing workplace use of artificially intelligent (AI) technologies has implications for the experience of meaningful human work. Meaningful work refers to the perception that one’s work has worth, significance, or a higher purpose. The development and organisational deployment of AI is accelerating, but the ways in which this will support or diminish opportunities for meaningful work and the ethical implications of these changes remain under-explored. This conceptual paper is positioned at the intersection of the meaningful work and ethical AI (...) literatures and offers a detailed assessment of the ways in which the deployment of AI can enhance or diminish employees’ experiences of meaningful work. We first outline the nature of meaningful work and draw on philosophical and business ethics accounts to establish its ethical importance. We then explore the impacts of three paths of AI deployment (replacing some tasks, ‘tending the machine’, and amplifying human skills) across five dimensions constituting a holistic account of meaningful work, and finally assess the ethical implications. In doing so we help to contextualise the meaningful work literature for the era of AI, extend the ethical AI literature into the workplace, and conclude with a range of practical implications and future research directions. (shrink)

This paper has 3 main goals: (1) to clarify the role of Artificial Intelligence (AI)—along with algorithms more broadly—in online radicalization that results in ‘real world violence’; (2) to argue that technological solutions (like better AI) are inadequate proposals for this problem given both technical and social reasons; and (3) to demonstrate that platform companies’ (e.g., Meta, Google) statements of preference for technological solutions functions as a type of propaganda that serves to erase the work of the thousands of human (...) content moderators and conceal the harms they experience. I argue that the proper assessment of these important, related issues must be free of the obfuscation that the ‘better AI’ proposal generates. For this reason, I describe the AI-centric solutions favoured by major platform companies as a type of obfuscating and dehumanizing propaganda. (shrink)

Artificial Intelligence-as-a-Service empowers individuals and organisations to access AI on-demand, in either tailored or ‘off-the-shelf’ forms. However, institutional separation between development, training and deployment can lead to critical opacities, such as obscuring the level of human effort necessary to produce and train AI services. Information about how, where, and for whom AI services have been produced are valuable secrets, which vendors strategically disclose to clients depending on commercial interests. This article provides a critical analysis of how AIaaS vendors manipulate the (...) visibility of human labour in AI production based on whether the vendor relies on paid or unpaid labour to fill interstitial gaps. Where vendors are able to occlude human labour in the organisational ‘backstage,’ such as in data preparation, validation or impersonation, they do so regularly, further contributing to ongoing techno-utopian narratives of AI hype. Yet, when vendors must co-produce the AI service with the client, such as through localised AI training, they must ‘lift the curtain’, resulting in a paradoxical situation of needing to both perpetuate dominant AI hype narratives while emphasising AI’s mundane limitations. (shrink)

As the artificial intelligence (AI) ethics field is currently working towards its operationalisation, ethics review as carried out by research ethics committees (RECs) constitutes a powerful, but so far underdeveloped, framework to make AI ethics effective in practice at the research level. This article contributes to the elaboration of research ethics frameworks for research projects developing and/or using AI. It highlights that these frameworks are still in their infancy and in need of a structure and criteria to ensure AI research (...) projects advance in a way that respects norms and principles. This article proposes to draw from the European Union’s AI Act currently in development to shape these frameworks. Although, in the current form of the draft (as of August 2023), the obligations of the AI Act do not apply to scientific research, it is most likely that they will still have a strong impact on AI research considering the need to anticipate market placement or to test new tools in real world conditions. This article investigates what the risk-based approach in the AI Act implies for research ethics and highlights some AI Act obligations of particular value to implement for ethics review processes. (shrink)

Archival data processing consists of cleaning and formatting data between the moment a dataset is deposited and its publication on the archive’s website. In this article, I approach data processing by combining scholarship on invisible labor in knowledge infrastructures with a Marxian framework and show the relevance of considering data processing as factory labor. Using this perspective to analyze ethnographic data collected during a six-month participatory observation at a U.S. data archive, I generate a taxonomy of the forms of alienation (...) that data processing generates, but also the types of resistance that processors develop, across four categories: routine, speed, skill, and meaning. This synthetic approach demonstrates, first, that data processing reproduces typical forms of factory worker’s alienation: processors are asked to work along a strict standardized pipeline, at a fast pace, without acquiring substantive skills or having a meaningful involvement in their work. It reveals, second, how data processors resist the alienating nature of this workflow by developing multiple tactics along the same four categories. Seen through this dual lens, data processors are therefore not only invisible workers, but also factory workers who follow and subvert a workflow organized as an assembly line. I conclude by proposing a four-step framework to better value the social contribution of data workers beyond the archive. (shrink)

Drawing on the analytic of the “colonial matrix of power” developed by Aníbal Quijano within the Latin American modernity/coloniality research program, this article theorises how a system of coloniality underpins the structuring logic of artificial intelligence (AI) systems. We develop a framework for critiquing the regimes of global labour exploitation and knowledge extraction that are rendered invisible through discourses of the purported universality and objectivity of AI. ​​Through bringing the political economy literature on AI production into conversation with scholarly work (...) on decolonial AI and the modernity/coloniality research program, we advance three main arguments. First, the global economic and political power imbalances in AI production are inextricably linked to the continuities of historical colonialism, constituting the colonial supply chain of AI. Second, this is produced through an international division of digital labour that extracts value from majority world labour for the benefit of Western technology companies. Third, this perpetuates hegemonic knowledge production through Western values and knowledge that marginalises non-Western alternatives within AI’s production and limits the possibilities for decolonising AI. By locating the production of AI systems within the colonial matrix of power, we contribute to critical and decolonial literature on the legacies of colonialism in AI and the hierarchies of power and extraction that shape the development of AI today. (shrink)

Many modern digital products use Machine Learning (ML) to emulate human abilities, knowledge, and intellect. In order to achieve this goal, ML systems need the greatest possible quantity of training data to allow the Artificial Intelligence (AI) model to develop an understanding of “what it means to be human”. We propose that the processes by which companies collect this data are problematic, because they entail extractive practices that resemble labour exploitation. The article presents four case studies in which unwitting individuals (...) contribute their humanness to develop AI training sets. By employing a post-Marxian framework, we then analyse the characteristic of these individuals and describe the elements of the capture-machine. Then, by describing and characterising the types of applications that are problematic, we set a foundation for defining and justifying interventions to address this form of labour exploitation. (shrink)

Scientific research is growingly increasingly reliant on "microwork" or "crowdsourcing" provided by digital platforms to collect new data. Digital platforms connect clients and workers, charging a fee for an algorithmically managed workflow based on Terms of Service agreements. Although these platforms offer a way to make a living or complement other sources of income, microworkers lack fundamental labor rights and basic safe working conditions, especially in the Global South. We ask how researchers and research institutions address the ethical issues involved (...) in considering microworkers as "human participants." We argue that current scientific research fails to treat microworkers in the same way as in-person human participants, producing de facto a double morality: one applied to people with rights acknowledged by states and international bodies (e.g., the Helsinki Declaration), the other to guest workers of digital autocracies who have almost no rights at all. We illustrate our argument by drawing on 57 interviews conducted with microworkers in Spanish-speaking countries. (shrink)

This article analyses the forms of dividuation workers undergo when they are linked to technologies, such as algorithms or artificial intelligence. It examines functionalities and operations deployed by certain types of Talent Management software and apps—UKG, Tribepad, Afiniti, RetailNext and Textio. Specifically, it analyses how talented workers materialise in relation to the profiles and the statistical models generated by such artificial intelligence machines. It argues that these operate as a nooscope that allows the transindividual plane to be quantified through a (...) process known as dividuation. Finally, by way of conclusion, the notion of the dividual is presented as the logic that characterises the human–machine relationship in the case of artificial intelligence and as the horizon of what Felix Guattari called “machinic capitalism”. (shrink)

This article presents Epistemic Spatialization as a new framework for investigating the interconnected patterns of biases when identifying objects with convolutional neural networks (convnets). It draws upon Foucault’s notion of spatialized knowledge to guide its method of enquiry. We argue that decisions involved in the creation of algorithms, alongside the labeling, ordering, presentation, and commercial prioritization of objects, together create a distorted “nomination of the visible”: they harden the visibility of some objects, make other objects excessively visible, and consign yet (...) others to permanent or haphazard invisibility. Our approach differs from those who focus on high-stakes misidentifications, such as errors tied to structural racism. Examining the far more dominant series of low-stakes mistakes shows the scope of errors, destabilizing the goal of image content identification with considerable societal impact. We explore these issues by closely examining the demonstration video of a popular convnet. This examination reveals an interlocking series of biases undermining the content identification process. The picture we paint is crucial for a better understanding of the errors that result as these convnets become further embedded in everyday products. The framework is valuable for critical work on computer vision, AI studies, and large-scale visual analysis. (shrink)

This review seeks to present a comprehensive picture of recent discussions in the social sciences of the anticipated impact of AI on the world of work. Issues covered include: technological unemployment, algorithmic management, platform work and the politics of AI work. The review identifies the major disciplinary and methodological perspectives on AI’s impact on work, and the obstacles they face in making predictions. Two parameters influencing the development and deployment of AI in the economy are highlighted: the capitalist imperative and (...) nationalistic pressures. (shrink)

Recent buzzes around big data, data science and artificial intelligence portray a data-driven future for healthcare. As a response, Europe's key players have stimulated the use of big data technologies to make healthcare more efficient and effective. Critical Data Studies and Science and Technology Studies have developed many concepts to reflect on such overly positive narratives and conduct critical policy evaluations. In this study, we argue that there is also much to be learned from studying how professionals in the healthcare (...) field affectively engage with this strong European narrative in concrete big data projects. We followed twelve hospital-based big data pilots in eight European countries and interviewed 145 professionals between 2018 and 2020. In this study, we introduce the metaphor of dreams to describe how professionals link the big data promises to their own frustrations, ideas, values and experiences with healthcare. Our research answers the question: how do professionals in concrete data-driven initiatives affectively engage with European Union's data hopes in their ‘dreams’ – and with what consequences? We describe the dreams of being seen, of timeliness, of connectedness and of being in control. Each of these dreams emphasizes certain aspects of the grand narrative of big data in Europe, makes particular assumptions and has different consequences. We argue that including attention to these dreams in our work could help shine an additional critical light on the big data developments and stimulate the development of responsible data-driven healthcare. (shrink)

In recent years, there has been a growing public discourse regarding the influence AI will have on the future of work. Simultaneously, considerable critical attention has been given to the implications of AI on gender equality. Far from making precise predictions about the future, this discourse demonstrates that new technologies are instances for renegotiating the relation of gender and work. This paper examines how gender is addressed in news media discourse on AI and the future of work, focusing on Germany. (...) We approach this question from a perspective of feminist technology studies and discourse analysis, exploring a corpus of 178 articles from 2015 to 2021 from German newspapers and newsmagazines. The findings indicate that critical AI and gender knowledge circulates in public discourse in the form of specific discursive frames, thematizing algorithmic bias, automatization and enhancement, and gender stereotypes. As a result, we show that, first, the discourse takes up feminist and scholarly discourse on gender and discusses AI in a way that is informed by social constructivism and standpoint theories. Second, gender appears as a—to some extent intersectional—diversity category which is critical to AI, while at the same time omitting important perspectives. Third, it can be shown that there is a renegotiating of the ideal worker norm taking place, and finally, we argue that the gendered frame of the powerful men developer responsible for AI’s risk is a concept to be challenged. (shrink)