The algorithmic accountability literature to date has primarily focused on procedural tools to govern automated decision-making systems. That prescriptive literature elides a fundamentally empirical question: whether and under what circumstances, if any, is the use of algorithmic systems to make public policy decisions perceived as legitimate? The present study begins to answer this question. Using factorial vignette survey methodology, we explore the relative importance of the type of decision, the procedural governance, the input data used, and outcome errors on perceptions (...) of the legitimacy of algorithmic public policy decisions as compared to similar human decisions. Among other findings, we find that the type of decision—low importance versus high importance—impacts the perceived legitimacy of automated decisions. We find that human governance of algorithmic systems increases perceptions of the legitimacy of algorithmic decision-making systems, even when those decisions are likely to result in significant errors. Notably, we also find the penalty to perceived legitimacy is greater when human decision-makers make mistakes than when algorithmic systems make the same errors. The positive impact on perceived legitimacy from governance—such as human-in-the-loop—is greatest for highly pivotal decisions such as parole, policing, and healthcare. After discussing the study’s limitations, we outline avenues for future research. (shrink)

Studies investigating the relationship between artificial intelligence and science tend to adopt a partial view. There is no broad and holistic view that synthesizes the channels through which this interaction occurs. Our goal is to systematically map the influence of the latest AI techniques on science. We draw on the work of Nathan Rosenberg to develop a taxonomy of the effects of technology on science. The proposed framework comprises four categories of technology effects on science: intellectual, economic, experimental and instrumental. (...) The application of the framework in the relationship between ML/DL and science allowed the identification of multiple triggers activated by the new techniques in the scientific field. Visualizing these different channels of influence allows us to identify two pressing, emerging issues. The first is the concentration of experimental effects in a few companies, which indicates a reinforcement effect between more data on the phenomenon and more capacity to commercialize the technique. The second is the diffusion of new techniques lacking in explanation throughout the fabric of science. The value of this article is twofold. First, it provides a simple framework to assess the relations between technology and science. Second, it provides this broad and holistic view of the influence of new AI techniques on science. More specifically, the article details the channels through which this relationship occurs, the nature of these channels and the loci in which the potential effects on science unfolds. (shrink)

The complex relationships between humans and AI-empowered machines have created and inspired new products and services as well as controversial debates, fiction and entertainment, and last but not least, a striving and vital field of research. The convergence between the two categories of entities has created stimulating concepts and theories in the past, such as the uncanny valley, machinization of humans through datafication, or humanization of machines, known as anthropomorphization. In this article, we identify a new gap in the relational (...) interaction between humans and AI triggered by commercial interests, making use of AI through advertisement, marketing, and corporate communications. Our scope is to broaden the field of AI and society by adding the business-society-nexus. Thus, we build on existing research streams of machinewashing and the analogous phenomenon of greenwashing to theorize about the humanwashing of AI-enabled machines as a specific anthropomorphization notion. In this way, the article offers a contribution to the anthropomorphization literature conceptualizing humanwashing as a deceptive use of AI-enabled machines aimed at intentionally or unintentionally misleading organizational stakeholders and the broader public about the true capabilities that AIEMs possess. (shrink)

In this paper, we discuss several problems with current Big data practices which, we claim, seriously erode the role of informed consent as it pertains to the use of personal information. To illustrate these problems, we consider how the notion of informed consent has been understood and operationalised in the ethical regulation of biomedical research (and medical practices, more broadly) and compare this with current Big data practices. We do so by first discussing three types of problems that can impede (...) informed consent with respect to Big data use. First, we discuss the transparency (or explanation) problem. Second, we discuss the re-repurposed data problem. Third, we discuss the meaningful alternatives problem. In the final section of the paper, we suggest some solutions to these problems. In particular, we propose that the use of personal data for commercial and administrative objectives could be subject to a ‘soft governance’ ethical regulation, akin to the way that all projects involving human participants (e.g., social science projects, human medical data and tissue use) are regulated in Australia through the Human Research Ethics Committees (HRECs). We also consider alternatives to the standard consent forms, and privacy policies, that could make use of some of the latest research focussed on the usability of pictorial legal contracts. (shrink)

The increasing use of artificial intelligence (AI) by public actors has led to a push for more transparency. Previous research has conceptualized AI transparency as knowledge that empowers citizens and experts to make informed choices about the use and governance of AI. Conversely, in this paper, we critically examine if transparency-as-knowledge is an appropriate concept for a public realm where private interests intersect with democratic concerns. We conduct a practice-based design research study in which we prototype and evaluate a transparent (...) smart electric vehicle charge point, and investigate experts’ and citizens’ understanding of AI transparency. We find that citizens experience transparency as burdensome; experts hope transparency ensures acceptance, while citizens are mostly indifferent to AI; and with absent means of control, citizens question transparency’s relevance. The tensions we identify suggest transparency cannot be reduced to a product feature, but should be seen as a mediator of debate between experts and citizens. (shrink)