This article considers the issue of opacity as a problem for socially consequential mechanisms of classification and ranking, such as spam filters, credit card fraud detection, search engines, news trends, market segmentation and advertising, insurance or loan qualification, and credit scoring. These mechanisms of classification all frequently rely on computational algorithms, and in many cases on machine learning algorithms to do this work. In this article, I draw a distinction between three forms of opacity: opacity as intentional corporate or state (...) secrecy, opacity as technical illiteracy, and an opacity that arises from the characteristics of machine learning algorithms and the scale required to apply them usefully. The analysis in this article gets inside the algorithms themselves. I cite existing literatures in computer science, known industry practices, and do some testing and manipulation of code as a form of lightweight code audit. I argue that recognizing the distinct forms of opacity that may be coming into play in a given application is a key to determining which of a variety of technical and non-technical solutions could help to prevent harm. (shrink)

In recent years, a plethora of high-profile scientific publications has been reporting about machine learning algorithms outperforming clinicians in medical diagnosis or treatment recommendations. This has spiked interest in deploying relevant algorithms with the aim of enhancing decision-making in healthcare. In this paper, we argue that instead of straightforwardly enhancing the decision-making capabilities of clinicians and healthcare institutions, deploying machines learning algorithms entails trade-offs at the epistemic and the normative level. Whereas involving machine learning might improve the accuracy of medical (...) diagnosis, it comes at the expense of opacity when trying to assess the reliability of given diagnosis. Drawing on literature in social epistemology and moral responsibility, we argue that the uncertainty in question potentially undermines the epistemic authority of clinicians. Furthermore, we elucidate potential pitfalls of involving machine learning in healthcare with respect to paternalism, moral responsibility and fairness. At last, we discuss how the deployment of machine learning algorithms might shift the evidentiary norms of medical diagnosis. In this regard, we hope to lay the grounds for further ethical reflection of the opportunities and pitfalls of machine learning for enhancing decision-making in healthcare. (shrink)

The capacity to collect and analyse data is growing exponentially. Referred to as ‘Big Data’, this scientific, social and technological trend has helped create destabilising amounts of information, which can challenge accepted social and ethical norms. Big Data remains a fuzzy idea, emerging across social, scientific, and business contexts sometimes seemingly related only by the gigantic size of the datasets being considered. As is often the case with the cutting edge of scientific and technological progress, understanding of the ethical implications (...) of Big Data lags behind. In order to bridge such a gap, this article systematically and comprehensively analyses academic literature concerning the ethical implications of Big Data, providing a watershed for future ethical investigations and regulations. Particular attention is paid to biomedical Big Data due to the inherent sensitivity of medical information. By means of a meta-analysis of the literature, a thematic narrative is provided to guide ethicists, data scientists, regulators and other stakeholders through what is already known or hypothesised about the ethical risks of this emerging and innovative phenomenon. Five key areas of concern are identified: informed consent, privacy, ownership, epistemology and objectivity, and ‘Big Data Divides’ created between those who have or lack the necessary resources to analyse increasingly large datasets. Critical gaps in the treatment of these themes are identified with suggestions for future research. Six additional areas of concern are then suggested which, although related have not yet attracted extensive debate in the existing literature. It is argued that they will require much closer scrutiny in the immediate future: the dangers of ignoring group-level ethical harms; the importance of epistemology in assessing the ethics of Big Data; the changing nature of fiduciary relationships that become increasingly data saturated; the need to distinguish between ‘academic’ and ‘commercial’ Big Data practices in terms of potential harm to data subjects; future problems with ownership of intellectual property generated from analysis of aggregated datasets; and the difficulty of providing meaningful access rights to individual data subjects that lack necessary resources. Considered together, these eleven themes provide a thorough critical framework to guide ethical assessment and governance of emerging Big Data practices. (shrink)

In an analysis of artificially intelligent systems for medical diagnostics and treatment planning we argue that patients should be able to exercise a right to withdraw from AI diagnostics and treatment planning for reasons related to (1) the physician’s role in the patients’ formation of and acting on personal preferences and values, (2) the bias and opacity problem of AI systems, and (3) rational concerns about the future societal effects of introducing AI systems in the health care sector.

Mhealth technology is mushrooming world-wide and, in a variety of forms, reaches increasing numbers of users in ever-widening contexts and virtually independent from standard medical evidence assessment. Yet, debate on the broader societal impact including in particular mapping and classification of ethical issues raised has been limited. This article, as part of an ongoing empirically informed ethical research project, provides an overview of ethical issues of mhealth applications with a specific focus on implications on autonomy as a key notion in (...) the debate. A multi-stage model of references to the potential of mhealth use for strengthening some or other form of self-determination will be proposed as a descriptive tool. It illustrates an assumed continuum of enhanced autonomy via mhealth broadly conceived: from patient to user autonomy, to improved health literacy, and finally to the vision of supra-individual empowerment and democratised, participatory health and medicine as a whole. On closer examination, however, these references are frequently ambivalent or vague, perpetuating the at times uncritical use of established autonomy concepts in medical ethics. The article suggests zooming in on the range of autonomy-related aspects against the backdrop of digital innovation and datafied health more generally, and on this basis add to existing frameworks for the ethical evaluation of mhealth more specifically. (shrink)

Given the profound influence of social media and emerging evidence of its effects on human behavior and health, bioethicists have an important role to play in the development of professional standards of conduct for health professionals using social media and in the design of online systems themselves. In short, social media is a bioethics issue that has serious implications for medical practice, research, and public health. Here, we inventory several ethical issues across four areas at the intersection of social media (...) and health: the impact of social networking sites on the doctor‐patient relationship, the development of e‐health platforms to deliver care, the use of online data and algorithms to inform health research, and the broader public health consequences of widespread social media use. In doing so, we review discussions of these topics and emphasize the need for bioethics to focus more deeply on the ways online technology platforms are designed and implemented. We argue that bioethicists should turn their attention to the ways in which consumer engagement, bias, and profit maximization shape online content and, consequently, human behavior and health. We also offer a set of recommendations and suggest future directions for addressing ethical challenges in these domains. (shrink)

Electronic informed consent represents an opportunity to redesign the way that participants understand and elect to enroll in clinical research studies. However, electronic consent faces certain barriers common to all informed consent processes and other barriers specific to the technical environment. At Sage Bionetworks, we designed an electronic consent process as a software product and released it as an open source tool. We believe that using contemporary design processes to intentionally create cognitive friction, where potential study participants are confronted with (...) interfaces that require them to slow down and contemplate study concepts, offers a significant opportunity for ethical design as research increasingly uses smartphones and digital methodologies. (shrink)

Should we be allowed to refuse any involvement of artificial intelligence technology in diagnosis and treatment planning? This is the relevant question posed by Ploug and Holm in a recent article in Medicine, Health Care and Philosophy. In this article, I adhere to their conclusions, but not necessarily to the rationale that supports them. First, I argue that the idea that we should recognize this right on the basis of a rational interest defence is not plausible, unless we are willing (...) to judge each patient’s ideology or religion. Instead, I consider that the right must be recognized by virtue of values such as social pluralism or individual autonomy. Second, I point out that the scope of such a right should be limited at least under three circumstances: if it is against a physician’s obligation to not cause unnecessary harm to a patient or to not provide futile treatment, in cases where the costs of implementing this right are too high, or if recognizing the right would deprive other patients of their own rights to adequate health care. (shrink)

Volume 19, Issue 6, June 2019, Page 4-6.