One of the key ethical requirements for biomedical research is that it have an acceptable risk-benefit profile (Emanuel, Wendler, and Grady 2000). The International Conference of Harmonization guidelines mandate that clinical trials should be initiated and continued only if “the anticipated benefits justify the risks” (1996). Guidelines from the Council for International Organizations of Medical Sciences state that biomedical research is acceptable only if the “potential benefits and risks are reasonably balanced” (2002). U.S. federal regulations require that the “risks to (...) subjects” be “reasonable in relation to anticipated benefits, if any, to subjects and the importance of the knowledge” to be gained from the .. (shrink)

Peter-Paul Verbeek's Moralizing Technology: Understanding and Designing the Morality of Things Content Type Journal Article Category Book Review Pages 1-4 DOI 10.1007/s11569-012-0143-5 Authors Sadjad Soltanzadeh, Centre for Applied Philosophy and Public Ethics, Canberra, Australia Journal NanoEthics Online ISSN 1871-4765 Print ISSN 1871-4757.

Gain-of-function research involves experimentation that aims or is expected to increase the transmissibility and/or virulence of pathogens. Such research, when conducted by responsible scientists, usually aims to improve understanding of disease causing agents, their interaction with human hosts, and/or their potential to cause pandemics. The ultimate objective of such research is to better inform public health and preparedness efforts and/or development of medical countermeasures. Despite these important potential benefits, GOF research can pose risks regarding biosecurity and biosafety. In 2014 the (...) administration of US President Barack Obama called for a “pause” on funding of GOF experiments involving influenza, SARS, and MERS viruses in particular. With announcement of this pause, the US Government launched a “deliberative process” regarding risks and benefits of GOFR to inform future funding decisions—and the US National Science Advisory Board for Biosecurity was tasked with making recommendations to the US Government on this matter. As part of this deliberative process the National Institutes of Health commissioned this Ethical Analysis White Paper, requesting that it provide review and summary of ethical literature on GOFR, identification and analysis of existing ethical and decision-making frameworks relevant to the evaluation of risks and benefits of GOFR, decision-making about the conduct of GOF studies, and the development of US policy regarding GOFR, and development of an ethical and decision-making framework that may be considered by NSABB when analyzing information provided by GOFR risk-benefit assessment, and when crafting its final recommendations. The ethical and decision-making framework ultimately developed is based on the idea that there are numerous ethically relevant dimensions upon which any given case of GOFR can fare better or worse : research imperative, proportionality, minimization of risks, manageability of risks, justice, good governance, evidence, and international outlook and engagement. Rather than drawing a sharp bright line between GOFR studies that are ethically acceptable and those that are ethically unacceptable, this framework is designed to indicate where any given study would fall on an ethical spectrum—where imaginable cases of GOFR might range from those that are most ethically acceptable, at one end of the spectrum, to those that are most ethically problematic or unacceptable, at the other. The aim should be that any GOFR pursued should be as far as possible towards the former end of the spectrum. (shrink)

This paper considers multiple meanings of the expression ‘dual use’ and examines lessons to be learned from the life sciences when considering ethical and policy issues associated with the dual-use nature of nanotechnology (and converging technologies). After examining recent controversial dual-use experiments in the life sciences, it considers the potential roles and limitations of science codes of conduct for addressing concerns associated with dual-use science and technology. It concludes that, rather than being essentially associated with voluntary self-governance of the scientific (...) community, codes of conduct should arguably be part of a broader regulatory oversight system. (shrink)

This article reinvigorates a key question in publication ethics: Is there research that it is permissible to conduct but that ought not to be published? The article raises the question in relation to two recent medical studies. It is argued that the publication of these studies may cause significant harm to individuals, that editors of medical journals have a moral responsibility for such harm, that denial of publication is inadequate as an instrument to fulfil this moral responsibility and that internationally (...) acknowledged publication ethics codes should incorporate this aspect of editors’ moral responsibility. (shrink)

Most recent studies of dual use research have focused on the life sciences, although some researchers have suggested that dual use research occurs across many disciplines. This research is an initial investigation into the prevalence of dual use research in other scientific disciplines by surveying senior editors of scientific journals, drawn from Journal Citation Reports. The survey was emailed to 7,500 journal editors with a response rate of 10.1 %. Approximately 4.8 % of life science editors reported they had to (...) consider whether to publish dual use research and 38.9 % said they decided to not publish the research in question. In disciplines other than the life sciences, 7.2 % of editors from other science disciplines reported that they had to consider whether to publish dual use research, and 48.4 % declined to publish it. The survey investigated relationships between dual use and the journal’s source of funding and place of publication, but no relationships were found. Further research is needed to better understand the occurrence of dual use research in other science disciplines. (shrink)

Advances in the life sciences are occurring with extreme rapidity and accumulating a great deal of knowledge about life’s vital processes. While this knowledge is essential for fighting disease in a more effective way, it can also be misused either intentionally or inadvertently to develop novel and more effective biological weapons. For nearly a decade civil-academic society as well as States Parties to the Biological and Toxin Weapons Convention have recognised the importance of dual-use biosecurity education for life scientists as (...) a means to foster a culture of responsibility and prevent the potential misuse of advances in the life sciences for non-peaceful purposes. Nevertheless, the implementation of dual-use biosecurity education for life scientists has made little progress in institutions of higher learning. Professional societies and academic organizations have worked from the bottom-up in developing online dual-use biosecurity education modules that can be used for instruction. However, top-down help is needed from goverments if further progress is to be made in implementing biosecurity education for life scientists. (shrink)

The dual-use dilemma arises in the context of research in the biological and other sciences as a consequence of the fact that one and the same piece of scientific research sometimes has the potential to be used for bad as well as good purposes. It is an ethical dilemma since it is about promoting good in the context of the potential for also causing harm, e.g., the promotion of health in the context of providing the wherewithal for the killing of (...) innocents. It is an ethical dilemma for the researcher because of the potential actions of others, e.g., malevolent non-researchers who might steal dangerous biological agents, or make use of the original researcher’s work. And it is a dilemma for governments concerned with the security of their citizens, as well as their health. In this article we construct a taxonomy of types of “experiments of concern” in the biological sciences, and thereby map the terrain of ethical risk. We then provide a series of analyses of the ethical problems and considerations at issue in the dual-use dilemma, including the impermissibility of certain kinds of research and possible restrictions on dissemination of research results given the risks to health and security. Finally, we explore the main available institutional responses to some of the specific ethical problems posed by the dual-use dilemma in the biological sciences. (shrink)

In 2011, for the first time ever, two scientific journals were asked not to publish research papers in full detail. The research in question was on the H5N1 influenza virus (bird flu), and the concern was that the expected public health benefits of disseminating the findings did not outweigh the potential harm should the knowledge be misused for malicious purposes. This constraint raises important ethical concerns as it collides with scientific freedom and openness. In this article, we argue that constraining (...) the dissemination of dual-use knowledge can in certain cases be justified because, for example: scientists have a responsibility for potentially harmful consequences of their research; the public need not always know of all scientific discoveries; uncertainty about the risks of harm may warrant precaution; and expected benefits do not always outweigh potential harm. However, the constraints in question are not absolute but can be both temporary and partial. We propose three core aspects for an ethics of dual-use dissemination: dual-use awareness, precaution, and acknowledgment of conflicting values. Additionally, to help scientists understand when constraints on dissemination may be justified we suggest three corresponding conditions that prompt scientists to recognize dual-use material or research, consider the potential impact of dual-use knowledge dissemination, and acknowledge and respond to external dissemination concerns. (shrink)

AI researchers have developed sophisticated language models capable of generating paragraphs of 'synthetic text' on topics specified by the user. While AI text generation has legitimate benefits, it could also be misused, potentially to grave effect. For example, AI text generators could be used to automate the production of convincing fake news, or to inundate social media platforms with machine-generated disinformation. This paper argues that AI text generators should be conceptualised as a dual-use technology, outlines some relevant lessons from earlier (...) debates on dual-use life sciences research, and calls for closer collaboration between ethicists and the machine learning community to address AI language models’ dual-use implications. (shrink)

Recent calls for retraction of a large body of Chinese transplant research and of Dr Jiankui He’s gene editing research has led to renewed interest in the question of publication, retraction and use of unethical biomedical research. In Part 1 of this paper, we briefly review the now well-established consequentialist and deontological arguments for and against the use of unethical research. We argue that, while there are potentially compelling justifications for use under some circumstances, these justifications fail when unethical practices (...) are ongoing—as in the case of research involving transplantations in which organs have been procured unethically from executed prisoners. Use of such research displays a lack of respect and concern for the victims and undermines efforts to deter unethical practices. Such use also creates moral taint and renders those who use the research complicit in continuing harm. In Part 2, we distinguish three dimensions of ‘non-use’ of unethical research: non-use of published unethical research, non-publication, and retraction and argue that all three types of non-use should be upheld in the case of Chinese transplant research. Publishers have responsibilities to not publish contemporary unethical biomedical research, and where this has occurred, to retract publications. Failure to retract the papers implicitly condones the research, while uptake of the research through citations rewards researchers and ongoing circulation of the data in the literature facilitates subsequent use by researchers, policymakers and clinicians. (shrink)

Certain research strands can yield “forbidden knowledge”. This term refers to knowledge that is considered too sensitive, dangerous or taboo to be produced or shared. Discourses about such publication restrictions are already entrenched in scientific fields like IT security, synthetic biology or nuclear physics research. This paper makes the case for transferring this discourse to machine learning research. Some machine learning applications can very easily be misused and unfold harmful consequences, for instance, with regard to generative video or text synthesis, (...) personality analysis, behavior manipulation, software vulnerability detection and the like. Up till now, the machine learning research community embraces the idea of open access. However, this is opposed to precautionary efforts to prevent the malicious use of machine learning applications. Information about or from such applications may, if improperly disclosed, cause harm to people, organizations or whole societies. Hence, the goal of this work is to outline deliberations on how to deal with questions concerning the dissemination of such information. It proposes a tentative ethical framework for the machine learning community on how to deal with forbidden knowledge and dual-use applications. (shrink)

In debates over the regulation of communication related to dual-use research, the risks that such communication creates must be weighed against against the value of scientific autonomy. The censorship of such communication seems justifiable in certain cases, given the potentially catastrophic applications of some dual-use research. This conclusion however, gives rise to another kind of danger: that regulators will use overly simplistic cost-benefit analysis to rationalize excessive regulation of scientific research. In response to this, we show how institutional design principles (...) and normative frameworks from free speech theory can be used to help extend the argument for regulating dangerous dual-use research beyond overly simplistic cost-benefit reasoning, but without reverting to an implausibly absolutist view of scientific autonomy. (shrink)

A recent controversy over the US National Science Advisory Board for Biosecurity's recommendation to censor two publications on genetically modified H5N1 avian influenza has generated concern over the threat to scientific freedom such censorship presents. In this paper, I argue that in the case of these studies, appeals to scientific freedom are not sufficient to motivate a rejection of censorship. I then use this conclusion to draw broader concerns about the ethics of dual-use research.

Debates about dual-use research often turn on the potential for scientific research to be used to benefit or harm humanity. This dual-use potential is conventionally understood as the product of the magnitude of the harms and benefits of dual-use research, multiplied by their likelihood. This account, however, neglects important social aspects of the use of science and technology. In this paper, I supplement existing conceptions of dual-use potential to account for the social context of dual-use research. This account incorporates relational (...) and positional concerns that feature in the success or failure of dual-use. I then defend this account against foreseeable objections. (shrink)

The rapid advance of life science within the context of increased international concern over the potential misuse of findings has resulted in the lack of agreement on the issues of responsibility, control and collaboration. This progress of knowledge outpaces the efforts of creating moral and legal guidelines for the detection and minimization of the risks in the research process. There is a need to identify and address normative aspects of dual-use research. This paper focuses on the issues of safety and (...) global collaboration in life science research by highlighting the importance of openness, enabling policies and cooperative governance. These safeguards are believed to reduce the risks related to the misuse of science while enabling the important research to move forward. The paper addresses the need for a better definition of dual use concept and, based on the historical precedents, explores the moral concerns and governmental strategies of dual-use research. The three necessary moves in addressing the issue of security in life sciences are suggested: the move from constraining to enabling types of policies, the move from secrecy to openness, and the move from segregation to integration of the public voice. (shrink)

Synthetic biologists aim to generate biological organisms according to rational design principles. Their work may have many beneficial applications, but it also raises potentially serious ethical concerns. In this article, we consider what attention the discipline demands from bioethicists. We argue that the most important issue for ethicists to examine is the risk that knowledge from synthetic biology will be misused, for example, in biological terrorism or warfare. To adequately address this concern, bioethics will need to broaden its scope, contemplating (...) not just the means by which scientific knowledge is produced, but also what kinds of knowledge should be sought and disseminated. (shrink)

The last 12 years have seen historically high levels of interest in biosecurity among life scientists, science policymakers, and academic experts on science and security policy. This interest was triggered by the 9/11 terrorist attacks, the ‘anthrax letters’ attack of the same year, and two virology papers, published early last decade, that were thought to raise serious biosecurity concerns.1 Ethicists have come relatively late to the game, but, in recent years, a lively debate has developed on ethical issues raised by (...) biosecurity policy, and, more generally, on the ethics of producing and disseminating ‘dangerous’ biomedical knowledge. Unsurprisingly, this debate has taken on increased sense of urgency over the last 18 months as the journals Science and Nature, the United States National Science Advisory Board for Biosecurity, and the World Health Organization, among others, have been considering whether and how to publish two academic papers reporting means of enhancing the transmissibility of H5N1 influenza, or ‘bird flu’ .We hope that this issue of the Journal of Medical Ethics will substantially advance the emerging ethical debate in this area. The issue features five articles on the ethics of biosecurity: a feature article, by Allen Buchanan and Maureen Kelley ; three brief replies to this article, by Michael Selgelid , Thomas May , and Nicholas King ; and a stand-alone paper by Nicholas Evans , which discusses the recent H5N1 controversy and analyses the appeals to scientific freedom that have been made by some of its protagonists. In this ‘concise argument’, I can, regrettably, comment only on the Buchanan and Kelley piece.Buchanan and Kelley on the framing of the biosecurity debateBuchanan and Kelley aim to broaden and reframe the existing debate on biosecurity. They begin by noting that "science policy … ". (shrink)

This paper explores early Australasian philosophy in some detail. Two approaches have dominated Western philosophy in Australia: idealism and materialism. Idealism was prevalent between the 1880s and the 1930s, but dissipated thereafter. Idealism in Australia often reflected Kantian themes, but it also reflected the revival of interest in Hegel through the work of ‘absolute idealists’ such as T. H. Green, F. H. Bradley, and Henry Jones. A number of the early New Zealand philosophers were also educated in the idealist tradition (...) and were influential in their communities, but produced relatively little. In Australia, materialism gained prominence through the work of John Anderson, who arrived in Australia in 1927, and continues to be influential. John Anderson had been a student of Henry Jones, who might therefore be said to have influenced both main strands of Australian philosophical thought. (shrink)

In this article, the concept of moralistic fallacy introduced by B. D. Davis is elaborated on in more detail. The main features of this fallacy are discussed, and its general form is presented. The moralistic fallacy might have some undesirable outcomes. Some of them might even be in direct conflict to the original moral position. If this occurs, it is possible to characterize it as a paradox of moralistic fallacy. The possibility of this paradox provides a further reason not to (...) prevent any scientific inquiries and not to depict any knowledge as dangerous. (shrink)