In this commentary, we discuss the nature of reversible and irreversible questions, that is, questions that may enable one to identify the nature of the source of their answers. We then introduce GPT-3, a third-generation, autoregressive language model that uses deep learning to produce human-like texts, and use the previous distinction to analyse it. We expand the analysis to present three tests based on mathematical, semantic, and ethical questions and show that GPT-3 is not designed to pass any of them. (...) This is a reminder that GPT-3 does not do what it is not supposed to do, and that any interpretation of GPT-3 as the beginning of the emergence of a general form of artificial intelligence is merely uninformed science fiction. We conclude by outlining some of the significant consequences of the industrialisation of automatic and cheap production of good, semantic artefacts. (shrink)

Addressing fake news requires a multidisciplinary effort The rise of fake news highlights the erosion of long-standing institutional bulwarks against misinformation in the internet age. Concern over the problem is global. However, much remains unknown regarding the vulnerabilities of individuals, institutions, and society to manipulations by malicious actors. A new system of safeguards is needed. Below, we discuss extant social and computer science research regarding belief in fake news and the mechanisms by which it spreads. Fake news has a long (...) history, but we focus on unanswered scientific questions raised by the proliferation of its most recent, politically oriented incarnation. Beyond selected references in the text, suggested further reading can be found in the supplementary materials. (shrink)

“[T]he Precautionary Principle still has neither a commonly accepted definition nor a set of criteria to guide its implementation. “There is”, Freestone … cogently observes, “a certain paradox in the widespread and rapid adoption of the Precautionary Principle”: While it is applauded as a “good thing”, no one is quite sure about what it really means or how it might be..

Mainstream moral theories deal with situations in which the outcome of each possible action is well-determined and knowable. In order to make ethics relevant for problems of risk and uncertainty, moral theories have to be extended so that they cover actions whose outcomes are not determinable beforehand. One approach to this extension problem is to develop methods for appraising probabilistic combinations of outcomes. This approach is investigated and shown not to solve the problem. An alternative approach is then developed. Its (...) starting-point is that everyone has a prima facie moral right not to be exposed to risk. However, this right can be overridden if the risk-exposure is part of an equitable system for risk-taking that works to the advantage of the individual risk-exposed person. (shrink)

Ethical codes, ethics committees, and respect for autonomy have been key to the development of medical ethics —elements that digital ethics would do well to emulate.

This book deals with the problem of dual-use science research and technology. It first explains the concept of dual use and then offers analyses of collective knowledge and collective ignorance. It goes on to present a theory of collective responsibility, followed by four chapters focusing on a particular scientific field or industry of dual use concern: the chemical industry, the nuclear industry, cyber-technology and the biological sciences. The problem of dual-use science research and technology arises because such research and technology (...) has the potential to be used for great evil as well as for great good. On the one hand, knowledge is a necessary condition, and perhaps a constitutive feature, of technologies that contribute greatly to individual and collective well-being. Consider, for example, nuclear technology that enables the generation of low cost electricity in populations without obvious alternative energy sources. So technological knowledge is a good thing and ignorance of it a bad thing. On the other hand, these same technologies can be extremely harmful to individuals and collectives, as with the atomic bombs dropped on Hiroshima and Nagasaki. So, at least with respect to some technologies evidently knowledge is a bad thing and ignorance a good thing. Accordingly, the question arises as to whether we ought to limit scientific research and/or the development of technology and, if so, which research or technology, in what manner and to what extent. This book examines the answer to that question. (shrink)

Synthetic biologists aim to generate biological organisms according to rational design principles. Their work may have many beneficial applications, but it also raises potentially serious ethical concerns. In this article, we consider what attention the discipline demands from bioethicists. We argue that the most important issue for ethicists to examine is the risk that knowledge from synthetic biology will be misused, for example, in biological terrorism or warfare. To adequately address this concern, bioethics will need to broaden its scope, contemplating (...) not just the means by which scientific knowledge is produced, but also what kinds of knowledge should be sought and disseminated. (shrink)

The precautionary principle aims to influence decision‐making in contexts where some activity poses uncertain but potentially grave threats. This perfectly describes the controversy surrounding germline gene editing. This article considers whether the precautionary principle should influence how we weigh the risks and benefits of human germline interventions, focusing especially on the possible threats to the health of future generations. We distinguish between several existing forms of the precautionary principle, assess their plausibility and consider their implications for the ethics of germline (...) modification. We also offer a novel form of the precautionary principle: the sufficientarian precautionary principle. Some plausible versions of the precautionary principle recommend placing somewhat greater weight on avoiding threats to future generations than on achieving short‐term benefits. However, no plausible versions of the precautionary principle entail that we should outright reject the use germline gene editing in human reproduction and some, such as the sufficientarian version, might endorse its use. (shrink)

There is worldwide concern over false news and the possibility that it can influence political, economic, and social well-being. To understand how false news spreads, Vosoughi et al. used a data set of rumor cascades on Twitter from 2006 to 2017. About 126,000 rumors were spread by ∼3 million people. False news reached more people than the truth; the top 1 of false news cascades diffused to between 1000 and 100,000 people, whereas the truth rarely diffused to more than 1000 (...) people. Falsehood also diffused faster than the truth. The degree of novelty and the emotional reactions of recipients may be responsible for the differences observed. Science, this issue p. 1146 A large-scale analysis of tweets reveals that false rumors spread further and faster than the truth. We investigated the differential diffusion of all of the verified true and false news stories distributed on Twitter from 2006 to 2017. The data comprise ~126,000 stories tweeted by ~3 million people more than 4.5 million times. We classified news as true or false using information from six independent fact-checking organizations that exhibited 95 to 98 agreement on the classifications. Falsehood diffused significantly farther, faster, deeper, and more broadly than the truth in all categories of information, and the effects were more pronounced for false political news than for false news about terrorism, natural disasters, science, urban legends, or financial information. We found that false news was more novel than true news, which suggests that people were more likely to share novel information. Whereas false stories inspired fear, disgust, and surprise in replies, true stories inspired anticipation, sadness, joy, and trust. Contrary to conventional wisdom, robots accelerated the spread of true and false news at the same rate, implying that false news spreads more than the truth because humans, not robots, are more likely to spread it. (shrink)

Gain-of-function research involves experimentation that aims or is expected to increase the transmissibility and/or virulence of pathogens. Such research, when conducted by responsible scientists, usually aims to improve understanding of disease causing agents, their interaction with human hosts, and/or their potential to cause pandemics. The ultimate objective of such research is to better inform public health and preparedness efforts and/or development of medical countermeasures. Despite these important potential benefits, GOF research can pose risks regarding biosecurity and biosafety. In 2014 the (...) administration of US President Barack Obama called for a “pause” on funding of GOF experiments involving influenza, SARS, and MERS viruses in particular. With announcement of this pause, the US Government launched a “deliberative process” regarding risks and benefits of GOFR to inform future funding decisions—and the US National Science Advisory Board for Biosecurity was tasked with making recommendations to the US Government on this matter. As part of this deliberative process the National Institutes of Health commissioned this Ethical Analysis White Paper, requesting that it provide review and summary of ethical literature on GOFR, identification and analysis of existing ethical and decision-making frameworks relevant to the evaluation of risks and benefits of GOFR, decision-making about the conduct of GOF studies, and the development of US policy regarding GOFR, and development of an ethical and decision-making framework that may be considered by NSABB when analyzing information provided by GOFR risk-benefit assessment, and when crafting its final recommendations. The ethical and decision-making framework ultimately developed is based on the idea that there are numerous ethically relevant dimensions upon which any given case of GOFR can fare better or worse : research imperative, proportionality, minimization of risks, manageability of risks, justice, good governance, evidence, and international outlook and engagement. Rather than drawing a sharp bright line between GOFR studies that are ethically acceptable and those that are ethically unacceptable, this framework is designed to indicate where any given study would fall on an ethical spectrum—where imaginable cases of GOFR might range from those that are most ethically acceptable, at one end of the spectrum, to those that are most ethically problematic or unacceptable, at the other. The aim should be that any GOFR pursued should be as far as possible towards the former end of the spectrum. (shrink)

: Some scientific research should not be published. The risks to national security and public health override the social benefits of disseminating scientific results openly. Unfortunately, scientists themselves are not in a position to know which studies to withhold from public view, as the National Research Council has proposed. Yet neither can government alone be trusted to balance the competing interests at stake.

In the last half century, decision theory has had a deep influence on moral theory. Its impact has largely been beneficial. However, it has also given rise to some problems, two of which are discussed here. First, issues such as risk-taking and risk imposition have been left out of ethics since they are believed to belong to decision theory, and consequently the ethical aspects of these issues have not been treated in either discipline. Secondly, ethics has adopted the decision-theoretical idea (...) that action-guidance has to be based on cause–effect or means–ends relationships between an individual action and its possible outcomes. This is problematic since the morally relevant connections between an action and future events are not fully covered by such relationships. In response to the first problem it is proposed that moral theory should deal directly and extensively with issues such as risk-taking and risk imposition, thereby intruding unabashedly into the traditional territory of decision theory. As a partial response to the second problem it is proposed that moral theorizing should release itself from the decision-theoretical requirement that the moral status of an action has to be derivable from the consequences (or other properties) that are assignable to that action alone. In particular, the effects that an action can have in combination with other actions by the same or other agents are valid arguments in an action-guiding moral discourse, even if its contribution to these combined consequences cannot be isolated and evaluated separately. (shrink)

The growing threat of the misuse of science and technology for terrorist or criminal purposes has led scientists, institutions, professional organizations, funding agencies, journals, and governments to consider how best to control research that can be readily used to cause significant harm to public health, the economy, the environment, or national security, also known as dual use research. This commentary argues that scientists can regulate dual use research, provided that they are committed to developing effective dual use policies and a (...) culture of shared responsibility. (shrink)

Health security has become a popular way of justifying efforts to control catastrophic threats to public health. Unfortunately, there has been little analysis of the concept of health security, nor the relationship between health security and other potential aims of public health policy. In this paper I develop an account of health security as an aversion to risky policy options. I explore three reasons for thinking risk avoidance is a distinctly worthwhile aim of public health policy: that security is intrinsically (...) valuable, that it is necessary for social planning and that it is an appropriate response to decision-making in contexts of very limited information. Striking the right balance between securing and maximizing population health thus requires a substantive, and hitherto unrecognized, value judgment. Finally, I critically evaluate the current health security agenda in light of this new account of the concept and its relationship to the other aims of public health policy. (shrink)

This article examines the global and worsening problem of research misconduct as it relates to bio-medico-legal education. While research misconduct has serious legal implications, few adequate legal remedies exist to deal with it. With respect to teaching, research ethics education should be mandatory for biomedical students and physicians. Although teaching alone will not prevent misconduct, it promotes integrity, accountability, and responsibility in research. Policies and law enforcement should send a clear message that researchers should adhere to the highest standards of (...) ethics in research. It is vital that researchers and physicians understand basic aspects of law and the legal system in order to develop understanding of the medico-legal issues not just in the legal context, but with a sound grounding in ethics, social and theoretical contexts so that they can practice good medicine. Routine and holistic research ethics education across the curriculum for medical students and resident physicians, and continuing medical education for practicing doctors, are probably the best ways to accomplish this goal. (shrink)

In 2011, for the first time ever, two scientific journals were asked not to publish research papers in full detail. The research in question was on the H5N1 influenza virus (bird flu), and the concern was that the expected public health benefits of disseminating the findings did not outweigh the potential harm should the knowledge be misused for malicious purposes. This constraint raises important ethical concerns as it collides with scientific freedom and openness. In this article, we argue that constraining (...) the dissemination of dual-use knowledge can in certain cases be justified because, for example: scientists have a responsibility for potentially harmful consequences of their research; the public need not always know of all scientific discoveries; uncertainty about the risks of harm may warrant precaution; and expected benefits do not always outweigh potential harm. However, the constraints in question are not absolute but can be both temporary and partial. We propose three core aspects for an ethics of dual-use dissemination: dual-use awareness, precaution, and acknowledgment of conflicting values. Additionally, to help scientists understand when constraints on dissemination may be justified we suggest three corresponding conditions that prompt scientists to recognize dual-use material or research, consider the potential impact of dual-use knowledge dissemination, and acknowledge and respond to external dissemination concerns. (shrink)