Abstract

Suicide is a complex act whose meanings, while sometimes tragic, vary widely. This chapter surveys the ethical landscape surrounding algorithmic methods of suicide prevention especially as it pertains to social media activity and to the moderation of online suicide communities. We begin with a typology of suicide, distinguishing between varied goals in which suicide may factor as a means. Suicides should be understood as an act with varied eliciting desires, meanings, consequences, and ethics. Further,while many suicides may be grounded on irrational desire, we argue that a desire to suicide may nonetheless be rational in some cases. We then offer a survey of the attempts by social media corporations to create suicide prediction algorithms and launch interventions aimed at preventing suicide as well as an overview of the current ethical debate. We argue that the values embedded within algorithmic suicide prevention nudges are “thick” in a substantive sense and deserving of scrutiny. Given that debates about the rationality, meaning, and permissibility of suicide are common and subject to intracultural and cross-cultural differences, we maintain that the task of suicide prediction is ill-suited to algorithmic approaches. Despite an algorithm’s ability to quantify a complex phenomenon like suicide risk and its appearance of objectivity, any suicide prediction algorithm is thoroughly subjective and involves moral judgments all the way down. Any such algorithm would necessarily impose a normative stance on suicide onto its user base that is subject to reasonable intra and cross-cultural disagreement.