Getting people not to harm others is a central goal of morality. But while it is commonly perceived that those who benefit others merit gratitude, those who do not harm others are not ordinarily thought to merit anything. I attempt to argue against this, claiming that all the arguments against gratitude to the non-maleficent are unsuccessful. Finally, I explore the difference it would make if we thought that we owe gratitude to those who do not harm us.