It has sometimes been suggested that removing statues of problematic historical figures such as Cecil Rhodes from the public realm amounts to ‘erasing history’ and should therefore be avoided. In philosophy, this approach has generally been rejected. In this article, I try to develop a more plausible version of the erasing history argument. I suggest that sometimes societies aim to forget for defensive reasons (i.e. to cover up past wrongdoing). I also suggest that such past wrongdoing can also consist in (...) the widespread acceptance of a problematic monument (and therewith complicity in the insult it represents). I conclude that in such cases, to avoid defensive forgetting, we should aim to recontextualize rather than remove the monument. I also discuss which forms such recontextualization may take. (shrink)