There is an old meta-philosophical worry: very roughly, metaphysical theories have no observational consequences and so the study of metaphysics has no value. The worry has been around in some form since the rise of logical positivism in the early twentieth century but has seen a bit of a renaissance recently. In this paper, I provide an apology for metaphysics in the face of this kind of concern. The core of the argument is this: pure mathematics detaches from science in much the same manner as metaphysics and yet it is valuable nonetheless. The source of value enjoyed by pure mathematics extends to metaphysics as well. Accordingly, if one denies that metaphysics has value, then one is forced to deny that pure mathematics has value. The argument places an added burden on the sceptic of metaphysics. If one truly believes that metaphysics is worthless (as some philosophers do), then one must give up on pure mathematics as well.