ABSTRACT This paper reveals David Hilbert’s position in the philosophy of mathematics, circa 1900, to be a form of non-eliminative structuralism, predating his formalism. I argue that Hilbert withstands the pressing objections put to him by Frege in the course of the Frege-Hilbert controversy in virtue of this early structuralist approach. To demonstrate that this historical position deserves contemporary attention I show that Hilbertian structuralism avoids a recent wave of objections against non-eliminative structuralists to the effect that they cannot distinguish (...) between structurally identical but importantly distinct mathematical objects, such as the complex roots of $-1$. (shrink)