The primary justification for mathematical structuralism is its capacity to explain two observations about mathematical objects, typically natural numbers. Non-eliminative structuralism attributes these features to the particular ontology of mathematics. I argue that attributing the features to an ontology of structural objects conflicts with claims often made by structuralists to the effect that their structuralist theses are versions of Quine’s ontological relativity or Putnam’s internal realism. I describe and argue for an alternative explanation for these features which instead explains the (...) attributes them to the mathematical practice of representing numbers using more concrete tokens, such as sets, strokes and so on. (shrink)