This paper discusses an outstanding issue in philosophy of physics concerning the relation between quantum symmetries and the notion of physical equivalence. Specifically, it deals with a dilemma arising for quantum symmetry breaking that was posed by Baker, who claimed that if two ground states are connected by a symmetry, even when it is broken, they must be physically equivalent. However, I argue that the dilemma is just apparent. In fact, I object to Baker’s conclusion by showing that the two (...) thermodynamical phases of a ferromagnet, which are connected by the so-called flip-flop symmetry, are physically inequivalent, thereby providing a counter-example to his claim. (shrink)