In a series of works, Jody Azzouni has defended deflationary nominalism, the view that certain sentences quantifying over mathematical objects are literally true, although such objects do not exist. One alleged attraction of this view is that it avoids various philosophical puzzles about mathematical objects. I argue that this thought is misguided. I first develop an ontologically neutral counterpart of Field’s reliability challenge and argue that deflationary nominalism offers no distinctive answer to it. I then show how this reasoning generalizes (...) to other philosophically problematic entities. The moral is that puzzle avoidance fails to motivate deflationary nominalism. (shrink)