Many philosophers have been attracted by the view that colors are mind-independent properties of object surfaces. While this view has come in for a fair bit of criticism for failing to do justice to the facts about perceptual variation, Byrne and Hilbert have recently argued that perceptual variation involving color is no more problematic for physicalism about color than representational variation involving temperature is for physicalism about temperature. Unfortunately, the analogy on which this response rests is no less controversial than (...) the disputed view about color, and so the response leads to a standoff rather than a resolution of the debate. However, we can appeal to facts about our inferential treatment of color and other properties as a way of resolving this impasse; doing so gives us defeasible reason for rejecting the Byrne and Hilbert response, and so for rejecting their mind-independent conception of color. (shrink)