It is widely supposed that methodological naturalism, understood as a thesis about the methodology of science, is metaphysically neutral, and that this in turn guarantees the value-neutrality of science. In this paper we argue that methodological naturalism is underpinned by certain ontological and epistemological assumptions including evidentialism and the causal closure of the physical, adoption of which necessitates commitment to metaphysical naturalism.