This chapter tries to answer the following question: How should we conceive of the method of mathematics, if we take a naturalist stance? The problem arises since mathematical knowledge is regarded as the paradigm of certain knowledge, because mathematics is based on the axiomatic method. Moreover, natural science is deeply mathematized, and science is crucial for any naturalist perspective. But mathematics seems to provide a counterexample both to methodological and ontological naturalism. To face this problem, some authors tried to naturalize mathematics by relying on evolutionism. But several difficulties arise when we try to do this. This chapter suggests that, in order to naturalize mathematics, it is better to take the method of mathematics to be the analytic method, rather than the axiomatic method, and thus conceive of mathematical knowledge as plausible knowledge.