According to epistemic fallibilism, we cannot be certain of anything. According to the Christian tradition, faith comes with certainty. I develop this dilemma from recent accounts of fallibilism and various representatives of the Christian tradition. I then argue that on John Henry Newman's account of faith the dilemma is merely apparent. Finally, I develop Newman's account of the certainty that accompanies faith and is compatible with fallibilism.