Klein’s account of epistemic justification, infinitism, supplies a novel solution to the regress problem. We argue that concentrating on the normative aspect of justification exposes a number of unpalatable consequences for infinitism, all of which warrant rejecting the position. As an intermediary step, we develop a stronger version of the ‘finite minds’ objection.