This article discusses some of Chateaubriand’s views on the connections between the ideas of formalization and infinity, as presented in chapters 19 and 20 of Logical Forms. We basically agree with his criticisms of the standard construal of these connections, a view we named “formal proofs as ultimate provings”, but we suggest an alternative way of picturing that connection based on some ideas of the late Wittgenstein.