This paper tries to make sense of Kant's scattered remarks about conic sections to see what light they shed on his philosophy of mathematics. It proceeds by confronting his remarks with the source that seems to have informed his thinking about conic sections: the Conica of Apollonius. The paper raises questions about Kant's attitude towards mathematics and the way he understood the cognitive resources available to us to do mathematics.