We provide a formally rigorous framework for integrating singular causation, as understood by Nuel Belnap's theory of causae causantes, and objective single case probabilities. The central notion is that of a causal probability space whose sample space consists of causal alternatives. Such a probability space is generally not isomorphic to a product space. We give a causally motivated statement of the Markov condition and an analysis of the concept of screening-off. 1. Causal dependencies and probabilities1.1Background: causation in branching space-times1.2What are (...) probabilities defined for?2. Basic transitions2.1Basics of basic transitions2.2Sets of basic transitions3. Causal probability theory3.1Some simple cases3.2General causal probabilities3.3Application: probability of suprema of a chain. (shrink)