The notion of common cause closedness of a classical, Kolmogorovian probability space with respect to a causal independence relation between the random events is defined, and propositions are presented that characterize common cause closedness for specific probability spaces. It is proved in particular that no probability space with a finite number of random events can contain common causes of all the correlations it predicts; however, it is demonstrated that probability spaces even with a finite number of random events can be (...) common cause closed with respect to a causal independence relation that is stronger than logical independence. Furthermore it is shown that infinite, atomless probability spaces are always common cause closed in the strongest possible sense. Open problems concerning common cause closedness are formulated and the results are interpreted from the perspective of Reichenbach's Common Cause Principle. (shrink)