Some arguments, based on the possible spontaneous violation of the cosmological principle (represented by the observed large-scale structures of galaxies), on the Cartan geometry of simple spinors, and on the Fock formulation of hydrogen atom wave equation in momentum space, are presented in favor of the hypothesis that space-time and momentum space should be both conformally compactified and should both originate from the two four-dimensional homogeneous spaces of the conformai group, both isomorphic (S 3 ×S 1)/Z 2 and correlated by (...) conformal inversion, but should not necessarily be identified with them. Within this framework, the possible common origin for the SO(4) symmetry underlying the geometrical structure of the Universe, of Kepler orbits, and of the H atom is discussed. One of the consequences of the proposed hypothesis could be that any quantum field theory should be naturally free from both infrared and ultraviolet divergences. But then physical spaces defined as those where physical phenomena may be best described through some set of fields, could be different from those homogeneous spaces. A simple, exactly soluble, toy model, valid for a two-dimensional spacetime, is presented where the conjectured conformally compactified homogeneous spaces are both isomorphic to (S 1 ×S 1)/Z 2,while the possible physical spaces could be two finite lattices which are dual since Fourier transforms, represented by finite, discrete, sums, may be well defined on them. (shrink)