It is shown that for an inside observer it is impossible to distinguish all states in which a system was at some past time. This holds for classical and quantum systems, but an assumption of determinism is essential in the proof.