Synesthetic experiences of color have been traditionally conceptualized as a perceptual phenomenon. However, recent evidence suggests a role of higher order cognition in the formation of synesthetic experiences. Here, we discuss how synesthetic experiences of color differ from and influence veridical color processing, and how non-perceptual processes such as imagery and color memory might play a role in eliciting synesthetic color experience.