Most Artificial Intelligence theories of language either assume a syntactic component which serves as “front end” for the rest of the system, or else reject all attempts at distinguishing modules within the comprehension system. In this paper we will present an alternative which, while keeping modularity, will account for several puzzles for typical “syntax first” theories. The major addition to this theory is a “marker passing” (or “spreading activation”) component, which operates in parallel to the normal syntactic component.