Japanese English learners have difficulty speaking Double Object (DO; give B A) than Prepositional Object (PO; give A to B) structures which neural underpinning is unknown. In speaking, syntactic and phonological processing follow semantic encoding, conversion of non-verbal mental representation into a structure suitable for expression. To test whether DO difficulty lies in linguistic or prelinguistic process, we conducted functional magnetic resonance imaging. Thirty participants described cartoons using DO or PO, or simply named them. Greater reaction times and error rates (...) indicated DO difficulty. DO compared with PO showed parieto-frontal activation including left inferior frontal gyrus, reflecting linguistic process. Psychological priming in PO produced immediately after DO and vice versa compared to after control, indicated shared process between PO and DO. Cross-structural neural repetition suppression was observed in occipito-parietal regions, overlapping the linguistic system in pre-SMA. Thus DO and PO share prelinguistic process, whereas linguistic process imposes overload in DO. (shrink)