In order to investigate whether addressees can make immediate use of speaker‐based constraints during reference resolution, participant addressees' eye movements were monitored as they helped a confederate cook follow a recipe. Objects were located in the helper's area, which the cook could not reach, and the cook's area, which both could reach. Critical referring expressions matched one object (helper's area) or two objects (helper's and cook's areas), and were produced when the cook's hands were empty or full, which defined the (...) cook's reaching ability constraints. Helper's first and total fixations showed that they restricted their domain of interpretation to their own objects when the cook's hands were empty, and widened it to include the cook's objects only when the cook's hands were full. These results demonstrate that addressees can quickly take into account task‐relevant constraints to restrict their referential domain to referents that are plausible given the speaker's goals and constraints. (shrink)

This study investigates whether addressees visually attend to speakers’ gestures in interaction and whether attention is modulated by changes in social setting and display size. We compare a live face-to-face setting to two video conditions. In all conditions, the face dominates as a fixation target and only a minority of gestures draw fixations. The social and size parameters affect gaze mainly when combined and in the opposite direction from the predicted with fewer gestures fixated on video than live. Gestural holds (...) and speakers’ gaze at their own gestures reliably attract addressees’ fixations in all conditions. The attraction force of holds is unaffected by changes in social and size parameters, suggesting a bottom-up response, whereas speaker-fixated gestures draw significantly less attention in both video conditions, suggesting a social effect for overt gaze-following and visual joint attention. The study provides and validates a video-based paradigm enabling further experimental but ecologically valid explorations of cross-modal information processing. (shrink)