How do we switch between “playing along” and treating robots as technical agents? We propose interaction breakdowns to help solve this “social artifact puzzle”: Breaks cause changes from fluid interaction to explicit reasoning and interaction with the raw artifact. These changes are closely linked to understanding the technical architecture and could be used to design better human–robot interaction (HRI).