Studying teaching behavior in controlled conditions is difficult. It seems intuitive that a human learner might have trouble reliably recreating response patterns over and over in interaction. A robot would be the perfect tool to study teaching behavior because its actions can be well controlled and described. However, due to the interactive nature of teaching, developing such a robot is not an easy task. As we will show in this review, respective studies require certain robot appearances and behaviors. These mainly (...) should induce teaching behavior in humans, be interactive, match the study design, and be realizable in terms of effort. We discuss how remote controlling of the robot or simulating robot capabilities is used as an option. With this review, we introduce the field of research on studying human teaching behavior with robots as a tool in the experimental design. We will provide a structured overview of existing work, and identify main challenges of employing robots in such studies. (shrink)