To explore issues of developmental structure, physical em- bodiment, integration of multiple sensory and motor systems, and social interaction, we have constructed an upper-torso humanoid robot called Cog. The robot has twenty-one degrees of freedom and a variety of sen- sory systems, including visual, auditory, vestibular, kinesthetic, and tac- tile senses. This chapter gives a background on the methodology that we have used in our investigations, highlights the research issues that have been raised during this project, and provides a summary (...) of both the current state of the project and our long-term goals. We report on a variety of implemented visual-motor routines (smooth-pursuit track- ing, saccades, binocular vergence, and vestibular-ocular and opto-kinetic re?exes), orientation behaviors, motor control techniques, and social be- haviors (pointing to a visual target, recognizing joint attention through face and eye ?nding, imitation of head nods, and regulating interaction through expressive feedback). We further outline a number of areas for future research that will be necessary to build a complete embodied sys- tem. (shrink)

Music is at the centre of what it means to be human – it is the sounds of human bodies and minds moving in creative, story-making ways. We argue that music comes from the way in which knowing bodies (Merleau-Ponty) prospectively explore the environment using habitual 'patterns of action' which we have identified as our innate ‘communicative musicality’. To support our argument, we present short case studies of infant interactions using micro analyses of video and audio recordings to show the (...) timings and shapes of intersubjective vocalisations and body movements of adult and child while they improvise shared narratives of meaning. Following a survey of the history of discoveries of infant abilities, we propose that the gestural narrative structures of voice and body seen as infants communicate with loving caregivers are the building blocks of what become particular cultural instances of the art of music, and of dance, theatre and other temporal arts. Children enter into a musical culture where their innate communicative musicality can be encouraged and strengthened through sensitive, respectful, playful, culturally informed teaching in companionship. The central importance of our abilities for music as part of what sustains our well-being is supported by evidence that communicative musicality strengthens emotions of social resilience to aid recovery from mental stress and illness. Drawing on the experience of the first author as a counsellor, we argue that the strength of one person’s communicative musicality can support the vitality of another’s through the application of skilful techniques that encourage an intimate, supportive, therapeutic, spirited companionship. Turning to brain science, we focus on hemispheric differences and the affective neuroscience of Jaak Panksepp. We emphasise that the psychobiological purpose of our innate musicality grows from the integrated rhythms of energy in the brain for prospective, sensation-seeking affective guidance of vitality of movement. We conclude with a Coda that recalls the philosophy of the Scottish Enlightenment, which built on the work of Heraclitus and Spinoza. This view places the shared experience of sensations of living – our communicative musicality – as inspiration for rules of logic formulated in symbols of language. (shrink)

Underlying the recent focus on embodied and interactive aspects of social understanding are several intuitions about what roles the body, interaction processes, and interpersonal experience play. In this paper, we introduce a systematic, hands-on method for investigating the experience of interacting and its role in intersubjectivity. Special about this method is that it starts from the idea that researchers of social understanding are themselves one of the best tools for their own investigations. The method provides ways for researchers to calibrate (...) and to trust themselves as sophisticated instruments to help generate novel insights into human interactive experience. We present the basics of the method, and two empirical studies. The first is a video-study on autism, which shows greater refinement in the way people with autism embody their social interactions than previously thought. The second is a study of thinking in live interactions, which provides insight into the common feeling that too much thinking can hamper interaction, and into how this kind of interactional awkwardness might be unblocked. (shrink)

The idea that natural language grammar and planned action are relatedsystems has been implicit in psychological theory for more than acentury. However, formal theories in the two domains have tendedto look very different. This article argues that both faculties sharethe formal character of applicative systems based on operationscorresponding to the same two combinatory operations, namely functional composition and type-raising. Viewing them in thisway suggests simpler and more cognitively plausible accounts of bothsystems, and suggests that the language faculty evolved in the (...) speciesand develops in children by a rather direct adaptation of a moreprimitive apparatus for planning purposive action in the world bycomposing affordances of objects or tools. Theknowledge representation that underlies such planning is alsoreflected in the natural language semantics of tense, mood, andaspect, which the paper begins by arguing provides the key tounderstanding both systems. (shrink)