There has been much discussion recently about the scope and limits of purely symbolic models of the mind and about the proper role of connectionism in cognitive modeling. This paper describes the symbol grounding problem : How can the semantic interpretation of a formal symbol system be made intrinsic to the system, rather than just parasitic on the meanings in our heads? How can the meanings of the meaningless symbol tokens, manipulated solely on the basis of their shapes, be grounded (...) in anything but other meaningless symbols? The problem is analogous to trying to learn Chinese from a Chinese/Chinese dictionary alone. A candidate solution is sketched: Symbolic representations must be grounded bottom-up in nonsymbolic representations of two kinds: iconic representations, which are analogs of the proximal sensory projections of distal objects and events, and categorical representations, which are learned and innate feature-detectors that pick out the invariant features of object and event categories from their sensory projections. Elementary symbols are the names of these object and event categories, assigned on the basis of their categorical representations. Higher-order symbolic representations, grounded in these elementary symbols, consist of symbol strings describing category membership relations. Connectionism is one natural candidate for the mechanism that learns the invariant features underlying categorical representations, thereby connecting names to the proximal projections of the distal objects they stand for. In this way connectionism can be seen as a complementary component in a hybrid nonsymbolic/symbolic model of the mind, rather than a rival to purely symbolic modeling. Such a hybrid model would not have an autonomous symbolic module, however; the symbolic functions would emerge as an intrinsically dedicated symbol system as a consequence of the bottom-up grounding of categories ' names in their sensory representations. Symbol manipulation would be governed not just by the arbitrary shapes of the symbol tokens, but by the nonarbitrary shapes of the icons and category invariants in which they are grounded. (shrink)

Nearly all listeners consider the subjective aspects of music, such as its emotional tone, to have primary importance. But contemporary philosophers often downplay, ignore, or even deny such aspects of experience. Moreover, traditional philosophies of music try to decontextualize it. Using music as an example, this paper explores the structure of qualitative experience, demonstrating that it is multi-layer emergent, non-compositional, enacted, and situation dependent, among other non-Cartesian properties. Our explanations draw on recent work in cognitive science, including blending, image schemas, (...) and sensory memory, as well as on phenomenology. A hierarchical structure transformation based complexity theory is applied to obtain a non-linear dynamical systems explanation of qualia and emotion that respects phenomenological insights about time, including retention and protention. The complexity measure provides both a metric structure and a potential function, on spaces of pieces that are constructed using given elements and transformations, with weights that reflect their cognitive difficulty. However, the approach is not reductionist; using improvisation and the evolution of musical notation as data, we argue that situatedness, especially enactment and social context, are key aspects of musical consciousness. (shrink)