A naturalistic scheme of primitive conceptual representations is proposed using the statistical measure of mutual information. It is argued that a concept represents, not the class of objects that caused its tokening, but the class of objects that is most likely to have caused it (had it been tokened), as specified by the statistical measure of mutual information. This solves the problem of misrepresentation which plagues causal accounts, by taking the representation relation to be determined via ordinal relationships between conditional (...) probabilities. The scheme can deal with statistical biases and does not rely on arbitrary criteria. Implications for the theory of meaning and semantic content are addressed. (shrink)

A naturalistic scheme of primitive conceptual representations is proposed using the statistical measure of mutual information. It is argued that a concept represents, not the class of objects that caused its tokening, but the class of objects that is most likely to have caused it (had it been tokened), as specified by the statistical measure of mutual information. This solves the problem of misrepresentation which plagues causal accounts, by taking the representation relation to be determined via ordinal relationships between conditional (...) probabilities. The scheme can deal with statistical biases and does not rely on arbitrary criteria. Implications for the theory of meaning and semantic content are addressed. (shrink)

The universality, invariance, and elegance of principles governing the universe may be reflected in principles of the minds that have evolved in that universe – provided that the mental principles are formulated with respect to the abstract spaces appropriate for the representation of biologically significant objects and their properties. (1) Positions and motions of objects conserve their shapes in the geometrically fullest and simplest way when represented as points and connecting geodesic paths in the six-dimensional manifold jointly determined by the (...) Euclidean group of three-dimensional space and the symmetry group of each object. (2) Colors of objects attain constancy when represented as points in a three-dimensional vector space in which each variation in natural illumination is canceled by application of its inverse from the three-dimensional linear group of terrestrial transformations of the invariant solar source. (3) Kinds of objects support optimal generalization and categorization when represented, in an evolutionarily-shaped space of possible objects, as connected regions with associated weights determined by Bayesian revision of maximum-entropy priors. Key Words: apparent motion; Bayesian inference; cognition; color constancy; generalization; mental rotation; perception; psychological laws; psychological space; universal laws. (shrink)

According to one productive and influential approach to cognition, categorization, object recognition, and higher level cognitive processes operate on a set of fixed features, which are the output of lower level perceptual processes. In many situations, however, it is the higher level cognitive process being executed that influences the lower level features that are created. Rather than viewing the repertoire of features as being fixed by low-level processes, we present a theory in which people create features to subserve the representation (...) and categorization of objects. Two types of category learning should be distinguished. Fixed space category learning occurs when new categorizations are representable with the available feature set. Flexible space category learning occurs when new categorizations cannot be represented with the features available. Whether fixed or flexible, learning depends on the featural contrasts and similarities between the new category to be represented and the individual's existing concepts. Fixed feature approaches face one of two problems with tasks that call for new features: If the fixed features are fairly high level and directly useful for categorization, then they will not be flexible enough to represent all objects that might be relevant for a new task. If the fixed features are small, subsymbolic fragments (such as pixels), then regularities at the level of the functional features required to accomplish categorizations will not be captured by these primitives. We present evidence of flexible perceptual changes arising from category learning and theoretical arguments for the importance of this flexibility. We describe conditions that promote feature creation and argue against interpreting them in terms of fixed features. Finally, we discuss the implications of functional features for object categorization, conceptual development, chunking, constructive induction, and formal models of dimensionality reduction. Key Words: concept learning; conceptual development; features; perceptual learning; stimulus encoding. (shrink)

According to Aristotle, humans are the rational animal. The borderline between rationality and irrationality is fundamental to many aspects of human life including the law, mental health, and language interpretation. But what is it to be rational? One answer, deeply embedded in the Western intellectual tradition since ancient Greece, is that rationality concerns reasoning according to the rules of logic – the formal theory that specifies the inferential connections that hold with certainty between propositions. Piaget viewed logical reasoning as defining (...) the end-point of cognitive development; and contemporary psychology of reasoning has focussed on comparing human reasoning against logical standards. (shrink)

This is the first of two papers that use off-training set (OTS) error to investigate the assumption-free relationship between learning algorithms. This first paper discusses the senses in which there are no a priori distinctions between learning algorithms. (The second paper discusses the senses in which there are such distinctions.) In this first paper it is shown, loosely speaking, that for any two algorithms A and B, there are “as many” targets (or priors over targets) for which A has lower (...) expected OTS error than B as vice versa, for loss functions like zero-one loss. In particular, this is true if A is cross-validation and B is “anti-cross-validation” (choose the learning algorithm with largest cross-validation error). This paper ends with a discussion of the implications of these results for computational learning theory. It is shown that one cannot say: if empirical misclassification rate is low, the Vapnik-Chervonenkis dimension of your generalizer is small, and the training set is large, then with high probability your OTS error is small. Other implications for “membership queries” algorithms and “punting” algorithms are also discussed. (shrink)

Harnad's main argument can be roughly summarised as follows: due to Searle's Chinese Room argument, symbol systems by themselves are insufficient to exhibit cognition, because the symbols are not grounded in the real world, hence without meaning. However, a symbol system that is connected to the real world through transducers receiving sensory data, with neural nets translating these data into sensory categories, would not be subject to the Chinese Room argument. Harnad's article is not only the starting point for the (...) present debate, but is also a contribution to a longlasting discussion about such questions as: Can a computer think? If yes, would this be solely by virtue of its program? Is the Turing Test appropriate for deciding whether a computer thinks? (shrink)