Computation and information processing are among the most fundamental notions in cognitive science. They are also among the most imprecisely discussed. Many cognitive scientists take it for granted that cognition involves computation, information processing, or both – although others disagree vehemently. Yet different cognitive scientists use ‘computation’ and ‘information processing’ to mean different things, sometimes without realizing that they do. In addition, computation and information processing are surrounded by several myths; first and foremost, that they are the same thing. In (...) this paper, we address this unsatisfactory state of affairs by presenting a general and theory-neutral account of computation and information processing. We also apply our framework by analyzing the relations between computation and information processing on one hand and classicism and connectionism on the other. We defend the relevance to cognitive science of both computation, in a generic sense that we fully articulate for the first time, and information processing, in three important senses of the term. Our account advances some foundational debates in cognitive science by untangling some of their conceptual knots in a theory-neutral way. By leveling the playing field, we pave the way for the future resolution of the debates’ empirical aspects. (shrink)

Biological functions are dispositions or effects a trait has which explain the recent maintenance of the trait under natural selection. This is the "modern history" approach to functions. The approach is historical because to ascribe a function is to make a claim about the past, but the relevant past is the recent past; modern history rather than ancient.

This book presents an attempt to develop a theory of knowledge and a philosophy of mind using ideas derived from the mathematical theory of communication developed by Claude Shannon. Information is seen as an objective commodity defined by the dependency relations between distinct events. Knowledge is then analyzed as information caused belief. Perception is the delivery of information in analog form for conceptual utilization by cognitive mechanisms. The final chapters attempt to develop a theory of meaning by viewing meaning as (...) a certain kind of information-carrying role. (shrink)

This paper traces the application of information theory to philosophical problems of mind and meaning from the earliest days of the creation of the mathematical theory of communication. The use of information theory to understand purposive behavior, learning, pattern recognition, and more marked the beginning of the naturalization of mind and meaning. From the inception of information theory, Wiener, Turing, and others began trying to show how to make a mind from informational and computational materials. Over the last 50 years, (...) many philosophers saw different aspects of the naturalization of the mind, though few saw at once all of the pieces of the puzzle that we now know. Starting with Norbert Wiener himself, philosophers and information theorists used concepts from information theory to understand cognition. This paper provides a window on the historical sequence of contributions made to the overall project of naturalizing the mind by philosophers from Shannon, Wiener, and MacKay, to Dennett, Sayre, Dretske, Fodor, and Perry, among others. At some time between 1928 and 1948, American engineers and mathematicians began to talk about `Theory of Information' and `Information Theory,' understanding by these terms approximately and vaguely a theory for which Hartley's `amount of information' is a basic concept. I have been unable to find out when and by whom these names were first used. Hartley himself does not use them nor does he employ the term `Theory of Transmission of Information,' from which the two other shorter terms presumably were derived. It seems that Norbert Wiener and Claude Shannon were using them in the Mid-Forties. (shrink)

This book, published in 1976, presents an entirely original approach to the subject of the mind-body problem, examining it in terms of the conceptual links between the physical sciences and the sciences of human behaviour. It is based on the cybernetic concepts of information and feedback and on the related concepts of thermodynamic and communication-theoretic entropy. The foundation of the approach is the theme of continuity between evolution, learning and human consciousness. The author defines life as a process of energy (...) exchange between organism and environment, and evolution as a feedback process maintaining equilibrium between environment and reproductive group. He demonstrates that closely related feedback processes on the levels of the behaving organism and of the organism’s nervous system constitute the phenomena of learning and consciousness respectively. He analyses language as an expedient for extending human information-processing and control capacities beyond those provided by one’s own nervous system, and shows reason to be a mode of processing information in the form of concepts removed from immediate stimulus control. The last chapter touches on colour vision, pleasure and pain, intentionality, self-awareness and other subjective phenomena. Of special interest to the communication theorist and philosopher, this study is also of interest to psychologists and anyone interested in the connection between the physical and life sciences. (shrink)

Brian Skyrms offers a fascinating demonstration of how fundamental signals are to our world. He uses various scientific tools to investigate how meaning and communication develop. Signals operate in networks of senders and receivers at all levels of life, transmitting and processing information. That is how humans and animals think and interact.

The concept of information tempts us as a theoretical primitive, partly because of the respectability lent to it by highly successful applications of Shannon’s information theory, partly because of its broad range of applicability in various domains, partly because of its neutrality with respect to what basic sorts of things there are. This versatility, however, is the very reason why information cannot be the theoretical primitive we might like it to be. “Information,” as it is variously used, is systematically ambiguous (...) between whether it involves continuous or discrete quantities, causal or noncausal relationships, and intrinsic or relational properties. Many uses can be firmly grounded in existing theory, however. Continuous quantities of information involving probabilities can be related to information theory proper. Information defined relative to systems of rules or conventions can be understood relative to the theory of meaning . A number of causal notions may possibly be located relative to standard notions in physics. Precise specification of these distinct properties involved in the common notion of information can allow us to map the relationships between them. Consequently, while information is not in itself the kind of single thing that can play a significant unifying role, analyzing its ambiguities may facilitate headway toward that goal. (shrink)

Biologists rely heavily on the language of information, coding, and transmission that is commonplace in the field of information theory developed by Claude Shannon, but there is open debate about whether such language is anything more than facile metaphor. Philosophers of biology have argued that when biologists talk about information in genes and in evolution, they are not talking about the sort of information that Shannon’s theory addresses. First, philosophers have suggested that Shannon’s theory is only useful for developing a (...) shallow notion of correlation, the so-called causal sense of information. Second, they typically argue that in genetics and evolutionary biology, information language is used in a semantic sense, whereas semantics are deliberately omitted from Shannon’s theory. Neither critique is well-founded. Here we propose an alternative to the causal and semantic senses of information: a transmission sense of information, in which an object X conveys information if the function of X is to reduce, by virtue of its sequence properties, uncertainty on the part of an agent who observes X. The transmission sense not only captures much of what biologists intend when they talk about information in genes, but also brings Shannon’s theory back to the fore. By taking the viewpoint of a communications engineer and focusing on the decision problem of how information is to be packaged for transport, this approach resolves several problems that have plagued the information concept in biology, and highlights a number of important features of the way that information is encoded, stored, and transmitted as genetic sequence. (shrink)

The brain is often taken to be a paradigmatic example of a signaling system with semantic and representational properties, in which neurons are senders and receivers of information carried in action potentials. A closer look at this picture shows that it is not as appealing as it might initially seem in explaining the function of the brain. Working from several sender-receiver models within the teleosemantic framework, I will first argue that two requirements must be met for a system to support (...) genuine semantic information: 1. The receiver must be competent —that is, it must be able to extract rewards from its environment on the basis of the signals that it receives. 2. The receiver must have some flexibility of response relative to the signal received. In the second part of the paper, this initial framework will be applied to neural processes, pointing to the surprising conclusion that signaling at the single-neuron level is only weakly semantic at best. Contrary to received views, neurons will have little or no access to semantic information (though their patterns of activity may carry plenty of quantitative, correlational information) about the world outside the organism. Genuine representation of the world requires an organism - level receiver of semantic information, to which any particular set of neurons makes only a small contribution. (shrink)