Connectionist models provide a promising alternative to the traditional computational approach that has for several decades dominated cognitive science and artificial intelligence, although the nature of connectionist models and their relation to symbol processing remains controversial. Connectionist models can be characterized by three general computational features: distinct layers of interconnected units, recursive rules for updating the strengths of the connections during learning, and “simple” homogeneous computing elements. Using just these three features one can construct surprisingly elegant and powerful models of (...) memory, perception, motor control, categorization, and reasoning. What makes the connectionist approach unique is not its variety of representational possibilities or its departure from explicit rule-based models, or even its preoccupation with the brain metaphor. Rather, it is that connectionist models can be used to explore systematically the complex interaction between learning and representation, as we try to demonstrate through the analysis of several large networks. (shrink)

Shannon's notion of information is more useful for naturalized epistemology than Dretske's.

It is well known that informational theories of representation have trouble accounting for error. Informational semantics is a family of theories attempting a naturalistic, unashamedly reductive explanation of the semantic and intentional properties of thought and language. Most simply, the informational approach explains truth-conditional content in terms of causal, nomic, or simply regular correlation between a representation and a state of affairs. The central work is Dretske, and the theory was largely developed at the University of Wisconsin by Fred Dretske, (...) Dennis Stampe, and Berent Enc. Recently, informational semantics has roamed far beyond its Wisconsin home, and built a sizeable collection of followers. Converts include Jerry Fodor, Robert Stalnaker and, less faithfully, Paul and Patricia Churchland and Hartry Field. But for some years informational semantics has been hounded by a problem with error – the classic presentation is Fodor – and no other problem has hounded the theory so persistently. (shrink)