The mathematical theory of communication.

This is a comprehensive discussion of complexity as it arises in physical, chemical, and biological systems, as well as in mathematical models of nature. Common features of these apparently unrelated fields are emphasised and incorporated into a uniform mathematical description, with the support of a large number of detailed examples and illustrations. The quantitative study of complexity is a rapidly developing subject with special impact in the fields of physics, mathematics, information science, and biology. Because of the variety of the (...) approaches, no comprehensive discussion has previously been attempted. This book will be of interest to graduate students and researchers in physics (nonlinear dynamics, fluid dynamics, solid-state, cellular automata, stochastic processes, statistical mechanics and thermodynamics), mathematics (dynamical systems, ergodic and probability theory), information and computer science (coding, information theory and algorithmic complexity), electrical engineering and theoretical biology. (shrink)

The functional complexity, or the number of functions, of organisms hasfigured prominently in certain theoretical and empirical work inevolutionary biology. Large-scale trends in functional complexity andcorrelations between functional complexity and other variables, such assize, have been proposed. However, the notion of number of functions hasalso been operationally intractable, in that no method has been developedfor counting functions in an organism in a systematic and reliable way.Thus, studies have had to rely on the largely unsupported assumption thatnumber of functions can be (...) measured indirectly, by using number ofmorphological, physiological, and behavioral parts as a proxy. Here, amodel is developed that supports this assumption. Specifically, the modelpredicts that few parts will have many functions overlapping in them, andtherefore the variance in number of functions per part will be low. If so,then number of parts is expected to be well correlated with number offunctions, and we can use part counts as proxies for function counts incomparative studies of organisms, even when part counts are low. Alsodiscussed briefly is a strategy for identifying certain kinds of parts inorganisms in a systematic way. (shrink)

Scientific knowledge grows at a phenomenal pace--but few books have had as lasting an impact or played as important a role in our modern world as The Mathematical Theory of Communication, published originally as a paper on communication theory more than fifty years ago. Republished in book form shortly thereafter, it has since gone through four hardcover and sixteen paperback printings. It is a revolutionary work, astounding in its foresight and contemporaneity. The University of Illinois Press is pleased and honored (...) to issue this commemorative reprinting of a classic. (shrink)