I propose that, in addition to the commonly recognized increase of entropy, two more time arrows influence living beings. The increase of damage reactions, which produce aging and genetic variation, and the decrease of the rate of entropy production involved in natural selection are neglected arrows of time. Although based on the statistical theory of the arrow of time, they are distinguishable from the general arrow of the increase of entropy. Physiology under healthy conditions only obeys the increase of entropy (...) arrow. But aging, death, and evolution are determined by the other time arrows as well. Paradoxes emerge from conflicts among the specific determinisms associated with each arrow. These conflicts, along with uncertainties intrinsic to the low-number statistics of the arrows of damage reactions and decrease of the rate of production of entropy, highlight the limits of determinism at different levels of biology and its dependence on time span and number of organisms. The recognition of the three time arrows opens new perspectives for the problem of compatibility of the flow of time in physics and psychology. (shrink)

In its predominant form, the understanding of the neurosciences, which stand in high public esteem, is a naturalistic one. The critique of this naturalism concerns the technical modelling of brain functions as a syntactic or control loop machine. Adequate solutions to the mind-body problem are not found in this way.

The term information has become a universal and omnipresent keyword in almost all areas of our modern world—be it in science or society in general. This is not only obvious from the naming of whole scientific branches like Information Theory, Information Science or Informatics but even more from common speaking—characterising our present time and society as information age viz. information society. However, what information might mean, is by no means clear and there is a wide range of interpretations covering, among (...) others, its technical, communicational, educational, mental, and scientific aspects. But is the use of the same term justified when adopted in Biology, Physics, Archaeology, Law, Communication Technology, and Informatics (to list just a few of the involved scientific branches) or do its different uses at least have some common characteristics—some sort of common denominator? Is information natural, e.g. manifesting itself as a material phenomenon residing in organisms, stars, atoms, or genes, or is it just a cultural product of human communication, thinking, and interpretation? In this article, we try to clarify some of the most important interpretations, discuss and contrast them with the Informatics point of view. Interpretations range from taking information as material, transferable signals (following Shannon’s Information Theory or the genetic approaches), treating it as a sign (following a semiotic approach), as a commercial product (now common in Web-based Information Business) to considering it a pure mental phenomenon bound to humans or human-like individuals or even to groups and societies. Based on these interpretations, we shall throw a critical glance on current trends in human science and society—focusing on the now popular concept of information society —and then derive some theses and guidelines for further research escorting the growth and dispersal of information technology. As it will turn out, an information society which defines itself through the number of computers, internet connections and network links is based on a very narrow, techno-centric concept of information. However, a reflection on the educational and cultural aspects of information might lead to a better-qualified society consisting of responsible and critical citizens. (shrink)

Debates concerning the types of representations that aid reading acquisition have often been influenced by the relationship between measures of early phonological awareness (the ability to process speech sounds) and later reading ability. Here, a complementary approach is explored, analyzing how the functional utility of different representational units, such as whole words, bodies (letters representing the vowel and final consonants of a syllable), and graphemes (letters representing a phoneme) may change as the number of words that can be read gradually (...) increases. Utility is measured by applying a Simplicity Principle to the problem of mapping from print to sound; that is, assuming that the “best” representational units for reading are those which allow the mapping from print to sounds to be encoded as efficiently as possible. Results indicate that when only a small number of words are read whole-word representations are most useful, whereas when many words can be read graphemic representations have the highest utility. (shrink)

One of the major impediments to understanding the concept of information is that the term is used to describe a number of disparate things, including a property of organized matter and messages sent from a sender to a receiver. Information is essentially an attribute of the form that matter and energy take, not of matter and energy themselves. Intrinsic information is a theoretical measure of the degree to which an entity is organized, the opposite of entropy. Meaningful information, however, involves (...) the detection of a pattern of organized matter or energy by an animate or a man-made receptor, which triggers a change in the behavior, function, or organizational structure of the receiving entity. The ability to detect and respond to meaningful information is one of the defining characteristics of living entities; the process that enables cells and organisms to receive their genetic heritage, regulate their internal milieu, and respond to changes in their environment. Although energy and information are the two fundamental causal agents in the natural world, they bring about change through completely different mechanisms. The energy involved in physical interactions is supplied by the originating entity, while the energy involved in informational interactions is provided by the recipient. There is no predictable relationship between the nature of the informational stimulus and the response it engenders, for this is primarily determined by the pattern of connections between the involved receptors and effectors that evolution and learning have fashioned. As a result, a living entity’s response to information cannot be predicted on a purely mechanical basis. The laws that describe the physical interaction of organized matter apply to the transfer of energy, not to the transfer of information. This is why biology cannot be reduced to physics. (shrink)

The general concept of information does not belong in the category of universal and inexorable physical laws but in the category of initial conditions and boundary conditions. Boundary conditions formed by local structures are often called constraints. Informational structures such as symbol vehicles are a special type of constraint. It should be clear that the concepts of initial conditions and constraints in physics make no sense outside the context of the law-based physical dynamics to which they apply. This is also (...) the case for the concept of information. -/- . (shrink)

A brief personal history is given about how information theory can be applied to binding sites of genetic control molecules on nucleic acids. The primary example used is ribosome binding sites in Escherichia coli. Once the sites are aligned, the information needed to describe the sites can be computed using Claude Shannon’s method. This is displayed by a computer graphic called a sequence logo. The logo represents an average binding site, and the mathematics easily allows one to determine the components (...) of this average. That is, given a set of binding sites, the information for individual binding sites can also be computed. One can go further and predict the information of sites that are not in the original data set. Information theory also allows one to model the flexibility of ribosome binding sites, and this led us to a simple model for ribosome translational initiation in which the molecular components fit together only when the ribosome is at a good ribosome binding site. Since information theory is general, the same mathematics applies to human splice junctions, where we can predict the effect of sequence changes that cause human genetic diseases and cancer. The second example given is the Pribnow “box,” which, when viewed by the information theory method, reveals a mechanism for initiation of both transcription and DNA replication. Replication, transcription, splicing, and translation into protein represent the central dogma, so these examples show how molecular information theory is contributing to our knowledge of basic biology. (shrink)

The philosophy of information (PI) is a new area of research with its own field of investigation and methodology. This article, based on the Herbert A. Simon Lecture of Computing and Philosophy I gave at Carnegie Mellon University in 2001, analyses the eighteen principal open problems in PI. Section 1 introduces the analysis by outlining Herbert Simon's approach to PI. Section 2 discusses some methodological considerations about what counts as a good philosophical problem. The discussion centers on Hilbert's famous analysis (...) of the central problems in mathematics. The rest of the article is devoted to the eighteen problems. These are organized into five sections: problems in the analysis of the concept of information, in semantics, in the study of intelligence, in the relation between information and nature, and in the investigation of values. (shrink)

People are remarkably smart: They use language, possess complex motor skills, make nontrivial inferences, develop and use scientific theories, make laws, and adapt to complex dynamic environments. Much of this knowledge requires concepts and this study focuses on how people acquire concepts. It is argued that conceptual development progresses from simple perceptual grouping to highly abstract scientific concepts. This proposal of conceptual development has four parts. First, it is argued that categories in the world have different structure. Second, there might (...) be different learning systems that evolved to learn categories of differing structures. Third, these systems exhibit differential maturational course, which affects how categories of different structures are learned in the course of development. And finally, an interaction of these components may result in the developmental transition from perceptual groupings to more abstract concepts. This study reviews a large body of empirical evidence supporting this proposal. (shrink)

The dissertation criticizes two analogical applications of Darwinism to the spheres of mind and culture: the Darwinian approach to creativity and memetics. These theories rely on three basic analogies: the ontological analogy states that the basic ontological units of culture are so-called memes, which are replicators like genes; the origination analogy states that novelty in human creativity emerges in a "blind" Darwinian manner; and the explanatory units of selection analogy states that memes are "egoistic" and that they can spread independently (...) of our mind. The detailed philosophical analysis offered in the dissertation shows that these three analogies rely on either wrong or trivial statements: they provide either wrong or no new descriptions or explanations of the phenomena at hand. In Chapter One, I introduce the diverse ways, in which contemporary Darwinism is used today outside of evolutionary biology. Chapter Two explains what it means to claim that something evolves in a Darwinian manner. Chapter Three to Five address each of the three analogies separately. Darwinism applied to culture and mind, at least in the way discussed in this study, is not a dangerous idea. It leads either to wrong claims or to a re-telling in Darwinian terms of what we have already known. (shrink)

Symbols enable people to organize and communicate about the world. However, the ways in which symbolic knowledge is learned and then represented in the mind are poorly understood. We present a formal analysis of symbolic learning—in particular, word learning—in terms of prediction and cue competition, and we consider two possible ways in which symbols might be learned: by learning to predict a label from the features of objects and events in the world, and by learning to predict features from a (...) label. This analysis predicts significant differences in symbolic learning depending on the sequencing of objects and labels. We report a computational simulation and two human experiments that confirm these differences, revealing the existence of Feature-Label-Ordering effects in learning. Discrimination learning is facilitated when objects predict labels, but not when labels predict objects. Our results and analysis suggest that the semantic categories people use to understand and communicate about the world can only be learned if labels are predicted from objects. We discuss the implications of this for our understanding of the nature of language and symbolic thought, and in particular, for theories of reference. (shrink)

Entropy is ubiquitous in physics, and it plays important roles in numerous other disciplines ranging from logic and statistics to biology and economics. However, a closer look reveals a complicated picture: entropy is defined differently in different contexts, and even within the same domain different notions of entropy are at work. Some of these are defined in terms of probabilities, others are not. The aim of this chapter is to arrive at an understanding of some of the most important notions (...) of entropy and to clarify the relations between them, After setting the stage by introducing the thermodynamic entropy, we discuss notions of entropy in information theory, statistical mechanics, dynamical systems theory and fractal geometry. (shrink)

Abstract: According to the Veridicality Thesis, information requires truth. On this view, smoke carries information about there being a fire only if there is a fire, the proposition that the earth has two moons carries information about the earth having two moons only if the earth has two moons, and so on. We reject this Veridicality Thesis. We argue that the main notions of information used in cognitive science and computer science allow A to have information about the obtaining of (...) p even when p is false. (shrink)

We show how an epistemology informed by cognitive science promises to shed light on an ancient problem in the philosophy of mathematics: the problem of exactness. The problem of exactness arises because geometrical knowledge is thought to concern perfect geometrical forms, whereas the embodiment of such forms in the natural world may be imperfect. There thus arises an apparent mismatch between mathematical concepts and physical reality. We propose that the problem can be solved by emphasizing the ways in which the (...) brain can transform and organize its perceptual intake. It is not necessary for a geometrical form to be perfectly instantiated in order for perception of such a form to be the basis of a geometrical concept. (shrink)

Philosophers of science have often favoured reductive approaches to how-possibly explanation. This article identifies three alternative conceptions making how-possibly explanation an interesting phenomenon in its own right. The first variety approaches “how possibly X?” by showing that X is not epistemically impossible. This can sometimes be achieved by removing misunderstandings concerning the implications of one’s current belief system but involves characteristically a modification of this belief system so that acceptance of X does not result in contradiction. The second variety offers (...) a potential how-explanation of X. It is usually followed by a range of further potential how-explanations of the same phenomenon. In recent literature the factual claims implied by the second variety have been downplayed whereas the heuristic role of mapping the space of conceptual possibilities has been emphasized. I will focus especially on this truth-bracketing sense of potentiality when looking closer at the second variety in the paper. The third variety has attracted less interest. It presents a partial how-explanation of X. Typically it aims to establish the existence of a mechanism by which X could be and was generated. The third conception stands out as the natural alternative for the advocate of ontic how-possibly explanations. This article transfers Salmon’s view that explanation-concepts can be broadly divided into epistemic, modal, and ontic to the context of how-possibly explanations. Moreover, it is argued that each of the three above-mentioned varieties of how-possibly explanation occurs in science. To recognize this may be especially relevant for philosophers. We are often misled by the promises of various why-explanation accounts, and seem to have forgotten nearly everything about the diversity of how-possibly explanations. (shrink)

Terrence Deacon has described three orders of emergence; Arthur Peacocke and others have suggested four levels of human systems and sciences; and Philip Clayton has postulated an additional, transcendent, level. Orders and levels describe distinct aspects of emergence, with orders characterizing topological complexity and levels characterizing theoretical knowledge and causal power. By using Deacon's orders to analyze and relate each of the four "lower" levels one can project that analysis on the transcendent level to gain insight into the teleodynamic emergence (...) of transcendent-level systems. I argue that cross-cultural interactions among human cultural-level systems results in the emergence of the "universal" transcendental norms historically characterized as the Greek Good, Beauty, and Truth. These norms require a dynamic existence that I characterize as the emergence of Spirit, using Josiah Royce's community of interpretation, and that I suggest provides a pragmatic clarification of Clayton's transcendent level. An understanding of those emergent norms clarifies ethical systems, highlights the importance of aesthetics in understanding scientific systems, and suggests the necessity of community in fruitful science-and-religion dialogue on human systems. (shrink)

I propose a new approach to the constitutive problem of psychology ‘what is mind?’ The first section introduces modifications of the received scope, methodology, and evaluation criteria of unified theories of cognition in accordance with the requirements of evolutionary compatibility and of a mature science. The second section outlines the proposed theory. Its first part provides empirically verifiable conditions delineating the class of meaningful neural formations and modifies accordingly the traditional conceptions of meaning, concept and thinking. This analysis is part (...) of a theory of communication in terms of inter-level systems of primitives that proposes the communication-understanding principle as a psychological invariance. It unifies a substantial amount of research by systematizing the notions of meaning, thinking, concept, belief, communication, and understanding and leads to a minimum vocabulary for this core system of mental phenomena. Its second part argues that written human language is the key characteristic of the artificially natural human mind. Overall, the theory both supports Darwin’s continuity hypothesis and proposes that the mental gap is within our own species. (shrink)

A typescript by Claude Shannon, ‘Theorems on statistical sequences’, is examined to shed light on the development of information theory. In particular, it appears that Shannon was still working out the mathematical details of his theory in the spring of 1948, just before he published ‘A mathematical theory of communication’. This is contrasted with evidence from a declassified cryptography report that Shannon’s theory was intuitively worked out in its essentials by the time he filed the report in 1945. Previous interviews (...) with Shannon, and a recent interview with a colleague of his, Brockway McMillan, confirm this picture.Keywords: History of science; History of technology; Claude Shannon; Information theory; Ergodic theory; Electrical engineering. (shrink)

The Model of Hierarchical Complexity is introduced in terms of its main concepts, background, and applications. As a general, quantitative behavioral developmental theory, the Model enables examination of universal patterns of evolution and development. Behavioral tasks are definable and their organization of information in increasingly greater hierarchical, or vertical, complexity is measurable. Fifteen orders of hierarchical complexity account for task performances across domains, ranging from those of machines to creative geniuses. The four most complex orders are demonstrated by postformal stages (...) of thought, which measure beyond formal operations, the highest stage found by Piaget for adults. (shrink)

Over the last quarter century, the dominant tendency in comparative cognitive psychology has been to emphasize the similarities between human and nonhuman minds and to downplay the differences as (Darwin 1871). In the present target article, we argue that Darwin was mistaken: the profound biological continuity between human and nonhuman animals masks an equally profound discontinuity between human and nonhuman minds. To wit, there is a significant discontinuity in the degree to which human and nonhuman animals are able to approximate (...) the higher-order, systematic, relational capabilities of a physical symbol system (PSS) (Newell 1980). We show that this symbolic-relational discontinuity pervades nearly every domain of cognition and runs much deeper than even the spectacular scaffolding provided by language or culture alone can explain. We propose a representational-level specification as to where human and nonhuman animals' abilities to approximate a PSS are similar and where they differ. We conclude by suggesting that recent symbolic-connectionist models of cognition shed new light on the mechanisms that underlie the gap between human and nonhuman minds. (shrink)

The Gestalt principle of isomorphism reveals the primacy of subjective experience as a valid source of evidence for the information encoded neurophysiologically. This theory invalidates the abstractionist view that the neurophysiological representation can be of lower dimensionality than the percept to which it gives rise.

This article focuses on the relevance of computational complexity for cognition. The syntactic items may be expressions that are surface strings. But in general, strings are syntactically ambiguous in that they can be generated in more than one way from atomic expressions and operations. The semantic function must take disambiguated items as arguments. When expressions are ambiguous, expressions cannot be the arguments. Instead, it is common to take the arguments to be terms, whose surface syntax reflects the derivation of the (...) string. The semantic function differs in one other important respect from an arithmetic function, since it maps entities between domains, from a syntactic to an ontic or conceptual domain of meanings. Compositionality helps to explain the rate of success in linguistic communication when the sentence used or the content communicated is new. (shrink)

Terms loaded with informational connotations are often employed to refer to genes and their dynamics. Indeed, genes are usually perceived by biologists as basically ‘the carriers of hereditary information.’ Nevertheless, a number of researchers consider such talk as inadequate and ‘just metaphorical,’ thus expressing a skepticism about the use of the term ‘information’ and its derivatives in biology as a natural science. First, because the meaning of that term in biology is not as precise as it is, for instance, in (...) the mathematical theory of communication. Second, because it seems to refer to a purported semantic property of genes without theoretically clarifying if any genuinely intrinsic semantics is involved. Biosemiotics, a field that attempts to analyze biological systems as semiotic systems, makes it possible to advance in the understanding of the concept of information in biology. From the perspective of Peircean biosemiotics, we develop here an account of genes as signs, including a detailed analysis of two fundamental processes in the genetic information system (transcription and protein synthesis) that have not been made so far in this field of research. Furthermore, we propose here an account of information based on Peircean semiotics and apply it to our analysis of transcription and protein synthesis. (shrink)

Some physicists seem to believe that quantum information theory requires a new concept of information , Introduction to Quantum Computation and Information, World Scientific, Singapore, ; Deutsch & Hayden, 1999, Information flow in entangled quantum subsystems, preprint quant-ph/9906007). I will argue that no new concept is necessary. Shannon's concept of information is sufficient for quantum information theory. Properties that are cited to contrast quantum information and classical information actually point to differences in our ability to manipulate, access, and transfer information (...) depending on whether quantum systems, opposed to classical systems, are used in a communication system. I also demonstrate that conceptually puzzling phenomena in quantum information theory, such as dense coding, teleportation, and Schumacher coding, all of which are cited as evidence that a new concept of information is required, do not have to be regarded as such. (shrink)

Formal learning theory is the mathematical embodiment of a normative epistemology. It deals with the question of how an agent should use observations about her environment to arrive at correct and informative conclusions. Philosophers such as Putnam, Glymour and Kelly have developed learning theory as a normative framework for scientific reasoning and inductive inference.

This is an extensive review of recent work on the foundations of statistical mechanics.

The first use of the term "information" to describe the content of nervous impulse occurs 20 years prior to Shannon`s (1948) work, in Edgar Adrian`s The Basis of Sensation (1928). Although, at least throughout the 1920s and early 30s, the term "information" does not appear in Adrian`s scientific writings to describe the content of nervous impulse, the notion that the structure of nervous impulse constitutes a type of message subject to certain constraints plays an important role in all of his (...) writings throughout the period. The appearance of the concept of information in Adrian`s work raises at least two important questions: (i) what were the relevant factors that motivated Adrian`s use of the concept of information? (ii) What concept of information does Adrian appeal to, and how can it be situated in relation to contemporary philosophical accounts of the notion of information in biology? The first question involves an account of the application of communications technology in neurobiology as well as the historical and scientific background of Adrian`s major scientific achievement, which was the recording of the action potential of a single sensory neuron. The response to the second question involves an explication of Adrian`s concept of information and an evaluation of how it may be situated in relation to more contemporary philosophical explications of a semantic concept of information. I suggest that Adrian`s concept of information places limitations on the sorts of systems that are referred to as information carriers by causal and functional accounts of information. (shrink)

Grice (1957) drew a distinction between natural(N) and non–natural(NN) meaning, and showed how the latter might be characterised in terms of intentions and the recognition of intentions. Focussing on the role of natural signs and natural behaviours in communication, this paper makes two main points. First, verbal communication often involves a mixture of natural and non–natural meaning and there is a continuum of cases between showing and meaningNN. This suggests that pragmatics is best seen as a theory of intentional verbal (...) communication rather than a theory of meaningNN. Second, some natural behaviours have a signalling function: they are, in effect, natural codes. Such behaviours do not fit easily into Grice's distinction between natural and non–natural meaning, which suggests it is not exhaustive. (shrink)

It is common in attempts to extend the theory of evolution to culture to generalize from the causal basis of biological evolution, so that evolutionary theory becomes the theory of copying processes. Generalizing from the formal dynamics of evolution allows greater leeway in what kinds of things cultural entities can be, if they are to evolve. By understanding the phenomenon of cultural transmission in terms of coordinated phenotypic variability, we can have a theory of cultural evolution which allows us to (...) avoid the various difficulties with the elaboration of informational entities such as the cultural replicator, or meme. Such an account is a boon to the project of evolutionary epistemology since it confirms the presumption in favor of the general adaptiveness of culture, illuminating rather than obscuring the inherent intimacy of our relationship to (e.g.) our ideas. (shrink)

The existence of objective knowledge and the possibility of communicating it by means of language have traditionally been taken for granted by educators. Recent developments in the philosophy of science and the historical study of scientific accomplishments have deprived these presuppositions of their former plausibility. Sooner or later, this must have an effect on the teaching of science. In this paper I am presenting a brief outline of an alternative theory of knowing that takes into account the thinking organism''s cognitive (...) isolation from reality. This orientation was proposed by Vico at the beginning of the 18th century, disregarded for two hundred years, and then propounded independently by Piaget as a developmentally grounded constructivist epistemology. The paper focuses specifically on the adaptive function of cognition, Piaget''s scheme theory, the process of communication, and the subjective perspective on social interaction. In the concluding section it then suggests some of the consequences the shift of epistemological presuppositions might have for the practice of teaching. (shrink)

This paper is an assessment of an attempt, by James Greeno, to measure the explanatory power of statistical theories by means of the notion of transmitted information (It). It is argued that It has certain features that are inappropriate in a measure of explanatory power. In particular, given a statistical theory T with explanans variables St and explanandum variables Mj, it is argued that no plausible measure of explanatory power should depend on the probability P(Si) of occurrence of initial conditions (...) in the systems to which T applies or the magnitudes of the conditional probabilities P(Mj/Si), in the manner in which Ir does. (shrink)

Entropy and information are both emerging as currencies of interdisciplinary dialogue, most recently in evolutionary theory. If this dialogue is to be fruitful, there must be general agreement about the meaning of these terms. That this is not presently the case owes principally to the supposition of many information theorists that information theory has succeeded in generalizing the entropy concept. The present paper will consider the merits of the generalization thesis, and make some suggestions for restricting both entropy and information (...) to specific arenas of discourse. (shrink)

This paper examines some common measures of complexity, structure, and information, with an eye toward understanding the extent to which complexity or information‐content may be regarded as objective properties of individual objects. A form of contextual objectivity is proposed which renders the measures objective, and which largely resolves the puzzle of Maxwell's Demon.

A new approach to information is proposed with the intention of providing a conceptual tool adapted to biology, including a semantic value.Information involves a material support as well as a significance, adapted to the cognitive domain of the receiver and/or the transmitter. A message does not carry any information, only data. The receiver makes an identification by a procedure of recognition of the forms, which activate previously learned significance. This treatment leads to a new significance (or new knowledge).

The use of informational terms is widespread in molecular and developmental biology. The usage dates back to Weismann. In both protein synthesis and in later development, genes are symbols, in that there is no necessary connection between their form (sequence) and their effects. The sequence of a gene has been determined, by past natural selection, because of the effects it produces. In biology, the use of informational terms implies intentionality, in that both the form of the signal, and the response (...) to it, have evolved by selection. Where an engineer sees design, a biologist sees natural selection. (shrink)

An explanation for the uncertain progress of formalist linguistics is sought in an examination of the concept of syntax. The idea of analyzing language formally was made possible by developments in 20th century logic. It has been pointed out by many that the analogy between natural language and a formal system may be imperfect, but the objection made here is that the very concept of syntax, when applied to any non-abstract system of communication, is flawed as it is commonly used. (...) Syntax is properly defined with respect to an individual transformation rule that might be applied to some message. Collections of syntax rules, however, are inevitably due to categories imposed by an observer, and do not correspond to functional features found in non-abstract systems. As such, these categories should not be relied upon as aids to understanding any natural system. (shrink)

Traditional diversity indices are computed from the abundances of species present and are insensitive to taxonomic differences between species. However, a community in which most species belong to the same genus is intuitively less diverse than another community with a similar number of species distributed more evenly between genera. In this paper, we propose an information-theoretical measure of taxonomic diversity that reflects both the abundances and taxonomic distinctness of the species. Unlike previous measures of taxonomic diversity, such as Rao's quadratic (...) entropy, in this new measure the analyzed taxonomic properties are associated with the single species instead of species pairs. (shrink)

A desirable property of a diversity index is strict concavity. This implies that the pooled diversity of a given community sample is greater than or equal to but not less than the weighted mean of the diversity values of the constituting plots. For a strict concave diversity index, such as species richness S, Shannon''s entropy H or Simpson''s index 1-D, the pooled diversity of a given community sample can be partitioned into two non-negative, additive components: average within-plot diversity and between-plot (...) diversity. As a result, species diversity can be summarized at various scales measuring all diversity components in the same units. Conversely, violation of strict concavity would imply the non-interpretable result of a negative diversity among community plots. In this paper, I apply this additive partition model generally adopted for traditional diversity measures to Aczél and Daróczy''s generalized entropy of type . In this way, a parametric measure of -diversity is derived as the ratio between the pooled sample diversity and the average within-plot diversity that represents the parametric analogue of Whittaker''s -diversity for data on species relative abundances. (shrink)

This paper argues that Information Theoretic Redundancy (ITR) is fundamentally a composite concept that has been continually misinterpreted since the very inception of Information Theory. We view ITR as compounded of true redundancy and partial redundancy. This demarcation of true redundancy illustrates a limiting case phenomenon: the underlying metric (number of alternatives) differs only by degree but the properties of this concept differ in kind from those of partial redundancy. Several other studies are instanced which also imply the composite nature (...) of ITR. We thus provide broadly based but particular support for earlier generalized suggestions that it is the underlying calculus of Information Theory rather than the ill-named concepts themselves that provides something of a unitary language for the description of phenomena. (shrink)

In a survey of information theory and some of its implications, Warren Weaver has proposed a distinction between engineering noise and semantic noise. Ordinary Spanish usage reflects this distinction quite neatly. If A speaks to B and B responds with no entiendo, it means ‘I have not heard your words, because of interfering sound or lack of attention; please transmit the same message again’; if he responds with no comprendo, it means ‘I heard you all right, but what I heard (...) doesn't make sense; please paraphrase or explain.’ Channel noise, thus, is the responsible factor when that which leaves a transmitter is not that which reaches the receiver; semantic noise is a discrepancy between the codes used by transmitter and receiver. (shrink)

The living forms represented in this paper are sets of parts that spontaneously increase in organization. Their organizations are measured by an information-theoretic function derived from the work of Boltzmann and Shannon. We briefly review its derivation in the context of the troubled role of mathematics in biology, and then define the function. We illustrate its nature by measuring the 22 different organizations of a set of eight things; and we facilitate its use by defining the parameters that determine an (...) amount of organization. The measure is then applied to show that the organization of limb pairs on free-living arthropods, based on data given by Cisne, confirms a pattern of increasing organization in their evolution from the Cambrian era to the present. Further applications measure the changes in organizations of ideal (theoretical) life forms, and contrasting changes in inanimate systems. Our main results represent the reproduction of unicellular organisms, and the formation of hierarchies, as processes of increasing organization. (shrink)

The concept of randomness has been unjustly neglected in recent philosophical literature, and when philosophers have thought about it, they have usually acquiesced in views about the concept that are fundamentally flawed. After indicating the ways in which these accounts are flawed, I propose that randomness is to be understood as a special case of the epistemic concept of the unpredictability of a process. This proposal arguably captures the intuitive desiderata for the concept of randomness; at least it should suggest (...) that the commonly accepted accounts cannot be the whole story and more philosophical attention needs to be paid. 1. Randomness in science1.1Random systems1.2Random behaviour1.3Random sampling1.4Caprice, arbitrariness and noise2. Concepts of randomness2.1Von Mises/church/martin-löf randomness2.2KCS-randomness3. Randomness is unpredictability: preliminaries3.1Process and product randomness3.2Randomness is indeterminism?4. Predictability4.1Epistemic constraints on prediction4.2Computational constraints on prediction4.3Pragmatic constraints on prediction4.4Prediction defined5. Unpredictability6. Randomness is unpredictability6.1Clarification of the definition of randomness6.2Randomness and probability6.3Subjectivity and context sensitivity of randomness7. Evaluating the analysis[R]andomness … is going to be a concept which is relative to our body of knowledge, which will somehow reflect what we know and what we don't know. Henry E. Kyburg, Jr ([1974], p. 217)Phenomena that we cannot predict must be judged random. Patrick Suppes ([1984], p. 32). (shrink)

We compare the elementary theories of Shannon information and Kolmogorov complexity, the extent to which they have a common purpose, and wherethey are fundamentally different. We discuss and relate the basicnotions of both theories: Shannon entropy, Kolmogorov complexity, Shannon mutual informationand Kolmogorov (``algorithmic'') mutual information. We explainhow universal coding may be viewed as a middle ground betweenthe two theories. We consider Shannon's rate distortion theory, whichquantifies useful (in a certain sense) information.We use the communication of information as our guiding motif, (...) and we explain howit relates to sequential question-answer sessions. (shrink)

John Maynard Smith has defended against philosophical criticism the view that developmental biology is the study of the expression of information encoded in the genes by natural selection. However, like other naturalistic concepts of information, this ‘teleosemantic’ information applies to many non-genetic factors in development. Maynard Smith also fails to show that developmental biology is concerned with teleosemantic information. Some other ways to support Maynard Smith’s conclusion are considered. It is argued that on any definition of information the view that (...) development is the expression of genetic information is misleading. Some reasons for the popularity of that view are suggested. (shrink)