An important suggestion of objective Bayesians is that the maximum entropy principle can replace a principle which is known to get into paradoxical difficulties: the principle of indifference. No one has previously determined whether the maximum entropy principle is better able to solve Bertrand’s chord paradox than the principle of indifference. In this paper I show that it is not. Additionally, the course of the analysis brings to light a new paradox, a revenge paradox of the chords, that is unique (...) to the maximum entropy principle. (shrink)

Despite of its formal precision and its great many applications, Shannon’s theory still offers an active terrain of debate when the interpretation of its main concepts is the task at issue. In this article we try to analyze certain points that still remain obscure or matter of discussion, and whose elucidation contribute to the assessment of the different interpretative proposals about the concept of information. In particular, we argue for a pluralist position, according to which the different views about information (...) are no longer rival, but different interpretations of a single formal concept. (shrink)

This book is conceived as an introductory text into the theory of syntactic and semantic information, and information flow.

Recognition that biological systems are stabilized far from equilibrium by self-organizing, informed, autocatalytic cycles and structures that dissipate unusable energy and matter has led to recent attempts to reformulate evolutionary theory. We hold that such insights are consistent with the broad development of the Darwinian Tradition and with the concept of natural selection. Biological systems are selected that re not only more efficient than competitors but also enhance the integrity of the web of energetic relations in which they are embedded. (...) But the expansion of the informational phase space, upon which selection acts, is also guaranteed by the properties of open informational-energetic systems. This provides a directionality and irreversibility to evolutionary processes that are not reflected in current theory.For this thermodynamically-based program to progress, we believe that biological information should not be treated in isolation from energy flows, and that the ecological perspective must be given descriptive and explanatory primacy. Levels of the ecological hierarchy are relational parts of ecological systems in which there are stable, informed patterns of energy flow and entropic dissipation. Isomorphies between developmental patterns and ecological succession are revealing because they suggest that much of the encoded metabolic information in biological systems is internalized ecological information. The geneological hierarchy, to the extent that its information content reflects internalized ecological information, can therefore be redescribed as an ecological hierarchy. (shrink)

We argue against some of Reichenbach's claims about causal forks are incorrect. We do not see why the Second Law of Thermodynamics rules out the existence of conjunctive forks open to the past. In addition, we argue that a common effect rarely forms a conjunctive fork with its joint causes, but it sometimes does. Nevertheless, we think there is something to be said for Reichenbach's idea that forks of various kinds are relevant to explaining why we know more about the (...) past than about the future. And entropy turns out to play a role in the explanation, though not the determining role that Reichenbach envisions. (shrink)

The central paradigm of Artificial Intelligence is rapidly shifting toward biological models for both robotic devices and systems performing such critical tasks as network management and process control. Here we apply recent mathematical analysis of the necessary conditions for consciousness in humans in an attempt to gain some understanding of the likely canonical failure modes inherent to a broad class of global workspace/blackboard machines designed to emulate biological functions. Similar problems are likely to confront other possible architectures, although their mathematical (...) description may be far less straightforward. (shrink)

The main aim of this work is to contribute tothe elucidation of the concept of informationby comparing three different views about thismatter: the view of Fred Dretske's semantictheory of information, the perspective adoptedby Peter Kosso in his interaction-informationaccount of scientific observation, and thesyntactic approach of Thomas Cover and JoyThomas. We will see that these views involvevery different concepts of information, eachone useful in its own field of application. This comparison will allow us to argue in favorof a terminological `cleansing': it (...) is necessaryto make a terminological distinction among thedifferent concepts of information, in order toavoid conceptual confusions when the word`information' is used to elucidate relatedconcepts as knowledge, observation orentropy. (shrink)

Focusing on Shannon information, this article shows that, even on the basis of the same formalism, there may be different interpretations of the concept of information, and that disagreements may be deep enough to lead to very different conclusions about the informational characterization of certain physical situations. On this basis, a pluralist view is argued for, according to which the concept of information is primarily a formal concept that can adopt different interpretations that are not mutually exclusive, but each useful (...) in a different specific context. (shrink)

Christopher Timpson proposes a deflationary view about information, according to which the term ‘information’ is an abstract noun and, as a consequence, information is not part of the material contents of the world. The main purpose of the present article consists in supplying a critical analysis of this proposal, which will lead us to conclude that information is an item even more abstract than what Timpson claims. From this view, we embrace a pluralist stance that recognizes the legitimacy of different (...) interpretations of the concept of information. (shrink)

Constantin Caratheodory offered the first systematic and contradiction free formulation of thermodynamics on the basis of his mathematical work on Pfaff forms. Moreover, his work on measure theory provided the basis for later improved formulations of thermodynamics and physics of continua where extensive variables are measures and intensive variables are densities. Caratheodory was the first to see that measure theory and not topology is the natural tool to understand the difficulties (ergodicity, approach to equilibrium, irreversibility) in the Foundations of Statistical (...) Physics. He gave a measure-theoretic proof of Poincaré's recurrence theorem in 1919. This work paved the way for Birkhoff to identify later ergodicity as metric transitivity and for Koopman and von Neumann to introduce spectral analysis of dynamical systems in Hilbert spaces. Mixing provided an explanation of the approach to equilibrium but not of irreversibility. The recent extension of spectral theory of dynamical systems to locally convex spaces, achieved by the Brussels–Austin groups, gives new nontrivial time asymmetric spectral decompositions for unstable and/or non-integrable systems. In this way irreversibility is resolved in a natural way. (shrink)

We extend the comparatively simple processes of group symmetry-breaking in physical systems to groupoid/equivalence class phase transitions characterizing adiabatically, piecewise stationary, information transmission in prebiotic, biological, and social phenomena: High vs. Low probability paths $$\rightarrow$$ Interior and Exterior Interact $$\rightarrow$$ Multiple Interacting Tunable Workspaces Application to nonstationary processes seems possible via generalizations of the symmetry algebra, for example, to semigroupoids. The dynamic probability models explored here can be transformed into statistical tools for the analysis of real-time and other data across (...) a spectrum of important disciplines confronted by biological and other forms of cognition and their dysfunctions. (shrink)

Mitochondrial dysfunction underlies a vast array of chronic disorders across the life span. The asymptotic limit theorems of information and control theories, supplemented by symmetry-breaking phase transition arguments adapted from physical theory, give deep insight into canonical mechanisms of cognition and regulation associated with such dysfunction. The probability models studied here can provide a foundation for the development of statistical tools useful in clinical and public health address of those disorders.

Cognition in living entities—and their social groupings or institutional artifacts—is necessarily as complicated as their embedding environments, which, for humans, includes a particularly rich cultural milieu. The asymptotic limit theorems of information and control theories permit construction of a new class of empirical ‘regression-like’ statistical models for cognitive developmental processes, their dynamics, and modes of dysfunction. Such models may, as have their simpler analogs, prove useful in the study and re-mediation of cognitive failure at and across the scales and levels (...) of organization that constitute and drive the phenomena of life. These new models particularly focus on the roles of sociocultural environment and stress, in a large sense, as both trigger for the failure of the regulation of bio-cognition and as ‘riverbanks’ determining the channels of pathology, with implications across life-course developmental trajectories. We examine the effects of an embedding cultural milieu and its socioeconomic implementations using the ‘lenses’ of metabolic optimization, control system theory, and an extension of symmetry-breaking appropriate to information systems. A central implication is that most, if not all, human developmental disorders are fundamentally culture-bound syndromes. This has deep implications for both individual treatment and public health policy. (shrink)

We extend recent information-theoretic phase transition approaches to evolutionary and cognitive process via the Rate Distortion and Joint Asymptotic Equipartition Theorems, in the circumstance of interaction with a highly structured environment. This suggests that learning plateaus in cognitive systems and punctuated equilibria in evolutionary process are formally analogous, even though evolution is not cognitive. Extending arguments by Adami et al. (2000), we argue that 'adaptation' is the process by which a distorted genetic image of a coherently structured environment is imposed (...) upon a species. (shrink)

Although the concept of uncertainty is as old as Epicurus’s writings, and an excellent quantitative theory, with entropy as the measure of uncertainty having been developed in recent times, there has been little exploration of the qualitative theory. The purpose of the present paper is to give a qualitative axiomatization of uncertainty, in the spirit of the many studies of qualitative comparative probability. The qualitative axioms are fundamentally about the uncertainty of a partition of the probability space of events. Of (...) course, it is common to speak of the uncertainty, or randomness, of a random variable, but only the partition defined by the values of the random variable enter into the definition of uncertainty, not the actual values. It is straightforward to add axioms for decision making following the general line of Savage from the 1950s. Indeed, in the spirit of Epicurus, it is really our intuitive feeling about the uncertainty of the future that motivates much of our thinking about decisions. Here, the distinction between the concepts of probability and uncertainty can be made by citing many familiar examples. Without spelling out the technical details, the axiomatization of qualitative probability with uncertainty as the most important primitive concept, it is possible to raise a different kind of question about bounded rationality. This new question is whether or not one should bound the uncertainty in thinking and investigating any detailed framework of decision making. Discussion of this point is certainly different from the question of bounding rationality by not maximizing expected utility. In practice, we naturally bound uncertainty in our analysis of decision-making problems. As in the case of formulating an alternative for maximizing expected utility, so is the case of rational alternatives to maximizing uncertainty. There are several issues to consider. In the spirit of my other work in qualitative probability, I explore alternatives rather than attempt to give a definitive argument for one single solution. (shrink)

The asymptotic limit theorems of information theory permit a concise formulation of Bernard Baars' global workspace/global broadcast picture of consciousness, focusing on how networks of unconscious cognitive modules are driven by the classic 'no free lunch' argument into shifting, tunable, alliances having variable thresholds for signal detection. The model directly accounts for the punctuated characteristics of many conscious phenomena, and derives the inherent necessity of inattentional blindness and related effects.

Despite growing interest in evolutionary economics since the 1980s, a unified theoretical approach has so far been lacking. Methodological and ontological discussions within evolutionary economics have attempted to understand and help rectify this failure, but have revealed in turn further differences of perspective. One aim of this article is to show how different approaches relate to different levels of abstraction. A second purpose is to show that generalized Darwinism is some way from the most abstract level, and illustrates how it (...) may be used to move towards more specific theoretical applications. Nevertheless, there is a long way to go before these become more evident. (shrink)

A conjectural inference is proposed, aimed at producing conjectural theorems from formal conjectures assumed as axioms, as well as admitting contradictory statements as conjectural theorems. To this end, we employ Paraconsistent Informational Logic, which provides a formal setting where the notion of conjecture formulated by an epistemic agent can be defined. The paraconsistent systems on which conjectural deduction is based are sequent formulations of the C-systems presented in Carnielli-Marcos [CAR 02b]. Thus, conjectural deduction may also be considered to be a (...) tool for investigating the properties of paraconsistency in general. (shrink)

– The paper explores first the postulational basis and significance of‘measures of information’in current information theory and their possible relations to physical entropy and Brillouin's‘negentropy’regarded as the negative of entropy. For some purposes, the same pattern or formal structure may be abstracted from both‘entropy’and‘information’. The paper analyzes, in the second place, the mathematical analogies which have been traced between information theory and quantum mechanics and argues that the analogies have but a limited value when we come to grips with the (...) deeper, and yet unsolved, problems of quantum theory. Lastly it is urged that the indiscriminate extensions of statistical and information‐theoretic methods, and of quantum‐mechanical analogies, e.g.‘linguistic duality’, to psycholinguistics, literary and aesthetic Gestalten, can result only in crude exaggerations. Dialectical methodology requires the continual reformulation of all scientific descriptions which have to reckon perpetually with the richness of human materials. (shrink)

There are two basic approaches to the problem of induction:the empirical one, which deems that the possibility of induction depends on how theworld was made (and how it works) and the logical one, which considers the formation(and function) of language. The first is closer to being useful for induction, whilethe second is more rigorous and clearer. The purpose of this paper is to create an empiricalapproach to induction that contains the same formal exactitude as the logical approach.This requires: (a) that (...) the empirical conditions for the induction are enunciatedand (b) that the most important results already obtained from inductive logic are againdemonstrated to be valid. Here we will be dealing only with induction by elimination,namely the analysis of the experimental confutation of a theory. The result will bea rule of refutation that takes into consideration all of the empirical aspect of theexperiment and has each of the asymptotic properties which inductive logic has shown tobe characteristic of induction. (shrink)