As adults age, their performance on many psychometric tests changes systematically, a finding that is widely taken to reveal that cognitive information-processing capacities decline across adulthood. Contrary to this, we suggest that older adults'; changing performance reflects memory search demands, which escalate as experience grows. A series of simulations show how the performance patterns observed across adulthood emerge naturally in learning models as they acquire knowledge. The simulations correctly identify greater variation in the cognitive performance of older adults, and successfully (...) predict that older adults will show greater sensitivity to fine-grained differences in the properties of test stimuli than younger adults. Our results indicate that older adults'; performance on cognitive tests reflects the predictable consequences of learning on information-processing, and not cognitive decline. We consider the implications of this for our scientific and cultural understanding of aging. (shrink)

I argue that a dual-aspect theory of consciousness, associated with a particular class of quantum states, can provide a consistent account of consciousness. I illustrate this with the use of coherent states as this class. The proposal meets Chalmers 'requirements of allowing a structural correspondence between consciousness and its physical correlate. It provides a means for consciousness to have an effect on the world in a way that supplements and completes conventional physics, rather than interfering with it. I draw on (...) the work of Hameroff and Penrose to explain the consistency of this proposal with decoherence, while adding details to this work. The proposal is open to extensive further research at both theoretical and experimental levels. (shrink)

World War II research into cryptography and computing produced methods, instruments and research communities that informed early research into artificial intelligence and semi-autonomous computing. Alan Turing and Claude Shannon in particular adapted this research into early theories and demonstrations of AI based on computers’ abilities to track, predict and compete with opponents. This formed a loosely bound collection of techniques, paradigms, and practices I call crypto-intelligence. Subsequent researchers such as Joseph Weizenbaum adapted crypto-intelligence but also reproduced aspects of its antagonistic (...) precepts. This was particularly true in the design and testing of chat bots. Here the ability to trick, fool, and deceive human and machine opponents was a premium, and practices of agent abuse were admired and rewarded. Recognizing the historical genesis of this particular variety of abuse can help researchers develop less antagonistic methodologies. (shrink)

We apply molecular code theory to a rule-based model of the human inner kinetochore and study how complex formation in general can give rise to molecular codes. We analyze 105 reaction networks generated from the rule-based inner kinetochore model in two variants: with and without dissociation of complexes. Interestingly, we found codes only when some but not all complexes are allowed to dissociate. We show that this is due to the fact that in the kinetochore model proteins can only bind (...) at kinetochores by attaching to already attached proteins and cannot form complexes in free solution. Using a generalized linear mixed model we study which centromere protein can take which role in a molecular code . By this, associations between CENPs and code roles are found. We observed that CenpA is a major risk factor while CenpQ is a major protection factor . Finally we show, using an abstract model of copolymer formation, that molecular codes can also be realized solely by the formation of stable complexes, which do not dissociate. For example, with particular dimers as context a molecular code mapping from two different monomers to two particular trimers can be realized just by non-selective complex formation. We conclude that the formation of protein complexes can be utilized by the cell to implement molecular codes. Living cells thus facilitate a subsystem allowing for an enormous flexibility in the realization of mappings, which can be used for specific regulatory processes, e.g. via the context of a mapping. (shrink)

Expected utility maximization problem is one of the most useful tools in mathematical finance, decision analysis and economics. Motivated by statistical model selection, via the principle of expected utility maximization, Friedman and Sandow (J Mach Learn Res 4:257–291, 2003a) considered the model performance question from the point of view of an investor who evaluates models based on the performance of the optimal strategies that the models suggest. They interpreted their performance measures in information theoretic terms and provided new generalizations of (...) Shannon entropy and Kullback–Leibler relative entropy and called them U-entropy and U-relative entropy. In this article, a utility-based criterion for independence of two random variables is defined. Then, Markov’s inequality for probabilities is extended from the U-entropy viewpoint. Moreover, a lower bound for the U-relative entropy is obtained. Finally, a link between conditional U-entropy and conditional Renyi entropy is derived. (shrink)

Human communication is often thought about in terms of transmitted messages in a conventional code like a language. But communication requires a specialized interactive intelligence. Senders have to be able to perform recipient design, while receivers need to be able to do intention recognition, knowing that recipient design has taken place. To study this interactive intelligence in the lab, we developed a new task that taps directly into the underlying abilities to communicate in the absence of a conventional code. We (...) show that subjects are remarkably successful communicators under these conditions, especially when senders get feedback from receivers. Signaling is accomplished by the manner in which an instrumental action is performed, such that instrumentally dysfunctional components of an action are used to convey communicative intentions. The findings have important implications for the nature of the human communicative infrastructure, and the task opens up a line of experimentation on human communication. (shrink)

The finding of fractal scaling (FS) in behavioral sequences has raised a debate on whether FS is a pervasive property of the cognitive system or is the result of specific processes. Inferences about the origins of properties in time sequences are causal. That is, as opposed to correlational inferences reflecting instantaneous symmetrical relations, causal inferences concern asymmetric relations lagged in time. Here, I integrate Granger‐causality with inferences about FS. Four simulations illustrate that causal analyses can isolate distinct FS sources, whereas (...) correlational techniques cannot. I then analyze three simultaneous sequences of responses from a database of word‐naming trials. I find that two, or perhaps three, distinct sources account for the presence of FS in these sequences, but FS is not a general property of the system. This suggests that FS arises due to the properties of a limited number of identifiable psychological and/or neural processes. Finally, I reanalyze a previously published dataset of acoustic frequency spectra using the new tools. The causality/criticality combination introduced here offers a new important perspective in the study of cognition. (shrink)

In this paper, I present and defend an explication of content in terms of the mathematical notion of information. In its most general formulation, the theory says that two states have the same content just in case they carry the same information, relative to a communication network. My account reifies content (it is the discrete counterpart to continuous information) and supports the idea that agents have internal means of comparing the contents of two thoughts. Further, it makes sense to say (...) that agents have communicated successfully when they coordinate on content in this sense; they have transmitted information without loss. (shrink)

The article inquires into the uneasiness of sociological systems theory about culture. Culture alternatively is called the solution to the problem of double contingency (Parsons) and removed from this solution (Luhmann). It is shown that meaning is the more basic term whose description reveals a form rule of social systems which is only patterned, yet not understood by culture. Culture is a memory and control device of society. It may be conceived of as providing the distinction of correct versus incorrect (...) behaviour. But who decides on the correctness or incorrectness of this distinction? Sociological thinking takes off where the cultural and the social are distinguished. (shrink)

Expected utility maximization problem is one of the most useful tools in mathematical finance, decision analysis and economics. Motivated by statistical model selection, via the principle of expected utility maximization, Friedman and Sandow (J Mach Learn Res 4:257–291, 2003a) considered the model performance question from the point of view of an investor who evaluates models based on the performance of the optimal strategies that the models suggest. They interpreted their performance measures in information theoretic terms and provided new generalizations of (...) Shannon entropy and Kullback–Leibler relative entropy and called them U-entropy and U-relative entropy. In this article, a utility-based criterion for independence of two random variables is defined. Then, Markov’s inequality for probabilities is extended from the U-entropy viewpoint. Moreover, a lower bound for the U-relative entropy is obtained. Finally, a link between conditional U-entropy and conditional Renyi entropy is derived. (shrink)

We consider a confidence parametrization of binary information sources in terms of appropriate likelihood ratios. This parametrization is used for Bayesian belief updates and for the equivalent comparison of binary experiments. In contrast to the standard parametrization of a binary information source in terms of its specificity and its sensitivity, one of the two confidence parameters is sufficient for a Bayesian belief update conditional on a signal realization. We introduce a confidence-augmented receiver operating characteristic for comparisons of binary experiments for (...) a class of “balanced” decision problems, relative to which the confidence order offers a higher resolution than Blackwell’s informativeness order. Where observation is concerned, Chance favors only the prepared mind.—Louis Pasteur (1822–1895). (shrink)

The present theory leads to a set of subjective weights such that the utility of an uncertain alternative (gamble) is partitioned into three terms involving those weights—a conventional subjectively weighted utility function over pure consequences, a subjectively weighted value function over events, and a subjectively weighted function of the subjective weights. Under several assumptions, this becomes one of several standard utility representations, plus a weighted value function over events, plus an entropy term of the weights. In the finitely additive case, (...) the latter is the Shannon entropy; in all other cases it is entropy of degree not 1. The primary mathematical tool is the theory of inset entropy. (shrink)

The article reviews Christopher Hitchcock’s Contemporary Debates in Philosophy of Science, aims to present contemporary issues in philosophy of science through a series of eight debates between leading analytic philosophers in the given specialist field. Each contributor argues for or against a proposed motion of the debate, ranging from issues of metaphysics and epistemology of science to specific philosophical questions in physics, biology and psychology. In that they draw on a wealth of techniques from the practice of philosophy of science (...) from conceptual clarifications to invocation of examples from scientific practice. Nonethless, against the background of philosophical work associated with contemporary scientific practice the topics selected for this volume seem limited in both depth and scope. The volume’s great worth is in presenting ‘philosophy of science in action’ by exercising many tricks of the trade in several self-contained chapters. (shrink)

It has been suggested that iconic graphical signs evolve into symbolic graphical signs through repeated usage. This article reports a series of interactive graphical communication experiments using a ‘pictionary’ task to establish the conditions under which the evolution might occur. Experiment 1 rules out a simple repetition based account in favor of an account that requires feedback and interaction between communicators. Experiment 2 shows how the degree of interaction affects the evolution of signs according to a process of grounding. Experiment (...) 3 confirms the prediction that those not involved directly in the interaction have trouble interpreting the graphical signs produced in Experiment 1. On the basis of these results, this article argues that icons evolve into symbols as a consequence of the systematic shift in the locus of information from the sign to the users' memory of the sign's usage supported by an interactive grounding process. (shrink)

Since the beginning of the XX-th century, it became increasingly evident that information, besides matter and energy, is a major actor in the life processes. Moreover, communication of information has been recognized as differentiating living things from inanimate ones, hence as specific to the life processes. Therefore the sciences of matter and energy, chemistry and physics, do not suffice to deal with life processes. Biology should also rely on sciences of information. A majority of biologists, however, did not change their (...) mind and continued to describe life in terms of chemistry and physics. They merely borrowed some vocabulary from the information sciences. The first science of information available to biological applications, semiotics, appeared at the end of the XIX-th century. It is a qualitative and descriptive science which stemmed from efforts of linguists and philosophers to understand the human language and is thus mainly concerned with semantics. Applying semiotics to biology resulted in today’s Biosemiotics. Independently, an explosive expansion of communication engineering began in the second half of the XX-th century. Besides tremendous progresses in hardware technology, it was made possible by the onset of a science of literal communication: Information Theory (Shannon, Bell Syst Tech J 27:379–457, 623–656, 1948). Literal communication consists of faithfully transporting a message from a place to another, or from an instant to another. Because the meaning of a message does not matter for its transportation, information theory ignores semantics. This restriction enables defining information as a measurable quantity on which a mathematical theory of communication is founded. Although lacking implementation means at its beginning, information theory became later very successful for designing communication means. Modern ones, like mobile phones, can be thought of as experimentally proving the relevance and accuracy of information theory since their design and operation heavily rely on it. Information theory is plainly relevant to biological functions which involve literal communication, especially heredity. This paper is intended to compare the two approaches. It shows that, besides obvious differences, they have some points in common: for instance, the quantitative measurement of information obeys Peirce’s triadic paradigm. They also can mutually enlighten each other. Using information theory, which is closer to the basic communication mechanisms, may appear as a preliminary step prior to more elaborated investigations. Criticizing genetics from outside, information theory furthermore reveals that the ability of the template-replication paradigm to faithfully conserve genomes is but a prejudice. Heredity actually demands error-correcting means which impose severe constraints to the living world and must be recognized as biological facts. (shrink)

I examine critically the application of information‐theoretic ideas to biological communication during embryonic development and in the functioning central nervous system (CNS). I show that intercellular communication relies mostly on simple signals whose role is to effect a selection among predetermined cellular states. Hence, a crucial role is played by cellular memory, which stabilizes such states. Memory in cells is partly located in the nuclear DNA; no less important however is (phenotypic) memory lying in the cell's organelles and compartments. Because (...) of combinatorial effects in gene expression patterns, cell memory is an enormously powerful mechanism, which also underlies plasticity, and thus constitutes the factor unifying genetic determination, plasticity and learning. Communication in the CNS is analyzed in some detail: here, cellular memory is embodied in anatomy (i.e., cell shape) and neurochemistry. These are the major, relatively “static” factors affecting the routing of neural impulses in the adult CNS. In addition, however, faster channeling is also required: action potentials must be directed to their targets along a few of exponentially many paths, and this dynamic routing is crucial for proper operation. I suggest that collective oscillatory modes may play a role in solving this addressing problem, in the same way that the clock signal gates the operation of man‐made computers. BioEssays 25:699–708, 2003. © 2003 Wiley Periodicals, Inc. (shrink)

Suppose a quantum experiment includes one or more random processes. Then the results of repeated measurements may appear consistent with irreversible decoherence even if the system’s evolution prior to measurement is reversible and unitary. Two thought experiments are constructed as examples.

Entangled states whose Wigner functions are non-negative may be viewed as being accounted for by local hidden variables (LHV). Recently, there were studies of Bell’s inequality violation (BIQV) for such states in conjunction with the well known theorem of Bell that precludes BIQV for theories that have LHV underpinning. We extend these studies to teleportation which is also based on entanglement. We investigate if, to what extent, and under what conditions may teleportation be accounted for via LHV theory. Our study (...) allows us to expose the role of various quantum requirements. These are, e.g., the uncertainty relation among non-commuting operators, and the no-cloning theorem which forces the complete elimination of the teleported state at its initial port. (shrink)

The potential contributions information and communication technology (ICT) can make to advancing human capabilities are acknowledged by both the capability approach (CA) and ICT communities. However, there is a lack of genuine engagement between the two communities. This paper addresses the question: How can a collaborative dialogue between the CA and ICT communities be advanced? A prerequisite to exploring collaboratively the potential use of particular technologies with specific capabilities is a conceptual framework within which a dialogue can be undertaken to (...) advance the operationalization of capabilities through the use of ICT. A communicative connection constituted of a dialogic space consisting of the CA and ICT communities and a set of normative values and objectives is proposed. The normative values of the communicative connection are derived from the human right to communicate (RTC) which serves as axiomatic principle of the communicative connection. The shared objectives are to operationalize through the use of ICT both the capability and the right to communicate, which are distinct but present in and reinforce each other. Alternative concepts of communication and freedom of expression to those held by the two communities is presented along with a comparison of the values embodied in the RTC and found in the CA. (shrink)

A word-by-word human sentence processing complexity metric is presented. This metric formalizes the intuition that comprehenders have more trouble on words contributing larger amounts of information about the syntactic structure of the sentence as a whole. The formalization is in terms of the conditional entropy of grammatical continuations, given the words that have been heard so far. To calculate the predictions of this metric, Wilson and Carroll's (1954) original entropy reduction idea is extended to infinite languages. This is demonstrated with (...) a mildly context-sensitive language that includes relative clauses formed on a variety of grammatical relations across the Accessibility Hierarchy of Keenan and Comrie (1977). Predictions are derived that correlate significantly with repetition accuracy results obtained in a sentence-memory experiment (Keenan & Hawkins, 1987). (shrink)

Explaining the seizure of power by the National Socialist Party and the totalitarian workings of the Nazi regime in the Third Reich is still difficult not only with respect to the atrocities committed but also to understanding whether the German population and society had to be terrorized into complying with the regime or were part and parcel of it. The paper introduces a notion of swarm to advance the idea that the German population was terrorized into a deliberate compliance with (...) the regime. The notion of swarm is sociologically controlled by a complementary notion of form, which serves to reconstruct and model the social calculus realized by the swarm to differentiate and reproduce itself inside a complex society. The data I use are the results of historical research done in the last 60 years. (shrink)

Psychological constructivist models of emotion propose that emotions arise from the combinations of multiple processes, many of which are not emotion specific. These models attempt to describe both the homogeneity of instances of an emotional “kind” (why are fears similar?) and the heterogeneity of instances (why are different fears quite different?). In this article, we review the iterative reprocessing model of affect, and suggest that emotions, at least in part, arise from the processing of dynamical unfolding representations of valence across (...) time. Critical to this model is the hypothesis that affective trajectories—over time—provide important information that helps build emotional states. (shrink)

The Sparse, Distributed Memory (SDM) model (Kanerva, 1984) is compared to Hopfield-type, neural-network models. A mathematical framework for comparing the two models is developed, and the capacity of each model is investigated. The capacity of the SDM can be increased independent of the dimension of the stored vectors, whereas the Hopfield capacity is limited to a fraction of this dimension. The stored information is proportional to the number of connections, and it is shown that this proportionality constant is the same (...) for the SDM, the Hopfield model, and higher-order models. The models are also compared in their ability to store and recall temporal sequences of patterns. The SDM also includes time delays so that contextual information can be used to recover sequences. A generalization of the SDM allows storage of correlated patterns. (shrink)

Early agreement within cognitive science on the topic of representation has now given way to a combination of positions. Some question the significance of representation in cognition. Others continue to argue in favor, but the case has not been demonstrated in any formal way. The present paper sets out a framework in which the value of representation use can be mathematically measured, albeit in a broadly sensory context rather than a specifically cognitive one. Key to the approach is the use (...) of Bayesian networks for modeling the distal dimension of sensory processes. More relevant to cognitive science is the theoretical result obtained, which is that a certain type of representational architecture is necessary for achievement of sensory efficiency. While exhibiting few of the characteristics of traditional, symbolic encoding, this architecture corresponds quite closely to the forms of embedded representation now being explored in some embedded/embodied approaches. It becomes meaningful to view that type of representation use as a form of information recovery. A formal basis then exists for viewing representation not so much as the substrate of reasoning and thought, but rather as a general medium for efficient, interpretive processing. (shrink)

Information is a peculiar quantity. Unlike matter and energy, which are conserved by the laws of physics, the aggregation of knowledge from many sources can in fact produce more information (synergy) or less (redundancy) than the sum of its parts. This feature can endow groups with problem‐solving strategies that are superior to those possible among noninteracting individuals and, in turn, may provide a selection drive toward collective cooperation and coordination. Here we explore the formal properties of information aggregation as a (...) general principle for explaining features of social organization. We quantify information in terms of the general formalism of information theory, which also prescribes the rules of how different pieces of evidence inform the solution of a given problem. We then show how several canonical examples of collective cognition and coordination can be understood through principles of minimization of uncertainty (maximization of predictability) under information pooling over many individuals. We discuss in some detail how collective coordination in swarms, markets, natural language processing, and collaborative filtering may be guided by the optimal aggregation of information in social collectives. We also identify circumstances when these processes fail, leading, for example, to inefficient markets. The contrast to approaches to understand coordination and collaboration via decision and game theory is also briefly discussed. (shrink)

Arguments for or against a trend in the evolution of complexity are weakened by the lack of an unambiguous definition of complexity. Such definitions abound for both dynamical systems and biological organisms, but have drawbacks of either a conceptual or a practical nature. Physical complexity, a measure based on automata theory and information theory, is a simple and intuitive measure of the amount of information that an organism stores, in its genome, about the environment in which it evolves. It is (...) argued that physical complexity must increase in molecular evolution of asexual organisms in a single niche if the environment does not change, due to natural selection. It is possible that complexity decreases in co‐evolving systems as well as at high mutation rates, in sexual populations, and in time‐dependent landscapes. However, it is reasoned that these factors usually help, rather than hinder, the evolution of complexity, and that a theory of physical complexity for co‐evolving species will reveal an overall trend towards higher complexity in biological evolution. BioEssays 24:1085–1094, 2002. © 2002 Wiley‐Periodicals, Inc. (shrink)

This paper is intended to complement our previous works on the necessary existence of error-correcting codes endowing genomes with the ability of being regenerated, not merely copied. It sketchily recalls some fundamental definitions and results of information theory and error-correcting codes; provides an overview of our research; shows that the disjunction of replication and regeneration enlightens the divide between germinal and somatic cells; suggests that some phenomena referred to as epigenetic may possibly find an explanation within the framework of error-correcting (...) codes; points out some difficulties, especially those related to sexual reproduction; criticizes the template-replication paradigm, and prompts geneticists to become familiar with information theory. (shrink)

The traditional divide between nature and culture restricts to the latter the use of information. Biosemiotics claims instead that the divide between nature and culture is a mere subdivision within the living world but that semiosis is the specific feature which distinguishes the living from the inanimate. The present paper is intended to reformulate this basic tenet in information-theoretic terms, to support it using information-theoretic arguments, and to show that its consequences match reality. It first proposes a ‘receiver-oriented’ interpretation of (...) semiosis. This interpretation implies that the means for recording, storing and processing information exclusively reside in the living world (extended so as to include the artefacts it produces). Then it may be argued that the main difference between the inanimate world and the living one lies in the fact that the very existence of the latter relies on information, which on the contrary is not relevant to the former. Thus, besides matter and energy, information is an entity irreducible to them which must be taken into account in any attempt for describing and understanding life. Information can interact with the real world only provided it is borne by some physical support: it must be ‘physically inscribed’. Contrary to matter and energy, information can be shared, not necessarily exchanged, so a same information can be borne by a number of distinct supports. Any living thing possesses means for recording, storing and processing information which are necessary for keeping it alive and securing its progeny. In particular, its genome contains hereditary information, can be replicated, and instructs the construction and maintenance of a phenotype. The simultaneous existence of a phenotype and of a genome, where the latter bears the symbolic description of the former, is mandatory for enabling the self-reproduction of an organism. Bearing and using information then endows a living thing with the ability to decrease the physical entropy, hence to act as Maxwell’s demon. Not only its own life is maintained against physical entropy, but its self-reproduction multiplies clones of the demon. Taking information as the entity which differentiates the living from the inanimate also supports Rovelli’s ‘relational’ interpretation of quantum physics. Experimental apparatuses then appear as information-theoretic channels from the inanimate world to a living observer. Besides having its own perspective (as stated by Rovelli), each of these channels has its own horizon because its capacity is necessarily finite. As another consequence, we may assert that the physicists’ quest of a ‘theory of everything’ is doomed to failure since, for lack of considering information as a relevant entity, physicists deny the living world, hence themselves. (shrink)

A conjectural inference is proposed, aimed at producing conjectural theorems from formal conjectures assumed as axioms, as well as admitting contradictory statements as conjectural theorems. To this end, we employ Paraconsistent Informational Logic, which provides a formal setting where the notion of conjecture formulated by an epistemic agent can be defined. The paraconsistent systems on which conjectural deduction is based are sequent formulations of the C-systems presented in Carnielli-Marcos [CAR 02b]. Thus, conjectural deduction may also be considered to be a (...) tool for investigating the properties of paraconsistency in general. (shrink)

The study of information based on the approach of Shannon was detached from problems of meaning. Also, it did not allow analysis of the structural characteristics of information, nor describe the way structures carry information. An outline of a different theory of information, including its semantics, was earlier proposed by the author. This theory was using closure spaces to model information. In the present paper, structures (called syllogistics) underlying syllogistic reasoning as well as ethnoscientific classifications are identified together with the (...) conditions for the lattice of closed subsets describing information to allow its existence. The structures can be used for logical analysis outside of language at the more general level of information, which in turn can be applied to the description of semantic relations in the context of information. (shrink)