In this paper I aim to demonstrate that Rudolf Carnap's analysis of the application of information theory within physics, an intellectual-historical precedent of current philosophical criticisms toward this tendency, is justified. First, Carnap and Bar-Hillel (1952) underlined the unjustified ‘semantification’ of Shannon entropy Furthermore, Carnap criticized the ‘physicalization’ of Shannon entropy, but that criticism was not accepted by the physics community of the 1950s (Köhler 2001). Finally, in the posthumously published "Two Essays on Entropy" Carnap (1977) developed a critical assessment (...) of entropy concepts that showed some deep conceptual and interpretative deficiencies in Jaynes (1957a) and Brillouin’s (1956) informational approaches to thermophysics. (shrink)

The main objective of the paper is to provide a conceptual apparatus of a general logical theory of language communication. The aim of the paper is to outline a formal-logical theory of language in which the concepts of the phenomenon of language communication and language communication in general are defined and some conditions for their adequacy are formulated. The theory explicates the key notions of contemporary syntax, semantics, and pragmatics. The theory is formalized on two levels: token-level and type-level. As (...) such, it takes into account the dual – token and type – ontological character of linguistic entities. The basic notions of the theory: language communication, meaning and interpretation are introduced on the second, type-level of formalization, and their required prior formalization of some of the notions introduced on the first, token-level; among others, the notion of an act of communication. Owing to the theory, it is possible to address the problems of adequacy of both empirical acts of communication and of language communication in general. All the conditions of adequacy of communication discussed in the presented paper, are valid for one-way communication (sender-recipient); nevertheless, they can also apply to the reverse direction of language communication (recipient-sender). Therefore, they concern the problem of two-way understanding in language communication. (shrink)

There is no consensus yet on the definition of semantic information. This paper contributes to the current debate by criticising and revising the Standard Definition of semantic Information (SDI) as meaningful data, in favour of the Dretske‐Grice approach: meaningful and well‐formed data constitute semantic information only if they also qualify as contingently truthful. After a brief introduction, SDI is criticised for providing necessary but insufficient conditions for the definition of semantic information. SDI is incorrect because truth‐values do not supervene on (...) semantic information, and misinformation (that is, false semantic information) is not a type of semantic information, but pseudo‐information, that is not semantic information at all. This is shown by arguing that none of the reasons for interpreting misinformation as a type of semantic information is convincing, whilst there are compelling reasons to treat it as pseudo‐information. As a consequence, SDI is revised to include a necessary truth‐condition. The last section summarises the main results of the paper and indicates some interesting areas of application of the revised definition. (shrink)

The paper enriches the conceptual apparatus of the theory of meaning and denotation that was presented in Part I (Section 3). This part concentrates on the notion of interpretation, which is defined as an equivalence class of the relation possessing the same manner of interpreting types. In this part, some relations between meaning and interpretation, as well as one between denotation an interpretational denotation are established. In the theory of meaning and interpretation, the notion of language communication has been formally (...) introduced and some conditions of correctness of communication have been formulated. (shrink)

This article provides the first comprehensive reconstruction and analysis of Hintikka’s attempt to obtain a measure of the information yield of deductive inferences. The reconstruction is detailed by necessity due to the originality of Hintikka’s contribution. The analysis will turn out to be destructive. It dismisses Hintikka’s distinction between surface information and depth information as being of any utility towards obtaining a measure of the information yield of deductive inferences. Hintikka is right to identify the failure of canonical information theory (...) to give an account of the information yield of deductions as a scandal, however this article demonstrates that his attempt to provide such an account fails. It fails primarily because it applies to only a restricted set of deductions in the polyadic predicate calculus, and fails to apply at all to the deductions in the monadic predicate calculus and the propositional calculus. Some corollaries of these facts are a number of undesirable and counterintuitive results concerning the proposed relation of linguistic meaning (and hence synonymy) with surface information. Some of these results will be seen to contradict Hintikka’s stated aims, whilst others are seen to be false. The consequence is that the problem of obtaining a measure of the information yield of deductive inferences remains an open one. The failure of Hintikka’s proposal will suggest that a purely syntactic approach to the problem be abandoned in favour of an intrinsically semantic one. (shrink)

In The Philosophy of Information, Luciano Floridi presents a theory of “strongly semantic information”, based on the idea that “information encapsulates truth” (the so-called “veridicality thesis”). Starting with Popper, philosophers of science have developed different explications of the notion of verisimilitude or truthlikeness, construed as a combination of truth and information. Thus, the theory of strongly semantic information and the theory of verisimilitude are intimately tied. Yet, with few exceptions, this link has virtually pass unnoticed. In this paper, we briefly (...) survey both theories and offer a critical comparison of strongly semantic information and related notions, like truth, verisimilitude, and partial truth. (shrink)

Typical spatial descriptions, such as “The car is in front of the house,” describe the position of a located object (LO; e.g., the car) in space relative to a reference object (RO) whose location is known (e.g., the house). The orientation of the RO affects spatial language comprehension via the reference frame selection process. However, the effects of the LO's orientation on spatial language have not received great attention. This study explores whether the pure geometric information of the LO (e.g., (...) its orientation) affects spatial language comprehension using placing and production tasks. Our results suggest that the orientation of the LO influences spatial language comprehension even in the absence of functional relationships. (shrink)

People reject ‘paradoxical’ inferences, such as: Luisa didn't play music; therefore, if Luisa played soccer, then she didn't play music. For some theorists, they are invalid for everyday conditionals, but valid in logic. The theory of mental models implies that they are valid, but unacceptable because the conclusion refers to a possibility inconsistent with the premise. Hence, individuals should accept them if the conclusions refer only to possibilities consistent with the premises: Luisa didn't play soccer; therefore, if Luisa played a (...) game then she didn't play soccer. Two experiments corroborated this prediction for three sorts of ‘paradox’, including a disjunctive paradox. (shrink)

This book is conceived as an introductory text into the theory of syntactic and semantic information, and information flow.

In this paper, I offer a contribution to the debate on testimony that rests on three elements: the definition of semantic information, the analysis of trust as a second?order property of first?order relations, and Floridi?s Network Theory of Account (NTA). I argue that testimony transmits semantic information and it is neither grounded on trust nor justified by it. Instead, I show that testimony is an occurrence of a first?order relation of communication affected by the second?order property of trust. I then (...) defend the view that an epistemic agent can acquire some knowledge, on the basis of the information communicated through testimony, if and only if the agent is able to connect the transmitted information to the conceptual network of interrelation to which it belongs. I refer to Floridi?s NTA to show how such a network allows the epistemic agent to achieve knowledge on the basis of semantic information. (shrink)

Ce qu'on peut appeler lathéorie du discoursbouleverse les fondements épistémologiques et les perspectives méthodologiques de la recherche dans d'importants secteurs des sciences humaines et sociales. L'ethnologie, la psychanalyse et, bien entendu, les sciences de la littérature deviennent le champ d'application d'un système conceptuel opératoire que sous-tend la notion de « texte », et d'un modèle d'analyse axé sur le problème de la découverte des « lois de construction » du texte. L'intérêt particulier que présentent les thèses de M. Foucault réside (...) dans le fait qu'elles envisagent la possibilité d'élargir à l'Histoire le champ d'application de cette théorie.. (shrink)

The philosophy of information (PI) is a new area of research with its own field of investigation and methodology. This article, based on the Herbert A. Simon Lecture of Computing and Philosophy I gave at Carnegie Mellon University in 2001, analyses the eighteen principal open problems in PI. Section 1 introduces the analysis by outlining Herbert Simon's approach to PI. Section 2 discusses some methodological considerations about what counts as a good philosophical problem. The discussion centers on Hilbert's famous analysis (...) of the central problems in mathematics. The rest of the article is devoted to the eighteen problems. These are organized into five sections: problems in the analysis of the concept of information, in semantics, in the study of intelligence, in the relation between information and nature, and in the investigation of values. (shrink)

Abstract Theories of induction in psychology and artificial intelligence assume that the process leads from observation and knowledge to the formulation of linguistic conjectures. This paper proposes instead that the process yields mental models of phenomena. It uses this hypothesis to distinguish between deduction, induction, and creative forms of thought. It shows how models could underlie inductions about specific matters. In the domain of linguistic conjectures, there are many possible inductive generalizations of a conjecture. In the domain of models, however, (...) generalization calls for only a single operation: the addition of information to a model. If the information to be added is inconsistent with the model, then it eliminates the model as false: this operation suffices for all generalizations in a Boolean domain. Otherwise, the information that is added may have effects equivalent (a) to the replacement of an existential quantifier by a universal quantifier, or (b) to the promotion of an existential quantifier from inside to outside the scope of a universal quantifier. The latter operation is novel, and does not seem to have been used in any linguistic theory of induction. Finally, the paper describes a set of constraints on human induction, and outlines the evidence in favor of a model theory of induction. (shrink)

One of the open problems in the philosophy of information is whether there is an information logic (IL), different from epistemic (EL) and doxastic logic (DL), which formalises the relation “a is informed that p” (Iap) satisfactorily. In this paper, the problem is solved by arguing that the axiom schemata of the normal modal logic (NML) KTB (also known as B or Br or Brouwer’s system) are well suited to formalise the relation of “being informed”. After having shown that IL (...) can be constructed as an informational reading of KTB, four consequences of a KTB-based IL are explored: information overload; the veridicality thesis (Iap → p); the relation between IL and EL; and the Kp → Bp principle or entailment property, according to which knowledge implies belief. Although these issues are discussed later in the article, they are the motivations behind the development of IL. (shrink)

Notice that this paper has not claimed that all natural languages are CFL's. What it has shown is that every published argument purporting to demonstrate the non-context-freeness of some natural language is invalid, either formally or empirically or both.18 Whether non-context-free characteristics can be found in the stringset of some natural language remains an open question, just as it was a quarter century ago.Whether the question is ultimately answered in the negative or the affirmative, there will be interesting further questions (...) to ask. If it turns out that natural languages are indeed always CFL's, it will be reasonable to ask whether this helps to explain why speakers apparently recognize so quickly whether a presented utterance corresponds to a grammatical sentence or not, and to associate structural and semantic details with it. It might also be reasonable to speculate about the explanation for the universally context-free character of the languages used by humans, and to wonder whether evolutionary biological factors are implicated in some way (Sampson (1979) could be read in this light). And naturally, it will be reasonable to pursue the program put forward by Gazdar (1981, in press) to see to what extent CFL-inducing grammatical devices can be exploited to yield insightful descriptions of natural languages that capture generalizations in revealing ways.If a human language that is not a CFL is proved to exist, on the other hand, a different question will be raised: give the non-context-free character of human languages in general, why has this property been so hard to demonstrate that it has taken over twenty-five years to bring it to light since the issue was first explicitly posed? If human languages do not have to be CFL's, why do so many (most?) of them come so close to having the property of context-freeness? And, since the CFL's certainly constitute a very broad class of mathematically natural and computationally tractable languages, what property of human beings or their communicative or cognitive needs is it that has caused some linguistic communities to reach beyond the boundaries of this class in the course of evolving a linguistic system?Either way, we shall be interested to see our initial question resolved, and further questions raised. One cautionary word should be said, however, about the implications (or lack of them) that the answer will have for grammatical studies. Chomsky has repeatedly stated that he does not see weak generative capacity as a theme of central importance in the theory of grammar, and we agree. It is very far from being the case that the recent resurgence of interest in exploring the potential of CF-PSG or equivalent systems will, or should, be halted dead in its tracks by the discovery (if it is ever forthcoming) that some natural language is not a CFL. In the area of parsing, for instance, it seems possible that natural languages are not only parsed on the basis of constituent structure such as a CF-PSG would assign, but are parsed as if they were finite state languages (see Langendoen (1975) and Church (1980) for discussion along these lines). That is, precisely those construction-types that figure in the various proofs that English is not an FSL appear to cause massive difficulty in the human processing system; the sentences crucial to the proofs are for the most part unprocessable unless they are extremely short (yet the arguments for English not being and FSL only go through if length is not an issue). This means that in practice properties of finite state grammars are still of great potential importance to linguistic theory despite the fact that they do not provide the framework for defining the total class of grammatical sentences. The same would almost certannly be true of CF-PSG's if they were shown to be inadequate in a similar sense. It is highly unlikely that the advances made so far in far in phrase structure description could be nullified by a discovery about weak generative capacity. Moreover, there are known to be numerous ways in which the power of CF-PSG's can be marginally enhanced to permit, for example, xx languages to be generated without allowing anything like the full class of recursively enumerable or even context-sensitive languages (see Hopcroft and Ullmann (1979), Chapter 14) for an introduction to this topic, noting especially Figure 14.7 on p. 393. The obvious thing to do if natural languages were ever shown not to be CFL's in the general case would be to start exploring such minimal enhancements of expressive power to determine exactly what natural languages call for in this regard and how it could be effectively but parsimoniously provided in a way that closely modelled human linguistic capacities.In the meantime, it seems reasonable to assume that the natural languages are a proper subset of the infinite-cardinality CFL's until such time as they are validly shown not to be. (shrink)

This paper outlines a quantitative theory of strongly semantic information (TSSI) based on truth-values rather than probability distributions. The main hypothesis supported in the paper is that the classic quantitative theory of weakly semantic information (TWSI), based on probability distributions, assumes that truth-values supervene on factual semantic information, yet this principle is too weak and generates a well-known semantic paradox, whereas TSSI, according to which factual semantic information encapsulates truth, can avoid the paradox and is more in line with the (...) standard conception of what generally counts as semantic information. After a brief introduction, section two outlines the semantic paradox implied by TWSI, analysing it in terms of an initial conflict between two requisites of a quantitative theory of semantic information. In section three, three criteria of semantic information equivalence are used to provide a taxonomy of quantitative approaches to semantic information and introduce TSSI. In section four, some further desiderata that should be fulfilled by a quantitative TSSI are explained. From section five to section seven, TSSI is developed on the basis of a calculus of truth-values and semantic discrepancy with respect to a given situation. In section eight, it is shown how TSSI succeeds in solving the paradox. Section nine summarises the main results of the paper and indicates some future developments. (shrink)

A theory of information is developed in which the informational content of a signal (structure, event) can be specified. This content is expressed by a sentence describing the condition at a source on which the properties of a signal depend in some lawful way. Information, as so defined, though perfectly objective, has the kind of semantic property (intentionality) that seems to be needed for an analysis of cognition. Perceptual knowledge is an information-dependent internal state with a content corresponding to the (...) information producing it. This picture of knowledge captures most of what makes knowledge an important cpistcmological notion. It also avoids many of the problems infecting traditional justificational accounts of knowledge (knowledge as [justified, true belief those (unlike knowledge) having a content that can be either true or false (e.g., belief) – are described in terms of the way internal (presumably neural) structures acquire during learning a certain information-carrying role. The content of these structures (whether true or false) is identified with the kind of information they were developed to carry. (shrink)

This paper traces the application of information theory to philosophical problems of mind and meaning from the earliest days of the creation of the mathematical theory of communication. The use of information theory to understand purposive behavior, learning, pattern recognition, and more marked the beginning of the naturalization of mind and meaning. From the inception of information theory, Wiener, Turing, and others began trying to show how to make a mind from informational and computational materials. Over the last 50 years, (...) many philosophers saw different aspects of the naturalization of the mind, though few saw at once all of the pieces of the puzzle that we now know. Starting with Norbert Wiener himself, philosophers and information theorists used concepts from information theory to understand cognition. This paper provides a window on the historical sequence of contributions made to the overall project of naturalizing the mind by philosophers from Shannon, Wiener, and MacKay, to Dennett, Sayre, Dretske, Fodor, and Perry, among others. At some time between 1928 and 1948, American engineers and mathematicians began to talk about `Theory of Information' and `Information Theory,' understanding by these terms approximately and vaguely a theory for which Hartley's `amount of information' is a basic concept. I have been unable to find out when and by whom these names were first used. Hartley himself does not use them nor does he employ the term `Theory of Transmission of Information,' from which the two other shorter terms presumably were derived. It seems that Norbert Wiener and Claude Shannon were using them in the Mid-Forties. (shrink)

Agents require a constant flow, and a high level of processing, of relevant semantic information, in order to interact successfully among themselves and with the environment in which they are embedded. Standard theories of information, however, are silent on the nature of epistemic relevance. In this paper, a subjectivist interpretation of epistemic relevance is developed and defended. It is based on a counterfactual and metatheoretical analysis of the degree of relevance of some semantic information i to an informee/agent a, as (...) a function of the accuracy of i understood as an answer to a query q, given the probability that q might be asked by a. This interpretation of epistemic relevance vindicates a strongly semantic theory of information, according to which semantic information encapsulates truth. It accounts satisfactorily for several important applications and interpretations of the concept of relevant information in a variety of philosophical areas. And it interfaces successfully with current philosophical interpretations of causal and logical relevance. (shrink)

Four difficulties with Dretske's theory of knowledge .

Quantifiers in Frege's Grundgesetze like are not well-defined because the part Fx & Gx stands for a concept but the yoking conjunction is horizontalised and must stand for a truth-value. This standard interpretation is rejected in favor of a substitutional reading that, it is argued, both conforms better to the text and is well-defined. The theory of the horizontal is investigated in detail and the composite reading of Frege's connectives as made up of horizontals is rejected. The sense in which (...) the Grundgesetze has a many-valued but classical logic is explained by proving that its propositional fragment (under the standard interpretation) and Bochvar's 3-valued logic are instances of the same metatheoretic methods. Historically, the paper argues for a more naive but well-defined reading of the text. Theoretically, it provides a formally adequate statement of that semantics, as well as developing the abstract metatheory which embraces Bochvar's language and the Fregean fragment. (shrink)

Shannon's notion of information is more useful for naturalized epistemology than Dretske's.

I will take it that general intelligence is intelligence of the kind that a typical human being—Fred, say—manifests in his role as a cognitive agent, that is, as an acquirer, receiver and circulator of knowledge in his cognitive economy. Framed in these terms, the word “general” underserves our ends. Hereafter our questions will bear upon the all-purpose intelligence of beings like Fred. Frederika appears as Fred’s AI-counterpart, not as a fully programmed and engineered being, but as a presently unrealized theoretical (...) construct. Our basic question is whether it is in principle possible to equip Frederika to do what Fred does as an all-purpose participant in his own cognitive economy. Can she achieve a sufficiency of relevant similarity to him to allow us to say that she herself can do what Fred can do, perhaps even better? One of the things that Fred can do—or at least could learn from experience to do—is discharge the duties of an Appeals Court judge. As set down in the ancient doctrine of lex non scripta, Fred must be able to detect, understand and correctly apply certain tacit and implicit rules of law which defy express propositional formulation and linguistic articulation. Fred has an even more widespread capacity for the epistemically tacit and implicit, clearly one of his most cost-saving kinds of intelligence. Indeed, most by far of what Fred will ever know he will know tacitly and implicitly. So we must ask: how tightly bound to the peculiarities of Fred’s cognitive enablement conditions is the character of the intelligence that he manifests? And how far down Fred’s causal make-up does intelligence actually go? (shrink)

This book brings together philosophers, mathematicians and logicians to penetrate important problems in the philosophy and foundations of mathematics. In philosophy, one has been concerned with the opposition between constructivism and classical mathematics and the different ontological and epistemological views that are reflected in this opposition. The dominant foundational framework for current mathematics is classical logic and set theory with the axiom of choice. This framework is, however, laden with philosophical difficulties. One important alternative foundational programme that is actively pursued (...) today is predicativistic constructivism based on Martin-Löf type theory. Associated philosophical foundations are meaning theories in the tradition of Wittgenstein, Dummett, Prawitz and Martin-Löf. What is the relation between proof-theoretical semantics in the tradition of Gentzen, Prawitz, and Martin-Löf and Wittgensteinian or other accounts of meaning-as-use? What can proof-theoretical analyses tell us about the scope and limits of constructive and predicative mathematics? (shrink)

This article responds to two unresolved and crucial problems of cognitive science: (1) What is actually accomplished by functions of the nervous system that we ordinarily describe in the intentional idiom? and (2) What makes the information processing involved in these functions semantic? It is argued that, contrary to the assumptions of many cognitive theorists, the computational approach does not provide coherent answers to these problems, and that a more promising start would be to fall back on mathematical communication theory (...) and, with the help of evolutionary biology and neurophysiology, to attempt a characterization of the adaptive processes involved in visual perception. Visual representations are explained as patterns of cortical activity that are enabled to focus on objects in the changing visual environment by constantly adjusting to maintain levels of mutual information between pattern and object that are adequate for continuing perceptual control. In these terms, the answer proposed to (1) is that the intentional functions of vision are those involved in the establishment and maintenance of such representations, and to (2) that semantic features are added to the information processes of vision with the focus on objects that these representations accomplish. The article concludes with proposals for extending this account of intentionality to the higher domains of conceptualization and reason, and with speculation about how semantic information-processing might be achieved in mechanical systems. (shrink)

Herbert G. Bohnert (1918–84) was a student and lifelong friend of Carnap. He wrote a doctoral thesis on Ramsey sentences and, after wavering between academia and the computer industry, eventually taught at Michigan State University. Bohnert defended Carnapian positions throughout his career and was especially productive in the 1970s. Unfortunately, Carnap’s philosophy was deemed hopelessly out of date during this period, and partly for this reason, Bohnert is almost completely forgotten today. This fate is undeserved. In this article, I reconstruct (...) his career and philosophical development by drawing on publications, as well as diary entries and private correspondence. I then argue that Carnap scholarship would benefit from closer attention to Bohnert’s writings. I support this claim by means of a case study from the philosophy of mathematics: Bohnert’s account of a conversation about set theory with Carnap in 1968 sheds new light on the contested question of whether Carnap held mathematics to be analytic in natural language. (shrink)

This paper develops an inference system for natural language within the ‘Natural Logic’ paradigm as advocated by van Benthem, Sánchez and others. The system that we propose is based on the Lambek calculus and works directly on the Curry-Howard counterparts for syntactic representations of natural language, with no intermediate translation to logical formulae. The Lambek -based system we propose extends the system by Fyodorov et~al., which is based on the Ajdukiewicz/Bar-Hillel calculus Bar Hillel,. This enables the system to deal with (...) new kinds of inferences, involving relative clauses, non-constituent coordination, and meaning postulates that involve complex expressions. Basing the system on the Lambek calculus leads to problems with non-normalized proof terms, which are treated by using normalization axioms. (shrink)