Every process studied in any science other than physics defines an arrow of time – to say nothing for the directedness of the processes of causation, inference, memory, control, and counterfactual dependence that occur in everyday life. The discussion in this chapter is confined to the arrow of time as it occurs in physics. The chapter briefly discusses those features of microscopic physics, which seem to conflict with time asymmetry. It explains just how this conflict plays out in the important (...) context of thermodynamics and statistical mechanics. The chapter then reviews the main strategies available for resolving the conflict between reversible microdynamics and irreversible macrodynamics, working within the context of the quantitative, time‐irreversible evolution laws that seem to apply to large‐scale phenomena. Finally, it offers a broad the discussion covering other arrows of time within physics. (shrink)

. The origin and history of Landauer’s principle is traced through the development of the thermodynamics of computation at IBM from 1959 to 1982. This development was characterized by multiple conceptual shifts: memory came to be seen not as information storage, but as delayed information transmission; information itself was seen not as a disembodied logical entity, but as participating in the physical world; and logical irreversibility was connected with physical, thermodynamic, irreversibility. These conceptual shifts were characterized by an ambivalence opposing (...) strong metaphysical claims to practical considerations. Three sorts of practical considerations are discussed. First, these conceptual shifts engaged materials central to IBM’s business practice. Second, arguments for metaphysical certainties were made with reference to the practical functioning of typical computers. Third, arguments for metaphysical certainties were made in the context of establishing the thermodynamics of information as a sub-discipline of physics. (shrink)

After more than 60 years, Shannon’s research continues to raise fundamental questions, such as the one formulated by R. Luce, which is still unanswered: “Why is information theory not very applicable to psychological problems, despite apparent similarities of concepts?” On this topic, S. Pinker, one of the foremost defenders of the widespread computational theory of mind, has argued that thought is simply a type of computation, and that the gap between human cognition and computational models may be illusory. In this (...) context, in his latest book, titled Thinking Fast and Slow, D. Kahneman provides further theoretical interpretation by differentiating the two assumed systems of the cognitive functioning of the human mind. He calls them intuition (system 1) determined to be an associative (automatic, fast and perceptual) machine, and reasoning (system 2) required to be voluntary and to operate logical-deductively. In this paper, we propose a mathematical approach inspired by Ausubel’s meaningful learning theory for investigating, from the constructivist perspective, information processing in the working memory of cognizers. Specifically, a thought experiment is performed utilizing the mind of a dual-natured creature known as Maxwell’s demon: a tiny “man–machine” solely equipped with the characteristics of system 1, which prevents it from reasoning. The calculation presented here shows that the Ausubelian learning schema, when inserted into the creature’s memory, leads to a Shannon-Hartley-like model that, in turn, converges exactly to the fundamental thermodynamic principle of computation, known as the Landauer limit. This result indicates that when the system 2 is shut down, both an intelligent being, as well as a binary machine, incur the same minimum energy cost per unit of information (knowledge) processed (acquired), which mathematically shows the computational attribute of the system 1, as Kahneman theorized. This finding links information theory to human psychological features and opens the possibility to experimentally test the computational theory of mind by means of Landauer’s energy cost, which can pave a way toward the conception of a multi-bit reasoning machine. (shrink)

Roughly speaking, classical statistical physics is the branch of theoretical physics that aims to account for the thermal behaviour of macroscopic bodies in terms of a classical mechanical model of their microscopic constituents, with the help of probabilistic assumptions. In the last century and a half, a fair number of approaches have been developed to meet this aim. This study of their foundations assesses their coherence and analyzes the motivations for their basic assumptions, and the interpretations of their central concepts. (...) The most outstanding foundational problems are the explanation of time-asymmetry in thermal behaviour, the relative autonomy of thermal phenomena from their microscopic underpinning, and the meaning of probability. A more or less historic survey is given of the work of Maxwell, Boltzmann and Gibbs in statistical physics, and the problems and objections to which their work gave rise. Next, we review some modern approaches to (i) equilibrium statistical mechanics, such as ergodic theory and the theory of the thermodynamic limit; and to (ii) non-equilibrium statistical mechanics as provided by Lanford's work on the Boltzmann equation, the so-called Bogolyubov-Born-Green-Kirkwood-Yvon approach, and stochastic approaches such as `coarse-graining' and the `open systems' approach. In all cases, we focus on the subtle interplay between probabilistic assumptions, dynamical assumptions, initial conditions and other ingredients used in these approaches. (shrink)

The problem of multiple-computations discovered by Hilary Putnam presents a deep difficulty for functionalism (of all sorts, computational and causal). We describe in out- line why Putnam’s result, and likewise the more restricted result we call the Multiple- Computations Theorem, are in fact theorems of statistical mechanics. We show why the mere interaction of a computing system with its environment cannot single out a computation as the preferred one amongst the many computations implemented by the system. We explain why nonreductive (...) approaches to solving the multiple- computations problem, and in particular why computational externalism, are dualistic in the sense that they imply that nonphysical facts in the environment of a computing system single out the computation. We discuss certain attempts to dissolve Putnam’s unrestricted result by appealing to systems with certain kinds of input and output states as a special case of computational externalism, and show why this approach is not workable without collapsing to behaviorism. We conclude with some remarks about the nonphysical nature of mainstream approaches to both statistical mechanics and the quantum theory of measurement with respect to the singling out of partitions and observables. (shrink)

Information, entropy, probability: these three terms are closely interconnected in the prevalent understanding of statistical mechanics, both when this field is taught to students at an introductory level and in advanced research into the field’s foundations. This paper examines the interconnection between these three notions in light of recent research in the foundations of statistical mechanics. It disentangles these concepts and highlights their differences, at the same time explaining why they came to be so closely linked in the literature. In (...) the literature the term ‘information’ is often linked to entropy and probability in discussions of Maxwell’s Demon and its attempted exorcism by the Landauer-Bennett thesis, and in analyses of the spin echo experiments. The direction taken in the present paper is a different one. Here we discuss the statistical mechanical underpinning of the notions of probability and entropy, and this constructive approach shows that information plays no fundamental role in these concepts, although it can be conveniently used in a sense that we shall specify. (shrink)

This paper makes a novel linkage between the multiple-computations theorem in philosophy of mind and Landauer’s principle in physics. The multiple-computations theorem implies that certain physical systems implement simultaneously more than one computation. Landauer’s principle implies that the physical implementation of “logically irreversible” functions is accompanied by minimal entropy increase. We show that the multiple-computations theorem is incompatible with, or at least challenges, the universal validity of Landauer’s principle. To this end we provide accounts of both ideas in terms of (...) low-level fundamental concepts in statistical mechanics, thus providing a deeper understanding of these ideas than their standard formulations given in the high-level terms of thermodynamics and cognitive science. Since Landauer’s principle is pivotal in the attempts to derive the universal validity of the second law of thermodynamics in statistical mechanics, our result entails that the multiple-computations theorem has crucial implications with respect to the second law. Finally, our analysis contributes to the understanding of notions, such as “logical irreversibility,” “entropy increase,” “implementing a computation,” in terms of fundamental physics, and to resolving open questions in the literature of both fields, such as: what could it possibly mean that a certain physical process implements a certain computation. (shrink)

Concept normativity is a prominent subject of inquiry in the philosophical literature on the nature of concepts. Concepts are said to be normative, in that the use of concepts to categorise is associated with an evaluation of the appropriateness of such categorisation measured against some objective external standard. Two broad groups of views have emerged in accounting for the normativity of concepts: a weaker view traces such normativity to the social practice in which the agent using the concept is embedded, (...) while a stronger view traces such normativity to a first-person capacity of reflection. However, both views have drawbacks: the weaker view seems not to do justice to the basic sense of normativity associated with an individual agent using a concept, while the stronger view ties such normativity with the first-person conscious evaluation, which appears to be too strong. Here, we propose a different view of concepts using principles from the Active Inference framework. We reconceive concepts, defining them as Bayesian beliefs—that is, conditional probability distributions—that represent causes and contingencies in the world, their form grounded in the exchange between the agent and its environment. This allows us to present a different view on the source of normativity, with an emphasis on the structure of the agent itself as well as its interaction with the environment. On the Active Inference view, concepts are normative in that they are intrinsically connected to the self-evidencing nature of an agent, whose very structure implies an evaluation of the concepts it employs. (shrink)

Ludwig Boltzmann is one of the foremost responsible for the development of modern atomism in thermodynamics. His proposition was revolutionary not only because it brought a new vision for Thermodynamics, merging a statistical approach with Newtonian physics, but also because he produced an entirely new perspective on the way of thinking about and describing physical phenomena. Boltzmann dared to flirt with constructivism and realism simultaneously, by hypothesizing the reality of atoms and claiming an inherent probabilistic nature related to many particles (...) systems. Boltzmann faced criticism from the positivists, who rejected the hypothesis of the atom as a matter of principle, and also from physicists, who rejected the idea of a classical bounded system that does not follow deterministic mechanical laws. We consider that Boltzmann thermodynamics has emerged as a systemic theory that deals with macroscopic bodies using collective variables; it was reformulated to a kinetic theory of gases, and subsequently to statistical mechanics. From the theoretical physical point of view, Boltzmann advocates an approach to thermodynamics based on mechanics and was one of the founders of statistical mechanics, together with ideas by Maxwell, Clausius and Gibbs. Subsequently, statistical mechanics has also influenced the development of quantum mechanics and information theory. Using an evolutionary epistemological perspective as a metaphor to describe the physical entities claimed in Boltzmann propositions, we interpret his work as a selected theory that gained attributes of reality and “survived” during a scientific-contextual competition to be more adapted, in the sense that it was able to better explain physical phenomena, and also generated “descendants”. (shrink)

The argument from causal closure of the physical is usually considered the most powerful argument in favor of the ontological doctrine of physicalism. Many authors, most notably Papineau, assume that CCP implies that physicalism is supported by physics. I demonstrate, however, that physical science has no bias in the ontological debate between proponents of physicalism and dualism. I show that the arguments offered for CCP are effective only against the accounts of mental causation based on the action of the mental (...) forces of a Newtonian nature, i.e. those which manifest themselves by causing accelerations. However, it is conceivable and possible that mental causation is manifested through the redistribution of energy, momentum and other conserved quantities in the system, brought about by altering the state probability distribution within the living system and leading to anomalous correlations of neural processes. After arguing that a probabilistic, interactionist model of mental causation is conceivable, which renders the argument from causal closure of the physical ineffective, I point to some basic features that such a model must have in order to be intelligible. At the same time, I indicate the way that conclusive testing of CCP can be done within the theoretical framework of physics. (shrink)

When considering controversial thermodynamic scenarios such as Maxwell's demon, it is often necessary to consider probabilistic mixtures of states. This raises the question of how, if at all, to assign entropy to them. The information-theoretic entropy is often used in such cases; however, no general proof of the soundness of doing so has been given, and indeed some arguments against doing so have been presented. We offer a general proof of the applicability of the information-theoretic entropy to probabilistic mixtures of (...) macrostates, making clear the assumptions on which it depends, in particular a probabilistic version of the Kelvin statement of the Second Law. We briefly discuss the interpretation of our result. (shrink)

Ladyman, Presnell, and Short proposed a model of the implementation of logical operations by physical processes in order to clarify the exact statement of Landauer's Principle, and then offered a new proof of the latter based on the construction of a thermodynamic cycle, arguing that if Landauer's Principle were false it would be possible to harness a machine that violated it to produce a violation of the second law of thermodynamics. In a recent paper in this journal, John Norton directly (...) challenges the consistency of that proof. In the present paper we defend the proof given by Ladyman et al. against his critique. In particular, contrary to what Norton claims, we argue that the processes used in the proof cannot be used to construct a cycle that enacts erasure in a thermodynamically reversible way, and that he does not show that the processes used in the proof violate the Second Law of Thermodynamics. (shrink)

Landauer’s principle is, roughly, the principle that logically irreversible operations cannot be performed without dissipation of energy, with a specified lower bound on that dissipation. Although widely accepted in the literature on the thermodynamics of computation, it has been the subject of considerable dispute in the philosophical literature. Proofs of the principle have been questioned on the grounds of insufficient generality and on the grounds of the assumption, used in the proofs, of the availability of reversible processes at the microscale. (...) The relevance of the principle, should it be true, has also been questioned, as it has been argued that microscale fluctuations entail dissipation that always greatly exceeds the Landauer bound. In this article Landauer’s principle is treated within statistical mechanics, and a proof of the principle is given that neither relies on neglect of fluctuations nor assumes the availability of thermodynamically reversible processes. In addition, it is argued that microscale fluctuations are no obstacle to approximating thermodynamic reversibility, in the appropriate sense, as closely as one would like. (shrink)

There has recently been a good deal of controversy about Landauer's Principle, which is often stated as follows: The erasure of one bit of information in a computational device is necessarily accompanied by a generation of kTln2 heat. This is often generalised to the claim that any logically irreversible operation cannot be implemented in a thermodynamically reversible way. John Norton (2005) and Owen Maroney (2005) both argue that Landauer's Principle has not been shown to hold in general, and Maroney offers (...) a method that he claims instantiates the operation Reset in a thermodynamically reversible way. In this paper we defend the qualitative form of Landauer's Principle, and clarify its quantitative consequences (assuming the second law of thermodynamics). We analyse in detail what it means for a physical system to implement a logical transformation L, and we make this precise by defining the notion of an L-machine. Then we show that logical irreversibility of L implies thermodynamic irreversibility of every corresponding L-machine. We do this in two ways. First, by assuming the phenomenological validity of the Kelvin statement of the second law, and second, by using information-theoretic reasoning. We illustrate our results with the example of the logical transformation 'Reset', and thereby recover the quantitative form of Landauer's Principle. (shrink)

Decompositional equivalence is the principle that there is no preferred decomposition of the universe into subsystems. It is shown here, by using a simple thought experiment, that quantum theory follows from decompositional equivalence together with Landauer’s principle. This demonstration raises within physics a question previously left to psychology: how do human—or any—observers identify or agree about what constitutes a “system of interest”?

Landauer's Principle asserts that there is an unavoidable cost in thermodynamic entropy creation when data is erased. It is usually derived from incorrect assumptions, most notably, that erasure must compress the phase space of a memory device or that thermodynamic entropy arises from the probabilistic uncertainty of random data. Recent work seeks to prove Landauer’s Principle without using these assumptions. I show that the processes assumed in the proof, and in the thermodynamics of computation more generally, can be combined to (...) produce devices that both violate the second law and erase data without entropy cost, indicating an inconsistency in the theoretical system. Worse, the standard repertoire of processes selectively neglects thermal fluctuations. Concrete proposals for how we might measure dissipationlessly and expand single molecule gases reversibly are shown to be fatally disrupted by fluctuations. Reversible, isothermal processes on molecular scales are shown to be disrupted by fluctuations that can only be overcome by introducing entropy creating, dissipative processes. (shrink)

It is commonly thought that the statistical mechanical reversibility objection implies that our putative records of the past are more likely to have arisen as spontaneous fluctuations from equilibrium states than through causal processes that correctly indicate past states of affairs. Hence, so the story goes, without some further assumption that solves the reversibility objection, such as the past hypothesis, all our beliefs about the past would almost surely be false. This claim is disputed and it is argued that at (...) least some of our records of the past can and should be thought to be veridical because the intentional contents of records are not included as part of their statistical mechanical description. The fact that the present state of the world around us coheres so well with the way we would expect it to be if our records were veridical provides good evidence for the claim that they are produced via a common causal structure. (shrink)

I explore the reduction of thermodynamics to statistical mechanics by treating the former as a control theory: a theory of which transitions between states can be induced on a system by means of operations from a fixed list. I recover the results of standard thermodynamics in this framework on the assumption that the available operations do not include measurements which affect subsequent choices of operations. I then relax this assumption and use the framework to consider the vexed questions of Maxwell's (...) demon and Landauer's principle. Throughout I assume rather than prove the basic irreversibility features of statistical mechanics, taking care to distinguish them from the conceptually distinct assumptions of thermodynamics proper. (shrink)

There has recently been a good deal of controversy about Landauer's Principle, which is often stated as follows: The erasure of one bit of information in a computational device is necessarily accompanied by a generation of kT ln 2 heat. This is often generalised to the claim that any logically irreversible operation cannot be implemented in a thermodynamically reversible way. John Norton (2005) and Owen Maroney (2005) both argue that Landauer's Principle has not been shown to hold in general, and (...) Maroney offers a method that he claims instantiates the operation reset in a thermodynamically reversible way. In this paper we defend the qualitative form of Landauer's Principle, and clarify its quantitative consequences (assuming the second law of thermodynamics). We analyse in detail what it means for a physical system to implement a logical transformation L, and we make this precise by defining the notion of an L-machine. Then we show that logical irreversibility of L implies thermodynamic irreversibility of every corresponding L-machine. We do this in two ways. First, by assuming the phenomenological validity of the Kelvin statement of the second law, and second, by using information-theoretic reasoning. We illustrate our results with the example of the logical transformation 'reset', and thereby recover the quantitative form of Landauer's Principle. (shrink)

We show that the so-called Multiple-Computations Theorem in cognitive science and philosophy of mind challenges Landauer’s Principle in physics. Since the orthodox wisdom in statistical physics is that Landauer’s Principle is implied by, or is the mechanical equivalent of, the Second Law of thermodynamics, our argument shows that the Multiple-Computations Theorem challenges the universal validity of the Second Law of thermodynamics itself. We construct two examples of computations carried out by one and the same dynamical process with respect to which (...) Landauer’s principle implies contradictory predictions concerning the entropy increase. Our two examples are based on a weak version of the Multiple-Computations Theorem, which is quite uncontroversial, and therefore they amount to a clear refutation of the universal validity of Landauer’s Principle. We consider some responses to this argument that do not attempt to single out one computation over the others, and we show that they do not work. We further consider ways out of the argument by externalist approaches supporting the computational theory of the mind who propose that the interaction of a computing system with the environment is enough to select a single computation over the others. We show on physical grounds that this approach fails too. We then reverse the direction of our challenge and formulate a dilemma for supporters of the computational theory of the mind: they must reject the causal closure of physic; or else they must accept on a priori grounds that Landauer’s Principle and the Second Law of thermodynamics are not universally valid. Finally, we present our version of a type–type mind-brain identity theory called Flat Physicalism, which is based on the paradigm case of statistical mechanics, and we show that it circumvents the challenge from Landauer’s Principle and the Multiple-Computations Theorem and does not fall prey to our dilemma. (shrink)

Schulman (Entropy 7(4):221–233, 2005) has argued that Boltzmann’s intuition, that the psychological arrow of time is necessarily aligned with the thermodynamic arrow, is correct. Schulman gives an explicit physical mechanism for this connection, based on the brain being representable as a computer, together with certain thermodynamic properties of computational processes. Hawking (Physical Origins of Time Asymmetry, Cambridge University Press, Cambridge, 1994) presents similar, if briefer, arguments. The purpose of this paper is to critically examine the support for the link between (...) thermodynamics and an arrow of time for computers. The principal arguments put forward by Schulman and Hawking will be shown to fail. It will be shown that any computational process that can take place in an entropy increasing universe, can equally take place in an entropy decreasing universe. This conclusion does not automatically imply a psychological arrow can run counter to the thermodynamic arrow. Some alternative possible explanations for the alignment of the two arrows will be briefly discussed. (shrink)

This article distinguishes two different senses of information-theoretic approaches to statistical mechanics that are often conflated in the literature: those relating to the thermodynamic cost of computational processes and those that offer an interpretation of statistical mechanics where the probabilities are treated as epistemic. This distinction is then investigated through Earman and Norton’s ([1999]) ‘sound’ and ‘profound’ dilemma for information-theoretic exorcisms of Maxwell’s demon. It is argued that Earman and Norton fail to countenance a ‘sound’ information-theoretic interpretation and this paper (...) describes how the latter inferential interpretations can escape the criticisms of Earman and Norton ([1999]) and Norton ([2005]) by adopting this ‘sound’ horn. This article considers a standard model of Maxwell’s demon to illustrate how one might adopt an information-theoretic approach to statistical mechanics without a reliance on Landauer’s principle, where the incompressibility of the probability distribution due to Liouville’s theorem is taken as the central feature of such an interpretation. (shrink)

It is impossible to deduce the properties of a strongly emergent whole from a complete knowledge of the properties of its constituents, according to C. D. Broad, when those constituents are isolated from the whole or when they are constituents of other wholes. Elanor Taylor proposes the Collapse Problem. Macro-level property p supposedly emerges when its micro-level components combine in relation r. However, each component has the property that it can combine with the others in r to produce p. Broad’s (...) nondeducibility criterion is not met. This article argues that the amount of information required for r is physically impossible. Strong Emergence does not collapse. But the Collapse Problem does. Belief in Strong Emergence is strongly warranted. Strong Emergence occurs whenever it is physically impossible to deduce how components, in a specific relation, would combine to produce a whole with p. Almost always, that is impossible. Strong Emergence is ubiquitous. Word counts. (shrink)

This article studies the emergence of ambiguity in communication through the concept of logical irreversibility and within the framework of Shannon’s information theory. This leads us to a precise and general expression of the intuition behind Zipf’s vocabulary balance in terms of a symmetry equation between the complexities of the coding and the decoding processes that imposes an unavoidable amount of logical uncertainty in natural communication. Accordingly, the emergence of irreversible computations is required if the complexities of the coding and (...) the decoding processes are balanced in a symmetric scenario, which means that the emergence of ambiguous codes is a necessary condition for natural communication to succeed. (shrink)

Physics has been thought to truly represent reality since at least Galileo, and the foundations of physics are always established using philosophical ideas. In particular, the elegant naming of physical entities is usually very influential in the acceptance of physical theories. We here demonstrate (using current developments in thermodynamics as an example) that both the epistemology and the ontology of physics ultimately rest on poetic language. What we understand depends essentially on the language we use. We wish to establish our (...) knowledge securely, but strictly speaking this is impossible using only analytic language. Knowledge of the meanings of things must use a natural language designed to express meaning, that is, poetic language. Although the world is really there, and although we can indeed know it truly, this knowledge is never either complete or certain but ultimately must rest on intuition. Reading a recently discovered artefact with a palaeo-Hebrew inscription as from the first century, we demonstrate from it that this ontological understanding long predates the Hellenic period. Poetic language is primary, both logically and temporally. (shrink)

Information theory presupposes the notion of an epistemic agent, such as a scientist or an idealized human. Despite that, information theory is increasingly invoked by physicists concerned with fundamental physics, physics at very high energies, or generally with the physics of situations in which even idealized epistemic agents cannot exist. In this paper, I shall try to determine the extent to which the application of information theory in those contexts is legitimate. I will illustrate my considerations using the case of (...) black hole thermodynamics and Bekenstein's celebrated argument for his formula for the entropy of black holes. This example is particularly pertinent to the theme of the present collection because it is widely accepted as `empirical data' in notoriously empirically deprived quantum gravity, even though the laws of black hole thermodynamics have so far evaded direct empirical confirmation. (shrink)