This chapter will review selected aspects of the terrain of discussions about probabilities in statistical mechanics (with no pretensions to exhaustiveness, though the major issues will be touched upon), and will argue for a number of claims. None of the claims to be defended is entirely original, but all deserve emphasis. The first, and least controversial, is that probabilistic notions are needed to make sense of statistical mechanics. The reason for this is the same reason that convinced Maxwell, Gibbs, and (...) Boltzmann that probabilities would be needed, namely, that the second law of thermodynamics, which in its original formulation says that certain processes are impossible, must, on the kinetic theory, be replaced by a weaker formulation according to which what the original version deems impossible is merely improbable. Second is that we ought not take the standard measures invoked in equilibrium statistical mechanics as giving, in any sense, the correct probabilities about microstates of the system. We can settle for a much weaker claim: that the probabilities for outcomes of experiments yielded by the standard distributions are effectively the same as those yielded by any distribution that we should take as a representing probabilities over microstates. Lastly, (and most controversially): in asking about the status of probabilities in statistical mechanics, the familiar dichotomy between epistemic probabilities (credences, or degrees of belief) and ontic (physical) probabilities is insufficient; the concept of probability that is best suited to the needs of statistical mechanics is one that combines epistemic and physical considerations. (shrink)

Begins by explaining then proving a generalized language dependence result similar to Goodman's "grue" problem. I then use this result to cast doubt on the existence of an objective evidential favoring relation (such as "the evidence confirms one hypothesis over another," "the evidence provides more reason to believe one hypothesis over the other," "the evidence justifies one hypothesis over the other," etc.). Once we understand what language dependence tells us about evidential favoring, our options are an implausibly strong conception of (...) the a priori, a hard externalism on which agents are unable to determine what their evidence favors, or a subjectivist view that makes evidential favoring relative to features of the agent. (shrink)

I attempt to get as clear as possible on the chain of reasoning by which irreversible macrodynamics is derivable from time-reversible microphysics, and in particular to clarify just what kinds of assumptions about the initial state of the universe, and about the nature of the microdynamics, are needed in these derivations. I conclude that while a “Past Hypothesis” about the early Universe does seem necessary to carry out such derivations, that Hypothesis is not correctly understood as a constraint on the (...) early Universe’s entropy. (shrink)

This paper presents a new argument for the Principle of Indifference. This argument can be thought of in two ways: as a pragmatic argument, justifying the principle as needing to hold if one is to minimise worst-case expected loss, or as an epistemic argument, justifying the principle as needing to hold in order to minimise worst-case expected inaccuracy. The question arises as to which interpretation is preferable. I show that the epistemic argument contradicts Evidentialism and suggest that the relative plausibility (...) of Evidentialism provides grounds to prefer the pragmatic interpretation. If this is right, it extends to a general preference for pragmatic arguments for the Principle of Indifference, and also to a general preference for pragmatic arguments for other norms of Bayesian epistemology. (shrink)

An important suggestion of objective Bayesians is that the maximum entropy principle can replace a principle which is known to get into paradoxical difficulties: the principle of indifference. No one has previously determined whether the maximum entropy principle is better able to solve Bertrand’s chord paradox than the principle of indifference. In this paper I show that it is not. Additionally, the course of the analysis brings to light a new paradox, a revenge paradox of the chords, that is unique (...) to the maximum entropy principle. (shrink)

In his Bayesian Nets and Causality, Jon Williamson presents an ‘Objective Bayesian’ interpretation of probability, which he endeavours to distance from the logical interpretation yet associate with the subjective interpretation. In doing so, he suggests that the logical interpretation suffers from severe epistemological problems that do not affect his alternative. In this paper, I present a challenge to his analysis. First, I closely examine the relationship between the logical and ‘Objective Bayesian’ views, and show how, and why, they are highly (...) similar. Second, I argue that the logical interpretation is not manifestly inferior, at least for the reasons that Williamson offers. I suggest that the key difference between the logical and ‘Objective Bayesian’ views is in the domain of the philosophy of logic; and that the genuine disagreement appears to be over Platonism versus nominalism. (shrink)

How ought you to evaluate your options if you're uncertain about what's fundamentally valuable? A prominent response is Expected Value Maximisation (EVM)—the view that under axiological uncertainty, an option is better than another if and only if it has the greater expected value across axiologies. But the expected value of an option depends on quantitative probability and value facts, and in particular on value comparisons across axiologies. We need to explain what it is for such facts to hold. Also, EVM (...) is by no means self-evident. We need an argument to defend that it’s true. This book introduces an axiomatic approach to answer these worries. It provides an explication of what EVM means by use of representation theorems: intertheoretic comparisons can be understood in terms of facts about which options are better than which, and mutatis mutandis for intratheoretic comparisons and axiological probabilities. And it provides a systematic argument to the effect that EVM is true: the theory can be vindicated through simple axioms. The result is a formally cogent and philosophically compelling extension of standard decision theory, and original take on the problem of axiological or normative uncertainty. (shrink)

We introduce a realist, unextravagant interpretation of quantum theory that builds on the existing physical structure of the theory and allows experiments to have definite outcomes but leaves the theory’s basic dynamical content essentially intact. Much as classical systems have specific states that evolve along definite trajectories through configuration spaces, the traditional formulation of quantum theory permits assuming that closed quantum systems have specific states that evolve unitarily along definite trajectories through Hilbert spaces, and our interpretation extends this intuitive picture (...) of states and Hilbert-space trajectories to the more realistic case of open quantum systems despite the generic development of entanglement. We provide independent justification for the partial-trace operation for density matrices, reformulate wave-function collapse in terms of an underlying interpolating dynamics, derive the Born rule from deeper principles, resolve several open questions regarding ontological stability and dynamics, address a number of familiar no-go theorems, and argue that our interpretation is ultimately compatible with Lorentz invariance. Along the way, we also investigate a number of unexplored features of quantum theory, including an interesting geometrical structure—which we call subsystem space—that we believe merits further study. We conclude with a summary, a list of criteria for future work on quantum foundations, and further research directions. We include an appendix that briefly reviews the traditional Copenhagen interpretation and the measurement problem of quantum theory, as well as the instrumentalist approach and a collection of foundational theorems not otherwise discussed in the main text. (shrink)

Expert probability forecasts can be useful for decision making . But levels of uncertainty escalate: however the forecaster expresses the uncertainty that attaches to a forecast, there are good reasons for her to express a further level of uncertainty, in the shape of either imprecision or higher order uncertainty . Bayesian epistemology provides the means to halt this escalator, by tying expressions of uncertainty to the propositions expressible in an agent’s language . But Bayesian epistemology comes in three main varieties. (...) Strictly subjective Bayesianism and empirically-based subjective Bayesianism have difficulty in justifying the use of a forecaster’s probabilities for decision making . On the other hand, objective Bayesianism can justify the use of these probabilities, at least when the probabilities are consistent with the agent’s evidence . Hence objective Bayesianism offers the most promise overall for explaining how testimony of uncertainty can be useful for decision making. Interestingly, the objective Bayesian analysis provided in Sect. 5 can also be used to justify a version of the Principle of Reflection. (shrink)

Schurz (2019, ch. 4) argues that probabilistic accounts of induction fail. In particular, he criticises probabilistic accounts of induction that appeal to direct inference principles, including subjective Bayesian approaches (e.g., Howson 2000) and objective Bayesian approaches (see, e.g., Williamson 2017). In this paper, I argue that Schurz’ preferred direct inference principle, namely Reichenbach’s Principle of the Narrowest Reference Class, faces formidable problems in a standard probabilistic setting. Furthermore, the main alternative direct inference principle, Lewis’ Principal Principle, is also hard to (...) reconcile with standard probabilism. So, I argue, standard probabilistic approaches cannot appeal to direct inference to explicate the logic of induction. However, I go on to defend a non-standard objective Bayesian account of induction: I argue that this approach can both accommodate direct inference and provide a viable account of the logic of induction. I then defend this account against Schurz’ criticisms. (shrink)

The principle of indifference has fallen from grace in contemporary philosophy, yet some papers have recently sought to vindicate its plausibility. This paper follows suit. In it, I articulate a version of the principle and provide what appears to be a novel argument in favour of it. The argument relies on a thought experiment where, intuitively, an agent’s confidence in any particular outcome being true should decrease with the addition of outcomes to the relevant space of possible outcomes. Put simply: (...) the greater the number of outcomes, the weaker your confidence should be in any one of those outcomes. The argument holds that this intuition favours the principle of indifference. I point out that, in contrast, the intuition is also incompatible with a major alternative to the principle which prescribes imprecise credences: the so-called wide interval view. Consequently, the argument may also be seen as an argument against the wide interval view. (shrink)

I develop an account of naturalness in physics which demonstrates that naturalness assumptions are not restricted to narrow cases in high-energy physics but are a ubiquitous part of how interlevel relations are derived in physics. After exploring how and to what extent we might justify such assumptions on methodological grounds or through appeal to speculative future physics, I consider the apparent failure of naturalness in cosmology and in the Standard Model. I argue that any such naturalness failure threatens to undermine (...) the entire structure of our understanding of intertheoretic reduction, and so risks a much larger crisis in physics than is sometimes suggested; I briefly review some currently-popular strategies that might avoid that crisis. (shrink)

Much research into morphogenesis focuses on discovering mechanisms and models able to generate or describe the forms we can observe in nature. These studies all provide insights, even though they do not directly touch upon what is the focus of this article: the understanding of form. To this end a conceptual scheme based on the following ideas is proposed: understanding , emerging , persisting , selection , and the relation concerning complexity versus uncertainty , in particular, the relation between form (...) and function. This article is thus a contribution to both the epistemology and the ontology of nature and, in particular, of the living world. (shrink)

One well-known objection to the principle of maximum entropy is the so-called Judy Benjamin problem, first introduced by van Fraassen. The problem turns on the apparently puzzling fact that, on the basis of information relating an event’s conditional probability, the maximum entropy distribution will almost always assign to the event conditionalized on a probability strictly less than that assigned to it by the uniform distribution. In this article, I present an analysis of the Judy Benjamin problem that can help to (...) make sense of this seemingly odd feature of maximum entropy inference. My analysis is based on the claim that, in applying the principle of maximum entropy, Judy Benjamin is not acting out of a concern to maximize uncertainty in the face of new evidence, but is rather exercising a certain brand of epistemic charity towards her informant. This epistemic charity takes the form of an assumption on the part of Judy Benjamin that her informant’s evidential report leaves out no relevant information. Such a reconceptualization of the motives underlying Judy Benjamin’s appeal to the principle of maximum entropy can help to further our understanding of the true epistemological grounds of this principle and correct a common misapprehension regarding its relationship to the principle of insufficient reason. 1Introduction2The Principle of Maximum Entropy3An Apologia for Judy Benjamin4Conclusion: Entropy and Insufficient Reason. (shrink)

The principle of maximum entropy is a general method to assign values to probability distributions on the basis of partial information. This principle, introduced by Jaynes in 1957, forms an extension of the classical principle of insufficient reason. It has been further generalized, both in mathematical formulation and in intended scope, into the principle of maximum relative entropy or of minimum information. It has been claimed that these principles are singled out as unique methods of statistical inference that agree with (...) certain compelling consistency requirements. This paper reviews these consistency arguments and the surrounding controversy. It is shown that the uniqueness proofs are flawed, or rest on unreasonably strong assumptions. A more general class of inference rules, maximizing the so-called Re[acute ]nyi entropies, is exhibited which also fulfill the reasonable part of the consistency assumptions. (shrink)

Neuroscientists are able to detect physical changes in information entropy in the available neurodata. However, the information paradigm is inadequate to describe fully nervous dynamics and mental activities such as perception. This paper suggests explanations to neural dynamics that provide an alternative to thermodynamic and information accounts. We recall the Banach–Tarski paradox, which informally states that when pieces of a ball are moved and rotated without changing their shape, a synergy between two balls of the same volume is achieved instead (...) of the original one. We show how and why BTP might display this physical and biological synergy meaningfully, making it possible to model nervous activities. The anatomical and functional structure of the central nervous system’s nodes and edges makes it possible to perform a sequence of moves inside the connectome that doubles the amount of available cortical oscillations. In particular, a BTP-based mechanism permits scale-invariant nervous oscillations to amplify and propagate towards widely separated brain areas. Paraphrasing the BTP’s definition, we could state that: when a few components of a self-similar nervous oscillation are moved and rotated throughout the cortical connectome, two self-similar oscillations are achieved instead of the original one. Furthermore, based on topological structures, we illustrate how, counterintuitively, the amplification of scale-free oscillations does not require information transfer. (shrink)

The Bayesian approach to quantum mechanics of Caves, Fuchs and Schack is presented. Its conjunction of realism about physics along with anti-realism about much of the structure of quantum theory is elaborated; and the position defended from common objections: that it is solipsist; that it is too instrumentalist; that it cannot deal with Wigner's friend scenarios. Three more substantive problems are raised: Can a reasonable ontology be found for the approach? Can it account for explanation in quantum theory? Are subjective (...) probabilities on their own adequate in the quantum domain? The first question is answered in the affirmative, drawing on elements from Nancy Cartwright's philosophy of science. The second two are not: it is argued that these present outstanding difficulties for the project. A quantum Bayesian version of Moore's paradox is developed to illustrate difficulties with the subjectivist account of pure state assignments. (shrink)

Explaining the emergence of stochastic irreversible macroscopic dynamics from time-reversible deterministic microscopic dynamics is one of the key problems in philosophy of physics. The Mori-Zwanzig projection operator formalism, which is one of the most important methods of modern nonequilibrium statistical mechanics, allows for a systematic derivation of irreversible transport equations from reversible microdynamics and thus provides a useful framework for understanding this issue. However, discussions of the MZ formalism in philosophy of physics tend to focus on simple variants rather than (...) on the more sophisticated ones used in modern physical research. In this work, I will close this gap by studying the problems of probability and irreversibility using the example of Grabert’s time-dependent projection operator formalism. This allows to better understand how general proposals for understanding probability in statistical mechanics, namely quantum approaches and almost-objective probabilities, can be accomodated in the MZ formalism. Moreover, I will provide a detailed physical analysis, based on the MZ formalism, of various proposals from the philosophical literature, such as Robertson’s theory of justifying coarse-graining via autonomous macrodynamics, Myrvold’s problem of explaining autonomous macrodynamics, and Wallace’s simple dynamical conjecture. (shrink)

One of the most challenging and fascinating issue in mathematical and theoretical physics concerns the possibility of identifying the logic underlying the so-called quantum universe, i.e., Quantum Mechanics and Quantum Gravity. Besides the sheer difficulty of the problem, inherent in the actual formulation of Quantum Mechanics—and especially of Quantum Gravity—to be used for such a task, a crucial aspect lies in the identification of the appropriate axiomatic logical proposition calculus to be associated to such theories. In this paper the issue (...) of the validity of the conventional principle of non-contradiction is called into question and is investigated in the context of non-relativistic Quantum Mechanics. In the same framework a modified form of the principle, denoted as 3-way PNC is shown to apply, which relates the axioms of quantum logic with the physical requirements placed by the Heisenberg Indeterminacy Principle. (shrink)

The logical structure of quantum gravity is addressed in the framework of the so-called manifestly covariant approach. This permits to display its close analogy with the logics of quantum mechanics. More precisely, in QG the conventional 2-way principle of non-contradiction holding in Classical Mechanics is shown to be replaced by a 3-way principle. The third state of logical truth corresponds to quantum indeterminacy/undecidability, i.e., the occurrence of quantum observables with infinite standard deviation. The same principle coincides, incidentally, with the earlier (...) one shown to hold in Part I, in analogous circumstances, for QM. However, this conclusion is found to apply only provided a well-defined manifestly-covariant theory of the gravitational field is adopted both at the classical and quantum levels. Such a choice is crucial. In fact it makes possible the canonical quantization of the underlying unconstrained Hamiltonian structure of general relativity, according to an approach recently developed by Cremaschini and Tessarotto. Remarkably, in the semiclassical limit of the theory, Classical Logic is proved to be correctly restored, together with the validity of the conventional 2-way principle. (shrink)

This paper develops a compositional, type-driven constraint semantic theory for a fragment of the language of subjective uncertainty. In the particular application explored here, the interpretation function of constraint semantics yields not propositions but constraints on credal states as the semantic values of declarative sentences. Constraints are richer than propositions in that constraints can straightforwardly represent assessments of the probability that the world is one way rather than another. The richness of constraints helps us model communicative acts in essentially the (...) same way that we model agents’ credences. Moreover, supplementing familiar truth-conditional theories of epistemic modals with constraint semantics helps capture contrasts between strong necessity and possibility modals, on the one hand, and weak necessity modals, on the other. (shrink)

Information, entropy, probability: these three terms are closely interconnected in the prevalent understanding of statistical mechanics, both when this field is taught to students at an introductory level and in advanced research into the field’s foundations. This paper examines the interconnection between these three notions in light of recent research in the foundations of statistical mechanics. It disentangles these concepts and highlights their differences, at the same time explaining why they came to be so closely linked in the literature. In (...) the literature the term ‘information’ is often linked to entropy and probability in discussions of Maxwell’s Demon and its attempted exorcism by the Landauer-Bennett thesis, and in analyses of the spin echo experiments. The direction taken in the present paper is a different one. Here we discuss the statistical mechanical underpinning of the notions of probability and entropy, and this constructive approach shows that information plays no fundamental role in these concepts, although it can be conveniently used in a sense that we shall specify. (shrink)

For the last three decades, physicists have been moving beyond the boundaries of their discipline, using their methods to study various problems usually instigated by economists. This trend labeled ‘econophysics’ can be seen as a hybrid area of knowledge that exists between economics and physics. Econophysics did not spring from nowhere—the existing literature agrees that econophysics emerged in the 1990s and historical studies on the field mainly deal with what happened during that decade. This article aims at investigating what happened (...) before the 1990s by clarifying the epistemic background that might have paved the way to the emergence of econophysics. This historical exploration led me to highlight the active role played by the Santa Fe Institute by promoting interdisciplinary research on complexity in 1980s. Precisely, by defining three research themes on economic complexity, the SFI defined a research agenda and a way of extending physics\biology to economics. This article offers a possible archeology of econophysics to clarify what could have contributed to the development of a particular episteme in the 1980s easing the advent of econophysics in the 1990s. (shrink)

I argue that none of the usual interpretations of probability provide an adequate interpretation of probabilistic theories in science. Assuming that the aim of such theories is to capture noisy relationships in the world, I suggest that we do not have to give them classical truth-conditional content at all: their probabilities can remain uninterpreted. Indirectly, this account turns out to explain what is right about the frequency interpretation, the best-systems interpretation, and the epistemic interpretation.

We present a discrete model theory similar in structure to ordinary quantum mechanics, but based on a finite field instead of complex amplitudes. The interpretation of this theory involves only the “modal” concepts of possibility and necessity rather than quantitative probability measures. Despite its simplicity, our model theory includes entangled states and has versions of both Bell’s theorem and the no cloning theorem.

It is a common view that the axioms of probability can be derived from the following assumptions: probabilities reflect degrees of belief, degrees of belief can be measured as betting quotients; and a rational agent must select betting quotients that are coherent. In this paper, I argue that a consideration of reasonable betting behaviour, with respect to the alleged derivation of the first axiom of probability, suggests that and are incorrect. In particular, I show how a rational agent might assign (...) a ‘probability’ of zero to an event which she is sure will occur. (shrink)

This paper argues that representationalism of a Fodorian variety can accommodate the fact that beliefs come in degrees. First, it responds to two key arguments to the contrary. Second, it builds upon these responses and outlines a novel representationalist theory of degrees of beliefs. I call this theory dispositional representationalism, as it involves direct appeal to our dispositions to form representations and propositional attitudes concerning them.

Darrell P. Rowbottom reviews the book "In defense of objective Bayesianism" by Jon Williamson.

The debates between Bayesian, frequentist, and other methodologies of statistics have tended to focus on conceptual justifications, sociological arguments, or mathematical proofs of their long run properties. Both Bayesian statistics and frequentist (“classical”) statistics have strong cases on these grounds. In this article, we instead approach the debates in the “Statistics Wars” from a largely unexplored angle: simulations of different methodologies’ performance in the short to medium run. We conducted a large number of simulations using a straightforward decision problem based (...) around tossing a coin with unknown bias and then placing bets. In this simulation, we programmed four players, inspired by Bayesian statistics, frequentist statistics, Jon Williamson’s version of Objective Bayesianism, and a player who simply extrapolates from observed frequencies to general frequencies. The last player functions as a benchmark: a statistical methodology should at least outperform a crude form of induction. We focused on the performance of these methodologies in guiding the players towards good decisions. Unlike an earlier simulation study of this type, we found no systematic difference in performance between the Bayesian and frequentist players, provided the Bayesian used a flat prior and the frequentist used a low confidence level. Unlike that study, we were able to use Big Data methods to mitigate problems of random error in the simulation results. The Williamsonian player, who is a novel element of our study, also had no systematic differences in their performance, provided that they use a low confidence level. These players performed similarly even in the very short run, when players were making different decisions. Our study indicates that all three methodologies should be taken seriously by philosophers and practitioners of statistics. However, the frequentist and Williamsonian performed poorly when their confidence levels were high, and the Bayesian was surprisingly harmed by biased priors, providing some unexpected lessons for these methodologies when facing this type of decision problem. (shrink)

We formulate an elementary statistical game which captures the essence of some fundamental quantum experiments such as photon polarization and spin measurement. We explore and compare the significance of the principle of maximum Shannon entropy and the principle of minimum Fisher information in solving such a game. The solution based on the principle of minimum Fisher information coincides with the solution based on an invariance principle, and provides an informational explanation of Malus' law for photon polarization. There is no solution (...) based on the principle of maximum Shannon entropy. The result demonstrates the merits of Fisher information, and the demerits of Shannon entropy, in treating some fundamental quantum problems. It also provides a quantitative example in support of a general philosophy: Nature intends to hide Fisher information, while obeying some simple rules. (shrink)

During the refereeing procedure of Anthropomorphic Quantum Darwinism by Thomas Durt, it became apparent in the dialogue between him and me that the definition of information in Physics is something about which not all authors agreed. This text aims at describing the concepts associated to information that are accepted as the standard in the Physics world community.

It is generally thought that objective chances for particular events different from 1 and 0 and determinism are incompatible. However, there are important scientific theories whose laws are deterministic but which also assign non-trivial probabilities to events. The most important of these is statistical mechanics whose probabilities are essential to the explanations of thermodynamic phenomena. These probabilities are often construed as 'ignorance' probabilities representing our lack of knowledge concerning the microstate. I argue that this construal is incompatible with the role (...) of probability in explanation and laws. This is the 'paradox of deterministic probabilities'. After surveying the usual list of accounts of objective chance and finding them inadequate I argue that an account of chance sketched by David Lewis can be modified to solve the paradox of deterministic probabilities and provide an adequate account of the probabilities in deterministic theories like statistical mechanics. (shrink)

According to the objective Bayesian approach to inductive logic, premisses inductively entail a conclusion just when every probability function with maximal entropy, from all those that satisfy the premisses, satisfies the conclusion. When premisses and conclusion are constraints on probabilities of sentences of a first-order predicate language, however, it is by no means obvious how to determine these maximal entropy functions. This paper makes progress on the problem in the following ways. Firstly, we introduce the concept of a limit in (...) entropy and show that, if the set of probability functions satisfying the premisses contains a limit in entropy, then this limit point is unique and is the maximal entropy probability function. Next, we turn to the special case in which the premisses are categorical sentences of the logical language. We show that if the uniform probability function gives the premisses positive probability, then the maximal entropy function can be found by simply conditionalising this uniform prior on the premisses. We generalise our results to demonstrate agreement between the maximal entropy approach and Jeffrey conditionalisation in the case in which there is a single premiss that specifies the probability of a sentence of the language. We show that, after learning such a premiss, certain inferences are preserved, namely inferences to inductive tautologies. Finally, we consider potential pathologies of the approach: we explore the extent to which the maximal entropy approach is invariant under permutations of the constants of the language, and we discuss some cases in which there is no maximal entropy probability function. (shrink)

Complex systems research is becoming ever more important in both the natural and social sciences. It is commonly implied that there is such a thing as a complex system, different examples of which are studied across many disciplines. However, there is no concise definition of a complex system, let alone a definition on which all scientists agree. We review various attempts to characterize a complex system, and consider a core set of features that are widely associated with complex systems in (...) the literature and by those in the field. We argue that some of these features are neither necessary nor sufficient for complexity, and that some of them are too vague or confused to be of any analytical use. In order to bring mathematical rigour to the issue we then review some standard measures of complexity from the scientific literature, and offer a taxonomy for them, before arguing that the one that best captures the qualitative notion of the order produced by complex systems is that of the Statistical Complexity. Finally, we offer our own list of necessary conditions as a characterization of complexity. These conditions are qualitative and may not be jointly sufficient for complexity. We close with some suggestions for future work. (shrink)

We are concerned here with how structural properties of language may come to reflect features of the world in which it evolves. As a concrete example, we will consider how a simple term language might evolve to support the principle of indifference over state descriptions in that language. The point is not that one is justified in applying the principle of indifference to state descriptions in natural language. Instead, it is that one should expect a language that has evolved in (...) the context of facilitating successful action to reflect probabilistic features of the world in which it evolved. (shrink)

In the previous papers, it was demonstrated that applying the principle of maximum information entropy by maximizing the conditional information entropy, subject to the constraint given by the Liouville equation averaged over the phase space, leads to a definition of the rate of entropy change for closed Hamiltonian systems without any additional assumptions. Here, we generalize this basic model and, with the introduction of the additional constraints which are equivalent to the hydrodynamic continuity equations, show that the results obtained are (...) consistent with the known results from the nonequilibrium statistical mechanics and thermodynamics of irreversible processes. In this way, as a part of the approach developed in this paper, the rate of entropy change and entropy production density for the classical Hamiltonian fluid are obtained. The results obtained suggest the general applicability of the foundational principles of predictive statistical mechanics and their importance for the theory of irreversibility. (shrink)

MaxEnt inference algorithm and information theory are relevant for the time evolution of macroscopic systems considered as problem of incomplete information. Two different MaxEnt approaches are introduced in this work, both applied to prediction of time evolution for closed Hamiltonian systems. The first one is based on Liouville equation for the conditional probability distribution, introduced as a strict microscopic constraint on time evolution in phase space. The conditional probability distribution is defined for the set of microstates associated with the set (...) of phase space paths determined by solutions of Hamilton’s equations. The MaxEnt inference algorithm with Shannon’s concept of the conditional information entropy is then applied to prediction, consistently with this strict microscopic constraint on time evolution in phase space. The second approach is based on the same concepts, with a difference that Liouville equation for the conditional probability distribution is introduced as a macroscopic constraint given by a phase space average. We consider the incomplete nature of our information about microscopic dynamics in a rational way that is consistent with Jaynes’ formulation of predictive statistical mechanics, and the concept of macroscopic reproducibility for time dependent processes. Maximization of the conditional information entropy subject to this macroscopic constraint leads to a loss of correlation between the initial phase space paths and final microstates. Information entropy is the theoretic upper bound on the conditional information entropy, with the upper bound attained only in case of the complete loss of correlation. In this alternative approach to prediction of macroscopic time evolution, maximization of the conditional information entropy is equivalent to the loss of statistical correlation, and leads to corresponding loss of information. In accordance with the original idea of Jaynes, irreversibility appears as a consequence of gradual loss of information about possible microstates of the system. (shrink)

Recently I posted a paper entitled “External observer reflections on QBism”. As any external observer, I was not able to reflect all features of QBism properly. The comments I received from one of QBism’s creators, C. A. Fuchs, were very valuable to me in better understanding the views of QBists. Some of QBism’s features are very delicate and extracting them from articles of QBists is not a simple task. Therefore, I hope that the second portion of my reflections on QBism (...) might be interesting and useful for other experts in quantum foundations and quantum information theory. In the present paper I correct some of my earlier posted critical comments on QBism. At the same time, other critical comments gained new validation through my recent deeper understanding of QBists views on a number of problems. (shrink)

Suppose a quantum experiment includes one or more random processes. Then the results of repeated measurements may appear consistent with irreversible decoherence even if the system’s evolution prior to measurement is reversible and unitary. Two thought experiments are constructed as examples.

It was recently shown that the Madelung equations, that is, a hydrodynamic form of the Schrödinger equation, can be derived from a canonical ensemble of neural networks where the quantum phase was identified with the free energy of hidden variables. We consider instead a grand canonical ensemble of neural networks, by allowing an exchange of neurons with an auxiliary subsystem, to show that the free energy must also be multivalued. By imposing the multivaluedness condition on the free energy we derive (...) the Schrödinger equation with “Planck’s constant” determined by the chemical potential of hidden variables. This shows that quantum mechanics provides a correct statistical description of the dynamics of the grand canonical ensemble of neural networks at the learning equilibrium. We also discuss implications of the results for machine learning, fundamental physics and, in a more speculative way, evolutionary biology. (shrink)

– We offer a new motivation for imprecise probabilities. We argue that there are propositions to which precise probability cannot be assigned, but to which imprecise probability can be assigned. In such cases the alternative to imprecise probability is not precise probability, but no probability at all. And an imprecise probability is substantially better than no probability at all. Our argument is based on the mathematical phenomenon of non-measurable sets. Non-measurable propositions cannot receive precise probabilities, but there is a natural (...) way for them to receive imprecise probabilities. The mathematics of non-measurable sets is arcane, but its epistemological import is far-reaching; even apparently mundane propositions are liable to be affected by non-measurability. The phenomenon of non-measurability dramatically reshapes the dialectic between critics and proponents of imprecise credence. Non-measurability offers natural rejoinders to prominent critics of imprecise credence. Non-measurability even reverses some of the critics’ arguments—by the very lights that have been used to argue against imprecise credences, imprecise credences are better than precise credences. (shrink)

Almost all of the entropy in the universe is in the form of Bekenstein–Hawking (BH) entropy of super-massive black holes. This entropy, if it satisfies Boltzmann’s equation S=logN\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$S=\log \mathcal{N}$$\end{document}, hence represents almost all the accessible phase space of the Universe, somehow associated to objects which themselves fill out a very small fraction of ordinary three-dimensional space. Although time scales are very long, it is believed that black holes will eventually evaporate by (...) emitting Hawking radiation, which is thermal when counted mode by mode. A pure quantum state collapsing to a black hole will hence eventually re-emerge as a state with strictly positive entropy, which constitutes the famous black hole information paradox. Expanding on a remark by Hawking we posit that BH entropy is a thermodynamic entropy, which must be distinguished from information-theoretic entropy. The paradox can then be explained by information return in Hawking radiation. The novel perspective advanced here is that if BH entropy counts the number of accessible physical states in a quantum black hole, then the paradox can be seen as an instance of the fundamental problem of statistical mechanics. We suggest a specific analogy to the increase of the entropy in a solvation process. We further show that the huge phase volume (N\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathcal{N}$$\end{document}), which must be made available to the universe in a gravitational collapse, cannot originate from the entanglement between ordinary matter and/or radiation inside and outside the black hole. We argue that, instead, the quantum degrees of freedom of the gravitational field must get activated near the singularity, resulting in a final state of the ‘entangled entanglement’ form involving both matter and gravity. (shrink)