Popper: Philosophy of Probability

There are (at least) three approaches to quantifying information. The first, algorithmic information or Kolmogorov complexity, takes events as strings and, given a universal Turing machine, quantifies the information content of a string as the length of the shortest program producing it [1]. The second, Shannon information, takes events as belonging to ensembles and quantifies the information resulting from observing the given event in terms of the number of alternate events that have been ruled out [2]. The third, statistical learning (...) theory, has introduced measures of capacity that control (in part) the expected risk of classifiers [3]. These capacities quantify the expectations regarding future data that learning algorithms embed into classifiers. Solomonoff and Hutter have applied algorithmic information to prove remarkable results on universal induction. Shannon information provides the mathematical foundation for communication and coding theory. However, both approaches have shortcomings. Algorithmic information is not computable, severely limiting its practical usefulness. Shannon information refers to ensembles rather than actual events: it makes no sense to compute the Shannon information of a single string – or rather, there are many answers to this question depending on how a related ensemble is constructed. Although there are asymptotic results linking algorithmic and Shannon information, it is unsatisfying that there is such a large gap – a difference in kind – between the two measures. This note describes a new method of quantifying information, effective information, that links algorithmic information to Shannon information, and also links both to capacities arising in statistical learning theory [4, 5]. After introducing the measure, we show that it provides a non-universal analog of Kolmogorov complexity. We then apply it to derive basic capacities in statistical learning theory: empirical VC-entropy and empirical Rademacher complexity. A nice byproduct of our approach is an interpretation of the explanatory power of a learning algorithm in terms of the number of hypotheses it falsifies [6], counted in two different ways for the two capacities. We also discuss how effective information relates to information gain, Shannon and mutual information. (shrink)

The question of truth is a broadly broached subject in Philosophy as it features along the entire historical and polemical growth of the discipline right from the time of the Ancients down to our Post-Modern era. Yet, the delimiting realization of being unable to register general success in our dogged attempts at truth and knowledge, mostly stares us blankly in the face, for matters on which philosophy endeavours to speculate on, are beyond the reach of definite knowledge.1 Our theories of (...) the universe open up to modifications, refutations, and further propositions, evidencing a historical development in philosophical inquiry. This generally is the growth of our science, of our knowledge. This paper critically seeks to examine Popper’s notion of verisimilitude. It takes us through the scientist’s journey from ignorance to truth, and the difference between probability and verisimilitude. It addresses the relevance of the theory of content in understanding verisimilitude, under its distinctions as quantitative and qualitative. Finally, it discusses corroboration and the criteria for theory-choice. (shrink)

DNA evidence is one of the most significant modern advances in the search for truth since the cross examination, but its format as a random-match-probability makes it difficult for people to assign an appropriate probative value (Koehler, 2001). While Frequentist theories propose that the presentation of the match as a frequency rather than a probability facilitates more accurate assessment (e.g., Slovic et al., 2000), Exemplar-Cueing Theory predicts that the subjective weight assigned may be affected by the frequency or probability format, (...) and how easily examples of the event, i.e., ‘exemplars’, are generated from linguistic cues that frame the match in light of further evidence (Koehler & Macchi, 2004). This paper presents two juror research studies to examine the difficulties that jurors have in assigning appropriate probative value to DNA evidence when contradictory evidence is presented. Study 1 showed that refuting evidence significantly reduced guilt judgments when exemplars were linguistically cued, even when the probability match and the refuting evidence had the same objective probative value. Moreover, qualitative reason for judgment responses revealed that interpreting refuting evidence was found to be complex and not necessarily reductive; refutation was found indicative of innocence or guilt depending on whether exemplars have been cued or not. Study 2 showed that the introduction of judges’ directions to linguistically cue exemplars, did not increase the impact of refuting evidence beyond its objective probative value, but less guilty verdicts were returned when jurors were instructed to consider all possible explanations of the evidence. The results are discussed in light of contradictory frequentist and exemplar-cueing theoretical positions, and their real-world consequences. (shrink)

Karl Popper (1902-1994) was one of the most influential philosophers of science of the 20th century. He made significant contributions to debates concerning general scientific methodology and theory choice, the demarcation of science from non-science, the nature of probability and quantum mechanics, and the methodology of the social sciences. His work is notable for its wide influence both within the philosophy of science, within science itself, and within a broader social context. Popper’s early work attempts to solve the problem of (...) demarcation and offer a clear criterion that distinguishes scientific theories from metaphysical or mythological claims. Popper’s falsificationist methodology holds that scientific theories are characterized by entailing predictions that future observations might reveal to be false. When theories are falsified by such observations, scientists can respond by revising the theory, or by rejecting the theory in favor of a rival or by maintaining the theory as is and changing an auxiliary hypothesis. In either case, however, this process must aim at the production of new, falsifiable predictions. While Popper recognizes that scientists can and do hold onto theories in the face of failed predictions when there are no predictively superior rivals to turn to. He holds that scientific practice is characterized by its continual effort to test theories against experience and make revisions based on the outcomes of these tests. By contrast, theories that are permanently immunized from falsification by the introduction of untestable ad hoc hypotheses can no longer be classified as scientific. Among other things, Popper argues that his falsificationist proposal allows for a solution of the problem of induction, since inductive reasoning plays no role in his account of theory choice. Along with his general proposals regarding falsification and scientific methodology, Popper is notable for his work on probability and quantum mechanics and on the methodology of the social sciences. Popper defends a propensity theory of probability, according to which probabilities are interpreted as objective, mind-independent properties of experimental setups. Popper then uses this theory to provide a realist interpretation of quantum mechanics, though its applicability goes beyond this specific case. With respect to the social sciences, Popper argued against the historicist attempt to formulate universal laws covering the whole of human history and instead argued in favor of methodological individualism and situational logic. Table of Contents 1. Background 2. Falsification and the Criterion of Demarcation a. Popper on Physics and Psychoanalysis b. Auxiliary and Ad Hoc Hypotheses c. Basic Sentences and the Role of Convention d. Induction, Corroboration, and Verisimilitude 3. Criticisms of Falsificationism 4. Realism, Quantum Mechanics, and Probability 5. Methodology in the Social Sciences 6. Popper’s Legacy 7. References and Further Reading a. Primary Sources b. Secondary Sources -/- . (shrink)

Karl Popper discovered in 1938 that the unconditional probability of a conditional of the form ‘If A, then B’ normally exceeds the conditional probability of B given A, provided that ‘If A, then B’ is taken to mean the same as ‘Not (A and not B)’. So it was clear (but presumably only to him at that time) that the conditional probability of B given A cannot be reduced to the unconditional probability of the material conditional ‘If A, then B’. (...) I describe how this insight was developed in Popper’s writings and I add to this historical study a logical one, in which I compare laws of excess in Kolmogorov probability theory with laws of excess in Popper probability theory. (shrink)

Popper's account of science is an endeavour in establishing the relationship between universality and truth. The idea is that the more an empirical law is universal, by precluding certain realities from obtaining in an evidentially falsifiable way, the more the law is supported by instances of its predictions being evidentially verified. The logical structure of this dynamic is captured by Popper's notion of 'corroboration'. However, this notion is suspect, for, depending on one's interpretation of evidential givenness, the relation between a (...) law's degree of universality and evidential corroborability could instead invert, thereby contradicting Popper. This paper also explores how a conceptualization of universality in terms of necessary simplicity-i.e., a measure of simplicity that is also sensitive to the evidence at hand-can better recontextualize evidential givenness to be about evidential support for a theory's predictive truth conduciveness, against Popper's understanding of evidential support for a theory's veracity concerning the evidence at hand. However, it is argued that employing necessary simplicity to attain truth conduciveness in a theory's predictions must appeal to specific background assumptions concerning the state of affairs the evidence is supposed to be about. When these background assumptions are denied as being necessarily instantiated, then a relation between necessary simplicity and truth conduciveness becomes contingently uncertain. (shrink)