In the first section, five major attempts to solve the problem of induction and their failures are discussed. In the second section, an account of meta-induction is introduced. It offers a novel solution to the problem of induction, based on mathematical theorems about the predictive optimality of attractivity-weighted meta-induction. In the third section, how the a priori justification of meta-induction provides a non-circular a posteriori justification of object-induction, based on its superior track record, is explained. In the fourth section, four (...) important extensions and refinements of the method of meta-induction are presented. The final section, summarizes the major impacts of the program of meta-induction for epistemology, the philosophy of science and cognitive science. (shrink)

In this paper a new conception of foundation-oriented epistemology is developed. The major challenge for foundation-oriented justifications consists in the problem of stopping the justificational regress without taking recourse to dogmatic assumptions or circular reasoning. Two alternative accounts that attempt to circumvent this problem, coherentism and externalism, are critically discussed and rejected as unsatisfactory. It is argued that optimality arguments are a new type of foundation-oriented justification that can stop the justificational regress. This is demonstrated on the basis of a (...) novel result in the area of induction: the optimality of meta-induction. In the final section the method of optimality justification is generalized to deductive and abductive inferences. (shrink)

The no free lunch theorem is a radicalized version of Hume’s induction skepticism. It asserts that relative to a uniform probability distribution over all possible worlds, all computable prediction algorithms—whether ‘clever’ inductive or ‘stupid’ guessing methods —have the same expected predictive success. This theorem seems to be in conflict with results about meta-induction. According to these results, certain meta-inductive prediction strategies may dominate other methods in their predictive success. In this article this conflict is analyzed and dissolved, by means of (...) probabilistic analysis and computer simulation. (shrink)

The universal optimality theorem for metainduction works for epistemic agents faced with a choice among finitely many prediction methods. Eckhart Arnold and Tom Sterkenburg objected that it breaks...

In this paper, the contributions to the account of meta-induction (Schurz 2019) collected in this volume are critically discussed and thereby, new insights are developed. How broad and expandable the program of meta-induction is can be learned from Ortner’s contribution. New insights about the transition from the a priori justification of meta-induction to the a posteriori justification of object-induction emerge from the reflection of Shogenji’s paper. How meta-induction may be applied also to religious prophecies and that their meta-inductive justification does (...) not fail for a priori reasons but because of missing evidence for predictive success is learned from the discussion of Pitts’ contribution. That meta-induction does not rely on a particular prior distribution, while the no free lunch theorem depends implicitly on a uniform prior, is the major conclusion drawn from the discussion of Wolpert’s article. How the problem of induction is treated in different versions of the Bayesian account is learned from the discussion of Willliamson’s paper. That meta-induction can also be employed for abduction, and that abductive theory-revision can offer meta-inductive aggregation methods is a new insight emerging from the reflection of Aliseda’s contribution. (shrink)

One of the most discussed issues in psychology—presently and in the past—is how to define and measure the extent to which human cognition is rational. The rationality of human cognition is often evaluated in terms of normative standards based on a priori intuitions. Yet this approach has been challenged by two recent developments in psychology that we review in this article: ecological rationality and descriptivism. Going beyond these contributions, we consider it a good moment for psychologists and philosophers to join (...) forces and work toward a new foundation for the definition of rational cognition. We take a first step in this direction by proposing that the rationality of both cognitive and normative systems can be measured in terms of their cognitive success. Cognitive success can be defined and gauged in terms of two factors: ecological validity (the system's validity in conditions in which it is applicable) and the system's applicability (the scope of conditions under which it can be applied). As we show, prominent systems of reasoning—deductive reasoning, Bayesian reasoning, uncertain conditionals, and prediction and choice—perform rather differently on these two factors. Furthermore, we demonstrate that conceptualizing rationality according to its cognitive success offers a new perspective on the time-honored relationship between the descriptive (“is”) and the normative (“ought”) in psychology and philosophy. (shrink)

According to the Feigl–Reichenbach–Salmon–Schurz pragmatic justification of induction, no predictive method is guaranteed or even likely to work for predicting the future; but if anything will work, induction will work—at least when induction is employed at the meta-level of predictive methods in light of their track records. One entertains a priori all manner of esoteric prediction methods, and is said to arrive a posteriori at the conclusion, based on the actual past, that object-level induction is optimal. Schurz’s refinements largely solve (...) the notorious short-run problem. A difficulty is noted, however, related to short-run worries but based on localized disagreement about the past, a feature characteristic of real debates (especially early modern) involving induction in intellectual history. Given the evidence about past events, _unfiltered by induction_, meta-induction might support a partly non-inductive method—especially as judged by proponents of esoteric prediction methods, who presumably believe that their methods have worked. Thus induction is justified meta-inductively in contexts where it was uncontroversial, while not obviously justified in key contexts where it has been disputed. This objection, momentarily sensed by Reichenbach regarding clairvoyance, is borne out by the Stoics’ use of meta-induction to justify both science and divination and by ancient Hebrew examples of meta-induction. Schurz’s recently introduced criteria for acceptance of testimony play a crucial role in arriving at object-level induction using meta-induction, but one might question them. Given the need for judgment in accepting testimony, it is unclear that the subjectivity of Howson’s Bayesian answer to Hume’s problem is overcome. (shrink)

Despite the ubiquity of uncertainty, scientific attention has focused primarily on probabilistic approaches, which predominantly rely on the assumption that uncertainty can be measured and expressed numerically. At the same time, the increasing amount of research from a range of areas including psychology, economics, and sociology testify that in the real world, people’s understanding of risky and uncertain situations cannot be satisfactorily explained in probabilistic and decision-theoretical terms. In this article, we offer a theoretical overview of an alternative approach to (...) uncertainty developed in the framework of the ecological rationality research program. We first trace the origins of the ecological approach to uncertainty in Simon’s bounded rationality and Brunswik’s lens model framework and then proceed by outlining a theoretical view of uncertainty that ensues from the ecological rationality approach. We argue that the ecological concept of uncertainty relies on a systemic view of uncertainty that features it as a property of the organism–environment system. We also show how simple heuristics can deal with unmeasurable uncertainty and in what cases ignoring probabilities emerges as a proper response to uncertainty. (shrink)

Topics in Cognitive Science, Volume 14, Issue 3, Page 467-491, July 2022.

We often need to have beliefs about things on which we are not experts. Luckily, we often have access to expert judgements on such topics. But how should we form our beliefs on the basis of expert opinion when experts conflict in their judgments? This is the core of the novice/2-expert problem in social epistemology. A closely related question is important in the context of policy making: how should a policy maker use expert judgments when making policy in domains in (...) which she is not herself an expert? This question is more complex, given the messy and strategic nature of politics. In this paper we argue that the prediction with expert advice framework from machine learning provides helpful tools for addressing these problems. We outline conditions under which we should expert PWEA to be helpful and those under which we should not expect these methods to perform well. (shrink)

The standard approach to solve prediction tasks is to apply inductive methods such as, e.g., the straight rule. Such methods are proven to be access-optimal in specific prediction settings, but not in all. Within the optimality-approach of meta-induction, success-based weighted prediction methods are proven to be access-optimal in all possible continuous prediction settings. However, meta-induction fails to be access-optimal in so-called demonic discrete prediction environments where the predicted value is inversely correlated with the true outcome. In this paper the problem (...) of discrete prediction environments is addressed by embedding them into a synchronised prediction setting. In such a setting the task consists in providing a discrete and a continuous prediction. It is shown that synchronisation constraints exclude the possibility of demonic environments. (shrink)

It is undeniable that inductive reasoning has brought us much good. At least since Hume, however, philosophers have wondered how to justify our reliance on induction. In important recent work, Schurz points out that philosophers have been wrongly assuming that justifying induction is tantamount to showing induction to be reliable. According to him, to justify our reliance on induction, it is enough to show that induction is optimal. His optimality approach consists of two steps: an analytic argument for meta-induction (that (...) is, induction over inductive methods) and an application of meta-induction to empirical findings concerning the predictive accuracy of our actual inductive practices as compared to various non-inductive methods. The present article agrees with Schurz’s general conclusion but also argues that it leaves an important aspect of our inductive practices unaccounted for, to wit, that these practices have so far been highly successful; to satisfy the optimality requirement, induction only needs to be as successful as random guessing. To explain the success of induction, I turn to insights from social epistemology, also highlighted in Schurz’s work, and make these formally explicit in a framework that combines the Hegselmann–Krause model for opinion dynamics and Carnap’s system of λ rules. Within this framework, I use a standard evolutionary algorithm to show how communities of interacting agents may, through variation and selection, come to consist of highly successful inductive reasoners. (shrink)

We describe a prediction method called "Attractivity Weighting" (AW). In the case of cue-based paired comparison tasks, AW's prediction is based on a weighted average of the cue values of the most successful cues. In many situations, AW's prediction is based on the cue value of the most successful cue, resulting in behavior similar to Take-the-Best (TTB). Unlike TTB, AW has a desirable characteristic called "access optimality": Its long-run success is guaranteed to be at least as great as the most (...) successful cue. While access optimality is a desirable characteristic, concerns may be raised about the short-term performance of AW. To evaluate such concerns, we here present a study of AW's short-term performance. The results suggest that there is little reason to worry about the short-run performance of AW. Our study also shows that, in random sequences of paired comparison tasks, the behavior of AW and TTB is nearly indiscernible. (shrink)