Suppose that two competing norms, N1 and N2, can be identified such that a given person’s response can be interpreted as correct according to N1 but incorrect according to N2. Which of these two norms, if any, should one use to interpret such a response? In this paper we seek to address this fundamental problem by studying individual variation in the interpretation of conditionals by establishing individual profiles of the participants based on their case judgments and reflective attitudes. To investigate (...) the participants’ reflective attitudes we introduce a new experimental paradigm called the Scorekeeping Task. As a case study, we identify the participants who follow the Suppositional Theory of conditionals (N1) versus Inferentialism (N2) and investigate to what extent internally consistent competence models can be reconstructed for the participants on this basis. After extensive empirical investigations, an apparent reasoning error with and-to-if inferences was found in one of these two groups. The implications of this case study for debates on the proper role of normative considerations in psychology are discussed. (shrink)

Normative theories can be useful in developing descriptive theories, as when normative subjective expected utility theory is used to develop descriptive rational choice theory and behavioral game theory. “Ought” questions are also the essence of theories of moral reasoning, a domain of higher mental processing that could not survive without normative considerations.

Elqayam & Evans (E&E) argue against prescriptive normativism and in favor of descriptivism. I challenge the assumption, implicit in their article, that there is a choice to be made between the two approaches. While descriptivism may be the right approach for some questions, others call for a normativist approach. To illustrate the point, I briefly discuss two questions of the latter sort.

Norms—that is, specifications of what we ought to do—play a critical role in the study of informal argumentation, as they do in studies of judgment, decision-making and reasoning more generally. Specifically, they guide a recurring theme: are people rational? Though rules and standards have been central to the study of reasoning, and behavior more generally, there has been little discussion within psychology about why (or indeed if) they should be considered normative despite the considerable philosophical literature that bears on this (...) topic. In the current paper, we ask what makes something a norm, with consideration both of norms in general and a specific example: norms for informal argumentation. We conclude that it is both possible and desirable to invoke norms for rational argument, and that a Bayesian approach provides solid normative principles with which to do so. (shrink)

This paper examines the basic question of how we can come to form accurate beliefs about the world when we do not fully know how good or bad our evidence is. Here, we show, using simulations with otherwise optimal agents, the cost of misjudging the quality of our evidence. We compare different strategies for correctly estimating that quality, such as outcome‐ and expectation‐based updating. We also identify conditions under which misjudgment of evidence quality can nevertheless lead to accurate beliefs, as (...) well as those conditions where no strategy will help. These results indicate both where people will nevertheless succeed and where they will fail when information quality is degraded. (shrink)

Much of what we believe we know, we know through the testimony of others. While there has been long-standing evidence that people are sensitive to the characteristics of the sources of testimony, for example in the context of persuasion, researchers have only recently begun to explore the wider implications of source reliability considerations for the nature of our beliefs. Likewise, much remains to be established concerning what factors influence source reliability. In this paper, we examine, both theoretically and empirically, the (...) implications of using message content as a cue to source reliability. We present a set of experiments examining the relationship between source information and message content in people's responses to simple communications. The results show that people spontaneously revise their beliefs in the reliability of the source on the basis of the expectedness of a source's claim and, conversely, adjust message impact by perceived reliability; hence source reliability and message content have a bi-directional relationship. The implications are discussed for a variety of psychological, philosophical and political issues such as belief polarization and dual-route models of persuasion. (shrink)

This article compares inference to the best explanation with Bayes’s rule in a social setting, specifically, in the context of a variant of the Hegselmann–Krause model in which agents not only update their belief states on the basis of evidence they receive directly from the world, but also take into account the belief states of their fellow agents. So far, the update rules mentioned have been studied only in an individualistic setting, and it is known that in such a setting (...) both have their strengths as well as their weaknesses. It is shown here that in a social setting, inference to the best explanation outperforms Bayes’s rule according to every desirable criterion. 1 What Is Inference to the Best Explanation?2 Judging the Rules—By Which Lights?3 From an Individualistic to a Social Perspective 3.1 The Hegselmann–Krause model 3.2 A probabilistic extension of the Hegselmann–Krause model 3.3 Simulations4 Results and Discussion5 Interpretation6 Conclusion. (shrink)

This paper aims to make explicit the methodological conditions that should be satisfied for the Bayesian model to be used as a normative model of human probability judgment. After noticing the lack of a clear definition of Bayesianism in the psychological literature and the lack of justification for using it, a classic definition of subjective Bayesianism is recalled, based on the following three criteria: an epistemic criterion, a static coherence criterion and a dynamic coherence criterion. Then it is shown that (...) the adoption of this framework has two kinds of implications. The first one regards the methodology of the experimental study of probability judgment. The Bayesian framework creates pragmatic constraints on the methodology that are linked to the interpretation of, and the belief in, the information presented, or referred to, by an experimenter in order for it to be the basis of a probability judgment by individual participants. It is shown that these constraints have not been satisfied in the past, and the question of whether they can be satisfied in principle is raised and answered negatively. The second kind of implications consists of two limitations in the scope of the Bayesian model. They regard (1) the background of revision (the Bayesian model considers only revising situations but not updating situations), and (2) the notorious case of the null priors. In both cases Lewis’ rule is an appropriate alternative to Bayes’ rule, but its use faces the same operational difficulties. (shrink)

There has been a probabilistic turn in contemporary cognitive science. Far and away, most of the work in this vein is Bayesian, at least in name. Coinciding with this development, philosophers have increasingly promoted Bayesianism as the best normative account of how humans ought to reason. In this paper, we make a push for exploring the probabilistic terrain outside of Bayesianism. Non-Bayesian, but still probabilistic, theories provide plausible competitors both to descriptive and normative Bayesian accounts. We argue for this general (...) idea via recent work on explanationist models of updating, which are fundamentally probabilistic but assign a substantial, non-Bayesian role to explanatory considerations. (shrink)

Van Fraassen (1989) argues that Inference to the Best Explanation is incoherent in the sense that adopting it as a rule for belief change will make one susceptible to a dynamic Dutch book. The present paper argues against this. A strategy is described that allows us to infer to the best explanation free of charge.

The appeal to expert opinion is an argument form that uses the verdict of an expert to support a position or hypothesis. A previous scheme-based treatment of the argument form is formalized within a Bayesian network that is able to capture the critical aspects of the argument form, including the central considerations of the expert's expertise and trustworthiness. We propose this as an appropriate normative framework for the argument form, enabling the development and testing of quantitative predictions as to how (...) people evaluate this argument, suggesting that such an approach might be beneficial to argumentation research generally. We subsequently present two experiments as an example of the potential for future research in this vein, demonstrating that participants' quantitative ratings of the convincingness of a proposition that has been supported with an appeal to expert opinion were broadly consistent with the predictions of the Bayesian model. (shrink)

In this paper, it is argued that the most fruitful approach to developing normative models of argument quality is one that combines the argumentation scheme approach with Bayesian argumentation. Three sample argumentation schemes from the literature are discussed: the argument from sign, the argument from expert opinion, and the appeal to popular opinion. Limitations of the scheme-based treatment of these argument forms are identified and it is shown how a Bayesian perspective may help to overcome these. At the same time, (...) the contributions of the standard scheme-based approach are highlighted, and it is argued that only a combination of the insights of different traditions will yield a complete normative theory of argument quality. (shrink)

The idea that knowledge is conceptually related to practical reasoning is becoming increasingly popular. In defending this idea, philosophers have been relying on a conception of practical reasoning that drastically deviates from one which has been more traditionally advocated in analytic philosophy and which assigns no special role to knowledge. This paper argues that these philosophers have failed to give good reasons for thinking that the conception of practical reasoning they have been assuming is the right one, and that hence (...) they have been rash to conclude that there is a conceptual relation between knowledge and practical reasoning. (shrink)

Objective standards for justification or for being a reason would be desirable, but inductive skepticism tells us that they cannot be presupposed. Rather, we have to start from subjective-relative notions of justification and of being a reason. The paper lays out the strategic options we have given this dilemma. The paper explains the requirements for this subject-relative notion and how they may be satisfied. Then it discusses four quite heterogeneous ways of providing more objective standards, which combine without guaranteeing complete (...) success. (shrink)