We argue that two long-term goals of AI research stand in tension with one another. The first involves creating AI that is safe, where this is understood as solving the problem of value alignment. The second involves creating artificial general intelligence, meaning AI that operates at or beyond human capacity across all or many intellectual domains. Our argument focuses on the human capacity to make what we call “existential choices”, choices that transform who we are as persons, including transforming what (...) we most deeply value or desire. It is a capacity for a kind of value misalignment, in that the values held prior to making such choices can be significantly different from (misaligned with) the values held after making them. Because of the connection to existentialist philosophers who highlight these choices, we call the resulting form of risk “existentialist risk.” It is, roughly, the risk that results from AI taking an active role in authoring its own values rather than passively going along with the values given to it. On our view, human-like intelligence requires a human-like capacity for value misalignment, which is in tension with the possibility of guaranteeing value alignment between AI and humans. (shrink)

Normative thinking about addiction has traditionally been divided between, on the one hand, a medical model which sees addiction as a disease characterized by compulsive and relapsing drug use over which the addict has little or no control and, on the other, a moral model which sees addiction as a choice characterized by voluntary behaviour under the control of the addict. Proponents of the former appeal to evidence showing that regular consumption of drugs causes persistent changes in the brain structures (...) and functions known to be involved in the motivation of behavior. On this evidence, it is often concluded that becoming addicted involves a transition from voluntary, chosen drug use to non-voluntary compulsive drug use. Against this view, proponents of the moral model provide ample evidence that addictive drug use involves voluntary chosen behaviour. In this paper we argue that although they are right about something, both views are mistaken. We present a third model that neither rules out the view of addictive drug use as compulsive, nor that it involves voluntary chosen behavior. -/- . (shrink)

This paper addresses some of the contours of an ethics of knowledge in the context of ameliorative epistemology, where this term describes epistemological projects aimed at redressing epistemic injustices, improving collective epistemic practices, and educating more effectively for higher-order reflective reasoning dispositions. Virtue theory and embodiment theory together help to tie the cultivation of moral and epistemic emotions to cooperative problem-solving. We examine one cooperative vice, ‘knavery,’ and how David Hume’s little-noticed discussion of it is a forerunner of contemporary game (...) theory’s concern with behavior of ‘free riding’ on systems of trust or cooperation. We develop these and other examples as calling for “risk-aware” social epistemology, which ties epistemic risk with doxastic responsibility. Risk-aware social epistemology aims at describing and ameliorating epistemic practices, but without confusing over-generalizing about culpability in ways that would conflate philosophical censure or critique of bias, with “blameworthiness” in any stronger sense. (shrink)

Cognitive scientists have revealed systematic errors in human reasoning. There is disagreement about what these errors indicate about human rationality, but one upshot seems clear: human reasoning does not seem to fit traditional views of human rationality. This concern about rationality has made its way through various fields and has recently caught the attention of philosophers. The concern is that if philosophers are prone to systematic errors in reasoning, then the integrity of philosophy would be threatened. In this paper, I (...) present some of the more famous work in cognitive science that has marshaled this concern. Then I present reasons to think that those with training in philosophy will be less prone to certain systematic errors in reasoning. The suggestion is that if philosophers could be shown to be less prone to such errors, then the worries about the integrity of philosophy could be constrained. Then I present evidence that, according to performance on the CRT (Frederick 2005), those who have benefited from training and selection in philosophy are indeed less prone to one kind of systematic error: irrationally arbitrating between intuitive and reflective responses. Nonetheless, philosophers are not entirely immune to this systematic error, and their proclivity for this error is statistically related to their responses to a variety of philosophical questions. So, while the evidence herein puts constraints on the worries about the integrity of philosophy, it by no means eliminates these worries. The conclusion, then, is that the present evidence offers prima facie reasons to ascribe a mitigated privilege to philosophers' ability to rationally arbitrate between intuitive and reflective responses. (shrink)

The attempts to mitigate the unprecedented health, economic, and social disruptions caused by the COVID-19 pandemic are largely dependent on establishing compliance to behavioral guidelines and rules that reduce the risk of infection. Here, by conducting an online survey that tested participants’ knowledge about the disease and measured demographic, attitudinal, and cognitive variables, we identify predictors of self-reported social distancing and hygiene behavior. To investigate the cognitive processes underlying health-prevention behavior in the pandemic, we co-opted the dual-process model of thinking (...) to measure participants’ propensities for automatic and intuitive thinking vs. controlled and reflective thinking. Self-reports of 17 precautionary behaviors, including regular hand washing, social distancing, and wearing a face mask, served as a dependent measure. The results of hierarchical regressions showed that age, risk-taking propensity, and concern about the pandemic predicted adoption of precautionary behavior. Variance in cognitive processes also predicted precautionary behavior: participants with higher scores for controlled thinking (measured with the Cognitive Reflection Test) reported less adherence to specific guidelines, as did respondents with a poor understanding of the infection and transmission mechanism of the COVID-19 virus. The predictive power of this model was comparable to an approach (Theory of Planned Behavior) based on attitudes to health behavior. Given these results, we propose the inclusion of measures of cognitive reflection and mental model variables in predictive models of compliance, and future studies of precautionary behavior to establish how cognitive variables are linked with people’s information processing and social norms. (shrink)

The dual-process model of cognition but most especially its reflective component, system 2 processing, shows strong conceptual links with critical thinking. In fact, the salient characteristics of system 2 processing are so strikingly close to that of critical thinking, that it is tempting to claim that critical thinking is system 2 processing, no more and no less. In this article, I consider the two sides of that claim: Does critical thinking always require system 2 processing? And does system 2 processing (...) always result in critical thinking? I argue that it is plausible and helpful to consider that critical thinking requires system 2 processing. In particular, this assumption can provide interesting insights and benchmarks for critical thinking education. On the other hand, I show that system 2 processing can result in a range of outcomes which are either contradictory with critical thinking, or of debatable social desirability—which suggests that there is more to critical thinking than mere system 2 processing, and more to system 2 processing than just critical thinking. (shrink)

Recent years have seen a Bayesian revolution in cognitive science. This should be of interest to metaphysicians of science, whose naturalist project involves working out the metaphysical implications of our leading scientific accounts, and in advancing our understanding of those accounts by drawing on the metaphysical frameworks developed by philosophers. Toward these ends, in this paper I develop a metaphysics of the Bayesian mind. My central claim is that the Bayesian approach supports a novel empirical argument for normativism, the thesis (...) that belief has a normative essence, with the norms in question being those of rationality. The argument I develop draws in part on the causal powers subset account of realization defended by Wilson and Shoemaker, with the link being that Bayesians often appeal to Marr’s framework of levels of analysis, which carries with it multiple realizability claims that can be understood in terms of the subset model. I then use the view developed, with its appeal to normativism and subset realization, to explain how Bayesians can accommodate empirical findings of irrationality that are sometimes thought to pose a problem for their view. (shrink)

Rational constructivism is one of the leading theories in developmental psychology. But it is not a purely psychological theory: rational constructivism also makes a number of substantial epistemological claims about both the nature of human rationality and several normative principles that fall squarely into the ambit of epistemology. The aim of this paper is to clarify and defend both theses and several other epistemological claims, as they represent the essential epistemological dimensions of rational constructivism.

Individual differences have been neglected in decision-making research on heuristics and cognitive biases. Addressing that issue requires having reliable measures. The author first reviewed the research on the measurement of individual differences in cognitive biases. While reliable measures of a dozen biases are currently available, our review revealed that some measures require improvement and measures of other key biases are still lacking (e.g., confirmation bias). We then conducted empirical work showing that adjustments produced a significant improvement of some measures and (...) that confirmation bias can be reliably measured. Overall, our review and findings highlight that the measurement of individual differences in cognitive biases is still in its infancy. In particular, we suggest that contextualized (in addition to generic) measures need to be improved or developed. (shrink)

One of the most debated topics among those who study heuristics is the question of their rationality. The present paper proposes an answer to this question based on the ideas of instrumental rationality and the probabilistic nature of heuristic judgments and decisions. Accordingly, it is argued that the rationality of heuristics is determined by their effectiveness, i.e., their ability to achieve a desired result. At the same time, heuristics do not always produce such a result, but only in a certain (...) number of cases. Therefore, their effectiveness should not be evaluated by the binary logic criterion (effective/ineffective) but by the probabilistic criterion, i.e., by how often they lead to the desired result. Each heuristic has a certain objective probability of achieving such a result, which determines its rationality. However, this probability is mostly unknown to us, so when relying on heuristics, we are likely guided by a subjective perception of it, which serves as a metacognitive cue about the probability of the conclusion obtained with the help of this heuristic. (shrink)

A common reaction to functional diversity is to group entities into clusters that are functionally similar. I argue here that people are diverse with respect to reasoning-related processes, and that these processes satisfy the basic requirements for evolving entities: they are heritable, mutable, and subject to selective pressures. I propose a metric to quantify functional difference and show how this can be used to place psychological processes into a structure akin to a phylogenetic or evolutionary tree. Three species concepts are (...) repurposed from biology and used to understand relationships in that tree. (shrink)

In this study, we investigated whether control of the conflict between incongruent heuristic and analytical answer options in a reasoning task is modulated by the presence of conflict on previous trials. In two experiments, we found that the incongruency of the previous trial has a significant effect on the control exhibited on the current trial. Our data also showed that this adaptation effect is modulated by the incongruency of the previous series of trials. These results demonstrate the same control adaptation (...) effects for a reasoning task as observed for standard response interference tasks. Coinciding control effects in the two research areas suggest that cognitive control might be an important mechanism underlying performance on reasoning tasks. Based on these results we argue that the study of cognitive control in reasoning could potentially facilitate the refinement of empirical predictions and provide a new tool to explore the exertion of top-down control in human thinking. (shrink)

Dispositional measures of actively open-minded thinking and cognitive reflection both predict reasoning accuracy on conflict problems. Here we investigated their relative impact on meta-reasoning. To this end, we measured reasoning accuracy and two indices of meta-reasoning performance – conflict detection sensitivity and meta-reasoning discrimination – using a ratio-bias task. Our key predictors were actively open-minded thinking and cognitive reflection, and numeracy, cognitive ability, and mindware instantiation were controlled for. Actively open-minded thinking was a better predictor of reasoning accuracy and meta-reasoning (...) discrimination than cognitive reflection, and was the only dispositional measure to significantly predict conflict detection sensitivity. Thus, susceptibility to biased reasoning and meta-reasoning may be better captured by a reasoner’s ability to engage in open-minded thinking than by their ability to engage in reflective thinking. (shrink)

Kai kurios šiuolaikinio kognityvinio mokslo teorijos teigia, kad žmogaus prote veikia dvi sistemos: sistema, vykdanti greitą intuityvų mąstymą, bei sistema, vadovaujanti lėtam logiškam mąstymui. Būtų galima manyti, kad šių sistemų egzistavimą patikrinti sudėtinga. Šiame straipsnyje pateikiamas būdas palaipsniui patvirtinti šių dviejų sistemų egzistavimą. Pasitelkiamas dviejų sistemų, pasireiškiančių per mentalinių modelių teoriją, principas. Be to, laikantis Carnapo redukcijos idėjos, straipsnyje aprašomos dvi procedūros, kuriomis hipotezė patvirtinama palaipsniui. Viena iš jų tyrinėja, kaip žmogaus protas nagrinėja žmogaus proto veiklą darant išvedimus pagal modus (...) tollendo tollens. Kita hipotezė tyrinėja išvedimus iš griežtosios disjunkcijos su trimis disjunktais. (shrink)

"Rationality: Contexts and Constraints" is an interdisciplinary reappraisal of the nature of rationality. In method, it is pluralistic, drawing upon the analytic approaches of philosophy, linguistics, neuroscience, and more. These methods guide exploration of the intersection between traditional scholarship and cutting-edge philosophical or scientific research. In this way, the book contributes to development of a suitably revised, comprehensive understanding of rationality, one that befits the 21st century, one that is adequately informed by recent investigations of science, pathology, non-human thought, emotion, (...) and even enigmatic Chinese texts that might previously have seemed to be expressions of irrationalism. Addresses recent challenges and Identifies a direction for future research on rationalityInvestigates the relationship between rationality and mental disorders, such as delusion and depressionAssesses reasoning in artificial intelligence and nonhuman animalsReflects on ancient Chinese Philosophy and possible cultural differences in human psychology Employs philosophical reflection, along with linguistic, probabilistic, and logical techniques. (shrink)

In the present paper we empirically investigate the psychometric properties of some of the most famous statistical and logical cognitive illusions from the “heuristics and biases” research program by Daniel Kahneman and Amos Tversky, who nearly 50 years ago introduced fascinating brain teasers such as the famous Linda problem, the Wason card selection task, and so-called Bayesian reasoning problems (e.g., the mammography task). In the meantime, a great number of articles has been published that empirically examine single cognitive illusions, theoretically (...) explaining people’s faulty thinking, or proposing and experimentally implementing measures to foster insight and to make these problems accessible to the human mind. Yet these problems have thus far usually been empirically analyzed on an individual-item level only (e.g., by experimentally comparing participants’ performance on various versions of one of these problems). In this paper, by contrast, we examine these illusions as a group and look at the ability to solve them as a psychological construct. Based on an sample ofN= 2,643 Luxembourgian school students of age 16–18 we investigate the internal psychometric structure of these illusions (i.e., Are they substantially correlated? Do they form a reflexive or a formative construct?), their connection to related constructs (e.g., Are they distinguishable from intelligence or mathematical competence in a confirmatory factor analysis?), and the question of which of a person’s abilities can predict the correct solution of these brain teasers (by means of a regression analysis). (shrink)

A hallmark of intelligent behavior is rationality – the disposition and ability to think analytically to make decisions that maximize expected utility or follow the laws of probability. However, the question remains as to whether rationality and intelligence are empirically distinct, as does the question of what cognitive mechanisms underlie individual differences in rationality. In a sample of 331 participants, we assessed the relationship between rationality and intelligence. There was a common ability underpinning performance on some, but not all, rationality (...) tests. Latent factors representing rationality and general intelligence were strongly correlated (r =.54), but their correlation fell well short of unity. Rationality correlated significantly with fluid intelligence (r =.56), working memory capacity (r =.44), and attention control (r =.49). Attention control fully accounted for the relationship between working memory capacity and rationality, and partially accounted for the relationship between fluid intelligence and rationality. We conclude by speculating about factors rationality tests may tap that other cognitive ability tests miss, and outline directions for further research. (shrink)

To successfully learn using open Internet resources, students must be able to critically search, evaluate and select online information, and verify sources. Defined as critical online reasoning, this construct is operationalized on two levels in our study: the student level using the newly developed Critical Online Reasoning Assessment, and the online information processing level using event log data, including gaze durations and fixations. The written responses of 32 students for one CORA task were scored by three independent raters. The resulting (...) score was operationalized as “task performance,” whereas the gaze fixations and durations were defined as indicators of “process performance.” Following a person-oriented approach, we conducted a process mining analysis, as well as a latent class analysis to test whether—following the dual-process theory—the undergraduates could be distinguished into two groups based on both their process and task performance. Using PM, the process performance of all 32 students was visualized and compared, indicating two distinct response process patterns. One group of students, defined as “strategic information processers,” processed online information more comprehensively, as well as more efficiently, which was also reflected in their higher task scores. In contrast, the distributions of the process performance variables for the other group, defined as “avoidance information processers,” indicated a poorer process performance, which was also reflected in their lower task scores. In the LCA, where two student groups were empirically distinguished by combining the process performance indicators and the task score as a joint discriminant criterion, we confirmed these two COR profiles, which were reflected in high vs. low process and task performances. The estimated parameters indicated that high-performing students were significantly more efficient at conducting strategic information processing, as reflected in their higher process performance. These findings are so far based on quantitative analyses using event log data. To enable a more differentiated analysis of students’ visual attention dynamics, more in-depth qualitative research of the identified student profiles in terms of COR will be required. (shrink)

The ability to reason and problem‐solve in novel situations, as measured by the Raven's Advanced Progressive Matrices (RAPM), is highly predictive of both cognitive task performance and real‐world outcomes. Here we provide evidence that RAPM performance depends on the ability to reallocate attention in response to self‐generated feedback about progress. We propose that such an ability is underpinned by the basal ganglia nuclei, which are critically tied to both reward processing and cognitive control. This hypothesis was implemented in a neurocomputational (...) model of the RAPM task, which was used to derive novel predictions at the behavioral and neural levels. These predictions were then verified in one neuroimaging and two behavioral experiments. Furthermore, an effective connectivity analysis of the neuroimaging data confirmed a role for the basal ganglia in modulating attention. Taken together, these results suggest that individual differences in a neural circuit related to reward processing underpin human fluid reasoning abilities. (shrink)

ABSTRACTThe ability to evaluate scientific claims and evidence is an important aspect of scientific literacy and requires various epistemic competences. Readers spontaneously validate presented information against their knowledge and beliefs but differ in their ability to strategically evaluate the soundness of informal arguments. The present research investigated how students of psychology, compared to scientists working in psychology, evaluate informal arguments. Using a think-aloud procedure, we identified the specific strategies students and scientists apply when judging the plausibility of arguments and classifying (...) common argumentation fallacies. Results indicate that students, compared to scientists, have difficulties forming these judgements and base them on intuition and opinion rather than the internal consistency of arguments. Our findings are discussed using the mental model theory framework. Although introductory students validate scientific information against their knowledge and beliefs, the.. (shrink)