Despite various studies examining intertemporal choice with hypothetical rewards due to problematic real reward delivery, there remains no substantial evidence on the effect of the incentives on the decision confidence and cognitive process in intertemporal choice and no comprehensive exploration on the loss domain. Hence, this study conducts an eye-tracking experiment to examine the effect of incentive approach and measure participants' decision confidence using a between-subject design in both gain and loss domains. Results replicated previous findings which show incentives do (...) not affect intertemporal choice in the gain domain. In contrast, in the loss domain, participants in the incentivized group were more likely to choose the larger-later options than those in the non-incentivized group. Furthermore, the decision confidence and the mean fixation duration differed between the incentivized and non-incentivized groups in both gain and loss domains. These findings allow for a better understanding of the effect of incentives on intertemporal choice and provide valuable information for the design of incentives in future intertemporal experiments. (shrink)

Metacognitive mental states are mental states about mental states. For example, I may be uncertain whether my belief is correct. In social discourse, an interlocutor’s metacognitive certainty may constitute evidence about the reliability of their testimony. For example, if a speaker is certain that their belief is correct, then we may take this as evidence in favour of their belief, or its content. This paper argues that, if metacognitive certainty is genuine evidence, then it is disproportionate evidence for extreme beliefs. (...) In support of the argument, we report findings from five studies with different participant samples, designs, and measures. These studies show that, the more extreme an agent’s belief (positive or negative), the more certain they are about it, and vice versa. This relationship might contribute to moralism, virtue signalling, and polarisation, which in turn may be epistemically and morally problematic. Therefore, we caution against taking metacognitive certainty as genuine evidence. (shrink)

This paper reports the first empirical investigation of the hypothesis that epistemic appraisals form part of the structure of concepts. To date, studies of concepts have focused on the way concepts encode properties of objects and the way those features are used in categorization and in other cognitive tasks. Philosophical considerations show the importance of also considering how a thinker assesses the epistemic value of beliefs and other cognitive resources and, in particular, concepts. We demonstrate that there are multiple, reliably (...) judged, dimensions of epistemic appraisal of concepts. Four of these dimensions are accounted for by a common underlying factor capturing how well people believe they understand a concept. Further studies show how dimensions of concept appraisal relate to other aspects of concepts. First, they relate directly to the hierarchical organization of concepts, reflecting the increase in specificity from superordinate to basic and subordinate levels. Second, they predict inductive choices in category-based induction. Our results suggest that epistemic appraisals of concepts form a psychologically important yet previously overlooked aspect of the structure of concepts. These findings will be important in understanding why individuals sometimes abandon and replace certain concepts; why social groups do so, for example, during a “scientific revolution”; and how we can facilitate such changes when we engage in deliberate “conceptual engineering” for epistemic, social, and political purposes. (shrink)

To study consciousness, scientists need to determine when participants are conscious and when they are not. They do so with consciousness detection procedures. A recurring skeptical argument against those procedures is that they cannot be calibrated: there is no way to make sure that detection outcomes are accurate. In this article, I address two main skeptical arguments purporting to show that consciousness scientists cannot calibrate detection procedures. I conclude that there is nothing wrong with calibration in consciousness science.

Consciousness and confidence seem intimately related. Accordingly, some researchers use confidence ratings as a measure of, or proxy for, consciousness. Rosenthal discusses the potential connections between the two, and rejects confidence as a valid measure of consciousness. He argues that there are better alternatives to get at conscious experiences such as direct subjective reports of awareness (i.e. subjects’ reports of perceiving something or of the degree of visibility of a stimulus). In this chapter, we offer a different perspective. Confidence ratings (...) in general, and metacognitive measures in particular, may offer important advantages over subjective ratings. The arguments we offer here are supported by empirical, practical and socio-strategic considerations. However, we do not suggest consciousness and confidence are interchangeable. We recognize the limitations of confidence ratings in some experimental designs and for some research questions. Nevertheless, we also address a potential conceptual link between consciousness and confidence that stems from Rosenthal’s very own work on mental quality space theory. (shrink)

Critics have often misunderstood the higher-order theory (HOT) of consciousness. Here we clarify its position on several issues, and distinguish it from other views such as the global The higher-order theory (HOT) of consciousness has often been misunderstood by critics. Here we clarify its position on several issues, and distinguish it from other views such as the global workspace theory (GWT) and early sensory models (e.g. first-order local recurrency theories). For example, HOT has been criticized for over-intellectualizing consciousness. We show (...) that while higher-order states are cognitively assembled, the requirements are actually considerably less than often presumed. In this sense HOT may be viewed as an intermediate position between GWT and early sensory views. Also, we clarify that most proponents of HOT do not stipulate consciousness as equivalent to metacognition or confidence. Further, compared to other existing theories, HOT can arguably account better for complex everyday experiences, such as of emotions and episodic memories. This makes HOT particularly useful as a framework for conceptualizing pathological mental states. (shrink)

This chapter discusses the main types of so-called ’subjective measures of consciousness’ used in current-day science of consciousness. After explaining the key worry about such measures, namely the problem of an ever-present response bias, I discuss the question of whether subjective measures of consciousness are introspective. I show that there is no clear answer to this question, as proponents of subjective measures do not employ a worked-out notion of subjective access. In turn, this makes the problem of response bias less (...) tractable than it might otherwise be. (shrink)

To study consciousness, scientists need to determine when participants are conscious and when they are not. They do so with consciousness detection procedures. A recurring skeptical argument against those procedures is that they cannot be calibrated: there is no way to make sure that detection outcomes are accurate. In this article, I address two main skeptical arguments purporting to show that consciousness scientists cannot calibrate detection procedures. I conclude that there is nothing wrong with calibration in consciousness science.

Many policies and ethical guidelines recommend developing “trustworthy AI”. We argue that developing morally trustworthy AI is not only unethical, as it promotes trust in an entity that cannot be trustworthy, but it is also unnecessary for optimal calibration. Instead, we show that reliability, exclusive of moral trust, entails the appropriate normative constraints that enable optimal calibration and mitigate the vulnerability that arises in high-stakes hybrid decision-making environments, without also demanding, as moral trust would, the anthropomorphization of AI and thus (...) epistemically dubious behavior. The normative demands of reliability for inter-agential action are argued to be met by an analogue to procedural metacognitive competence (i.e., the ability to evaluate the quality of one’s own informational states to regulate subsequent action). Drawing on recent empirical findings that suggest providing reliability scores (e.g., F1-scores) to human decision-makers improves calibration in the AI system, we argue that reliability scores provide a good index of competence and enable humans to determine how much they wish to rely on the system. (shrink)

Metacognition, the cognition about cognition, is closely linked to intelligence and therefore understanding the metacognitive processes underlying intelligence test performance, specifically on Raven’s Progressive Matrices, could help advance the knowledge about intelligence. The measurement of metacognition, is often done using domain-general offline questionnaires or domain-specific online think-aloud protocols. This study aimed to investigate the relationship between metacognitive awareness and intelligence via the design and use of a novel Meta-Cognitive Awareness Scale – Domain Specific that encourages reflection of task strategy processes. (...) This domain-specific scale was first constructed to measure participants’ awareness of their own metacognition linked to Raven’s Progressive Matrices. Following discriminatory index and Exploratory Factor Analysis, a 15-item scale was derived. Exploratory Factor Analysis showed five factors: Awareness of Engagement in Self-Monitoring, Awareness of Own Ability, Awareness of Responding Speed/Time, Awareness of Alternative Solutions and Awareness of Requisite Problem-Solving Resources. The intelligence level of ninety-eight adults was then estimated using Raven’s Standard Progressive Matrices. Participants also completed the MCAS-DS, and further items that examined their test-taking behavior and Confidence level. Metacognitive awareness was positively correlated to standardized IQ scores derived from the SPM whilst Over-Confidence derived using the Confidence level measure was negatively correlated to SPM. Despite some limitations, this study shows promise for elucidating the relationship between metacognitive awareness and intelligence using the task-specific scale. (shrink)

Confidence ratings have often been integrated into reasoning and intelligence tasks as a means for assessing meta-reasoning processes. Although it is often assumed that eliciting these judgements throughout reasoning tasks has no effect on the underlying performance outcomes, this is yet to be established empirically. The current study examines whether eliciting CR from participants during a fluid-reasoning task influences their performance and how this effect is moderated by their initial self-confidence in their own reasoning abilities. In a first experiment, we (...) found that participants performing CR during Raven's Progressive Matrices significantly outperformed a control group who did not provide ratings. Additionally, a second experiment demonstrated that CR only facilitated performance in participants who have a high level of initial self-confidence in their reasoning ability, whereas they were detrimental to participants low in self-confidence. (shrink)

Metamemory processes depend on different factors across the learning and memory time-scale. In the laboratory, subjects are often asked to make prospective feeling-of-knowing (FOK) judgments about target retrievability, or are asked to make retrospective confidence judgments (RCJs) about the retrieved target. We examined distinct and shared contributors to metamemory judgments, and how they were built over time. Eye movements were monitored during a face-scene associative memory task. At test, participants viewed a studied scene, then rated their FOK that they would (...) remember the associated face. This was followed by a forced choice recognition test and RCJs. FOK judgments were less accurate than RCJ judgments, showing that the addition of mnemonic experience can increase metacognitive accuracy over time. However, there was also evidence that the given FOK rating influenced RCJs. Turning to eye movements, initial analyses showed that higher cue fluency was related to both higher FOKs and higher RCJs. However, further analyses revealed that the effects of the scene cue on RCJs were mediated by FOKs. Turning to the target, increased viewing time and faster viewing of the correct associate related to higher FOKs, consistent with the idea that target accessibility is a basis of FOKs. In contrast, the amount of viewing directed to the chosen face, regardless of whether it was correct, predicted higher RCJs, suggesting that choice experience is a significant contributor RCJs. We also examined covariates of the change in RCJ rating from the FOK rating, and showed that increased and faster viewing of the chosen face predicted raising one’s confidence above one’s FOK. Taken together these results suggest that metamemory judgments should not be thought of only as distinct subjective experiences, but complex processes that interact and evolve as new psychological bases for subjective experience become available. (shrink)

Negative subjective reports such as “I didn’t see the stimulus” can be interpreted as indicating either that the subject didn’t see the stimulus, or as indicating that, while the subject did see the stimulus, the strength of sensory signals associated with the stimulus fell below a conservative criterion for answering “seen”. Determining which of these two interpretations is correct is the criterion problem. I present two ways in which researchers can solve this problem. But there’s more. What I call the (...) “new criterion problem” consists in determining whether criteria effects reflect perceptual changes, or changes in response strategy. Through case studies, I argue that this new version of the problem can be solved as well, although there is currently no systematic way to solve it. I conclude that criterion problems do not constitute good reasons for skepticism about the scientific study of consciousness. (shrink)

In this article, we suggest that the study of social interactions and the development of a “sense of agency” in joint action can help determine the content of relevant explanations to be implemented in artificial systems to make them “explainable.” The introduction of automated systems, and more broadly of Artificial Intelligence, into many domains has profoundly changed the nature of human activity, as well as the subjective experience that agents have of their own actions and their consequences – an experience (...) that is commonly referred to as sense of agency. We propose to examine the empirical evidence supporting this impact of automation on individuals’ sense of agency, and hence on measures as diverse as operator performance, system explicability and acceptability. Because of some of its key characteristics, AI occupies a special status in the artificial systems landscape. We suggest that this status prompts us to reconsider human–AI interactions in the light of human–human relations. We approach the study of joint actions in human social interactions to deduce what key features are necessary for the development of a reliable sense of agency in a social context and suggest that such framework can help define what constitutes a good explanation. Finally, we propose possible directions to improve human–AI interactions and, in particular, to restore the sense of agency of human operators, improve their confidence in the decisions made by artificial agents, and increase the acceptability of such agents. (shrink)

People are often inaccurate in their predictions of performance on a variety of cognitive tasks. We tested whether receptivity to bullshit – the tendency to perceive meaningless statements as profound – would relate to the accuracy of metacognitive judgments on several problem-solving tasks. Individuals who were highly receptive to bullshit were less accurate in their predictions of performance on creative problem-solving tasks, but not on verbal analogy or recall tasks. Further, individuals with high BS receptivity were less able to discriminate (...) between solvable and unsolvable problems when making metacognitive judgments. These findings support the possibility that the tendency to perceive semantic connections where none exist, as indicated by high bullshit receptivity, may lead to inaccurate predictions of performance on tasks that require noticing and utilizing distant semantic connections. (shrink)

Metacognition is the capacity to evaluate the success of one's own cognitive processes in various domains; for example, memory and perception. It remains controversial whether metacognition relies on a domain-general resource that is applied to different tasks or if self-evaluative processes are domain specific. Here, we investigated this issue directly by examining the neural substrates engaged when metacognitive judgments were made by human participants of both sexes during perceptual and memory tasks matched for stimulus and performance characteristics. By comparing patterns (...) of fMRI activity while subjects evaluated their performance, we revealed both domain-specific and domain-general metacognitive representations. Multivoxel activity patterns in anterior prefrontal cortex predicted levels of confidence in a domain-specific fashion, whereas domain-general signals predicting confidence and accuracy were found in a widespread network in the frontal and posterior midline. The demonstration of domain-specific metacognitive representations suggests the presence of a content-rich mechanism available to introspection and cognitive control. (shrink)

The article suggests answers to the questions of how we can arrive at an unambiguous characterization of consciousness, whether conscious states are coextensive with subjective ones, and whether consciousness can be graded and multidimensional at the same time. As regards the first, it is argued that a general characterization of consciousness should be based on its four dimensions: i.e., the phenomenological, semantic, physiological and functional ones. With respect to the second, it is argued that all informational states of a given (...) organism are subjective, but not all are necessarily conscious. Finally, where the third question is concerned, in each of the four dimensions of consciousness a graded element is identified: quality of information in the phenomenological one, abstractness in the semantic one, complexity in the physiological one, and usefulness in the functional one. The article also considers certain consequences of the solutions proposed, as well as some practical applications of the 4D-view of consciousness. (shrink)

Research suggests that metacognitive monitoring ability does not decline with age. For example, judgments-of-learning accuracy is roughly equivalent between younger and older adults. But few studies have asked whether younger and older adults’ metacognitive ability varies across different types of memory processes. The current study tested the relationship between memory and post-decision confidence ratings at the trial level on item and associative memory recognition tests. As predicted, younger and older adults had similarmetacognitive efficiency, when using meta-d’/d’, a measure derived from (...) Signal Detection Theory, despite a significant age effect favoring younger adults on memory performance. This result is consistent with previous work showing age-equivalent metacognitive efficiency in the memory domain. We also found that metacognitive efficiency was higher for associative memory than for item memory across age groups, even though associative and item recognition memory were statistically equivalent. Higher accuracy on post-test decision confidence ratings for associative recognition relative to item recognition on resolution accuracy itself and when corrected for performance differences are novel findings. Implications for associative metacognition are discussed. (shrink)

By definition, metacognitive processes may monitor or regulate various stages of first-order processing. By combining causal analysis with hypotheses expressed by other authors we derive the theoretical and methodological consequences of this special relation between metacognition and the underlying processes. In particular, we prove that because multiple processing stages may be monitored or regulated and because metacognition may form latent feedback loops, (1) without strong additional causal assumptions, typical measures of metacognitive monitoring or regulation are confounded; (2) without strong additional (...) causal assumptions, typical methods of controlling for first-order task performance (i.e., calibration, staircase, including first-order task performance in a regression analysis, or analyzing correct and incorrect trials separately) not only do not deconfound measures of metacognition but may even introduce bias; (3) that the first two problems cannot be solved by using simple models of decision-making derived from Signal Detection Theory. We conclude the paper by advocating robust methods of discovering properties of latent mechanisms. (shrink)

One of the most prominent social influences on human decision making is conformity, which is even more prominent when the perceptual information is ambiguous. The Bayes optimal solution to this problem entails weighting the relative reliability of cognitive information and perceptual signals in constructing the percept from self‐sourced/endogenous and social sources, respectively. The current study investigated whether humans integrate the statistics (i.e., mean and variance) of endogenous perceptual and social information in a Bayes optimal way while estimating numerosities. Our results (...) demonstrated adjustment of initial estimations toward group means only when group estimations were more reliable (or “certain”), compared to participants’ endogenous metric uncertainty. Our results support Bayes optimal social conformity while also pointing to an implicit form of metacognition. (shrink)

In prior research, signal detection theory has been widely utilized to assess metacognitive ability. However, the SDT metacognitive model requires the use of a two-alternative forced-choice task, while confidence must also be measured discretely. In our model, participants’ cognitive ability and their confidence in the cognitive task were used to estimate their metacognitive abilities. Therefore, in this study, a metacognitive model that can be applied to various cognitive tasks was developed. This model implements the item response theory and Q-learning models (...) to estimate cognitive ability; participants’ metacognitive ability is defined as the discrepancy between their confidence in their cognitive ability and their actual cognitive ability. The entire procedure was divided into two experiments. In experiment 1, two different cognitive tasks were used to estimate metacognitive ability and to examine overall discriminative and convergent validity. Notably, the parameters representing metacognitive ability did not correlate with cognitive ability but were positively correlated between the two tasks. In experiment 2, we performed a similar analysis using a different task to test the replicability of experiment 1. The results for experiment 2 were replicated for discriminative and convergent validity, albeit with weak results. Our metacognitive model exhibited high interpretability and versatility. (shrink)