To study consciousness, scientists need to determine when participants are conscious and when they are not. They do so with consciousness detection procedures. A recurring skeptical argument against those procedures is that they cannot be calibrated: there is no way to make sure that detection outcomes are accurate. In this article, I address two main skeptical arguments purporting to show that consciousness scientists cannot calibrate detection procedures. I conclude that there is nothing wrong with calibration in consciousness science.

One of the most prominent social influences on human decision making is conformity, which is even more prominent when the perceptual information is ambiguous. The Bayes optimal solution to this problem entails weighting the relative reliability of cognitive information and perceptual signals in constructing the percept from self‐sourced/endogenous and social sources, respectively. The current study investigated whether humans integrate the statistics (i.e., mean and variance) of endogenous perceptual and social information in a Bayes optimal way while estimating numerosities. Our results (...) demonstrated adjustment of initial estimations toward group means only when group estimations were more reliable (or “certain”), compared to participants’ endogenous metric uncertainty. Our results support Bayes optimal social conformity while also pointing to an implicit form of metacognition. (shrink)

Critics have often misunderstood the higher-order theory (HOT) of consciousness. Here we clarify its position on several issues, and distinguish it from other views such as the global The higher-order theory (HOT) of consciousness has often been misunderstood by critics. Here we clarify its position on several issues, and distinguish it from other views such as the global workspace theory (GWT) and early sensory models (e.g. first-order local recurrency theories). For example, HOT has been criticized for over-intellectualizing consciousness. We show (...) that while higher-order states are cognitively assembled, the requirements are actually considerably less than often presumed. In this sense HOT may be viewed as an intermediate position between GWT and early sensory views. Also, we clarify that most proponents of HOT do not stipulate consciousness as equivalent to metacognition or confidence. Further, compared to other existing theories, HOT can arguably account better for complex everyday experiences, such as of emotions and episodic memories. This makes HOT particularly useful as a framework for conceptualizing pathological mental states. (shrink)

Metacognitive ability has been described as an important predictor of several processes involved in learning, including problem-solving. Although this relationship is fairly documented, little is known about the mechanisms that could modulate it. Given its relationship with both constructs, we decided to evaluate the impact of self-knowledge on PS. In addition, we inspected whether emotional and interpersonal variables could affect the relationship between metacognition and problem-solving. We tested a sample of 32 undergraduate students and used behavioural tasks and self-report questionnaires. (...) Contrary to the literature, we found no significant relationship between metacognition and problem-solving performance, nor a significant moderating effect when including emotional and interpersonal variables in the model. In contrast, we observed a significant moderating model combining metacognition, self-reported anxiety and attitudes towards social interdependence. It was found that participants with high metacognition reported attitudes unfavourable towards interdependence when they felt high anxiety. These results suggest that already anxious individuals with high metacognition would prefer to work alone rather than with others, as a coping mechanism against further anxiety derived from cooperation. We hypothesise that in anxiogenic contexts, metacognition is used as a tool to compare possible threats with one’s own skills and act accordingly, in order to maximise one’s own performance. Further studies are needed to understand how metacognition works in contexts adverse to learning. (shrink)

Negative subjective reports such as “I didn’t see the stimulus” can be interpreted as indicating either that the subject didn’t see the stimulus, or as indicating that, while the subject did see the stimulus, the strength of sensory signals associated with the stimulus fell below a conservative criterion for answering “seen”. Determining which of these two interpretations is correct is the criterion problem. I present two ways in which researchers can solve this problem. But there’s more. What I call the (...) “new criterion problem” consists in determining whether criteria effects reflect perceptual changes, or changes in response strategy. Through case studies, I argue that this new version of the problem can be solved as well, although there is currently no systematic way to solve it. I conclude that criterion problems do not constitute good reasons for skepticism about the scientific study of consciousness. (shrink)

Consciousness and confidence seem intimately related. Accordingly, some researchers use confidence ratings as a measure of, or proxy for, consciousness. Rosenthal discusses the potential connections between the two, and rejects confidence as a valid measure of consciousness. He argues that there are better alternatives to get at conscious experiences such as direct subjective reports of awareness (i.e. subjects’ reports of perceiving something or of the degree of visibility of a stimulus). In this chapter, we offer a different perspective. Confidence ratings (...) in general, and metacognitive measures in particular, may offer important advantages over subjective ratings. The arguments we offer here are supported by empirical, practical and socio-strategic considerations. However, we do not suggest consciousness and confidence are interchangeable. We recognize the limitations of confidence ratings in some experimental designs and for some research questions. Nevertheless, we also address a potential conceptual link between consciousness and confidence that stems from Rosenthal’s very own work on mental quality space theory. (shrink)

This chapter discusses the main types of so-called ’subjective measures of consciousness’ used in current-day science of consciousness. After explaining the key worry about such measures, namely the problem of an ever-present response bias, I discuss the question of whether subjective measures of consciousness are introspective. I show that there is no clear answer to this question, as proponents of subjective measures do not employ a worked-out notion of subjective access. In turn, this makes the problem of response bias less (...) tractable than it might otherwise be. (shrink)

Research suggests that metacognitive monitoring ability does not decline with age. For example, judgments-of-learning accuracy is roughly equivalent between younger and older adults. But few studies have asked whether younger and older adults’ metacognitive ability varies across different types of memory processes. The current study tested the relationship between memory and post-decision confidence ratings at the trial level on item and associative memory recognition tests. As predicted, younger and older adults had similarmetacognitive efficiency, when using meta-d’/d’, a measure derived from (...) Signal Detection Theory, despite a significant age effect favoring younger adults on memory performance. This result is consistent with previous work showing age-equivalent metacognitive efficiency in the memory domain. We also found that metacognitive efficiency was higher for associative memory than for item memory across age groups, even though associative and item recognition memory were statistically equivalent. Higher accuracy on post-test decision confidence ratings for associative recognition relative to item recognition on resolution accuracy itself and when corrected for performance differences are novel findings. Implications for associative metacognition are discussed. (shrink)

Despite various studies examining intertemporal choice with hypothetical rewards due to problematic real reward delivery, there remains no substantial evidence on the effect of the incentives on the decision confidence and cognitive process in intertemporal choice and no comprehensive exploration on the loss domain. Hence, this study conducts an eye-tracking experiment to examine the effect of incentive approach and measure participants' decision confidence using a between-subject design in both gain and loss domains. Results replicated previous findings which show incentives do (...) not affect intertemporal choice in the gain domain. In contrast, in the loss domain, participants in the incentivized group were more likely to choose the larger-later options than those in the non-incentivized group. Furthermore, the decision confidence and the mean fixation duration differed between the incentivized and non-incentivized groups in both gain and loss domains. These findings allow for a better understanding of the effect of incentives on intertemporal choice and provide valuable information for the design of incentives in future intertemporal experiments. (shrink)

This paper reports the first empirical investigation of the hypothesis that epistemic appraisals form part of the structure of concepts. To date, studies of concepts have focused on the way concepts encode properties of objects and the way those features are used in categorization and in other cognitive tasks. Philosophical considerations show the importance of also considering how a thinker assesses the epistemic value of beliefs and other cognitive resources and, in particular, concepts. We demonstrate that there are multiple, reliably (...) judged, dimensions of epistemic appraisal of concepts. Four of these dimensions are accounted for by a common underlying factor capturing how well people believe they understand a concept. Further studies show how dimensions of concept appraisal relate to other aspects of concepts. First, they relate directly to the hierarchical organization of concepts, reflecting the increase in specificity from superordinate to basic and subordinate levels. Second, they predict inductive choices in category-based induction. Our results suggest that epistemic appraisals of concepts form a psychologically important yet previously overlooked aspect of the structure of concepts. These findings will be important in understanding why individuals sometimes abandon and replace certain concepts; why social groups do so, for example, during a “scientific revolution”; and how we can facilitate such changes when we engage in deliberate “conceptual engineering” for epistemic, social, and political purposes. (shrink)

Metacognition, the cognition about cognition, is closely linked to intelligence and therefore understanding the metacognitive processes underlying intelligence test performance, specifically on Raven’s Progressive Matrices, could help advance the knowledge about intelligence. The measurement of metacognition, is often done using domain-general offline questionnaires or domain-specific online think-aloud protocols. This study aimed to investigate the relationship between metacognitive awareness and intelligence via the design and use of a novel Meta-Cognitive Awareness Scale – Domain Specific that encourages reflection of task strategy processes. (...) This domain-specific scale was first constructed to measure participants’ awareness of their own metacognition linked to Raven’s Progressive Matrices. Following discriminatory index and Exploratory Factor Analysis, a 15-item scale was derived. Exploratory Factor Analysis showed five factors: Awareness of Engagement in Self-Monitoring, Awareness of Own Ability, Awareness of Responding Speed/Time, Awareness of Alternative Solutions and Awareness of Requisite Problem-Solving Resources. The intelligence level of ninety-eight adults was then estimated using Raven’s Standard Progressive Matrices. Participants also completed the MCAS-DS, and further items that examined their test-taking behavior and Confidence level. Metacognitive awareness was positively correlated to standardized IQ scores derived from the SPM whilst Over-Confidence derived using the Confidence level measure was negatively correlated to SPM. Despite some limitations, this study shows promise for elucidating the relationship between metacognitive awareness and intelligence using the task-specific scale. (shrink)

In prior research, signal detection theory has been widely utilized to assess metacognitive ability. However, the SDT metacognitive model requires the use of a two-alternative forced-choice task, while confidence must also be measured discretely. In our model, participants’ cognitive ability and their confidence in the cognitive task were used to estimate their metacognitive abilities. Therefore, in this study, a metacognitive model that can be applied to various cognitive tasks was developed. This model implements the item response theory and Q-learning models (...) to estimate cognitive ability; participants’ metacognitive ability is defined as the discrepancy between their confidence in their cognitive ability and their actual cognitive ability. The entire procedure was divided into two experiments. In experiment 1, two different cognitive tasks were used to estimate metacognitive ability and to examine overall discriminative and convergent validity. Notably, the parameters representing metacognitive ability did not correlate with cognitive ability but were positively correlated between the two tasks. In experiment 2, we performed a similar analysis using a different task to test the replicability of experiment 1. The results for experiment 2 were replicated for discriminative and convergent validity, albeit with weak results. Our metacognitive model exhibited high interpretability and versatility. (shrink)

By definition, metacognitive processes may monitor or regulate various stages of first-order processing. By combining causal analysis with hypotheses expressed by other authors we derive the theoretical and methodological consequences of this special relation between metacognition and the underlying processes. In particular, we prove that because multiple processing stages may be monitored or regulated and because metacognition may form latent feedback loops, 1) without strong additional causal assumptions, typical measures of metacognitive monitoring or regulation are confounded; 2) without strong additional (...) causal assumptions, typical methods of controlling for first-order task performance (i.e., calibration, staircase, including first-order task performance in a regression analysis, or analyzing correct and incorrect trials separately) not only do not deconfound measures of metacognition but may even introduce bias; 3) that the first two problems cannot be solved by using simple models of decision-making derived from Signal Detection Theory. We conclude the paper by advocating robust methods of discovering properties of latent mechanisms. (shrink)

In this article, we suggest that the study of social interactions and the development of a “sense of agency” in joint action can help determine the content of relevant explanations to be implemented in artificial systems to make them “explainable.” The introduction of automated systems, and more broadly of Artificial Intelligence, into many domains has profoundly changed the nature of human activity, as well as the subjective experience that agents have of their own actions and their consequences – an experience (...) that is commonly referred to as sense of agency. We propose to examine the empirical evidence supporting this impact of automation on individuals’ sense of agency, and hence on measures as diverse as operator performance, system explicability and acceptability. Because of some of its key characteristics, AI occupies a special status in the artificial systems landscape. We suggest that this status prompts us to reconsider human–AI interactions in the light of human–human relations. We approach the study of joint actions in human social interactions to deduce what key features are necessary for the development of a reliable sense of agency in a social context and suggest that such framework can help define what constitutes a good explanation. Finally, we propose possible directions to improve human–AI interactions and, in particular, to restore the sense of agency of human operators, improve their confidence in the decisions made by artificial agents, and increase the acceptability of such agents. (shrink)