Many policies and ethical guidelines recommend developing “trustworthy AI”. We argue that developing morally trustworthy AI is not only unethical, as it promotes trust in an entity that cannot be trustworthy, but it is also unnecessary for optimal calibration. Instead, we show that reliability, exclusive of moral trust, entails the appropriate normative constraints that enable optimal calibration and mitigate the vulnerability that arises in high-stakes hybrid decision-making environments, without also demanding, as moral trust would, the anthropomorphization of AI and thus (...) epistemically dubious behavior. The normative demands of reliability for inter-agential action are argued to be met by an analogue to procedural metacognitive competence (i.e., the ability to evaluate the quality of one’s own informational states to regulate subsequent action). Drawing on recent empirical findings that suggest providing reliability scores (e.g., F1-scores) to human decision-makers improves calibration in the AI system, we argue that reliability scores provide a good index of competence and enable humans to determine how much they wish to rely on the system. (shrink)

Background Neuroimaging and lesion studies suggested that the dorsolateral prefrontal and posterior parietal cortices mediate visual metacognitive awareness. The causal evidence provided by non-invasive brain stimulation, however, is inconsistent. -/- Objective/hypothesis Here we revisit a major figure discrimination experiment adding a new Kanizsa figure task trying to resolve whether bilateral continuous theta-burst transcranial magnetic stimulation (cTBS) over these regions affects perceptual metacognition. Specifically, we tested whether subjective visibility ratings and/or metacognitive efficiency are lower when cTBS is applied to these two (...) regions in comparison to an active control region. -/- Methods A within-subjects design including three sessions spaced by one-week intervals was implemented. In each session, every participant was administered bilateral cTBS to either prefrontal, control or parietal cortices. Two concurrent tasks were performed, a real and an illusory figure task, stabilising objective performance with use of an adaptive staircase procedure. -/- Results When performing the replicated task, cTBS was found insufficient to disrupt neither visibility ratings nor metacognitive efficiency. However, with use of Kanizsa style illusory figures, cTBS over the dorsolateral prefrontal, but not over the posterior parietal cortex, was observed to significantly diminish metacognitive efficiency. -/- Conclusion(s) Real and illusory figure tasks demonstrated different cTBS effects. A possible explanation is the involvement of the prefrontal cortex in the creation of expectations, which is necessary for efficient metacognition. Failure to replicate previous findings for the real figure task, however, cannot be said to support, conclusively, the notion that these brain regions have a causal role in metacognitive awareness. This inconsistent finding may result from certain limitations of our study, thereby suggesting the need for yet further investigation. (shrink)

Negative subjective reports such as “I didn’t see the stimulus” can be interpreted as indicating either that the subject didn’t see the stimulus, or as indicating that, while the subject did see the stimulus, the strength of sensory signals associated with the stimulus fell below a conservative criterion for answering “seen”. Determining which of these two interpretations is correct is the criterion problem. I present two ways in which researchers can solve this problem. But there’s more. What I call the (...) “new criterion problem” consists in determining whether criteria effects reflect perceptual changes, or changes in response strategy. Through case studies, I argue that this new version of the problem can be solved as well, although there is currently no systematic way to solve it. I conclude that criterion problems do not constitute good reasons for skepticism about the scientific study of consciousness. (shrink)

Metacognitive mental states are mental states about mental states. For example, I may be uncertain whether my belief is correct. In social discourse, an interlocutor’s metacognitive certainty may constitute evidence about the reliability of their testimony. For example, if a speaker is certain that their belief is correct, then we may take this as evidence in favour of their belief, or its content. This paper argues that, if metacognitive certainty is genuine evidence, then it is disproportionate evidence for extreme beliefs. (...) In support of the argument, we report findings from five studies with different participant samples, designs, and measures. These studies show that, the more extreme an agent’s belief (positive or negative), the more certain they are about it, and vice versa. This relationship might contribute to moralism, virtue signalling, and polarisation, which in turn may be epistemically and morally problematic. Therefore, we caution against taking metacognitive certainty as genuine evidence. (shrink)

To study consciousness, scientists need to determine when participants are conscious and when they are not. They do so with consciousness detection procedures. A recurring skeptical argument against those procedures is that they cannot be calibrated: there is no way to make sure that detection outcomes are accurate. In this article, I address two main skeptical arguments purporting to show that consciousness scientists cannot calibrate detection procedures. I conclude that there is nothing wrong with calibration in consciousness science.

Consciousness and confidence seem intimately related. Accordingly, some researchers use confidence ratings as a measure of, or proxy for, consciousness. Rosenthal discusses the potential connections between the two, and rejects confidence as a valid measure of consciousness. He argues that there are better alternatives to get at conscious experiences such as direct subjective reports of awareness (i.e. subjects’ reports of perceiving something or of the degree of visibility of a stimulus). In this chapter, we offer a different perspective. Confidence ratings (...) in general, and metacognitive measures in particular, may offer important advantages over subjective ratings. The arguments we offer here are supported by empirical, practical and socio-strategic considerations. However, we do not suggest consciousness and confidence are interchangeable. We recognize the limitations of confidence ratings in some experimental designs and for some research questions. Nevertheless, we also address a potential conceptual link between consciousness and confidence that stems from Rosenthal’s very own work on mental quality space theory. (shrink)

Metacognition is the capacity to evaluate the success of one's own cognitive processes in various domains; for example, memory and perception. It remains controversial whether metacognition relies on a domain-general resource that is applied to different tasks or if self-evaluative processes are domain specific. Here, we investigated this issue directly by examining the neural substrates engaged when metacognitive judgments were made by human participants of both sexes during perceptual and memory tasks matched for stimulus and performance characteristics. By comparing patterns (...) of fMRI activity while subjects evaluated their performance, we revealed both domain-specific and domain-general metacognitive representations. Multivoxel activity patterns in anterior prefrontal cortex predicted levels of confidence in a domain-specific fashion, whereas domain-general signals predicting confidence and accuracy were found in a widespread network in the frontal and posterior midline. The demonstration of domain-specific metacognitive representations suggests the presence of a content-rich mechanism available to introspection and cognitive control. (shrink)

Critics have often misunderstood the higher-order theory (HOT) of consciousness. Here we clarify its position on several issues, and distinguish it from other views such as the global The higher-order theory (HOT) of consciousness has often been misunderstood by critics. Here we clarify its position on several issues, and distinguish it from other views such as the global workspace theory (GWT) and early sensory models (e.g. first-order local recurrency theories). For example, HOT has been criticized for over-intellectualizing consciousness. We show (...) that while higher-order states are cognitively assembled, the requirements are actually considerably less than often presumed. In this sense HOT may be viewed as an intermediate position between GWT and early sensory views. Also, we clarify that most proponents of HOT do not stipulate consciousness as equivalent to metacognition or confidence. Further, compared to other existing theories, HOT can arguably account better for complex everyday experiences, such as of emotions and episodic memories. This makes HOT particularly useful as a framework for conceptualizing pathological mental states. (shrink)

This chapter discusses the main types of so-called ’subjective measures of consciousness’ used in current-day science of consciousness. After explaining the key worry about such measures, namely the problem of an ever-present response bias, I discuss the question of whether subjective measures of consciousness are introspective. I show that there is no clear answer to this question, as proponents of subjective measures do not employ a worked-out notion of subjective access. In turn, this makes the problem of response bias less (...) tractable than it might otherwise be. (shrink)

We often effortlessly take the perceptual perspective of others: we represent some aspect of the environment that others currently perceive. However, taking someone's perspective can interfere with one's perceptual processing: another person's gaze can spontaneously affect our ability to detect stimuli in a scene. But it is still unclear whether our cognitive evaluation of those judgements is also affected. In this study, we investigated whether social perspective-taking can influence participants' metacognitive judgements about their perceptual responses. Participants performed a contrast detection (...) task with a task-irrelevant avatar oriented either congruently or incongruently to the stimulus location. By “blindfolding” the avatar, we tested the influence of social perspective-taking versus domain-general directional orienting. Participants had higher accuracy and perceptual sensitivity with a congruent avatar regardless of the blindfold, suggesting a directional cueing effect. However, their metacognitive efficiency was modulated only by the congruency of a seeing avatar. These results suggest that perceptual metacognitive ability can be socially enhanced by sharing perception of the same objects with others. (shrink)

One of the most prominent social influences on human decision making is conformity, which is even more prominent when the perceptual information is ambiguous. The Bayes optimal solution to this problem entails weighting the relative reliability of cognitive information and perceptual signals in constructing the percept from self‐sourced/endogenous and social sources, respectively. The current study investigated whether humans integrate the statistics (i.e., mean and variance) of endogenous perceptual and social information in a Bayes optimal way while estimating numerosities. Our results (...) demonstrated adjustment of initial estimations toward group means only when group estimations were more reliable (or “certain”), compared to participants’ endogenous metric uncertainty. Our results support Bayes optimal social conformity while also pointing to an implicit form of metacognition. (shrink)

The article suggests answers to the questions of how we can arrive at an unambiguous characterization of consciousness, whether conscious states are coextensive with subjective ones, and whether consciousness can be graded and multidimensional at the same time. As regards the first, it is argued that a general characterization of consciousness should be based on its four dimensions: i.e., the phenomenological, semantic, physiological and functional ones. With respect to the second, it is argued that all informational states of a given (...) organism are subjective, but not all are necessarily conscious. Finally, where the third question is concerned, in each of the four dimensions of consciousness a graded element is identified: quality of information in the phenomenological one, abstractness in the semantic one, complexity in the physiological one, and usefulness in the functional one. The article also considers certain consequences of the solutions proposed, as well as some practical applications of the 4D-view of consciousness. (shrink)

Metacognition, the cognition about cognition, is closely linked to intelligence and therefore understanding the metacognitive processes underlying intelligence test performance, specifically on Raven’s Progressive Matrices, could help advance the knowledge about intelligence. The measurement of metacognition, is often done using domain-general offline questionnaires or domain-specific online think-aloud protocols. This study aimed to investigate the relationship between metacognitive awareness and intelligence via the design and use of a novel Meta-Cognitive Awareness Scale – Domain Specific that encourages reflection of task strategy processes. (...) This domain-specific scale was first constructed to measure participants’ awareness of their own metacognition linked to Raven’s Progressive Matrices. Following discriminatory index and Exploratory Factor Analysis, a 15-item scale was derived. Exploratory Factor Analysis showed five factors: Awareness of Engagement in Self-Monitoring, Awareness of Own Ability, Awareness of Responding Speed/Time, Awareness of Alternative Solutions and Awareness of Requisite Problem-Solving Resources. The intelligence level of ninety-eight adults was then estimated using Raven’s Standard Progressive Matrices. Participants also completed the MCAS-DS, and further items that examined their test-taking behavior and Confidence level. Metacognitive awareness was positively correlated to standardized IQ scores derived from the SPM whilst Over-Confidence derived using the Confidence level measure was negatively correlated to SPM. Despite some limitations, this study shows promise for elucidating the relationship between metacognitive awareness and intelligence using the task-specific scale. (shrink)

To study consciousness, scientists need to determine when participants are conscious and when they are not. They do so with consciousness detection procedures. A recurring skeptical argument against those procedures is that they cannot be calibrated: there is no way to make sure that detection outcomes are accurate. In this article, I address two main skeptical arguments purporting to show that consciousness scientists cannot calibrate detection procedures. I conclude that there is nothing wrong with calibration in consciousness science.

People are often inaccurate in their predictions of performance on a variety of cognitive tasks. We tested whether receptivity to bullshit – the tendency to perceive meaningless statements as profound – would relate to the accuracy of metacognitive judgments on several problem-solving tasks. Individuals who were highly receptive to bullshit were less accurate in their predictions of performance on creative problem-solving tasks, but not on verbal analogy or recall tasks. Further, individuals with high BS receptivity were less able to discriminate (...) between solvable and unsolvable problems when making metacognitive judgments. These findings support the possibility that the tendency to perceive semantic connections where none exist, as indicated by high bullshit receptivity, may lead to inaccurate predictions of performance on tasks that require noticing and utilizing distant semantic connections. (shrink)

The present work is concerned with a phenomenon referred to as contextual cueing. In visual search, if a searched-for target object is consistently encountered within a stable spatial arrangement of distractor objects, detecting the target becomes more efficient over time, relative to non-repeated, random arrangements. This effect is attributed to learned target-distractor spatial associations stored in long-term memory, which expedite visual search. This Thesis investigates four aspects of contextual cueing: Study 1 tackled the implicit-explicit debate of contextual cueing from a (...) new perspective. Previous studies tested explicit access to learned displays by applying a recognition test, asking observers whether they have seen a given display in the previous search task. These tests, however, typically yield mixed findings and there is an on-going controversy whether contextual cueing can be described as an implicit or an explicit effect. The current study applied the new perspective of metacognition to contextual cueing and combined a contextual cueing task with metacognitive ratings about the clarity of the visual experience, either of the display configuration or the target stimulus. Bayesian analysis revealed that there was an effect of repeated context on metacognitive sensitivity for configuration, but not target, ratings. It was concluded that effects of contextual memory on metacognition are content-specific and lead to increased metacognitive access to the display configuration, but not to the target stimulus. The more general implication is that from the perspective of metacognition, contextual cueing can be considered as an explicit effect. Study 2 aimed at testing how explicit knowledge affects memory-guided visual search. Two sets of search displays were shown to participants: explicit and implicit displays. Explicit displays were introduced prior to the search experiment, in a dedicated learning session, and observers should deliberately learn these displays. Implicit displays, on the other hand, were first shown in the search experiment and learning was incidental through repeated exposure to these displays. Contextual cueing arising from explicit and implicit displays was assessed relative to a baseline condition of non-repeated displays. The results showed a standard contextual cueing effect for explicit displays and, interestingly, a negative cueing effect for implicit displays. Recognition performance was above chance for both types of repeated displays; however, it was higher for explicit displays. This pattern of results confirmed – in part – the predictions of a single memory model of attention-moderated associative learning, in which different display types compete for behavior and explicit representations block the retrieval of implicit representations. Study 3 investigates interactions between long-term contextual memory with short-term perceptual hypotheses. Both types of perceptual memory share high similarities with respect to their content, therefore the hypothesis was formulated that they share a common memory resource. In three experiments of interrupted search with repeated and non-repeated displays, it was shown that contextual cueing expedites performance in interrupted search; however, there was no interaction of contextual cueing with the generation or the confirmation of perceptual hypotheses. Rather, the analysis of fixational eye movements showed that long-term memory exerts its influence on search performance upon the first glance of a given display, essentially affecting the starting point of the search process. The behavior of approaching the target stimulus is then a product of generating and confirming perceptual hypotheses with these processes being unaffected by long-term contextual memory. It was concluded that long-term and short-term memory representations of the same search display are independent and exhibit additive effects on search performance. Study 4 is concerned with the effects of reward on perceptual learning. It was argued that rewarding repeated displays in a contextual cueing paradigm leads to an acceleration of the learning effect; however, it was not considered whether reward also has an effect in non-repeated displays. In these displays, at least the target position is kept constant while distractor configurations are random across repetitions. Usually this is done in order to account for target position-specific probability learning in contextual cueing. However, it is possible that probability learning itself is modulated by reward. The current experiment introduced high or low reward to repeated and importantly, also non-repeated displays. It was shown that reward had a huge effect on non-repeated displays, indicating that rewarding certain target positions, irrespective of the distractor layout, facilitates RT performance. Interestingly, reward effects were even larger for non-repeated compared to repeated displays. It was concluded that reward has a strong effect on probability-, and not context learning. (shrink)

Despite various studies examining intertemporal choice with hypothetical rewards due to problematic real reward delivery, there remains no substantial evidence on the effect of the incentives on the decision confidence and cognitive process in intertemporal choice and no comprehensive exploration on the loss domain. Hence, this study conducts an eye-tracking experiment to examine the effect of incentive approach and measure participants' decision confidence using a between-subject design in both gain and loss domains. Results replicated previous findings which show incentives do (...) not affect intertemporal choice in the gain domain. In contrast, in the loss domain, participants in the incentivized group were more likely to choose the larger-later options than those in the non-incentivized group. Furthermore, the decision confidence and the mean fixation duration differed between the incentivized and non-incentivized groups in both gain and loss domains. These findings allow for a better understanding of the effect of incentives on intertemporal choice and provide valuable information for the design of incentives in future intertemporal experiments. (shrink)

The mainstream science of consciousness offers a few predominate views of how the brain gives rise to awareness. Chief among these are the Higher-Order Thought Theory, Global Neuronal Workspace Theory, Integrated Information Theory, and hybrids thereof. In parallel, rapid development in predictive processing approaches have begun to outline concrete mechanisms by which interoceptive inference shapes selfhood, affect, and exteroceptive perception. Here, we consider these new approaches in terms of what they might offer our empirical, phenomenological, and philosophical understanding of consciousness (...) and its neurobiological roots. (shrink)

By definition, metacognitive processes may monitor or regulate various stages of first-order processing. By combining causal analysis with hypotheses expressed by other authors we derive the theoretical and methodological consequences of this special relation between metacognition and the underlying processes. In particular, we prove that because multiple processing stages may be monitored or regulated and because metacognition may form latent feedback loops, (1) without strong additional causal assumptions, typical measures of metacognitive monitoring or regulation are confounded; (2) without strong additional (...) causal assumptions, typical methods of controlling for first-order task performance (i.e., calibration, staircase, including first-order task performance in a regression analysis, or analyzing correct and incorrect trials separately) not only do not deconfound measures of metacognition but may even introduce bias; (3) that the first two problems cannot be solved by using simple models of decision-making derived from Signal Detection Theory. We conclude the paper by advocating robust methods of discovering properties of latent mechanisms. (shrink)