Many policies and ethical guidelines recommend developing “trustworthy AI”. We argue that developing morally trustworthy AI is not only unethical, as it promotes trust in an entity that cannot be trustworthy, but it is also unnecessary for optimal calibration. Instead, we show that reliability, exclusive of moral trust, entails the appropriate normative constraints that enable optimal calibration and mitigate the vulnerability that arises in high-stakes hybrid decision-making environments, without also demanding, as moral trust would, the anthropomorphization of AI and thus (...) epistemically dubious behavior. The normative demands of reliability for inter-agential action are argued to be met by an analogue to procedural metacognitive competence (i.e., the ability to evaluate the quality of one’s own informational states to regulate subsequent action). Drawing on recent empirical findings that suggest providing reliability scores (e.g., F1-scores) to human decision-makers improves calibration in the AI system, we argue that reliability scores provide a good index of competence and enable humans to determine how much they wish to rely on the system. (shrink)

Procedural metacognition is the set of affect-based mechanisms allowing agents to regulate cognitive actions like perceptual discrimination, memory retrieval or problem solving. This article proposes that procedural metacognition has had a major role in the evolution of communication. A plausible hypothesis is that, under pressure for maximizing signalling efficiency, the metacognitive abilities used by nonhumans to regulate their perception and their memory have been re-used to regulate their communication. On this view, detecting one’s production errors in signalling, or solving species-specific (...) trade-offs between informativeness, processing effort, clarity, or urgency depend on a form of procedural metacognition, called “metacommunication”. How does this view relate to Gricean theories of human communication? A parallel between procedural trade-offs and conversational maxims is discussed for its evolutionary implications. Rather than accepting radically discontinuist interpretations, in which mindreading operates a full reorganization of pragmatics, it is proposed that procedural forms of regulation are entrenched in all forms of human communication. According to contextual demands, humans adopt and monitor more or less demanding informational goals, such as factual updating, clarifying, explaining, proving, and reaching consensus in collective matters. Under time pressure, only part of these goals require adopting others’ viewpoint. Efficiency in collective decision-making, in particular, might have been considerably raised by an ability to interpret others’ intentions and motivations. (shrink)

Procedural metacognition is the set of affect-based mechanisms allowing agents to regulate cognitive actions like perceptual discrimination, memory retrieval or problem solving. This article proposes that procedural metacognition has had a major role in the evolution of communication. A plausible hypothesis is that, under pressure for maximizing signalling efficiency, the metacognitive abilities used by nonhumans to regulate their perception and their memory have been re-used to regulate their communication. On this view, detecting one’s production errors in signalling, or solving species-specific (...) trade-offs between informativeness, processing effort, clarity, or urgency depend on a form of procedural metacognition, called “metacommunication”. How does this view relate to Gricean theories of human communication? A parallel between procedural trade-offs and conversational maxims is discussed for its evolutionary implications. Rather than accepting radically discontinuist interpretations, in which mindreading operates a full reorganization of pragmatics, it is proposed that procedural forms of regulation are entrenched in all forms of human communication. According to contextual demands, humans adopt and monitor more or less demanding informational goals, such as factual updating, clarifying, explaining, proving, and reaching consensus in collective matters. Under time pressure, only part of these goals require adopting others’ viewpoint. Efficiency in collective decision-making, in particular, might have been considerably raised by an ability to interpret others’ intentions and motivations. (shrink)

Perceiving an armchair prepares us to sit. Reading the first line in a text prepares us to read it. This article proposes that the affordance construct used to explain reactive potentiation of behavior similarly applies to reactive potentiation of cognitive actions. It defends furthermore that, in both cases, affordance-sensings do not only apply to selective (dis)engagement, but also to the revision and the termination of actions. In the first section, characteristics of environmental affordance-sensings such as directness, stability, action potentiation, valence, (...) and phenomenology are reexamined in light of contemporary cognitive science. In the second section, it is proposed that cognitive affordance-sensings can also be characterized along these dimensions. Called “metacognitive feelings” in the metacognitive literature, their function is to select, engage, revise and post-evaluate cognitive actions. A third section discusses alternative views, and responds to objections. (shrink)

Previous research suggests that curiosity is sometimes induced by novel information one has no relevant knowledge about, but it is sometimes induced by new information about something that one is familiar with and has prior knowledge about. However, the conditions under which novelty or familiarity triggers curiosity remain unclear. Using metacognitive confidence judgments as a proxy to quantify the amount of knowledge, this study evaluates the relationship between the amount of relevant knowledge and curiosity. We reviewed previous studies on the (...) relationship between subjective curiosity and confidence and reanalyzed existing large‐sample data. The findings indicate that the relationship between curiosity and confidence differs depending on the nature of the stimuli: epistemic versus perceptual. Regarding perceptual stimuli, curiosity is stronger when individuals have lower confidence levels. By contrast, for epistemic stimuli, curiosity is stronger when individuals have higher confidence levels. These results suggest that curiosity triggered by perceptual stimuli is based on perceived novelty, whereas that triggered by epistemic stimuli is based on familiarity with prior knowledge. (shrink)