No scientific conclusion follows automatically from a statistically non-significant result, yet people routinely use non-significant results to guide conclusions about the status of theories (or the effectiveness of practices). To know whether a non-significant result counts against a theory, or if it just indicates data insensitivity, researchers must use one of: power, intervals (such as confidence or credibility intervals), or else an indicator of the relative evidence for one theory over another, such as a Bayes factor. I argue Bayes factors (...) allow theory to be linked to data in a way that overcomes the weaknesses of the other approaches. Specifically, Bayes factors use the data themselves to determine their sensitivity in distinguishing theories (unlike power), and they make use of those aspects of a theory’s predictions that are often easiest to specify (unlike power and intervals, which require specifying the minimal interesting value in order to address theory). Bayes factors provide a coherent approach to determining whether non-significant results support a null hypothesis over a theory, or whether the data are just insensitive. They allow accepting and rejecting the null hypothesis to be put on an equal footing. Concrete examples are provided to indicate the range of application of a simple online Bayes calculator, which reveal both the strengths and weaknesses of Bayes factors. (shrink)

Studying consciousness requires contrasting conscious and unconscious perception. While many studies have reported unconscious perceptual effects, recent work has questioned whether such effects are genuinely unconscious, or whether they are due to weak conscious perception. Some philosophers and psychologists have reacted by denying that there is such a thing as unconscious perception, or by holding that unconscious perception has been previously overestimated. This article has two parts. In the first part, I argue that the most significant attack on unconscious perception (...) commits the criterion content fallacy: the fallacy of interpreting evidence that observers were conscious of something as evidence that they were conscious of the task-relevant features of the stimuli. In the second part, I contend that the criterion content fallacy is prevalent in consciousness research. For this reason, I hold that if unconscious perception exists, scientists studying consciousness could routinely underestimate it. I conclude with methodological recommendations for moving the debate forward. (shrink)

Block () highlights two experimental studies of neglect patients which, he contends, provide ‘dramatic evidence’ for unconscious seeing. In Block's hands this is the highly non-trivial thesis that seeing of the same fundamental kind as ordinary conscious seeing can occur outside of phenomenal consciousness. Block's case for it provides an excellent opportunity to consider a large body of research on clinical syndromes widely held to evidence unconscious perception. I begin by considering in detail the two studies of neglect to which (...) Block appeals. I show why their interpretation as evidence of unconscious seeing faces a series of local difficulties. I then explain how, even bracketing these issues, a long-standing but overlooked problem concerning our criterion for consciousness problematizes the appeal to both studies. I explain why this problem is especially pressing for Block given his view that phenomenal consciousness overflows access consciousness. I further show that it is epidemic—not only affecting all report-based studies of unconscious seeing in neglect, but also analogous studies of the condition most often alleged to show unconscious seeing, namely blindsight. (shrink)

Phillips argues that blindsight is due to response criterion artefacts under degraded conscious vision. His view provides alternative explanations for some studies, but may not work well when one considers several key findings in conjunction. Empirically, not all criterion effects are decidedly non-perceptual. Awareness is not completely abolished for some stimuli, in some patients. But in other cases, it was clearly impaired relative to the corresponding visual sensitivity. This relative dissociation is what makes blindsight so important and interesting.

Metacognition is the capacity to evaluate the success of one's own cognitive processes in various domains; for example, memory and perception. It remains controversial whether metacognition relies on a domain-general resource that is applied to different tasks or if self-evaluative processes are domain specific. Here, we investigated this issue directly by examining the neural substrates engaged when metacognitive judgments were made by human participants of both sexes during perceptual and memory tasks matched for stimulus and performance characteristics. By comparing patterns (...) of fMRI activity while subjects evaluated their performance, we revealed both domain-specific and domain-general metacognitive representations. Multivoxel activity patterns in anterior prefrontal cortex predicted levels of confidence in a domain-specific fashion, whereas domain-general signals predicting confidence and accuracy were found in a widespread network in the frontal and posterior midline. The demonstration of domain-specific metacognitive representations suggests the presence of a content-rich mechanism available to introspection and cognitive control. (shrink)

The introspective devices framework proposed by Kammerer and Frankish (this issue) offers an attractive conceptual tool for evaluating and developing accounts of introspection. However, the framework assumes that different views about the nature of introspection can be easily evaluated against a set of common criteria. In this paper, I set out to test this assumption by analysing two formal models of introspection using the introspective device framework. The question I aim to answer is not only whether models developed outside of (...) philosophy can be successfully evaluated against the set of conceptual criteria proposed by Kammerer and Frankish, but also whether this kind of evaluation can reveal some limitations inherent to the framework. (shrink)

To study consciousness, scientists need to determine when participants are conscious and when they are not. They do so with consciousness detection procedures. A recurring skeptical argument against those procedures is that they cannot be calibrated: there is no way to make sure that detection outcomes are accurate. In this article, I address two main skeptical arguments purporting to show that consciousness scientists cannot calibrate detection procedures. I conclude that there is nothing wrong with calibration in consciousness science.

Consciousness is now a hot topic in both philosophy and the cognitive sciences, yet there is much controversy over how to measure it. First, it is not clear whether biased subjective reports should be taken as adequate for measuring consciousness, or if more objective measures are required. Ways to benefit from the advantages of both these measures in the form of ‘Type 2’ metacognitive measures are under development, but face criticism. Research into neurophysiological measures of consciousness is potentially very valuable, (...) but often hindered by its dependence on behavioural measures that are themselves controversial. Newer informational measures are theoretically interesting, but as yet not easily applicable, while other measures of consciousness are designed for application in clinical cases . Although much optimism accompanies research into measures of consciousness, the controversies and methodological problems reviewed here suggest that making progress in this area may be more difficult than is often acknowledged. (shrink)

This paper argues for a position of ‘dark pessimism’ towards introspective reports playing a strong justificatory role in consciousness science, based on the application of frameworks and concepts of measurement. I first show that treating introspective reports as measurements fits well within current discussions of the reliability of introspection, and argue that introspective reports must satisfy at least a minimal definition of measurement in order to play a justificatory role in consciousness science. I then show how treating introspective reports as (...) measurements makes it possible to identify the foundational methodological problems that underlie much of the current philosophical and scientific debate about the status of introspective evidence in studying consciousness. I argue that these problems prevent introspective reports from playing a strong justificatory role and resolving long-standing debates in consciousness science, both in contemporary work and in the future. (shrink)

We often effortlessly take the perceptual perspective of others: we represent some aspect of the environment that others currently perceive. However, taking someone's perspective can interfere with one's perceptual processing: another person's gaze can spontaneously affect our ability to detect stimuli in a scene. But it is still unclear whether our cognitive evaluation of those judgements is also affected. In this study, we investigated whether social perspective-taking can influence participants' metacognitive judgements about their perceptual responses. Participants performed a contrast detection (...) task with a task-irrelevant avatar oriented either congruently or incongruently to the stimulus location. By “blindfolding” the avatar, we tested the influence of social perspective-taking versus domain-general directional orienting. Participants had higher accuracy and perceptual sensitivity with a congruent avatar regardless of the blindfold, suggesting a directional cueing effect. However, their metacognitive efficiency was modulated only by the congruency of a seeing avatar. These results suggest that perceptual metacognitive ability can be socially enhanced by sharing perception of the same objects with others. (shrink)

A series of five experiments investigated the extent of subliminal processing of negation. Participants were presented with a subliminal instruction to either pick or not pick an accompanying noun, followed by a choice of two nouns. By employing subjective measures to determine individual thresholds of subliminal priming, the results of these studies indicated that participants were able to identify the correct noun of the pair – even when the correct noun was specified by negation. Furthermore, using a grey-scale contrast method (...) of masking, Experiment 5 confirmed that these priming effects were evidenced in the absence of partial awareness, and without the effect being attributed to the retrieval of stimulus–response links established during conscious rehearsal. (shrink)

By definition, metacognitive processes may monitor or regulate various stages of first-order processing. By combining causal analysis with hypotheses expressed by other authors we derive the theoretical and methodological consequences of this special relation between metacognition and the underlying processes. In particular, we prove that because multiple processing stages may be monitored or regulated and because metacognition may form latent feedback loops, (1) without strong additional causal assumptions, typical measures of metacognitive monitoring or regulation are confounded; (2) without strong additional (...) causal assumptions, typical methods of controlling for first-order task performance (i.e., calibration, staircase, including first-order task performance in a regression analysis, or analyzing correct and incorrect trials separately) not only do not deconfound measures of metacognition but may even introduce bias; (3) that the first two problems cannot be solved by using simple models of decision-making derived from Signal Detection Theory. We conclude the paper by advocating robust methods of discovering properties of latent mechanisms. (shrink)

Neuroscientists have located brain activity that prepares or encodes action plans before agents are aware of intending to act. On the basis of these findings and broader agency research, activity in these regions has been proposed as the neural realizers of practical intention. My aim in this paper is to evaluate the case for taking these neural states to be neural representations of intention. I draw on work in philosophy of action on the role and nature of practical intentions to (...) construct a framework of the functional profile of intentions fit for empirical investigation. With this framework, I turn to the broader empirical neuroscience literature on agency to assess these proposed neural representations of intention. I argue that while these neural states in some respects satisfy the functions of intention in planning agency prospective of action, their fit with the role of intention in action execution is not well supported. I close by offering a sketch of which experimental task features could aid in the search for the neural realizer of intention in action. (shrink)

Negative subjective reports such as “I didn’t see the stimulus” can be interpreted as indicating either that the subject didn’t see the stimulus, or as indicating that, while the subject did see the stimulus, the strength of sensory signals associated with the stimulus fell below a conservative criterion for answering “seen”. Determining which of these two interpretations is correct is the criterion problem. I present two ways in which researchers can solve this problem. But there’s more. What I call the (...) “new criterion problem” consists in determining whether criteria effects reflect perceptual changes, or changes in response strategy. Through case studies, I argue that this new version of the problem can be solved as well, although there is currently no systematic way to solve it. I conclude that criterion problems do not constitute good reasons for skepticism about the scientific study of consciousness. (shrink)

Research suggests that metacognitive monitoring ability does not decline with age. For example, judgments-of-learning accuracy is roughly equivalent between younger and older adults. But few studies have asked whether younger and older adults’ metacognitive ability varies across different types of memory processes. The current study tested the relationship between memory and post-decision confidence ratings at the trial level on item and associative memory recognition tests. As predicted, younger and older adults had similarmetacognitive efficiency, when using meta-d’/d’, a measure derived from (...) Signal Detection Theory, despite a significant age effect favoring younger adults on memory performance. This result is consistent with previous work showing age-equivalent metacognitive efficiency in the memory domain. We also found that metacognitive efficiency was higher for associative memory than for item memory across age groups, even though associative and item recognition memory were statistically equivalent. Higher accuracy on post-test decision confidence ratings for associative recognition relative to item recognition on resolution accuracy itself and when corrected for performance differences are novel findings. Implications for associative metacognition are discussed. (shrink)