This article argues that conscious attention exists not so much for selecting an immediate action as for using the current task to focus specialized learning for the action-selection mechanism and predictive models on tasks and environmental contingencies likely to affect the conscious agent. It is perfectly possible to build this sort of a system into machine intelligence, but it would not be strictly necessary unless the intelligence needs to learn and is resource-bounded with respect to the rate of learning versus (...) the rate of relevant environmental change. Support for this theory is drawn from scientific research and AI simulations. Consequences are discussed with respect to self-consciousness and ethical obligations to and for AI. (shrink)

Research on human reasoning has both popularized and struggled with the idea that intuitive and deliberate thoughts stem from two different systems, raising the question how people switch between them. Inspired by research on cognitive control and conflict monitoring, we argue that detecting the need for further thought relies on an intuitive, context-sensitive process that is learned in itself.

Cognitive control has long been one of the most active areas of computational modeling work in cognitive science. The focus on computational models as a medium for specifying and developing theory predates the PDP books, and cognitive control was not one of the areas on which they focused. However, the framework they provided has injected work on cognitive control with new energy and new ideas. On the occasion of the books' anniversary, we review computational modeling in the study of cognitive (...) control, with a focus on the influence that the PDP approach has brought to bear in this area. Rather than providing a comprehensive review, we offer a framework for thinking about past and future modeling efforts in this domain. We define control in terms of the optimal parameterization of task processing. From this vantage point, the development of control systems in the brain can be seen as responding to the structure of naturalistic tasks, through the filter of the brain systems with which control directly interfaces. This perspective lays open a set of fascinating but difficult research questions, which together define an important frontier for future computational research. (shrink)

The dynamical systems approach in cognitive science offers a potentially useful perspective on both brain and behavior. Indeed, the importation of formal tools from dynamical systems research has already paid off for our field in many ways. However, like some other theoretical perspectives in cognitive science, the dynamical systems approach comes in both moderate or pragmatic and “fundamentalist” varieties (Jones & Love, 2011). In the latter form, dynamical systems theory can rise to some stirring rhetorical heights. However, as argued here, (...) it also triggers a number of serious and specific reservations. (shrink)

Humans regularly pursue activities characterized by dramatic success or failure outcomes where, critically, the chances of success depend on the time invested working toward it. How should people allocate time between such make‐or‐break challenges and safe alternatives, where rewards are more predictable (e.g., linear) functions of performance? We present a formal framework for studying time allocation between these two types of activities, and we explore optimal behavior in both one‐shot and dynamic versions of the problem. In the one‐shot version, we (...) illustrate striking discontinuities in the optimal time allocation policy as we gradually change the parameters of the decision‐making problem. In the dynamic version, we formulate the optimal strategy—defined by a giving‐up threshold—which adaptively dictates when people should stop pursuing the make‐or‐break goal. We then show that this strategy is computationally inaccessible for humans, and we explore boundedly rational alternatives. We compare the performance of the optimal model against (a) a myopic giving‐up threshold that is easier to compute, and even simpler heuristic strategies that either (b) only decide whether or not to start pursuing the goal and never give up or (c) consider giving up at a fixed number of control points. Comparing strategies across environments, we investigate the cost and behavioral implications of sidestepping the computational burden of full rationality. (shrink)

Diffusion models are widely-used and successful accounts of the time course of two-choice decision making. Most diffusion models assume constant boundaries, which are the threshold levels of evidence that must be sampled from a stimulus to reach a decision. We summarize theoretical results from statistics that relate distributions of decisions and response times to diffusion models with time-varying boundaries. We then develop a computational method for finding time-varying boundaries from empirical data, and apply our new method to two problems. The (...) first problem involves finding the time-varying boundaries that make diffusion models equivalent to the alternative sequential sampling class of accumulator models. The second problem involves finding the time-varying boundaries, at the individual level, that best fit empirical data for perceptual stimuli that provide equal evidence for both decision alternatives. We discuss the theoretical and modeling implications of using time-varying boundaries in diffusion models, as well as the limitations and potential of our approach to their inference. (shrink)

The semantic fluency task is commonly used as a measure of one’s ability to retrieve semantic concepts. While performance is typically scored by counting the total number of responses, the ordering of responses can be used to estimate how individuals or groups organize semantic concepts within a category. I provide an overview of this methodology, using Alzheimer’s disease as a case study for how the approach can help advance theoretical questions about the nature of semantic representation. However, many open questions (...) surrounding the validity and reliability of this approach remain unresolved. (shrink)

The medial prefrontal cortex (mPFC) has been the subject of intense interest as a locus of cognitive control. Several computational models have been proposed to account for a range of effects, including error detection, conflict monitoring, error likelihood prediction, and numerous other effects observed with single-unit neurophysiology, fMRI, and lesion studies. Here, we review the state of computational models of cognitive control and offer a new theoretical synthesis of the mPFC as signaling response–outcome predictions. This new synthesis has two interacting (...) components. The first component learns to predict the various possible outcomes of a planned action, and the second component detects discrepancies between the actual and intended responses; the detected discrepancies in turn update the outcome predictions. This single construct is consistent with a wide array of performance monitoring effects in mPFC and suggests a unifying account of the cognitive role of medial PFC in performance monitoring. (shrink)

After more than 15 years of study, the 1/f noise or complex-systems approach to cognitive science has delivered promises of progress, colorful verbiage, and statistical analyses of phenomena whose relevance for cognition remains unclear. What the complex-systems approach has arguably failed to deliver are concrete insights about how people perceive, think, decide, and act. Without formal models that implement the proposed abstract concepts, the complex-systems approach to cognitive science runs the danger of becoming a philosophical exercise in futility. The complex-systems (...) approach can be informative and innovative, but only if it is implemented as a formal model that allows concrete prediction, falsification, and comparison against more traditional approaches. (shrink)

In many learning or inference tasks human behavior approximates that of a Bayesian ideal observer, suggesting that, at some level, cognition can be described as Bayesian inference. However, a number of findings have highlighted an intriguing mismatch between human behavior and standard assumptions about optimality: People often appear to make decisions based on just one or a few samples from the appropriate posterior probability distribution, rather than using the full distribution. Although sampling-based approximations are a common way to implement Bayesian (...) inference, the very limited numbers of samples often used by humans seem insufficient to approximate the required probability distributions very accurately. Here, we consider this discrepancy in the broader framework of statistical decision theory, and ask: If people are making decisions based on samples—but as samples are costly—how many samples should people use to optimize their total expected or worst-case reward over a large number of decisions? We find that under reasonable assumptions about the time costs of sampling, making many quick but locally suboptimal decisions based on very few samples may be the globally optimal strategy over long periods. These results help to reconcile a large body of work showing sampling-based or probability matching behavior with the hypothesis that human cognition can be understood in Bayesian terms, and they suggest promising future directions for studies of resource-constrained cognition. (shrink)

The speed‐accuracy trade‐off (SAT) effect refers to the behavioral trade‐off between fast yet error‐prone respones and accurate but slow responses. Multiple theories on the cognitive mechanisms behind SAT exist. One theory assumes that SAT is a consequence of strategically adjusting the amount of evidence required for overt behaviors, such as perceptual choices. Another theory hypothesizes that SAT is the consequence of the mixture of multiple categorically different cognitive processes. In this paper, these theories are disambiguated by assessing whether the fixed‐point (...) property of mixture distributions holds, in both simulations and data. I conclude that, at least for perceptual decision making, there is no evidence for a mixture of different cognitive processes to trade off accuracy of responding for speed. (shrink)

Piéron's Law describes the relationship between stimulus intensity and reaction time. Previously (Stafford & Gurney, 2004), we have shown that Piéron's Law is a necessary consequence of rise-to-threshold decision making and thus will arise from optimal simple decision-making algorithms (e.g., Bogacz, Brown, Moehlis, Holmes, & Cohen, 2006). Here, we manipulate the color saturation of a Stroop stimulus. Our results show that Piéron's Law holds for color intensity and color-naming reaction time, extending the domain of this law, in line with our (...) suggestion of the generality of the processes that can give rise to Piéron's Law. In addition, we find that Stroop condition does not interact with the effect of color saturation; Stroop interference and facilitation remain constant at all levels of color saturation. An analysis demonstrates that this result cannot be accounted for by single-stage decision-making algorithms which combine all the evidence pertaining to a decision into a common metric. This shows that human decision making is not information-optimal and suggests that the generalization of current models of simple perceptual decision making to more complex decisions is not straightforward. (shrink)

Evidence accumulation has been the core component in recent development of perceptual and value-based decision-making theories. Most studies have focused on the evaluation of evidence between alternative options. What remains largely unknown is the process that prepares evidence: how may the decision-maker sample different sources of information sequentially, if they can only sample one source at a time? Here we propose a normative framework in prescribing how different sources of information should be sampled proactively to facilitate the decision process: beliefs (...) for different noisy sources are updated in a Bayesian manner and participants can proactively allocate resource for sampling (i.e. saccades) among different sources to maximize the information gain in such process. We show that our framework can account for human participants’ actual choice and saccade behaviors in a two-alternative value-based decision-making task. Moreover, our framework makes novel predictions about the empirical eye movement patterns. (shrink)

Researchers studying complex cognition have grown increasingly interested in mapping symbolic cognitive architectures onto subsymbolic brain models. Such a mapping seems essential for understanding cognition under all but the most extreme viewpoints (namely, that cognition consists exclusively of digitally implemented rules; or instead, involves no rules whatsoever). Making this mapping reduces to specifying an interface between symbolic and subsymbolic descriptions of brain activity. To that end, we propose parameterization techniques for building cognitive models as programmable, structured, recurrent neural networks. Feedback (...) strength in these models determines whether their components implement classically subsymbolic neural network functions (e.g., pattern recognition), or instead, logical rules and digital memory. These techniques support the implementation of limited production systems. Though inherently sequential and symbolic, these neural production systems can exploit principles of parallel, analog processing from decision-making models in psychology and neuroscience to explain the effects of brain damage on problem solving behavior. (shrink)

The speed-accuracy trade-off effect refers to the behavioral trade-off between fast yet error-prone respones and accurate but slow responses. Multiple theories on the cognitive mechanisms behind SAT exist. One theory assumes that SAT is a consequence of strategically adjusting the amount of evidence required for overt behaviors, such as perceptual choices. Another theory hypothesizes that SAT is the consequence of the mixture of multiple categorically different cognitive processes. In this paper, these theories are disambiguated by assessing whether the fixed-point property (...) of mixture distributions holds, in both simulations and data. I conclude that, at least for perceptual decision making, there is no evidence for a mixture of different cognitive processes to trade off accuracy of responding for speed. (shrink)

Past research suggests that people process verbal quantifiers differently from numerical ones, but this suggestion has yet to be formally tested. Drawing from traditional correlates of dual-process...

This study investigated the interaction between sampling behavior and preference formation underlying subjective decision making for like and dislike decisions. Two-alternative forced-choice tasks were used with closely-matched musical excerpts and the participants were free to listen and re-listen, i.e. to sample and resample each excerpt, until they reached a decision. We predicted that for decisions involving resampling, a sampling bias would be observed before the moment of conscious decision for the like decision only. The results indeed showed a gradually increasing (...) sampling bias favouring the choice before the moment of overt response for like decisions. Such a bias was absent for dislike decisions. Furthermore, the participants reported stronger relative preferences for like decisions as compared to dislike decisions. This study demonstrated distinct differences in preference formation between like and dislike decisions, both in the implicit orienting/sampling processes prior to the conscious decision and in the subjective evaluation afterwards. (shrink)

We explore the idea that eye-movement strategies in reading are precisely adapted to the joint constraints of task structure, task payoff, and processing architecture. We present a model of saccadic control that separates a parametric control policy space from a parametric machine architecture, the latter based on a small set of assumptions derived from research on eye movements in reading (Engbert, Nuthmann, Richter, & Kliegl, 2005; Reichle, Warren, & McConnell, 2009). The eye-control model is embedded in a decision architecture (a (...) machine and policy space) that is capable of performing a simple linguistic task integrating information across saccades. Model predictions are derived by jointly optimizing the control of eye movements and task decisions under payoffs that quantitatively express different desired speed-accuracy trade-offs. The model yields distinct eye-movement predictions for the same task under different payoffs, including single-fixation durations, frequency effects, accuracy effects, and list position effects, and their modulation by task payoff. The predictions are compared to—and found to accord with—eye-movement data obtained from human participants performing the same task under the same payoffs, but they are found not to accord as well when the assumptions concerning payoff optimization and processing architecture are varied. These results extend work on rational analysis of oculomotor control and adaptation of reading strategy (Bicknell & Levy, ; McConkie, Rayner, & Wilson, 1973; Norris, 2009; Wotschack, 2009) by providing evidence for adaptation at low levels of saccadic control that is shaped by quantitatively varying task demands and the dynamics of processing architecture. (shrink)

Which rules should guide our reasoning? Human reasoners often use reasoning shortcuts, called heuristics, which function well in some contexts but lack the universality of reasoning rules like deductive implication or inference to the best explanation. Does it follow that human reasoning is hopelessly irrational? I argue: no. Heuristic reasoning often represents human reasoners reaching a local rational maximum, reasoning more accurately than if they try to implement more “ideal” rules of reasoning. I argue this is a genuine rational achievement. (...) Our ideal rational advisors would advise us to reason with heuristic rules, not more complicated ideal rules. I argue we do not need a radical new account of epistemic norms to make sense of the success of heuristic reasoning. (shrink)

This paper addresses a common challenge with computational cognitive models: identifying parameter values that are both theoretically plausible and generate predictions that match well with empirical data. While computational models can offer deep explanations of cognition, they are computationally complex and often out of reach of traditional parameter fitting methods. Weak methodology may lead to premature rejection of valid models or to acceptance of models that might otherwise be falsified. Mathematically robust fitting methods are, therefore, essential to the progress of (...) computational modeling in cognitive science. In this article, we investigate the capability and role of modern fitting methods—including Bayesian optimization and approximate Bayesian computation—and contrast them to some more commonly used methods: grid search and Nelder–Mead optimization. Our investigation consists of a reanalysis of the fitting of two previous computational models: an Adaptive Control of Thought—Rational model of skill acquisition and a computational rationality model of visual search. The results contrast the efficiency and informativeness of the methods. A key advantage of the Bayesian methods is the ability to estimate the uncertainty of fitted parameter values. We conclude that approximate Bayesian computation is (a) efficient, (b) informative, and (c) offers a path to reproducible results. (shrink)

Recently, psychological phenomena have been expanded to new domains, crisscrossing boundaries of organizational levels, with the emergence of areas such as social personality and ecosystem learning. In this contribution, we analyze the ascription of an individual-based concept (personality) to the social level. Although justified boundary crossings can boost new approaches and applications, the indiscriminate misuse of concepts refrains the growth of scientific areas. The concept of social personality is based mainly on the detection of repeated group differences across a population, (...) in a direct transposition of personality concepts from the individual to the social level. We show that this direct transposition is problematic for avowing the nonsensical ascription of personality even to simple electronic devices. To go beyond a metaphoric use of social personality, we apply the organizational approach to a review of social insect communication networks. Our conceptual analysis shows that socially self-organized systems, such as isolated ant trails and bee’s recruitment groups, are too simple to have social personality. The situation is more nuanced when measuring the collective choice between nest sites or foraging patches: some species show positive and negative feedbacks between two or more self-organized social structures so that these co-dependent structures are inter-related by second-order, social information systems, complying with a formal requirement for having social personality: the social closure of constraints. Other requirements include the decoupling between individual and social dynamics, and the self-regulation of collective decision processes. Social personality results to be sometimes a metaphorical transposition of a psychological concept to a social phenomenon. The application of this organizational approach to cases of learning ecosystems, or evolutionary learning, could help to ground theoretically the ascription of psychological properties to levels of analysis beyond the individual, up to meta-populations or ecological communities. (shrink)

This paper explains what’s wrong with a Hume-inspired argument for skepticism about induction. Hume’s argument takes as a premise that inductive reasoning presupposes that the future will resemble the past. I explain why that claim is not plausible. The most plausible premise in the vicinity is that inductive reasoning from E to H presupposes that if E then H. I formulate and then refute a skeptical argument based on that premise. Central to my response is a psychological explanation for how (...) people judge that if E then H without realizing that they thereby settled the matter rationally. (shrink)

A sensible epistemologist may not see how she could know that she is not a brain in a vat ; but she doesn’t panic. She sticks with her empirical beliefs, and as that requires, believes that she is not a BIV. (She does not inferentially base her belief that she is not a BIV on her empirical knowledge—she rejects that ‘Moorean’ response to skepticism.) Drawing on the psychological literature on metacognition, I describe a mechanism that’s plausibly responsible for a sensible (...) epistemologist coming to believe she is not a BIV. I propose she thereby knows that she is not a BIV. The particular belief-forming mechanism employed explains why she overlooks this account of how she knows she is not a BIV, making it seem that there is no way for her to know it. I argue this proposal satisfactorily resolves the skeptical puzzle. (shrink)