Expert chess players, specialized in different openings, recalled positions and solved problems within and outside their area of specialization. While their general expertise was at a similar level, players performed better with stimuli from their area of specialization. The effect of specialization on both recall and problem solving was strong enough to override general expertise—players remembering positions and solving problems from their area of specialization performed at around the level of players 1 standard deviation (SD) above them in general skill. (...) Their problem‐solving strategy also changed depending on whether the problem was within their area of specialization. When it was, they searched more in depth and less in breadth; with problems outside their area of specialization, the reverse. The knowledge that comes from familiarity with a problem area is more important than general purpose strategies in determining how an expert will tackle it. These results demonstrate the link in experts between problem solving and memory of specific experiences and indicate that the search for context‐independent general purpose problem‐solving strategies to teach to future experts is unlikely to be successful. (shrink)

The purpose of this paper is to provide a detailed technical protocol analysis of chess masters' evaluative expertise, paying particular attention to the analysis of the structure of their memory process in evaluating foreseen possibilities in games of dynamic equilibrium. The paper has two purposes. First, to publish a results chapter from my DPhil thesis (in revised journal article form) attending to the measurement of foresight in chess masters' evaluation process, testing alternative theories of cognitive expertise in the domain of (...) chess; and second to provide a subset of the technical graphical analysis that corresponds to that measurement to preserve this protocol analysis for access in the academic domain for future studies of expert memory and foresight (e.g., Ericsson & Simon, 1993). The step-by-step protocol analysis consists of: (i) an introduction to foresight cognition as hypothesis testing, (ii) a theoretical review in the domain of chess masters' expertise according to the theoretical frameworks in that field purporting hypotheses relevant to chess masters' evaluative skill processes, and (iii) summary tables and non-parametric statistical analysis corroborating chunking theory frameworks of expert cognition (e.g., DeGroot, 1965; Newell & Simon, 1972; Gobet, 1998; Gobet et al., 2004), and refuting the alternative search-evaluation models (e.g., Holding & Reynolds, 1982). Moreover, the journal article espouses the preservation of the traditional protocol analysis method core to the field of expert cognition (DeGroot, 1969; Kotov, 1971). The full protocol analysis can be found in monograph form here on my SSRN profile in ‘The role of falsification in hypothesis testing’. It takes the form of a specialist population study (e.g., detailed case study work; Luria, 1987). Thus the outline consists of a short introduction, a theoretical methodological review discussing protocol analysis methods for specialist population studies in cognition (with particular attention to the preservation of protocol analysis methods for chess studies in cognition and expert memory/ with a fresh angle on the foresight process), and the full set of protocol analyses with corresponding problem behaviour graphs. A subset of the main results has been published elsewhere (e.g., Cowley & Byrne, 2004; Cowley 2006), receiving scientific and scientific journalistic acclaim (e.g., Nature Online News 2004). (shrink)

Interpersonal coordination is a key factor in team performance. In interactive team sports, the limited predictability of a constantly changing context makes coordination challenging. Approaches that highlight the support provided by environmental information and theories of shared mental models provide potential explanations of how interpersonal coordination can nonetheless be established. In this article, we first outline the main assumptions of these approaches and consider criticisms that have been raised with regard to each. The aim of this article is to define (...) a theoretical perspective that integrates the coordination mechanisms of the two approaches. In doing so, we borrow from a theoretical outline of group action. According to this outline, group action based on a priori shared mental models is an example of how interpersonal coordination is established from the top down. Interpersonal coordination in reaction to the perception of affordances represents the bottom-up component of group action. Both components are inextricably involved in the coordination of interactive sports teams. We further elaborate on the theoretical outline to integrate a third, constructivist approach. Integrating this third approach helps to explain interpersonal coordination in game situations for which no shared mental models are established and game situations that remain ambiguous in terms of perceived affordances. The article describes how hierarchical, sequential and complex dimensions of action organization are important aspects of this constructivist perspective and how mental models may be involved. A basketball example is used to illustrate how top-down, bottom-up and constructivist processes may be simultaneously involved in enabling interpersonal coordination. Finally, we present the implications for research and practice. (shrink)

Expertise has become a topic of increased interest to philosophers. Fascinating in its own right, expertise also plays a crucial role in several philosophical debates. My aim in this paper is to draw attention to an important, and hitherto unappreciated feature of expertise: its brittleness. Experts are often unable to transfer their proficiency in one domain to other, even intuitively similar domains. Experts are often unable to flexibly respond to changes within their domains. And, even more surprisingly, experts will occasionally (...) be outperformed by novices when confronted with novel circumstances within their domains of expertise. In section 1, I marshal the evidence in favour of brittleness. In section 2, I argue that appeals to brittleness can advance the dialectic in debates on skilled action and provide reasons to reject a powerful recent argument offered by Christensen et al. : 693–719, 2019). In section 3, I appeal to brittleness to argue against a common conception of philosophical expertise, according to which philosophers possess a domain-general set of reasoning skills. Although my argument in this section is largely negative, there is a twist. Recalibrating our understanding of philosophical expertise opens new avenues of research for defenders of the so-called ‘expertise defence’ against the findings of experimental philosophy. (shrink)

Each day people are presented with circumstances that may require speculation. Scientists may ponder questions such as why a star is born or how rainbows are made, psychologists may ask social questions such as why people are prejudiced, and military strategists may imagine what the consequences of their actions might be. Speculations may lead to the generation of putative explanations called hypotheses. But it is by checking if hypotheses accurately reflect the encountered facts that lead to sensible behaviour demonstrating a (...) true understanding. If evidence shows a hypothesis to be false, then people should rationally abandon it, especially if there are negative consequences. The aim of this thesis is to examine how effectively people search for evidence in their hypothesis testing to test whether or not their hypotheses are true or false in competitive games. -/- Research findings from six studies of hypothesis testing behaviour in competitive deductive tasks are explored. Chapter by chapter the thesis tests how everyday people, and master chess players, tackle hypothesis testing in mathematical tasks, such as how to solve sequential number sequence puzzles when thinking about an opponent, or how to solve chess problems in a variety of contexts. The implications of the results are discussed in light of aspects of general cognition: such as reasoning, social hypothesis testing and planning. (shrink)

Deep Neural Networks (DNNs) are popular for classifying large noisy analogue data. However, DNNs suffer from several known issues, including explainability, efficiency, catastrophic interference, and a need for high‐end computational resources. Our simulations reveal that psychologically‐inspired symbolic deep networks (SDNs) achieve similar accuracy and robustness to noise as DNNs on common ML problem sets, while addressing these issues.

The last two decades have produced unprecedented successes in the fields of artificial intelligence and machine learning (ML), due almost entirely to advances in deep neural networks (DNNs). Deep hierarchical memory networks are not a novel concept in cognitive science and can be traced back more than a half century to Simon's early work on discrimination nets for simulating human expertise. The major difference between DNNs and the deep memory nets meant for explaining human cognition is that the latter are (...) symbolic networks meant to model the dynamics of human memory and learning. Cognition-inspired symbolic deep networks (SDNs) address several known issues with DNNs, including (1) learning efficiency, where a much larger number of training examples are required for DNNs than would be expected for a human; (2) catastrophic interference, where what is learned by a DNN gets unlearned when a new problem is presented; and (3) explainability, where there is no way to explain what is learned by a DNN. This paper explores whether SDNs can achieve similar classification accuracy performance to DNNs across several popular ML datasets and discusses the strengths and weaknesses of each approach. Simulations reveal that (1) SDNs provide similar accuracy to DNNs in most cases, (2) SDNs are far more efficient than DNNs, (3) SDNs are as robust as DNNs to irrelevant/noisy attributes in the data, and (4) SDNs are far more robust to catastrophic interference than DNNs. We conclude that SDNs offer a promising path toward human-level accuracy and efficiency in category learning. More generally, ML frameworks could stand to benefit from cognitively inspired approaches, borrowing more features and functionality from models meant to simulate and explain human learning. (shrink)

What is ‘counterintuitive’? There is general agreement that it refers to a violation of previously held knowledge, but the precise definition seems to vary with every author and study. The aim of this paper is to deconstruct the notion of ‘counterintuitive’ and provide a more philosophically rigorous definition congruent with the history of psychology, recent experimental work in ‘minimally counterintuitive’ concepts, the science vs. religion debate, and the developmental and evolutionary background of human beings. We conclude that previous definitions of (...) counterintuitiveness have been flawed and did not resolve the conflict between a believer’s conception of the supernatural entity (an atypical “real kind”) and the non-believer’s conception (empty name/fictional). Furthermore, too much emphasis has been placed on the universality and (presumed) innateness of intuitive concepts (and hence the criteria for what is counterintuitive)—and far too little attention paid to learning and expertise. We argue that many putatively universal concepts are not innate, but mostly learned and defeasible—part of a religious believer’s repertoire of expert knowledge. Nonetheless, the results from empirical studies about the memorability of counterintuitive concepts have been convincing and it is difficult to improve on existing designs and methodologies. However, future studies in counterintuitive concepts need to embed their work in research about context effects, typicality, the psychology of learning and expertise (for example, the formation of expert templates and range defaults), with more attention to the sources of knowledge (direct and indirect knowledge) and a better idea of what ‘default’ knowledge really is. (shrink)

The well-known game of chess has traditionally been modeled in artificial intelligence studies by search engines with advanced pruning techniques. The models were thus centered on an inference engine manipulating passive symbols in the form of tokens. It is beyond doubt, however, that human players do not carry out such processes. Instead, chess masters instead carry out perceptual processes, carefully categorizing the chunks perceived in a position and gradually building complex dynamic structures to represent the subtle pressures embedded in the (...) positions. In this paper we will consider two hypotheses concerning the underlying subcognitive processes and architecture. In the first hypothesis, a multiple-leveled chess representational structure is presented, which includes distance graphs (with varying levels of quality) between pieces, piece mobilities, and abstract roles. These representational schemes seem to account for numerous characteristics of human player’s psychology. The second hypothesis concerns the extension of the architecture proposed in the Copycat project as central for modeling the emergent intuitive perception of a chess position. We provide a synthesis on how the postulated architecture models chess intuition as an emergent mixture of simultaneous distance estimations, chunk perceptions, abstract role awareness, and intention activations. This is an alternative model to the traditional AI approaches, focusing on the philosophy of active symbols. (shrink)

Musical improvisation is a sophisticated activity in which a performer realizes, real-time, melodic, and rhythmic sequences in harmony with those from other musicians. The study of musical improvisation helps one to understand not only the cognition of creativity, but also the complex neuronal basis of executive functions, the relation between conscious and unconscious action, and even more. So far, the prevailing models, founded on the brain imaging method, have focused on the connection between the cortical areas and their cognitive processes. (...) Little attention, on the other hand, has been given to the huge variety of subcortical activities, especially in the basal ganglia. This fundamental subcortical component, through its implicit procedures and the role it plays in memory, is responsible to produce new information all the time, allowing the prefrontal cortex to transform a huge and disordered amount of data in explicit creative acts. The basal ganglia are strongly related to the activation of chemical signals generated by dissonance or lack of symmetry between perception and expectation, participating even in the responses to environmental demands according to the circumstances. Thus, they interact with the frontal cortex and with the limbic system, playing a key role in planning and selecting appropriate actions and in decision making. In this text, we try to explain in which sense improvisation is connected to the processes of executive functions, to creativity and to the integrated activity of cortical–subcortical areas controlling the free flow of ideas and to expressive spontaneity. Eventually, we purpose a model according to which structure and process take part at the centrencephalic space of functional integration, which, through both competing and cooperating dynamics, gives way to spontaneous composition. (shrink)

We introduce an innovative technique that quantifies human expertise development in such a way that humans and artificial systems can be directly compared. Using this technique we are able to highlight certain fundamental difficulties associated with the learning of a complex task that humans are still exceptionally better at than their computer counterparts. We demonstrate that expertise goes through significant developmental transitions that have previously been predicted but never explicated. The first signals the onset of a steady increase in global (...) awareness that begins surprisingly late in expertise acquisition. The second transition, reached by only a very few experts in the world, shows a major reorganisation of global contextual knowledge resulting in a relatively minor gain in skill. We are able to show that these empirical findings have consequences for our understanding of the way in which expertise acquisition may be modelled by learning in artificial intelligence systems. This point is emphasised with a novel theoretical result showing explicitly how our findings imply a non-trivial hurdle for learning for suitably complex tasks. (shrink)

As engineers gain experience and become experts in their domain, the structure and content of their knowledge changes. Two studies are presented that examine differences in knowledge representation among freshman and senior engineering students. The first study examines recall of mechanical devices and chunking of components, and the second examines whether seniors represent devices in a more abstract functional manner than do freshmen. The most prominent differences between these 2 groups involve their representation of the functioning of groups of electromechanical (...) components and how these groups of components interact to produce device behavior. Seniors are better able to construct coherent representations of devices by focusing on the function of sets of components in the device. The findings from these studies highlight some ways in which the structure and content of mental representations of design knowledge differ during the early stages of expertise acquisition. (shrink)

This essay explores the nature and neurological basis of creativity in technical production. After presenting a model of expert technical cognition based in cognitive anthropology and cognitive psychology, the authors propose that craft production has three inherent sources of novelty — procedural drift, serendipitous error and fiddling. However, these are quite limited in their creative potential, which may help explain the virtual absence of innovation over the long millennia of the Palaeolithic. Innovation can be far more rapid and effective via (...) invention, which requires folk theories of causation and adequate working memory capacity, all fairly recent evolutionary developments. The neurological basis of expert technical cognition lies in well-known cortical and sub-cortical structures, but recent research has established a provocative role for the cerebellum in the formulation of novel arrangements. (shrink)

Structural equation modelling (SEM) is outlined and compared with two non-linear alternatives, artificial neural networks and ''fast and frugal'' models. One particular non-linear decision-making situation is discussed, that exemplified by a lexicographic semi-order. We illustrate the use of SEM on a dataset derived from 539 volunteers' responses to questions about food-related risks. Our conclusion is that SEM is a useful member of the armoury of techniques available to the student of human judgement: it subsumes several multivariate statistical techniques and permits (...) their flexible combination, and it provides robust goodness-of-fit statistics and is available in (generally) easy-to-use computer packages. Although the number of tasks for which SEM provides a persuasive psychological model is small, it is very useful in identifying the important variables and their inter-relations that contribute to task performance, and thus can constitute a valuable intermediate staging point between raw data and a fully fledged psychological theory. (shrink)

For many years, the game of chess has provided an invaluable task environment for research on cognition, in particular on the differences between novices and experts and the learning that removes these differences, and upon the structure of human memory and its paramaters. The template theory presented by Gobet and Simon based on the EPAM theory offers precise predictions on cognitive processes during the presentation and recall of chess positions. This article describes the behavior of CHREST, a computer implementation of (...) the template theory, in a memory task when the presentation time is varied from one second to sixty, on the recall of game and random positions, and compares the model to human data. Strong players are better than weak players in both types of positions, especially with long presentation times, but even after brief presentations. CHREST predicts the data, both qualitatively and quantitatively. Strong players' superiority with random positions is explained by the large number of chunks they hold in LTM. Their excellent recall with short presentation times is explained by templates, a special class of chunks. CHREST is compared to other theories of chess skill, which either cannot account for the superiority of Masters in random positions or predict too strong a performance of Masters in such positions. (shrink)

As engineers gain experience and become experts in their domain, the structure and content of their knowledge changes. Two studies are presented that examine differences in knowledge representation among freshman and senior engineering students. The first study examines recall of mechanical devices and chunking of components, and the second examines whether seniors represent devices in a more abstract functional manner than do freshmen. The most prominent differences between these 2 groups involve their representation of the functioning of groups of electromechanical (...) components and how these groups of components interact to produce device behavior. Seniors are better able to construct coherent representations of devices by focusing on the function of sets of components in the device. The findings from these studies highlight some ways in which the structure and content of mental representations of design knowledge differ during the early stages of expertise acquisition. (shrink)