A general model of problem‐solving processes based on misconception elimination is presented to simulate both impasses and solving processes. The model operates on goal‐related rules and a set of constraint rules in the form of “if (state or goal), do not (Action)” for the explicit constraints in the instructions and the implicit constraints that come from misconceptions of legal moves. When impasses occur, a constraint elimination mechanism is applied. Because successive eliminations of implicit constraints enlarge the problem space and have (...) an effect on planning, the model integrates “plan‐based” and “constraint‐based” approaches to problem‐solving behavior.Simulating individual protocols of Tower of Hanoi situations shows that the model, which has a proper set of constraints, predicts a single move with no alternative on about 61% of the movements and that protocols are quite successfully simulated movement by movement. Finally, it is shown that many features of previous models are embedded in the constraint elimination model. (shrink)

First, a number of previous theories of intrinsic motivation are reviewed. Then, several studies of highly motivating computer games are described. These studies focus on what makes the games fun, not on what makes them educational. Finally, with this background, a rudimentary theory of intrinsically motivating instruction is developed, based on three categories: challenge, fantasy, and curiosity.Challenge is hypothesized to depend on goals with uncertain outcomes. Several ways of making outcomes uncertain are discussed, including variable difficulty level, multiple level goals, (...) hidden information, and randomness. Fantasy is claimed to have both cognitive and emotional advantages in designing instructional environments. A distinction is made between extrinsic fantasies that depend only weakly on the skill used in a game, and intrinsic fantasies that are intimately related to the use of the skill. Curiosity is separated into sensory and cognitive components, and it is suggested that cognitive curiosity can be aroused by making learners believe their knowledge structures are incomplete, inconsistent, or unparsimonious. (shrink)

Complex problem solving (CPS) emerged in the last 30 years in Europe as a new part of the psychology of thinking and problem solving. This paper introduces into the field and provides a personal view. Also, related concepts like macrocognition or operative intelligence will be explained in this context. Two examples for the assessment of CPS, Tailorshop and MicroDYN, are presented to illustrate the concept by means of their measurement devices. Also, the relation of complex cognition and emotion in the (...) CPS context is discussed. The question if CPS requires complex cognition is answered with a tentative “yes.”. (shrink)

The purpose of this paper is to provide a detailed technical protocol analysis of chess masters' evaluative expertise, paying particular attention to the analysis of the structure of their memory process in evaluating foreseen possibilities in games of dynamic equilibrium. The paper has two purposes. First, to publish a results chapter from my DPhil thesis (in revised journal article form) attending to the measurement of foresight in chess masters' evaluation process, testing alternative theories of cognitive expertise in the domain of (...) chess; and second to provide a subset of the technical graphical analysis that corresponds to that measurement to preserve this protocol analysis for access in the academic domain for future studies of expert memory and foresight (e.g., Ericsson & Simon, 1993). The step-by-step protocol analysis consists of: (i) an introduction to foresight cognition as hypothesis testing, (ii) a theoretical review in the domain of chess masters' expertise according to the theoretical frameworks in that field purporting hypotheses relevant to chess masters' evaluative skill processes, and (iii) summary tables and non-parametric statistical analysis corroborating chunking theory frameworks of expert cognition (e.g., DeGroot, 1965; Newell & Simon, 1972; Gobet, 1998; Gobet et al., 2004), and refuting the alternative search-evaluation models (e.g., Holding & Reynolds, 1982). Moreover, the journal article espouses the preservation of the traditional protocol analysis method core to the field of expert cognition (DeGroot, 1969; Kotov, 1971). The full protocol analysis can be found in monograph form here on my SSRN profile in ‘The role of falsification in hypothesis testing’. It takes the form of a specialist population study (e.g., detailed case study work; Luria, 1987). Thus the outline consists of a short introduction, a theoretical methodological review discussing protocol analysis methods for specialist population studies in cognition (with particular attention to the preservation of protocol analysis methods for chess studies in cognition and expert memory/ with a fresh angle on the foresight process), and the full set of protocol analyses with corresponding problem behaviour graphs. A subset of the main results has been published elsewhere (e.g., Cowley & Byrne, 2004; Cowley 2006), receiving scientific and scientific journalistic acclaim (e.g., Nature Online News 2004). (shrink)

Each day people are presented with circumstances that may require speculation. Scientists may ponder questions such as why a star is born or how rainbows are made, psychologists may ask social questions such as why people are prejudiced, and military strategists may imagine what the consequences of their actions might be. Speculations may lead to the generation of putative explanations called hypotheses. But it is by checking if hypotheses accurately reflect the encountered facts that lead to sensible behaviour demonstrating a (...) true understanding. If evidence shows a hypothesis to be false, then people should rationally abandon it, especially if there are negative consequences. The aim of this thesis is to examine how effectively people search for evidence in their hypothesis testing to test whether or not their hypotheses are true or false in competitive games. -/- Research findings from six studies of hypothesis testing behaviour in competitive deductive tasks are explored. Chapter by chapter the thesis tests how everyday people, and master chess players, tackle hypothesis testing in mathematical tasks, such as how to solve sequential number sequence puzzles when thinking about an opponent, or how to solve chess problems in a variety of contexts. The implications of the results are discussed in light of aspects of general cognition: such as reasoning, social hypothesis testing and planning. (shrink)

Novice designers produced a sequence of sketches while inventing a logo for a novel brand of soft drink. The sketches were scored for the presence of specific objects, their local features and global composition. Self‐assessment scores for each sketch and art critics' scores for the end products were collected. It was investigated whether the design evolves in an essentially random fashion or according to an overall heuristic. The results indicated a macrostructure in the evolution of the design, characterized by two (...) stages. For the majority of participants, the first stage is marked by the introduction and modification of novel objects and their local and global aspects; the second stage is characterized by changes in their global composition. The minority that showed the better designs has a different strategy, in which most global changes were made in the beginning. Although participants did not consciously apply these strategies, their self‐assessment scores reflect the stages of the process. (shrink)

We explore the extent to which Anderson's (1987) theory of knowledge compilation can account for the relationship between instructions and practice in learning to use a simple device. Bibby and Payne (1993) reported experimental support for knowledge compilation in this domain. This article replicates the finding of a performance cross‐over between instruction type and task type that disappears with practice on the tasks. The research is extended by using verbal protocols to model the strategies of novice and more experienced individuals. (...) Production system models of these strategies suggest that knowledge compilation only provides an adequate account of practice for one of two Instruction groups. To model the strategy shifts for the second group, we employ a “procedure modification heuristic” (after Neches, 1987), which relies on access to a declarative model of the configuration of the device. This suggests that instructionally derived declarative knowledge may have a subtle ongoing effect on the changes in procedural knowledge with practice. (shrink)

Hans Krebs' discovery, in 1932, of the urea cycle was a major event in biochemistry. This article describes a program, KEKADA, which models the heuristics Hans Krebs used in this discovery. KEKADA reacts to surprises, formulates explanations, and carries out experiments in the same manner as the evidence in the form of laboratory notebooks and interviews indicates Hans Krebs did. Furthermore, we answer a number of questions about the nature of the heuristics used by Krebs, in particular: How domain‐specific are (...) the heuristics? To what extent are they idiosyncratic to Krebs? To what extent do they represent general strategies of problem‐solving search?The relative generality of KEKADA allows us to view the control structure of KEKADA and its domain‐independent heuristics as a model of scientific experimentation that should apply over a broad domain. (shrink)

Several authors have hailed intuition as one of the defining features of expertise. In particular, while disagreeing on almost anything that touches on human cognition and artificial intelligence, Hubert Dreyfus and Herbert Simon agreed on this point. However, the highly influential theories of intuition they proposed differed in major ways, especially with respect to the role given to search and as to whether intuition is holistic or analytic. Both theories suffer from empirical weaknesses. In this paper, we show how, with (...) some additions, a recent theory of expert memory (the template theory) offers a coherent and wide-ranging explanation of intuition in expert behaviour. It is shown that the theory accounts for the key features of intuition: it explains the rapid onset of intuition and its perceptual nature, provides mechanisms for learning, incorporates processes showing how perception is linked to action and emotion, and how experts capture the entirety of a situation. In doing so, the new theory addresses the issues problematic for Dreyfus’s and Simon’s theories. Implications for research and practice are discussed. (shrink)

The framework of plateaus, dips, and leaps shines light on periods when individuals may be inventing new methods of skilled performance. We begin with a review of the role performance plateaus have played in experimental psychology, human–computer interaction, and cognitive science. We then reanalyze two classic studies of individual performance to show plateaus and dips which resulted in performance leaps. For a third study, we show how the statistical methods of Changepoint Analysis plus a few simple heuristics may direct our (...) focus to periods of performance change for individuals. For the researcher, dips become the marker of exploration where performance suffers as new methods are invented and tested. Leaps mark the implementation of a successful new method and an incremental jump above the path plotted by smooth and steady log–log performance increments. The methods developed during these dips and leaps are the key to surpassing one's teachers and acquiring extreme expertise. (shrink)

Interest in thought experiments (TEs) derives from the paradox: “How can findings that carry conviction result from a new experiment conducted entirely within the head?” Historical studies have established the importance of TEs in science but have proposed disparate hypotheses concerning the source of knowledge in TEs, ranging from empiricist to rationalist accounts. This article analyzes TEs in think‐aloud protocols of scientifically trained experts to examine more fine‐grained information about their use. Some TEs appear powerful enough to discredit an existing (...) theory—a disconfirmatory purpose. In addition, confirmatory and generative purposes were identified for other TEs. One can also use details in transcript data, including imagery reports and gestures, to provide evidence for a central role played by imagistic simulations in many TEs, and to suggest that these simulations can generate new knowledge using several sources, including the “extended application” of perceptual motor schemas, implicit prior knowledge, and spatial reasoning operations, in contrast to formal arguments. These sources suggest what it means for TEs to be grounded in embodied processes that can begin to explain the paradox above. This leads to a rationalistic view of TEs as using productive internal reasoning, but the view also acknowledges the historical role that experience with the world can play in forming certain schemas used in TEs. Understanding such processes could help provide a foundation for developing a larger model of scientific investigation processes grounded on imagistic simulation (Clement, 2008). (shrink)

The present study discusses findings that replicate and extend the original work of Burns and Vollmeyer (2002), which showed that performance in problem solving tasks was more accurate when people were engaged in a non-specific goal than in a specific goal. The main innovation here was to examine the goal specificity effect under both observation-based and conventional action-based learning conditions. The findings show that goal specificity affects the accuracy of problem solving in the same way, both when the learning stage (...) of the task is observationbased and when it is action-based. Additionally, the findings show that, when instructions do not promote goal specificity, observation-based problem solving is as effective as action-based problem solving. (shrink)

This paper explores the interaction between implicit and explicit processes during skill learning, in terms of top-down learning (that is, learning that goes from explicit to implicit knowledge) versus bottom-up learning (that is, learning that goes from implicit to explicit knowledge). Instead of studying each type of knowledge (implicit or explicit) in isolation, we stress the interaction between the two types, especially in terms of one type giving rise to the other, and its effects on learning. The work presents an (...) integrated model of skill learning that takes into account both implicit and explicit processes and both top-down and bottom-up learning. We examine and simulate human data in the Tower of Hanoi task. The paper shows how the quantitative data in this task may be captured using either top-down or bottom-up approaches, although top-down learning is a more apt explanation of the human data currently available. These results illustrate the two different directions of learning (top-down versus bottom-up), and thereby provide a new perspective on skill learning. Ó 2003 Elsevier B.V. All rights reserved. (shrink)

Using the Chinese Ring Puzzle (Kotovsky & Simon, Citation1990; P. J. Reber & Kotovsky, Citation1997), we studied the effect on rule discovery of having to plan actions or not in order to reach a goal state. This was done by asking participants to predict legal moves as in implicit learning tasks (Experiment 1) and by asking participants to make legal moves as in problem-solving tasks (Experiment 2). Our hypothesis was that having a specific goal state to reach has a dual (...) effect on rule discovery. The first effect is positive and related to feedback from moves done in order to attain the goal: generalising the results of action and associating them to the conditions in which they were obtained allows discovery of the rule and learning it. The second effect is negative. In attempting to reach a specific goal, participants first tend to reduce the distance that separates the current state from the goal state (hill climbing) and so neglect the kind of exploration that facilitates rule and procedure discovery because this would seem to be a detour from the goal. Results show that having to plan actions improved performance in implicit learning tasks (Experiment 1), yet it impaired performance in problem-solving tasks (Experiment 2). Although implicit learning and problem solving are based on rule discovery, and entail noticing regularities in the material, in both cases, rule discovery processes appear to be task-dependent. (shrink)

When asked to explain their solutions to a problem, both adults and children gesture as they talk. These gestures at times convey information that is not conveyed in speech and thus reveal thoughts that are distinct from those revealed in speech. In this study, we use the classic Tower of Hanoi puzzle to validate the claim that gesture and speech taken together can reflect the activation of two cognitive strategies within a single response. The Tower of Hanoi is a well‐studied (...) puzzle, known to be most efficiently solved by activating subroutines at theoretically defined choice points. When asked to explain how they solved the Tower of Hanoi puzzle, both adults and children produced significantly more gesture‐speech mismatches—explanations in which speech conveyed one path and gesture another—at these theoretically defined choice points than they produced at non‐choice points. Even when the participants did not solve the problem efficiently, gesture could be used to indicate where the participants were deciding between alternative paths. Gesture can, thus, serve as a useful adjunct to speech when attempting to discover cognitive processes in problem‐solving. (shrink)

The goals of this study are to evaluate a relatively novel learning environment, as well as to seek greater understanding of why human tutoring is so effective. This alternative learning environment consists of pairs of students collaboratively observing a videotape of another student being tutored. Comparing this collaboratively observing environment to four other instructional methods—one‐on‐one human tutoring, observing tutoring individually, collaborating without observing, and studying alone—the results showed that students learned to solve physics problems just as effectively from observing tutoring (...) collaboratively as the tutees who were being tutored individually. We explain the effectiveness of this learning environment by postulating that such a situation encourages learners to become active and constructive observers through interactions with a peer. In essence, collaboratively observing combines the benefit of tutoring with the benefit of collaborating. The learning outcomes of the tutees and the collaborative observers, along with the tutoring dialogues, were used to further evaluate three hypotheses explaining why human tutoring is an effective learning method. Detailed analyses of the protocols at several grain sizes suggest that tutoring is effective when tutees are independently or jointly constructing knowledge: with the tutor, but not when the tutor independently conveys knowledge. (shrink)

This study examined whether experience with different computer-based complex problem situations would improve complex problem solving competence in an unknown problem situation. Therefore, university students took part in a control group study. They were trained in five different complex problem situations for up to 7 hr, and their performance was tested in a sixth complex problem situation. The data analyses revealed that the training influenced the CPS process of knowledge acquisition. However, the CPS process of knowledge application was not impacted (...) by experience with other problem situations. Implications for the concept of CPS as a trainable competence as well as the training of CPS in general are discussed. (shrink)

We have developed a process model that learns in multiple ways while finding faults in a simple control panel device. The model predicts human participants' learning through its own learning. The model's performance was systematically compared to human learning data, including the time course and specific sequence of learned behaviors. These comparisons show that the model accounts very well for measures such as problem‐solving strategy, the relative difficulty of faults, and average fault‐finding time. More important, because the model learns and (...) transfers its learning across problems, it also accounts for the faster problem‐solving times due to learning when examined across participants, across faults, and across the series of 20 trials on an individual participant basis. The model shows how learning while problem solving can lead to more recognition‐based performance, and helps explain how the shape of the learning curve can arise through learning and be modified by differential transfer. Overall, the quality of the correspondence appears to have arisen from procedural, declarative, and episodic learning all taking place within individual problem‐solving episodes. (shrink)

Novice designers produced a sequence of sketches while inventing a logo for a novel brand of soft drink. The sketches were scored for the presence of specific objects, their local features and global composition. Self‐assessment scores for each sketch and art critics' scores for the end products were collected. It was investigated whether the design evolves in an essentially random fashion or according to an overall heuristic. The results indicated a macrostructure in the evolution of the design, characterized by two (...) stages. For the majority of participants, the first stage is marked by the introduction and modification of novel objects and their local and global aspects; the second stage is characterized by changes in their global composition. The minority that showed the better designs has a different strategy, in which most global changes were made in the beginning. Although participants did not consciously apply these strategies, their self‐assessment scores reflect the stages of the process. (shrink)

Reasoning patterns found in Galileo’s treatise on machines, On Mechanics, are compared with patterns identified in case studies of scientifically trained experts thinking aloud, and many similarities are found. At one level the primary patterns identified are ordered analogy sequences and special diagrammatic techniques to support them. At a deeper level I develop constructs to describe patterns that can support embodied, imagistic, mental simulations as a central underlying process. Additionally, a larger hypothesized pattern of ‘progressive imagistic generalization’—Galileo’s development of a (...) model or mechanism that becomes more and more general with each machine while still being imagistically projectable into many machines—provides a way to think about his progress toward a modern explanatory model of torque. By unpacking his arguments, we gain an appreciation of his skillful ability to foster imagistic processes underlying scientific thinking. (shrink)

This paper reports a study of planning processes in the five-disc Tower of London (TOL) task in 20 younger and 20 older adult participants. A concurrent direct ''think-aloud'' method was used to obtain data on planning processes prior to moving discs in the TOL. A check was made of the effects of verbalising by comparing performance data from the experimental groups with data from control groups who did not verbalise during planning or moving. Verbalising slowed down planning and moving but (...) did not appear to distort the participants' approaches to the task. Older and younger participants did not differ in average moves taken to solve the tasks. However, older participants' planning was less complete and more error-prone than that of younger participants. The planning processes were characterised as showing a means-ends ''goal selection'' strategy. In this strategy participants (1) identify a single active goal disc at the start, (2) select moves and move sequences to enable the placing of the current goal disc in its target position, and (3) continue in this way until all discs are in their target positions. Age differences were found in the planning stage, during which there was no stimulus support and hence a substantial working memory load. During the move phase there was stimulus support and hence little loading of working memory. Age differences in moves required were not found in the move phase. As older participants tend to have depleted working memory capacity the present results suggest that working memory is heavily loaded in TOL planning but less so in the move phase of TOL. (shrink)

Goal‐directed cognition is often discussed in terms of specialized memory structures like the “goal stack.” The goal‐activation model presented here analyzes goal‐directed cognition in terms of the general memory constructs of activation and associative priming. The model embodies three predictive constraints: (1) the interference level, which arises from residual memory for old goals; (1) the strengthening constraint, which makes predictions about time to encode a new goal; and (3) the priming constraint, which makes predictions about the role of cues in (...) retrieving pending goals. These constraints are formulated algebraically and tested through simulation of latency and error data from the Tower of Hanoi, a means‐ends puzzle that depends heavily on suspension and resumption of goals. Implications of the model for understanding intention superiority, postcompletion error, and effects of task interruption are discussed. (shrink)

Why games? How could anyone consider action games an experimental paradigm for Cognitive Science? In 1973, as one of three strategies he proposed for advancing Cognitive Science, Allen Newell exhorted us to “accept a single complex task and do all of it.” More specifically, he told us that rather than taking an “experimental psychology as usual approach,” we should “focus on a series of experimental and theoretical studies around a single complex task” so as to demonstrate that our theories of (...) human cognition were powerful enough to explain “a genuine slab of human behavior” with the studies fitting into a detailed theoretical picture. Action games represent the type of experimental paradigm that Newell was advocating and the current state of programming expertise and laboratory equipment, along with the emergence of Big Data and naturally occurring datasets, provide the technologies and data needed to realize his vision. Action games enable us to escape from our field's regrettable focus on novice performance to develop theories that account for the full range of expertise through a twin focus on expertise sampling and longitudinal studies of simple and complex tasks. (shrink)